[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 12:23:02.182103  9681 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.9.116.126:34075
I20260709 12:23:02.184451  9681 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 12:23:02.185858  9681 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:02.212321  9688 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:02.212455  9690 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:02.212801  9687 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:02.214533  9681 server_base.cc:1061] running on GCE node
I20260709 12:23:03.483466  9681 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:03.483949  9681 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:03.484239  9681 hybrid_clock.cc:648] HybridClock initialized: now 1783599783484207 us; error 0 us; skew 500 ppm
I20260709 12:23:03.485329  9681 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:03.491930  9681 webserver.cc:533] Webserver started at http://127.9.116.126:32915/ using document root <none> and password file <none>
I20260709 12:23:03.493073  9681 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:03.493342  9681 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:03.493882  9681 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:03.500623  9681 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599781984018-9681-0/minicluster-data/master-0-root/instance:
uuid: "d453334205b44948852117ab39cac7b6"
format_stamp: "Formatted at 2026-07-09 12:23:03 on dist-test-slave-zk51"
I20260709 12:23:03.511255  9681 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.010s	sys 0.000s
I20260709 12:23:03.518039  9696 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:03.519991  9681 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:23:03.520485  9681 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599781984018-9681-0/minicluster-data/master-0-root
uuid: "d453334205b44948852117ab39cac7b6"
format_stamp: "Formatted at 2026-07-09 12:23:03 on dist-test-slave-zk51"
I20260709 12:23:03.520839  9681 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599781984018-9681-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599781984018-9681-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599781984018-9681-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:03.581601  9681 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:03.583827  9681 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 12:23:03.584416  9681 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:03.669201  9681 rpc_server.cc:307] RPC server started. Bound to: 127.9.116.126:34075
I20260709 12:23:03.669277  9747 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.116.126:34075 every 8 connection(s)
I20260709 12:23:03.678649  9748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:03.707908  9748 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d453334205b44948852117ab39cac7b6: Bootstrap starting.
I20260709 12:23:03.714051  9748 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d453334205b44948852117ab39cac7b6: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:03.716220  9748 log.cc:826] T 00000000000000000000000000000000 P d453334205b44948852117ab39cac7b6: Log is configured to *not* fsync() on all Append() calls
I20260709 12:23:03.722582  9748 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d453334205b44948852117ab39cac7b6: No bootstrap required, opened a new log
I20260709 12:23:03.748580  9748 raft_consensus.cc:359] T 00000000000000000000000000000000 P d453334205b44948852117ab39cac7b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d453334205b44948852117ab39cac7b6" member_type: VOTER }
I20260709 12:23:03.749209  9748 raft_consensus.cc:385] T 00000000000000000000000000000000 P d453334205b44948852117ab39cac7b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:03.749423  9748 raft_consensus.cc:740] T 00000000000000000000000000000000 P d453334205b44948852117ab39cac7b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d453334205b44948852117ab39cac7b6, State: Initialized, Role: FOLLOWER
I20260709 12:23:03.750504  9748 consensus_queue.cc:260] T 00000000000000000000000000000000 P d453334205b44948852117ab39cac7b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d453334205b44948852117ab39cac7b6" member_type: VOTER }
I20260709 12:23:03.751008  9748 raft_consensus.cc:399] T 00000000000000000000000000000000 P d453334205b44948852117ab39cac7b6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:23:03.751271  9748 raft_consensus.cc:493] T 00000000000000000000000000000000 P d453334205b44948852117ab39cac7b6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:23:03.751600  9748 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d453334205b44948852117ab39cac7b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:03.756578  9748 raft_consensus.cc:515] T 00000000000000000000000000000000 P d453334205b44948852117ab39cac7b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d453334205b44948852117ab39cac7b6" member_type: VOTER }
I20260709 12:23:03.757599  9748 leader_election.cc:304] T 00000000000000000000000000000000 P d453334205b44948852117ab39cac7b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d453334205b44948852117ab39cac7b6; no voters: 
I20260709 12:23:03.759922  9748 leader_election.cc:290] T 00000000000000000000000000000000 P d453334205b44948852117ab39cac7b6 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:23:03.760403  9751 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d453334205b44948852117ab39cac7b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:03.763819  9751 raft_consensus.cc:697] T 00000000000000000000000000000000 P d453334205b44948852117ab39cac7b6 [term 1 LEADER]: Becoming Leader. State: Replica: d453334205b44948852117ab39cac7b6, State: Running, Role: LEADER
I20260709 12:23:03.765347  9751 consensus_queue.cc:237] T 00000000000000000000000000000000 P d453334205b44948852117ab39cac7b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d453334205b44948852117ab39cac7b6" member_type: VOTER }
I20260709 12:23:03.767000  9748 sys_catalog.cc:565] T 00000000000000000000000000000000 P d453334205b44948852117ab39cac7b6 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:23:03.779445  9753 sys_catalog.cc:455] T 00000000000000000000000000000000 P d453334205b44948852117ab39cac7b6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d453334205b44948852117ab39cac7b6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d453334205b44948852117ab39cac7b6" member_type: VOTER } }
I20260709 12:23:03.779896  9752 sys_catalog.cc:455] T 00000000000000000000000000000000 P d453334205b44948852117ab39cac7b6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d453334205b44948852117ab39cac7b6. Latest consensus state: current_term: 1 leader_uuid: "d453334205b44948852117ab39cac7b6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d453334205b44948852117ab39cac7b6" member_type: VOTER } }
I20260709 12:23:03.780965  9753 sys_catalog.cc:458] T 00000000000000000000000000000000 P d453334205b44948852117ab39cac7b6 [sys.catalog]: This master's current role is: LEADER
I20260709 12:23:03.781088  9752 sys_catalog.cc:458] T 00000000000000000000000000000000 P d453334205b44948852117ab39cac7b6 [sys.catalog]: This master's current role is: LEADER
I20260709 12:23:03.785189  9761 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:23:03.800602  9761 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:23:03.802985  9681 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:23:03.823292  9761 catalog_manager.cc:1383] Generated new cluster ID: ec7da12ae8304e9b8a3cdf96a7125e31
I20260709 12:23:03.823675  9761 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:23:03.853936  9761 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:23:03.855895  9761 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:23:03.875680  9761 catalog_manager.cc:6070] T 00000000000000000000000000000000 P d453334205b44948852117ab39cac7b6: Generated new TSK 0
I20260709 12:23:03.877179  9761 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:23:03.935673  9681 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:03.946277  9770 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:03.949415  9771 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:03.952163  9773 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:03.953325  9681 server_base.cc:1061] running on GCE node
I20260709 12:23:03.954311  9681 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:03.954588  9681 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:03.954792  9681 hybrid_clock.cc:648] HybridClock initialized: now 1783599783954769 us; error 0 us; skew 500 ppm
I20260709 12:23:03.955514  9681 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:03.961804  9681 webserver.cc:533] Webserver started at http://127.9.116.65:43523/ using document root <none> and password file <none>
I20260709 12:23:03.962531  9681 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:03.962791  9681 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:03.963133  9681 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:03.964709  9681 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599781984018-9681-0/minicluster-data/ts-0-root/instance:
uuid: "9e380843f48544819091608f98a0c72f"
format_stamp: "Formatted at 2026-07-09 12:23:03 on dist-test-slave-zk51"
I20260709 12:23:03.972214  9681 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.003s	sys 0.005s
I20260709 12:23:03.977409  9778 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:03.978526  9681 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.003s
I20260709 12:23:03.978928  9681 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599781984018-9681-0/minicluster-data/ts-0-root
uuid: "9e380843f48544819091608f98a0c72f"
format_stamp: "Formatted at 2026-07-09 12:23:03 on dist-test-slave-zk51"
I20260709 12:23:03.979367  9681 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599781984018-9681-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599781984018-9681-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599781984018-9681-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:04.006608  9681 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:04.008633  9681 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:04.011561  9681 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:04.017369  9681 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:04.017735  9681 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:04.018090  9681 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:04.018353  9681 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:04.128633  9681 rpc_server.cc:307] RPC server started. Bound to: 127.9.116.65:34569
I20260709 12:23:04.128743  9840 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.116.65:34569 every 8 connection(s)
I20260709 12:23:04.141881  9681 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:04.153254  9845 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:04.154803  9846 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:04.168040  9681 server_base.cc:1061] running on GCE node
W20260709 12:23:04.169966  9848 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:04.171411  9681 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:04.171840  9681 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:04.172075  9681 hybrid_clock.cc:648] HybridClock initialized: now 1783599784172054 us; error 0 us; skew 500 ppm
I20260709 12:23:04.172711  9681 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:04.176383  9681 webserver.cc:533] Webserver started at http://127.9.116.66:45471/ using document root <none> and password file <none>
I20260709 12:23:04.177054  9681 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:04.177312  9681 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:04.177664  9681 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:04.179141  9681 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599781984018-9681-0/minicluster-data/ts-1-root/instance:
uuid: "7381fd84faa0411aa19672822665c0c6"
format_stamp: "Formatted at 2026-07-09 12:23:04 on dist-test-slave-zk51"
I20260709 12:23:04.184949  9841 heartbeater.cc:344] Connected to a master server at 127.9.116.126:34075
I20260709 12:23:04.185624  9841 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:04.187249  9841 heartbeater.cc:507] Master 127.9.116.126:34075 requested a full tablet report, sending...
I20260709 12:23:04.189836  9681 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.005s	sys 0.003s
I20260709 12:23:04.191797  9713 ts_manager.cc:194] Registered new tserver with Master: 9e380843f48544819091608f98a0c72f (127.9.116.65:34569)
I20260709 12:23:04.195268  9713 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40606
I20260709 12:23:04.196715  9853 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:04.198619  9681 fs_manager.cc:730] Time spent opening block manager: real 0.006s	user 0.000s	sys 0.004s
I20260709 12:23:04.199044  9681 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599781984018-9681-0/minicluster-data/ts-1-root
uuid: "7381fd84faa0411aa19672822665c0c6"
format_stamp: "Formatted at 2026-07-09 12:23:04 on dist-test-slave-zk51"
I20260709 12:23:04.199414  9681 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599781984018-9681-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599781984018-9681-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599781984018-9681-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:04.240262  9681 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:04.241921  9681 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:04.243825  9681 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:04.247633  9681 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:04.247896  9681 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:23:04.248194  9681 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:04.248379  9681 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:04.359805  9681 rpc_server.cc:307] RPC server started. Bound to: 127.9.116.66:40415
I20260709 12:23:04.359925  9915 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.116.66:40415 every 8 connection(s)
I20260709 12:23:04.367478  9681 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:04.381608  9919 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:04.382566  9920 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:04.387624  9922 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:04.388207  9681 server_base.cc:1061] running on GCE node
I20260709 12:23:04.389003  9916 heartbeater.cc:344] Connected to a master server at 127.9.116.126:34075
I20260709 12:23:04.389490  9916 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:04.389515  9681 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:04.389870  9681 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:04.390069  9681 hybrid_clock.cc:648] HybridClock initialized: now 1783599784390048 us; error 0 us; skew 500 ppm
I20260709 12:23:04.390475  9916 heartbeater.cc:507] Master 127.9.116.126:34075 requested a full tablet report, sending...
I20260709 12:23:04.390815  9681 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:04.392863  9713 ts_manager.cc:194] Registered new tserver with Master: 7381fd84faa0411aa19672822665c0c6 (127.9.116.66:40415)
I20260709 12:23:04.394218  9681 webserver.cc:533] Webserver started at http://127.9.116.67:33993/ using document root <none> and password file <none>
I20260709 12:23:04.394610  9713 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40616
I20260709 12:23:04.394762  9681 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:04.395243  9681 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:04.395972  9681 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:04.397501  9681 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599781984018-9681-0/minicluster-data/ts-2-root/instance:
uuid: "b1bad12877874d57a97d81468a0879cc"
format_stamp: "Formatted at 2026-07-09 12:23:04 on dist-test-slave-zk51"
I20260709 12:23:04.403496  9681 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.001s
I20260709 12:23:04.407264  9927 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:04.408169  9681 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:23:04.408488  9681 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599781984018-9681-0/minicluster-data/ts-2-root
uuid: "b1bad12877874d57a97d81468a0879cc"
format_stamp: "Formatted at 2026-07-09 12:23:04 on dist-test-slave-zk51"
I20260709 12:23:04.408820  9681 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599781984018-9681-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599781984018-9681-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599781984018-9681-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:04.421039  9681 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:04.422911  9681 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:04.425711  9681 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:04.429006  9681 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:04.429267  9681 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:04.429530  9681 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:04.429718  9681 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:04.535537  9681 rpc_server.cc:307] RPC server started. Bound to: 127.9.116.67:42315
I20260709 12:23:04.536072  9989 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.116.67:42315 every 8 connection(s)
I20260709 12:23:04.556092  9990 heartbeater.cc:344] Connected to a master server at 127.9.116.126:34075
I20260709 12:23:04.556667  9990 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:04.557787  9990 heartbeater.cc:507] Master 127.9.116.126:34075 requested a full tablet report, sending...
I20260709 12:23:04.560513  9713 ts_manager.cc:194] Registered new tserver with Master: b1bad12877874d57a97d81468a0879cc (127.9.116.67:42315)
I20260709 12:23:04.561273  9681 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.020091215s
I20260709 12:23:04.562547  9713 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40618
I20260709 12:23:04.627333  9713 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40624:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:23:04.631253  9713 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:23:04.748442  9881 tablet_service.cc:1511] Processing CreateTablet for tablet 88209028e06042419fced28068c1542b (DEFAULT_TABLE table=test-workload [id=dde25e0f19de4fb998a14c955f8bf295]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:23:04.750131  9876 tablet_service.cc:1511] Processing CreateTablet for tablet 02c174f129bc454a821e33e6427b6548 (DEFAULT_TABLE table=test-workload [id=dde25e0f19de4fb998a14c955f8bf295]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:23:04.751103  9880 tablet_service.cc:1511] Processing CreateTablet for tablet 335ce65e703a4289be64bc4030886524 (DEFAULT_TABLE table=test-workload [id=dde25e0f19de4fb998a14c955f8bf295]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:23:04.759821  9875 tablet_service.cc:1511] Processing CreateTablet for tablet 152402cdfb684f4d9bdbc6828f9160fe (DEFAULT_TABLE table=test-workload [id=dde25e0f19de4fb998a14c955f8bf295]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:23:04.760942  9881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88209028e06042419fced28068c1542b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.751246  9879 tablet_service.cc:1511] Processing CreateTablet for tablet 5e60b7cfdc344a748869fbee80c30cef (DEFAULT_TABLE table=test-workload [id=dde25e0f19de4fb998a14c955f8bf295]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:23:04.761622  9880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 335ce65e703a4289be64bc4030886524. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.752241  9874 tablet_service.cc:1511] Processing CreateTablet for tablet 85f2c8f75bef41a0a04f80205611c054 (DEFAULT_TABLE table=test-workload [id=dde25e0f19de4fb998a14c955f8bf295]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:23:04.763439  9874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85f2c8f75bef41a0a04f80205611c054. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.753835  9878 tablet_service.cc:1511] Processing CreateTablet for tablet 48fcbe3ecfb44941b74325e03a8463e1 (DEFAULT_TABLE table=test-workload [id=dde25e0f19de4fb998a14c955f8bf295]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:23:04.756194  9877 tablet_service.cc:1511] Processing CreateTablet for tablet 2baffcc7e478421295036241364bfcaf (DEFAULT_TABLE table=test-workload [id=dde25e0f19de4fb998a14c955f8bf295]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:23:04.765944  9876 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02c174f129bc454a821e33e6427b6548. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.768033  9878 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48fcbe3ecfb44941b74325e03a8463e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.769747  9879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e60b7cfdc344a748869fbee80c30cef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.778167  9875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 152402cdfb684f4d9bdbc6828f9160fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.785895  9877 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2baffcc7e478421295036241364bfcaf. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:23:04.789184  9760 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:04.802956  9873 tablet_service.cc:1511] Processing CreateTablet for tablet 2eea8dc76b734af3ad92320d2e4dbab2 (DEFAULT_TABLE table=test-workload [id=dde25e0f19de4fb998a14c955f8bf295]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:23:04.805076  9873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2eea8dc76b734af3ad92320d2e4dbab2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.886724  9953 tablet_service.cc:1511] Processing CreateTablet for tablet 5e60b7cfdc344a748869fbee80c30cef (DEFAULT_TABLE table=test-workload [id=dde25e0f19de4fb998a14c955f8bf295]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:23:04.895627  9806 tablet_service.cc:1511] Processing CreateTablet for tablet 88209028e06042419fced28068c1542b (DEFAULT_TABLE table=test-workload [id=dde25e0f19de4fb998a14c955f8bf295]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:23:04.890964  9804 tablet_service.cc:1511] Processing CreateTablet for tablet 5e60b7cfdc344a748869fbee80c30cef (DEFAULT_TABLE table=test-workload [id=dde25e0f19de4fb998a14c955f8bf295]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:23:04.896596  9955 tablet_service.cc:1511] Processing CreateTablet for tablet 88209028e06042419fced28068c1542b (DEFAULT_TABLE table=test-workload [id=dde25e0f19de4fb998a14c955f8bf295]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:23:04.903681  9952 tablet_service.cc:1511] Processing CreateTablet for tablet 48fcbe3ecfb44941b74325e03a8463e1 (DEFAULT_TABLE table=test-workload [id=dde25e0f19de4fb998a14c955f8bf295]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:23:04.890477  9805 tablet_service.cc:1511] Processing CreateTablet for tablet 335ce65e703a4289be64bc4030886524 (DEFAULT_TABLE table=test-workload [id=dde25e0f19de4fb998a14c955f8bf295]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:23:04.895727  9954 tablet_service.cc:1511] Processing CreateTablet for tablet 335ce65e703a4289be64bc4030886524 (DEFAULT_TABLE table=test-workload [id=dde25e0f19de4fb998a14c955f8bf295]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:23:04.906380  9950 tablet_service.cc:1511] Processing CreateTablet for tablet 02c174f129bc454a821e33e6427b6548 (DEFAULT_TABLE table=test-workload [id=dde25e0f19de4fb998a14c955f8bf295]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:23:04.914773  9803 tablet_service.cc:1511] Processing CreateTablet for tablet 48fcbe3ecfb44941b74325e03a8463e1 (DEFAULT_TABLE table=test-workload [id=dde25e0f19de4fb998a14c955f8bf295]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:23:04.917470  9949 tablet_service.cc:1511] Processing CreateTablet for tablet 152402cdfb684f4d9bdbc6828f9160fe (DEFAULT_TABLE table=test-workload [id=dde25e0f19de4fb998a14c955f8bf295]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:23:04.922477 10007 tablet_bootstrap.cc:492] T 335ce65e703a4289be64bc4030886524 P 7381fd84faa0411aa19672822665c0c6: Bootstrap starting.
I20260709 12:23:04.922075  9953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e60b7cfdc344a748869fbee80c30cef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.917419  9801 tablet_service.cc:1511] Processing CreateTablet for tablet 02c174f129bc454a821e33e6427b6548 (DEFAULT_TABLE table=test-workload [id=dde25e0f19de4fb998a14c955f8bf295]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:23:04.921020  9800 tablet_service.cc:1511] Processing CreateTablet for tablet 152402cdfb684f4d9bdbc6828f9160fe (DEFAULT_TABLE table=test-workload [id=dde25e0f19de4fb998a14c955f8bf295]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:23:04.928582  9806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88209028e06042419fced28068c1542b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.928128  9951 tablet_service.cc:1511] Processing CreateTablet for tablet 2baffcc7e478421295036241364bfcaf (DEFAULT_TABLE table=test-workload [id=dde25e0f19de4fb998a14c955f8bf295]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:23:04.931842  9947 tablet_service.cc:1511] Processing CreateTablet for tablet 2eea8dc76b734af3ad92320d2e4dbab2 (DEFAULT_TABLE table=test-workload [id=dde25e0f19de4fb998a14c955f8bf295]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:23:04.919605  9799 tablet_service.cc:1511] Processing CreateTablet for tablet 85f2c8f75bef41a0a04f80205611c054 (DEFAULT_TABLE table=test-workload [id=dde25e0f19de4fb998a14c955f8bf295]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:23:04.931119  9802 tablet_service.cc:1511] Processing CreateTablet for tablet 2baffcc7e478421295036241364bfcaf (DEFAULT_TABLE table=test-workload [id=dde25e0f19de4fb998a14c955f8bf295]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:23:04.931890  9948 tablet_service.cc:1511] Processing CreateTablet for tablet 85f2c8f75bef41a0a04f80205611c054 (DEFAULT_TABLE table=test-workload [id=dde25e0f19de4fb998a14c955f8bf295]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:23:04.930115  9798 tablet_service.cc:1511] Processing CreateTablet for tablet 2eea8dc76b734af3ad92320d2e4dbab2 (DEFAULT_TABLE table=test-workload [id=dde25e0f19de4fb998a14c955f8bf295]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:23:04.938256  9805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 335ce65e703a4289be64bc4030886524. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.948086  9804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e60b7cfdc344a748869fbee80c30cef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.954180  9952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48fcbe3ecfb44941b74325e03a8463e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.955681  9949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 152402cdfb684f4d9bdbc6828f9160fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.957947  9951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2baffcc7e478421295036241364bfcaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.959301  9948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85f2c8f75bef41a0a04f80205611c054. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.962164  9800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 152402cdfb684f4d9bdbc6828f9160fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.962839  9950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02c174f129bc454a821e33e6427b6548. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.965498  9799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85f2c8f75bef41a0a04f80205611c054. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.970146  9954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 335ce65e703a4289be64bc4030886524. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.971901  9955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88209028e06042419fced28068c1542b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.972070  9803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48fcbe3ecfb44941b74325e03a8463e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.974212  9947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2eea8dc76b734af3ad92320d2e4dbab2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.984956  9798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2eea8dc76b734af3ad92320d2e4dbab2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:04.993630  9801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02c174f129bc454a821e33e6427b6548. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:05.007969  9802 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2baffcc7e478421295036241364bfcaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:05.066015 10007 tablet_bootstrap.cc:654] T 335ce65e703a4289be64bc4030886524 P 7381fd84faa0411aa19672822665c0c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:05.086676 10008 tablet_bootstrap.cc:492] T 5e60b7cfdc344a748869fbee80c30cef P b1bad12877874d57a97d81468a0879cc: Bootstrap starting.
I20260709 12:23:05.109860 10008 tablet_bootstrap.cc:654] T 5e60b7cfdc344a748869fbee80c30cef P b1bad12877874d57a97d81468a0879cc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:05.121088 10007 tablet_bootstrap.cc:492] T 335ce65e703a4289be64bc4030886524 P 7381fd84faa0411aa19672822665c0c6: No bootstrap required, opened a new log
I20260709 12:23:05.121743 10007 ts_tablet_manager.cc:1403] T 335ce65e703a4289be64bc4030886524 P 7381fd84faa0411aa19672822665c0c6: Time spent bootstrapping tablet: real 0.221s	user 0.025s	sys 0.006s
I20260709 12:23:05.129248 10007 raft_consensus.cc:359] T 335ce65e703a4289be64bc4030886524 P 7381fd84faa0411aa19672822665c0c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:05.130388 10007 raft_consensus.cc:385] T 335ce65e703a4289be64bc4030886524 P 7381fd84faa0411aa19672822665c0c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:05.130707 10007 raft_consensus.cc:740] T 335ce65e703a4289be64bc4030886524 P 7381fd84faa0411aa19672822665c0c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7381fd84faa0411aa19672822665c0c6, State: Initialized, Role: FOLLOWER
I20260709 12:23:05.142194 10010 tablet_bootstrap.cc:492] T 88209028e06042419fced28068c1542b P 9e380843f48544819091608f98a0c72f: Bootstrap starting.
I20260709 12:23:05.145547 10007 consensus_queue.cc:260] T 335ce65e703a4289be64bc4030886524 P 7381fd84faa0411aa19672822665c0c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:05.151104 10008 tablet_bootstrap.cc:492] T 5e60b7cfdc344a748869fbee80c30cef P b1bad12877874d57a97d81468a0879cc: No bootstrap required, opened a new log
I20260709 12:23:05.155730 10008 ts_tablet_manager.cc:1403] T 5e60b7cfdc344a748869fbee80c30cef P b1bad12877874d57a97d81468a0879cc: Time spent bootstrapping tablet: real 0.097s	user 0.014s	sys 0.017s
I20260709 12:23:05.160130 10007 ts_tablet_manager.cc:1434] T 335ce65e703a4289be64bc4030886524 P 7381fd84faa0411aa19672822665c0c6: Time spent starting tablet: real 0.038s	user 0.010s	sys 0.008s
I20260709 12:23:05.161413  9916 heartbeater.cc:499] Master 127.9.116.126:34075 was elected leader, sending a full tablet report...
I20260709 12:23:05.161713 10007 tablet_bootstrap.cc:492] T 02c174f129bc454a821e33e6427b6548 P 7381fd84faa0411aa19672822665c0c6: Bootstrap starting.
I20260709 12:23:05.160298 10008 raft_consensus.cc:359] T 5e60b7cfdc344a748869fbee80c30cef P b1bad12877874d57a97d81468a0879cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:05.166085 10008 raft_consensus.cc:385] T 5e60b7cfdc344a748869fbee80c30cef P b1bad12877874d57a97d81468a0879cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:05.166435 10008 raft_consensus.cc:740] T 5e60b7cfdc344a748869fbee80c30cef P b1bad12877874d57a97d81468a0879cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1bad12877874d57a97d81468a0879cc, State: Initialized, Role: FOLLOWER
I20260709 12:23:05.167364 10008 consensus_queue.cc:260] T 5e60b7cfdc344a748869fbee80c30cef P b1bad12877874d57a97d81468a0879cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:05.177170 10008 ts_tablet_manager.cc:1434] T 5e60b7cfdc344a748869fbee80c30cef P b1bad12877874d57a97d81468a0879cc: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.003s
I20260709 12:23:05.177990 10008 tablet_bootstrap.cc:492] T 2eea8dc76b734af3ad92320d2e4dbab2 P b1bad12877874d57a97d81468a0879cc: Bootstrap starting.
I20260709 12:23:05.179939  9990 heartbeater.cc:499] Master 127.9.116.126:34075 was elected leader, sending a full tablet report...
I20260709 12:23:05.184821 10008 tablet_bootstrap.cc:654] T 2eea8dc76b734af3ad92320d2e4dbab2 P b1bad12877874d57a97d81468a0879cc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:05.184821 10007 tablet_bootstrap.cc:654] T 02c174f129bc454a821e33e6427b6548 P 7381fd84faa0411aa19672822665c0c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:05.189718 10010 tablet_bootstrap.cc:654] T 88209028e06042419fced28068c1542b P 9e380843f48544819091608f98a0c72f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:05.200407  9841 heartbeater.cc:499] Master 127.9.116.126:34075 was elected leader, sending a full tablet report...
I20260709 12:23:05.228935 10010 tablet_bootstrap.cc:492] T 88209028e06042419fced28068c1542b P 9e380843f48544819091608f98a0c72f: No bootstrap required, opened a new log
I20260709 12:23:05.229588 10010 ts_tablet_manager.cc:1403] T 88209028e06042419fced28068c1542b P 9e380843f48544819091608f98a0c72f: Time spent bootstrapping tablet: real 0.106s	user 0.020s	sys 0.024s
I20260709 12:23:05.229892 10007 tablet_bootstrap.cc:492] T 02c174f129bc454a821e33e6427b6548 P 7381fd84faa0411aa19672822665c0c6: No bootstrap required, opened a new log
I20260709 12:23:05.230423 10007 ts_tablet_manager.cc:1403] T 02c174f129bc454a821e33e6427b6548 P 7381fd84faa0411aa19672822665c0c6: Time spent bootstrapping tablet: real 0.069s	user 0.016s	sys 0.011s
I20260709 12:23:05.233641 10008 tablet_bootstrap.cc:492] T 2eea8dc76b734af3ad92320d2e4dbab2 P b1bad12877874d57a97d81468a0879cc: No bootstrap required, opened a new log
I20260709 12:23:05.236189 10008 ts_tablet_manager.cc:1403] T 2eea8dc76b734af3ad92320d2e4dbab2 P b1bad12877874d57a97d81468a0879cc: Time spent bootstrapping tablet: real 0.058s	user 0.006s	sys 0.024s
I20260709 12:23:05.239696 10008 raft_consensus.cc:359] T 2eea8dc76b734af3ad92320d2e4dbab2 P b1bad12877874d57a97d81468a0879cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:05.240454 10008 raft_consensus.cc:385] T 2eea8dc76b734af3ad92320d2e4dbab2 P b1bad12877874d57a97d81468a0879cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:05.240795 10008 raft_consensus.cc:740] T 2eea8dc76b734af3ad92320d2e4dbab2 P b1bad12877874d57a97d81468a0879cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1bad12877874d57a97d81468a0879cc, State: Initialized, Role: FOLLOWER
I20260709 12:23:05.241801 10008 consensus_queue.cc:260] T 2eea8dc76b734af3ad92320d2e4dbab2 P b1bad12877874d57a97d81468a0879cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:05.233421 10010 raft_consensus.cc:359] T 88209028e06042419fced28068c1542b P 9e380843f48544819091608f98a0c72f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:05.243163 10010 raft_consensus.cc:385] T 88209028e06042419fced28068c1542b P 9e380843f48544819091608f98a0c72f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:05.233871 10007 raft_consensus.cc:359] T 02c174f129bc454a821e33e6427b6548 P 7381fd84faa0411aa19672822665c0c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:05.243525 10010 raft_consensus.cc:740] T 88209028e06042419fced28068c1542b P 9e380843f48544819091608f98a0c72f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e380843f48544819091608f98a0c72f, State: Initialized, Role: FOLLOWER
I20260709 12:23:05.244395 10010 consensus_queue.cc:260] T 88209028e06042419fced28068c1542b P 9e380843f48544819091608f98a0c72f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:05.243709 10007 raft_consensus.cc:385] T 02c174f129bc454a821e33e6427b6548 P 7381fd84faa0411aa19672822665c0c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:05.245469 10007 raft_consensus.cc:740] T 02c174f129bc454a821e33e6427b6548 P 7381fd84faa0411aa19672822665c0c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7381fd84faa0411aa19672822665c0c6, State: Initialized, Role: FOLLOWER
I20260709 12:23:05.246549 10007 consensus_queue.cc:260] T 02c174f129bc454a821e33e6427b6548 P 7381fd84faa0411aa19672822665c0c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:05.254268 10007 ts_tablet_manager.cc:1434] T 02c174f129bc454a821e33e6427b6548 P 7381fd84faa0411aa19672822665c0c6: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.000s
I20260709 12:23:05.255227 10007 tablet_bootstrap.cc:492] T 2eea8dc76b734af3ad92320d2e4dbab2 P 7381fd84faa0411aa19672822665c0c6: Bootstrap starting.
I20260709 12:23:05.262349 10007 tablet_bootstrap.cc:654] T 2eea8dc76b734af3ad92320d2e4dbab2 P 7381fd84faa0411aa19672822665c0c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:05.250581 10008 ts_tablet_manager.cc:1434] T 2eea8dc76b734af3ad92320d2e4dbab2 P b1bad12877874d57a97d81468a0879cc: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.002s
I20260709 12:23:05.252105 10010 ts_tablet_manager.cc:1434] T 88209028e06042419fced28068c1542b P 9e380843f48544819091608f98a0c72f: Time spent starting tablet: real 0.022s	user 0.010s	sys 0.003s
I20260709 12:23:05.264518 10010 tablet_bootstrap.cc:492] T 85f2c8f75bef41a0a04f80205611c054 P 9e380843f48544819091608f98a0c72f: Bootstrap starting.
I20260709 12:23:05.269644 10008 tablet_bootstrap.cc:492] T 02c174f129bc454a821e33e6427b6548 P b1bad12877874d57a97d81468a0879cc: Bootstrap starting.
I20260709 12:23:05.278122 10010 tablet_bootstrap.cc:654] T 85f2c8f75bef41a0a04f80205611c054 P 9e380843f48544819091608f98a0c72f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:05.279019 10008 tablet_bootstrap.cc:654] T 02c174f129bc454a821e33e6427b6548 P b1bad12877874d57a97d81468a0879cc: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:05.293854  9991 tablet.cc:2406] T 2eea8dc76b734af3ad92320d2e4dbab2 P b1bad12877874d57a97d81468a0879cc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:23:05.295987 10007 tablet_bootstrap.cc:492] T 2eea8dc76b734af3ad92320d2e4dbab2 P 7381fd84faa0411aa19672822665c0c6: No bootstrap required, opened a new log
I20260709 12:23:05.296552 10007 ts_tablet_manager.cc:1403] T 2eea8dc76b734af3ad92320d2e4dbab2 P 7381fd84faa0411aa19672822665c0c6: Time spent bootstrapping tablet: real 0.042s	user 0.017s	sys 0.007s
I20260709 12:23:05.297736 10010 tablet_bootstrap.cc:492] T 85f2c8f75bef41a0a04f80205611c054 P 9e380843f48544819091608f98a0c72f: No bootstrap required, opened a new log
I20260709 12:23:05.298249 10010 ts_tablet_manager.cc:1403] T 85f2c8f75bef41a0a04f80205611c054 P 9e380843f48544819091608f98a0c72f: Time spent bootstrapping tablet: real 0.034s	user 0.014s	sys 0.008s
I20260709 12:23:05.298851 10008 tablet_bootstrap.cc:492] T 02c174f129bc454a821e33e6427b6548 P b1bad12877874d57a97d81468a0879cc: No bootstrap required, opened a new log
I20260709 12:23:05.299695 10008 ts_tablet_manager.cc:1403] T 02c174f129bc454a821e33e6427b6548 P b1bad12877874d57a97d81468a0879cc: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.014s
I20260709 12:23:05.299916 10007 raft_consensus.cc:359] T 2eea8dc76b734af3ad92320d2e4dbab2 P 7381fd84faa0411aa19672822665c0c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:05.300761 10007 raft_consensus.cc:385] T 2eea8dc76b734af3ad92320d2e4dbab2 P 7381fd84faa0411aa19672822665c0c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:05.301100 10007 raft_consensus.cc:740] T 2eea8dc76b734af3ad92320d2e4dbab2 P 7381fd84faa0411aa19672822665c0c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7381fd84faa0411aa19672822665c0c6, State: Initialized, Role: FOLLOWER
I20260709 12:23:05.301326 10010 raft_consensus.cc:359] T 85f2c8f75bef41a0a04f80205611c054 P 9e380843f48544819091608f98a0c72f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:05.302199 10010 raft_consensus.cc:385] T 85f2c8f75bef41a0a04f80205611c054 P 9e380843f48544819091608f98a0c72f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:05.301959 10007 consensus_queue.cc:260] T 2eea8dc76b734af3ad92320d2e4dbab2 P 7381fd84faa0411aa19672822665c0c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:05.302526 10010 raft_consensus.cc:740] T 85f2c8f75bef41a0a04f80205611c054 P 9e380843f48544819091608f98a0c72f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e380843f48544819091608f98a0c72f, State: Initialized, Role: FOLLOWER
I20260709 12:23:05.303534 10008 raft_consensus.cc:359] T 02c174f129bc454a821e33e6427b6548 P b1bad12877874d57a97d81468a0879cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:05.304347 10008 raft_consensus.cc:385] T 02c174f129bc454a821e33e6427b6548 P b1bad12877874d57a97d81468a0879cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:05.304643 10008 raft_consensus.cc:740] T 02c174f129bc454a821e33e6427b6548 P b1bad12877874d57a97d81468a0879cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1bad12877874d57a97d81468a0879cc, State: Initialized, Role: FOLLOWER
I20260709 12:23:05.305084 10007 ts_tablet_manager.cc:1434] T 2eea8dc76b734af3ad92320d2e4dbab2 P 7381fd84faa0411aa19672822665c0c6: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:23:05.305377 10008 consensus_queue.cc:260] T 02c174f129bc454a821e33e6427b6548 P b1bad12877874d57a97d81468a0879cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:05.306025 10007 tablet_bootstrap.cc:492] T 85f2c8f75bef41a0a04f80205611c054 P 7381fd84faa0411aa19672822665c0c6: Bootstrap starting.
I20260709 12:23:05.307864 10008 ts_tablet_manager.cc:1434] T 02c174f129bc454a821e33e6427b6548 P b1bad12877874d57a97d81468a0879cc: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.005s
I20260709 12:23:05.309082 10008 tablet_bootstrap.cc:492] T 335ce65e703a4289be64bc4030886524 P b1bad12877874d57a97d81468a0879cc: Bootstrap starting.
I20260709 12:23:05.313660 10007 tablet_bootstrap.cc:654] T 85f2c8f75bef41a0a04f80205611c054 P 7381fd84faa0411aa19672822665c0c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:05.315647 10008 tablet_bootstrap.cc:654] T 335ce65e703a4289be64bc4030886524 P b1bad12877874d57a97d81468a0879cc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:05.327281 10007 tablet_bootstrap.cc:492] T 85f2c8f75bef41a0a04f80205611c054 P 7381fd84faa0411aa19672822665c0c6: No bootstrap required, opened a new log
I20260709 12:23:05.328004 10007 ts_tablet_manager.cc:1403] T 85f2c8f75bef41a0a04f80205611c054 P 7381fd84faa0411aa19672822665c0c6: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.006s
I20260709 12:23:05.328135 10008 tablet_bootstrap.cc:492] T 335ce65e703a4289be64bc4030886524 P b1bad12877874d57a97d81468a0879cc: No bootstrap required, opened a new log
I20260709 12:23:05.328709 10008 ts_tablet_manager.cc:1403] T 335ce65e703a4289be64bc4030886524 P b1bad12877874d57a97d81468a0879cc: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.005s
I20260709 12:23:05.328711 10010 consensus_queue.cc:260] T 85f2c8f75bef41a0a04f80205611c054 P 9e380843f48544819091608f98a0c72f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:05.331982 10008 raft_consensus.cc:359] T 335ce65e703a4289be64bc4030886524 P b1bad12877874d57a97d81468a0879cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:05.332758 10008 raft_consensus.cc:385] T 335ce65e703a4289be64bc4030886524 P b1bad12877874d57a97d81468a0879cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:05.332800 10010 ts_tablet_manager.cc:1434] T 85f2c8f75bef41a0a04f80205611c054 P 9e380843f48544819091608f98a0c72f: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.002s
I20260709 12:23:05.332517 10007 raft_consensus.cc:359] T 85f2c8f75bef41a0a04f80205611c054 P 7381fd84faa0411aa19672822665c0c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:05.333209 10008 raft_consensus.cc:740] T 335ce65e703a4289be64bc4030886524 P b1bad12877874d57a97d81468a0879cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1bad12877874d57a97d81468a0879cc, State: Initialized, Role: FOLLOWER
I20260709 12:23:05.333568 10007 raft_consensus.cc:385] T 85f2c8f75bef41a0a04f80205611c054 P 7381fd84faa0411aa19672822665c0c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:05.333905 10007 raft_consensus.cc:740] T 85f2c8f75bef41a0a04f80205611c054 P 7381fd84faa0411aa19672822665c0c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7381fd84faa0411aa19672822665c0c6, State: Initialized, Role: FOLLOWER
I20260709 12:23:05.334239 10010 tablet_bootstrap.cc:492] T 152402cdfb684f4d9bdbc6828f9160fe P 9e380843f48544819091608f98a0c72f: Bootstrap starting.
I20260709 12:23:05.334156 10008 consensus_queue.cc:260] T 335ce65e703a4289be64bc4030886524 P b1bad12877874d57a97d81468a0879cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:05.334679 10007 consensus_queue.cc:260] T 85f2c8f75bef41a0a04f80205611c054 P 7381fd84faa0411aa19672822665c0c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:05.337422 10007 ts_tablet_manager.cc:1434] T 85f2c8f75bef41a0a04f80205611c054 P 7381fd84faa0411aa19672822665c0c6: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 12:23:05.337656 10008 ts_tablet_manager.cc:1434] T 335ce65e703a4289be64bc4030886524 P b1bad12877874d57a97d81468a0879cc: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:23:05.338516 10007 tablet_bootstrap.cc:492] T 88209028e06042419fced28068c1542b P 7381fd84faa0411aa19672822665c0c6: Bootstrap starting.
I20260709 12:23:05.338817 10008 tablet_bootstrap.cc:492] T 48fcbe3ecfb44941b74325e03a8463e1 P b1bad12877874d57a97d81468a0879cc: Bootstrap starting.
I20260709 12:23:05.349938 10013 raft_consensus.cc:493] T 2eea8dc76b734af3ad92320d2e4dbab2 P b1bad12877874d57a97d81468a0879cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.350585 10013 raft_consensus.cc:515] T 2eea8dc76b734af3ad92320d2e4dbab2 P b1bad12877874d57a97d81468a0879cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:05.351871 10010 tablet_bootstrap.cc:654] T 152402cdfb684f4d9bdbc6828f9160fe P 9e380843f48544819091608f98a0c72f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:05.353696 10012 raft_consensus.cc:493] T 335ce65e703a4289be64bc4030886524 P 7381fd84faa0411aa19672822665c0c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.354360 10012 raft_consensus.cc:515] T 335ce65e703a4289be64bc4030886524 P 7381fd84faa0411aa19672822665c0c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:05.356056 10008 tablet_bootstrap.cc:654] T 48fcbe3ecfb44941b74325e03a8463e1 P b1bad12877874d57a97d81468a0879cc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:05.361660 10012 leader_election.cc:290] T 335ce65e703a4289be64bc4030886524 P 7381fd84faa0411aa19672822665c0c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e380843f48544819091608f98a0c72f (127.9.116.65:34569), b1bad12877874d57a97d81468a0879cc (127.9.116.67:42315)
I20260709 12:23:05.359283 10013 leader_election.cc:290] T 2eea8dc76b734af3ad92320d2e4dbab2 P b1bad12877874d57a97d81468a0879cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e380843f48544819091608f98a0c72f (127.9.116.65:34569), 7381fd84faa0411aa19672822665c0c6 (127.9.116.66:40415)
I20260709 12:23:05.382774 10007 tablet_bootstrap.cc:654] T 88209028e06042419fced28068c1542b P 7381fd84faa0411aa19672822665c0c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:05.394165 10013 raft_consensus.cc:493] T 335ce65e703a4289be64bc4030886524 P b1bad12877874d57a97d81468a0879cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.394871 10013 raft_consensus.cc:515] T 335ce65e703a4289be64bc4030886524 P b1bad12877874d57a97d81468a0879cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:05.412595 10013 leader_election.cc:290] T 335ce65e703a4289be64bc4030886524 P b1bad12877874d57a97d81468a0879cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e380843f48544819091608f98a0c72f (127.9.116.65:34569), 7381fd84faa0411aa19672822665c0c6 (127.9.116.66:40415)
I20260709 12:23:05.433207 10017 raft_consensus.cc:493] T 88209028e06042419fced28068c1542b P 9e380843f48544819091608f98a0c72f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.433753 10017 raft_consensus.cc:515] T 88209028e06042419fced28068c1542b P 9e380843f48544819091608f98a0c72f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:05.434646 10010 tablet_bootstrap.cc:492] T 152402cdfb684f4d9bdbc6828f9160fe P 9e380843f48544819091608f98a0c72f: No bootstrap required, opened a new log
I20260709 12:23:05.435153 10010 ts_tablet_manager.cc:1403] T 152402cdfb684f4d9bdbc6828f9160fe P 9e380843f48544819091608f98a0c72f: Time spent bootstrapping tablet: real 0.101s	user 0.012s	sys 0.014s
I20260709 12:23:05.436697 10017 leader_election.cc:290] T 88209028e06042419fced28068c1542b P 9e380843f48544819091608f98a0c72f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7381fd84faa0411aa19672822665c0c6 (127.9.116.66:40415), b1bad12877874d57a97d81468a0879cc (127.9.116.67:42315)
I20260709 12:23:05.450110 10007 tablet_bootstrap.cc:492] T 88209028e06042419fced28068c1542b P 7381fd84faa0411aa19672822665c0c6: No bootstrap required, opened a new log
I20260709 12:23:05.460282 10007 ts_tablet_manager.cc:1403] T 88209028e06042419fced28068c1542b P 7381fd84faa0411aa19672822665c0c6: Time spent bootstrapping tablet: real 0.122s	user 0.017s	sys 0.014s
I20260709 12:23:05.467121 10008 tablet_bootstrap.cc:492] T 48fcbe3ecfb44941b74325e03a8463e1 P b1bad12877874d57a97d81468a0879cc: No bootstrap required, opened a new log
I20260709 12:23:05.467985 10008 ts_tablet_manager.cc:1403] T 48fcbe3ecfb44941b74325e03a8463e1 P b1bad12877874d57a97d81468a0879cc: Time spent bootstrapping tablet: real 0.129s	user 0.014s	sys 0.019s
I20260709 12:23:05.468801 10007 raft_consensus.cc:359] T 88209028e06042419fced28068c1542b P 7381fd84faa0411aa19672822665c0c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:05.476567 10007 raft_consensus.cc:385] T 88209028e06042419fced28068c1542b P 7381fd84faa0411aa19672822665c0c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:05.477059 10007 raft_consensus.cc:740] T 88209028e06042419fced28068c1542b P 7381fd84faa0411aa19672822665c0c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7381fd84faa0411aa19672822665c0c6, State: Initialized, Role: FOLLOWER
I20260709 12:23:05.477854 10007 consensus_queue.cc:260] T 88209028e06042419fced28068c1542b P 7381fd84faa0411aa19672822665c0c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:05.479097 10008 raft_consensus.cc:359] T 48fcbe3ecfb44941b74325e03a8463e1 P b1bad12877874d57a97d81468a0879cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:05.480397 10008 raft_consensus.cc:385] T 48fcbe3ecfb44941b74325e03a8463e1 P b1bad12877874d57a97d81468a0879cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:05.480636 10007 ts_tablet_manager.cc:1434] T 88209028e06042419fced28068c1542b P 7381fd84faa0411aa19672822665c0c6: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 12:23:05.483022 10007 tablet_bootstrap.cc:492] T 152402cdfb684f4d9bdbc6828f9160fe P 7381fd84faa0411aa19672822665c0c6: Bootstrap starting.
I20260709 12:23:05.480716 10008 raft_consensus.cc:740] T 48fcbe3ecfb44941b74325e03a8463e1 P b1bad12877874d57a97d81468a0879cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1bad12877874d57a97d81468a0879cc, State: Initialized, Role: FOLLOWER
I20260709 12:23:05.467612 10010 raft_consensus.cc:359] T 152402cdfb684f4d9bdbc6828f9160fe P 9e380843f48544819091608f98a0c72f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:05.487936 10010 raft_consensus.cc:385] T 152402cdfb684f4d9bdbc6828f9160fe P 9e380843f48544819091608f98a0c72f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:05.488456 10010 raft_consensus.cc:740] T 152402cdfb684f4d9bdbc6828f9160fe P 9e380843f48544819091608f98a0c72f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e380843f48544819091608f98a0c72f, State: Initialized, Role: FOLLOWER
I20260709 12:23:05.489724 10008 consensus_queue.cc:260] T 48fcbe3ecfb44941b74325e03a8463e1 P b1bad12877874d57a97d81468a0879cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:05.491807 10010 consensus_queue.cc:260] T 152402cdfb684f4d9bdbc6828f9160fe P 9e380843f48544819091608f98a0c72f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:05.508963  9816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eea8dc76b734af3ad92320d2e4dbab2" candidate_uuid: "b1bad12877874d57a97d81468a0879cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e380843f48544819091608f98a0c72f" is_pre_election: true
I20260709 12:23:05.511794 10010 ts_tablet_manager.cc:1434] T 152402cdfb684f4d9bdbc6828f9160fe P 9e380843f48544819091608f98a0c72f: Time spent starting tablet: real 0.076s	user 0.011s	sys 0.002s
I20260709 12:23:05.513794 10013 raft_consensus.cc:493] T 5e60b7cfdc344a748869fbee80c30cef P b1bad12877874d57a97d81468a0879cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.514446 10013 raft_consensus.cc:515] T 5e60b7cfdc344a748869fbee80c30cef P b1bad12877874d57a97d81468a0879cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:05.516619 10010 tablet_bootstrap.cc:492] T 5e60b7cfdc344a748869fbee80c30cef P 9e380843f48544819091608f98a0c72f: Bootstrap starting.
W20260709 12:23:05.516930  9928 leader_election.cc:343] T 2eea8dc76b734af3ad92320d2e4dbab2 P b1bad12877874d57a97d81468a0879cc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e380843f48544819091608f98a0c72f (127.9.116.65:34569): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:05.518924 10013 leader_election.cc:290] T 5e60b7cfdc344a748869fbee80c30cef P b1bad12877874d57a97d81468a0879cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e380843f48544819091608f98a0c72f (127.9.116.65:34569), 7381fd84faa0411aa19672822665c0c6 (127.9.116.66:40415)
I20260709 12:23:05.519476  9816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "335ce65e703a4289be64bc4030886524" candidate_uuid: "b1bad12877874d57a97d81468a0879cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e380843f48544819091608f98a0c72f" is_pre_election: true
I20260709 12:23:05.516427 10008 ts_tablet_manager.cc:1434] T 48fcbe3ecfb44941b74325e03a8463e1 P b1bad12877874d57a97d81468a0879cc: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.003s
W20260709 12:23:05.529353  9928 leader_election.cc:343] T 335ce65e703a4289be64bc4030886524 P b1bad12877874d57a97d81468a0879cc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e380843f48544819091608f98a0c72f (127.9.116.65:34569): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:05.529632 10008 tablet_bootstrap.cc:492] T 2baffcc7e478421295036241364bfcaf P b1bad12877874d57a97d81468a0879cc: Bootstrap starting.
I20260709 12:23:05.528936  9816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b7cfdc344a748869fbee80c30cef" candidate_uuid: "b1bad12877874d57a97d81468a0879cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e380843f48544819091608f98a0c72f" is_pre_election: true
I20260709 12:23:05.534884  9891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eea8dc76b734af3ad92320d2e4dbab2" candidate_uuid: "b1bad12877874d57a97d81468a0879cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7381fd84faa0411aa19672822665c0c6" is_pre_election: true
I20260709 12:23:05.539086  9891 raft_consensus.cc:2468] T 2eea8dc76b734af3ad92320d2e4dbab2 P 7381fd84faa0411aa19672822665c0c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1bad12877874d57a97d81468a0879cc in term 0.
I20260709 12:23:05.541859  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b7cfdc344a748869fbee80c30cef" candidate_uuid: "b1bad12877874d57a97d81468a0879cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7381fd84faa0411aa19672822665c0c6" is_pre_election: true
I20260709 12:23:05.541333 10007 tablet_bootstrap.cc:654] T 152402cdfb684f4d9bdbc6828f9160fe P 7381fd84faa0411aa19672822665c0c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:05.550669  9931 leader_election.cc:304] T 2eea8dc76b734af3ad92320d2e4dbab2 P b1bad12877874d57a97d81468a0879cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7381fd84faa0411aa19672822665c0c6, b1bad12877874d57a97d81468a0879cc; no voters: 9e380843f48544819091608f98a0c72f
I20260709 12:23:05.541846  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "335ce65e703a4289be64bc4030886524" candidate_uuid: "b1bad12877874d57a97d81468a0879cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7381fd84faa0411aa19672822665c0c6" is_pre_election: true
I20260709 12:23:05.554313 10013 raft_consensus.cc:2804] T 2eea8dc76b734af3ad92320d2e4dbab2 P b1bad12877874d57a97d81468a0879cc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:05.556063 10013 raft_consensus.cc:493] T 2eea8dc76b734af3ad92320d2e4dbab2 P b1bad12877874d57a97d81468a0879cc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:05.548879  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88209028e06042419fced28068c1542b" candidate_uuid: "9e380843f48544819091608f98a0c72f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7381fd84faa0411aa19672822665c0c6" is_pre_election: true
W20260709 12:23:05.549700  9928 leader_election.cc:343] T 5e60b7cfdc344a748869fbee80c30cef P b1bad12877874d57a97d81468a0879cc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e380843f48544819091608f98a0c72f (127.9.116.65:34569): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:05.557346  9889 raft_consensus.cc:2468] T 88209028e06042419fced28068c1542b P 7381fd84faa0411aa19672822665c0c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e380843f48544819091608f98a0c72f in term 0.
I20260709 12:23:05.556463 10013 raft_consensus.cc:3060] T 2eea8dc76b734af3ad92320d2e4dbab2 P b1bad12877874d57a97d81468a0879cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:05.556217  9890 raft_consensus.cc:2468] T 335ce65e703a4289be64bc4030886524 P 7381fd84faa0411aa19672822665c0c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1bad12877874d57a97d81468a0879cc in term 0.
W20260709 12:23:05.558014  9931 leader_election.cc:343] T 5e60b7cfdc344a748869fbee80c30cef P b1bad12877874d57a97d81468a0879cc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7381fd84faa0411aa19672822665c0c6 (127.9.116.66:40415): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:05.563650  9782 leader_election.cc:304] T 88209028e06042419fced28068c1542b P 9e380843f48544819091608f98a0c72f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7381fd84faa0411aa19672822665c0c6, 9e380843f48544819091608f98a0c72f; no voters: 
I20260709 12:23:05.566864 10017 raft_consensus.cc:2804] T 88209028e06042419fced28068c1542b P 9e380843f48544819091608f98a0c72f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:05.566756  9931 leader_election.cc:304] T 5e60b7cfdc344a748869fbee80c30cef P b1bad12877874d57a97d81468a0879cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1bad12877874d57a97d81468a0879cc; no voters: 7381fd84faa0411aa19672822665c0c6, 9e380843f48544819091608f98a0c72f
I20260709 12:23:05.567319 10017 raft_consensus.cc:493] T 88209028e06042419fced28068c1542b P 9e380843f48544819091608f98a0c72f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:05.567974 10017 raft_consensus.cc:3060] T 88209028e06042419fced28068c1542b P 9e380843f48544819091608f98a0c72f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:05.576509 10012 raft_consensus.cc:493] T 85f2c8f75bef41a0a04f80205611c054 P 7381fd84faa0411aa19672822665c0c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.582625 10010 tablet_bootstrap.cc:654] T 5e60b7cfdc344a748869fbee80c30cef P 9e380843f48544819091608f98a0c72f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:05.582507 10012 raft_consensus.cc:515] T 85f2c8f75bef41a0a04f80205611c054 P 7381fd84faa0411aa19672822665c0c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:05.588088  9965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88209028e06042419fced28068c1542b" candidate_uuid: "9e380843f48544819091608f98a0c72f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1bad12877874d57a97d81468a0879cc" is_pre_election: true
I20260709 12:23:05.591039 10012 leader_election.cc:290] T 85f2c8f75bef41a0a04f80205611c054 P 7381fd84faa0411aa19672822665c0c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e380843f48544819091608f98a0c72f (127.9.116.65:34569), b1bad12877874d57a97d81468a0879cc (127.9.116.67:42315)
W20260709 12:23:05.592680  9779 leader_election.cc:343] T 88209028e06042419fced28068c1542b P 9e380843f48544819091608f98a0c72f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1bad12877874d57a97d81468a0879cc (127.9.116.67:42315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:05.594986  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85f2c8f75bef41a0a04f80205611c054" candidate_uuid: "7381fd84faa0411aa19672822665c0c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e380843f48544819091608f98a0c72f" is_pre_election: true
I20260709 12:23:05.596021  9815 raft_consensus.cc:2468] T 85f2c8f75bef41a0a04f80205611c054 P 9e380843f48544819091608f98a0c72f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7381fd84faa0411aa19672822665c0c6 in term 0.
I20260709 12:23:05.594204  9816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "335ce65e703a4289be64bc4030886524" candidate_uuid: "7381fd84faa0411aa19672822665c0c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e380843f48544819091608f98a0c72f" is_pre_election: true
I20260709 12:23:05.598999 10038 raft_consensus.cc:2749] T 5e60b7cfdc344a748869fbee80c30cef P b1bad12877874d57a97d81468a0879cc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:05.597422 10013 raft_consensus.cc:515] T 2eea8dc76b734af3ad92320d2e4dbab2 P b1bad12877874d57a97d81468a0879cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:05.596617 10017 raft_consensus.cc:515] T 88209028e06042419fced28068c1542b P 9e380843f48544819091608f98a0c72f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:05.589318  9931 leader_election.cc:304] T 335ce65e703a4289be64bc4030886524 P b1bad12877874d57a97d81468a0879cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7381fd84faa0411aa19672822665c0c6, b1bad12877874d57a97d81468a0879cc; no voters: 9e380843f48544819091608f98a0c72f
I20260709 12:23:05.599191  9854 leader_election.cc:304] T 85f2c8f75bef41a0a04f80205611c054 P 7381fd84faa0411aa19672822665c0c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7381fd84faa0411aa19672822665c0c6, 9e380843f48544819091608f98a0c72f; no voters: 
I20260709 12:23:05.603839 10012 raft_consensus.cc:2804] T 85f2c8f75bef41a0a04f80205611c054 P 7381fd84faa0411aa19672822665c0c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:23:05.604313  9854 leader_election.cc:343] T 335ce65e703a4289be64bc4030886524 P 7381fd84faa0411aa19672822665c0c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e380843f48544819091608f98a0c72f (127.9.116.65:34569): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:05.606279 10008 tablet_bootstrap.cc:654] T 2baffcc7e478421295036241364bfcaf P b1bad12877874d57a97d81468a0879cc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:05.605067 10012 raft_consensus.cc:493] T 85f2c8f75bef41a0a04f80205611c054 P 7381fd84faa0411aa19672822665c0c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:05.606947 10012 raft_consensus.cc:3060] T 85f2c8f75bef41a0a04f80205611c054 P 7381fd84faa0411aa19672822665c0c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:05.611639  9965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88209028e06042419fced28068c1542b" candidate_uuid: "9e380843f48544819091608f98a0c72f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1bad12877874d57a97d81468a0879cc"
I20260709 12:23:05.611874  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88209028e06042419fced28068c1542b" candidate_uuid: "9e380843f48544819091608f98a0c72f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7381fd84faa0411aa19672822665c0c6"
I20260709 12:23:05.608208 10017 leader_election.cc:290] T 88209028e06042419fced28068c1542b P 9e380843f48544819091608f98a0c72f [CANDIDATE]: Term 1 election: Requested vote from peers 7381fd84faa0411aa19672822665c0c6 (127.9.116.66:40415), b1bad12877874d57a97d81468a0879cc (127.9.116.67:42315)
I20260709 12:23:05.612381  9890 raft_consensus.cc:3060] T 88209028e06042419fced28068c1542b P 7381fd84faa0411aa19672822665c0c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:05.613673  9816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eea8dc76b734af3ad92320d2e4dbab2" candidate_uuid: "b1bad12877874d57a97d81468a0879cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e380843f48544819091608f98a0c72f"
W20260709 12:23:05.613320  9779 leader_election.cc:343] T 88209028e06042419fced28068c1542b P 9e380843f48544819091608f98a0c72f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1bad12877874d57a97d81468a0879cc (127.9.116.67:42315): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:05.615353  9928 leader_election.cc:343] T 2eea8dc76b734af3ad92320d2e4dbab2 P b1bad12877874d57a97d81468a0879cc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9e380843f48544819091608f98a0c72f (127.9.116.65:34569): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:05.609579 10013 leader_election.cc:290] T 2eea8dc76b734af3ad92320d2e4dbab2 P b1bad12877874d57a97d81468a0879cc [CANDIDATE]: Term 1 election: Requested vote from peers 9e380843f48544819091608f98a0c72f (127.9.116.65:34569), 7381fd84faa0411aa19672822665c0c6 (127.9.116.66:40415)
I20260709 12:23:05.610984 10038 raft_consensus.cc:2804] T 335ce65e703a4289be64bc4030886524 P b1bad12877874d57a97d81468a0879cc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:05.616685 10038 raft_consensus.cc:493] T 335ce65e703a4289be64bc4030886524 P b1bad12877874d57a97d81468a0879cc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:05.618249 10038 raft_consensus.cc:3060] T 335ce65e703a4289be64bc4030886524 P b1bad12877874d57a97d81468a0879cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:05.625994 10012 raft_consensus.cc:515] T 85f2c8f75bef41a0a04f80205611c054 P 7381fd84faa0411aa19672822665c0c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:05.629947  9816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85f2c8f75bef41a0a04f80205611c054" candidate_uuid: "7381fd84faa0411aa19672822665c0c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e380843f48544819091608f98a0c72f"
I20260709 12:23:05.631026  9816 raft_consensus.cc:3060] T 85f2c8f75bef41a0a04f80205611c054 P 9e380843f48544819091608f98a0c72f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:05.639605 10012 leader_election.cc:290] T 85f2c8f75bef41a0a04f80205611c054 P 7381fd84faa0411aa19672822665c0c6 [CANDIDATE]: Term 1 election: Requested vote from peers 9e380843f48544819091608f98a0c72f (127.9.116.65:34569), b1bad12877874d57a97d81468a0879cc (127.9.116.67:42315)
I20260709 12:23:05.640559 10007 tablet_bootstrap.cc:492] T 152402cdfb684f4d9bdbc6828f9160fe P 7381fd84faa0411aa19672822665c0c6: No bootstrap required, opened a new log
I20260709 12:23:05.641099 10007 ts_tablet_manager.cc:1403] T 152402cdfb684f4d9bdbc6828f9160fe P 7381fd84faa0411aa19672822665c0c6: Time spent bootstrapping tablet: real 0.159s	user 0.024s	sys 0.002s
I20260709 12:23:05.644548 10007 raft_consensus.cc:359] T 152402cdfb684f4d9bdbc6828f9160fe P 7381fd84faa0411aa19672822665c0c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:05.645346 10007 raft_consensus.cc:385] T 152402cdfb684f4d9bdbc6828f9160fe P 7381fd84faa0411aa19672822665c0c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:05.645668 10007 raft_consensus.cc:740] T 152402cdfb684f4d9bdbc6828f9160fe P 7381fd84faa0411aa19672822665c0c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7381fd84faa0411aa19672822665c0c6, State: Initialized, Role: FOLLOWER
I20260709 12:23:05.641355  9890 raft_consensus.cc:2468] T 88209028e06042419fced28068c1542b P 7381fd84faa0411aa19672822665c0c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e380843f48544819091608f98a0c72f in term 1.
I20260709 12:23:05.646504 10007 consensus_queue.cc:260] T 152402cdfb684f4d9bdbc6828f9160fe P 7381fd84faa0411aa19672822665c0c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:05.646938  9782 leader_election.cc:304] T 88209028e06042419fced28068c1542b P 9e380843f48544819091608f98a0c72f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7381fd84faa0411aa19672822665c0c6, 9e380843f48544819091608f98a0c72f; no voters: b1bad12877874d57a97d81468a0879cc
I20260709 12:23:05.650832  9816 raft_consensus.cc:2468] T 85f2c8f75bef41a0a04f80205611c054 P 9e380843f48544819091608f98a0c72f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7381fd84faa0411aa19672822665c0c6 in term 1.
I20260709 12:23:05.651779 10017 raft_consensus.cc:2804] T 88209028e06042419fced28068c1542b P 9e380843f48544819091608f98a0c72f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:05.648379 10007 ts_tablet_manager.cc:1434] T 152402cdfb684f4d9bdbc6828f9160fe P 7381fd84faa0411aa19672822665c0c6: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
W20260709 12:23:05.656426  9931 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:40415, user_credentials={real_user=slave}} blocked reactor thread for 67961.4us
I20260709 12:23:05.657968 10038 raft_consensus.cc:515] T 335ce65e703a4289be64bc4030886524 P b1bad12877874d57a97d81468a0879cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:05.661710  9854 leader_election.cc:304] T 85f2c8f75bef41a0a04f80205611c054 P 7381fd84faa0411aa19672822665c0c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7381fd84faa0411aa19672822665c0c6, 9e380843f48544819091608f98a0c72f; no voters: 
I20260709 12:23:05.662829 10008 tablet_bootstrap.cc:492] T 2baffcc7e478421295036241364bfcaf P b1bad12877874d57a97d81468a0879cc: No bootstrap required, opened a new log
I20260709 12:23:05.663375 10008 ts_tablet_manager.cc:1403] T 2baffcc7e478421295036241364bfcaf P b1bad12877874d57a97d81468a0879cc: Time spent bootstrapping tablet: real 0.134s	user 0.012s	sys 0.006s
I20260709 12:23:05.663601 10007 tablet_bootstrap.cc:492] T 5e60b7cfdc344a748869fbee80c30cef P 7381fd84faa0411aa19672822665c0c6: Bootstrap starting.
I20260709 12:23:05.663748 10012 raft_consensus.cc:2804] T 85f2c8f75bef41a0a04f80205611c054 P 7381fd84faa0411aa19672822665c0c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:05.672591  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eea8dc76b734af3ad92320d2e4dbab2" candidate_uuid: "b1bad12877874d57a97d81468a0879cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7381fd84faa0411aa19672822665c0c6"
I20260709 12:23:05.670250 10017 raft_consensus.cc:697] T 88209028e06042419fced28068c1542b P 9e380843f48544819091608f98a0c72f [term 1 LEADER]: Becoming Leader. State: Replica: 9e380843f48544819091608f98a0c72f, State: Running, Role: LEADER
I20260709 12:23:05.678642  9890 raft_consensus.cc:3060] T 2eea8dc76b734af3ad92320d2e4dbab2 P 7381fd84faa0411aa19672822665c0c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:05.682873  9965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "335ce65e703a4289be64bc4030886524" candidate_uuid: "7381fd84faa0411aa19672822665c0c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1bad12877874d57a97d81468a0879cc" is_pre_election: true
I20260709 12:23:05.683101 10038 leader_election.cc:290] T 335ce65e703a4289be64bc4030886524 P b1bad12877874d57a97d81468a0879cc [CANDIDATE]: Term 1 election: Requested vote from peers 9e380843f48544819091608f98a0c72f (127.9.116.65:34569), 7381fd84faa0411aa19672822665c0c6 (127.9.116.66:40415)
I20260709 12:23:05.683951 10012 raft_consensus.cc:697] T 85f2c8f75bef41a0a04f80205611c054 P 7381fd84faa0411aa19672822665c0c6 [term 1 LEADER]: Becoming Leader. State: Replica: 7381fd84faa0411aa19672822665c0c6, State: Running, Role: LEADER
I20260709 12:23:05.679152 10008 raft_consensus.cc:359] T 2baffcc7e478421295036241364bfcaf P b1bad12877874d57a97d81468a0879cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:05.687839 10008 raft_consensus.cc:385] T 2baffcc7e478421295036241364bfcaf P b1bad12877874d57a97d81468a0879cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:05.687755  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85f2c8f75bef41a0a04f80205611c054" candidate_uuid: "7381fd84faa0411aa19672822665c0c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1bad12877874d57a97d81468a0879cc"
I20260709 12:23:05.688293  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "335ce65e703a4289be64bc4030886524" candidate_uuid: "b1bad12877874d57a97d81468a0879cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7381fd84faa0411aa19672822665c0c6"
I20260709 12:23:05.687750  9965 raft_consensus.cc:2393] T 335ce65e703a4289be64bc4030886524 P b1bad12877874d57a97d81468a0879cc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7381fd84faa0411aa19672822665c0c6 in current term 1: Already voted for candidate b1bad12877874d57a97d81468a0879cc in this term.
I20260709 12:23:05.688336 10008 raft_consensus.cc:740] T 2baffcc7e478421295036241364bfcaf P b1bad12877874d57a97d81468a0879cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1bad12877874d57a97d81468a0879cc, State: Initialized, Role: FOLLOWER
I20260709 12:23:05.689284  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85f2c8f75bef41a0a04f80205611c054" candidate_uuid: "7381fd84faa0411aa19672822665c0c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1bad12877874d57a97d81468a0879cc" is_pre_election: true
I20260709 12:23:05.689874  9889 raft_consensus.cc:3060] T 335ce65e703a4289be64bc4030886524 P 7381fd84faa0411aa19672822665c0c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:05.693084 10010 tablet_bootstrap.cc:492] T 5e60b7cfdc344a748869fbee80c30cef P 9e380843f48544819091608f98a0c72f: No bootstrap required, opened a new log
I20260709 12:23:05.692271 10007 tablet_bootstrap.cc:654] T 5e60b7cfdc344a748869fbee80c30cef P 7381fd84faa0411aa19672822665c0c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:05.684707 10017 consensus_queue.cc:237] T 88209028e06042419fced28068c1542b P 9e380843f48544819091608f98a0c72f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
W20260709 12:23:05.691053  9854 leader_election.cc:343] T 85f2c8f75bef41a0a04f80205611c054 P 7381fd84faa0411aa19672822665c0c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1bad12877874d57a97d81468a0879cc (127.9.116.67:42315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:05.693382 10012 consensus_queue.cc:237] T 85f2c8f75bef41a0a04f80205611c054 P 7381fd84faa0411aa19672822665c0c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:05.694320 10010 ts_tablet_manager.cc:1403] T 5e60b7cfdc344a748869fbee80c30cef P 9e380843f48544819091608f98a0c72f: Time spent bootstrapping tablet: real 0.181s	user 0.021s	sys 0.005s
I20260709 12:23:05.692857 10008 consensus_queue.cc:260] T 2baffcc7e478421295036241364bfcaf P b1bad12877874d57a97d81468a0879cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:05.695592  9816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "335ce65e703a4289be64bc4030886524" candidate_uuid: "b1bad12877874d57a97d81468a0879cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e380843f48544819091608f98a0c72f"
I20260709 12:23:05.696424  9854 leader_election.cc:304] T 335ce65e703a4289be64bc4030886524 P 7381fd84faa0411aa19672822665c0c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7381fd84faa0411aa19672822665c0c6; no voters: 9e380843f48544819091608f98a0c72f, b1bad12877874d57a97d81468a0879cc
W20260709 12:23:05.700524  9928 leader_election.cc:343] T 335ce65e703a4289be64bc4030886524 P b1bad12877874d57a97d81468a0879cc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9e380843f48544819091608f98a0c72f (127.9.116.65:34569): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:05.702010  9854 leader_election.cc:343] T 85f2c8f75bef41a0a04f80205611c054 P 7381fd84faa0411aa19672822665c0c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1bad12877874d57a97d81468a0879cc (127.9.116.67:42315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:05.704485 10010 raft_consensus.cc:359] T 5e60b7cfdc344a748869fbee80c30cef P 9e380843f48544819091608f98a0c72f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:05.706046 10010 raft_consensus.cc:385] T 5e60b7cfdc344a748869fbee80c30cef P 9e380843f48544819091608f98a0c72f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:05.706607 10010 raft_consensus.cc:740] T 5e60b7cfdc344a748869fbee80c30cef P 9e380843f48544819091608f98a0c72f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e380843f48544819091608f98a0c72f, State: Initialized, Role: FOLLOWER
I20260709 12:23:05.708273  9889 raft_consensus.cc:2468] T 335ce65e703a4289be64bc4030886524 P 7381fd84faa0411aa19672822665c0c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1bad12877874d57a97d81468a0879cc in term 1.
I20260709 12:23:05.708573  9890 raft_consensus.cc:2468] T 2eea8dc76b734af3ad92320d2e4dbab2 P 7381fd84faa0411aa19672822665c0c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1bad12877874d57a97d81468a0879cc in term 1.
I20260709 12:23:05.708181 10010 consensus_queue.cc:260] T 5e60b7cfdc344a748869fbee80c30cef P 9e380843f48544819091608f98a0c72f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:05.728245 10008 ts_tablet_manager.cc:1434] T 2baffcc7e478421295036241364bfcaf P b1bad12877874d57a97d81468a0879cc: Time spent starting tablet: real 0.065s	user 0.012s	sys 0.001s
I20260709 12:23:05.731308 10044 raft_consensus.cc:2749] T 335ce65e703a4289be64bc4030886524 P 7381fd84faa0411aa19672822665c0c6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:05.739938 10012 raft_consensus.cc:493] T 02c174f129bc454a821e33e6427b6548 P 7381fd84faa0411aa19672822665c0c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.741587 10010 ts_tablet_manager.cc:1434] T 5e60b7cfdc344a748869fbee80c30cef P 9e380843f48544819091608f98a0c72f: Time spent starting tablet: real 0.044s	user 0.011s	sys 0.000s
I20260709 12:23:05.741505 10012 raft_consensus.cc:515] T 02c174f129bc454a821e33e6427b6548 P 7381fd84faa0411aa19672822665c0c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:05.731104  9931 leader_election.cc:304] T 335ce65e703a4289be64bc4030886524 P b1bad12877874d57a97d81468a0879cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7381fd84faa0411aa19672822665c0c6, b1bad12877874d57a97d81468a0879cc; no voters: 9e380843f48544819091608f98a0c72f
I20260709 12:23:05.744843 10008 tablet_bootstrap.cc:492] T 152402cdfb684f4d9bdbc6828f9160fe P b1bad12877874d57a97d81468a0879cc: Bootstrap starting.
I20260709 12:23:05.746440 10010 tablet_bootstrap.cc:492] T 335ce65e703a4289be64bc4030886524 P 9e380843f48544819091608f98a0c72f: Bootstrap starting.
I20260709 12:23:05.746703 10038 raft_consensus.cc:2804] T 335ce65e703a4289be64bc4030886524 P b1bad12877874d57a97d81468a0879cc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:05.748561 10038 raft_consensus.cc:697] T 335ce65e703a4289be64bc4030886524 P b1bad12877874d57a97d81468a0879cc [term 1 LEADER]: Becoming Leader. State: Replica: b1bad12877874d57a97d81468a0879cc, State: Running, Role: LEADER
I20260709 12:23:05.749094 10007 tablet_bootstrap.cc:492] T 5e60b7cfdc344a748869fbee80c30cef P 7381fd84faa0411aa19672822665c0c6: No bootstrap required, opened a new log
I20260709 12:23:05.749612 10007 ts_tablet_manager.cc:1403] T 5e60b7cfdc344a748869fbee80c30cef P 7381fd84faa0411aa19672822665c0c6: Time spent bootstrapping tablet: real 0.086s	user 0.016s	sys 0.012s
I20260709 12:23:05.749471 10038 consensus_queue.cc:237] T 335ce65e703a4289be64bc4030886524 P b1bad12877874d57a97d81468a0879cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:05.750735  9931 leader_election.cc:304] T 2eea8dc76b734af3ad92320d2e4dbab2 P b1bad12877874d57a97d81468a0879cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7381fd84faa0411aa19672822665c0c6, b1bad12877874d57a97d81468a0879cc; no voters: 9e380843f48544819091608f98a0c72f
I20260709 12:23:05.751693 10013 raft_consensus.cc:2804] T 2eea8dc76b734af3ad92320d2e4dbab2 P b1bad12877874d57a97d81468a0879cc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:05.752281 10012 leader_election.cc:290] T 02c174f129bc454a821e33e6427b6548 P 7381fd84faa0411aa19672822665c0c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e380843f48544819091608f98a0c72f (127.9.116.65:34569), b1bad12877874d57a97d81468a0879cc (127.9.116.67:42315)
I20260709 12:23:05.756002 10040 raft_consensus.cc:493] T 48fcbe3ecfb44941b74325e03a8463e1 P b1bad12877874d57a97d81468a0879cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.756682 10040 raft_consensus.cc:515] T 48fcbe3ecfb44941b74325e03a8463e1 P b1bad12877874d57a97d81468a0879cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:05.758236  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c174f129bc454a821e33e6427b6548" candidate_uuid: "7381fd84faa0411aa19672822665c0c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1bad12877874d57a97d81468a0879cc" is_pre_election: true
I20260709 12:23:05.761910 10040 leader_election.cc:290] T 48fcbe3ecfb44941b74325e03a8463e1 P b1bad12877874d57a97d81468a0879cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e380843f48544819091608f98a0c72f (127.9.116.65:34569), 7381fd84faa0411aa19672822665c0c6 (127.9.116.66:40415)
I20260709 12:23:05.763012  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48fcbe3ecfb44941b74325e03a8463e1" candidate_uuid: "b1bad12877874d57a97d81468a0879cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e380843f48544819091608f98a0c72f" is_pre_election: true
W20260709 12:23:05.765609  9928 leader_election.cc:343] T 48fcbe3ecfb44941b74325e03a8463e1 P b1bad12877874d57a97d81468a0879cc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e380843f48544819091608f98a0c72f (127.9.116.65:34569): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:05.754446  9816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c174f129bc454a821e33e6427b6548" candidate_uuid: "7381fd84faa0411aa19672822665c0c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e380843f48544819091608f98a0c72f" is_pre_election: true
I20260709 12:23:05.758849  9964 raft_consensus.cc:2468] T 02c174f129bc454a821e33e6427b6548 P b1bad12877874d57a97d81468a0879cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7381fd84faa0411aa19672822665c0c6 in term 0.
W20260709 12:23:05.769306  9854 leader_election.cc:343] T 02c174f129bc454a821e33e6427b6548 P 7381fd84faa0411aa19672822665c0c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e380843f48544819091608f98a0c72f (127.9.116.65:34569): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:05.769232  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48fcbe3ecfb44941b74325e03a8463e1" candidate_uuid: "b1bad12877874d57a97d81468a0879cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7381fd84faa0411aa19672822665c0c6" is_pre_election: true
I20260709 12:23:05.769060 10007 raft_consensus.cc:359] T 5e60b7cfdc344a748869fbee80c30cef P 7381fd84faa0411aa19672822665c0c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:05.770746 10007 raft_consensus.cc:385] T 5e60b7cfdc344a748869fbee80c30cef P 7381fd84faa0411aa19672822665c0c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:05.770629  9854 leader_election.cc:304] T 02c174f129bc454a821e33e6427b6548 P 7381fd84faa0411aa19672822665c0c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7381fd84faa0411aa19672822665c0c6, b1bad12877874d57a97d81468a0879cc; no voters: 9e380843f48544819091608f98a0c72f
I20260709 12:23:05.771188 10007 raft_consensus.cc:740] T 5e60b7cfdc344a748869fbee80c30cef P 7381fd84faa0411aa19672822665c0c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7381fd84faa0411aa19672822665c0c6, State: Initialized, Role: FOLLOWER
W20260709 12:23:05.772166  9931 leader_election.cc:343] T 48fcbe3ecfb44941b74325e03a8463e1 P b1bad12877874d57a97d81468a0879cc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7381fd84faa0411aa19672822665c0c6 (127.9.116.66:40415): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:05.772212 10044 raft_consensus.cc:2804] T 02c174f129bc454a821e33e6427b6548 P 7381fd84faa0411aa19672822665c0c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:05.777596 10044 raft_consensus.cc:493] T 02c174f129bc454a821e33e6427b6548 P 7381fd84faa0411aa19672822665c0c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:05.778003 10044 raft_consensus.cc:3060] T 02c174f129bc454a821e33e6427b6548 P 7381fd84faa0411aa19672822665c0c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:05.777240 10007 consensus_queue.cc:260] T 5e60b7cfdc344a748869fbee80c30cef P 7381fd84faa0411aa19672822665c0c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:05.776341  9931 leader_election.cc:304] T 48fcbe3ecfb44941b74325e03a8463e1 P b1bad12877874d57a97d81468a0879cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1bad12877874d57a97d81468a0879cc; no voters: 7381fd84faa0411aa19672822665c0c6, 9e380843f48544819091608f98a0c72f
I20260709 12:23:05.784199 10040 raft_consensus.cc:2749] T 48fcbe3ecfb44941b74325e03a8463e1 P b1bad12877874d57a97d81468a0879cc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:05.784246 10008 tablet_bootstrap.cc:654] T 152402cdfb684f4d9bdbc6828f9160fe P b1bad12877874d57a97d81468a0879cc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:05.776669 10013 raft_consensus.cc:697] T 2eea8dc76b734af3ad92320d2e4dbab2 P b1bad12877874d57a97d81468a0879cc [term 1 LEADER]: Becoming Leader. State: Replica: b1bad12877874d57a97d81468a0879cc, State: Running, Role: LEADER
I20260709 12:23:05.793803 10007 ts_tablet_manager.cc:1434] T 5e60b7cfdc344a748869fbee80c30cef P 7381fd84faa0411aa19672822665c0c6: Time spent starting tablet: real 0.044s	user 0.009s	sys 0.002s
W20260709 12:23:05.793892  9760 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:05.800933 10007 tablet_bootstrap.cc:492] T 2baffcc7e478421295036241364bfcaf P 7381fd84faa0411aa19672822665c0c6: Bootstrap starting.
I20260709 12:23:05.800653 10013 consensus_queue.cc:237] T 2eea8dc76b734af3ad92320d2e4dbab2 P b1bad12877874d57a97d81468a0879cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:05.820984 10007 tablet_bootstrap.cc:654] T 2baffcc7e478421295036241364bfcaf P 7381fd84faa0411aa19672822665c0c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:05.825937 10008 tablet_bootstrap.cc:492] T 152402cdfb684f4d9bdbc6828f9160fe P b1bad12877874d57a97d81468a0879cc: No bootstrap required, opened a new log
I20260709 12:23:05.826542 10008 ts_tablet_manager.cc:1403] T 152402cdfb684f4d9bdbc6828f9160fe P b1bad12877874d57a97d81468a0879cc: Time spent bootstrapping tablet: real 0.084s	user 0.012s	sys 0.009s
I20260709 12:23:05.835211 10008 raft_consensus.cc:359] T 152402cdfb684f4d9bdbc6828f9160fe P b1bad12877874d57a97d81468a0879cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:05.836221 10008 raft_consensus.cc:385] T 152402cdfb684f4d9bdbc6828f9160fe P b1bad12877874d57a97d81468a0879cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:05.836591 10008 raft_consensus.cc:740] T 152402cdfb684f4d9bdbc6828f9160fe P b1bad12877874d57a97d81468a0879cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1bad12877874d57a97d81468a0879cc, State: Initialized, Role: FOLLOWER
I20260709 12:23:05.837577 10008 consensus_queue.cc:260] T 152402cdfb684f4d9bdbc6828f9160fe P b1bad12877874d57a97d81468a0879cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:05.842500 10010 tablet_bootstrap.cc:654] T 335ce65e703a4289be64bc4030886524 P 9e380843f48544819091608f98a0c72f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:05.821156 10044 raft_consensus.cc:515] T 02c174f129bc454a821e33e6427b6548 P 7381fd84faa0411aa19672822665c0c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:05.827548  9712 catalog_manager.cc:5697] T 85f2c8f75bef41a0a04f80205611c054 P 7381fd84faa0411aa19672822665c0c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7381fd84faa0411aa19672822665c0c6 (127.9.116.66). New cstate: current_term: 1 leader_uuid: "7381fd84faa0411aa19672822665c0c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:05.847114  9816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c174f129bc454a821e33e6427b6548" candidate_uuid: "7381fd84faa0411aa19672822665c0c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e380843f48544819091608f98a0c72f"
W20260709 12:23:05.849094  9854 leader_election.cc:343] T 02c174f129bc454a821e33e6427b6548 P 7381fd84faa0411aa19672822665c0c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9e380843f48544819091608f98a0c72f (127.9.116.65:34569): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:05.850735 10008 ts_tablet_manager.cc:1434] T 152402cdfb684f4d9bdbc6828f9160fe P b1bad12877874d57a97d81468a0879cc: Time spent starting tablet: real 0.024s	user 0.009s	sys 0.000s
I20260709 12:23:05.851832 10008 tablet_bootstrap.cc:492] T 88209028e06042419fced28068c1542b P b1bad12877874d57a97d81468a0879cc: Bootstrap starting.
I20260709 12:23:05.847851  9711 catalog_manager.cc:5697] T 88209028e06042419fced28068c1542b P 9e380843f48544819091608f98a0c72f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e380843f48544819091608f98a0c72f (127.9.116.65). New cstate: current_term: 1 leader_uuid: "9e380843f48544819091608f98a0c72f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:05.854457  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c174f129bc454a821e33e6427b6548" candidate_uuid: "7381fd84faa0411aa19672822665c0c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1bad12877874d57a97d81468a0879cc"
I20260709 12:23:05.855345  9964 raft_consensus.cc:3060] T 02c174f129bc454a821e33e6427b6548 P b1bad12877874d57a97d81468a0879cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:05.858798 10044 leader_election.cc:290] T 02c174f129bc454a821e33e6427b6548 P 7381fd84faa0411aa19672822665c0c6 [CANDIDATE]: Term 1 election: Requested vote from peers 9e380843f48544819091608f98a0c72f (127.9.116.65:34569), b1bad12877874d57a97d81468a0879cc (127.9.116.67:42315)
I20260709 12:23:05.860514 10007 tablet_bootstrap.cc:492] T 2baffcc7e478421295036241364bfcaf P 7381fd84faa0411aa19672822665c0c6: No bootstrap required, opened a new log
I20260709 12:23:05.861078 10007 ts_tablet_manager.cc:1403] T 2baffcc7e478421295036241364bfcaf P 7381fd84faa0411aa19672822665c0c6: Time spent bootstrapping tablet: real 0.061s	user 0.009s	sys 0.015s
I20260709 12:23:05.861109 10008 tablet_bootstrap.cc:654] T 88209028e06042419fced28068c1542b P b1bad12877874d57a97d81468a0879cc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:05.864122  9964 raft_consensus.cc:2468] T 02c174f129bc454a821e33e6427b6548 P b1bad12877874d57a97d81468a0879cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7381fd84faa0411aa19672822665c0c6 in term 1.
I20260709 12:23:05.864624 10007 raft_consensus.cc:359] T 2baffcc7e478421295036241364bfcaf P 7381fd84faa0411aa19672822665c0c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:05.865723 10007 raft_consensus.cc:385] T 2baffcc7e478421295036241364bfcaf P 7381fd84faa0411aa19672822665c0c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:05.866212 10007 raft_consensus.cc:740] T 2baffcc7e478421295036241364bfcaf P 7381fd84faa0411aa19672822665c0c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7381fd84faa0411aa19672822665c0c6, State: Initialized, Role: FOLLOWER
I20260709 12:23:05.866113  9854 leader_election.cc:304] T 02c174f129bc454a821e33e6427b6548 P 7381fd84faa0411aa19672822665c0c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7381fd84faa0411aa19672822665c0c6, b1bad12877874d57a97d81468a0879cc; no voters: 9e380843f48544819091608f98a0c72f
I20260709 12:23:05.867607 10044 raft_consensus.cc:2804] T 02c174f129bc454a821e33e6427b6548 P 7381fd84faa0411aa19672822665c0c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:05.867481 10007 consensus_queue.cc:260] T 2baffcc7e478421295036241364bfcaf P 7381fd84faa0411aa19672822665c0c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:05.868992 10017 raft_consensus.cc:493] T 152402cdfb684f4d9bdbc6828f9160fe P 9e380843f48544819091608f98a0c72f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.869500 10017 raft_consensus.cc:515] T 152402cdfb684f4d9bdbc6828f9160fe P 9e380843f48544819091608f98a0c72f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:05.870950 10007 ts_tablet_manager.cc:1434] T 2baffcc7e478421295036241364bfcaf P 7381fd84faa0411aa19672822665c0c6: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:23:05.872310 10007 tablet_bootstrap.cc:492] T 48fcbe3ecfb44941b74325e03a8463e1 P 7381fd84faa0411aa19672822665c0c6: Bootstrap starting.
I20260709 12:23:05.874907  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "152402cdfb684f4d9bdbc6828f9160fe" candidate_uuid: "9e380843f48544819091608f98a0c72f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7381fd84faa0411aa19672822665c0c6" is_pre_election: true
I20260709 12:23:05.875850  9890 raft_consensus.cc:2468] T 152402cdfb684f4d9bdbc6828f9160fe P 7381fd84faa0411aa19672822665c0c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e380843f48544819091608f98a0c72f in term 0.
I20260709 12:23:05.877673  9782 leader_election.cc:304] T 152402cdfb684f4d9bdbc6828f9160fe P 9e380843f48544819091608f98a0c72f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7381fd84faa0411aa19672822665c0c6, 9e380843f48544819091608f98a0c72f; no voters: 
I20260709 12:23:05.878925 10043 raft_consensus.cc:2804] T 152402cdfb684f4d9bdbc6828f9160fe P 9e380843f48544819091608f98a0c72f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:05.878888 10017 leader_election.cc:290] T 152402cdfb684f4d9bdbc6828f9160fe P 9e380843f48544819091608f98a0c72f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7381fd84faa0411aa19672822665c0c6 (127.9.116.66:40415), b1bad12877874d57a97d81468a0879cc (127.9.116.67:42315)
I20260709 12:23:05.879561 10007 tablet_bootstrap.cc:654] T 48fcbe3ecfb44941b74325e03a8463e1 P 7381fd84faa0411aa19672822665c0c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:05.868790 10044 raft_consensus.cc:697] T 02c174f129bc454a821e33e6427b6548 P 7381fd84faa0411aa19672822665c0c6 [term 1 LEADER]: Becoming Leader. State: Replica: 7381fd84faa0411aa19672822665c0c6, State: Running, Role: LEADER
I20260709 12:23:05.879559 10043 raft_consensus.cc:493] T 152402cdfb684f4d9bdbc6828f9160fe P 9e380843f48544819091608f98a0c72f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:05.880471 10043 raft_consensus.cc:3060] T 152402cdfb684f4d9bdbc6828f9160fe P 9e380843f48544819091608f98a0c72f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:05.880921 10044 consensus_queue.cc:237] T 02c174f129bc454a821e33e6427b6548 P 7381fd84faa0411aa19672822665c0c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:05.882830  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "152402cdfb684f4d9bdbc6828f9160fe" candidate_uuid: "9e380843f48544819091608f98a0c72f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1bad12877874d57a97d81468a0879cc" is_pre_election: true
I20260709 12:23:05.883644  9964 raft_consensus.cc:2468] T 152402cdfb684f4d9bdbc6828f9160fe P b1bad12877874d57a97d81468a0879cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e380843f48544819091608f98a0c72f in term 0.
I20260709 12:23:05.902370 10010 tablet_bootstrap.cc:492] T 335ce65e703a4289be64bc4030886524 P 9e380843f48544819091608f98a0c72f: No bootstrap required, opened a new log
I20260709 12:23:05.911108 10010 ts_tablet_manager.cc:1403] T 335ce65e703a4289be64bc4030886524 P 9e380843f48544819091608f98a0c72f: Time spent bootstrapping tablet: real 0.166s	user 0.012s	sys 0.011s
I20260709 12:23:05.912762 10008 tablet_bootstrap.cc:492] T 88209028e06042419fced28068c1542b P b1bad12877874d57a97d81468a0879cc: No bootstrap required, opened a new log
I20260709 12:23:05.915351 10008 ts_tablet_manager.cc:1403] T 88209028e06042419fced28068c1542b P b1bad12877874d57a97d81468a0879cc: Time spent bootstrapping tablet: real 0.064s	user 0.016s	sys 0.009s
I20260709 12:23:05.919171 10008 raft_consensus.cc:359] T 88209028e06042419fced28068c1542b P b1bad12877874d57a97d81468a0879cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:05.920446 10008 raft_consensus.cc:385] T 88209028e06042419fced28068c1542b P b1bad12877874d57a97d81468a0879cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:05.920789 10008 raft_consensus.cc:740] T 88209028e06042419fced28068c1542b P b1bad12877874d57a97d81468a0879cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1bad12877874d57a97d81468a0879cc, State: Initialized, Role: FOLLOWER
I20260709 12:23:05.921118 10043 raft_consensus.cc:515] T 152402cdfb684f4d9bdbc6828f9160fe P 9e380843f48544819091608f98a0c72f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:05.922142 10007 tablet_bootstrap.cc:492] T 48fcbe3ecfb44941b74325e03a8463e1 P 7381fd84faa0411aa19672822665c0c6: No bootstrap required, opened a new log
I20260709 12:23:05.921936 10008 consensus_queue.cc:260] T 88209028e06042419fced28068c1542b P b1bad12877874d57a97d81468a0879cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:05.923516 10007 ts_tablet_manager.cc:1403] T 48fcbe3ecfb44941b74325e03a8463e1 P 7381fd84faa0411aa19672822665c0c6: Time spent bootstrapping tablet: real 0.051s	user 0.023s	sys 0.009s
I20260709 12:23:05.925669  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "152402cdfb684f4d9bdbc6828f9160fe" candidate_uuid: "9e380843f48544819091608f98a0c72f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7381fd84faa0411aa19672822665c0c6"
I20260709 12:23:05.926337  9890 raft_consensus.cc:3060] T 152402cdfb684f4d9bdbc6828f9160fe P 7381fd84faa0411aa19672822665c0c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:05.927441 10007 raft_consensus.cc:359] T 48fcbe3ecfb44941b74325e03a8463e1 P 7381fd84faa0411aa19672822665c0c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:05.928221 10007 raft_consensus.cc:385] T 48fcbe3ecfb44941b74325e03a8463e1 P 7381fd84faa0411aa19672822665c0c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:05.928529 10007 raft_consensus.cc:740] T 48fcbe3ecfb44941b74325e03a8463e1 P 7381fd84faa0411aa19672822665c0c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7381fd84faa0411aa19672822665c0c6, State: Initialized, Role: FOLLOWER
I20260709 12:23:05.929278 10007 consensus_queue.cc:260] T 48fcbe3ecfb44941b74325e03a8463e1 P 7381fd84faa0411aa19672822665c0c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:05.931416 10007 ts_tablet_manager.cc:1434] T 48fcbe3ecfb44941b74325e03a8463e1 P 7381fd84faa0411aa19672822665c0c6: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 12:23:05.933997 10043 leader_election.cc:290] T 152402cdfb684f4d9bdbc6828f9160fe P 9e380843f48544819091608f98a0c72f [CANDIDATE]: Term 1 election: Requested vote from peers 7381fd84faa0411aa19672822665c0c6 (127.9.116.66:40415), b1bad12877874d57a97d81468a0879cc (127.9.116.67:42315)
I20260709 12:23:05.935786  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "152402cdfb684f4d9bdbc6828f9160fe" candidate_uuid: "9e380843f48544819091608f98a0c72f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1bad12877874d57a97d81468a0879cc"
I20260709 12:23:05.936139 10008 ts_tablet_manager.cc:1434] T 88209028e06042419fced28068c1542b P b1bad12877874d57a97d81468a0879cc: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 12:23:05.936637  9964 raft_consensus.cc:3060] T 152402cdfb684f4d9bdbc6828f9160fe P b1bad12877874d57a97d81468a0879cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:05.937616 10008 tablet_bootstrap.cc:492] T 85f2c8f75bef41a0a04f80205611c054 P b1bad12877874d57a97d81468a0879cc: Bootstrap starting.
I20260709 12:23:05.936302  9890 raft_consensus.cc:2468] T 152402cdfb684f4d9bdbc6828f9160fe P 7381fd84faa0411aa19672822665c0c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e380843f48544819091608f98a0c72f in term 1.
I20260709 12:23:05.940411  9782 leader_election.cc:304] T 152402cdfb684f4d9bdbc6828f9160fe P 9e380843f48544819091608f98a0c72f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7381fd84faa0411aa19672822665c0c6, 9e380843f48544819091608f98a0c72f; no voters: 
I20260709 12:23:05.941696 10043 raft_consensus.cc:2804] T 152402cdfb684f4d9bdbc6828f9160fe P 9e380843f48544819091608f98a0c72f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:05.942703 10043 raft_consensus.cc:697] T 152402cdfb684f4d9bdbc6828f9160fe P 9e380843f48544819091608f98a0c72f [term 1 LEADER]: Becoming Leader. State: Replica: 9e380843f48544819091608f98a0c72f, State: Running, Role: LEADER
I20260709 12:23:05.943696 10043 consensus_queue.cc:237] T 152402cdfb684f4d9bdbc6828f9160fe P 9e380843f48544819091608f98a0c72f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:05.946879  9964 raft_consensus.cc:2468] T 152402cdfb684f4d9bdbc6828f9160fe P b1bad12877874d57a97d81468a0879cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e380843f48544819091608f98a0c72f in term 1.
I20260709 12:23:05.938494 10010 raft_consensus.cc:359] T 335ce65e703a4289be64bc4030886524 P 9e380843f48544819091608f98a0c72f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:05.948834 10010 raft_consensus.cc:385] T 335ce65e703a4289be64bc4030886524 P 9e380843f48544819091608f98a0c72f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:05.949190 10010 raft_consensus.cc:740] T 335ce65e703a4289be64bc4030886524 P 9e380843f48544819091608f98a0c72f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e380843f48544819091608f98a0c72f, State: Initialized, Role: FOLLOWER
I20260709 12:23:05.950640 10008 tablet_bootstrap.cc:654] T 85f2c8f75bef41a0a04f80205611c054 P b1bad12877874d57a97d81468a0879cc: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:05.950263 10010 consensus_queue.cc:260] T 335ce65e703a4289be64bc4030886524 P 9e380843f48544819091608f98a0c72f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:05.959041 10010 ts_tablet_manager.cc:1434] T 335ce65e703a4289be64bc4030886524 P 9e380843f48544819091608f98a0c72f: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.001s
I20260709 12:23:05.960156 10010 tablet_bootstrap.cc:492] T 2eea8dc76b734af3ad92320d2e4dbab2 P 9e380843f48544819091608f98a0c72f: Bootstrap starting.
I20260709 12:23:05.963845 10013 raft_consensus.cc:493] T 88209028e06042419fced28068c1542b P b1bad12877874d57a97d81468a0879cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.964608 10013 raft_consensus.cc:515] T 88209028e06042419fced28068c1542b P b1bad12877874d57a97d81468a0879cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:05.966930 10013 leader_election.cc:290] T 88209028e06042419fced28068c1542b P b1bad12877874d57a97d81468a0879cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7381fd84faa0411aa19672822665c0c6 (127.9.116.66:40415), 9e380843f48544819091608f98a0c72f (127.9.116.65:34569)
I20260709 12:23:05.967928  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88209028e06042419fced28068c1542b" candidate_uuid: "b1bad12877874d57a97d81468a0879cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7381fd84faa0411aa19672822665c0c6" is_pre_election: true
I20260709 12:23:05.968194  9816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88209028e06042419fced28068c1542b" candidate_uuid: "b1bad12877874d57a97d81468a0879cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e380843f48544819091608f98a0c72f" is_pre_election: true
I20260709 12:23:05.969027  9890 raft_consensus.cc:2393] T 88209028e06042419fced28068c1542b P 7381fd84faa0411aa19672822665c0c6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1bad12877874d57a97d81468a0879cc in current term 1: Already voted for candidate 9e380843f48544819091608f98a0c72f in this term.
I20260709 12:23:05.970659  9931 leader_election.cc:304] T 88209028e06042419fced28068c1542b P b1bad12877874d57a97d81468a0879cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1bad12877874d57a97d81468a0879cc; no voters: 7381fd84faa0411aa19672822665c0c6, 9e380843f48544819091608f98a0c72f
I20260709 12:23:05.971709 10010 tablet_bootstrap.cc:654] T 2eea8dc76b734af3ad92320d2e4dbab2 P 9e380843f48544819091608f98a0c72f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:05.972165 10013 raft_consensus.cc:3060] T 88209028e06042419fced28068c1542b P b1bad12877874d57a97d81468a0879cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:05.973114 10008 tablet_bootstrap.cc:492] T 85f2c8f75bef41a0a04f80205611c054 P b1bad12877874d57a97d81468a0879cc: No bootstrap required, opened a new log
I20260709 12:23:05.973690 10008 ts_tablet_manager.cc:1403] T 85f2c8f75bef41a0a04f80205611c054 P b1bad12877874d57a97d81468a0879cc: Time spent bootstrapping tablet: real 0.036s	user 0.014s	sys 0.002s
I20260709 12:23:05.982143 10010 tablet_bootstrap.cc:492] T 2eea8dc76b734af3ad92320d2e4dbab2 P 9e380843f48544819091608f98a0c72f: No bootstrap required, opened a new log
I20260709 12:23:05.982671 10010 ts_tablet_manager.cc:1403] T 2eea8dc76b734af3ad92320d2e4dbab2 P 9e380843f48544819091608f98a0c72f: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.001s
I20260709 12:23:05.982730 10008 raft_consensus.cc:359] T 85f2c8f75bef41a0a04f80205611c054 P b1bad12877874d57a97d81468a0879cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:05.983508 10008 raft_consensus.cc:385] T 85f2c8f75bef41a0a04f80205611c054 P b1bad12877874d57a97d81468a0879cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:05.983811 10008 raft_consensus.cc:740] T 85f2c8f75bef41a0a04f80205611c054 P b1bad12877874d57a97d81468a0879cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1bad12877874d57a97d81468a0879cc, State: Initialized, Role: FOLLOWER
I20260709 12:23:05.984910 10008 consensus_queue.cc:260] T 85f2c8f75bef41a0a04f80205611c054 P b1bad12877874d57a97d81468a0879cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:05.988129 10008 ts_tablet_manager.cc:1434] T 85f2c8f75bef41a0a04f80205611c054 P b1bad12877874d57a97d81468a0879cc: Time spent starting tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 12:23:05.983804 10013 raft_consensus.cc:2749] T 88209028e06042419fced28068c1542b P b1bad12877874d57a97d81468a0879cc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:05.997880  9710 catalog_manager.cc:5697] T 335ce65e703a4289be64bc4030886524 P b1bad12877874d57a97d81468a0879cc reported cstate change: term changed from 0 to 1, leader changed from <none> to b1bad12877874d57a97d81468a0879cc (127.9.116.67). New cstate: current_term: 1 leader_uuid: "b1bad12877874d57a97d81468a0879cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:06.000492 10010 raft_consensus.cc:359] T 2eea8dc76b734af3ad92320d2e4dbab2 P 9e380843f48544819091608f98a0c72f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:06.001818 10010 raft_consensus.cc:385] T 2eea8dc76b734af3ad92320d2e4dbab2 P 9e380843f48544819091608f98a0c72f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:06.002152 10010 raft_consensus.cc:740] T 2eea8dc76b734af3ad92320d2e4dbab2 P 9e380843f48544819091608f98a0c72f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e380843f48544819091608f98a0c72f, State: Initialized, Role: FOLLOWER
I20260709 12:23:06.001850  9710 catalog_manager.cc:5697] T 2eea8dc76b734af3ad92320d2e4dbab2 P b1bad12877874d57a97d81468a0879cc reported cstate change: term changed from 0 to 1, leader changed from <none> to b1bad12877874d57a97d81468a0879cc (127.9.116.67). New cstate: current_term: 1 leader_uuid: "b1bad12877874d57a97d81468a0879cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:06.003526 10010 consensus_queue.cc:260] T 2eea8dc76b734af3ad92320d2e4dbab2 P 9e380843f48544819091608f98a0c72f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:06.011566 10010 ts_tablet_manager.cc:1434] T 2eea8dc76b734af3ad92320d2e4dbab2 P 9e380843f48544819091608f98a0c72f: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.005s
I20260709 12:23:06.012529 10010 tablet_bootstrap.cc:492] T 48fcbe3ecfb44941b74325e03a8463e1 P 9e380843f48544819091608f98a0c72f: Bootstrap starting.
I20260709 12:23:06.015786  9712 catalog_manager.cc:5697] T 02c174f129bc454a821e33e6427b6548 P 7381fd84faa0411aa19672822665c0c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7381fd84faa0411aa19672822665c0c6 (127.9.116.66). New cstate: current_term: 1 leader_uuid: "7381fd84faa0411aa19672822665c0c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:06.017899 10010 tablet_bootstrap.cc:654] T 48fcbe3ecfb44941b74325e03a8463e1 P 9e380843f48544819091608f98a0c72f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:06.023555 10044 raft_consensus.cc:493] T 48fcbe3ecfb44941b74325e03a8463e1 P 7381fd84faa0411aa19672822665c0c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.024219 10044 raft_consensus.cc:515] T 48fcbe3ecfb44941b74325e03a8463e1 P 7381fd84faa0411aa19672822665c0c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:06.026646 10044 leader_election.cc:290] T 48fcbe3ecfb44941b74325e03a8463e1 P 7381fd84faa0411aa19672822665c0c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e380843f48544819091608f98a0c72f (127.9.116.65:34569), b1bad12877874d57a97d81468a0879cc (127.9.116.67:42315)
I20260709 12:23:06.028285  9816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48fcbe3ecfb44941b74325e03a8463e1" candidate_uuid: "7381fd84faa0411aa19672822665c0c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e380843f48544819091608f98a0c72f" is_pre_election: true
I20260709 12:23:06.029597  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48fcbe3ecfb44941b74325e03a8463e1" candidate_uuid: "7381fd84faa0411aa19672822665c0c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1bad12877874d57a97d81468a0879cc" is_pre_election: true
I20260709 12:23:06.030272  9964 raft_consensus.cc:2468] T 48fcbe3ecfb44941b74325e03a8463e1 P b1bad12877874d57a97d81468a0879cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7381fd84faa0411aa19672822665c0c6 in term 0.
I20260709 12:23:06.031890  9854 leader_election.cc:304] T 48fcbe3ecfb44941b74325e03a8463e1 P 7381fd84faa0411aa19672822665c0c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7381fd84faa0411aa19672822665c0c6, b1bad12877874d57a97d81468a0879cc; no voters: 
W20260709 12:23:06.032853  9854 leader_election.cc:343] T 48fcbe3ecfb44941b74325e03a8463e1 P 7381fd84faa0411aa19672822665c0c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e380843f48544819091608f98a0c72f (127.9.116.65:34569): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:06.033689 10010 tablet_bootstrap.cc:492] T 48fcbe3ecfb44941b74325e03a8463e1 P 9e380843f48544819091608f98a0c72f: No bootstrap required, opened a new log
I20260709 12:23:06.034241 10010 ts_tablet_manager.cc:1403] T 48fcbe3ecfb44941b74325e03a8463e1 P 9e380843f48544819091608f98a0c72f: Time spent bootstrapping tablet: real 0.022s	user 0.001s	sys 0.012s
I20260709 12:23:06.033473  9711 catalog_manager.cc:5697] T 152402cdfb684f4d9bdbc6828f9160fe P 9e380843f48544819091608f98a0c72f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e380843f48544819091608f98a0c72f (127.9.116.65). New cstate: current_term: 1 leader_uuid: "9e380843f48544819091608f98a0c72f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:06.037493 10044 raft_consensus.cc:2804] T 48fcbe3ecfb44941b74325e03a8463e1 P 7381fd84faa0411aa19672822665c0c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:06.037619 10010 raft_consensus.cc:359] T 48fcbe3ecfb44941b74325e03a8463e1 P 9e380843f48544819091608f98a0c72f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:06.038115 10044 raft_consensus.cc:493] T 48fcbe3ecfb44941b74325e03a8463e1 P 7381fd84faa0411aa19672822665c0c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:06.038487 10010 raft_consensus.cc:385] T 48fcbe3ecfb44941b74325e03a8463e1 P 9e380843f48544819091608f98a0c72f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:06.038555 10044 raft_consensus.cc:3060] T 48fcbe3ecfb44941b74325e03a8463e1 P 7381fd84faa0411aa19672822665c0c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.038900 10010 raft_consensus.cc:740] T 48fcbe3ecfb44941b74325e03a8463e1 P 9e380843f48544819091608f98a0c72f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e380843f48544819091608f98a0c72f, State: Initialized, Role: FOLLOWER
I20260709 12:23:06.039939 10010 consensus_queue.cc:260] T 48fcbe3ecfb44941b74325e03a8463e1 P 9e380843f48544819091608f98a0c72f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:06.042452 10010 ts_tablet_manager.cc:1434] T 48fcbe3ecfb44941b74325e03a8463e1 P 9e380843f48544819091608f98a0c72f: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:23:06.043606 10010 tablet_bootstrap.cc:492] T 2baffcc7e478421295036241364bfcaf P 9e380843f48544819091608f98a0c72f: Bootstrap starting.
I20260709 12:23:06.046919 10044 raft_consensus.cc:515] T 48fcbe3ecfb44941b74325e03a8463e1 P 7381fd84faa0411aa19672822665c0c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:06.051110 10044 leader_election.cc:290] T 48fcbe3ecfb44941b74325e03a8463e1 P 7381fd84faa0411aa19672822665c0c6 [CANDIDATE]: Term 1 election: Requested vote from peers 9e380843f48544819091608f98a0c72f (127.9.116.65:34569), b1bad12877874d57a97d81468a0879cc (127.9.116.67:42315)
I20260709 12:23:06.052349  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48fcbe3ecfb44941b74325e03a8463e1" candidate_uuid: "7381fd84faa0411aa19672822665c0c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1bad12877874d57a97d81468a0879cc"
I20260709 12:23:06.052742  9816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48fcbe3ecfb44941b74325e03a8463e1" candidate_uuid: "7381fd84faa0411aa19672822665c0c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e380843f48544819091608f98a0c72f"
I20260709 12:23:06.052958  9964 raft_consensus.cc:3060] T 48fcbe3ecfb44941b74325e03a8463e1 P b1bad12877874d57a97d81468a0879cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.053349  9816 raft_consensus.cc:3060] T 48fcbe3ecfb44941b74325e03a8463e1 P 9e380843f48544819091608f98a0c72f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.056258 10010 tablet_bootstrap.cc:654] T 2baffcc7e478421295036241364bfcaf P 9e380843f48544819091608f98a0c72f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:06.057798 10043 raft_consensus.cc:493] T 5e60b7cfdc344a748869fbee80c30cef P 9e380843f48544819091608f98a0c72f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.058350 10043 raft_consensus.cc:515] T 5e60b7cfdc344a748869fbee80c30cef P 9e380843f48544819091608f98a0c72f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:06.059875  9964 raft_consensus.cc:2468] T 48fcbe3ecfb44941b74325e03a8463e1 P b1bad12877874d57a97d81468a0879cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7381fd84faa0411aa19672822665c0c6 in term 1.
I20260709 12:23:06.061551  9854 leader_election.cc:304] T 48fcbe3ecfb44941b74325e03a8463e1 P 7381fd84faa0411aa19672822665c0c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7381fd84faa0411aa19672822665c0c6, b1bad12877874d57a97d81468a0879cc; no voters: 
I20260709 12:23:06.063386 10043 leader_election.cc:290] T 5e60b7cfdc344a748869fbee80c30cef P 9e380843f48544819091608f98a0c72f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7381fd84faa0411aa19672822665c0c6 (127.9.116.66:40415), b1bad12877874d57a97d81468a0879cc (127.9.116.67:42315)
I20260709 12:23:06.063295  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b7cfdc344a748869fbee80c30cef" candidate_uuid: "9e380843f48544819091608f98a0c72f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7381fd84faa0411aa19672822665c0c6" is_pre_election: true
I20260709 12:23:06.064438  9890 raft_consensus.cc:2468] T 5e60b7cfdc344a748869fbee80c30cef P 7381fd84faa0411aa19672822665c0c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e380843f48544819091608f98a0c72f in term 0.
I20260709 12:23:06.067077  9782 leader_election.cc:304] T 5e60b7cfdc344a748869fbee80c30cef P 9e380843f48544819091608f98a0c72f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7381fd84faa0411aa19672822665c0c6, 9e380843f48544819091608f98a0c72f; no voters: 
I20260709 12:23:06.068746  9816 raft_consensus.cc:2468] T 48fcbe3ecfb44941b74325e03a8463e1 P 9e380843f48544819091608f98a0c72f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7381fd84faa0411aa19672822665c0c6 in term 1.
I20260709 12:23:06.071633 10044 raft_consensus.cc:2804] T 48fcbe3ecfb44941b74325e03a8463e1 P 7381fd84faa0411aa19672822665c0c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:06.072361 10044 raft_consensus.cc:697] T 48fcbe3ecfb44941b74325e03a8463e1 P 7381fd84faa0411aa19672822665c0c6 [term 1 LEADER]: Becoming Leader. State: Replica: 7381fd84faa0411aa19672822665c0c6, State: Running, Role: LEADER
I20260709 12:23:06.074028 10044 consensus_queue.cc:237] T 48fcbe3ecfb44941b74325e03a8463e1 P 7381fd84faa0411aa19672822665c0c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:06.080526 10043 raft_consensus.cc:2804] T 5e60b7cfdc344a748869fbee80c30cef P 9e380843f48544819091608f98a0c72f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:06.080996 10043 raft_consensus.cc:493] T 5e60b7cfdc344a748869fbee80c30cef P 9e380843f48544819091608f98a0c72f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:06.081359 10043 raft_consensus.cc:3060] T 5e60b7cfdc344a748869fbee80c30cef P 9e380843f48544819091608f98a0c72f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.081511 10010 tablet_bootstrap.cc:492] T 2baffcc7e478421295036241364bfcaf P 9e380843f48544819091608f98a0c72f: No bootstrap required, opened a new log
I20260709 12:23:06.082129 10010 ts_tablet_manager.cc:1403] T 2baffcc7e478421295036241364bfcaf P 9e380843f48544819091608f98a0c72f: Time spent bootstrapping tablet: real 0.039s	user 0.014s	sys 0.013s
I20260709 12:23:06.085489 10010 raft_consensus.cc:359] T 2baffcc7e478421295036241364bfcaf P 9e380843f48544819091608f98a0c72f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:06.086432 10010 raft_consensus.cc:385] T 2baffcc7e478421295036241364bfcaf P 9e380843f48544819091608f98a0c72f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:06.086689 10010 raft_consensus.cc:740] T 2baffcc7e478421295036241364bfcaf P 9e380843f48544819091608f98a0c72f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e380843f48544819091608f98a0c72f, State: Initialized, Role: FOLLOWER
I20260709 12:23:06.063297  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b7cfdc344a748869fbee80c30cef" candidate_uuid: "9e380843f48544819091608f98a0c72f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1bad12877874d57a97d81468a0879cc" is_pre_election: true
I20260709 12:23:06.087339 10010 consensus_queue.cc:260] T 2baffcc7e478421295036241364bfcaf P 9e380843f48544819091608f98a0c72f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:06.089740 10010 ts_tablet_manager.cc:1434] T 2baffcc7e478421295036241364bfcaf P 9e380843f48544819091608f98a0c72f: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:23:06.090711 10010 tablet_bootstrap.cc:492] T 02c174f129bc454a821e33e6427b6548 P 9e380843f48544819091608f98a0c72f: Bootstrap starting.
I20260709 12:23:06.091218 10043 raft_consensus.cc:515] T 5e60b7cfdc344a748869fbee80c30cef P 9e380843f48544819091608f98a0c72f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:06.094868  9965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b7cfdc344a748869fbee80c30cef" candidate_uuid: "9e380843f48544819091608f98a0c72f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1bad12877874d57a97d81468a0879cc"
I20260709 12:23:06.096343  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b7cfdc344a748869fbee80c30cef" candidate_uuid: "9e380843f48544819091608f98a0c72f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7381fd84faa0411aa19672822665c0c6"
I20260709 12:23:06.096882 10043 leader_election.cc:290] T 5e60b7cfdc344a748869fbee80c30cef P 9e380843f48544819091608f98a0c72f [CANDIDATE]: Term 1 election: Requested vote from peers 7381fd84faa0411aa19672822665c0c6 (127.9.116.66:40415), b1bad12877874d57a97d81468a0879cc (127.9.116.67:42315)
I20260709 12:23:06.096942  9890 raft_consensus.cc:3060] T 5e60b7cfdc344a748869fbee80c30cef P 7381fd84faa0411aa19672822665c0c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.097106 10010 tablet_bootstrap.cc:654] T 02c174f129bc454a821e33e6427b6548 P 9e380843f48544819091608f98a0c72f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:06.098136 10017 raft_consensus.cc:493] T 335ce65e703a4289be64bc4030886524 P 9e380843f48544819091608f98a0c72f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.100826 10017 raft_consensus.cc:515] T 335ce65e703a4289be64bc4030886524 P 9e380843f48544819091608f98a0c72f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:06.087833  9964 raft_consensus.cc:2468] T 5e60b7cfdc344a748869fbee80c30cef P b1bad12877874d57a97d81468a0879cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e380843f48544819091608f98a0c72f in term 0.
I20260709 12:23:06.103259 10017 leader_election.cc:290] T 335ce65e703a4289be64bc4030886524 P 9e380843f48544819091608f98a0c72f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7381fd84faa0411aa19672822665c0c6 (127.9.116.66:40415), b1bad12877874d57a97d81468a0879cc (127.9.116.67:42315)
I20260709 12:23:06.105123  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "335ce65e703a4289be64bc4030886524" candidate_uuid: "9e380843f48544819091608f98a0c72f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7381fd84faa0411aa19672822665c0c6" is_pre_election: true
I20260709 12:23:06.106326  9889 raft_consensus.cc:2393] T 335ce65e703a4289be64bc4030886524 P 7381fd84faa0411aa19672822665c0c6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e380843f48544819091608f98a0c72f in current term 1: Already voted for candidate b1bad12877874d57a97d81468a0879cc in this term.
I20260709 12:23:06.110339  9890 raft_consensus.cc:2468] T 5e60b7cfdc344a748869fbee80c30cef P 7381fd84faa0411aa19672822665c0c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e380843f48544819091608f98a0c72f in term 1.
I20260709 12:23:06.112187  9782 leader_election.cc:304] T 5e60b7cfdc344a748869fbee80c30cef P 9e380843f48544819091608f98a0c72f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7381fd84faa0411aa19672822665c0c6, 9e380843f48544819091608f98a0c72f; no voters: b1bad12877874d57a97d81468a0879cc
I20260709 12:23:06.113338 10017 raft_consensus.cc:2804] T 5e60b7cfdc344a748869fbee80c30cef P 9e380843f48544819091608f98a0c72f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:06.113644 10010 tablet_bootstrap.cc:492] T 02c174f129bc454a821e33e6427b6548 P 9e380843f48544819091608f98a0c72f: No bootstrap required, opened a new log
I20260709 12:23:06.113837 10017 raft_consensus.cc:697] T 5e60b7cfdc344a748869fbee80c30cef P 9e380843f48544819091608f98a0c72f [term 1 LEADER]: Becoming Leader. State: Replica: 9e380843f48544819091608f98a0c72f, State: Running, Role: LEADER
I20260709 12:23:06.114697 10010 ts_tablet_manager.cc:1403] T 02c174f129bc454a821e33e6427b6548 P 9e380843f48544819091608f98a0c72f: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.001s
I20260709 12:23:06.115124 10017 consensus_queue.cc:237] T 5e60b7cfdc344a748869fbee80c30cef P 9e380843f48544819091608f98a0c72f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:06.117657 10010 raft_consensus.cc:359] T 02c174f129bc454a821e33e6427b6548 P 9e380843f48544819091608f98a0c72f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:06.118374 10010 raft_consensus.cc:385] T 02c174f129bc454a821e33e6427b6548 P 9e380843f48544819091608f98a0c72f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:06.117456  9712 catalog_manager.cc:5697] T 48fcbe3ecfb44941b74325e03a8463e1 P 7381fd84faa0411aa19672822665c0c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7381fd84faa0411aa19672822665c0c6 (127.9.116.66). New cstate: current_term: 1 leader_uuid: "7381fd84faa0411aa19672822665c0c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:06.118669 10010 raft_consensus.cc:740] T 02c174f129bc454a821e33e6427b6548 P 9e380843f48544819091608f98a0c72f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e380843f48544819091608f98a0c72f, State: Initialized, Role: FOLLOWER
I20260709 12:23:06.120529 10010 consensus_queue.cc:260] T 02c174f129bc454a821e33e6427b6548 P 9e380843f48544819091608f98a0c72f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:06.121523  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "335ce65e703a4289be64bc4030886524" candidate_uuid: "9e380843f48544819091608f98a0c72f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1bad12877874d57a97d81468a0879cc" is_pre_election: true
I20260709 12:23:06.122586 10010 ts_tablet_manager.cc:1434] T 02c174f129bc454a821e33e6427b6548 P 9e380843f48544819091608f98a0c72f: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:23:06.123714  9779 leader_election.cc:304] T 335ce65e703a4289be64bc4030886524 P 9e380843f48544819091608f98a0c72f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e380843f48544819091608f98a0c72f; no voters: 7381fd84faa0411aa19672822665c0c6, b1bad12877874d57a97d81468a0879cc
I20260709 12:23:06.125433 10017 raft_consensus.cc:3060] T 335ce65e703a4289be64bc4030886524 P 9e380843f48544819091608f98a0c72f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.125510  9711 catalog_manager.cc:5697] T 5e60b7cfdc344a748869fbee80c30cef P 9e380843f48544819091608f98a0c72f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e380843f48544819091608f98a0c72f (127.9.116.65). New cstate: current_term: 1 leader_uuid: "9e380843f48544819091608f98a0c72f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:06.132201 10044 raft_consensus.cc:493] T 2baffcc7e478421295036241364bfcaf P 7381fd84faa0411aa19672822665c0c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.132931 10044 raft_consensus.cc:515] T 2baffcc7e478421295036241364bfcaf P 7381fd84faa0411aa19672822665c0c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:06.135453 10044 leader_election.cc:290] T 2baffcc7e478421295036241364bfcaf P 7381fd84faa0411aa19672822665c0c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e380843f48544819091608f98a0c72f (127.9.116.65:34569), b1bad12877874d57a97d81468a0879cc (127.9.116.67:42315)
I20260709 12:23:06.136641  9816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2baffcc7e478421295036241364bfcaf" candidate_uuid: "7381fd84faa0411aa19672822665c0c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e380843f48544819091608f98a0c72f" is_pre_election: true
I20260709 12:23:06.137393  9816 raft_consensus.cc:2468] T 2baffcc7e478421295036241364bfcaf P 9e380843f48544819091608f98a0c72f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7381fd84faa0411aa19672822665c0c6 in term 0.
I20260709 12:23:06.139261  9854 leader_election.cc:304] T 2baffcc7e478421295036241364bfcaf P 7381fd84faa0411aa19672822665c0c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7381fd84faa0411aa19672822665c0c6, 9e380843f48544819091608f98a0c72f; no voters: 
I20260709 12:23:06.140729 10017 raft_consensus.cc:2749] T 335ce65e703a4289be64bc4030886524 P 9e380843f48544819091608f98a0c72f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:06.140657  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2baffcc7e478421295036241364bfcaf" candidate_uuid: "7381fd84faa0411aa19672822665c0c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1bad12877874d57a97d81468a0879cc" is_pre_election: true
I20260709 12:23:06.141479  9964 raft_consensus.cc:2468] T 2baffcc7e478421295036241364bfcaf P b1bad12877874d57a97d81468a0879cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7381fd84faa0411aa19672822665c0c6 in term 0.
I20260709 12:23:06.142056 10044 raft_consensus.cc:2804] T 2baffcc7e478421295036241364bfcaf P 7381fd84faa0411aa19672822665c0c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:06.142515 10044 raft_consensus.cc:493] T 2baffcc7e478421295036241364bfcaf P 7381fd84faa0411aa19672822665c0c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:06.142943 10044 raft_consensus.cc:3060] T 2baffcc7e478421295036241364bfcaf P 7381fd84faa0411aa19672822665c0c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.155810 10044 raft_consensus.cc:515] T 2baffcc7e478421295036241364bfcaf P 7381fd84faa0411aa19672822665c0c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:06.158177 10044 leader_election.cc:290] T 2baffcc7e478421295036241364bfcaf P 7381fd84faa0411aa19672822665c0c6 [CANDIDATE]: Term 1 election: Requested vote from peers 9e380843f48544819091608f98a0c72f (127.9.116.65:34569), b1bad12877874d57a97d81468a0879cc (127.9.116.67:42315)
I20260709 12:23:06.159106 10017 raft_consensus.cc:493] T 2eea8dc76b734af3ad92320d2e4dbab2 P 9e380843f48544819091608f98a0c72f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.159566  9816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2baffcc7e478421295036241364bfcaf" candidate_uuid: "7381fd84faa0411aa19672822665c0c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e380843f48544819091608f98a0c72f"
I20260709 12:23:06.159934  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2baffcc7e478421295036241364bfcaf" candidate_uuid: "7381fd84faa0411aa19672822665c0c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1bad12877874d57a97d81468a0879cc"
I20260709 12:23:06.160197  9816 raft_consensus.cc:3060] T 2baffcc7e478421295036241364bfcaf P 9e380843f48544819091608f98a0c72f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.160468  9964 raft_consensus.cc:3060] T 2baffcc7e478421295036241364bfcaf P b1bad12877874d57a97d81468a0879cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.159561 10017 raft_consensus.cc:515] T 2eea8dc76b734af3ad92320d2e4dbab2 P 9e380843f48544819091608f98a0c72f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:06.166405 10017 leader_election.cc:290] T 2eea8dc76b734af3ad92320d2e4dbab2 P 9e380843f48544819091608f98a0c72f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7381fd84faa0411aa19672822665c0c6 (127.9.116.66:40415), b1bad12877874d57a97d81468a0879cc (127.9.116.67:42315)
I20260709 12:23:06.167696 10013 consensus_queue.cc:1048] T 335ce65e703a4289be64bc4030886524 P b1bad12877874d57a97d81468a0879cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:06.168498  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eea8dc76b734af3ad92320d2e4dbab2" candidate_uuid: "9e380843f48544819091608f98a0c72f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7381fd84faa0411aa19672822665c0c6" is_pre_election: true
I20260709 12:23:06.169610  9889 raft_consensus.cc:2393] T 2eea8dc76b734af3ad92320d2e4dbab2 P 7381fd84faa0411aa19672822665c0c6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e380843f48544819091608f98a0c72f in current term 1: Already voted for candidate b1bad12877874d57a97d81468a0879cc in this term.
I20260709 12:23:06.170989  9965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eea8dc76b734af3ad92320d2e4dbab2" candidate_uuid: "9e380843f48544819091608f98a0c72f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1bad12877874d57a97d81468a0879cc" is_pre_election: true
I20260709 12:23:06.173619  9782 leader_election.cc:304] T 2eea8dc76b734af3ad92320d2e4dbab2 P 9e380843f48544819091608f98a0c72f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e380843f48544819091608f98a0c72f; no voters: 7381fd84faa0411aa19672822665c0c6, b1bad12877874d57a97d81468a0879cc
I20260709 12:23:06.174775 10049 consensus_queue.cc:1048] T 335ce65e703a4289be64bc4030886524 P b1bad12877874d57a97d81468a0879cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:06.174906 10017 raft_consensus.cc:3060] T 2eea8dc76b734af3ad92320d2e4dbab2 P 9e380843f48544819091608f98a0c72f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.175814  9816 raft_consensus.cc:2468] T 2baffcc7e478421295036241364bfcaf P 9e380843f48544819091608f98a0c72f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7381fd84faa0411aa19672822665c0c6 in term 1.
I20260709 12:23:06.177708  9854 leader_election.cc:304] T 2baffcc7e478421295036241364bfcaf P 7381fd84faa0411aa19672822665c0c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7381fd84faa0411aa19672822665c0c6, 9e380843f48544819091608f98a0c72f; no voters: 
I20260709 12:23:06.178961 10012 raft_consensus.cc:2804] T 2baffcc7e478421295036241364bfcaf P 7381fd84faa0411aa19672822665c0c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:06.179625 10012 raft_consensus.cc:697] T 2baffcc7e478421295036241364bfcaf P 7381fd84faa0411aa19672822665c0c6 [term 1 LEADER]: Becoming Leader. State: Replica: 7381fd84faa0411aa19672822665c0c6, State: Running, Role: LEADER
I20260709 12:23:06.180667 10012 consensus_queue.cc:237] T 2baffcc7e478421295036241364bfcaf P 7381fd84faa0411aa19672822665c0c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:06.184834  9964 raft_consensus.cc:2468] T 2baffcc7e478421295036241364bfcaf P b1bad12877874d57a97d81468a0879cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7381fd84faa0411aa19672822665c0c6 in term 1.
I20260709 12:23:06.192488 10017 raft_consensus.cc:2749] T 2eea8dc76b734af3ad92320d2e4dbab2 P 9e380843f48544819091608f98a0c72f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:06.207511  9964 raft_consensus.cc:3060] T 85f2c8f75bef41a0a04f80205611c054 P b1bad12877874d57a97d81468a0879cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.207996  9712 catalog_manager.cc:5697] T 2baffcc7e478421295036241364bfcaf P 7381fd84faa0411aa19672822665c0c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7381fd84faa0411aa19672822665c0c6 (127.9.116.66). New cstate: current_term: 1 leader_uuid: "7381fd84faa0411aa19672822665c0c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:06.218513 10044 consensus_queue.cc:1048] T 85f2c8f75bef41a0a04f80205611c054 P 7381fd84faa0411aa19672822665c0c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:06.248687 10049 consensus_queue.cc:1048] T 2eea8dc76b734af3ad92320d2e4dbab2 P b1bad12877874d57a97d81468a0879cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:06.254952 10046 consensus_queue.cc:1048] T 85f2c8f75bef41a0a04f80205611c054 P 7381fd84faa0411aa19672822665c0c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:06.257050 10017 consensus_queue.cc:1048] T 88209028e06042419fced28068c1542b P 9e380843f48544819091608f98a0c72f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:06.282974 10043 consensus_queue.cc:1048] T 88209028e06042419fced28068c1542b P 9e380843f48544819091608f98a0c72f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:06.298599 10038 consensus_queue.cc:1048] T 2eea8dc76b734af3ad92320d2e4dbab2 P b1bad12877874d57a97d81468a0879cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:06.331121  9816 raft_consensus.cc:3060] T 02c174f129bc454a821e33e6427b6548 P 9e380843f48544819091608f98a0c72f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.340155 10012 consensus_queue.cc:1048] T 02c174f129bc454a821e33e6427b6548 P 7381fd84faa0411aa19672822665c0c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:06.354638 10046 consensus_queue.cc:1048] T 02c174f129bc454a821e33e6427b6548 P 7381fd84faa0411aa19672822665c0c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:06.436421 10043 consensus_queue.cc:1048] T 152402cdfb684f4d9bdbc6828f9160fe P 9e380843f48544819091608f98a0c72f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:06.450379 10017 consensus_queue.cc:1048] T 152402cdfb684f4d9bdbc6828f9160fe P 9e380843f48544819091608f98a0c72f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:06.524134  9964 raft_consensus.cc:3060] T 5e60b7cfdc344a748869fbee80c30cef P b1bad12877874d57a97d81468a0879cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:06.530900 10087 consensus_queue.cc:1048] T 5e60b7cfdc344a748869fbee80c30cef P 9e380843f48544819091608f98a0c72f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:06.545470 10087 consensus_queue.cc:1048] T 5e60b7cfdc344a748869fbee80c30cef P 9e380843f48544819091608f98a0c72f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:06.564322 10046 consensus_queue.cc:1048] T 48fcbe3ecfb44941b74325e03a8463e1 P 7381fd84faa0411aa19672822665c0c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:06.587632 10012 consensus_queue.cc:1048] T 48fcbe3ecfb44941b74325e03a8463e1 P 7381fd84faa0411aa19672822665c0c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:06.606751  9965 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "335ce65e703a4289be64bc4030886524"
dest_uuid: "b1bad12877874d57a97d81468a0879cc"
mode: GRACEFUL
new_leader_uuid: "9e380843f48544819091608f98a0c72f"
 from {username='slave'} at 127.0.0.1:45584
I20260709 12:23:06.607960  9965 raft_consensus.cc:606] T 335ce65e703a4289be64bc4030886524 P b1bad12877874d57a97d81468a0879cc [term 1 LEADER]: Received request to transfer leadership to TS 9e380843f48544819091608f98a0c72f
I20260709 12:23:06.629329  9889 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "48fcbe3ecfb44941b74325e03a8463e1"
dest_uuid: "7381fd84faa0411aa19672822665c0c6"
mode: GRACEFUL
new_leader_uuid: "9e380843f48544819091608f98a0c72f"
 from {username='slave'} at 127.0.0.1:54036
I20260709 12:23:06.630321  9889 raft_consensus.cc:606] T 48fcbe3ecfb44941b74325e03a8463e1 P 7381fd84faa0411aa19672822665c0c6 [term 1 LEADER]: Received request to transfer leadership to TS 9e380843f48544819091608f98a0c72f
I20260709 12:23:06.654733  9816 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "152402cdfb684f4d9bdbc6828f9160fe"
dest_uuid: "9e380843f48544819091608f98a0c72f"
mode: GRACEFUL
new_leader_uuid: "7381fd84faa0411aa19672822665c0c6"
 from {username='slave'} at 127.0.0.1:43906
I20260709 12:23:06.655537  9816 raft_consensus.cc:606] T 152402cdfb684f4d9bdbc6828f9160fe P 9e380843f48544819091608f98a0c72f [term 1 LEADER]: Received request to transfer leadership to TS 7381fd84faa0411aa19672822665c0c6
I20260709 12:23:06.774016 10044 consensus_queue.cc:1048] T 2baffcc7e478421295036241364bfcaf P 7381fd84faa0411aa19672822665c0c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:06.776302 10044 consensus_queue.cc:1048] T 2baffcc7e478421295036241364bfcaf P 7381fd84faa0411aa19672822665c0c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:06.892647 10043 raft_consensus.cc:993] T 152402cdfb684f4d9bdbc6828f9160fe P 9e380843f48544819091608f98a0c72f: : Instructing follower 7381fd84faa0411aa19672822665c0c6 to start an election
I20260709 12:23:06.893527 10043 raft_consensus.cc:1081] T 152402cdfb684f4d9bdbc6828f9160fe P 9e380843f48544819091608f98a0c72f [term 1 LEADER]: Signalling peer 7381fd84faa0411aa19672822665c0c6 to start an election
I20260709 12:23:06.895440  9889 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "152402cdfb684f4d9bdbc6828f9160fe"
dest_uuid: "7381fd84faa0411aa19672822665c0c6"
 from {username='slave'} at 127.0.0.1:54024
I20260709 12:23:06.896246  9889 raft_consensus.cc:493] T 152402cdfb684f4d9bdbc6828f9160fe P 7381fd84faa0411aa19672822665c0c6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:06.896669  9889 raft_consensus.cc:3060] T 152402cdfb684f4d9bdbc6828f9160fe P 7381fd84faa0411aa19672822665c0c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:06.902681  9889 raft_consensus.cc:515] T 152402cdfb684f4d9bdbc6828f9160fe P 7381fd84faa0411aa19672822665c0c6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:06.905076  9889 leader_election.cc:290] T 152402cdfb684f4d9bdbc6828f9160fe P 7381fd84faa0411aa19672822665c0c6 [CANDIDATE]: Term 2 election: Requested vote from peers 9e380843f48544819091608f98a0c72f (127.9.116.65:34569), b1bad12877874d57a97d81468a0879cc (127.9.116.67:42315)
I20260709 12:23:06.906656  9816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "152402cdfb684f4d9bdbc6828f9160fe" candidate_uuid: "7381fd84faa0411aa19672822665c0c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e380843f48544819091608f98a0c72f"
I20260709 12:23:06.906952  9965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "152402cdfb684f4d9bdbc6828f9160fe" candidate_uuid: "7381fd84faa0411aa19672822665c0c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b1bad12877874d57a97d81468a0879cc"
I20260709 12:23:06.908789  9816 raft_consensus.cc:3055] T 152402cdfb684f4d9bdbc6828f9160fe P 9e380843f48544819091608f98a0c72f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:06.909226  9816 raft_consensus.cc:740] T 152402cdfb684f4d9bdbc6828f9160fe P 9e380843f48544819091608f98a0c72f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e380843f48544819091608f98a0c72f, State: Running, Role: LEADER
I20260709 12:23:06.909271  9965 raft_consensus.cc:3060] T 152402cdfb684f4d9bdbc6828f9160fe P b1bad12877874d57a97d81468a0879cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:06.912323  9816 consensus_queue.cc:260] T 152402cdfb684f4d9bdbc6828f9160fe P 9e380843f48544819091608f98a0c72f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:06.914485  9816 raft_consensus.cc:3060] T 152402cdfb684f4d9bdbc6828f9160fe P 9e380843f48544819091608f98a0c72f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:06.918742  9965 raft_consensus.cc:2468] T 152402cdfb684f4d9bdbc6828f9160fe P b1bad12877874d57a97d81468a0879cc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7381fd84faa0411aa19672822665c0c6 in term 2.
I20260709 12:23:06.920356  9854 leader_election.cc:304] T 152402cdfb684f4d9bdbc6828f9160fe P 7381fd84faa0411aa19672822665c0c6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7381fd84faa0411aa19672822665c0c6, b1bad12877874d57a97d81468a0879cc; no voters: 
I20260709 12:23:06.921274 10012 raft_consensus.cc:2804] T 152402cdfb684f4d9bdbc6828f9160fe P 7381fd84faa0411aa19672822665c0c6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:06.921890  9816 raft_consensus.cc:2468] T 152402cdfb684f4d9bdbc6828f9160fe P 9e380843f48544819091608f98a0c72f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7381fd84faa0411aa19672822665c0c6 in term 2.
I20260709 12:23:06.923939 10012 raft_consensus.cc:697] T 152402cdfb684f4d9bdbc6828f9160fe P 7381fd84faa0411aa19672822665c0c6 [term 2 LEADER]: Becoming Leader. State: Replica: 7381fd84faa0411aa19672822665c0c6, State: Running, Role: LEADER
I20260709 12:23:06.924826 10012 consensus_queue.cc:237] T 152402cdfb684f4d9bdbc6828f9160fe P 7381fd84faa0411aa19672822665c0c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:06.935424  9711 catalog_manager.cc:5697] T 152402cdfb684f4d9bdbc6828f9160fe P 7381fd84faa0411aa19672822665c0c6 reported cstate change: term changed from 1 to 2, leader changed from 9e380843f48544819091608f98a0c72f (127.9.116.65) to 7381fd84faa0411aa19672822665c0c6 (127.9.116.66). New cstate: current_term: 2 leader_uuid: "7381fd84faa0411aa19672822665c0c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:07.047478 10040 raft_consensus.cc:993] T 335ce65e703a4289be64bc4030886524 P b1bad12877874d57a97d81468a0879cc: : Instructing follower 9e380843f48544819091608f98a0c72f to start an election
I20260709 12:23:07.048029 10013 raft_consensus.cc:1081] T 335ce65e703a4289be64bc4030886524 P b1bad12877874d57a97d81468a0879cc [term 1 LEADER]: Signalling peer 9e380843f48544819091608f98a0c72f to start an election
I20260709 12:23:07.050276  9816 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "335ce65e703a4289be64bc4030886524"
dest_uuid: "9e380843f48544819091608f98a0c72f"
 from {username='slave'} at 127.0.0.1:43884
I20260709 12:23:07.051002  9816 raft_consensus.cc:493] T 335ce65e703a4289be64bc4030886524 P 9e380843f48544819091608f98a0c72f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:07.051613  9816 raft_consensus.cc:3060] T 335ce65e703a4289be64bc4030886524 P 9e380843f48544819091608f98a0c72f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:07.056957  9816 raft_consensus.cc:515] T 335ce65e703a4289be64bc4030886524 P 9e380843f48544819091608f98a0c72f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:07.059655  9816 leader_election.cc:290] T 335ce65e703a4289be64bc4030886524 P 9e380843f48544819091608f98a0c72f [CANDIDATE]: Term 2 election: Requested vote from peers 7381fd84faa0411aa19672822665c0c6 (127.9.116.66:40415), b1bad12877874d57a97d81468a0879cc (127.9.116.67:42315)
I20260709 12:23:07.060708  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "335ce65e703a4289be64bc4030886524" candidate_uuid: "9e380843f48544819091608f98a0c72f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7381fd84faa0411aa19672822665c0c6"
I20260709 12:23:07.060930  9965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "335ce65e703a4289be64bc4030886524" candidate_uuid: "9e380843f48544819091608f98a0c72f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b1bad12877874d57a97d81468a0879cc"
I20260709 12:23:07.061359  9889 raft_consensus.cc:3060] T 335ce65e703a4289be64bc4030886524 P 7381fd84faa0411aa19672822665c0c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:07.061630  9965 raft_consensus.cc:3055] T 335ce65e703a4289be64bc4030886524 P b1bad12877874d57a97d81468a0879cc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:07.062055  9965 raft_consensus.cc:740] T 335ce65e703a4289be64bc4030886524 P b1bad12877874d57a97d81468a0879cc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b1bad12877874d57a97d81468a0879cc, State: Running, Role: LEADER
I20260709 12:23:07.063094  9965 consensus_queue.cc:260] T 335ce65e703a4289be64bc4030886524 P b1bad12877874d57a97d81468a0879cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:07.065021  9965 raft_consensus.cc:3060] T 335ce65e703a4289be64bc4030886524 P b1bad12877874d57a97d81468a0879cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:07.071988  9889 raft_consensus.cc:2468] T 335ce65e703a4289be64bc4030886524 P 7381fd84faa0411aa19672822665c0c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e380843f48544819091608f98a0c72f in term 2.
I20260709 12:23:07.073882  9965 raft_consensus.cc:2468] T 335ce65e703a4289be64bc4030886524 P b1bad12877874d57a97d81468a0879cc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e380843f48544819091608f98a0c72f in term 2.
I20260709 12:23:07.073889  9782 leader_election.cc:304] T 335ce65e703a4289be64bc4030886524 P 9e380843f48544819091608f98a0c72f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7381fd84faa0411aa19672822665c0c6, 9e380843f48544819091608f98a0c72f; no voters: 
I20260709 12:23:07.075346 10043 raft_consensus.cc:2804] T 335ce65e703a4289be64bc4030886524 P 9e380843f48544819091608f98a0c72f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:07.075948 10043 raft_consensus.cc:697] T 335ce65e703a4289be64bc4030886524 P 9e380843f48544819091608f98a0c72f [term 2 LEADER]: Becoming Leader. State: Replica: 9e380843f48544819091608f98a0c72f, State: Running, Role: LEADER
I20260709 12:23:07.076824 10043 consensus_queue.cc:237] T 335ce65e703a4289be64bc4030886524 P 9e380843f48544819091608f98a0c72f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:07.085897  9711 catalog_manager.cc:5697] T 335ce65e703a4289be64bc4030886524 P 9e380843f48544819091608f98a0c72f reported cstate change: term changed from 1 to 2, leader changed from b1bad12877874d57a97d81468a0879cc (127.9.116.67) to 9e380843f48544819091608f98a0c72f (127.9.116.65). New cstate: current_term: 2 leader_uuid: "9e380843f48544819091608f98a0c72f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:07.110695 10044 raft_consensus.cc:993] T 48fcbe3ecfb44941b74325e03a8463e1 P 7381fd84faa0411aa19672822665c0c6: : Instructing follower 9e380843f48544819091608f98a0c72f to start an election
I20260709 12:23:07.111480 10099 raft_consensus.cc:1081] T 48fcbe3ecfb44941b74325e03a8463e1 P 7381fd84faa0411aa19672822665c0c6 [term 1 LEADER]: Signalling peer 9e380843f48544819091608f98a0c72f to start an election
I20260709 12:23:07.114048  9816 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "48fcbe3ecfb44941b74325e03a8463e1"
dest_uuid: "9e380843f48544819091608f98a0c72f"
 from {username='slave'} at 127.0.0.1:43898
I20260709 12:23:07.114779  9816 raft_consensus.cc:493] T 48fcbe3ecfb44941b74325e03a8463e1 P 9e380843f48544819091608f98a0c72f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:07.115186  9816 raft_consensus.cc:3060] T 48fcbe3ecfb44941b74325e03a8463e1 P 9e380843f48544819091608f98a0c72f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:07.121977  9816 raft_consensus.cc:515] T 48fcbe3ecfb44941b74325e03a8463e1 P 9e380843f48544819091608f98a0c72f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:07.124325  9816 leader_election.cc:290] T 48fcbe3ecfb44941b74325e03a8463e1 P 9e380843f48544819091608f98a0c72f [CANDIDATE]: Term 2 election: Requested vote from peers 7381fd84faa0411aa19672822665c0c6 (127.9.116.66:40415), b1bad12877874d57a97d81468a0879cc (127.9.116.67:42315)
I20260709 12:23:07.125914  9965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48fcbe3ecfb44941b74325e03a8463e1" candidate_uuid: "9e380843f48544819091608f98a0c72f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b1bad12877874d57a97d81468a0879cc"
I20260709 12:23:07.125991  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48fcbe3ecfb44941b74325e03a8463e1" candidate_uuid: "9e380843f48544819091608f98a0c72f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7381fd84faa0411aa19672822665c0c6"
I20260709 12:23:07.126611  9965 raft_consensus.cc:3060] T 48fcbe3ecfb44941b74325e03a8463e1 P b1bad12877874d57a97d81468a0879cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:07.126865  9889 raft_consensus.cc:3055] T 48fcbe3ecfb44941b74325e03a8463e1 P 7381fd84faa0411aa19672822665c0c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:07.127404  9889 raft_consensus.cc:740] T 48fcbe3ecfb44941b74325e03a8463e1 P 7381fd84faa0411aa19672822665c0c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7381fd84faa0411aa19672822665c0c6, State: Running, Role: LEADER
I20260709 12:23:07.128481  9889 consensus_queue.cc:260] T 48fcbe3ecfb44941b74325e03a8463e1 P 7381fd84faa0411aa19672822665c0c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:07.130321  9889 raft_consensus.cc:3060] T 48fcbe3ecfb44941b74325e03a8463e1 P 7381fd84faa0411aa19672822665c0c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:07.134227  9965 raft_consensus.cc:2468] T 48fcbe3ecfb44941b74325e03a8463e1 P b1bad12877874d57a97d81468a0879cc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e380843f48544819091608f98a0c72f in term 2.
I20260709 12:23:07.135850  9779 leader_election.cc:304] T 48fcbe3ecfb44941b74325e03a8463e1 P 9e380843f48544819091608f98a0c72f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e380843f48544819091608f98a0c72f, b1bad12877874d57a97d81468a0879cc; no voters: 
I20260709 12:23:07.136778 10043 raft_consensus.cc:2804] T 48fcbe3ecfb44941b74325e03a8463e1 P 9e380843f48544819091608f98a0c72f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:07.137267 10043 raft_consensus.cc:697] T 48fcbe3ecfb44941b74325e03a8463e1 P 9e380843f48544819091608f98a0c72f [term 2 LEADER]: Becoming Leader. State: Replica: 9e380843f48544819091608f98a0c72f, State: Running, Role: LEADER
I20260709 12:23:07.138144 10043 consensus_queue.cc:237] T 48fcbe3ecfb44941b74325e03a8463e1 P 9e380843f48544819091608f98a0c72f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:07.139144  9889 raft_consensus.cc:2468] T 48fcbe3ecfb44941b74325e03a8463e1 P 7381fd84faa0411aa19672822665c0c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e380843f48544819091608f98a0c72f in term 2.
I20260709 12:23:07.147086  9711 catalog_manager.cc:5697] T 48fcbe3ecfb44941b74325e03a8463e1 P 9e380843f48544819091608f98a0c72f reported cstate change: term changed from 1 to 2, leader changed from 7381fd84faa0411aa19672822665c0c6 (127.9.116.66) to 9e380843f48544819091608f98a0c72f (127.9.116.65). New cstate: current_term: 2 leader_uuid: "9e380843f48544819091608f98a0c72f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:07.396130  9816 raft_consensus.cc:1275] T 152402cdfb684f4d9bdbc6828f9160fe P 9e380843f48544819091608f98a0c72f [term 2 FOLLOWER]: Refusing update from remote peer 7381fd84faa0411aa19672822665c0c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:07.397415 10099 consensus_queue.cc:1048] T 152402cdfb684f4d9bdbc6828f9160fe P 7381fd84faa0411aa19672822665c0c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:07.407670  9965 raft_consensus.cc:1275] T 152402cdfb684f4d9bdbc6828f9160fe P b1bad12877874d57a97d81468a0879cc [term 2 FOLLOWER]: Refusing update from remote peer 7381fd84faa0411aa19672822665c0c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:07.409026 10012 consensus_queue.cc:1048] T 152402cdfb684f4d9bdbc6828f9160fe P 7381fd84faa0411aa19672822665c0c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:07.502463  9965 raft_consensus.cc:1275] T 335ce65e703a4289be64bc4030886524 P b1bad12877874d57a97d81468a0879cc [term 2 FOLLOWER]: Refusing update from remote peer 9e380843f48544819091608f98a0c72f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:07.504295 10043 consensus_queue.cc:1048] T 335ce65e703a4289be64bc4030886524 P 9e380843f48544819091608f98a0c72f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:07.514719  9889 raft_consensus.cc:1275] T 335ce65e703a4289be64bc4030886524 P 7381fd84faa0411aa19672822665c0c6 [term 2 FOLLOWER]: Refusing update from remote peer 9e380843f48544819091608f98a0c72f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:07.517165 10043 consensus_queue.cc:1048] T 335ce65e703a4289be64bc4030886524 P 9e380843f48544819091608f98a0c72f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:07.739758  9889 raft_consensus.cc:1275] T 48fcbe3ecfb44941b74325e03a8463e1 P 7381fd84faa0411aa19672822665c0c6 [term 2 FOLLOWER]: Refusing update from remote peer 9e380843f48544819091608f98a0c72f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:07.741634 10043 consensus_queue.cc:1048] T 48fcbe3ecfb44941b74325e03a8463e1 P 9e380843f48544819091608f98a0c72f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:07.752682  9965 raft_consensus.cc:1275] T 48fcbe3ecfb44941b74325e03a8463e1 P b1bad12877874d57a97d81468a0879cc [term 2 FOLLOWER]: Refusing update from remote peer 9e380843f48544819091608f98a0c72f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:07.754441 10043 consensus_queue.cc:1048] T 48fcbe3ecfb44941b74325e03a8463e1 P 9e380843f48544819091608f98a0c72f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:09.699506  9681 auto_leader_rebalancer-test.cc:294] The leader distribution is 
I20260709 12:23:09.700803  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:09.724380  9816 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e60b7cfdc344a748869fbee80c30cef"
dest_uuid: "9e380843f48544819091608f98a0c72f"
mode: GRACEFUL
new_leader_uuid: "b1bad12877874d57a97d81468a0879cc"
 from {username='slave'} at 127.0.0.1:45376
I20260709 12:23:09.724895  9816 raft_consensus.cc:606] T 5e60b7cfdc344a748869fbee80c30cef P 9e380843f48544819091608f98a0c72f [term 1 LEADER]: Received request to transfer leadership to TS b1bad12877874d57a97d81468a0879cc
I20260709 12:23:09.737613  9889 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "85f2c8f75bef41a0a04f80205611c054"
dest_uuid: "7381fd84faa0411aa19672822665c0c6"
mode: GRACEFUL
new_leader_uuid: "b1bad12877874d57a97d81468a0879cc"
 from {username='slave'} at 127.0.0.1:59198
I20260709 12:23:09.738266  9889 raft_consensus.cc:606] T 85f2c8f75bef41a0a04f80205611c054 P 7381fd84faa0411aa19672822665c0c6 [term 1 LEADER]: Received request to transfer leadership to TS b1bad12877874d57a97d81468a0879cc
I20260709 12:23:09.739804  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:23:09.740377  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:09.887471 10111 raft_consensus.cc:993] T 85f2c8f75bef41a0a04f80205611c054 P 7381fd84faa0411aa19672822665c0c6: : Instructing follower b1bad12877874d57a97d81468a0879cc to start an election
I20260709 12:23:09.888067 10115 raft_consensus.cc:1081] T 85f2c8f75bef41a0a04f80205611c054 P 7381fd84faa0411aa19672822665c0c6 [term 1 LEADER]: Signalling peer b1bad12877874d57a97d81468a0879cc to start an election
I20260709 12:23:09.890026  9965 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "85f2c8f75bef41a0a04f80205611c054"
dest_uuid: "b1bad12877874d57a97d81468a0879cc"
 from {username='slave'} at 127.0.0.1:45558
I20260709 12:23:09.890501  9965 raft_consensus.cc:493] T 85f2c8f75bef41a0a04f80205611c054 P b1bad12877874d57a97d81468a0879cc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:09.890777  9965 raft_consensus.cc:3060] T 85f2c8f75bef41a0a04f80205611c054 P b1bad12877874d57a97d81468a0879cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:09.895363  9965 raft_consensus.cc:515] T 85f2c8f75bef41a0a04f80205611c054 P b1bad12877874d57a97d81468a0879cc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:09.897953  9965 leader_election.cc:290] T 85f2c8f75bef41a0a04f80205611c054 P b1bad12877874d57a97d81468a0879cc [CANDIDATE]: Term 2 election: Requested vote from peers 9e380843f48544819091608f98a0c72f (127.9.116.65:34569), 7381fd84faa0411aa19672822665c0c6 (127.9.116.66:40415)
I20260709 12:23:09.899164  9816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85f2c8f75bef41a0a04f80205611c054" candidate_uuid: "b1bad12877874d57a97d81468a0879cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e380843f48544819091608f98a0c72f"
I20260709 12:23:09.899398  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85f2c8f75bef41a0a04f80205611c054" candidate_uuid: "b1bad12877874d57a97d81468a0879cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7381fd84faa0411aa19672822665c0c6"
I20260709 12:23:09.899952  9816 raft_consensus.cc:3060] T 85f2c8f75bef41a0a04f80205611c054 P 9e380843f48544819091608f98a0c72f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:09.900144  9889 raft_consensus.cc:3055] T 85f2c8f75bef41a0a04f80205611c054 P 7381fd84faa0411aa19672822665c0c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:09.900560  9889 raft_consensus.cc:740] T 85f2c8f75bef41a0a04f80205611c054 P 7381fd84faa0411aa19672822665c0c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7381fd84faa0411aa19672822665c0c6, State: Running, Role: LEADER
I20260709 12:23:09.901305  9889 consensus_queue.cc:260] T 85f2c8f75bef41a0a04f80205611c054 P 7381fd84faa0411aa19672822665c0c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:09.902745  9889 raft_consensus.cc:3060] T 85f2c8f75bef41a0a04f80205611c054 P 7381fd84faa0411aa19672822665c0c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:09.906353  9816 raft_consensus.cc:2468] T 85f2c8f75bef41a0a04f80205611c054 P 9e380843f48544819091608f98a0c72f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1bad12877874d57a97d81468a0879cc in term 2.
I20260709 12:23:09.907857  9928 leader_election.cc:304] T 85f2c8f75bef41a0a04f80205611c054 P b1bad12877874d57a97d81468a0879cc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e380843f48544819091608f98a0c72f, b1bad12877874d57a97d81468a0879cc; no voters: 
I20260709 12:23:09.908854 10013 raft_consensus.cc:2804] T 85f2c8f75bef41a0a04f80205611c054 P b1bad12877874d57a97d81468a0879cc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:09.909888  9889 raft_consensus.cc:2468] T 85f2c8f75bef41a0a04f80205611c054 P 7381fd84faa0411aa19672822665c0c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1bad12877874d57a97d81468a0879cc in term 2.
I20260709 12:23:09.910324 10013 raft_consensus.cc:697] T 85f2c8f75bef41a0a04f80205611c054 P b1bad12877874d57a97d81468a0879cc [term 2 LEADER]: Becoming Leader. State: Replica: b1bad12877874d57a97d81468a0879cc, State: Running, Role: LEADER
I20260709 12:23:09.911299 10013 consensus_queue.cc:237] T 85f2c8f75bef41a0a04f80205611c054 P b1bad12877874d57a97d81468a0879cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:09.918802  9712 catalog_manager.cc:5697] T 85f2c8f75bef41a0a04f80205611c054 P b1bad12877874d57a97d81468a0879cc reported cstate change: term changed from 1 to 2, leader changed from 7381fd84faa0411aa19672822665c0c6 (127.9.116.66) to b1bad12877874d57a97d81468a0879cc (127.9.116.67). New cstate: current_term: 2 leader_uuid: "b1bad12877874d57a97d81468a0879cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:10.177425 10107 raft_consensus.cc:993] T 5e60b7cfdc344a748869fbee80c30cef P 9e380843f48544819091608f98a0c72f: : Instructing follower b1bad12877874d57a97d81468a0879cc to start an election
I20260709 12:23:10.178186 10107 raft_consensus.cc:1081] T 5e60b7cfdc344a748869fbee80c30cef P 9e380843f48544819091608f98a0c72f [term 1 LEADER]: Signalling peer b1bad12877874d57a97d81468a0879cc to start an election
I20260709 12:23:10.180158  9965 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5e60b7cfdc344a748869fbee80c30cef"
dest_uuid: "b1bad12877874d57a97d81468a0879cc"
 from {username='slave'} at 127.0.0.1:45570
I20260709 12:23:10.180768  9965 raft_consensus.cc:493] T 5e60b7cfdc344a748869fbee80c30cef P b1bad12877874d57a97d81468a0879cc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:10.181052  9965 raft_consensus.cc:3060] T 5e60b7cfdc344a748869fbee80c30cef P b1bad12877874d57a97d81468a0879cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:10.186816  9965 raft_consensus.cc:515] T 5e60b7cfdc344a748869fbee80c30cef P b1bad12877874d57a97d81468a0879cc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:10.188609  9965 leader_election.cc:290] T 5e60b7cfdc344a748869fbee80c30cef P b1bad12877874d57a97d81468a0879cc [CANDIDATE]: Term 2 election: Requested vote from peers 9e380843f48544819091608f98a0c72f (127.9.116.65:34569), 7381fd84faa0411aa19672822665c0c6 (127.9.116.66:40415)
I20260709 12:23:10.189774  9816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b7cfdc344a748869fbee80c30cef" candidate_uuid: "b1bad12877874d57a97d81468a0879cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e380843f48544819091608f98a0c72f"
I20260709 12:23:10.189774  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b7cfdc344a748869fbee80c30cef" candidate_uuid: "b1bad12877874d57a97d81468a0879cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7381fd84faa0411aa19672822665c0c6"
I20260709 12:23:10.190603  9889 raft_consensus.cc:3060] T 5e60b7cfdc344a748869fbee80c30cef P 7381fd84faa0411aa19672822665c0c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:10.190596  9816 raft_consensus.cc:3055] T 5e60b7cfdc344a748869fbee80c30cef P 9e380843f48544819091608f98a0c72f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:10.191141  9816 raft_consensus.cc:740] T 5e60b7cfdc344a748869fbee80c30cef P 9e380843f48544819091608f98a0c72f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e380843f48544819091608f98a0c72f, State: Running, Role: LEADER
I20260709 12:23:10.192001  9816 consensus_queue.cc:260] T 5e60b7cfdc344a748869fbee80c30cef P 9e380843f48544819091608f98a0c72f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:10.193290  9816 raft_consensus.cc:3060] T 5e60b7cfdc344a748869fbee80c30cef P 9e380843f48544819091608f98a0c72f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:10.198019  9889 raft_consensus.cc:2468] T 5e60b7cfdc344a748869fbee80c30cef P 7381fd84faa0411aa19672822665c0c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1bad12877874d57a97d81468a0879cc in term 2.
I20260709 12:23:10.199685  9931 leader_election.cc:304] T 5e60b7cfdc344a748869fbee80c30cef P b1bad12877874d57a97d81468a0879cc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7381fd84faa0411aa19672822665c0c6, b1bad12877874d57a97d81468a0879cc; no voters: 
I20260709 12:23:10.200003  9816 raft_consensus.cc:2468] T 5e60b7cfdc344a748869fbee80c30cef P 9e380843f48544819091608f98a0c72f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1bad12877874d57a97d81468a0879cc in term 2.
I20260709 12:23:10.200565 10013 raft_consensus.cc:2804] T 5e60b7cfdc344a748869fbee80c30cef P b1bad12877874d57a97d81468a0879cc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:10.201084 10013 raft_consensus.cc:697] T 5e60b7cfdc344a748869fbee80c30cef P b1bad12877874d57a97d81468a0879cc [term 2 LEADER]: Becoming Leader. State: Replica: b1bad12877874d57a97d81468a0879cc, State: Running, Role: LEADER
I20260709 12:23:10.201957 10013 consensus_queue.cc:237] T 5e60b7cfdc344a748869fbee80c30cef P b1bad12877874d57a97d81468a0879cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:10.210681  9712 catalog_manager.cc:5697] T 5e60b7cfdc344a748869fbee80c30cef P b1bad12877874d57a97d81468a0879cc reported cstate change: term changed from 1 to 2, leader changed from 9e380843f48544819091608f98a0c72f (127.9.116.65) to b1bad12877874d57a97d81468a0879cc (127.9.116.67). New cstate: current_term: 2 leader_uuid: "b1bad12877874d57a97d81468a0879cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:10.452658  9889 raft_consensus.cc:1275] T 85f2c8f75bef41a0a04f80205611c054 P 7381fd84faa0411aa19672822665c0c6 [term 2 FOLLOWER]: Refusing update from remote peer b1bad12877874d57a97d81468a0879cc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:10.453985 10013 consensus_queue.cc:1048] T 85f2c8f75bef41a0a04f80205611c054 P b1bad12877874d57a97d81468a0879cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:10.467226  9816 raft_consensus.cc:1275] T 85f2c8f75bef41a0a04f80205611c054 P 9e380843f48544819091608f98a0c72f [term 2 FOLLOWER]: Refusing update from remote peer b1bad12877874d57a97d81468a0879cc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:10.469991 10013 consensus_queue.cc:1048] T 85f2c8f75bef41a0a04f80205611c054 P b1bad12877874d57a97d81468a0879cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:23:10.589471  9814 raft_consensus.cc:1275] T 5e60b7cfdc344a748869fbee80c30cef P 9e380843f48544819091608f98a0c72f [term 2 FOLLOWER]: Refusing update from remote peer b1bad12877874d57a97d81468a0879cc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:10.590945 10129 consensus_queue.cc:1048] T 5e60b7cfdc344a748869fbee80c30cef P b1bad12877874d57a97d81468a0879cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:10.602694  9889 raft_consensus.cc:1275] T 5e60b7cfdc344a748869fbee80c30cef P 7381fd84faa0411aa19672822665c0c6 [term 2 FOLLOWER]: Refusing update from remote peer b1bad12877874d57a97d81468a0879cc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:10.605093 10117 consensus_queue.cc:1048] T 5e60b7cfdc344a748869fbee80c30cef P b1bad12877874d57a97d81468a0879cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:10.741956  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:10.748153  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:10.748610  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:11.749754  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:11.754914  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:11.755398  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:12.756912  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:12.763314  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:12.763834  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:13.765192  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:13.772179  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:13.772578  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:14.773784  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:14.779294  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:14.779863  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:15.781270  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:15.786695  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:15.787140  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:16.788228  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:16.793519  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:16.793905  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:17.795061  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:17.800169  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:17.800601  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:18.801772  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:18.807948  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:18.808449  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:19.844583  9681 auto_leader_rebalancer-test.cc:313] The leader distribution is 
I20260709 12:23:19.850452  9814 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "88209028e06042419fced28068c1542b"
dest_uuid: "9e380843f48544819091608f98a0c72f"
mode: GRACEFUL
new_leader_uuid: "7381fd84faa0411aa19672822665c0c6"
 from {username='slave'} at 127.0.0.1:43906
I20260709 12:23:19.851116  9814 raft_consensus.cc:606] T 88209028e06042419fced28068c1542b P 9e380843f48544819091608f98a0c72f [term 1 LEADER]: Received request to transfer leadership to TS 7381fd84faa0411aa19672822665c0c6
I20260709 12:23:19.857641  9814 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "335ce65e703a4289be64bc4030886524"
dest_uuid: "9e380843f48544819091608f98a0c72f"
mode: GRACEFUL
new_leader_uuid: "7381fd84faa0411aa19672822665c0c6"
 from {username='slave'} at 127.0.0.1:43906
I20260709 12:23:19.858217  9814 raft_consensus.cc:606] T 335ce65e703a4289be64bc4030886524 P 9e380843f48544819091608f98a0c72f [term 2 LEADER]: Received request to transfer leadership to TS 7381fd84faa0411aa19672822665c0c6
I20260709 12:23:19.864357 10143 raft_consensus.cc:993] T 88209028e06042419fced28068c1542b P 9e380843f48544819091608f98a0c72f: : Instructing follower 7381fd84faa0411aa19672822665c0c6 to start an election
I20260709 12:23:19.865093 10141 raft_consensus.cc:1081] T 88209028e06042419fced28068c1542b P 9e380843f48544819091608f98a0c72f [term 1 LEADER]: Signalling peer 7381fd84faa0411aa19672822665c0c6 to start an election
I20260709 12:23:19.865345  9964 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e60b7cfdc344a748869fbee80c30cef"
dest_uuid: "b1bad12877874d57a97d81468a0879cc"
mode: GRACEFUL
new_leader_uuid: "7381fd84faa0411aa19672822665c0c6"
 from {username='slave'} at 127.0.0.1:45584
I20260709 12:23:19.866168  9964 raft_consensus.cc:606] T 5e60b7cfdc344a748869fbee80c30cef P b1bad12877874d57a97d81468a0879cc [term 2 LEADER]: Received request to transfer leadership to TS 7381fd84faa0411aa19672822665c0c6
I20260709 12:23:19.867062  9890 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "88209028e06042419fced28068c1542b"
dest_uuid: "7381fd84faa0411aa19672822665c0c6"
 from {username='slave'} at 127.0.0.1:54024
I20260709 12:23:19.867667  9890 raft_consensus.cc:493] T 88209028e06042419fced28068c1542b P 7381fd84faa0411aa19672822665c0c6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:19.868193  9890 raft_consensus.cc:3060] T 88209028e06042419fced28068c1542b P 7381fd84faa0411aa19672822665c0c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:19.872457  9814 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "48fcbe3ecfb44941b74325e03a8463e1"
dest_uuid: "9e380843f48544819091608f98a0c72f"
mode: GRACEFUL
new_leader_uuid: "7381fd84faa0411aa19672822665c0c6"
 from {username='slave'} at 127.0.0.1:43906
I20260709 12:23:19.873019  9814 raft_consensus.cc:606] T 48fcbe3ecfb44941b74325e03a8463e1 P 9e380843f48544819091608f98a0c72f [term 2 LEADER]: Received request to transfer leadership to TS 7381fd84faa0411aa19672822665c0c6
I20260709 12:23:19.875680  9890 raft_consensus.cc:515] T 88209028e06042419fced28068c1542b P 7381fd84faa0411aa19672822665c0c6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:19.877902  9890 leader_election.cc:290] T 88209028e06042419fced28068c1542b P 7381fd84faa0411aa19672822665c0c6 [CANDIDATE]: Term 2 election: Requested vote from peers 9e380843f48544819091608f98a0c72f (127.9.116.65:34569), b1bad12877874d57a97d81468a0879cc (127.9.116.67:42315)
I20260709 12:23:19.878851  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88209028e06042419fced28068c1542b" candidate_uuid: "7381fd84faa0411aa19672822665c0c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e380843f48544819091608f98a0c72f"
I20260709 12:23:19.879961  9814 raft_consensus.cc:3055] T 88209028e06042419fced28068c1542b P 9e380843f48544819091608f98a0c72f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:19.880281  9814 raft_consensus.cc:740] T 88209028e06042419fced28068c1542b P 9e380843f48544819091608f98a0c72f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e380843f48544819091608f98a0c72f, State: Running, Role: LEADER
I20260709 12:23:19.881165  9814 consensus_queue.cc:260] T 88209028e06042419fced28068c1542b P 9e380843f48544819091608f98a0c72f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:19.882146  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88209028e06042419fced28068c1542b" candidate_uuid: "7381fd84faa0411aa19672822665c0c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b1bad12877874d57a97d81468a0879cc"
I20260709 12:23:19.882731  9814 raft_consensus.cc:3060] T 88209028e06042419fced28068c1542b P 9e380843f48544819091608f98a0c72f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:19.882758  9964 raft_consensus.cc:3060] T 88209028e06042419fced28068c1542b P b1bad12877874d57a97d81468a0879cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:19.889709  9965 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "85f2c8f75bef41a0a04f80205611c054"
dest_uuid: "b1bad12877874d57a97d81468a0879cc"
mode: GRACEFUL
new_leader_uuid: "7381fd84faa0411aa19672822665c0c6"
 from {username='slave'} at 127.0.0.1:45584
I20260709 12:23:19.890237  9965 raft_consensus.cc:606] T 85f2c8f75bef41a0a04f80205611c054 P b1bad12877874d57a97d81468a0879cc [term 2 LEADER]: Received request to transfer leadership to TS 7381fd84faa0411aa19672822665c0c6
I20260709 12:23:19.890988  9964 raft_consensus.cc:2468] T 88209028e06042419fced28068c1542b P b1bad12877874d57a97d81468a0879cc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7381fd84faa0411aa19672822665c0c6 in term 2.
I20260709 12:23:19.892365  9854 leader_election.cc:304] T 88209028e06042419fced28068c1542b P 7381fd84faa0411aa19672822665c0c6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7381fd84faa0411aa19672822665c0c6, b1bad12877874d57a97d81468a0879cc; no voters: 
I20260709 12:23:19.893227 10115 raft_consensus.cc:2804] T 88209028e06042419fced28068c1542b P 7381fd84faa0411aa19672822665c0c6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:19.894294  9814 raft_consensus.cc:2468] T 88209028e06042419fced28068c1542b P 9e380843f48544819091608f98a0c72f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7381fd84faa0411aa19672822665c0c6 in term 2.
I20260709 12:23:19.895506 10115 raft_consensus.cc:697] T 88209028e06042419fced28068c1542b P 7381fd84faa0411aa19672822665c0c6 [term 2 LEADER]: Becoming Leader. State: Replica: 7381fd84faa0411aa19672822665c0c6, State: Running, Role: LEADER
I20260709 12:23:19.896505 10115 consensus_queue.cc:237] T 88209028e06042419fced28068c1542b P 7381fd84faa0411aa19672822665c0c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:19.897823 10145 raft_consensus.cc:993] T 5e60b7cfdc344a748869fbee80c30cef P b1bad12877874d57a97d81468a0879cc: : Instructing follower 7381fd84faa0411aa19672822665c0c6 to start an election
I20260709 12:23:19.898716 10135 raft_consensus.cc:1081] T 5e60b7cfdc344a748869fbee80c30cef P b1bad12877874d57a97d81468a0879cc [term 2 LEADER]: Signalling peer 7381fd84faa0411aa19672822665c0c6 to start an election
I20260709 12:23:19.900764  9890 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5e60b7cfdc344a748869fbee80c30cef"
dest_uuid: "7381fd84faa0411aa19672822665c0c6"
 from {username='slave'} at 127.0.0.1:54016
I20260709 12:23:19.901309  9890 raft_consensus.cc:493] T 5e60b7cfdc344a748869fbee80c30cef P 7381fd84faa0411aa19672822665c0c6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:19.901633  9890 raft_consensus.cc:3060] T 5e60b7cfdc344a748869fbee80c30cef P 7381fd84faa0411aa19672822665c0c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:19.906877  9890 raft_consensus.cc:515] T 5e60b7cfdc344a748869fbee80c30cef P 7381fd84faa0411aa19672822665c0c6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:19.909076  9890 leader_election.cc:290] T 5e60b7cfdc344a748869fbee80c30cef P 7381fd84faa0411aa19672822665c0c6 [CANDIDATE]: Term 3 election: Requested vote from peers 9e380843f48544819091608f98a0c72f (127.9.116.65:34569), b1bad12877874d57a97d81468a0879cc (127.9.116.67:42315)
I20260709 12:23:19.910643  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b7cfdc344a748869fbee80c30cef" candidate_uuid: "7381fd84faa0411aa19672822665c0c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9e380843f48544819091608f98a0c72f"
I20260709 12:23:19.910728  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e60b7cfdc344a748869fbee80c30cef" candidate_uuid: "7381fd84faa0411aa19672822665c0c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b1bad12877874d57a97d81468a0879cc"
I20260709 12:23:19.911398  9814 raft_consensus.cc:3060] T 5e60b7cfdc344a748869fbee80c30cef P 9e380843f48544819091608f98a0c72f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:19.911491  9964 raft_consensus.cc:3055] T 5e60b7cfdc344a748869fbee80c30cef P b1bad12877874d57a97d81468a0879cc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:19.911922  9964 raft_consensus.cc:740] T 5e60b7cfdc344a748869fbee80c30cef P b1bad12877874d57a97d81468a0879cc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b1bad12877874d57a97d81468a0879cc, State: Running, Role: LEADER
I20260709 12:23:19.912660  9964 consensus_queue.cc:260] T 5e60b7cfdc344a748869fbee80c30cef P b1bad12877874d57a97d81468a0879cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:19.913820  9964 raft_consensus.cc:3060] T 5e60b7cfdc344a748869fbee80c30cef P b1bad12877874d57a97d81468a0879cc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:19.913708  9711 catalog_manager.cc:5697] T 88209028e06042419fced28068c1542b P 7381fd84faa0411aa19672822665c0c6 reported cstate change: term changed from 1 to 2, leader changed from 9e380843f48544819091608f98a0c72f (127.9.116.65) to 7381fd84faa0411aa19672822665c0c6 (127.9.116.66). New cstate: current_term: 2 leader_uuid: "7381fd84faa0411aa19672822665c0c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:19.919507  9964 raft_consensus.cc:2468] T 5e60b7cfdc344a748869fbee80c30cef P b1bad12877874d57a97d81468a0879cc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7381fd84faa0411aa19672822665c0c6 in term 3.
I20260709 12:23:19.919764  9814 raft_consensus.cc:2468] T 5e60b7cfdc344a748869fbee80c30cef P 9e380843f48544819091608f98a0c72f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7381fd84faa0411aa19672822665c0c6 in term 3.
I20260709 12:23:19.921074  9854 leader_election.cc:304] T 5e60b7cfdc344a748869fbee80c30cef P 7381fd84faa0411aa19672822665c0c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7381fd84faa0411aa19672822665c0c6, 9e380843f48544819091608f98a0c72f; no voters: 
I20260709 12:23:19.921777 10115 raft_consensus.cc:2804] T 5e60b7cfdc344a748869fbee80c30cef P 7381fd84faa0411aa19672822665c0c6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:19.922282 10115 raft_consensus.cc:697] T 5e60b7cfdc344a748869fbee80c30cef P 7381fd84faa0411aa19672822665c0c6 [term 3 LEADER]: Becoming Leader. State: Replica: 7381fd84faa0411aa19672822665c0c6, State: Running, Role: LEADER
I20260709 12:23:19.923197 10115 consensus_queue.cc:237] T 5e60b7cfdc344a748869fbee80c30cef P 7381fd84faa0411aa19672822665c0c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:19.935491  9711 catalog_manager.cc:5697] T 5e60b7cfdc344a748869fbee80c30cef P 7381fd84faa0411aa19672822665c0c6 reported cstate change: term changed from 2 to 3, leader changed from b1bad12877874d57a97d81468a0879cc (127.9.116.67) to 7381fd84faa0411aa19672822665c0c6 (127.9.116.66). New cstate: current_term: 3 leader_uuid: "7381fd84faa0411aa19672822665c0c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:20.106633 10143 raft_consensus.cc:993] T 48fcbe3ecfb44941b74325e03a8463e1 P 9e380843f48544819091608f98a0c72f: : Instructing follower 7381fd84faa0411aa19672822665c0c6 to start an election
I20260709 12:23:20.107149 10141 raft_consensus.cc:1081] T 48fcbe3ecfb44941b74325e03a8463e1 P 9e380843f48544819091608f98a0c72f [term 2 LEADER]: Signalling peer 7381fd84faa0411aa19672822665c0c6 to start an election
I20260709 12:23:20.108568  9890 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "48fcbe3ecfb44941b74325e03a8463e1"
dest_uuid: "7381fd84faa0411aa19672822665c0c6"
 from {username='slave'} at 127.0.0.1:54024
I20260709 12:23:20.109009  9890 raft_consensus.cc:493] T 48fcbe3ecfb44941b74325e03a8463e1 P 7381fd84faa0411aa19672822665c0c6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:20.109279  9890 raft_consensus.cc:3060] T 48fcbe3ecfb44941b74325e03a8463e1 P 7381fd84faa0411aa19672822665c0c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:20.115653  9890 raft_consensus.cc:515] T 48fcbe3ecfb44941b74325e03a8463e1 P 7381fd84faa0411aa19672822665c0c6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:20.118111  9890 leader_election.cc:290] T 48fcbe3ecfb44941b74325e03a8463e1 P 7381fd84faa0411aa19672822665c0c6 [CANDIDATE]: Term 3 election: Requested vote from peers 9e380843f48544819091608f98a0c72f (127.9.116.65:34569), b1bad12877874d57a97d81468a0879cc (127.9.116.67:42315)
I20260709 12:23:20.119616  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48fcbe3ecfb44941b74325e03a8463e1" candidate_uuid: "7381fd84faa0411aa19672822665c0c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9e380843f48544819091608f98a0c72f"
I20260709 12:23:20.119904  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48fcbe3ecfb44941b74325e03a8463e1" candidate_uuid: "7381fd84faa0411aa19672822665c0c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b1bad12877874d57a97d81468a0879cc"
I20260709 12:23:20.120268  9814 raft_consensus.cc:3055] T 48fcbe3ecfb44941b74325e03a8463e1 P 9e380843f48544819091608f98a0c72f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:20.120430  9964 raft_consensus.cc:3060] T 48fcbe3ecfb44941b74325e03a8463e1 P b1bad12877874d57a97d81468a0879cc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:20.120641  9814 raft_consensus.cc:740] T 48fcbe3ecfb44941b74325e03a8463e1 P 9e380843f48544819091608f98a0c72f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9e380843f48544819091608f98a0c72f, State: Running, Role: LEADER
I20260709 12:23:20.121516  9814 consensus_queue.cc:260] T 48fcbe3ecfb44941b74325e03a8463e1 P 9e380843f48544819091608f98a0c72f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:20.122820  9814 raft_consensus.cc:3060] T 48fcbe3ecfb44941b74325e03a8463e1 P 9e380843f48544819091608f98a0c72f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:20.128022 10143 raft_consensus.cc:993] T 335ce65e703a4289be64bc4030886524 P 9e380843f48544819091608f98a0c72f: : Instructing follower 7381fd84faa0411aa19672822665c0c6 to start an election
I20260709 12:23:20.128548  9964 raft_consensus.cc:2468] T 48fcbe3ecfb44941b74325e03a8463e1 P b1bad12877874d57a97d81468a0879cc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7381fd84faa0411aa19672822665c0c6 in term 3.
I20260709 12:23:20.128592 10143 raft_consensus.cc:1081] T 335ce65e703a4289be64bc4030886524 P 9e380843f48544819091608f98a0c72f [term 2 LEADER]: Signalling peer 7381fd84faa0411aa19672822665c0c6 to start an election
I20260709 12:23:20.130227  9814 raft_consensus.cc:2468] T 48fcbe3ecfb44941b74325e03a8463e1 P 9e380843f48544819091608f98a0c72f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7381fd84faa0411aa19672822665c0c6 in term 3.
I20260709 12:23:20.130386  9854 leader_election.cc:304] T 48fcbe3ecfb44941b74325e03a8463e1 P 7381fd84faa0411aa19672822665c0c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7381fd84faa0411aa19672822665c0c6, b1bad12877874d57a97d81468a0879cc; no voters: 
I20260709 12:23:20.130780  9890 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "335ce65e703a4289be64bc4030886524"
dest_uuid: "7381fd84faa0411aa19672822665c0c6"
 from {username='slave'} at 127.0.0.1:54024
I20260709 12:23:20.131433  9890 raft_consensus.cc:493] T 335ce65e703a4289be64bc4030886524 P 7381fd84faa0411aa19672822665c0c6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:20.131696 10115 raft_consensus.cc:2804] T 48fcbe3ecfb44941b74325e03a8463e1 P 7381fd84faa0411aa19672822665c0c6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:20.131963  9890 raft_consensus.cc:3060] T 335ce65e703a4289be64bc4030886524 P 7381fd84faa0411aa19672822665c0c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:20.132336 10115 raft_consensus.cc:697] T 48fcbe3ecfb44941b74325e03a8463e1 P 7381fd84faa0411aa19672822665c0c6 [term 3 LEADER]: Becoming Leader. State: Replica: 7381fd84faa0411aa19672822665c0c6, State: Running, Role: LEADER
I20260709 12:23:20.133239 10115 consensus_queue.cc:237] T 48fcbe3ecfb44941b74325e03a8463e1 P 7381fd84faa0411aa19672822665c0c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:20.140364  9890 raft_consensus.cc:515] T 335ce65e703a4289be64bc4030886524 P 7381fd84faa0411aa19672822665c0c6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:20.142738  9890 leader_election.cc:290] T 335ce65e703a4289be64bc4030886524 P 7381fd84faa0411aa19672822665c0c6 [CANDIDATE]: Term 3 election: Requested vote from peers 9e380843f48544819091608f98a0c72f (127.9.116.65:34569), b1bad12877874d57a97d81468a0879cc (127.9.116.67:42315)
I20260709 12:23:20.142270  9711 catalog_manager.cc:5697] T 48fcbe3ecfb44941b74325e03a8463e1 P 7381fd84faa0411aa19672822665c0c6 reported cstate change: term changed from 2 to 3, leader changed from 9e380843f48544819091608f98a0c72f (127.9.116.65) to 7381fd84faa0411aa19672822665c0c6 (127.9.116.66). New cstate: current_term: 3 leader_uuid: "7381fd84faa0411aa19672822665c0c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:20.143879  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "335ce65e703a4289be64bc4030886524" candidate_uuid: "7381fd84faa0411aa19672822665c0c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9e380843f48544819091608f98a0c72f"
I20260709 12:23:20.144281  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "335ce65e703a4289be64bc4030886524" candidate_uuid: "7381fd84faa0411aa19672822665c0c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b1bad12877874d57a97d81468a0879cc"
I20260709 12:23:20.144590  9814 raft_consensus.cc:3055] T 335ce65e703a4289be64bc4030886524 P 9e380843f48544819091608f98a0c72f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:20.144755  9964 raft_consensus.cc:3060] T 335ce65e703a4289be64bc4030886524 P b1bad12877874d57a97d81468a0879cc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:20.144942  9814 raft_consensus.cc:740] T 335ce65e703a4289be64bc4030886524 P 9e380843f48544819091608f98a0c72f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9e380843f48544819091608f98a0c72f, State: Running, Role: LEADER
I20260709 12:23:20.145988  9814 consensus_queue.cc:260] T 335ce65e703a4289be64bc4030886524 P 9e380843f48544819091608f98a0c72f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:20.147222  9814 raft_consensus.cc:3060] T 335ce65e703a4289be64bc4030886524 P 9e380843f48544819091608f98a0c72f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:20.151547  9964 raft_consensus.cc:2468] T 335ce65e703a4289be64bc4030886524 P b1bad12877874d57a97d81468a0879cc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7381fd84faa0411aa19672822665c0c6 in term 3.
I20260709 12:23:20.152868  9854 leader_election.cc:304] T 335ce65e703a4289be64bc4030886524 P 7381fd84faa0411aa19672822665c0c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7381fd84faa0411aa19672822665c0c6, b1bad12877874d57a97d81468a0879cc; no voters: 
I20260709 12:23:20.153661 10115 raft_consensus.cc:2804] T 335ce65e703a4289be64bc4030886524 P 7381fd84faa0411aa19672822665c0c6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:20.154390 10115 raft_consensus.cc:697] T 335ce65e703a4289be64bc4030886524 P 7381fd84faa0411aa19672822665c0c6 [term 3 LEADER]: Becoming Leader. State: Replica: 7381fd84faa0411aa19672822665c0c6, State: Running, Role: LEADER
I20260709 12:23:20.154564  9814 raft_consensus.cc:2468] T 335ce65e703a4289be64bc4030886524 P 9e380843f48544819091608f98a0c72f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7381fd84faa0411aa19672822665c0c6 in term 3.
I20260709 12:23:20.155604 10115 consensus_queue.cc:237] T 335ce65e703a4289be64bc4030886524 P 7381fd84faa0411aa19672822665c0c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:20.163729  9711 catalog_manager.cc:5697] T 335ce65e703a4289be64bc4030886524 P 7381fd84faa0411aa19672822665c0c6 reported cstate change: term changed from 2 to 3, leader changed from 9e380843f48544819091608f98a0c72f (127.9.116.65) to 7381fd84faa0411aa19672822665c0c6 (127.9.116.66). New cstate: current_term: 3 leader_uuid: "7381fd84faa0411aa19672822665c0c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:20.214349 10145 raft_consensus.cc:993] T 85f2c8f75bef41a0a04f80205611c054 P b1bad12877874d57a97d81468a0879cc: : Instructing follower 7381fd84faa0411aa19672822665c0c6 to start an election
I20260709 12:23:20.214797 10145 raft_consensus.cc:1081] T 85f2c8f75bef41a0a04f80205611c054 P b1bad12877874d57a97d81468a0879cc [term 2 LEADER]: Signalling peer 7381fd84faa0411aa19672822665c0c6 to start an election
I20260709 12:23:20.216521  9890 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "85f2c8f75bef41a0a04f80205611c054"
dest_uuid: "7381fd84faa0411aa19672822665c0c6"
 from {username='slave'} at 127.0.0.1:54016
I20260709 12:23:20.217130  9890 raft_consensus.cc:493] T 85f2c8f75bef41a0a04f80205611c054 P 7381fd84faa0411aa19672822665c0c6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:20.217419  9890 raft_consensus.cc:3060] T 85f2c8f75bef41a0a04f80205611c054 P 7381fd84faa0411aa19672822665c0c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:20.222630  9890 raft_consensus.cc:515] T 85f2c8f75bef41a0a04f80205611c054 P 7381fd84faa0411aa19672822665c0c6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:20.224253  9890 leader_election.cc:290] T 85f2c8f75bef41a0a04f80205611c054 P 7381fd84faa0411aa19672822665c0c6 [CANDIDATE]: Term 3 election: Requested vote from peers 9e380843f48544819091608f98a0c72f (127.9.116.65:34569), b1bad12877874d57a97d81468a0879cc (127.9.116.67:42315)
I20260709 12:23:20.225379  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85f2c8f75bef41a0a04f80205611c054" candidate_uuid: "7381fd84faa0411aa19672822665c0c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9e380843f48544819091608f98a0c72f"
I20260709 12:23:20.225663  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85f2c8f75bef41a0a04f80205611c054" candidate_uuid: "7381fd84faa0411aa19672822665c0c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b1bad12877874d57a97d81468a0879cc"
I20260709 12:23:20.226150  9814 raft_consensus.cc:3060] T 85f2c8f75bef41a0a04f80205611c054 P 9e380843f48544819091608f98a0c72f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:20.226233  9964 raft_consensus.cc:3055] T 85f2c8f75bef41a0a04f80205611c054 P b1bad12877874d57a97d81468a0879cc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:20.226601  9964 raft_consensus.cc:740] T 85f2c8f75bef41a0a04f80205611c054 P b1bad12877874d57a97d81468a0879cc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b1bad12877874d57a97d81468a0879cc, State: Running, Role: LEADER
I20260709 12:23:20.227427  9964 consensus_queue.cc:260] T 85f2c8f75bef41a0a04f80205611c054 P b1bad12877874d57a97d81468a0879cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:20.228924  9964 raft_consensus.cc:3060] T 85f2c8f75bef41a0a04f80205611c054 P b1bad12877874d57a97d81468a0879cc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:20.233693  9814 raft_consensus.cc:2468] T 85f2c8f75bef41a0a04f80205611c054 P 9e380843f48544819091608f98a0c72f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7381fd84faa0411aa19672822665c0c6 in term 3.
I20260709 12:23:20.235081  9854 leader_election.cc:304] T 85f2c8f75bef41a0a04f80205611c054 P 7381fd84faa0411aa19672822665c0c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7381fd84faa0411aa19672822665c0c6, 9e380843f48544819091608f98a0c72f; no voters: 
I20260709 12:23:20.236037  9964 raft_consensus.cc:2468] T 85f2c8f75bef41a0a04f80205611c054 P b1bad12877874d57a97d81468a0879cc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7381fd84faa0411aa19672822665c0c6 in term 3.
I20260709 12:23:20.236306 10144 raft_consensus.cc:2804] T 85f2c8f75bef41a0a04f80205611c054 P 7381fd84faa0411aa19672822665c0c6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:20.236795 10144 raft_consensus.cc:697] T 85f2c8f75bef41a0a04f80205611c054 P 7381fd84faa0411aa19672822665c0c6 [term 3 LEADER]: Becoming Leader. State: Replica: 7381fd84faa0411aa19672822665c0c6, State: Running, Role: LEADER
I20260709 12:23:20.237707 10144 consensus_queue.cc:237] T 85f2c8f75bef41a0a04f80205611c054 P 7381fd84faa0411aa19672822665c0c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:20.244783  9711 catalog_manager.cc:5697] T 85f2c8f75bef41a0a04f80205611c054 P 7381fd84faa0411aa19672822665c0c6 reported cstate change: term changed from 2 to 3, leader changed from b1bad12877874d57a97d81468a0879cc (127.9.116.67) to 7381fd84faa0411aa19672822665c0c6 (127.9.116.66). New cstate: current_term: 3 leader_uuid: "7381fd84faa0411aa19672822665c0c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:20.293071  9814 raft_consensus.cc:1275] T 88209028e06042419fced28068c1542b P 9e380843f48544819091608f98a0c72f [term 2 FOLLOWER]: Refusing update from remote peer 7381fd84faa0411aa19672822665c0c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:20.294687 10144 consensus_queue.cc:1048] T 88209028e06042419fced28068c1542b P 7381fd84faa0411aa19672822665c0c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:20.308336  9964 raft_consensus.cc:1275] T 88209028e06042419fced28068c1542b P b1bad12877874d57a97d81468a0879cc [term 2 FOLLOWER]: Refusing update from remote peer 7381fd84faa0411aa19672822665c0c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:20.309682 10144 consensus_queue.cc:1048] T 88209028e06042419fced28068c1542b P 7381fd84faa0411aa19672822665c0c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:20.396199  9964 raft_consensus.cc:1275] T 5e60b7cfdc344a748869fbee80c30cef P b1bad12877874d57a97d81468a0879cc [term 3 FOLLOWER]: Refusing update from remote peer 7381fd84faa0411aa19672822665c0c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:20.398193 10144 consensus_queue.cc:1048] T 5e60b7cfdc344a748869fbee80c30cef P 7381fd84faa0411aa19672822665c0c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:20.398967  9814 raft_consensus.cc:1275] T 5e60b7cfdc344a748869fbee80c30cef P 9e380843f48544819091608f98a0c72f [term 3 FOLLOWER]: Refusing update from remote peer 7381fd84faa0411aa19672822665c0c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:20.400843 10144 consensus_queue.cc:1048] T 5e60b7cfdc344a748869fbee80c30cef P 7381fd84faa0411aa19672822665c0c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:20.668772  9965 raft_consensus.cc:1275] T 335ce65e703a4289be64bc4030886524 P b1bad12877874d57a97d81468a0879cc [term 3 FOLLOWER]: Refusing update from remote peer 7381fd84faa0411aa19672822665c0c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:20.669896 10162 consensus_queue.cc:1048] T 335ce65e703a4289be64bc4030886524 P 7381fd84faa0411aa19672822665c0c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:20.679028  9814 raft_consensus.cc:1275] T 335ce65e703a4289be64bc4030886524 P 9e380843f48544819091608f98a0c72f [term 3 FOLLOWER]: Refusing update from remote peer 7381fd84faa0411aa19672822665c0c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:20.680378 10162 consensus_queue.cc:1048] T 335ce65e703a4289be64bc4030886524 P 7381fd84faa0411aa19672822665c0c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:20.703048  9965 raft_consensus.cc:1275] T 48fcbe3ecfb44941b74325e03a8463e1 P b1bad12877874d57a97d81468a0879cc [term 3 FOLLOWER]: Refusing update from remote peer 7381fd84faa0411aa19672822665c0c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:20.704607 10162 consensus_queue.cc:1048] T 48fcbe3ecfb44941b74325e03a8463e1 P 7381fd84faa0411aa19672822665c0c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:20.706744  9814 raft_consensus.cc:1275] T 85f2c8f75bef41a0a04f80205611c054 P 9e380843f48544819091608f98a0c72f [term 3 FOLLOWER]: Refusing update from remote peer 7381fd84faa0411aa19672822665c0c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:20.708364 10144 consensus_queue.cc:1048] T 85f2c8f75bef41a0a04f80205611c054 P 7381fd84faa0411aa19672822665c0c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:20.718588  9965 raft_consensus.cc:1275] T 85f2c8f75bef41a0a04f80205611c054 P b1bad12877874d57a97d81468a0879cc [term 3 FOLLOWER]: Refusing update from remote peer 7381fd84faa0411aa19672822665c0c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:20.720753 10162 consensus_queue.cc:1048] T 85f2c8f75bef41a0a04f80205611c054 P 7381fd84faa0411aa19672822665c0c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:23:20.735384  9816 raft_consensus.cc:1275] T 48fcbe3ecfb44941b74325e03a8463e1 P 9e380843f48544819091608f98a0c72f [term 3 FOLLOWER]: Refusing update from remote peer 7381fd84faa0411aa19672822665c0c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:20.737874 10115 consensus_queue.cc:1048] T 48fcbe3ecfb44941b74325e03a8463e1 P 7381fd84faa0411aa19672822665c0c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:22.935195  9681 auto_leader_rebalancer-test.cc:328] The leader distribution is 
I20260709 12:23:22.936203  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:22.944255  9890 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "152402cdfb684f4d9bdbc6828f9160fe"
dest_uuid: "7381fd84faa0411aa19672822665c0c6"
mode: GRACEFUL
new_leader_uuid: "9e380843f48544819091608f98a0c72f"
 from {username='slave'} at 127.0.0.1:59198
I20260709 12:23:22.944976  9890 raft_consensus.cc:606] T 152402cdfb684f4d9bdbc6828f9160fe P 7381fd84faa0411aa19672822665c0c6 [term 2 LEADER]: Received request to transfer leadership to TS 9e380843f48544819091608f98a0c72f
I20260709 12:23:22.949090  9890 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2baffcc7e478421295036241364bfcaf"
dest_uuid: "7381fd84faa0411aa19672822665c0c6"
mode: GRACEFUL
new_leader_uuid: "9e380843f48544819091608f98a0c72f"
 from {username='slave'} at 127.0.0.1:59198
I20260709 12:23:22.949800  9890 raft_consensus.cc:606] T 2baffcc7e478421295036241364bfcaf P 7381fd84faa0411aa19672822665c0c6 [term 1 LEADER]: Received request to transfer leadership to TS 9e380843f48544819091608f98a0c72f
I20260709 12:23:22.952673  9890 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "335ce65e703a4289be64bc4030886524"
dest_uuid: "7381fd84faa0411aa19672822665c0c6"
mode: GRACEFUL
new_leader_uuid: "9e380843f48544819091608f98a0c72f"
 from {username='slave'} at 127.0.0.1:59198
I20260709 12:23:22.953279  9890 raft_consensus.cc:606] T 335ce65e703a4289be64bc4030886524 P 7381fd84faa0411aa19672822665c0c6 [term 3 LEADER]: Received request to transfer leadership to TS 9e380843f48544819091608f98a0c72f
I20260709 12:23:22.955996  9890 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "85f2c8f75bef41a0a04f80205611c054"
dest_uuid: "7381fd84faa0411aa19672822665c0c6"
mode: GRACEFUL
new_leader_uuid: "b1bad12877874d57a97d81468a0879cc"
 from {username='slave'} at 127.0.0.1:59198
I20260709 12:23:22.956591  9890 raft_consensus.cc:606] T 85f2c8f75bef41a0a04f80205611c054 P 7381fd84faa0411aa19672822665c0c6 [term 3 LEADER]: Received request to transfer leadership to TS b1bad12877874d57a97d81468a0879cc
I20260709 12:23:22.959848  9890 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "88209028e06042419fced28068c1542b"
dest_uuid: "7381fd84faa0411aa19672822665c0c6"
mode: GRACEFUL
new_leader_uuid: "b1bad12877874d57a97d81468a0879cc"
 from {username='slave'} at 127.0.0.1:59198
I20260709 12:23:22.960508  9890 raft_consensus.cc:606] T 88209028e06042419fced28068c1542b P 7381fd84faa0411aa19672822665c0c6 [term 2 LEADER]: Received request to transfer leadership to TS b1bad12877874d57a97d81468a0879cc
I20260709 12:23:22.961858  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:23:22.962451  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:23.035386 10115 raft_consensus.cc:993] T 2baffcc7e478421295036241364bfcaf P 7381fd84faa0411aa19672822665c0c6: : Instructing follower 9e380843f48544819091608f98a0c72f to start an election
I20260709 12:23:23.035869 10115 raft_consensus.cc:1081] T 2baffcc7e478421295036241364bfcaf P 7381fd84faa0411aa19672822665c0c6 [term 1 LEADER]: Signalling peer 9e380843f48544819091608f98a0c72f to start an election
I20260709 12:23:23.037704  9816 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2baffcc7e478421295036241364bfcaf"
dest_uuid: "9e380843f48544819091608f98a0c72f"
 from {username='slave'} at 127.0.0.1:43898
I20260709 12:23:23.038414  9816 raft_consensus.cc:493] T 2baffcc7e478421295036241364bfcaf P 9e380843f48544819091608f98a0c72f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:23.038925  9816 raft_consensus.cc:3060] T 2baffcc7e478421295036241364bfcaf P 9e380843f48544819091608f98a0c72f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:23.045585  9816 raft_consensus.cc:515] T 2baffcc7e478421295036241364bfcaf P 9e380843f48544819091608f98a0c72f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:23.048894  9816 leader_election.cc:290] T 2baffcc7e478421295036241364bfcaf P 9e380843f48544819091608f98a0c72f [CANDIDATE]: Term 2 election: Requested vote from peers 7381fd84faa0411aa19672822665c0c6 (127.9.116.66:40415), b1bad12877874d57a97d81468a0879cc (127.9.116.67:42315)
I20260709 12:23:23.050417  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2baffcc7e478421295036241364bfcaf" candidate_uuid: "9e380843f48544819091608f98a0c72f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b1bad12877874d57a97d81468a0879cc"
I20260709 12:23:23.050027  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2baffcc7e478421295036241364bfcaf" candidate_uuid: "9e380843f48544819091608f98a0c72f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7381fd84faa0411aa19672822665c0c6"
I20260709 12:23:23.051204  9964 raft_consensus.cc:3060] T 2baffcc7e478421295036241364bfcaf P b1bad12877874d57a97d81468a0879cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:23.051307  9890 raft_consensus.cc:3055] T 2baffcc7e478421295036241364bfcaf P 7381fd84faa0411aa19672822665c0c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:23.051699  9890 raft_consensus.cc:740] T 2baffcc7e478421295036241364bfcaf P 7381fd84faa0411aa19672822665c0c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7381fd84faa0411aa19672822665c0c6, State: Running, Role: LEADER
I20260709 12:23:23.052377  9890 consensus_queue.cc:260] T 2baffcc7e478421295036241364bfcaf P 7381fd84faa0411aa19672822665c0c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:23.053347  9890 raft_consensus.cc:3060] T 2baffcc7e478421295036241364bfcaf P 7381fd84faa0411aa19672822665c0c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:23.056866  9964 raft_consensus.cc:2468] T 2baffcc7e478421295036241364bfcaf P b1bad12877874d57a97d81468a0879cc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e380843f48544819091608f98a0c72f in term 2.
I20260709 12:23:23.058624  9890 raft_consensus.cc:2468] T 2baffcc7e478421295036241364bfcaf P 7381fd84faa0411aa19672822665c0c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e380843f48544819091608f98a0c72f in term 2.
I20260709 12:23:23.058650  9779 leader_election.cc:304] T 2baffcc7e478421295036241364bfcaf P 9e380843f48544819091608f98a0c72f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e380843f48544819091608f98a0c72f, b1bad12877874d57a97d81468a0879cc; no voters: 
I20260709 12:23:23.060541 10174 raft_consensus.cc:2804] T 2baffcc7e478421295036241364bfcaf P 9e380843f48544819091608f98a0c72f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:23.061602 10174 raft_consensus.cc:697] T 2baffcc7e478421295036241364bfcaf P 9e380843f48544819091608f98a0c72f [term 2 LEADER]: Becoming Leader. State: Replica: 9e380843f48544819091608f98a0c72f, State: Running, Role: LEADER
I20260709 12:23:23.062682 10174 consensus_queue.cc:237] T 2baffcc7e478421295036241364bfcaf P 9e380843f48544819091608f98a0c72f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:23.070690  9710 catalog_manager.cc:5697] T 2baffcc7e478421295036241364bfcaf P 9e380843f48544819091608f98a0c72f reported cstate change: term changed from 1 to 2, leader changed from 7381fd84faa0411aa19672822665c0c6 (127.9.116.66) to 9e380843f48544819091608f98a0c72f (127.9.116.65). New cstate: current_term: 2 leader_uuid: "9e380843f48544819091608f98a0c72f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:23.071388 10173 raft_consensus.cc:993] T 85f2c8f75bef41a0a04f80205611c054 P 7381fd84faa0411aa19672822665c0c6: : Instructing follower b1bad12877874d57a97d81468a0879cc to start an election
I20260709 12:23:23.071914 10115 raft_consensus.cc:1081] T 85f2c8f75bef41a0a04f80205611c054 P 7381fd84faa0411aa19672822665c0c6 [term 3 LEADER]: Signalling peer b1bad12877874d57a97d81468a0879cc to start an election
I20260709 12:23:23.073443  9964 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "85f2c8f75bef41a0a04f80205611c054"
dest_uuid: "b1bad12877874d57a97d81468a0879cc"
 from {username='slave'} at 127.0.0.1:45558
I20260709 12:23:23.073904  9964 raft_consensus.cc:493] T 85f2c8f75bef41a0a04f80205611c054 P b1bad12877874d57a97d81468a0879cc [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:23.074137  9964 raft_consensus.cc:3060] T 85f2c8f75bef41a0a04f80205611c054 P b1bad12877874d57a97d81468a0879cc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:23.082922  9964 raft_consensus.cc:515] T 85f2c8f75bef41a0a04f80205611c054 P b1bad12877874d57a97d81468a0879cc [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:23.086822  9964 leader_election.cc:290] T 85f2c8f75bef41a0a04f80205611c054 P b1bad12877874d57a97d81468a0879cc [CANDIDATE]: Term 4 election: Requested vote from peers 9e380843f48544819091608f98a0c72f (127.9.116.65:34569), 7381fd84faa0411aa19672822665c0c6 (127.9.116.66:40415)
I20260709 12:23:23.087005  9816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85f2c8f75bef41a0a04f80205611c054" candidate_uuid: "b1bad12877874d57a97d81468a0879cc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9e380843f48544819091608f98a0c72f"
I20260709 12:23:23.087672  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85f2c8f75bef41a0a04f80205611c054" candidate_uuid: "b1bad12877874d57a97d81468a0879cc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7381fd84faa0411aa19672822665c0c6"
I20260709 12:23:23.087967  9816 raft_consensus.cc:3060] T 85f2c8f75bef41a0a04f80205611c054 P 9e380843f48544819091608f98a0c72f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:23.088352  9890 raft_consensus.cc:3055] T 85f2c8f75bef41a0a04f80205611c054 P 7381fd84faa0411aa19672822665c0c6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:23.088718  9890 raft_consensus.cc:740] T 85f2c8f75bef41a0a04f80205611c054 P 7381fd84faa0411aa19672822665c0c6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7381fd84faa0411aa19672822665c0c6, State: Running, Role: LEADER
I20260709 12:23:23.089485  9890 consensus_queue.cc:260] T 85f2c8f75bef41a0a04f80205611c054 P 7381fd84faa0411aa19672822665c0c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:23.090969  9890 raft_consensus.cc:3060] T 85f2c8f75bef41a0a04f80205611c054 P 7381fd84faa0411aa19672822665c0c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:23.094383  9816 raft_consensus.cc:2468] T 85f2c8f75bef41a0a04f80205611c054 P 9e380843f48544819091608f98a0c72f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1bad12877874d57a97d81468a0879cc in term 4.
I20260709 12:23:23.095971  9928 leader_election.cc:304] T 85f2c8f75bef41a0a04f80205611c054 P b1bad12877874d57a97d81468a0879cc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e380843f48544819091608f98a0c72f, b1bad12877874d57a97d81468a0879cc; no voters: 
I20260709 12:23:23.096849 10169 raft_consensus.cc:2804] T 85f2c8f75bef41a0a04f80205611c054 P b1bad12877874d57a97d81468a0879cc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:23.097105  9890 raft_consensus.cc:2468] T 85f2c8f75bef41a0a04f80205611c054 P 7381fd84faa0411aa19672822665c0c6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1bad12877874d57a97d81468a0879cc in term 4.
I20260709 12:23:23.098237 10169 raft_consensus.cc:697] T 85f2c8f75bef41a0a04f80205611c054 P b1bad12877874d57a97d81468a0879cc [term 4 LEADER]: Becoming Leader. State: Replica: b1bad12877874d57a97d81468a0879cc, State: Running, Role: LEADER
I20260709 12:23:23.099177 10169 consensus_queue.cc:237] T 85f2c8f75bef41a0a04f80205611c054 P b1bad12877874d57a97d81468a0879cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:23.109117  9710 catalog_manager.cc:5697] T 85f2c8f75bef41a0a04f80205611c054 P b1bad12877874d57a97d81468a0879cc reported cstate change: term changed from 3 to 4, leader changed from 7381fd84faa0411aa19672822665c0c6 (127.9.116.66) to b1bad12877874d57a97d81468a0879cc (127.9.116.67). New cstate: current_term: 4 leader_uuid: "b1bad12877874d57a97d81468a0879cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:23.251945 10173 raft_consensus.cc:993] T 335ce65e703a4289be64bc4030886524 P 7381fd84faa0411aa19672822665c0c6: : Instructing follower 9e380843f48544819091608f98a0c72f to start an election
I20260709 12:23:23.252341 10173 raft_consensus.cc:1081] T 335ce65e703a4289be64bc4030886524 P 7381fd84faa0411aa19672822665c0c6 [term 3 LEADER]: Signalling peer 9e380843f48544819091608f98a0c72f to start an election
I20260709 12:23:23.253844  9816 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "335ce65e703a4289be64bc4030886524"
dest_uuid: "9e380843f48544819091608f98a0c72f"
 from {username='slave'} at 127.0.0.1:43898
I20260709 12:23:23.254350  9816 raft_consensus.cc:493] T 335ce65e703a4289be64bc4030886524 P 9e380843f48544819091608f98a0c72f [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:23.254603  9816 raft_consensus.cc:3060] T 335ce65e703a4289be64bc4030886524 P 9e380843f48544819091608f98a0c72f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:23.260592  9816 raft_consensus.cc:515] T 335ce65e703a4289be64bc4030886524 P 9e380843f48544819091608f98a0c72f [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:23.262239  9816 leader_election.cc:290] T 335ce65e703a4289be64bc4030886524 P 9e380843f48544819091608f98a0c72f [CANDIDATE]: Term 4 election: Requested vote from peers 7381fd84faa0411aa19672822665c0c6 (127.9.116.66:40415), b1bad12877874d57a97d81468a0879cc (127.9.116.67:42315)
I20260709 12:23:23.263252  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "335ce65e703a4289be64bc4030886524" candidate_uuid: "9e380843f48544819091608f98a0c72f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7381fd84faa0411aa19672822665c0c6"
I20260709 12:23:23.263406  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "335ce65e703a4289be64bc4030886524" candidate_uuid: "9e380843f48544819091608f98a0c72f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b1bad12877874d57a97d81468a0879cc"
I20260709 12:23:23.263797  9890 raft_consensus.cc:3055] T 335ce65e703a4289be64bc4030886524 P 7381fd84faa0411aa19672822665c0c6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:23.263947  9964 raft_consensus.cc:3060] T 335ce65e703a4289be64bc4030886524 P b1bad12877874d57a97d81468a0879cc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:23.264096  9890 raft_consensus.cc:740] T 335ce65e703a4289be64bc4030886524 P 7381fd84faa0411aa19672822665c0c6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7381fd84faa0411aa19672822665c0c6, State: Running, Role: LEADER
I20260709 12:23:23.264843  9890 consensus_queue.cc:260] T 335ce65e703a4289be64bc4030886524 P 7381fd84faa0411aa19672822665c0c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:23.265728  9890 raft_consensus.cc:3060] T 335ce65e703a4289be64bc4030886524 P 7381fd84faa0411aa19672822665c0c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:23.269870  9964 raft_consensus.cc:2468] T 335ce65e703a4289be64bc4030886524 P b1bad12877874d57a97d81468a0879cc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e380843f48544819091608f98a0c72f in term 4.
I20260709 12:23:23.271370  9779 leader_election.cc:304] T 335ce65e703a4289be64bc4030886524 P 9e380843f48544819091608f98a0c72f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e380843f48544819091608f98a0c72f, b1bad12877874d57a97d81468a0879cc; no voters: 
I20260709 12:23:23.272020  9890 raft_consensus.cc:2468] T 335ce65e703a4289be64bc4030886524 P 7381fd84faa0411aa19672822665c0c6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e380843f48544819091608f98a0c72f in term 4.
I20260709 12:23:23.272338 10174 raft_consensus.cc:2804] T 335ce65e703a4289be64bc4030886524 P 9e380843f48544819091608f98a0c72f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:23.273108 10174 raft_consensus.cc:697] T 335ce65e703a4289be64bc4030886524 P 9e380843f48544819091608f98a0c72f [term 4 LEADER]: Becoming Leader. State: Replica: 9e380843f48544819091608f98a0c72f, State: Running, Role: LEADER
I20260709 12:23:23.273974 10174 consensus_queue.cc:237] T 335ce65e703a4289be64bc4030886524 P 9e380843f48544819091608f98a0c72f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:23.283298  9710 catalog_manager.cc:5697] T 335ce65e703a4289be64bc4030886524 P 9e380843f48544819091608f98a0c72f reported cstate change: term changed from 3 to 4, leader changed from 7381fd84faa0411aa19672822665c0c6 (127.9.116.66) to 9e380843f48544819091608f98a0c72f (127.9.116.65). New cstate: current_term: 4 leader_uuid: "9e380843f48544819091608f98a0c72f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:23.296005 10115 raft_consensus.cc:993] T 152402cdfb684f4d9bdbc6828f9160fe P 7381fd84faa0411aa19672822665c0c6: : Instructing follower 9e380843f48544819091608f98a0c72f to start an election
I20260709 12:23:23.296438 10115 raft_consensus.cc:1081] T 152402cdfb684f4d9bdbc6828f9160fe P 7381fd84faa0411aa19672822665c0c6 [term 2 LEADER]: Signalling peer 9e380843f48544819091608f98a0c72f to start an election
I20260709 12:23:23.297734  9816 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "152402cdfb684f4d9bdbc6828f9160fe"
dest_uuid: "9e380843f48544819091608f98a0c72f"
 from {username='slave'} at 127.0.0.1:43898
I20260709 12:23:23.298125  9816 raft_consensus.cc:493] T 152402cdfb684f4d9bdbc6828f9160fe P 9e380843f48544819091608f98a0c72f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:23.298372  9816 raft_consensus.cc:3060] T 152402cdfb684f4d9bdbc6828f9160fe P 9e380843f48544819091608f98a0c72f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:23.303920  9816 raft_consensus.cc:515] T 152402cdfb684f4d9bdbc6828f9160fe P 9e380843f48544819091608f98a0c72f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:23.305529  9816 leader_election.cc:290] T 152402cdfb684f4d9bdbc6828f9160fe P 9e380843f48544819091608f98a0c72f [CANDIDATE]: Term 3 election: Requested vote from peers 7381fd84faa0411aa19672822665c0c6 (127.9.116.66:40415), b1bad12877874d57a97d81468a0879cc (127.9.116.67:42315)
I20260709 12:23:23.306421  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "152402cdfb684f4d9bdbc6828f9160fe" candidate_uuid: "9e380843f48544819091608f98a0c72f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7381fd84faa0411aa19672822665c0c6"
I20260709 12:23:23.306622  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "152402cdfb684f4d9bdbc6828f9160fe" candidate_uuid: "9e380843f48544819091608f98a0c72f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b1bad12877874d57a97d81468a0879cc"
I20260709 12:23:23.307014  9890 raft_consensus.cc:3055] T 152402cdfb684f4d9bdbc6828f9160fe P 7381fd84faa0411aa19672822665c0c6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:23.307070  9964 raft_consensus.cc:3060] T 152402cdfb684f4d9bdbc6828f9160fe P b1bad12877874d57a97d81468a0879cc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:23.307410  9890 raft_consensus.cc:740] T 152402cdfb684f4d9bdbc6828f9160fe P 7381fd84faa0411aa19672822665c0c6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7381fd84faa0411aa19672822665c0c6, State: Running, Role: LEADER
I20260709 12:23:23.308189  9890 consensus_queue.cc:260] T 152402cdfb684f4d9bdbc6828f9160fe P 7381fd84faa0411aa19672822665c0c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:23.309305  9890 raft_consensus.cc:3060] T 152402cdfb684f4d9bdbc6828f9160fe P 7381fd84faa0411aa19672822665c0c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:23.313678  9964 raft_consensus.cc:2468] T 152402cdfb684f4d9bdbc6828f9160fe P b1bad12877874d57a97d81468a0879cc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e380843f48544819091608f98a0c72f in term 3.
I20260709 12:23:23.315181  9779 leader_election.cc:304] T 152402cdfb684f4d9bdbc6828f9160fe P 9e380843f48544819091608f98a0c72f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e380843f48544819091608f98a0c72f, b1bad12877874d57a97d81468a0879cc; no voters: 
I20260709 12:23:23.315493  9890 raft_consensus.cc:2468] T 152402cdfb684f4d9bdbc6828f9160fe P 7381fd84faa0411aa19672822665c0c6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e380843f48544819091608f98a0c72f in term 3.
I20260709 12:23:23.316169 10174 raft_consensus.cc:2804] T 152402cdfb684f4d9bdbc6828f9160fe P 9e380843f48544819091608f98a0c72f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:23.316717 10174 raft_consensus.cc:697] T 152402cdfb684f4d9bdbc6828f9160fe P 9e380843f48544819091608f98a0c72f [term 3 LEADER]: Becoming Leader. State: Replica: 9e380843f48544819091608f98a0c72f, State: Running, Role: LEADER
I20260709 12:23:23.317593 10174 consensus_queue.cc:237] T 152402cdfb684f4d9bdbc6828f9160fe P 9e380843f48544819091608f98a0c72f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:23.326642  9710 catalog_manager.cc:5697] T 152402cdfb684f4d9bdbc6828f9160fe P 9e380843f48544819091608f98a0c72f reported cstate change: term changed from 2 to 3, leader changed from 7381fd84faa0411aa19672822665c0c6 (127.9.116.66) to 9e380843f48544819091608f98a0c72f (127.9.116.65). New cstate: current_term: 3 leader_uuid: "9e380843f48544819091608f98a0c72f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:23.484156  9890 raft_consensus.cc:1275] T 2baffcc7e478421295036241364bfcaf P 7381fd84faa0411aa19672822665c0c6 [term 2 FOLLOWER]: Refusing update from remote peer 9e380843f48544819091608f98a0c72f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:23.485842 10174 consensus_queue.cc:1048] T 2baffcc7e478421295036241364bfcaf P 9e380843f48544819091608f98a0c72f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:23.494233 10115 raft_consensus.cc:993] T 88209028e06042419fced28068c1542b P 7381fd84faa0411aa19672822665c0c6: : Instructing follower b1bad12877874d57a97d81468a0879cc to start an election
I20260709 12:23:23.494921 10115 raft_consensus.cc:1081] T 88209028e06042419fced28068c1542b P 7381fd84faa0411aa19672822665c0c6 [term 2 LEADER]: Signalling peer b1bad12877874d57a97d81468a0879cc to start an election
I20260709 12:23:23.497016  9964 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "88209028e06042419fced28068c1542b"
dest_uuid: "b1bad12877874d57a97d81468a0879cc"
 from {username='slave'} at 127.0.0.1:45558
I20260709 12:23:23.497992  9964 raft_consensus.cc:493] T 88209028e06042419fced28068c1542b P b1bad12877874d57a97d81468a0879cc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:23.498415  9964 raft_consensus.cc:3060] T 88209028e06042419fced28068c1542b P b1bad12877874d57a97d81468a0879cc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:23.504086  9965 raft_consensus.cc:1275] T 2baffcc7e478421295036241364bfcaf P b1bad12877874d57a97d81468a0879cc [term 2 FOLLOWER]: Refusing update from remote peer 9e380843f48544819091608f98a0c72f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:23.506327 10188 consensus_queue.cc:1048] T 2baffcc7e478421295036241364bfcaf P 9e380843f48544819091608f98a0c72f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:23.510119  9964 raft_consensus.cc:515] T 88209028e06042419fced28068c1542b P b1bad12877874d57a97d81468a0879cc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:23.512305  9964 leader_election.cc:290] T 88209028e06042419fced28068c1542b P b1bad12877874d57a97d81468a0879cc [CANDIDATE]: Term 3 election: Requested vote from peers 7381fd84faa0411aa19672822665c0c6 (127.9.116.66:40415), 9e380843f48544819091608f98a0c72f (127.9.116.65:34569)
I20260709 12:23:23.513042  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88209028e06042419fced28068c1542b" candidate_uuid: "b1bad12877874d57a97d81468a0879cc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7381fd84faa0411aa19672822665c0c6"
I20260709 12:23:23.513757  9890 raft_consensus.cc:3055] T 88209028e06042419fced28068c1542b P 7381fd84faa0411aa19672822665c0c6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:23.514070  9890 raft_consensus.cc:740] T 88209028e06042419fced28068c1542b P 7381fd84faa0411aa19672822665c0c6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7381fd84faa0411aa19672822665c0c6, State: Running, Role: LEADER
I20260709 12:23:23.514871  9890 consensus_queue.cc:260] T 88209028e06042419fced28068c1542b P 7381fd84faa0411aa19672822665c0c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:23.515374  9816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88209028e06042419fced28068c1542b" candidate_uuid: "b1bad12877874d57a97d81468a0879cc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9e380843f48544819091608f98a0c72f"
I20260709 12:23:23.515933  9816 raft_consensus.cc:3060] T 88209028e06042419fced28068c1542b P 9e380843f48544819091608f98a0c72f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:23.516165  9890 raft_consensus.cc:3060] T 88209028e06042419fced28068c1542b P 7381fd84faa0411aa19672822665c0c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:23.523769  9816 raft_consensus.cc:2468] T 88209028e06042419fced28068c1542b P 9e380843f48544819091608f98a0c72f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1bad12877874d57a97d81468a0879cc in term 3.
I20260709 12:23:23.525084  9928 leader_election.cc:304] T 88209028e06042419fced28068c1542b P b1bad12877874d57a97d81468a0879cc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e380843f48544819091608f98a0c72f, b1bad12877874d57a97d81468a0879cc; no voters: 
I20260709 12:23:23.525969 10169 raft_consensus.cc:2804] T 88209028e06042419fced28068c1542b P b1bad12877874d57a97d81468a0879cc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:23.526458 10169 raft_consensus.cc:697] T 88209028e06042419fced28068c1542b P b1bad12877874d57a97d81468a0879cc [term 3 LEADER]: Becoming Leader. State: Replica: b1bad12877874d57a97d81468a0879cc, State: Running, Role: LEADER
I20260709 12:23:23.526535  9890 raft_consensus.cc:2468] T 88209028e06042419fced28068c1542b P 7381fd84faa0411aa19672822665c0c6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1bad12877874d57a97d81468a0879cc in term 3.
I20260709 12:23:23.527484 10169 consensus_queue.cc:237] T 88209028e06042419fced28068c1542b P b1bad12877874d57a97d81468a0879cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } } peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } }
I20260709 12:23:23.537182  9712 catalog_manager.cc:5697] T 88209028e06042419fced28068c1542b P b1bad12877874d57a97d81468a0879cc reported cstate change: term changed from 2 to 3, leader changed from 7381fd84faa0411aa19672822665c0c6 (127.9.116.66) to b1bad12877874d57a97d81468a0879cc (127.9.116.67). New cstate: current_term: 3 leader_uuid: "b1bad12877874d57a97d81468a0879cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:23.563797  9814 raft_consensus.cc:1275] T 85f2c8f75bef41a0a04f80205611c054 P 9e380843f48544819091608f98a0c72f [term 4 FOLLOWER]: Refusing update from remote peer b1bad12877874d57a97d81468a0879cc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:23:23.565462 10169 consensus_queue.cc:1048] T 85f2c8f75bef41a0a04f80205611c054 P b1bad12877874d57a97d81468a0879cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:23.576273  9890 raft_consensus.cc:1275] T 85f2c8f75bef41a0a04f80205611c054 P 7381fd84faa0411aa19672822665c0c6 [term 4 FOLLOWER]: Refusing update from remote peer b1bad12877874d57a97d81468a0879cc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:23:23.577726 10193 consensus_queue.cc:1048] T 85f2c8f75bef41a0a04f80205611c054 P b1bad12877874d57a97d81468a0879cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:23.741552  9890 raft_consensus.cc:1275] T 152402cdfb684f4d9bdbc6828f9160fe P 7381fd84faa0411aa19672822665c0c6 [term 3 FOLLOWER]: Refusing update from remote peer 9e380843f48544819091608f98a0c72f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:23.743216 10188 consensus_queue.cc:1048] T 152402cdfb684f4d9bdbc6828f9160fe P 9e380843f48544819091608f98a0c72f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:23.753970  9965 raft_consensus.cc:1275] T 152402cdfb684f4d9bdbc6828f9160fe P b1bad12877874d57a97d81468a0879cc [term 3 FOLLOWER]: Refusing update from remote peer 9e380843f48544819091608f98a0c72f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:23.756135 10188 consensus_queue.cc:1048] T 152402cdfb684f4d9bdbc6828f9160fe P 9e380843f48544819091608f98a0c72f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:23.760176  9964 raft_consensus.cc:1275] T 335ce65e703a4289be64bc4030886524 P b1bad12877874d57a97d81468a0879cc [term 4 FOLLOWER]: Refusing update from remote peer 9e380843f48544819091608f98a0c72f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:23:23.763511 10188 consensus_queue.cc:1048] T 335ce65e703a4289be64bc4030886524 P 9e380843f48544819091608f98a0c72f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1bad12877874d57a97d81468a0879cc" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:23.774371  9890 raft_consensus.cc:1275] T 335ce65e703a4289be64bc4030886524 P 7381fd84faa0411aa19672822665c0c6 [term 4 FOLLOWER]: Refusing update from remote peer 9e380843f48544819091608f98a0c72f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:23:23.776646 10174 consensus_queue.cc:1048] T 335ce65e703a4289be64bc4030886524 P 9e380843f48544819091608f98a0c72f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:23.963811  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:23.969439  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:23.969882  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:23.991366  9890 raft_consensus.cc:1275] T 88209028e06042419fced28068c1542b P 7381fd84faa0411aa19672822665c0c6 [term 3 FOLLOWER]: Refusing update from remote peer b1bad12877874d57a97d81468a0879cc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:23.992661 10193 consensus_queue.cc:1048] T 88209028e06042419fced28068c1542b P b1bad12877874d57a97d81468a0879cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7381fd84faa0411aa19672822665c0c6" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 40415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:24.003875  9814 raft_consensus.cc:1275] T 88209028e06042419fced28068c1542b P 9e380843f48544819091608f98a0c72f [term 3 FOLLOWER]: Refusing update from remote peer b1bad12877874d57a97d81468a0879cc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:24.005411 10181 consensus_queue.cc:1048] T 88209028e06042419fced28068c1542b P b1bad12877874d57a97d81468a0879cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e380843f48544819091608f98a0c72f" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 34569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:24.970940  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:24.975849  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:24.976330  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:25.977840  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:25.986939  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:25.987426  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:26.988627  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:26.993758  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:26.994216  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:27.995534  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:28.001730  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:28.002604  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:29.004025  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:29.009464  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:29.009959  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:30.011220  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:30.017916  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:30.018572  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:31.020191  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:31.026691  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:31.027292  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:32.028962  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:32.034956  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:32.035790  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:33.074714  9681 auto_leader_rebalancer-test.cc:340] The leader distribution is 
I20260709 12:23:33.075387  9681 tablet_server.cc:179] TabletServer@127.9.116.65:0 shutting down...
I20260709 12:23:33.123313  9681 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:33.124219  9681 tablet_replica.cc:333] T 2baffcc7e478421295036241364bfcaf P 9e380843f48544819091608f98a0c72f: stopping tablet replica
I20260709 12:23:33.125062  9681 raft_consensus.cc:2243] T 2baffcc7e478421295036241364bfcaf P 9e380843f48544819091608f98a0c72f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:33.126272  9681 raft_consensus.cc:2272] T 2baffcc7e478421295036241364bfcaf P 9e380843f48544819091608f98a0c72f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:33.128922  9681 tablet_replica.cc:333] T 48fcbe3ecfb44941b74325e03a8463e1 P 9e380843f48544819091608f98a0c72f: stopping tablet replica
I20260709 12:23:33.129480  9681 raft_consensus.cc:2243] T 48fcbe3ecfb44941b74325e03a8463e1 P 9e380843f48544819091608f98a0c72f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:33.129920  9681 raft_consensus.cc:2272] T 48fcbe3ecfb44941b74325e03a8463e1 P 9e380843f48544819091608f98a0c72f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:33.131897  9681 tablet_replica.cc:333] T 02c174f129bc454a821e33e6427b6548 P 9e380843f48544819091608f98a0c72f: stopping tablet replica
I20260709 12:23:33.132436  9681 raft_consensus.cc:2243] T 02c174f129bc454a821e33e6427b6548 P 9e380843f48544819091608f98a0c72f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:33.132849  9681 raft_consensus.cc:2272] T 02c174f129bc454a821e33e6427b6548 P 9e380843f48544819091608f98a0c72f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:33.134577  9681 tablet_replica.cc:333] T 2eea8dc76b734af3ad92320d2e4dbab2 P 9e380843f48544819091608f98a0c72f: stopping tablet replica
I20260709 12:23:33.135094  9681 raft_consensus.cc:2243] T 2eea8dc76b734af3ad92320d2e4dbab2 P 9e380843f48544819091608f98a0c72f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:33.135774  9681 raft_consensus.cc:2272] T 2eea8dc76b734af3ad92320d2e4dbab2 P 9e380843f48544819091608f98a0c72f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:33.138106  9681 tablet_replica.cc:333] T 5e60b7cfdc344a748869fbee80c30cef P 9e380843f48544819091608f98a0c72f: stopping tablet replica
I20260709 12:23:33.138804  9681 raft_consensus.cc:2243] T 5e60b7cfdc344a748869fbee80c30cef P 9e380843f48544819091608f98a0c72f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:33.139410  9681 raft_consensus.cc:2272] T 5e60b7cfdc344a748869fbee80c30cef P 9e380843f48544819091608f98a0c72f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:33.141556  9681 tablet_replica.cc:333] T 335ce65e703a4289be64bc4030886524 P 9e380843f48544819091608f98a0c72f: stopping tablet replica
I20260709 12:23:33.142125  9681 raft_consensus.cc:2243] T 335ce65e703a4289be64bc4030886524 P 9e380843f48544819091608f98a0c72f [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:23:33.143069  9681 raft_consensus.cc:2272] T 335ce65e703a4289be64bc4030886524 P 9e380843f48544819091608f98a0c72f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:33.144990  9681 tablet_replica.cc:333] T 152402cdfb684f4d9bdbc6828f9160fe P 9e380843f48544819091608f98a0c72f: stopping tablet replica
I20260709 12:23:33.145545  9681 raft_consensus.cc:2243] T 152402cdfb684f4d9bdbc6828f9160fe P 9e380843f48544819091608f98a0c72f [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:23:33.147032  9681 raft_consensus.cc:2272] T 152402cdfb684f4d9bdbc6828f9160fe P 9e380843f48544819091608f98a0c72f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:33.149077  9681 tablet_replica.cc:333] T 85f2c8f75bef41a0a04f80205611c054 P 9e380843f48544819091608f98a0c72f: stopping tablet replica
I20260709 12:23:33.149618  9681 raft_consensus.cc:2243] T 85f2c8f75bef41a0a04f80205611c054 P 9e380843f48544819091608f98a0c72f [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:33.150097  9681 raft_consensus.cc:2272] T 85f2c8f75bef41a0a04f80205611c054 P 9e380843f48544819091608f98a0c72f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:33.151983  9681 tablet_replica.cc:333] T 88209028e06042419fced28068c1542b P 9e380843f48544819091608f98a0c72f: stopping tablet replica
I20260709 12:23:33.152463  9681 raft_consensus.cc:2243] T 88209028e06042419fced28068c1542b P 9e380843f48544819091608f98a0c72f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:33.152952  9681 raft_consensus.cc:2272] T 88209028e06042419fced28068c1542b P 9e380843f48544819091608f98a0c72f [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:33.251938  9854 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.116.65:34569: connect: Connection refused (error 111)
I20260709 12:23:33.252883  9681 tablet_server.cc:196] TabletServer@127.9.116.65:0 shutdown complete.
W20260709 12:23:33.256083  9854 consensus_peers.cc:597] T 48fcbe3ecfb44941b74325e03a8463e1 P 7381fd84faa0411aa19672822665c0c6 -> Peer 9e380843f48544819091608f98a0c72f (127.9.116.65:34569): Couldn't send request to peer 9e380843f48544819091608f98a0c72f. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:34569: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:33.276510  9681 tablet_server.cc:179] TabletServer@127.9.116.66:0 shutting down...
I20260709 12:23:33.310235  9681 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:33.311204  9681 tablet_replica.cc:333] T 48fcbe3ecfb44941b74325e03a8463e1 P 7381fd84faa0411aa19672822665c0c6: stopping tablet replica
I20260709 12:23:33.313045  9681 raft_consensus.cc:2243] T 48fcbe3ecfb44941b74325e03a8463e1 P 7381fd84faa0411aa19672822665c0c6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:23:33.314033  9681 raft_consensus.cc:2272] T 48fcbe3ecfb44941b74325e03a8463e1 P 7381fd84faa0411aa19672822665c0c6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:33.317063  9681 tablet_replica.cc:333] T 2baffcc7e478421295036241364bfcaf P 7381fd84faa0411aa19672822665c0c6: stopping tablet replica
I20260709 12:23:33.318656  9681 raft_consensus.cc:2243] T 2baffcc7e478421295036241364bfcaf P 7381fd84faa0411aa19672822665c0c6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:33.319779  9681 raft_consensus.cc:2272] T 2baffcc7e478421295036241364bfcaf P 7381fd84faa0411aa19672822665c0c6 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:33.321326  9931 consensus_peers.cc:597] T 88209028e06042419fced28068c1542b P b1bad12877874d57a97d81468a0879cc -> Peer 7381fd84faa0411aa19672822665c0c6 (127.9.116.66:40415): Couldn't send request to peer 7381fd84faa0411aa19672822665c0c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:33.322793  9681 tablet_replica.cc:333] T 152402cdfb684f4d9bdbc6828f9160fe P 7381fd84faa0411aa19672822665c0c6: stopping tablet replica
I20260709 12:23:33.323499  9681 raft_consensus.cc:2243] T 152402cdfb684f4d9bdbc6828f9160fe P 7381fd84faa0411aa19672822665c0c6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:33.324052  9681 raft_consensus.cc:2272] T 152402cdfb684f4d9bdbc6828f9160fe P 7381fd84faa0411aa19672822665c0c6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:33.326207  9681 tablet_replica.cc:333] T 85f2c8f75bef41a0a04f80205611c054 P 7381fd84faa0411aa19672822665c0c6: stopping tablet replica
I20260709 12:23:33.327208  9681 raft_consensus.cc:2243] T 85f2c8f75bef41a0a04f80205611c054 P 7381fd84faa0411aa19672822665c0c6 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:33.327776  9681 raft_consensus.cc:2272] T 85f2c8f75bef41a0a04f80205611c054 P 7381fd84faa0411aa19672822665c0c6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:33.329542  9681 tablet_replica.cc:333] T 02c174f129bc454a821e33e6427b6548 P 7381fd84faa0411aa19672822665c0c6: stopping tablet replica
I20260709 12:23:33.330060  9681 raft_consensus.cc:2243] T 02c174f129bc454a821e33e6427b6548 P 7381fd84faa0411aa19672822665c0c6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:33.330864  9681 raft_consensus.cc:2272] T 02c174f129bc454a821e33e6427b6548 P 7381fd84faa0411aa19672822665c0c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:33.332804  9681 tablet_replica.cc:333] T 2eea8dc76b734af3ad92320d2e4dbab2 P 7381fd84faa0411aa19672822665c0c6: stopping tablet replica
I20260709 12:23:33.333313  9681 raft_consensus.cc:2243] T 2eea8dc76b734af3ad92320d2e4dbab2 P 7381fd84faa0411aa19672822665c0c6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:33.333732  9681 raft_consensus.cc:2272] T 2eea8dc76b734af3ad92320d2e4dbab2 P 7381fd84faa0411aa19672822665c0c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:33.335845  9681 tablet_replica.cc:333] T 88209028e06042419fced28068c1542b P 7381fd84faa0411aa19672822665c0c6: stopping tablet replica
I20260709 12:23:33.336582  9681 raft_consensus.cc:2243] T 88209028e06042419fced28068c1542b P 7381fd84faa0411aa19672822665c0c6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:33.337041  9681 raft_consensus.cc:2272] T 88209028e06042419fced28068c1542b P 7381fd84faa0411aa19672822665c0c6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:33.338867  9681 tablet_replica.cc:333] T 5e60b7cfdc344a748869fbee80c30cef P 7381fd84faa0411aa19672822665c0c6: stopping tablet replica
I20260709 12:23:33.339684  9681 raft_consensus.cc:2243] T 5e60b7cfdc344a748869fbee80c30cef P 7381fd84faa0411aa19672822665c0c6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:23:33.340932  9681 raft_consensus.cc:2272] T 5e60b7cfdc344a748869fbee80c30cef P 7381fd84faa0411aa19672822665c0c6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:33.342933  9681 tablet_replica.cc:333] T 335ce65e703a4289be64bc4030886524 P 7381fd84faa0411aa19672822665c0c6: stopping tablet replica
I20260709 12:23:33.343469  9681 raft_consensus.cc:2243] T 335ce65e703a4289be64bc4030886524 P 7381fd84faa0411aa19672822665c0c6 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:33.344043  9681 raft_consensus.cc:2272] T 335ce65e703a4289be64bc4030886524 P 7381fd84faa0411aa19672822665c0c6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:33.375061  9681 tablet_server.cc:196] TabletServer@127.9.116.66:0 shutdown complete.
W20260709 12:23:33.392067  9928 consensus_peers.cc:597] T 2eea8dc76b734af3ad92320d2e4dbab2 P b1bad12877874d57a97d81468a0879cc -> Peer 9e380843f48544819091608f98a0c72f (127.9.116.65:34569): Couldn't send request to peer 9e380843f48544819091608f98a0c72f. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:34569: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:33.399340  9681 tablet_server.cc:179] TabletServer@127.9.116.67:0 shutting down...
W20260709 12:23:33.428788  9928 consensus_peers.cc:597] T 88209028e06042419fced28068c1542b P b1bad12877874d57a97d81468a0879cc -> Peer 9e380843f48544819091608f98a0c72f (127.9.116.65:34569): Couldn't send request to peer 9e380843f48544819091608f98a0c72f. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:34569: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:33.436131  9681 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:33.437076  9681 tablet_replica.cc:333] T 88209028e06042419fced28068c1542b P b1bad12877874d57a97d81468a0879cc: stopping tablet replica
W20260709 12:23:33.437322  9928 consensus_peers.cc:597] T 85f2c8f75bef41a0a04f80205611c054 P b1bad12877874d57a97d81468a0879cc -> Peer 9e380843f48544819091608f98a0c72f (127.9.116.65:34569): Couldn't send request to peer 9e380843f48544819091608f98a0c72f. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:34569: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:33.437883  9681 raft_consensus.cc:2243] T 88209028e06042419fced28068c1542b P b1bad12877874d57a97d81468a0879cc [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:23:33.438758  9681 raft_consensus.cc:2272] T 88209028e06042419fced28068c1542b P b1bad12877874d57a97d81468a0879cc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:33.440780  9681 tablet_replica.cc:333] T 85f2c8f75bef41a0a04f80205611c054 P b1bad12877874d57a97d81468a0879cc: stopping tablet replica
I20260709 12:23:33.441341  9681 raft_consensus.cc:2243] T 85f2c8f75bef41a0a04f80205611c054 P b1bad12877874d57a97d81468a0879cc [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:23:33.442195  9681 raft_consensus.cc:2272] T 85f2c8f75bef41a0a04f80205611c054 P b1bad12877874d57a97d81468a0879cc [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:33.444018  9681 tablet_replica.cc:333] T 152402cdfb684f4d9bdbc6828f9160fe P b1bad12877874d57a97d81468a0879cc: stopping tablet replica
I20260709 12:23:33.444566  9681 raft_consensus.cc:2243] T 152402cdfb684f4d9bdbc6828f9160fe P b1bad12877874d57a97d81468a0879cc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:33.445017  9681 raft_consensus.cc:2272] T 152402cdfb684f4d9bdbc6828f9160fe P b1bad12877874d57a97d81468a0879cc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:33.446691  9681 tablet_replica.cc:333] T 2baffcc7e478421295036241364bfcaf P b1bad12877874d57a97d81468a0879cc: stopping tablet replica
I20260709 12:23:33.447862  9681 raft_consensus.cc:2243] T 2baffcc7e478421295036241364bfcaf P b1bad12877874d57a97d81468a0879cc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:33.448487  9681 raft_consensus.cc:2272] T 2baffcc7e478421295036241364bfcaf P b1bad12877874d57a97d81468a0879cc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:33.450724  9681 tablet_replica.cc:333] T 5e60b7cfdc344a748869fbee80c30cef P b1bad12877874d57a97d81468a0879cc: stopping tablet replica
I20260709 12:23:33.451416  9681 raft_consensus.cc:2243] T 5e60b7cfdc344a748869fbee80c30cef P b1bad12877874d57a97d81468a0879cc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:33.452051  9681 raft_consensus.cc:2272] T 5e60b7cfdc344a748869fbee80c30cef P b1bad12877874d57a97d81468a0879cc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:33.454312  9681 tablet_replica.cc:333] T 335ce65e703a4289be64bc4030886524 P b1bad12877874d57a97d81468a0879cc: stopping tablet replica
I20260709 12:23:33.454936  9681 raft_consensus.cc:2243] T 335ce65e703a4289be64bc4030886524 P b1bad12877874d57a97d81468a0879cc [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:33.455544  9681 raft_consensus.cc:2272] T 335ce65e703a4289be64bc4030886524 P b1bad12877874d57a97d81468a0879cc [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:33.457717  9681 tablet_replica.cc:333] T 48fcbe3ecfb44941b74325e03a8463e1 P b1bad12877874d57a97d81468a0879cc: stopping tablet replica
I20260709 12:23:33.458288  9681 raft_consensus.cc:2243] T 48fcbe3ecfb44941b74325e03a8463e1 P b1bad12877874d57a97d81468a0879cc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:33.458770  9681 raft_consensus.cc:2272] T 48fcbe3ecfb44941b74325e03a8463e1 P b1bad12877874d57a97d81468a0879cc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:33.460741  9681 tablet_replica.cc:333] T 02c174f129bc454a821e33e6427b6548 P b1bad12877874d57a97d81468a0879cc: stopping tablet replica
I20260709 12:23:33.461206  9681 raft_consensus.cc:2243] T 02c174f129bc454a821e33e6427b6548 P b1bad12877874d57a97d81468a0879cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:33.461622  9681 raft_consensus.cc:2272] T 02c174f129bc454a821e33e6427b6548 P b1bad12877874d57a97d81468a0879cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:33.463546  9681 tablet_replica.cc:333] T 2eea8dc76b734af3ad92320d2e4dbab2 P b1bad12877874d57a97d81468a0879cc: stopping tablet replica
I20260709 12:23:33.464075  9681 raft_consensus.cc:2243] T 2eea8dc76b734af3ad92320d2e4dbab2 P b1bad12877874d57a97d81468a0879cc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:33.464882  9681 raft_consensus.cc:2272] T 2eea8dc76b734af3ad92320d2e4dbab2 P b1bad12877874d57a97d81468a0879cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:33.498481  9681 tablet_server.cc:196] TabletServer@127.9.116.67:0 shutdown complete.
I20260709 12:23:33.520205  9681 master.cc:562] Master@127.9.116.126:34075 shutting down...
I20260709 12:23:33.688100  9681 raft_consensus.cc:2243] T 00000000000000000000000000000000 P d453334205b44948852117ab39cac7b6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:33.688788  9681 raft_consensus.cc:2272] T 00000000000000000000000000000000 P d453334205b44948852117ab39cac7b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:33.689149  9681 tablet_replica.cc:333] T 00000000000000000000000000000000 P d453334205b44948852117ab39cac7b6: stopping tablet replica
I20260709 12:23:33.710894  9681 master.cc:584] Master@127.9.116.126:34075 shutdown complete.
7381fd84faa0411aa19672822665c0c6  4
9e380843f48544819091608f98a0c72f  4
b1bad12877874d57a97d81468a0879cc  1
7381fd84faa0411aa19672822665c0c6  3
9e380843f48544819091608f98a0c72f  3
b1bad12877874d57a97d81468a0879cc  3
7381fd84faa0411aa19672822665c0c6  8
9e380843f48544819091608f98a0c72f  0
b1bad12877874d57a97d81468a0879cc  1
7381fd84faa0411aa19672822665c0c6  3
9e380843f48544819091608f98a0c72f  3
b1bad12877874d57a97d81468a0879cc  3
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (31584 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 12:23:33.761737  9681 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.9.116.126:41725
I20260709 12:23:33.762961  9681 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:33.769095 10215 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:33.769182 10214 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:33.769942 10217 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:33.772037  9681 server_base.cc:1061] running on GCE node
I20260709 12:23:33.773027  9681 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:33.773209  9681 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:33.773408  9681 hybrid_clock.cc:648] HybridClock initialized: now 1783599813773394 us; error 0 us; skew 500 ppm
I20260709 12:23:33.773991  9681 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:33.777182  9681 webserver.cc:533] Webserver started at http://127.9.116.126:42561/ using document root <none> and password file <none>
I20260709 12:23:33.777817  9681 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:33.778025  9681 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:33.778530  9681 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:33.780140  9681 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599781984018-9681-0/minicluster-data/master-0-root/instance:
uuid: "fcc36cd2576f4384a986fa531b21cf59"
format_stamp: "Formatted at 2026-07-09 12:23:33 on dist-test-slave-zk51"
I20260709 12:23:33.785833  9681 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:23:33.789935 10222 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:33.790730  9681 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:23:33.791052  9681 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599781984018-9681-0/minicluster-data/master-0-root
uuid: "fcc36cd2576f4384a986fa531b21cf59"
format_stamp: "Formatted at 2026-07-09 12:23:33 on dist-test-slave-zk51"
I20260709 12:23:33.791371  9681 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599781984018-9681-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599781984018-9681-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599781984018-9681-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:33.826467  9681 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:33.827881  9681 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:33.874467  9681 rpc_server.cc:307] RPC server started. Bound to: 127.9.116.126:41725
I20260709 12:23:33.874481 10273 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.116.126:41725 every 8 connection(s)
I20260709 12:23:33.879359 10274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:33.892066 10274 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fcc36cd2576f4384a986fa531b21cf59: Bootstrap starting.
I20260709 12:23:33.898486 10274 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fcc36cd2576f4384a986fa531b21cf59: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:33.904456 10274 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fcc36cd2576f4384a986fa531b21cf59: No bootstrap required, opened a new log
I20260709 12:23:33.907167 10274 raft_consensus.cc:359] T 00000000000000000000000000000000 P fcc36cd2576f4384a986fa531b21cf59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fcc36cd2576f4384a986fa531b21cf59" member_type: VOTER }
I20260709 12:23:33.907765 10274 raft_consensus.cc:385] T 00000000000000000000000000000000 P fcc36cd2576f4384a986fa531b21cf59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:33.908016 10274 raft_consensus.cc:740] T 00000000000000000000000000000000 P fcc36cd2576f4384a986fa531b21cf59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcc36cd2576f4384a986fa531b21cf59, State: Initialized, Role: FOLLOWER
I20260709 12:23:33.908821 10274 consensus_queue.cc:260] T 00000000000000000000000000000000 P fcc36cd2576f4384a986fa531b21cf59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fcc36cd2576f4384a986fa531b21cf59" member_type: VOTER }
I20260709 12:23:33.909332 10274 raft_consensus.cc:399] T 00000000000000000000000000000000 P fcc36cd2576f4384a986fa531b21cf59 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:23:33.909552 10274 raft_consensus.cc:493] T 00000000000000000000000000000000 P fcc36cd2576f4384a986fa531b21cf59 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:23:33.909966 10274 raft_consensus.cc:3060] T 00000000000000000000000000000000 P fcc36cd2576f4384a986fa531b21cf59 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:33.914083 10274 raft_consensus.cc:515] T 00000000000000000000000000000000 P fcc36cd2576f4384a986fa531b21cf59 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fcc36cd2576f4384a986fa531b21cf59" member_type: VOTER }
I20260709 12:23:33.914644 10274 leader_election.cc:304] T 00000000000000000000000000000000 P fcc36cd2576f4384a986fa531b21cf59 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fcc36cd2576f4384a986fa531b21cf59; no voters: 
I20260709 12:23:33.916091 10274 leader_election.cc:290] T 00000000000000000000000000000000 P fcc36cd2576f4384a986fa531b21cf59 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:23:33.916388 10277 raft_consensus.cc:2804] T 00000000000000000000000000000000 P fcc36cd2576f4384a986fa531b21cf59 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:33.917914 10277 raft_consensus.cc:697] T 00000000000000000000000000000000 P fcc36cd2576f4384a986fa531b21cf59 [term 1 LEADER]: Becoming Leader. State: Replica: fcc36cd2576f4384a986fa531b21cf59, State: Running, Role: LEADER
I20260709 12:23:33.918779 10277 consensus_queue.cc:237] T 00000000000000000000000000000000 P fcc36cd2576f4384a986fa531b21cf59 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fcc36cd2576f4384a986fa531b21cf59" member_type: VOTER }
I20260709 12:23:33.919968 10274 sys_catalog.cc:565] T 00000000000000000000000000000000 P fcc36cd2576f4384a986fa531b21cf59 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:23:33.924348 10279 sys_catalog.cc:455] T 00000000000000000000000000000000 P fcc36cd2576f4384a986fa531b21cf59 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fcc36cd2576f4384a986fa531b21cf59. Latest consensus state: current_term: 1 leader_uuid: "fcc36cd2576f4384a986fa531b21cf59" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fcc36cd2576f4384a986fa531b21cf59" member_type: VOTER } }
I20260709 12:23:33.924134 10278 sys_catalog.cc:455] T 00000000000000000000000000000000 P fcc36cd2576f4384a986fa531b21cf59 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fcc36cd2576f4384a986fa531b21cf59" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fcc36cd2576f4384a986fa531b21cf59" member_type: VOTER } }
I20260709 12:23:33.925537 10278 sys_catalog.cc:458] T 00000000000000000000000000000000 P fcc36cd2576f4384a986fa531b21cf59 [sys.catalog]: This master's current role is: LEADER
I20260709 12:23:33.925446 10279 sys_catalog.cc:458] T 00000000000000000000000000000000 P fcc36cd2576f4384a986fa531b21cf59 [sys.catalog]: This master's current role is: LEADER
I20260709 12:23:33.930413 10284 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:23:33.939258 10284 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:23:33.941413  9681 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:23:33.950881 10284 catalog_manager.cc:1383] Generated new cluster ID: ff72028d8fa244dca1a1fe18316c2b30
I20260709 12:23:33.951298 10284 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:23:33.984918 10284 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:23:33.986200 10284 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:23:34.004552 10284 catalog_manager.cc:6070] T 00000000000000000000000000000000 P fcc36cd2576f4384a986fa531b21cf59: Generated new TSK 0
I20260709 12:23:34.005237 10284 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:23:34.072840  9681 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:34.079439 10295 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:34.080835 10296 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:34.082651  9681 server_base.cc:1061] running on GCE node
W20260709 12:23:34.083755 10298 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:34.084796  9681 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:34.085070  9681 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:34.085258  9681 hybrid_clock.cc:648] HybridClock initialized: now 1783599814085244 us; error 0 us; skew 500 ppm
I20260709 12:23:34.085846  9681 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:34.088565  9681 webserver.cc:533] Webserver started at http://127.9.116.65:34145/ using document root <none> and password file <none>
I20260709 12:23:34.089092  9681 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:34.089259  9681 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:34.089526  9681 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:34.090617  9681 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599781984018-9681-0/minicluster-data/ts-0-root/instance:
uuid: "09ec138dff9842f0858adca947bc33fb"
format_stamp: "Formatted at 2026-07-09 12:23:34 on dist-test-slave-zk51"
I20260709 12:23:34.095520  9681 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:23:34.100248 10303 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:34.101331  9681 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:23:34.101752  9681 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599781984018-9681-0/minicluster-data/ts-0-root
uuid: "09ec138dff9842f0858adca947bc33fb"
format_stamp: "Formatted at 2026-07-09 12:23:34 on dist-test-slave-zk51"
I20260709 12:23:34.102066  9681 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599781984018-9681-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599781984018-9681-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599781984018-9681-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:34.148216  9681 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:34.149569  9681 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:34.151126  9681 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:34.153736  9681 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:34.153978  9681 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:34.154263  9681 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:34.154460  9681 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:34.202966  9681 rpc_server.cc:307] RPC server started. Bound to: 127.9.116.65:42825
I20260709 12:23:34.203071 10365 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.116.65:42825 every 8 connection(s)
I20260709 12:23:34.208003  9681 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:34.215157 10370 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:34.216658 10371 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:34.218794  9681 server_base.cc:1061] running on GCE node
W20260709 12:23:34.220165 10373 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:34.221302  9681 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:34.221552  9681 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:34.221841  9681 hybrid_clock.cc:648] HybridClock initialized: now 1783599814221819 us; error 0 us; skew 500 ppm
I20260709 12:23:34.222469  9681 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:34.225941  9681 webserver.cc:533] Webserver started at http://127.9.116.66:45455/ using document root <none> and password file <none>
I20260709 12:23:34.226680  9681 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:34.226945  9681 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:34.227275  9681 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:34.229002  9681 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599781984018-9681-0/minicluster-data/ts-1-root/instance:
uuid: "39666a280cd648579a4ad0f800aa7261"
format_stamp: "Formatted at 2026-07-09 12:23:34 on dist-test-slave-zk51"
I20260709 12:23:34.230032 10366 heartbeater.cc:344] Connected to a master server at 127.9.116.126:41725
I20260709 12:23:34.230485 10366 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:34.231277 10366 heartbeater.cc:507] Master 127.9.116.126:41725 requested a full tablet report, sending...
I20260709 12:23:34.233661 10239 ts_manager.cc:194] Registered new tserver with Master: 09ec138dff9842f0858adca947bc33fb (127.9.116.65:42825)
I20260709 12:23:34.235226  9681 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:23:34.236281 10239 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48584
I20260709 12:23:34.239778 10378 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:34.240729  9681 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:23:34.240996  9681 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599781984018-9681-0/minicluster-data/ts-1-root
uuid: "39666a280cd648579a4ad0f800aa7261"
format_stamp: "Formatted at 2026-07-09 12:23:34 on dist-test-slave-zk51"
I20260709 12:23:34.241263  9681 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599781984018-9681-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599781984018-9681-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599781984018-9681-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:34.258178  9681 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:34.259461  9681 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:34.261210  9681 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:34.263772  9681 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:34.263978  9681 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:34.264292  9681 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:34.264469  9681 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:34.313963  9681 rpc_server.cc:307] RPC server started. Bound to: 127.9.116.66:43111
I20260709 12:23:34.314072 10440 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.116.66:43111 every 8 connection(s)
I20260709 12:23:34.319222  9681 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:34.327421 10444 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:34.331426 10445 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:34.332392  9681 server_base.cc:1061] running on GCE node
W20260709 12:23:34.333000 10447 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:34.334504  9681 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:23:34.334537 10441 heartbeater.cc:344] Connected to a master server at 127.9.116.126:41725
W20260709 12:23:34.334937  9681 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:34.335103 10441 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:34.335217  9681 hybrid_clock.cc:648] HybridClock initialized: now 1783599814335197 us; error 0 us; skew 500 ppm
I20260709 12:23:34.336118  9681 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:34.336151 10441 heartbeater.cc:507] Master 127.9.116.126:41725 requested a full tablet report, sending...
I20260709 12:23:34.338909 10239 ts_manager.cc:194] Registered new tserver with Master: 39666a280cd648579a4ad0f800aa7261 (127.9.116.66:43111)
I20260709 12:23:34.339416  9681 webserver.cc:533] Webserver started at http://127.9.116.67:38741/ using document root <none> and password file <none>
I20260709 12:23:34.339957  9681 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:34.340112  9681 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:34.340310  9681 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:34.340494 10239 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48590
I20260709 12:23:34.341468  9681 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599781984018-9681-0/minicluster-data/ts-2-root/instance:
uuid: "62eb0e44cb794e9db922a20fcfb9d606"
format_stamp: "Formatted at 2026-07-09 12:23:34 on dist-test-slave-zk51"
I20260709 12:23:34.346760  9681 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:23:34.350965 10452 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:34.352422  9681 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:23:34.352768  9681 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599781984018-9681-0/minicluster-data/ts-2-root
uuid: "62eb0e44cb794e9db922a20fcfb9d606"
format_stamp: "Formatted at 2026-07-09 12:23:34 on dist-test-slave-zk51"
I20260709 12:23:34.353024  9681 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599781984018-9681-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599781984018-9681-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599781984018-9681-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:34.371181  9681 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:34.372502  9681 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:34.373965  9681 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:34.376341  9681 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:34.376526  9681 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:34.376837  9681 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:34.377005  9681 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:34.425854  9681 rpc_server.cc:307] RPC server started. Bound to: 127.9.116.67:42127
I20260709 12:23:34.426249 10514 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.116.67:42127 every 8 connection(s)
I20260709 12:23:34.443059 10515 heartbeater.cc:344] Connected to a master server at 127.9.116.126:41725
I20260709 12:23:34.443496 10515 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:34.444340 10515 heartbeater.cc:507] Master 127.9.116.126:41725 requested a full tablet report, sending...
I20260709 12:23:34.446679 10239 ts_manager.cc:194] Registered new tserver with Master: 62eb0e44cb794e9db922a20fcfb9d606 (127.9.116.67:42127)
I20260709 12:23:34.447857  9681 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.018082972s
I20260709 12:23:34.448319 10239 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48602
I20260709 12:23:34.478004 10239 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48612:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:23:34.481714 10239 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:23:34.568936 10406 tablet_service.cc:1511] Processing CreateTablet for tablet f45d2ff8d4f540878e0ec1058a28f8d5 (DEFAULT_TABLE table=test-workload [id=10a8e22a91a94b62af098a79eb91ce55]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:23:34.570447 10406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f45d2ff8d4f540878e0ec1058a28f8d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:34.577041 10404 tablet_service.cc:1511] Processing CreateTablet for tablet 1763c604c9c84205be8b3bf019a15fa0 (DEFAULT_TABLE table=test-workload [id=10a8e22a91a94b62af098a79eb91ce55]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:23:34.578883 10404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1763c604c9c84205be8b3bf019a15fa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:34.578538 10480 tablet_service.cc:1511] Processing CreateTablet for tablet f45d2ff8d4f540878e0ec1058a28f8d5 (DEFAULT_TABLE table=test-workload [id=10a8e22a91a94b62af098a79eb91ce55]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:23:34.580241 10480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f45d2ff8d4f540878e0ec1058a28f8d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:34.579936 10330 tablet_service.cc:1511] Processing CreateTablet for tablet 5764d623ece6411d8e3adfbd095f0fe1 (DEFAULT_TABLE table=test-workload [id=10a8e22a91a94b62af098a79eb91ce55]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:23:34.581271 10330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5764d623ece6411d8e3adfbd095f0fe1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:34.580999 10403 tablet_service.cc:1511] Processing CreateTablet for tablet c8b3a5c008584867bf2282f87acb3cde (DEFAULT_TABLE table=test-workload [id=10a8e22a91a94b62af098a79eb91ce55]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:23:34.582948 10403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8b3a5c008584867bf2282f87acb3cde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:34.583011 10402 tablet_service.cc:1511] Processing CreateTablet for tablet 57fc852991f54b508ff41067c25fe854 (DEFAULT_TABLE table=test-workload [id=10a8e22a91a94b62af098a79eb91ce55]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:23:34.578540 10331 tablet_service.cc:1511] Processing CreateTablet for tablet f45d2ff8d4f540878e0ec1058a28f8d5 (DEFAULT_TABLE table=test-workload [id=10a8e22a91a94b62af098a79eb91ce55]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:23:34.584527 10402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57fc852991f54b508ff41067c25fe854. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:34.585259 10331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f45d2ff8d4f540878e0ec1058a28f8d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:34.584931 10328 tablet_service.cc:1511] Processing CreateTablet for tablet c8b3a5c008584867bf2282f87acb3cde (DEFAULT_TABLE table=test-workload [id=10a8e22a91a94b62af098a79eb91ce55]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:23:34.586762 10328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8b3a5c008584867bf2282f87acb3cde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:34.587436 10329 tablet_service.cc:1511] Processing CreateTablet for tablet 1763c604c9c84205be8b3bf019a15fa0 (DEFAULT_TABLE table=test-workload [id=10a8e22a91a94b62af098a79eb91ce55]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:23:34.574972 10405 tablet_service.cc:1511] Processing CreateTablet for tablet 5764d623ece6411d8e3adfbd095f0fe1 (DEFAULT_TABLE table=test-workload [id=10a8e22a91a94b62af098a79eb91ce55]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:23:34.587926 10479 tablet_service.cc:1511] Processing CreateTablet for tablet 5764d623ece6411d8e3adfbd095f0fe1 (DEFAULT_TABLE table=test-workload [id=10a8e22a91a94b62af098a79eb91ce55]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:23:34.588825 10327 tablet_service.cc:1511] Processing CreateTablet for tablet 57fc852991f54b508ff41067c25fe854 (DEFAULT_TABLE table=test-workload [id=10a8e22a91a94b62af098a79eb91ce55]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:23:34.590171 10329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1763c604c9c84205be8b3bf019a15fa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:34.590873 10478 tablet_service.cc:1511] Processing CreateTablet for tablet 1763c604c9c84205be8b3bf019a15fa0 (DEFAULT_TABLE table=test-workload [id=10a8e22a91a94b62af098a79eb91ce55]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:23:34.593304 10327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57fc852991f54b508ff41067c25fe854. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:34.593613 10405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5764d623ece6411d8e3adfbd095f0fe1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:34.595480 10477 tablet_service.cc:1511] Processing CreateTablet for tablet c8b3a5c008584867bf2282f87acb3cde (DEFAULT_TABLE table=test-workload [id=10a8e22a91a94b62af098a79eb91ce55]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:23:34.597028 10479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5764d623ece6411d8e3adfbd095f0fe1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:34.600325 10478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1763c604c9c84205be8b3bf019a15fa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:34.603258 10477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8b3a5c008584867bf2282f87acb3cde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:34.639343 10476 tablet_service.cc:1511] Processing CreateTablet for tablet 57fc852991f54b508ff41067c25fe854 (DEFAULT_TABLE table=test-workload [id=10a8e22a91a94b62af098a79eb91ce55]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:23:34.640924 10476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57fc852991f54b508ff41067c25fe854. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:34.667220 10326 tablet_service.cc:1511] Processing CreateTablet for tablet b719323785d84477bf49a3ebbf366f37 (DEFAULT_TABLE table=test-workload [id=10a8e22a91a94b62af098a79eb91ce55]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:23:34.669715 10326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b719323785d84477bf49a3ebbf366f37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:34.673996 10402 tablet_service.cc:1511] Processing CreateTablet for tablet b719323785d84477bf49a3ebbf366f37 (DEFAULT_TABLE table=test-workload [id=10a8e22a91a94b62af098a79eb91ce55]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:23:34.675356 10402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b719323785d84477bf49a3ebbf366f37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:34.681161 10530 tablet_bootstrap.cc:492] T 57fc852991f54b508ff41067c25fe854 P 39666a280cd648579a4ad0f800aa7261: Bootstrap starting.
I20260709 12:23:34.690131 10478 tablet_service.cc:1511] Processing CreateTablet for tablet b719323785d84477bf49a3ebbf366f37 (DEFAULT_TABLE table=test-workload [id=10a8e22a91a94b62af098a79eb91ce55]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:23:34.691612 10478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b719323785d84477bf49a3ebbf366f37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:34.696631 10530 tablet_bootstrap.cc:654] T 57fc852991f54b508ff41067c25fe854 P 39666a280cd648579a4ad0f800aa7261: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:34.699844 10479 tablet_service.cc:1511] Processing CreateTablet for tablet ddcced512029492fb6903fc4d42abd31 (DEFAULT_TABLE table=test-workload [id=10a8e22a91a94b62af098a79eb91ce55]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:23:34.699893 10531 tablet_bootstrap.cc:492] T c8b3a5c008584867bf2282f87acb3cde P 62eb0e44cb794e9db922a20fcfb9d606: Bootstrap starting.
I20260709 12:23:34.702343 10404 tablet_service.cc:1511] Processing CreateTablet for tablet ddcced512029492fb6903fc4d42abd31 (DEFAULT_TABLE table=test-workload [id=10a8e22a91a94b62af098a79eb91ce55]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:23:34.703680 10404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddcced512029492fb6903fc4d42abd31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:34.704052 10479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddcced512029492fb6903fc4d42abd31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:34.708753 10532 tablet_bootstrap.cc:492] T 5764d623ece6411d8e3adfbd095f0fe1 P 09ec138dff9842f0858adca947bc33fb: Bootstrap starting.
I20260709 12:23:34.712283 10477 tablet_service.cc:1511] Processing CreateTablet for tablet 86d8ee5b13404484811b10e05818abc8 (DEFAULT_TABLE table=test-workload [id=10a8e22a91a94b62af098a79eb91ce55]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:23:34.713035 10330 tablet_service.cc:1511] Processing CreateTablet for tablet 86d8ee5b13404484811b10e05818abc8 (DEFAULT_TABLE table=test-workload [id=10a8e22a91a94b62af098a79eb91ce55]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:23:34.713713 10477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86d8ee5b13404484811b10e05818abc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:34.714371 10330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86d8ee5b13404484811b10e05818abc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:34.715353 10326 tablet_service.cc:1511] Processing CreateTablet for tablet ddcced512029492fb6903fc4d42abd31 (DEFAULT_TABLE table=test-workload [id=10a8e22a91a94b62af098a79eb91ce55]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:23:34.716754 10406 tablet_service.cc:1511] Processing CreateTablet for tablet 86d8ee5b13404484811b10e05818abc8 (DEFAULT_TABLE table=test-workload [id=10a8e22a91a94b62af098a79eb91ce55]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:23:34.722651 10326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddcced512029492fb6903fc4d42abd31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:34.724406 10329 tablet_service.cc:1511] Processing CreateTablet for tablet b6cc3e80f4f6411b89c21921f2929554 (DEFAULT_TABLE table=test-workload [id=10a8e22a91a94b62af098a79eb91ce55]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:23:34.722651 10406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86d8ee5b13404484811b10e05818abc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:34.731315 10329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6cc3e80f4f6411b89c21921f2929554. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:34.732242 10531 tablet_bootstrap.cc:654] T c8b3a5c008584867bf2282f87acb3cde P 62eb0e44cb794e9db922a20fcfb9d606: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:34.742095 10405 tablet_service.cc:1511] Processing CreateTablet for tablet b6cc3e80f4f6411b89c21921f2929554 (DEFAULT_TABLE table=test-workload [id=10a8e22a91a94b62af098a79eb91ce55]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:23:34.743721 10405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6cc3e80f4f6411b89c21921f2929554. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:34.751483 10530 tablet_bootstrap.cc:492] T 57fc852991f54b508ff41067c25fe854 P 39666a280cd648579a4ad0f800aa7261: No bootstrap required, opened a new log
I20260709 12:23:34.752113 10530 ts_tablet_manager.cc:1403] T 57fc852991f54b508ff41067c25fe854 P 39666a280cd648579a4ad0f800aa7261: Time spent bootstrapping tablet: real 0.094s	user 0.016s	sys 0.000s
I20260709 12:23:34.756098 10530 raft_consensus.cc:359] T 57fc852991f54b508ff41067c25fe854 P 39666a280cd648579a4ad0f800aa7261 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:34.757186 10530 raft_consensus.cc:385] T 57fc852991f54b508ff41067c25fe854 P 39666a280cd648579a4ad0f800aa7261 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:34.757702 10530 raft_consensus.cc:740] T 57fc852991f54b508ff41067c25fe854 P 39666a280cd648579a4ad0f800aa7261 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39666a280cd648579a4ad0f800aa7261, State: Initialized, Role: FOLLOWER
I20260709 12:23:34.758419 10532 tablet_bootstrap.cc:654] T 5764d623ece6411d8e3adfbd095f0fe1 P 09ec138dff9842f0858adca947bc33fb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:34.758500 10530 consensus_queue.cc:260] T 57fc852991f54b508ff41067c25fe854 P 39666a280cd648579a4ad0f800aa7261 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:34.766855 10441 heartbeater.cc:499] Master 127.9.116.126:41725 was elected leader, sending a full tablet report...
I20260709 12:23:34.767270 10530 ts_tablet_manager.cc:1434] T 57fc852991f54b508ff41067c25fe854 P 39666a280cd648579a4ad0f800aa7261: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:23:34.767608 10531 tablet_bootstrap.cc:492] T c8b3a5c008584867bf2282f87acb3cde P 62eb0e44cb794e9db922a20fcfb9d606: No bootstrap required, opened a new log
I20260709 12:23:34.774478 10531 ts_tablet_manager.cc:1403] T c8b3a5c008584867bf2282f87acb3cde P 62eb0e44cb794e9db922a20fcfb9d606: Time spent bootstrapping tablet: real 0.075s	user 0.009s	sys 0.008s
I20260709 12:23:34.770535 10477 tablet_service.cc:1511] Processing CreateTablet for tablet b6cc3e80f4f6411b89c21921f2929554 (DEFAULT_TABLE table=test-workload [id=10a8e22a91a94b62af098a79eb91ce55]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:23:34.768354 10530 tablet_bootstrap.cc:492] T c8b3a5c008584867bf2282f87acb3cde P 39666a280cd648579a4ad0f800aa7261: Bootstrap starting.
I20260709 12:23:34.784937 10477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6cc3e80f4f6411b89c21921f2929554. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:34.778033 10531 raft_consensus.cc:359] T c8b3a5c008584867bf2282f87acb3cde P 62eb0e44cb794e9db922a20fcfb9d606 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:34.788901 10531 raft_consensus.cc:385] T c8b3a5c008584867bf2282f87acb3cde P 62eb0e44cb794e9db922a20fcfb9d606 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:34.789271 10531 raft_consensus.cc:740] T c8b3a5c008584867bf2282f87acb3cde P 62eb0e44cb794e9db922a20fcfb9d606 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62eb0e44cb794e9db922a20fcfb9d606, State: Initialized, Role: FOLLOWER
I20260709 12:23:34.790084 10530 tablet_bootstrap.cc:654] T c8b3a5c008584867bf2282f87acb3cde P 39666a280cd648579a4ad0f800aa7261: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:34.790663 10532 tablet_bootstrap.cc:492] T 5764d623ece6411d8e3adfbd095f0fe1 P 09ec138dff9842f0858adca947bc33fb: No bootstrap required, opened a new log
I20260709 12:23:34.790084 10531 consensus_queue.cc:260] T c8b3a5c008584867bf2282f87acb3cde P 62eb0e44cb794e9db922a20fcfb9d606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:34.791158 10532 ts_tablet_manager.cc:1403] T 5764d623ece6411d8e3adfbd095f0fe1 P 09ec138dff9842f0858adca947bc33fb: Time spent bootstrapping tablet: real 0.084s	user 0.012s	sys 0.000s
I20260709 12:23:34.794660 10532 raft_consensus.cc:359] T 5764d623ece6411d8e3adfbd095f0fe1 P 09ec138dff9842f0858adca947bc33fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:34.795693 10532 raft_consensus.cc:385] T 5764d623ece6411d8e3adfbd095f0fe1 P 09ec138dff9842f0858adca947bc33fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:34.796084 10532 raft_consensus.cc:740] T 5764d623ece6411d8e3adfbd095f0fe1 P 09ec138dff9842f0858adca947bc33fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09ec138dff9842f0858adca947bc33fb, State: Initialized, Role: FOLLOWER
I20260709 12:23:34.800133 10531 ts_tablet_manager.cc:1434] T c8b3a5c008584867bf2282f87acb3cde P 62eb0e44cb794e9db922a20fcfb9d606: Time spent starting tablet: real 0.025s	user 0.010s	sys 0.004s
I20260709 12:23:34.801162 10531 tablet_bootstrap.cc:492] T 1763c604c9c84205be8b3bf019a15fa0 P 62eb0e44cb794e9db922a20fcfb9d606: Bootstrap starting.
I20260709 12:23:34.801713 10515 heartbeater.cc:499] Master 127.9.116.126:41725 was elected leader, sending a full tablet report...
I20260709 12:23:34.804643 10532 consensus_queue.cc:260] T 5764d623ece6411d8e3adfbd095f0fe1 P 09ec138dff9842f0858adca947bc33fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:34.808137 10531 tablet_bootstrap.cc:654] T 1763c604c9c84205be8b3bf019a15fa0 P 62eb0e44cb794e9db922a20fcfb9d606: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:34.820887 10330 tablet_service.cc:1511] Processing CreateTablet for tablet ce98990ba39f44f4b792419973437b1c (DEFAULT_TABLE table=test-workload [id=10a8e22a91a94b62af098a79eb91ce55]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:23:34.822762 10330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce98990ba39f44f4b792419973437b1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:34.823450 10404 tablet_service.cc:1511] Processing CreateTablet for tablet ce98990ba39f44f4b792419973437b1c (DEFAULT_TABLE table=test-workload [id=10a8e22a91a94b62af098a79eb91ce55]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:23:34.824808 10404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce98990ba39f44f4b792419973437b1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:34.828641 10531 tablet_bootstrap.cc:492] T 1763c604c9c84205be8b3bf019a15fa0 P 62eb0e44cb794e9db922a20fcfb9d606: No bootstrap required, opened a new log
I20260709 12:23:34.829237 10531 ts_tablet_manager.cc:1403] T 1763c604c9c84205be8b3bf019a15fa0 P 62eb0e44cb794e9db922a20fcfb9d606: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.004s
I20260709 12:23:34.830991 10535 raft_consensus.cc:493] T 57fc852991f54b508ff41067c25fe854 P 39666a280cd648579a4ad0f800aa7261 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:34.831189 10479 tablet_service.cc:1511] Processing CreateTablet for tablet ce98990ba39f44f4b792419973437b1c (DEFAULT_TABLE table=test-workload [id=10a8e22a91a94b62af098a79eb91ce55]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:23:34.831619 10535 raft_consensus.cc:515] T 57fc852991f54b508ff41067c25fe854 P 39666a280cd648579a4ad0f800aa7261 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:34.832573 10479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce98990ba39f44f4b792419973437b1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:34.837157 10531 raft_consensus.cc:359] T 1763c604c9c84205be8b3bf019a15fa0 P 62eb0e44cb794e9db922a20fcfb9d606 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:34.837917 10531 raft_consensus.cc:385] T 1763c604c9c84205be8b3bf019a15fa0 P 62eb0e44cb794e9db922a20fcfb9d606 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:34.838228 10531 raft_consensus.cc:740] T 1763c604c9c84205be8b3bf019a15fa0 P 62eb0e44cb794e9db922a20fcfb9d606 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62eb0e44cb794e9db922a20fcfb9d606, State: Initialized, Role: FOLLOWER
I20260709 12:23:34.839223 10535 leader_election.cc:290] T 57fc852991f54b508ff41067c25fe854 P 39666a280cd648579a4ad0f800aa7261 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09ec138dff9842f0858adca947bc33fb (127.9.116.65:42825), 62eb0e44cb794e9db922a20fcfb9d606 (127.9.116.67:42127)
I20260709 12:23:34.840691 10366 heartbeater.cc:499] Master 127.9.116.126:41725 was elected leader, sending a full tablet report...
I20260709 12:23:34.843216 10531 consensus_queue.cc:260] T 1763c604c9c84205be8b3bf019a15fa0 P 62eb0e44cb794e9db922a20fcfb9d606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:34.849391 10341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fc852991f54b508ff41067c25fe854" candidate_uuid: "39666a280cd648579a4ad0f800aa7261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09ec138dff9842f0858adca947bc33fb" is_pre_election: true
W20260709 12:23:34.851708 10382 leader_election.cc:343] T 57fc852991f54b508ff41067c25fe854 P 39666a280cd648579a4ad0f800aa7261 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09ec138dff9842f0858adca947bc33fb (127.9.116.65:42825): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:34.849639 10531 ts_tablet_manager.cc:1434] T 1763c604c9c84205be8b3bf019a15fa0 P 62eb0e44cb794e9db922a20fcfb9d606: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 12:23:34.852025 10532 ts_tablet_manager.cc:1434] T 5764d623ece6411d8e3adfbd095f0fe1 P 09ec138dff9842f0858adca947bc33fb: Time spent starting tablet: real 0.060s	user 0.009s	sys 0.012s
I20260709 12:23:34.857688 10532 tablet_bootstrap.cc:492] T c8b3a5c008584867bf2282f87acb3cde P 09ec138dff9842f0858adca947bc33fb: Bootstrap starting.
I20260709 12:23:34.866302 10531 tablet_bootstrap.cc:492] T 57fc852991f54b508ff41067c25fe854 P 62eb0e44cb794e9db922a20fcfb9d606: Bootstrap starting.
I20260709 12:23:34.871999 10532 tablet_bootstrap.cc:654] T c8b3a5c008584867bf2282f87acb3cde P 09ec138dff9842f0858adca947bc33fb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:34.876586 10531 tablet_bootstrap.cc:654] T 57fc852991f54b508ff41067c25fe854 P 62eb0e44cb794e9db922a20fcfb9d606: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:34.877578 10490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fc852991f54b508ff41067c25fe854" candidate_uuid: "39666a280cd648579a4ad0f800aa7261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62eb0e44cb794e9db922a20fcfb9d606" is_pre_election: true
I20260709 12:23:34.877571 10530 tablet_bootstrap.cc:492] T c8b3a5c008584867bf2282f87acb3cde P 39666a280cd648579a4ad0f800aa7261: No bootstrap required, opened a new log
W20260709 12:23:34.879230 10379 leader_election.cc:343] T 57fc852991f54b508ff41067c25fe854 P 39666a280cd648579a4ad0f800aa7261 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 62eb0e44cb794e9db922a20fcfb9d606 (127.9.116.67:42127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:34.879650 10530 ts_tablet_manager.cc:1403] T c8b3a5c008584867bf2282f87acb3cde P 39666a280cd648579a4ad0f800aa7261: Time spent bootstrapping tablet: real 0.112s	user 0.031s	sys 0.017s
I20260709 12:23:34.879686 10379 leader_election.cc:304] T 57fc852991f54b508ff41067c25fe854 P 39666a280cd648579a4ad0f800aa7261 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39666a280cd648579a4ad0f800aa7261; no voters: 09ec138dff9842f0858adca947bc33fb, 62eb0e44cb794e9db922a20fcfb9d606
I20260709 12:23:34.880898 10535 raft_consensus.cc:2749] T 57fc852991f54b508ff41067c25fe854 P 39666a280cd648579a4ad0f800aa7261 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:34.882824 10532 tablet_bootstrap.cc:492] T c8b3a5c008584867bf2282f87acb3cde P 09ec138dff9842f0858adca947bc33fb: No bootstrap required, opened a new log
I20260709 12:23:34.883426 10532 ts_tablet_manager.cc:1403] T c8b3a5c008584867bf2282f87acb3cde P 09ec138dff9842f0858adca947bc33fb: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.000s
I20260709 12:23:34.882869 10530 raft_consensus.cc:359] T c8b3a5c008584867bf2282f87acb3cde P 39666a280cd648579a4ad0f800aa7261 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:34.886548 10532 raft_consensus.cc:359] T c8b3a5c008584867bf2282f87acb3cde P 09ec138dff9842f0858adca947bc33fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:34.887712 10532 raft_consensus.cc:385] T c8b3a5c008584867bf2282f87acb3cde P 09ec138dff9842f0858adca947bc33fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:34.888028 10532 raft_consensus.cc:740] T c8b3a5c008584867bf2282f87acb3cde P 09ec138dff9842f0858adca947bc33fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09ec138dff9842f0858adca947bc33fb, State: Initialized, Role: FOLLOWER
I20260709 12:23:34.887301 10530 raft_consensus.cc:385] T c8b3a5c008584867bf2282f87acb3cde P 39666a280cd648579a4ad0f800aa7261 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:34.888964 10530 raft_consensus.cc:740] T c8b3a5c008584867bf2282f87acb3cde P 39666a280cd648579a4ad0f800aa7261 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39666a280cd648579a4ad0f800aa7261, State: Initialized, Role: FOLLOWER
I20260709 12:23:34.889698 10530 consensus_queue.cc:260] T c8b3a5c008584867bf2282f87acb3cde P 39666a280cd648579a4ad0f800aa7261 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:34.890777 10531 tablet_bootstrap.cc:492] T 57fc852991f54b508ff41067c25fe854 P 62eb0e44cb794e9db922a20fcfb9d606: No bootstrap required, opened a new log
I20260709 12:23:34.890763 10532 consensus_queue.cc:260] T c8b3a5c008584867bf2282f87acb3cde P 09ec138dff9842f0858adca947bc33fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:34.891463 10531 ts_tablet_manager.cc:1403] T 57fc852991f54b508ff41067c25fe854 P 62eb0e44cb794e9db922a20fcfb9d606: Time spent bootstrapping tablet: real 0.035s	user 0.015s	sys 0.005s
I20260709 12:23:34.893361 10532 ts_tablet_manager.cc:1434] T c8b3a5c008584867bf2282f87acb3cde P 09ec138dff9842f0858adca947bc33fb: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:23:34.894411 10532 tablet_bootstrap.cc:492] T f45d2ff8d4f540878e0ec1058a28f8d5 P 09ec138dff9842f0858adca947bc33fb: Bootstrap starting.
I20260709 12:23:34.895103 10531 raft_consensus.cc:359] T 57fc852991f54b508ff41067c25fe854 P 62eb0e44cb794e9db922a20fcfb9d606 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:34.895825 10531 raft_consensus.cc:385] T 57fc852991f54b508ff41067c25fe854 P 62eb0e44cb794e9db922a20fcfb9d606 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:34.896101 10531 raft_consensus.cc:740] T 57fc852991f54b508ff41067c25fe854 P 62eb0e44cb794e9db922a20fcfb9d606 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62eb0e44cb794e9db922a20fcfb9d606, State: Initialized, Role: FOLLOWER
I20260709 12:23:34.896847 10531 consensus_queue.cc:260] T 57fc852991f54b508ff41067c25fe854 P 62eb0e44cb794e9db922a20fcfb9d606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:34.899076 10531 ts_tablet_manager.cc:1434] T 57fc852991f54b508ff41067c25fe854 P 62eb0e44cb794e9db922a20fcfb9d606: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:23:34.900080 10531 tablet_bootstrap.cc:492] T f45d2ff8d4f540878e0ec1058a28f8d5 P 62eb0e44cb794e9db922a20fcfb9d606: Bootstrap starting.
I20260709 12:23:34.900729 10532 tablet_bootstrap.cc:654] T f45d2ff8d4f540878e0ec1058a28f8d5 P 09ec138dff9842f0858adca947bc33fb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:34.901695 10530 ts_tablet_manager.cc:1434] T c8b3a5c008584867bf2282f87acb3cde P 39666a280cd648579a4ad0f800aa7261: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.001s
I20260709 12:23:34.906828 10531 tablet_bootstrap.cc:654] T f45d2ff8d4f540878e0ec1058a28f8d5 P 62eb0e44cb794e9db922a20fcfb9d606: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:34.908752 10530 tablet_bootstrap.cc:492] T 5764d623ece6411d8e3adfbd095f0fe1 P 39666a280cd648579a4ad0f800aa7261: Bootstrap starting.
I20260709 12:23:34.913033 10532 tablet_bootstrap.cc:492] T f45d2ff8d4f540878e0ec1058a28f8d5 P 09ec138dff9842f0858adca947bc33fb: No bootstrap required, opened a new log
I20260709 12:23:34.913582 10532 ts_tablet_manager.cc:1403] T f45d2ff8d4f540878e0ec1058a28f8d5 P 09ec138dff9842f0858adca947bc33fb: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.008s
I20260709 12:23:34.916811 10532 raft_consensus.cc:359] T f45d2ff8d4f540878e0ec1058a28f8d5 P 09ec138dff9842f0858adca947bc33fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } } peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } }
I20260709 12:23:34.917722 10532 raft_consensus.cc:385] T f45d2ff8d4f540878e0ec1058a28f8d5 P 09ec138dff9842f0858adca947bc33fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:34.918025 10532 raft_consensus.cc:740] T f45d2ff8d4f540878e0ec1058a28f8d5 P 09ec138dff9842f0858adca947bc33fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09ec138dff9842f0858adca947bc33fb, State: Initialized, Role: FOLLOWER
I20260709 12:23:34.919085 10532 consensus_queue.cc:260] T f45d2ff8d4f540878e0ec1058a28f8d5 P 09ec138dff9842f0858adca947bc33fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } } peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } }
I20260709 12:23:34.919561 10535 raft_consensus.cc:493] T c8b3a5c008584867bf2282f87acb3cde P 39666a280cd648579a4ad0f800aa7261 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:34.920312 10535 raft_consensus.cc:515] T c8b3a5c008584867bf2282f87acb3cde P 39666a280cd648579a4ad0f800aa7261 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:34.923765 10341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8b3a5c008584867bf2282f87acb3cde" candidate_uuid: "39666a280cd648579a4ad0f800aa7261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09ec138dff9842f0858adca947bc33fb" is_pre_election: true
I20260709 12:23:34.924646 10341 raft_consensus.cc:2468] T c8b3a5c008584867bf2282f87acb3cde P 09ec138dff9842f0858adca947bc33fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39666a280cd648579a4ad0f800aa7261 in term 0.
I20260709 12:23:34.925034 10532 ts_tablet_manager.cc:1434] T f45d2ff8d4f540878e0ec1058a28f8d5 P 09ec138dff9842f0858adca947bc33fb: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.003s
I20260709 12:23:34.925251 10490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8b3a5c008584867bf2282f87acb3cde" candidate_uuid: "39666a280cd648579a4ad0f800aa7261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62eb0e44cb794e9db922a20fcfb9d606" is_pre_election: true
I20260709 12:23:34.926342 10532 tablet_bootstrap.cc:492] T 57fc852991f54b508ff41067c25fe854 P 09ec138dff9842f0858adca947bc33fb: Bootstrap starting.
I20260709 12:23:34.926143 10382 leader_election.cc:304] T c8b3a5c008584867bf2282f87acb3cde P 39666a280cd648579a4ad0f800aa7261 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09ec138dff9842f0858adca947bc33fb, 39666a280cd648579a4ad0f800aa7261; no voters: 
I20260709 12:23:34.926486 10535 leader_election.cc:290] T c8b3a5c008584867bf2282f87acb3cde P 39666a280cd648579a4ad0f800aa7261 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09ec138dff9842f0858adca947bc33fb (127.9.116.65:42825), 62eb0e44cb794e9db922a20fcfb9d606 (127.9.116.67:42127)
I20260709 12:23:34.927356 10535 raft_consensus.cc:2804] T c8b3a5c008584867bf2282f87acb3cde P 39666a280cd648579a4ad0f800aa7261 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:34.927832 10535 raft_consensus.cc:493] T c8b3a5c008584867bf2282f87acb3cde P 39666a280cd648579a4ad0f800aa7261 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:34.928305 10535 raft_consensus.cc:3060] T c8b3a5c008584867bf2282f87acb3cde P 39666a280cd648579a4ad0f800aa7261 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:34.926188 10490 raft_consensus.cc:2468] T c8b3a5c008584867bf2282f87acb3cde P 62eb0e44cb794e9db922a20fcfb9d606 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39666a280cd648579a4ad0f800aa7261 in term 0.
I20260709 12:23:34.934233 10532 tablet_bootstrap.cc:654] T 57fc852991f54b508ff41067c25fe854 P 09ec138dff9842f0858adca947bc33fb: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:34.935953 10287 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:34.937893 10530 tablet_bootstrap.cc:654] T 5764d623ece6411d8e3adfbd095f0fe1 P 39666a280cd648579a4ad0f800aa7261: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:34.943547 10531 tablet_bootstrap.cc:492] T f45d2ff8d4f540878e0ec1058a28f8d5 P 62eb0e44cb794e9db922a20fcfb9d606: No bootstrap required, opened a new log
I20260709 12:23:34.943665 10532 tablet_bootstrap.cc:492] T 57fc852991f54b508ff41067c25fe854 P 09ec138dff9842f0858adca947bc33fb: No bootstrap required, opened a new log
I20260709 12:23:34.944311 10531 ts_tablet_manager.cc:1403] T f45d2ff8d4f540878e0ec1058a28f8d5 P 62eb0e44cb794e9db922a20fcfb9d606: Time spent bootstrapping tablet: real 0.044s	user 0.019s	sys 0.015s
I20260709 12:23:34.944525 10532 ts_tablet_manager.cc:1403] T 57fc852991f54b508ff41067c25fe854 P 09ec138dff9842f0858adca947bc33fb: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.003s
I20260709 12:23:34.947135 10535 raft_consensus.cc:515] T c8b3a5c008584867bf2282f87acb3cde P 39666a280cd648579a4ad0f800aa7261 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:34.947801 10532 raft_consensus.cc:359] T 57fc852991f54b508ff41067c25fe854 P 09ec138dff9842f0858adca947bc33fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:34.947710 10531 raft_consensus.cc:359] T f45d2ff8d4f540878e0ec1058a28f8d5 P 62eb0e44cb794e9db922a20fcfb9d606 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } } peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } }
I20260709 12:23:34.948711 10531 raft_consensus.cc:385] T f45d2ff8d4f540878e0ec1058a28f8d5 P 62eb0e44cb794e9db922a20fcfb9d606 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:34.948688 10532 raft_consensus.cc:385] T 57fc852991f54b508ff41067c25fe854 P 09ec138dff9842f0858adca947bc33fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:34.949230 10531 raft_consensus.cc:740] T f45d2ff8d4f540878e0ec1058a28f8d5 P 62eb0e44cb794e9db922a20fcfb9d606 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62eb0e44cb794e9db922a20fcfb9d606, State: Initialized, Role: FOLLOWER
I20260709 12:23:34.949257 10532 raft_consensus.cc:740] T 57fc852991f54b508ff41067c25fe854 P 09ec138dff9842f0858adca947bc33fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09ec138dff9842f0858adca947bc33fb, State: Initialized, Role: FOLLOWER
I20260709 12:23:34.950264 10531 consensus_queue.cc:260] T f45d2ff8d4f540878e0ec1058a28f8d5 P 62eb0e44cb794e9db922a20fcfb9d606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } } peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } }
I20260709 12:23:34.950238 10532 consensus_queue.cc:260] T 57fc852991f54b508ff41067c25fe854 P 09ec138dff9842f0858adca947bc33fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:34.951915 10341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8b3a5c008584867bf2282f87acb3cde" candidate_uuid: "39666a280cd648579a4ad0f800aa7261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09ec138dff9842f0858adca947bc33fb"
I20260709 12:23:34.952482 10341 raft_consensus.cc:3060] T c8b3a5c008584867bf2282f87acb3cde P 09ec138dff9842f0858adca947bc33fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:34.953034 10531 ts_tablet_manager.cc:1434] T f45d2ff8d4f540878e0ec1058a28f8d5 P 62eb0e44cb794e9db922a20fcfb9d606: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:23:34.953547 10532 ts_tablet_manager.cc:1434] T 57fc852991f54b508ff41067c25fe854 P 09ec138dff9842f0858adca947bc33fb: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:23:34.954294 10531 tablet_bootstrap.cc:492] T 5764d623ece6411d8e3adfbd095f0fe1 P 62eb0e44cb794e9db922a20fcfb9d606: Bootstrap starting.
I20260709 12:23:34.954497 10532 tablet_bootstrap.cc:492] T 1763c604c9c84205be8b3bf019a15fa0 P 09ec138dff9842f0858adca947bc33fb: Bootstrap starting.
I20260709 12:23:34.960114 10341 raft_consensus.cc:2468] T c8b3a5c008584867bf2282f87acb3cde P 09ec138dff9842f0858adca947bc33fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39666a280cd648579a4ad0f800aa7261 in term 1.
I20260709 12:23:34.961318 10382 leader_election.cc:304] T c8b3a5c008584867bf2282f87acb3cde P 39666a280cd648579a4ad0f800aa7261 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09ec138dff9842f0858adca947bc33fb, 39666a280cd648579a4ad0f800aa7261; no voters: 
I20260709 12:23:34.961844 10531 tablet_bootstrap.cc:654] T 5764d623ece6411d8e3adfbd095f0fe1 P 62eb0e44cb794e9db922a20fcfb9d606: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:34.962348 10546 raft_consensus.cc:2804] T c8b3a5c008584867bf2282f87acb3cde P 39666a280cd648579a4ad0f800aa7261 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:34.963367 10532 tablet_bootstrap.cc:654] T 1763c604c9c84205be8b3bf019a15fa0 P 09ec138dff9842f0858adca947bc33fb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:34.973147 10530 tablet_bootstrap.cc:492] T 5764d623ece6411d8e3adfbd095f0fe1 P 39666a280cd648579a4ad0f800aa7261: No bootstrap required, opened a new log
I20260709 12:23:34.973719 10530 ts_tablet_manager.cc:1403] T 5764d623ece6411d8e3adfbd095f0fe1 P 39666a280cd648579a4ad0f800aa7261: Time spent bootstrapping tablet: real 0.065s	user 0.009s	sys 0.014s
I20260709 12:23:34.975878 10535 leader_election.cc:290] T c8b3a5c008584867bf2282f87acb3cde P 39666a280cd648579a4ad0f800aa7261 [CANDIDATE]: Term 1 election: Requested vote from peers 09ec138dff9842f0858adca947bc33fb (127.9.116.65:42825), 62eb0e44cb794e9db922a20fcfb9d606 (127.9.116.67:42127)
I20260709 12:23:34.977151 10490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8b3a5c008584867bf2282f87acb3cde" candidate_uuid: "39666a280cd648579a4ad0f800aa7261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62eb0e44cb794e9db922a20fcfb9d606"
I20260709 12:23:34.978010 10490 raft_consensus.cc:3060] T c8b3a5c008584867bf2282f87acb3cde P 62eb0e44cb794e9db922a20fcfb9d606 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:34.982944 10530 raft_consensus.cc:359] T 5764d623ece6411d8e3adfbd095f0fe1 P 39666a280cd648579a4ad0f800aa7261 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:34.983768 10530 raft_consensus.cc:385] T 5764d623ece6411d8e3adfbd095f0fe1 P 39666a280cd648579a4ad0f800aa7261 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:34.984069 10530 raft_consensus.cc:740] T 5764d623ece6411d8e3adfbd095f0fe1 P 39666a280cd648579a4ad0f800aa7261 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39666a280cd648579a4ad0f800aa7261, State: Initialized, Role: FOLLOWER
I20260709 12:23:34.984867 10530 consensus_queue.cc:260] T 5764d623ece6411d8e3adfbd095f0fe1 P 39666a280cd648579a4ad0f800aa7261 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:34.987061 10546 raft_consensus.cc:697] T c8b3a5c008584867bf2282f87acb3cde P 39666a280cd648579a4ad0f800aa7261 [term 1 LEADER]: Becoming Leader. State: Replica: 39666a280cd648579a4ad0f800aa7261, State: Running, Role: LEADER
I20260709 12:23:34.988207 10546 consensus_queue.cc:237] T c8b3a5c008584867bf2282f87acb3cde P 39666a280cd648579a4ad0f800aa7261 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:34.994256 10530 ts_tablet_manager.cc:1434] T 5764d623ece6411d8e3adfbd095f0fe1 P 39666a280cd648579a4ad0f800aa7261: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.003s
I20260709 12:23:34.989830 10490 raft_consensus.cc:2468] T c8b3a5c008584867bf2282f87acb3cde P 62eb0e44cb794e9db922a20fcfb9d606 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39666a280cd648579a4ad0f800aa7261 in term 1.
I20260709 12:23:34.995604 10530 tablet_bootstrap.cc:492] T f45d2ff8d4f540878e0ec1058a28f8d5 P 39666a280cd648579a4ad0f800aa7261: Bootstrap starting.
I20260709 12:23:35.003014 10531 tablet_bootstrap.cc:492] T 5764d623ece6411d8e3adfbd095f0fe1 P 62eb0e44cb794e9db922a20fcfb9d606: No bootstrap required, opened a new log
I20260709 12:23:35.003715 10531 ts_tablet_manager.cc:1403] T 5764d623ece6411d8e3adfbd095f0fe1 P 62eb0e44cb794e9db922a20fcfb9d606: Time spent bootstrapping tablet: real 0.050s	user 0.026s	sys 0.018s
I20260709 12:23:35.003899 10532 tablet_bootstrap.cc:492] T 1763c604c9c84205be8b3bf019a15fa0 P 09ec138dff9842f0858adca947bc33fb: No bootstrap required, opened a new log
I20260709 12:23:35.004020 10530 tablet_bootstrap.cc:654] T f45d2ff8d4f540878e0ec1058a28f8d5 P 39666a280cd648579a4ad0f800aa7261: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:35.004519 10532 ts_tablet_manager.cc:1403] T 1763c604c9c84205be8b3bf019a15fa0 P 09ec138dff9842f0858adca947bc33fb: Time spent bootstrapping tablet: real 0.050s	user 0.020s	sys 0.025s
I20260709 12:23:35.007382 10531 raft_consensus.cc:359] T 5764d623ece6411d8e3adfbd095f0fe1 P 62eb0e44cb794e9db922a20fcfb9d606 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:35.008404 10531 raft_consensus.cc:385] T 5764d623ece6411d8e3adfbd095f0fe1 P 62eb0e44cb794e9db922a20fcfb9d606 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:35.007854 10532 raft_consensus.cc:359] T 1763c604c9c84205be8b3bf019a15fa0 P 09ec138dff9842f0858adca947bc33fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:35.008728 10531 raft_consensus.cc:740] T 5764d623ece6411d8e3adfbd095f0fe1 P 62eb0e44cb794e9db922a20fcfb9d606 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62eb0e44cb794e9db922a20fcfb9d606, State: Initialized, Role: FOLLOWER
I20260709 12:23:35.008893 10532 raft_consensus.cc:385] T 1763c604c9c84205be8b3bf019a15fa0 P 09ec138dff9842f0858adca947bc33fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:35.009424 10532 raft_consensus.cc:740] T 1763c604c9c84205be8b3bf019a15fa0 P 09ec138dff9842f0858adca947bc33fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09ec138dff9842f0858adca947bc33fb, State: Initialized, Role: FOLLOWER
I20260709 12:23:35.008987 10237 catalog_manager.cc:5697] T c8b3a5c008584867bf2282f87acb3cde P 39666a280cd648579a4ad0f800aa7261 reported cstate change: term changed from 0 to 1, leader changed from <none> to 39666a280cd648579a4ad0f800aa7261 (127.9.116.66). New cstate: current_term: 1 leader_uuid: "39666a280cd648579a4ad0f800aa7261" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:35.009686 10531 consensus_queue.cc:260] T 5764d623ece6411d8e3adfbd095f0fe1 P 62eb0e44cb794e9db922a20fcfb9d606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:35.010876 10532 consensus_queue.cc:260] T 1763c604c9c84205be8b3bf019a15fa0 P 09ec138dff9842f0858adca947bc33fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:35.011860 10537 raft_consensus.cc:493] T f45d2ff8d4f540878e0ec1058a28f8d5 P 62eb0e44cb794e9db922a20fcfb9d606 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.012537 10537 raft_consensus.cc:515] T f45d2ff8d4f540878e0ec1058a28f8d5 P 62eb0e44cb794e9db922a20fcfb9d606 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } } peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } }
I20260709 12:23:35.014804 10532 ts_tablet_manager.cc:1434] T 1763c604c9c84205be8b3bf019a15fa0 P 09ec138dff9842f0858adca947bc33fb: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 12:23:35.016526 10532 tablet_bootstrap.cc:492] T b719323785d84477bf49a3ebbf366f37 P 09ec138dff9842f0858adca947bc33fb: Bootstrap starting.
I20260709 12:23:35.021044 10537 leader_election.cc:290] T f45d2ff8d4f540878e0ec1058a28f8d5 P 62eb0e44cb794e9db922a20fcfb9d606 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39666a280cd648579a4ad0f800aa7261 (127.9.116.66:43111), 09ec138dff9842f0858adca947bc33fb (127.9.116.65:42825)
I20260709 12:23:35.025040 10537 raft_consensus.cc:493] T 1763c604c9c84205be8b3bf019a15fa0 P 62eb0e44cb794e9db922a20fcfb9d606 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.030121 10537 raft_consensus.cc:515] T 1763c604c9c84205be8b3bf019a15fa0 P 62eb0e44cb794e9db922a20fcfb9d606 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:35.025532 10532 tablet_bootstrap.cc:654] T b719323785d84477bf49a3ebbf366f37 P 09ec138dff9842f0858adca947bc33fb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:35.032989 10537 leader_election.cc:290] T 1763c604c9c84205be8b3bf019a15fa0 P 62eb0e44cb794e9db922a20fcfb9d606 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09ec138dff9842f0858adca947bc33fb (127.9.116.65:42825), 39666a280cd648579a4ad0f800aa7261 (127.9.116.66:43111)
I20260709 12:23:35.028822 10531 ts_tablet_manager.cc:1434] T 5764d623ece6411d8e3adfbd095f0fe1 P 62eb0e44cb794e9db922a20fcfb9d606: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 12:23:35.034366 10531 tablet_bootstrap.cc:492] T b719323785d84477bf49a3ebbf366f37 P 62eb0e44cb794e9db922a20fcfb9d606: Bootstrap starting.
I20260709 12:23:35.047057 10530 tablet_bootstrap.cc:492] T f45d2ff8d4f540878e0ec1058a28f8d5 P 39666a280cd648579a4ad0f800aa7261: No bootstrap required, opened a new log
I20260709 12:23:35.047643 10530 ts_tablet_manager.cc:1403] T f45d2ff8d4f540878e0ec1058a28f8d5 P 39666a280cd648579a4ad0f800aa7261: Time spent bootstrapping tablet: real 0.052s	user 0.019s	sys 0.021s
I20260709 12:23:35.049136 10531 tablet_bootstrap.cc:654] T b719323785d84477bf49a3ebbf366f37 P 62eb0e44cb794e9db922a20fcfb9d606: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:35.051000 10530 raft_consensus.cc:359] T f45d2ff8d4f540878e0ec1058a28f8d5 P 39666a280cd648579a4ad0f800aa7261 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } } peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } }
I20260709 12:23:35.052029 10530 raft_consensus.cc:385] T f45d2ff8d4f540878e0ec1058a28f8d5 P 39666a280cd648579a4ad0f800aa7261 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:35.052316 10530 raft_consensus.cc:740] T f45d2ff8d4f540878e0ec1058a28f8d5 P 39666a280cd648579a4ad0f800aa7261 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39666a280cd648579a4ad0f800aa7261, State: Initialized, Role: FOLLOWER
I20260709 12:23:35.053457 10532 tablet_bootstrap.cc:492] T b719323785d84477bf49a3ebbf366f37 P 09ec138dff9842f0858adca947bc33fb: No bootstrap required, opened a new log
I20260709 12:23:35.053187 10530 consensus_queue.cc:260] T f45d2ff8d4f540878e0ec1058a28f8d5 P 39666a280cd648579a4ad0f800aa7261 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } } peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } }
I20260709 12:23:35.054318 10532 ts_tablet_manager.cc:1403] T b719323785d84477bf49a3ebbf366f37 P 09ec138dff9842f0858adca947bc33fb: Time spent bootstrapping tablet: real 0.038s	user 0.008s	sys 0.008s
I20260709 12:23:35.057982 10530 ts_tablet_manager.cc:1434] T f45d2ff8d4f540878e0ec1058a28f8d5 P 39666a280cd648579a4ad0f800aa7261: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:23:35.059065 10530 tablet_bootstrap.cc:492] T 1763c604c9c84205be8b3bf019a15fa0 P 39666a280cd648579a4ad0f800aa7261: Bootstrap starting.
I20260709 12:23:35.068032 10416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f45d2ff8d4f540878e0ec1058a28f8d5" candidate_uuid: "62eb0e44cb794e9db922a20fcfb9d606" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39666a280cd648579a4ad0f800aa7261" is_pre_election: true
I20260709 12:23:35.068392 10415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1763c604c9c84205be8b3bf019a15fa0" candidate_uuid: "62eb0e44cb794e9db922a20fcfb9d606" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39666a280cd648579a4ad0f800aa7261" is_pre_election: true
I20260709 12:23:35.069033 10416 raft_consensus.cc:2468] T f45d2ff8d4f540878e0ec1058a28f8d5 P 39666a280cd648579a4ad0f800aa7261 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62eb0e44cb794e9db922a20fcfb9d606 in term 0.
I20260709 12:23:35.066458 10532 raft_consensus.cc:359] T b719323785d84477bf49a3ebbf366f37 P 09ec138dff9842f0858adca947bc33fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:35.071496 10532 raft_consensus.cc:385] T b719323785d84477bf49a3ebbf366f37 P 09ec138dff9842f0858adca947bc33fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:35.071518 10530 tablet_bootstrap.cc:654] T 1763c604c9c84205be8b3bf019a15fa0 P 39666a280cd648579a4ad0f800aa7261: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:35.072077 10532 raft_consensus.cc:740] T b719323785d84477bf49a3ebbf366f37 P 09ec138dff9842f0858adca947bc33fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09ec138dff9842f0858adca947bc33fb, State: Initialized, Role: FOLLOWER
I20260709 12:23:35.072913 10532 consensus_queue.cc:260] T b719323785d84477bf49a3ebbf366f37 P 09ec138dff9842f0858adca947bc33fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:35.074012 10531 tablet_bootstrap.cc:492] T b719323785d84477bf49a3ebbf366f37 P 62eb0e44cb794e9db922a20fcfb9d606: No bootstrap required, opened a new log
I20260709 12:23:35.074584 10531 ts_tablet_manager.cc:1403] T b719323785d84477bf49a3ebbf366f37 P 62eb0e44cb794e9db922a20fcfb9d606: Time spent bootstrapping tablet: real 0.040s	user 0.010s	sys 0.010s
I20260709 12:23:35.077353 10532 ts_tablet_manager.cc:1434] T b719323785d84477bf49a3ebbf366f37 P 09ec138dff9842f0858adca947bc33fb: Time spent starting tablet: real 0.023s	user 0.010s	sys 0.000s
I20260709 12:23:35.078368 10532 tablet_bootstrap.cc:492] T b6cc3e80f4f6411b89c21921f2929554 P 09ec138dff9842f0858adca947bc33fb: Bootstrap starting.
W20260709 12:23:35.079730 10456 leader_election.cc:343] T 1763c604c9c84205be8b3bf019a15fa0 P 62eb0e44cb794e9db922a20fcfb9d606 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 39666a280cd648579a4ad0f800aa7261 (127.9.116.66:43111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:35.080670 10456 leader_election.cc:304] T f45d2ff8d4f540878e0ec1058a28f8d5 P 62eb0e44cb794e9db922a20fcfb9d606 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39666a280cd648579a4ad0f800aa7261, 62eb0e44cb794e9db922a20fcfb9d606; no voters: 
I20260709 12:23:35.088320 10554 raft_consensus.cc:2804] T f45d2ff8d4f540878e0ec1058a28f8d5 P 62eb0e44cb794e9db922a20fcfb9d606 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:35.088919 10554 raft_consensus.cc:493] T f45d2ff8d4f540878e0ec1058a28f8d5 P 62eb0e44cb794e9db922a20fcfb9d606 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:35.089357 10554 raft_consensus.cc:3060] T f45d2ff8d4f540878e0ec1058a28f8d5 P 62eb0e44cb794e9db922a20fcfb9d606 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:35.096318 10539 raft_consensus.cc:493] T 1763c604c9c84205be8b3bf019a15fa0 P 09ec138dff9842f0858adca947bc33fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.097044 10539 raft_consensus.cc:515] T 1763c604c9c84205be8b3bf019a15fa0 P 09ec138dff9842f0858adca947bc33fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:35.108641 10532 tablet_bootstrap.cc:654] T b6cc3e80f4f6411b89c21921f2929554 P 09ec138dff9842f0858adca947bc33fb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:35.109956 10341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f45d2ff8d4f540878e0ec1058a28f8d5" candidate_uuid: "62eb0e44cb794e9db922a20fcfb9d606" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09ec138dff9842f0858adca947bc33fb" is_pre_election: true
I20260709 12:23:35.110050 10531 raft_consensus.cc:359] T b719323785d84477bf49a3ebbf366f37 P 62eb0e44cb794e9db922a20fcfb9d606 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:35.111013 10341 raft_consensus.cc:2468] T f45d2ff8d4f540878e0ec1058a28f8d5 P 09ec138dff9842f0858adca947bc33fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62eb0e44cb794e9db922a20fcfb9d606 in term 0.
I20260709 12:23:35.111323 10531 raft_consensus.cc:385] T b719323785d84477bf49a3ebbf366f37 P 62eb0e44cb794e9db922a20fcfb9d606 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:35.112061 10531 raft_consensus.cc:740] T b719323785d84477bf49a3ebbf366f37 P 62eb0e44cb794e9db922a20fcfb9d606 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62eb0e44cb794e9db922a20fcfb9d606, State: Initialized, Role: FOLLOWER
I20260709 12:23:35.113111 10531 consensus_queue.cc:260] T b719323785d84477bf49a3ebbf366f37 P 62eb0e44cb794e9db922a20fcfb9d606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:35.113749 10341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1763c604c9c84205be8b3bf019a15fa0" candidate_uuid: "62eb0e44cb794e9db922a20fcfb9d606" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09ec138dff9842f0858adca947bc33fb" is_pre_election: true
I20260709 12:23:35.114885 10341 raft_consensus.cc:2468] T 1763c604c9c84205be8b3bf019a15fa0 P 09ec138dff9842f0858adca947bc33fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62eb0e44cb794e9db922a20fcfb9d606 in term 0.
I20260709 12:23:35.117489 10456 leader_election.cc:304] T 1763c604c9c84205be8b3bf019a15fa0 P 62eb0e44cb794e9db922a20fcfb9d606 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09ec138dff9842f0858adca947bc33fb, 62eb0e44cb794e9db922a20fcfb9d606; no voters: 39666a280cd648579a4ad0f800aa7261
I20260709 12:23:35.118853 10531 ts_tablet_manager.cc:1434] T b719323785d84477bf49a3ebbf366f37 P 62eb0e44cb794e9db922a20fcfb9d606: Time spent starting tablet: real 0.044s	user 0.018s	sys 0.013s
I20260709 12:23:35.120306 10531 tablet_bootstrap.cc:492] T 86d8ee5b13404484811b10e05818abc8 P 62eb0e44cb794e9db922a20fcfb9d606: Bootstrap starting.
I20260709 12:23:35.129235 10539 leader_election.cc:290] T 1763c604c9c84205be8b3bf019a15fa0 P 09ec138dff9842f0858adca947bc33fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39666a280cd648579a4ad0f800aa7261 (127.9.116.66:43111), 62eb0e44cb794e9db922a20fcfb9d606 (127.9.116.67:42127)
I20260709 12:23:35.129951 10537 raft_consensus.cc:2804] T 1763c604c9c84205be8b3bf019a15fa0 P 62eb0e44cb794e9db922a20fcfb9d606 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:35.130615 10537 raft_consensus.cc:493] T 1763c604c9c84205be8b3bf019a15fa0 P 62eb0e44cb794e9db922a20fcfb9d606 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:35.131268 10537 raft_consensus.cc:3060] T 1763c604c9c84205be8b3bf019a15fa0 P 62eb0e44cb794e9db922a20fcfb9d606 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:35.141593 10531 tablet_bootstrap.cc:654] T 86d8ee5b13404484811b10e05818abc8 P 62eb0e44cb794e9db922a20fcfb9d606: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:35.142951 10537 raft_consensus.cc:515] T 1763c604c9c84205be8b3bf019a15fa0 P 62eb0e44cb794e9db922a20fcfb9d606 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:35.145896 10554 raft_consensus.cc:515] T f45d2ff8d4f540878e0ec1058a28f8d5 P 62eb0e44cb794e9db922a20fcfb9d606 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } } peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } }
I20260709 12:23:35.148779 10554 leader_election.cc:290] T f45d2ff8d4f540878e0ec1058a28f8d5 P 62eb0e44cb794e9db922a20fcfb9d606 [CANDIDATE]: Term 1 election: Requested vote from peers 39666a280cd648579a4ad0f800aa7261 (127.9.116.66:43111), 09ec138dff9842f0858adca947bc33fb (127.9.116.65:42825)
I20260709 12:23:35.146268 10537 leader_election.cc:290] T 1763c604c9c84205be8b3bf019a15fa0 P 62eb0e44cb794e9db922a20fcfb9d606 [CANDIDATE]: Term 1 election: Requested vote from peers 09ec138dff9842f0858adca947bc33fb (127.9.116.65:42825), 39666a280cd648579a4ad0f800aa7261 (127.9.116.66:43111)
I20260709 12:23:35.151928 10554 raft_consensus.cc:493] T 57fc852991f54b508ff41067c25fe854 P 62eb0e44cb794e9db922a20fcfb9d606 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.153416 10530 tablet_bootstrap.cc:492] T 1763c604c9c84205be8b3bf019a15fa0 P 39666a280cd648579a4ad0f800aa7261: No bootstrap required, opened a new log
I20260709 12:23:35.154690 10530 ts_tablet_manager.cc:1403] T 1763c604c9c84205be8b3bf019a15fa0 P 39666a280cd648579a4ad0f800aa7261: Time spent bootstrapping tablet: real 0.096s	user 0.036s	sys 0.044s
I20260709 12:23:35.155414 10554 raft_consensus.cc:515] T 57fc852991f54b508ff41067c25fe854 P 62eb0e44cb794e9db922a20fcfb9d606 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:35.156651 10341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1763c604c9c84205be8b3bf019a15fa0" candidate_uuid: "62eb0e44cb794e9db922a20fcfb9d606" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09ec138dff9842f0858adca947bc33fb"
I20260709 12:23:35.157258 10341 raft_consensus.cc:3060] T 1763c604c9c84205be8b3bf019a15fa0 P 09ec138dff9842f0858adca947bc33fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:35.158910 10530 raft_consensus.cc:359] T 1763c604c9c84205be8b3bf019a15fa0 P 39666a280cd648579a4ad0f800aa7261 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:35.161459 10530 raft_consensus.cc:385] T 1763c604c9c84205be8b3bf019a15fa0 P 39666a280cd648579a4ad0f800aa7261 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:35.162973 10530 raft_consensus.cc:740] T 1763c604c9c84205be8b3bf019a15fa0 P 39666a280cd648579a4ad0f800aa7261 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39666a280cd648579a4ad0f800aa7261, State: Initialized, Role: FOLLOWER
I20260709 12:23:35.163710 10416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1763c604c9c84205be8b3bf019a15fa0" candidate_uuid: "09ec138dff9842f0858adca947bc33fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39666a280cd648579a4ad0f800aa7261" is_pre_election: true
I20260709 12:23:35.164201 10554 leader_election.cc:290] T 57fc852991f54b508ff41067c25fe854 P 62eb0e44cb794e9db922a20fcfb9d606 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09ec138dff9842f0858adca947bc33fb (127.9.116.65:42825), 39666a280cd648579a4ad0f800aa7261 (127.9.116.66:43111)
I20260709 12:23:35.163932 10530 consensus_queue.cc:260] T 1763c604c9c84205be8b3bf019a15fa0 P 39666a280cd648579a4ad0f800aa7261 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:35.167829 10531 tablet_bootstrap.cc:492] T 86d8ee5b13404484811b10e05818abc8 P 62eb0e44cb794e9db922a20fcfb9d606: No bootstrap required, opened a new log
I20260709 12:23:35.167796 10416 raft_consensus.cc:2468] T 1763c604c9c84205be8b3bf019a15fa0 P 39666a280cd648579a4ad0f800aa7261 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09ec138dff9842f0858adca947bc33fb in term 0.
I20260709 12:23:35.168404 10531 ts_tablet_manager.cc:1403] T 86d8ee5b13404484811b10e05818abc8 P 62eb0e44cb794e9db922a20fcfb9d606: Time spent bootstrapping tablet: real 0.048s	user 0.013s	sys 0.003s
I20260709 12:23:35.169415 10530 ts_tablet_manager.cc:1434] T 1763c604c9c84205be8b3bf019a15fa0 P 39666a280cd648579a4ad0f800aa7261: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.002s
I20260709 12:23:35.170526 10530 tablet_bootstrap.cc:492] T b719323785d84477bf49a3ebbf366f37 P 39666a280cd648579a4ad0f800aa7261: Bootstrap starting.
I20260709 12:23:35.171644 10414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f45d2ff8d4f540878e0ec1058a28f8d5" candidate_uuid: "62eb0e44cb794e9db922a20fcfb9d606" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39666a280cd648579a4ad0f800aa7261"
I20260709 12:23:35.171602 10531 raft_consensus.cc:359] T 86d8ee5b13404484811b10e05818abc8 P 62eb0e44cb794e9db922a20fcfb9d606 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:35.172400 10414 raft_consensus.cc:3060] T f45d2ff8d4f540878e0ec1058a28f8d5 P 39666a280cd648579a4ad0f800aa7261 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:35.172608 10531 raft_consensus.cc:385] T 86d8ee5b13404484811b10e05818abc8 P 62eb0e44cb794e9db922a20fcfb9d606 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:35.173039 10531 raft_consensus.cc:740] T 86d8ee5b13404484811b10e05818abc8 P 62eb0e44cb794e9db922a20fcfb9d606 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62eb0e44cb794e9db922a20fcfb9d606, State: Initialized, Role: FOLLOWER
I20260709 12:23:35.174372 10531 consensus_queue.cc:260] T 86d8ee5b13404484811b10e05818abc8 P 62eb0e44cb794e9db922a20fcfb9d606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:35.176620 10307 leader_election.cc:304] T 1763c604c9c84205be8b3bf019a15fa0 P 09ec138dff9842f0858adca947bc33fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09ec138dff9842f0858adca947bc33fb, 39666a280cd648579a4ad0f800aa7261; no voters: 
I20260709 12:23:35.188220 10530 tablet_bootstrap.cc:654] T b719323785d84477bf49a3ebbf366f37 P 39666a280cd648579a4ad0f800aa7261: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:35.188848 10531 ts_tablet_manager.cc:1434] T 86d8ee5b13404484811b10e05818abc8 P 62eb0e44cb794e9db922a20fcfb9d606: Time spent starting tablet: real 0.020s	user 0.016s	sys 0.000s
I20260709 12:23:35.189889 10531 tablet_bootstrap.cc:492] T ddcced512029492fb6903fc4d42abd31 P 62eb0e44cb794e9db922a20fcfb9d606: Bootstrap starting.
I20260709 12:23:35.165191 10341 raft_consensus.cc:2468] T 1763c604c9c84205be8b3bf019a15fa0 P 09ec138dff9842f0858adca947bc33fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62eb0e44cb794e9db922a20fcfb9d606 in term 1.
I20260709 12:23:35.166304 10490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1763c604c9c84205be8b3bf019a15fa0" candidate_uuid: "09ec138dff9842f0858adca947bc33fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62eb0e44cb794e9db922a20fcfb9d606" is_pre_election: true
I20260709 12:23:35.195730 10490 raft_consensus.cc:2393] T 1763c604c9c84205be8b3bf019a15fa0 P 62eb0e44cb794e9db922a20fcfb9d606 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09ec138dff9842f0858adca947bc33fb in current term 1: Already voted for candidate 62eb0e44cb794e9db922a20fcfb9d606 in this term.
I20260709 12:23:35.196627 10531 tablet_bootstrap.cc:654] T ddcced512029492fb6903fc4d42abd31 P 62eb0e44cb794e9db922a20fcfb9d606: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:35.166865 10415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1763c604c9c84205be8b3bf019a15fa0" candidate_uuid: "62eb0e44cb794e9db922a20fcfb9d606" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39666a280cd648579a4ad0f800aa7261"
I20260709 12:23:35.167187 10532 tablet_bootstrap.cc:492] T b6cc3e80f4f6411b89c21921f2929554 P 09ec138dff9842f0858adca947bc33fb: No bootstrap required, opened a new log
I20260709 12:23:35.197316 10415 raft_consensus.cc:3060] T 1763c604c9c84205be8b3bf019a15fa0 P 39666a280cd648579a4ad0f800aa7261 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:35.197484 10532 ts_tablet_manager.cc:1403] T b6cc3e80f4f6411b89c21921f2929554 P 09ec138dff9842f0858adca947bc33fb: Time spent bootstrapping tablet: real 0.119s	user 0.010s	sys 0.005s
I20260709 12:23:35.200786 10532 raft_consensus.cc:359] T b6cc3e80f4f6411b89c21921f2929554 P 09ec138dff9842f0858adca947bc33fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:35.201542 10532 raft_consensus.cc:385] T b6cc3e80f4f6411b89c21921f2929554 P 09ec138dff9842f0858adca947bc33fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:35.191176 10414 raft_consensus.cc:2468] T f45d2ff8d4f540878e0ec1058a28f8d5 P 39666a280cd648579a4ad0f800aa7261 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62eb0e44cb794e9db922a20fcfb9d606 in term 1.
I20260709 12:23:35.203063 10539 raft_consensus.cc:2764] T 1763c604c9c84205be8b3bf019a15fa0 P 09ec138dff9842f0858adca947bc33fb [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:23:35.201870 10532 raft_consensus.cc:740] T b6cc3e80f4f6411b89c21921f2929554 P 09ec138dff9842f0858adca947bc33fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09ec138dff9842f0858adca947bc33fb, State: Initialized, Role: FOLLOWER
I20260709 12:23:35.205964 10532 consensus_queue.cc:260] T b6cc3e80f4f6411b89c21921f2929554 P 09ec138dff9842f0858adca947bc33fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:35.212316 10340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f45d2ff8d4f540878e0ec1058a28f8d5" candidate_uuid: "62eb0e44cb794e9db922a20fcfb9d606" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09ec138dff9842f0858adca947bc33fb"
I20260709 12:23:35.213338 10340 raft_consensus.cc:3060] T f45d2ff8d4f540878e0ec1058a28f8d5 P 09ec138dff9842f0858adca947bc33fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:35.214772 10539 raft_consensus.cc:493] T 57fc852991f54b508ff41067c25fe854 P 09ec138dff9842f0858adca947bc33fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.215479 10539 raft_consensus.cc:515] T 57fc852991f54b508ff41067c25fe854 P 09ec138dff9842f0858adca947bc33fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:35.218922 10414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fc852991f54b508ff41067c25fe854" candidate_uuid: "62eb0e44cb794e9db922a20fcfb9d606" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39666a280cd648579a4ad0f800aa7261" is_pre_election: true
I20260709 12:23:35.219863 10414 raft_consensus.cc:2468] T 57fc852991f54b508ff41067c25fe854 P 39666a280cd648579a4ad0f800aa7261 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62eb0e44cb794e9db922a20fcfb9d606 in term 0.
I20260709 12:23:35.222153 10531 tablet_bootstrap.cc:492] T ddcced512029492fb6903fc4d42abd31 P 62eb0e44cb794e9db922a20fcfb9d606: No bootstrap required, opened a new log
I20260709 12:23:35.216285 10339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fc852991f54b508ff41067c25fe854" candidate_uuid: "62eb0e44cb794e9db922a20fcfb9d606" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09ec138dff9842f0858adca947bc33fb" is_pre_election: true
I20260709 12:23:35.222746 10531 ts_tablet_manager.cc:1403] T ddcced512029492fb6903fc4d42abd31 P 62eb0e44cb794e9db922a20fcfb9d606: Time spent bootstrapping tablet: real 0.033s	user 0.005s	sys 0.009s
I20260709 12:23:35.222860 10339 raft_consensus.cc:2468] T 57fc852991f54b508ff41067c25fe854 P 09ec138dff9842f0858adca947bc33fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62eb0e44cb794e9db922a20fcfb9d606 in term 0.
I20260709 12:23:35.224872 10456 leader_election.cc:304] T f45d2ff8d4f540878e0ec1058a28f8d5 P 62eb0e44cb794e9db922a20fcfb9d606 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39666a280cd648579a4ad0f800aa7261, 62eb0e44cb794e9db922a20fcfb9d606; no voters: 
I20260709 12:23:35.227061 10414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fc852991f54b508ff41067c25fe854" candidate_uuid: "09ec138dff9842f0858adca947bc33fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39666a280cd648579a4ad0f800aa7261" is_pre_election: true
I20260709 12:23:35.228266 10554 raft_consensus.cc:2804] T f45d2ff8d4f540878e0ec1058a28f8d5 P 62eb0e44cb794e9db922a20fcfb9d606 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:35.230926 10554 raft_consensus.cc:697] T f45d2ff8d4f540878e0ec1058a28f8d5 P 62eb0e44cb794e9db922a20fcfb9d606 [term 1 LEADER]: Becoming Leader. State: Replica: 62eb0e44cb794e9db922a20fcfb9d606, State: Running, Role: LEADER
I20260709 12:23:35.232203 10554 consensus_queue.cc:237] T f45d2ff8d4f540878e0ec1058a28f8d5 P 62eb0e44cb794e9db922a20fcfb9d606 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } } peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } }
I20260709 12:23:35.233054 10415 raft_consensus.cc:2468] T 1763c604c9c84205be8b3bf019a15fa0 P 39666a280cd648579a4ad0f800aa7261 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62eb0e44cb794e9db922a20fcfb9d606 in term 1.
I20260709 12:23:35.232650 10490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fc852991f54b508ff41067c25fe854" candidate_uuid: "09ec138dff9842f0858adca947bc33fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62eb0e44cb794e9db922a20fcfb9d606" is_pre_election: true
I20260709 12:23:35.229638 10456 leader_election.cc:304] T 57fc852991f54b508ff41067c25fe854 P 62eb0e44cb794e9db922a20fcfb9d606 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39666a280cd648579a4ad0f800aa7261, 62eb0e44cb794e9db922a20fcfb9d606; no voters: 
I20260709 12:23:35.234793 10490 raft_consensus.cc:2468] T 57fc852991f54b508ff41067c25fe854 P 62eb0e44cb794e9db922a20fcfb9d606 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09ec138dff9842f0858adca947bc33fb in term 0.
I20260709 12:23:35.232781 10531 raft_consensus.cc:359] T ddcced512029492fb6903fc4d42abd31 P 62eb0e44cb794e9db922a20fcfb9d606 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:35.235896 10531 raft_consensus.cc:385] T ddcced512029492fb6903fc4d42abd31 P 62eb0e44cb794e9db922a20fcfb9d606 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:35.236236 10531 raft_consensus.cc:740] T ddcced512029492fb6903fc4d42abd31 P 62eb0e44cb794e9db922a20fcfb9d606 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62eb0e44cb794e9db922a20fcfb9d606, State: Initialized, Role: FOLLOWER
I20260709 12:23:35.236553 10456 leader_election.cc:304] T 1763c604c9c84205be8b3bf019a15fa0 P 62eb0e44cb794e9db922a20fcfb9d606 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09ec138dff9842f0858adca947bc33fb, 62eb0e44cb794e9db922a20fcfb9d606; no voters: 
I20260709 12:23:35.236894 10531 consensus_queue.cc:260] T ddcced512029492fb6903fc4d42abd31 P 62eb0e44cb794e9db922a20fcfb9d606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:35.237314 10537 raft_consensus.cc:2804] T 1763c604c9c84205be8b3bf019a15fa0 P 62eb0e44cb794e9db922a20fcfb9d606 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:35.230870 10414 raft_consensus.cc:2468] T 57fc852991f54b508ff41067c25fe854 P 39666a280cd648579a4ad0f800aa7261 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09ec138dff9842f0858adca947bc33fb in term 0.
I20260709 12:23:35.239825 10564 raft_consensus.cc:2804] T 57fc852991f54b508ff41067c25fe854 P 62eb0e44cb794e9db922a20fcfb9d606 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:35.240805 10307 leader_election.cc:304] T 57fc852991f54b508ff41067c25fe854 P 09ec138dff9842f0858adca947bc33fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09ec138dff9842f0858adca947bc33fb, 39666a280cd648579a4ad0f800aa7261; no voters: 
I20260709 12:23:35.241011 10564 raft_consensus.cc:493] T 57fc852991f54b508ff41067c25fe854 P 62eb0e44cb794e9db922a20fcfb9d606 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:35.241181 10532 ts_tablet_manager.cc:1434] T b6cc3e80f4f6411b89c21921f2929554 P 09ec138dff9842f0858adca947bc33fb: Time spent starting tablet: real 0.043s	user 0.009s	sys 0.010s
I20260709 12:23:35.241387 10564 raft_consensus.cc:3060] T 57fc852991f54b508ff41067c25fe854 P 62eb0e44cb794e9db922a20fcfb9d606 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:35.238494 10539 leader_election.cc:290] T 57fc852991f54b508ff41067c25fe854 P 09ec138dff9842f0858adca947bc33fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39666a280cd648579a4ad0f800aa7261 (127.9.116.66:43111), 62eb0e44cb794e9db922a20fcfb9d606 (127.9.116.67:42127)
I20260709 12:23:35.253772 10532 tablet_bootstrap.cc:492] T ddcced512029492fb6903fc4d42abd31 P 09ec138dff9842f0858adca947bc33fb: Bootstrap starting.
I20260709 12:23:35.260123 10570 raft_consensus.cc:493] T 5764d623ece6411d8e3adfbd095f0fe1 P 09ec138dff9842f0858adca947bc33fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.260758 10570 raft_consensus.cc:515] T 5764d623ece6411d8e3adfbd095f0fe1 P 09ec138dff9842f0858adca947bc33fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:35.263224 10530 tablet_bootstrap.cc:492] T b719323785d84477bf49a3ebbf366f37 P 39666a280cd648579a4ad0f800aa7261: No bootstrap required, opened a new log
I20260709 12:23:35.263940 10530 ts_tablet_manager.cc:1403] T b719323785d84477bf49a3ebbf366f37 P 39666a280cd648579a4ad0f800aa7261: Time spent bootstrapping tablet: real 0.094s	user 0.018s	sys 0.037s
I20260709 12:23:35.264140 10414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5764d623ece6411d8e3adfbd095f0fe1" candidate_uuid: "09ec138dff9842f0858adca947bc33fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39666a280cd648579a4ad0f800aa7261" is_pre_election: true
I20260709 12:23:35.260310 10569 raft_consensus.cc:2804] T 57fc852991f54b508ff41067c25fe854 P 09ec138dff9842f0858adca947bc33fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:35.264223 10340 raft_consensus.cc:2468] T f45d2ff8d4f540878e0ec1058a28f8d5 P 09ec138dff9842f0858adca947bc33fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62eb0e44cb794e9db922a20fcfb9d606 in term 1.
I20260709 12:23:35.265791 10414 raft_consensus.cc:2468] T 5764d623ece6411d8e3adfbd095f0fe1 P 39666a280cd648579a4ad0f800aa7261 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09ec138dff9842f0858adca947bc33fb in term 0.
I20260709 12:23:35.267189 10307 leader_election.cc:304] T 5764d623ece6411d8e3adfbd095f0fe1 P 09ec138dff9842f0858adca947bc33fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09ec138dff9842f0858adca947bc33fb, 39666a280cd648579a4ad0f800aa7261; no voters: 
I20260709 12:23:35.268342 10569 raft_consensus.cc:493] T 57fc852991f54b508ff41067c25fe854 P 09ec138dff9842f0858adca947bc33fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:35.268265 10571 raft_consensus.cc:2804] T 5764d623ece6411d8e3adfbd095f0fe1 P 09ec138dff9842f0858adca947bc33fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:35.267930 10530 raft_consensus.cc:359] T b719323785d84477bf49a3ebbf366f37 P 39666a280cd648579a4ad0f800aa7261 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:35.268905 10530 raft_consensus.cc:385] T b719323785d84477bf49a3ebbf366f37 P 39666a280cd648579a4ad0f800aa7261 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:35.268841 10571 raft_consensus.cc:493] T 5764d623ece6411d8e3adfbd095f0fe1 P 09ec138dff9842f0858adca947bc33fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:35.269246 10530 raft_consensus.cc:740] T b719323785d84477bf49a3ebbf366f37 P 39666a280cd648579a4ad0f800aa7261 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39666a280cd648579a4ad0f800aa7261, State: Initialized, Role: FOLLOWER
I20260709 12:23:35.269475 10571 raft_consensus.cc:3060] T 5764d623ece6411d8e3adfbd095f0fe1 P 09ec138dff9842f0858adca947bc33fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:35.270220 10530 consensus_queue.cc:260] T b719323785d84477bf49a3ebbf366f37 P 39666a280cd648579a4ad0f800aa7261 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:35.272964 10569 raft_consensus.cc:3060] T 57fc852991f54b508ff41067c25fe854 P 09ec138dff9842f0858adca947bc33fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:35.277580 10532 tablet_bootstrap.cc:654] T ddcced512029492fb6903fc4d42abd31 P 09ec138dff9842f0858adca947bc33fb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:35.277973 10571 raft_consensus.cc:515] T 5764d623ece6411d8e3adfbd095f0fe1 P 09ec138dff9842f0858adca947bc33fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:35.256635 10564 raft_consensus.cc:515] T 57fc852991f54b508ff41067c25fe854 P 62eb0e44cb794e9db922a20fcfb9d606 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:35.280355 10537 raft_consensus.cc:697] T 1763c604c9c84205be8b3bf019a15fa0 P 62eb0e44cb794e9db922a20fcfb9d606 [term 1 LEADER]: Becoming Leader. State: Replica: 62eb0e44cb794e9db922a20fcfb9d606, State: Running, Role: LEADER
I20260709 12:23:35.281390 10414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5764d623ece6411d8e3adfbd095f0fe1" candidate_uuid: "09ec138dff9842f0858adca947bc33fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39666a280cd648579a4ad0f800aa7261"
I20260709 12:23:35.281629 10530 ts_tablet_manager.cc:1434] T b719323785d84477bf49a3ebbf366f37 P 39666a280cd648579a4ad0f800aa7261: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.001s
I20260709 12:23:35.282176 10414 raft_consensus.cc:3060] T 5764d623ece6411d8e3adfbd095f0fe1 P 39666a280cd648579a4ad0f800aa7261 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:35.281631 10537 consensus_queue.cc:237] T 1763c604c9c84205be8b3bf019a15fa0 P 62eb0e44cb794e9db922a20fcfb9d606 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:35.282364 10490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5764d623ece6411d8e3adfbd095f0fe1" candidate_uuid: "09ec138dff9842f0858adca947bc33fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62eb0e44cb794e9db922a20fcfb9d606" is_pre_election: true
I20260709 12:23:35.282989 10490 raft_consensus.cc:2468] T 5764d623ece6411d8e3adfbd095f0fe1 P 62eb0e44cb794e9db922a20fcfb9d606 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09ec138dff9842f0858adca947bc33fb in term 0.
I20260709 12:23:35.285483 10530 tablet_bootstrap.cc:492] T 86d8ee5b13404484811b10e05818abc8 P 39666a280cd648579a4ad0f800aa7261: Bootstrap starting.
I20260709 12:23:35.285742 10569 raft_consensus.cc:515] T 57fc852991f54b508ff41067c25fe854 P 09ec138dff9842f0858adca947bc33fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:35.280777 10570 leader_election.cc:290] T 5764d623ece6411d8e3adfbd095f0fe1 P 09ec138dff9842f0858adca947bc33fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39666a280cd648579a4ad0f800aa7261 (127.9.116.66:43111), 62eb0e44cb794e9db922a20fcfb9d606 (127.9.116.67:42127)
I20260709 12:23:35.293392 10564 leader_election.cc:290] T 57fc852991f54b508ff41067c25fe854 P 62eb0e44cb794e9db922a20fcfb9d606 [CANDIDATE]: Term 1 election: Requested vote from peers 09ec138dff9842f0858adca947bc33fb (127.9.116.65:42825), 39666a280cd648579a4ad0f800aa7261 (127.9.116.66:43111)
I20260709 12:23:35.293354 10414 raft_consensus.cc:2468] T 5764d623ece6411d8e3adfbd095f0fe1 P 39666a280cd648579a4ad0f800aa7261 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09ec138dff9842f0858adca947bc33fb in term 1.
I20260709 12:23:35.296546 10415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fc852991f54b508ff41067c25fe854" candidate_uuid: "62eb0e44cb794e9db922a20fcfb9d606" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39666a280cd648579a4ad0f800aa7261"
I20260709 12:23:35.297402 10415 raft_consensus.cc:3060] T 57fc852991f54b508ff41067c25fe854 P 39666a280cd648579a4ad0f800aa7261 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:35.299335 10490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fc852991f54b508ff41067c25fe854" candidate_uuid: "09ec138dff9842f0858adca947bc33fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62eb0e44cb794e9db922a20fcfb9d606"
I20260709 12:23:35.296615 10307 leader_election.cc:304] T 5764d623ece6411d8e3adfbd095f0fe1 P 09ec138dff9842f0858adca947bc33fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09ec138dff9842f0858adca947bc33fb, 39666a280cd648579a4ad0f800aa7261; no voters: 
I20260709 12:23:35.300490 10490 raft_consensus.cc:2393] T 57fc852991f54b508ff41067c25fe854 P 62eb0e44cb794e9db922a20fcfb9d606 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 09ec138dff9842f0858adca947bc33fb in current term 1: Already voted for candidate 62eb0e44cb794e9db922a20fcfb9d606 in this term.
I20260709 12:23:35.300714 10570 raft_consensus.cc:2804] T 5764d623ece6411d8e3adfbd095f0fe1 P 09ec138dff9842f0858adca947bc33fb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:35.301676 10570 raft_consensus.cc:697] T 5764d623ece6411d8e3adfbd095f0fe1 P 09ec138dff9842f0858adca947bc33fb [term 1 LEADER]: Becoming Leader. State: Replica: 09ec138dff9842f0858adca947bc33fb, State: Running, Role: LEADER
I20260709 12:23:35.302652 10570 consensus_queue.cc:237] T 5764d623ece6411d8e3adfbd095f0fe1 P 09ec138dff9842f0858adca947bc33fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:35.303422 10490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5764d623ece6411d8e3adfbd095f0fe1" candidate_uuid: "09ec138dff9842f0858adca947bc33fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62eb0e44cb794e9db922a20fcfb9d606"
I20260709 12:23:35.304004 10490 raft_consensus.cc:3060] T 5764d623ece6411d8e3adfbd095f0fe1 P 62eb0e44cb794e9db922a20fcfb9d606 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:35.306469 10571 leader_election.cc:290] T 5764d623ece6411d8e3adfbd095f0fe1 P 09ec138dff9842f0858adca947bc33fb [CANDIDATE]: Term 1 election: Requested vote from peers 39666a280cd648579a4ad0f800aa7261 (127.9.116.66:43111), 62eb0e44cb794e9db922a20fcfb9d606 (127.9.116.67:42127)
I20260709 12:23:35.307067 10569 leader_election.cc:290] T 57fc852991f54b508ff41067c25fe854 P 09ec138dff9842f0858adca947bc33fb [CANDIDATE]: Term 1 election: Requested vote from peers 39666a280cd648579a4ad0f800aa7261 (127.9.116.66:43111), 62eb0e44cb794e9db922a20fcfb9d606 (127.9.116.67:42127)
I20260709 12:23:35.307886 10340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fc852991f54b508ff41067c25fe854" candidate_uuid: "62eb0e44cb794e9db922a20fcfb9d606" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09ec138dff9842f0858adca947bc33fb"
I20260709 12:23:35.307293 10237 catalog_manager.cc:5697] T f45d2ff8d4f540878e0ec1058a28f8d5 P 62eb0e44cb794e9db922a20fcfb9d606 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62eb0e44cb794e9db922a20fcfb9d606 (127.9.116.67). New cstate: current_term: 1 leader_uuid: "62eb0e44cb794e9db922a20fcfb9d606" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:35.308651 10340 raft_consensus.cc:2393] T 57fc852991f54b508ff41067c25fe854 P 09ec138dff9842f0858adca947bc33fb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 62eb0e44cb794e9db922a20fcfb9d606 in current term 1: Already voted for candidate 09ec138dff9842f0858adca947bc33fb in this term.
I20260709 12:23:35.313073 10414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fc852991f54b508ff41067c25fe854" candidate_uuid: "09ec138dff9842f0858adca947bc33fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39666a280cd648579a4ad0f800aa7261"
I20260709 12:23:35.314857 10307 leader_election.cc:304] T 57fc852991f54b508ff41067c25fe854 P 09ec138dff9842f0858adca947bc33fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09ec138dff9842f0858adca947bc33fb; no voters: 39666a280cd648579a4ad0f800aa7261, 62eb0e44cb794e9db922a20fcfb9d606
I20260709 12:23:35.317868 10546 raft_consensus.cc:493] T b719323785d84477bf49a3ebbf366f37 P 39666a280cd648579a4ad0f800aa7261 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.318526 10546 raft_consensus.cc:515] T b719323785d84477bf49a3ebbf366f37 P 39666a280cd648579a4ad0f800aa7261 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
W20260709 12:23:35.321987 10442 tablet.cc:2406] T 1763c604c9c84205be8b3bf019a15fa0 P 39666a280cd648579a4ad0f800aa7261: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:23:35.323477 10530 tablet_bootstrap.cc:654] T 86d8ee5b13404484811b10e05818abc8 P 39666a280cd648579a4ad0f800aa7261: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:35.323964 10489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719323785d84477bf49a3ebbf366f37" candidate_uuid: "39666a280cd648579a4ad0f800aa7261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62eb0e44cb794e9db922a20fcfb9d606" is_pre_election: true
I20260709 12:23:35.325062 10489 raft_consensus.cc:2468] T b719323785d84477bf49a3ebbf366f37 P 62eb0e44cb794e9db922a20fcfb9d606 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39666a280cd648579a4ad0f800aa7261 in term 0.
I20260709 12:23:35.327993 10379 leader_election.cc:304] T b719323785d84477bf49a3ebbf366f37 P 39666a280cd648579a4ad0f800aa7261 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39666a280cd648579a4ad0f800aa7261, 62eb0e44cb794e9db922a20fcfb9d606; no voters: 
I20260709 12:23:35.328337 10571 raft_consensus.cc:493] T b719323785d84477bf49a3ebbf366f37 P 09ec138dff9842f0858adca947bc33fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.329073 10571 raft_consensus.cc:515] T b719323785d84477bf49a3ebbf366f37 P 09ec138dff9842f0858adca947bc33fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:35.329314 10546 leader_election.cc:290] T b719323785d84477bf49a3ebbf366f37 P 39666a280cd648579a4ad0f800aa7261 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09ec138dff9842f0858adca947bc33fb (127.9.116.65:42825), 62eb0e44cb794e9db922a20fcfb9d606 (127.9.116.67:42127)
I20260709 12:23:35.330149 10546 raft_consensus.cc:2804] T b719323785d84477bf49a3ebbf366f37 P 39666a280cd648579a4ad0f800aa7261 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:35.330627 10546 raft_consensus.cc:493] T b719323785d84477bf49a3ebbf366f37 P 39666a280cd648579a4ad0f800aa7261 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:35.331058 10546 raft_consensus.cc:3060] T b719323785d84477bf49a3ebbf366f37 P 39666a280cd648579a4ad0f800aa7261 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:35.331418 10415 raft_consensus.cc:2468] T 57fc852991f54b508ff41067c25fe854 P 39666a280cd648579a4ad0f800aa7261 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62eb0e44cb794e9db922a20fcfb9d606 in term 1.
I20260709 12:23:35.332408 10571 leader_election.cc:290] T b719323785d84477bf49a3ebbf366f37 P 09ec138dff9842f0858adca947bc33fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39666a280cd648579a4ad0f800aa7261 (127.9.116.66:43111), 62eb0e44cb794e9db922a20fcfb9d606 (127.9.116.67:42127)
I20260709 12:23:35.333845 10564 raft_consensus.cc:493] T ddcced512029492fb6903fc4d42abd31 P 62eb0e44cb794e9db922a20fcfb9d606 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.334753 10564 raft_consensus.cc:515] T ddcced512029492fb6903fc4d42abd31 P 62eb0e44cb794e9db922a20fcfb9d606 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:35.337706 10564 leader_election.cc:290] T ddcced512029492fb6903fc4d42abd31 P 62eb0e44cb794e9db922a20fcfb9d606 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09ec138dff9842f0858adca947bc33fb (127.9.116.65:42825), 39666a280cd648579a4ad0f800aa7261 (127.9.116.66:43111)
I20260709 12:23:35.338912 10456 leader_election.cc:304] T 57fc852991f54b508ff41067c25fe854 P 62eb0e44cb794e9db922a20fcfb9d606 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39666a280cd648579a4ad0f800aa7261, 62eb0e44cb794e9db922a20fcfb9d606; no voters: 09ec138dff9842f0858adca947bc33fb
I20260709 12:23:35.335116 10489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719323785d84477bf49a3ebbf366f37" candidate_uuid: "09ec138dff9842f0858adca947bc33fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62eb0e44cb794e9db922a20fcfb9d606" is_pre_election: true
I20260709 12:23:35.342494 10574 raft_consensus.cc:2804] T 57fc852991f54b508ff41067c25fe854 P 62eb0e44cb794e9db922a20fcfb9d606 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:35.342422 10489 raft_consensus.cc:2468] T b719323785d84477bf49a3ebbf366f37 P 62eb0e44cb794e9db922a20fcfb9d606 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09ec138dff9842f0858adca947bc33fb in term 0.
I20260709 12:23:35.343089 10574 raft_consensus.cc:697] T 57fc852991f54b508ff41067c25fe854 P 62eb0e44cb794e9db922a20fcfb9d606 [term 1 LEADER]: Becoming Leader. State: Replica: 62eb0e44cb794e9db922a20fcfb9d606, State: Running, Role: LEADER
I20260709 12:23:35.340811 10490 raft_consensus.cc:2468] T 5764d623ece6411d8e3adfbd095f0fe1 P 62eb0e44cb794e9db922a20fcfb9d606 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09ec138dff9842f0858adca947bc33fb in term 1.
I20260709 12:23:35.344077 10574 consensus_queue.cc:237] T 57fc852991f54b508ff41067c25fe854 P 62eb0e44cb794e9db922a20fcfb9d606 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:35.344802 10340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719323785d84477bf49a3ebbf366f37" candidate_uuid: "39666a280cd648579a4ad0f800aa7261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09ec138dff9842f0858adca947bc33fb" is_pre_election: true
I20260709 12:23:35.345458 10340 raft_consensus.cc:2468] T b719323785d84477bf49a3ebbf366f37 P 09ec138dff9842f0858adca947bc33fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39666a280cd648579a4ad0f800aa7261 in term 0.
I20260709 12:23:35.344077 10304 leader_election.cc:304] T b719323785d84477bf49a3ebbf366f37 P 09ec138dff9842f0858adca947bc33fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09ec138dff9842f0858adca947bc33fb, 62eb0e44cb794e9db922a20fcfb9d606; no voters: 
I20260709 12:23:35.350883 10571 raft_consensus.cc:2804] T b719323785d84477bf49a3ebbf366f37 P 09ec138dff9842f0858adca947bc33fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:35.351281 10571 raft_consensus.cc:493] T b719323785d84477bf49a3ebbf366f37 P 09ec138dff9842f0858adca947bc33fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:35.351641 10571 raft_consensus.cc:3060] T b719323785d84477bf49a3ebbf366f37 P 09ec138dff9842f0858adca947bc33fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:35.352578 10340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcced512029492fb6903fc4d42abd31" candidate_uuid: "62eb0e44cb794e9db922a20fcfb9d606" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09ec138dff9842f0858adca947bc33fb" is_pre_election: true
I20260709 12:23:35.355624 10531 ts_tablet_manager.cc:1434] T ddcced512029492fb6903fc4d42abd31 P 62eb0e44cb794e9db922a20fcfb9d606: Time spent starting tablet: real 0.132s	user 0.003s	sys 0.017s
I20260709 12:23:35.356477 10531 tablet_bootstrap.cc:492] T b6cc3e80f4f6411b89c21921f2929554 P 62eb0e44cb794e9db922a20fcfb9d606: Bootstrap starting.
I20260709 12:23:35.317394 10569 raft_consensus.cc:2749] T 57fc852991f54b508ff41067c25fe854 P 09ec138dff9842f0858adca947bc33fb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:23:35.352085 10415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719323785d84477bf49a3ebbf366f37" candidate_uuid: "09ec138dff9842f0858adca947bc33fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39666a280cd648579a4ad0f800aa7261" is_pre_election: true
W20260709 12:23:35.361315 10456 leader_election.cc:343] T ddcced512029492fb6903fc4d42abd31 P 62eb0e44cb794e9db922a20fcfb9d606 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09ec138dff9842f0858adca947bc33fb (127.9.116.65:42825): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:35.364692 10532 tablet_bootstrap.cc:492] T ddcced512029492fb6903fc4d42abd31 P 09ec138dff9842f0858adca947bc33fb: No bootstrap required, opened a new log
I20260709 12:23:35.365324 10532 ts_tablet_manager.cc:1403] T ddcced512029492fb6903fc4d42abd31 P 09ec138dff9842f0858adca947bc33fb: Time spent bootstrapping tablet: real 0.112s	user 0.019s	sys 0.019s
I20260709 12:23:35.367480 10531 tablet_bootstrap.cc:654] T b6cc3e80f4f6411b89c21921f2929554 P 62eb0e44cb794e9db922a20fcfb9d606: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:35.369989 10532 raft_consensus.cc:359] T ddcced512029492fb6903fc4d42abd31 P 09ec138dff9842f0858adca947bc33fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:35.370781 10532 raft_consensus.cc:385] T ddcced512029492fb6903fc4d42abd31 P 09ec138dff9842f0858adca947bc33fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:35.371080 10532 raft_consensus.cc:740] T ddcced512029492fb6903fc4d42abd31 P 09ec138dff9842f0858adca947bc33fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09ec138dff9842f0858adca947bc33fb, State: Initialized, Role: FOLLOWER
I20260709 12:23:35.370920 10546 raft_consensus.cc:515] T b719323785d84477bf49a3ebbf366f37 P 39666a280cd648579a4ad0f800aa7261 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:35.371963 10532 consensus_queue.cc:260] T ddcced512029492fb6903fc4d42abd31 P 09ec138dff9842f0858adca947bc33fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:35.372479 10415 raft_consensus.cc:2393] T b719323785d84477bf49a3ebbf366f37 P 39666a280cd648579a4ad0f800aa7261 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09ec138dff9842f0858adca947bc33fb in current term 1: Already voted for candidate 39666a280cd648579a4ad0f800aa7261 in this term.
I20260709 12:23:35.372900 10237 catalog_manager.cc:5697] T 1763c604c9c84205be8b3bf019a15fa0 P 62eb0e44cb794e9db922a20fcfb9d606 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62eb0e44cb794e9db922a20fcfb9d606 (127.9.116.67). New cstate: current_term: 1 leader_uuid: "62eb0e44cb794e9db922a20fcfb9d606" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:35.374090 10571 raft_consensus.cc:515] T b719323785d84477bf49a3ebbf366f37 P 09ec138dff9842f0858adca947bc33fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:35.374828 10532 ts_tablet_manager.cc:1434] T ddcced512029492fb6903fc4d42abd31 P 09ec138dff9842f0858adca947bc33fb: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:23:35.375810 10532 tablet_bootstrap.cc:492] T 86d8ee5b13404484811b10e05818abc8 P 09ec138dff9842f0858adca947bc33fb: Bootstrap starting.
I20260709 12:23:35.382382 10571 leader_election.cc:290] T b719323785d84477bf49a3ebbf366f37 P 09ec138dff9842f0858adca947bc33fb [CANDIDATE]: Term 1 election: Requested vote from peers 39666a280cd648579a4ad0f800aa7261 (127.9.116.66:43111), 62eb0e44cb794e9db922a20fcfb9d606 (127.9.116.67:42127)
I20260709 12:23:35.385120 10340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719323785d84477bf49a3ebbf366f37" candidate_uuid: "39666a280cd648579a4ad0f800aa7261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09ec138dff9842f0858adca947bc33fb"
I20260709 12:23:35.385720 10490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719323785d84477bf49a3ebbf366f37" candidate_uuid: "09ec138dff9842f0858adca947bc33fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62eb0e44cb794e9db922a20fcfb9d606"
I20260709 12:23:35.386257 10340 raft_consensus.cc:2393] T b719323785d84477bf49a3ebbf366f37 P 09ec138dff9842f0858adca947bc33fb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 39666a280cd648579a4ad0f800aa7261 in current term 1: Already voted for candidate 09ec138dff9842f0858adca947bc33fb in this term.
I20260709 12:23:35.386595 10490 raft_consensus.cc:3060] T b719323785d84477bf49a3ebbf366f37 P 62eb0e44cb794e9db922a20fcfb9d606 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:35.376912 10238 catalog_manager.cc:5697] T 5764d623ece6411d8e3adfbd095f0fe1 P 09ec138dff9842f0858adca947bc33fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 09ec138dff9842f0858adca947bc33fb (127.9.116.65). New cstate: current_term: 1 leader_uuid: "09ec138dff9842f0858adca947bc33fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:35.375820 10414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcced512029492fb6903fc4d42abd31" candidate_uuid: "62eb0e44cb794e9db922a20fcfb9d606" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39666a280cd648579a4ad0f800aa7261" is_pre_election: true
I20260709 12:23:35.390673 10546 leader_election.cc:290] T b719323785d84477bf49a3ebbf366f37 P 39666a280cd648579a4ad0f800aa7261 [CANDIDATE]: Term 1 election: Requested vote from peers 09ec138dff9842f0858adca947bc33fb (127.9.116.65:42825), 62eb0e44cb794e9db922a20fcfb9d606 (127.9.116.67:42127)
I20260709 12:23:35.391952 10415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719323785d84477bf49a3ebbf366f37" candidate_uuid: "09ec138dff9842f0858adca947bc33fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39666a280cd648579a4ad0f800aa7261"
W20260709 12:23:35.392580 10456 leader_election.cc:343] T ddcced512029492fb6903fc4d42abd31 P 62eb0e44cb794e9db922a20fcfb9d606 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 39666a280cd648579a4ad0f800aa7261 (127.9.116.66:43111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:35.392808 10415 raft_consensus.cc:2393] T b719323785d84477bf49a3ebbf366f37 P 39666a280cd648579a4ad0f800aa7261 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 09ec138dff9842f0858adca947bc33fb in current term 1: Already voted for candidate 39666a280cd648579a4ad0f800aa7261 in this term.
I20260709 12:23:35.393041 10456 leader_election.cc:304] T ddcced512029492fb6903fc4d42abd31 P 62eb0e44cb794e9db922a20fcfb9d606 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 62eb0e44cb794e9db922a20fcfb9d606; no voters: 09ec138dff9842f0858adca947bc33fb, 39666a280cd648579a4ad0f800aa7261
I20260709 12:23:35.393857 10554 raft_consensus.cc:2749] T ddcced512029492fb6903fc4d42abd31 P 62eb0e44cb794e9db922a20fcfb9d606 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:35.391952 10489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719323785d84477bf49a3ebbf366f37" candidate_uuid: "39666a280cd648579a4ad0f800aa7261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62eb0e44cb794e9db922a20fcfb9d606"
I20260709 12:23:35.396879 10379 leader_election.cc:304] T b719323785d84477bf49a3ebbf366f37 P 39666a280cd648579a4ad0f800aa7261 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39666a280cd648579a4ad0f800aa7261; no voters: 09ec138dff9842f0858adca947bc33fb, 62eb0e44cb794e9db922a20fcfb9d606
I20260709 12:23:35.400892 10532 tablet_bootstrap.cc:654] T 86d8ee5b13404484811b10e05818abc8 P 09ec138dff9842f0858adca947bc33fb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:35.398546 10490 raft_consensus.cc:2468] T b719323785d84477bf49a3ebbf366f37 P 62eb0e44cb794e9db922a20fcfb9d606 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09ec138dff9842f0858adca947bc33fb in term 1.
I20260709 12:23:35.397838 10546 raft_consensus.cc:2749] T b719323785d84477bf49a3ebbf366f37 P 39666a280cd648579a4ad0f800aa7261 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:23:35.403117 10304 leader_election.cc:304] T b719323785d84477bf49a3ebbf366f37 P 09ec138dff9842f0858adca947bc33fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09ec138dff9842f0858adca947bc33fb, 62eb0e44cb794e9db922a20fcfb9d606; no voters: 39666a280cd648579a4ad0f800aa7261
I20260709 12:23:35.406055 10531 tablet_bootstrap.cc:492] T b6cc3e80f4f6411b89c21921f2929554 P 62eb0e44cb794e9db922a20fcfb9d606: No bootstrap required, opened a new log
I20260709 12:23:35.406556 10531 ts_tablet_manager.cc:1403] T b6cc3e80f4f6411b89c21921f2929554 P 62eb0e44cb794e9db922a20fcfb9d606: Time spent bootstrapping tablet: real 0.050s	user 0.017s	sys 0.004s
I20260709 12:23:35.406090 10571 raft_consensus.cc:2804] T b719323785d84477bf49a3ebbf366f37 P 09ec138dff9842f0858adca947bc33fb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:35.407557 10571 raft_consensus.cc:697] T b719323785d84477bf49a3ebbf366f37 P 09ec138dff9842f0858adca947bc33fb [term 1 LEADER]: Becoming Leader. State: Replica: 09ec138dff9842f0858adca947bc33fb, State: Running, Role: LEADER
I20260709 12:23:35.409358 10571 consensus_queue.cc:237] T b719323785d84477bf49a3ebbf366f37 P 09ec138dff9842f0858adca947bc33fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:35.414789 10531 raft_consensus.cc:359] T b6cc3e80f4f6411b89c21921f2929554 P 62eb0e44cb794e9db922a20fcfb9d606 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:35.415526 10531 raft_consensus.cc:385] T b6cc3e80f4f6411b89c21921f2929554 P 62eb0e44cb794e9db922a20fcfb9d606 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:35.415831 10531 raft_consensus.cc:740] T b6cc3e80f4f6411b89c21921f2929554 P 62eb0e44cb794e9db922a20fcfb9d606 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62eb0e44cb794e9db922a20fcfb9d606, State: Initialized, Role: FOLLOWER
I20260709 12:23:35.416494 10531 consensus_queue.cc:260] T b6cc3e80f4f6411b89c21921f2929554 P 62eb0e44cb794e9db922a20fcfb9d606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:35.418766 10531 ts_tablet_manager.cc:1434] T b6cc3e80f4f6411b89c21921f2929554 P 62eb0e44cb794e9db922a20fcfb9d606: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 12:23:35.419772 10531 tablet_bootstrap.cc:492] T ce98990ba39f44f4b792419973437b1c P 62eb0e44cb794e9db922a20fcfb9d606: Bootstrap starting.
I20260709 12:23:35.421387 10530 tablet_bootstrap.cc:492] T 86d8ee5b13404484811b10e05818abc8 P 39666a280cd648579a4ad0f800aa7261: No bootstrap required, opened a new log
I20260709 12:23:35.421886 10530 ts_tablet_manager.cc:1403] T 86d8ee5b13404484811b10e05818abc8 P 39666a280cd648579a4ad0f800aa7261: Time spent bootstrapping tablet: real 0.137s	user 0.020s	sys 0.003s
I20260709 12:23:35.420704 10237 catalog_manager.cc:5697] T 57fc852991f54b508ff41067c25fe854 P 62eb0e44cb794e9db922a20fcfb9d606 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62eb0e44cb794e9db922a20fcfb9d606 (127.9.116.67). New cstate: current_term: 1 leader_uuid: "62eb0e44cb794e9db922a20fcfb9d606" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:35.425621 10530 raft_consensus.cc:359] T 86d8ee5b13404484811b10e05818abc8 P 39666a280cd648579a4ad0f800aa7261 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:35.426177 10531 tablet_bootstrap.cc:654] T ce98990ba39f44f4b792419973437b1c P 62eb0e44cb794e9db922a20fcfb9d606: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:35.426548 10530 raft_consensus.cc:385] T 86d8ee5b13404484811b10e05818abc8 P 39666a280cd648579a4ad0f800aa7261 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:35.426898 10530 raft_consensus.cc:740] T 86d8ee5b13404484811b10e05818abc8 P 39666a280cd648579a4ad0f800aa7261 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39666a280cd648579a4ad0f800aa7261, State: Initialized, Role: FOLLOWER
I20260709 12:23:35.428304 10530 consensus_queue.cc:260] T 86d8ee5b13404484811b10e05818abc8 P 39666a280cd648579a4ad0f800aa7261 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:35.444955 10530 ts_tablet_manager.cc:1434] T 86d8ee5b13404484811b10e05818abc8 P 39666a280cd648579a4ad0f800aa7261: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 12:23:35.446974 10530 tablet_bootstrap.cc:492] T b6cc3e80f4f6411b89c21921f2929554 P 39666a280cd648579a4ad0f800aa7261: Bootstrap starting.
I20260709 12:23:35.457515 10531 tablet_bootstrap.cc:492] T ce98990ba39f44f4b792419973437b1c P 62eb0e44cb794e9db922a20fcfb9d606: No bootstrap required, opened a new log
I20260709 12:23:35.458005 10531 ts_tablet_manager.cc:1403] T ce98990ba39f44f4b792419973437b1c P 62eb0e44cb794e9db922a20fcfb9d606: Time spent bootstrapping tablet: real 0.038s	user 0.015s	sys 0.020s
I20260709 12:23:35.458065 10532 tablet_bootstrap.cc:492] T 86d8ee5b13404484811b10e05818abc8 P 09ec138dff9842f0858adca947bc33fb: No bootstrap required, opened a new log
I20260709 12:23:35.458542 10532 ts_tablet_manager.cc:1403] T 86d8ee5b13404484811b10e05818abc8 P 09ec138dff9842f0858adca947bc33fb: Time spent bootstrapping tablet: real 0.083s	user 0.012s	sys 0.009s
I20260709 12:23:35.460996 10531 raft_consensus.cc:359] T ce98990ba39f44f4b792419973437b1c P 62eb0e44cb794e9db922a20fcfb9d606 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:35.460683 10237 catalog_manager.cc:5697] T b719323785d84477bf49a3ebbf366f37 P 09ec138dff9842f0858adca947bc33fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 09ec138dff9842f0858adca947bc33fb (127.9.116.65). New cstate: current_term: 1 leader_uuid: "09ec138dff9842f0858adca947bc33fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:35.461702 10531 raft_consensus.cc:385] T ce98990ba39f44f4b792419973437b1c P 62eb0e44cb794e9db922a20fcfb9d606 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:35.462000 10531 raft_consensus.cc:740] T ce98990ba39f44f4b792419973437b1c P 62eb0e44cb794e9db922a20fcfb9d606 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62eb0e44cb794e9db922a20fcfb9d606, State: Initialized, Role: FOLLOWER
I20260709 12:23:35.462628 10531 consensus_queue.cc:260] T ce98990ba39f44f4b792419973437b1c P 62eb0e44cb794e9db922a20fcfb9d606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:35.465263 10531 ts_tablet_manager.cc:1434] T ce98990ba39f44f4b792419973437b1c P 62eb0e44cb794e9db922a20fcfb9d606: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:23:35.466539 10571 raft_consensus.cc:493] T ddcced512029492fb6903fc4d42abd31 P 09ec138dff9842f0858adca947bc33fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.467195 10546 consensus_queue.cc:1048] T c8b3a5c008584867bf2282f87acb3cde P 39666a280cd648579a4ad0f800aa7261 [LEADER]: Connected to new peer: Peer: permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:35.467125 10571 raft_consensus.cc:515] T ddcced512029492fb6903fc4d42abd31 P 09ec138dff9842f0858adca947bc33fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:35.469412 10571 leader_election.cc:290] T ddcced512029492fb6903fc4d42abd31 P 09ec138dff9842f0858adca947bc33fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39666a280cd648579a4ad0f800aa7261 (127.9.116.66:43111), 62eb0e44cb794e9db922a20fcfb9d606 (127.9.116.67:42127)
I20260709 12:23:35.469242 10532 raft_consensus.cc:359] T 86d8ee5b13404484811b10e05818abc8 P 09ec138dff9842f0858adca947bc33fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:35.469987 10532 raft_consensus.cc:385] T 86d8ee5b13404484811b10e05818abc8 P 09ec138dff9842f0858adca947bc33fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:35.470252 10532 raft_consensus.cc:740] T 86d8ee5b13404484811b10e05818abc8 P 09ec138dff9842f0858adca947bc33fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09ec138dff9842f0858adca947bc33fb, State: Initialized, Role: FOLLOWER
I20260709 12:23:35.470659 10490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcced512029492fb6903fc4d42abd31" candidate_uuid: "09ec138dff9842f0858adca947bc33fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62eb0e44cb794e9db922a20fcfb9d606" is_pre_election: true
I20260709 12:23:35.470868 10532 consensus_queue.cc:260] T 86d8ee5b13404484811b10e05818abc8 P 09ec138dff9842f0858adca947bc33fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:35.471377 10490 raft_consensus.cc:2468] T ddcced512029492fb6903fc4d42abd31 P 62eb0e44cb794e9db922a20fcfb9d606 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09ec138dff9842f0858adca947bc33fb in term 0.
I20260709 12:23:35.473026 10532 ts_tablet_manager.cc:1434] T 86d8ee5b13404484811b10e05818abc8 P 09ec138dff9842f0858adca947bc33fb: Time spent starting tablet: real 0.014s	user 0.002s	sys 0.003s
I20260709 12:23:35.472735 10304 leader_election.cc:304] T ddcced512029492fb6903fc4d42abd31 P 09ec138dff9842f0858adca947bc33fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09ec138dff9842f0858adca947bc33fb, 62eb0e44cb794e9db922a20fcfb9d606; no voters: 
I20260709 12:23:35.473979 10532 tablet_bootstrap.cc:492] T ce98990ba39f44f4b792419973437b1c P 09ec138dff9842f0858adca947bc33fb: Bootstrap starting.
I20260709 12:23:35.474283 10570 raft_consensus.cc:2804] T ddcced512029492fb6903fc4d42abd31 P 09ec138dff9842f0858adca947bc33fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:35.474838 10570 raft_consensus.cc:493] T ddcced512029492fb6903fc4d42abd31 P 09ec138dff9842f0858adca947bc33fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:35.475208 10570 raft_consensus.cc:3060] T ddcced512029492fb6903fc4d42abd31 P 09ec138dff9842f0858adca947bc33fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:35.472690 10415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcced512029492fb6903fc4d42abd31" candidate_uuid: "09ec138dff9842f0858adca947bc33fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39666a280cd648579a4ad0f800aa7261" is_pre_election: true
W20260709 12:23:35.478096 10307 leader_election.cc:343] T ddcced512029492fb6903fc4d42abd31 P 09ec138dff9842f0858adca947bc33fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 39666a280cd648579a4ad0f800aa7261 (127.9.116.66:43111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:35.479923 10530 tablet_bootstrap.cc:654] T b6cc3e80f4f6411b89c21921f2929554 P 39666a280cd648579a4ad0f800aa7261: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:35.485711 10571 raft_consensus.cc:493] T b6cc3e80f4f6411b89c21921f2929554 P 09ec138dff9842f0858adca947bc33fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.486277 10571 raft_consensus.cc:515] T b6cc3e80f4f6411b89c21921f2929554 P 09ec138dff9842f0858adca947bc33fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:35.481927 10532 tablet_bootstrap.cc:654] T ce98990ba39f44f4b792419973437b1c P 09ec138dff9842f0858adca947bc33fb: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:35.492211 10571 leader_election.cc:290] T b6cc3e80f4f6411b89c21921f2929554 P 09ec138dff9842f0858adca947bc33fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39666a280cd648579a4ad0f800aa7261 (127.9.116.66:43111), 62eb0e44cb794e9db922a20fcfb9d606 (127.9.116.67:42127)
I20260709 12:23:35.492399 10415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6cc3e80f4f6411b89c21921f2929554" candidate_uuid: "09ec138dff9842f0858adca947bc33fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39666a280cd648579a4ad0f800aa7261" is_pre_election: true
W20260709 12:23:35.495841 10307 leader_election.cc:343] T b6cc3e80f4f6411b89c21921f2929554 P 09ec138dff9842f0858adca947bc33fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 39666a280cd648579a4ad0f800aa7261 (127.9.116.66:43111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:35.497841 10490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6cc3e80f4f6411b89c21921f2929554" candidate_uuid: "09ec138dff9842f0858adca947bc33fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62eb0e44cb794e9db922a20fcfb9d606" is_pre_election: true
I20260709 12:23:35.498018 10574 raft_consensus.cc:493] T 86d8ee5b13404484811b10e05818abc8 P 62eb0e44cb794e9db922a20fcfb9d606 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.498622 10574 raft_consensus.cc:515] T 86d8ee5b13404484811b10e05818abc8 P 62eb0e44cb794e9db922a20fcfb9d606 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:35.501148 10574 leader_election.cc:290] T 86d8ee5b13404484811b10e05818abc8 P 62eb0e44cb794e9db922a20fcfb9d606 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09ec138dff9842f0858adca947bc33fb (127.9.116.65:42825), 39666a280cd648579a4ad0f800aa7261 (127.9.116.66:43111)
I20260709 12:23:35.503749 10415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d8ee5b13404484811b10e05818abc8" candidate_uuid: "62eb0e44cb794e9db922a20fcfb9d606" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39666a280cd648579a4ad0f800aa7261" is_pre_election: true
I20260709 12:23:35.504457 10415 raft_consensus.cc:2468] T 86d8ee5b13404484811b10e05818abc8 P 39666a280cd648579a4ad0f800aa7261 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62eb0e44cb794e9db922a20fcfb9d606 in term 0.
I20260709 12:23:35.505002 10530 tablet_bootstrap.cc:492] T b6cc3e80f4f6411b89c21921f2929554 P 39666a280cd648579a4ad0f800aa7261: No bootstrap required, opened a new log
I20260709 12:23:35.505609 10530 ts_tablet_manager.cc:1403] T b6cc3e80f4f6411b89c21921f2929554 P 39666a280cd648579a4ad0f800aa7261: Time spent bootstrapping tablet: real 0.059s	user 0.020s	sys 0.010s
I20260709 12:23:35.506237 10456 leader_election.cc:304] T 86d8ee5b13404484811b10e05818abc8 P 62eb0e44cb794e9db922a20fcfb9d606 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39666a280cd648579a4ad0f800aa7261, 62eb0e44cb794e9db922a20fcfb9d606; no voters: 
I20260709 12:23:35.508066 10549 consensus_queue.cc:1048] T c8b3a5c008584867bf2282f87acb3cde P 39666a280cd648579a4ad0f800aa7261 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:35.508735 10530 raft_consensus.cc:359] T b6cc3e80f4f6411b89c21921f2929554 P 39666a280cd648579a4ad0f800aa7261 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:35.509513 10530 raft_consensus.cc:385] T b6cc3e80f4f6411b89c21921f2929554 P 39666a280cd648579a4ad0f800aa7261 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:35.509831 10530 raft_consensus.cc:740] T b6cc3e80f4f6411b89c21921f2929554 P 39666a280cd648579a4ad0f800aa7261 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39666a280cd648579a4ad0f800aa7261, State: Initialized, Role: FOLLOWER
I20260709 12:23:35.510030 10340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d8ee5b13404484811b10e05818abc8" candidate_uuid: "62eb0e44cb794e9db922a20fcfb9d606" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09ec138dff9842f0858adca947bc33fb" is_pre_election: true
I20260709 12:23:35.510533 10530 consensus_queue.cc:260] T b6cc3e80f4f6411b89c21921f2929554 P 39666a280cd648579a4ad0f800aa7261 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:35.511001 10340 raft_consensus.cc:2468] T 86d8ee5b13404484811b10e05818abc8 P 09ec138dff9842f0858adca947bc33fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62eb0e44cb794e9db922a20fcfb9d606 in term 0.
I20260709 12:23:35.517653 10530 ts_tablet_manager.cc:1434] T b6cc3e80f4f6411b89c21921f2929554 P 39666a280cd648579a4ad0f800aa7261: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:23:35.518810 10530 tablet_bootstrap.cc:492] T ddcced512029492fb6903fc4d42abd31 P 39666a280cd648579a4ad0f800aa7261: Bootstrap starting.
I20260709 12:23:35.515287 10574 raft_consensus.cc:2804] T 86d8ee5b13404484811b10e05818abc8 P 62eb0e44cb794e9db922a20fcfb9d606 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:35.519500 10574 raft_consensus.cc:493] T 86d8ee5b13404484811b10e05818abc8 P 62eb0e44cb794e9db922a20fcfb9d606 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:35.519995 10574 raft_consensus.cc:3060] T 86d8ee5b13404484811b10e05818abc8 P 62eb0e44cb794e9db922a20fcfb9d606 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:35.518525 10490 raft_consensus.cc:2468] T b6cc3e80f4f6411b89c21921f2929554 P 62eb0e44cb794e9db922a20fcfb9d606 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09ec138dff9842f0858adca947bc33fb in term 0.
I20260709 12:23:35.537894 10304 leader_election.cc:304] T b6cc3e80f4f6411b89c21921f2929554 P 09ec138dff9842f0858adca947bc33fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09ec138dff9842f0858adca947bc33fb, 62eb0e44cb794e9db922a20fcfb9d606; no voters: 39666a280cd648579a4ad0f800aa7261
I20260709 12:23:35.539419 10571 raft_consensus.cc:2804] T b6cc3e80f4f6411b89c21921f2929554 P 09ec138dff9842f0858adca947bc33fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:35.539943 10571 raft_consensus.cc:493] T b6cc3e80f4f6411b89c21921f2929554 P 09ec138dff9842f0858adca947bc33fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:35.540345 10571 raft_consensus.cc:3060] T b6cc3e80f4f6411b89c21921f2929554 P 09ec138dff9842f0858adca947bc33fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:35.545449 10554 raft_consensus.cc:493] T ce98990ba39f44f4b792419973437b1c P 62eb0e44cb794e9db922a20fcfb9d606 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.546707 10554 raft_consensus.cc:515] T ce98990ba39f44f4b792419973437b1c P 62eb0e44cb794e9db922a20fcfb9d606 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:35.549866 10554 leader_election.cc:290] T ce98990ba39f44f4b792419973437b1c P 62eb0e44cb794e9db922a20fcfb9d606 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09ec138dff9842f0858adca947bc33fb (127.9.116.65:42825), 39666a280cd648579a4ad0f800aa7261 (127.9.116.66:43111)
I20260709 12:23:35.550504 10530 tablet_bootstrap.cc:654] T ddcced512029492fb6903fc4d42abd31 P 39666a280cd648579a4ad0f800aa7261: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:35.552148 10415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98990ba39f44f4b792419973437b1c" candidate_uuid: "62eb0e44cb794e9db922a20fcfb9d606" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39666a280cd648579a4ad0f800aa7261" is_pre_election: true
W20260709 12:23:35.553772 10456 leader_election.cc:343] T ce98990ba39f44f4b792419973437b1c P 62eb0e44cb794e9db922a20fcfb9d606 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 39666a280cd648579a4ad0f800aa7261 (127.9.116.66:43111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:35.553551 10570 raft_consensus.cc:515] T ddcced512029492fb6903fc4d42abd31 P 09ec138dff9842f0858adca947bc33fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:35.558619 10574 raft_consensus.cc:515] T 86d8ee5b13404484811b10e05818abc8 P 62eb0e44cb794e9db922a20fcfb9d606 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:35.561918 10415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcced512029492fb6903fc4d42abd31" candidate_uuid: "09ec138dff9842f0858adca947bc33fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39666a280cd648579a4ad0f800aa7261"
W20260709 12:23:35.563395 10307 leader_election.cc:343] T ddcced512029492fb6903fc4d42abd31 P 09ec138dff9842f0858adca947bc33fb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 39666a280cd648579a4ad0f800aa7261 (127.9.116.66:43111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:35.566180 10339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98990ba39f44f4b792419973437b1c" candidate_uuid: "62eb0e44cb794e9db922a20fcfb9d606" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09ec138dff9842f0858adca947bc33fb" is_pre_election: true
W20260709 12:23:35.568081 10456 leader_election.cc:343] T ce98990ba39f44f4b792419973437b1c P 62eb0e44cb794e9db922a20fcfb9d606 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09ec138dff9842f0858adca947bc33fb (127.9.116.65:42825): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:35.568862 10456 leader_election.cc:304] T ce98990ba39f44f4b792419973437b1c P 62eb0e44cb794e9db922a20fcfb9d606 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 62eb0e44cb794e9db922a20fcfb9d606; no voters: 09ec138dff9842f0858adca947bc33fb, 39666a280cd648579a4ad0f800aa7261
I20260709 12:23:35.571462 10554 raft_consensus.cc:2749] T ce98990ba39f44f4b792419973437b1c P 62eb0e44cb794e9db922a20fcfb9d606 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:35.573272 10570 leader_election.cc:290] T ddcced512029492fb6903fc4d42abd31 P 09ec138dff9842f0858adca947bc33fb [CANDIDATE]: Term 1 election: Requested vote from peers 39666a280cd648579a4ad0f800aa7261 (127.9.116.66:43111), 62eb0e44cb794e9db922a20fcfb9d606 (127.9.116.67:42127)
I20260709 12:23:35.572955 10571 raft_consensus.cc:515] T b6cc3e80f4f6411b89c21921f2929554 P 09ec138dff9842f0858adca947bc33fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:35.574883 10490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcced512029492fb6903fc4d42abd31" candidate_uuid: "09ec138dff9842f0858adca947bc33fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62eb0e44cb794e9db922a20fcfb9d606"
I20260709 12:23:35.576763 10490 raft_consensus.cc:3060] T ddcced512029492fb6903fc4d42abd31 P 62eb0e44cb794e9db922a20fcfb9d606 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:35.592396 10589 raft_consensus.cc:493] T b6cc3e80f4f6411b89c21921f2929554 P 39666a280cd648579a4ad0f800aa7261 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.593232 10589 raft_consensus.cc:515] T b6cc3e80f4f6411b89c21921f2929554 P 39666a280cd648579a4ad0f800aa7261 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:35.597321 10589 leader_election.cc:290] T b6cc3e80f4f6411b89c21921f2929554 P 39666a280cd648579a4ad0f800aa7261 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09ec138dff9842f0858adca947bc33fb (127.9.116.65:42825), 62eb0e44cb794e9db922a20fcfb9d606 (127.9.116.67:42127)
I20260709 12:23:35.598169 10488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6cc3e80f4f6411b89c21921f2929554" candidate_uuid: "39666a280cd648579a4ad0f800aa7261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62eb0e44cb794e9db922a20fcfb9d606" is_pre_election: true
I20260709 12:23:35.598908 10488 raft_consensus.cc:2468] T b6cc3e80f4f6411b89c21921f2929554 P 62eb0e44cb794e9db922a20fcfb9d606 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39666a280cd648579a4ad0f800aa7261 in term 0.
I20260709 12:23:35.599332 10339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d8ee5b13404484811b10e05818abc8" candidate_uuid: "62eb0e44cb794e9db922a20fcfb9d606" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09ec138dff9842f0858adca947bc33fb"
I20260709 12:23:35.600085 10339 raft_consensus.cc:3060] T 86d8ee5b13404484811b10e05818abc8 P 09ec138dff9842f0858adca947bc33fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:35.601511 10574 leader_election.cc:290] T 86d8ee5b13404484811b10e05818abc8 P 62eb0e44cb794e9db922a20fcfb9d606 [CANDIDATE]: Term 1 election: Requested vote from peers 09ec138dff9842f0858adca947bc33fb (127.9.116.65:42825), 39666a280cd648579a4ad0f800aa7261 (127.9.116.66:43111)
I20260709 12:23:35.603475 10532 tablet_bootstrap.cc:492] T ce98990ba39f44f4b792419973437b1c P 09ec138dff9842f0858adca947bc33fb: No bootstrap required, opened a new log
I20260709 12:23:35.603004 10379 leader_election.cc:304] T b6cc3e80f4f6411b89c21921f2929554 P 39666a280cd648579a4ad0f800aa7261 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39666a280cd648579a4ad0f800aa7261, 62eb0e44cb794e9db922a20fcfb9d606; no voters: 
I20260709 12:23:35.604061 10532 ts_tablet_manager.cc:1403] T ce98990ba39f44f4b792419973437b1c P 09ec138dff9842f0858adca947bc33fb: Time spent bootstrapping tablet: real 0.130s	user 0.018s	sys 0.059s
I20260709 12:23:35.605238 10415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d8ee5b13404484811b10e05818abc8" candidate_uuid: "62eb0e44cb794e9db922a20fcfb9d606" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39666a280cd648579a4ad0f800aa7261"
I20260709 12:23:35.606025 10415 raft_consensus.cc:3060] T 86d8ee5b13404484811b10e05818abc8 P 39666a280cd648579a4ad0f800aa7261 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:35.606594 10532 raft_consensus.cc:359] T ce98990ba39f44f4b792419973437b1c P 09ec138dff9842f0858adca947bc33fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:35.607297 10532 raft_consensus.cc:385] T ce98990ba39f44f4b792419973437b1c P 09ec138dff9842f0858adca947bc33fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:35.607602 10532 raft_consensus.cc:740] T ce98990ba39f44f4b792419973437b1c P 09ec138dff9842f0858adca947bc33fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09ec138dff9842f0858adca947bc33fb, State: Initialized, Role: FOLLOWER
I20260709 12:23:35.607661 10341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6cc3e80f4f6411b89c21921f2929554" candidate_uuid: "39666a280cd648579a4ad0f800aa7261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09ec138dff9842f0858adca947bc33fb" is_pre_election: true
I20260709 12:23:35.609011 10546 raft_consensus.cc:2804] T b6cc3e80f4f6411b89c21921f2929554 P 39666a280cd648579a4ad0f800aa7261 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:35.609419 10546 raft_consensus.cc:493] T b6cc3e80f4f6411b89c21921f2929554 P 39666a280cd648579a4ad0f800aa7261 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:35.609812 10546 raft_consensus.cc:3060] T b6cc3e80f4f6411b89c21921f2929554 P 39666a280cd648579a4ad0f800aa7261 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:35.609593 10339 raft_consensus.cc:2468] T 86d8ee5b13404484811b10e05818abc8 P 09ec138dff9842f0858adca947bc33fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62eb0e44cb794e9db922a20fcfb9d606 in term 1.
I20260709 12:23:35.610373 10532 consensus_queue.cc:260] T ce98990ba39f44f4b792419973437b1c P 09ec138dff9842f0858adca947bc33fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:35.613397 10456 leader_election.cc:304] T 86d8ee5b13404484811b10e05818abc8 P 62eb0e44cb794e9db922a20fcfb9d606 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09ec138dff9842f0858adca947bc33fb, 62eb0e44cb794e9db922a20fcfb9d606; no voters: 
I20260709 12:23:35.613224 10532 ts_tablet_manager.cc:1434] T ce98990ba39f44f4b792419973437b1c P 09ec138dff9842f0858adca947bc33fb: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:23:35.617138 10530 tablet_bootstrap.cc:492] T ddcced512029492fb6903fc4d42abd31 P 39666a280cd648579a4ad0f800aa7261: No bootstrap required, opened a new log
I20260709 12:23:35.617686 10530 ts_tablet_manager.cc:1403] T ddcced512029492fb6903fc4d42abd31 P 39666a280cd648579a4ad0f800aa7261: Time spent bootstrapping tablet: real 0.099s	user 0.025s	sys 0.014s
I20260709 12:23:35.618027 10574 raft_consensus.cc:2804] T 86d8ee5b13404484811b10e05818abc8 P 62eb0e44cb794e9db922a20fcfb9d606 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:35.619334 10574 raft_consensus.cc:697] T 86d8ee5b13404484811b10e05818abc8 P 62eb0e44cb794e9db922a20fcfb9d606 [term 1 LEADER]: Becoming Leader. State: Replica: 62eb0e44cb794e9db922a20fcfb9d606, State: Running, Role: LEADER
I20260709 12:23:35.617542 10415 raft_consensus.cc:2468] T 86d8ee5b13404484811b10e05818abc8 P 39666a280cd648579a4ad0f800aa7261 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62eb0e44cb794e9db922a20fcfb9d606 in term 1.
I20260709 12:23:35.620474 10530 raft_consensus.cc:359] T ddcced512029492fb6903fc4d42abd31 P 39666a280cd648579a4ad0f800aa7261 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:35.621186 10530 raft_consensus.cc:385] T ddcced512029492fb6903fc4d42abd31 P 39666a280cd648579a4ad0f800aa7261 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:35.621460 10530 raft_consensus.cc:740] T ddcced512029492fb6903fc4d42abd31 P 39666a280cd648579a4ad0f800aa7261 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39666a280cd648579a4ad0f800aa7261, State: Initialized, Role: FOLLOWER
I20260709 12:23:35.620257 10574 consensus_queue.cc:237] T 86d8ee5b13404484811b10e05818abc8 P 62eb0e44cb794e9db922a20fcfb9d606 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:35.605233 10490 raft_consensus.cc:2468] T ddcced512029492fb6903fc4d42abd31 P 62eb0e44cb794e9db922a20fcfb9d606 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09ec138dff9842f0858adca947bc33fb in term 1.
I20260709 12:23:35.624924 10304 leader_election.cc:304] T ddcced512029492fb6903fc4d42abd31 P 09ec138dff9842f0858adca947bc33fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09ec138dff9842f0858adca947bc33fb, 62eb0e44cb794e9db922a20fcfb9d606; no voters: 39666a280cd648579a4ad0f800aa7261
I20260709 12:23:35.625936 10569 raft_consensus.cc:2804] T ddcced512029492fb6903fc4d42abd31 P 09ec138dff9842f0858adca947bc33fb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:35.626608 10569 raft_consensus.cc:697] T ddcced512029492fb6903fc4d42abd31 P 09ec138dff9842f0858adca947bc33fb [term 1 LEADER]: Becoming Leader. State: Replica: 09ec138dff9842f0858adca947bc33fb, State: Running, Role: LEADER
I20260709 12:23:35.627799 10569 consensus_queue.cc:237] T ddcced512029492fb6903fc4d42abd31 P 09ec138dff9842f0858adca947bc33fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:35.632301 10341 raft_consensus.cc:2393] T b6cc3e80f4f6411b89c21921f2929554 P 09ec138dff9842f0858adca947bc33fb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39666a280cd648579a4ad0f800aa7261 in current term 1: Already voted for candidate 09ec138dff9842f0858adca947bc33fb in this term.
I20260709 12:23:35.632781 10546 raft_consensus.cc:515] T b6cc3e80f4f6411b89c21921f2929554 P 39666a280cd648579a4ad0f800aa7261 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:35.635522 10415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6cc3e80f4f6411b89c21921f2929554" candidate_uuid: "09ec138dff9842f0858adca947bc33fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39666a280cd648579a4ad0f800aa7261"
I20260709 12:23:35.636467 10415 raft_consensus.cc:2393] T b6cc3e80f4f6411b89c21921f2929554 P 39666a280cd648579a4ad0f800aa7261 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 09ec138dff9842f0858adca947bc33fb in current term 1: Already voted for candidate 39666a280cd648579a4ad0f800aa7261 in this term.
I20260709 12:23:35.638494 10490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6cc3e80f4f6411b89c21921f2929554" candidate_uuid: "09ec138dff9842f0858adca947bc33fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62eb0e44cb794e9db922a20fcfb9d606"
I20260709 12:23:35.636545 10530 consensus_queue.cc:260] T ddcced512029492fb6903fc4d42abd31 P 39666a280cd648579a4ad0f800aa7261 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:35.640218 10490 raft_consensus.cc:3060] T b6cc3e80f4f6411b89c21921f2929554 P 62eb0e44cb794e9db922a20fcfb9d606 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:35.640233 10488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6cc3e80f4f6411b89c21921f2929554" candidate_uuid: "39666a280cd648579a4ad0f800aa7261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62eb0e44cb794e9db922a20fcfb9d606"
I20260709 12:23:35.644352 10341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6cc3e80f4f6411b89c21921f2929554" candidate_uuid: "39666a280cd648579a4ad0f800aa7261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09ec138dff9842f0858adca947bc33fb"
I20260709 12:23:35.645452 10341 raft_consensus.cc:2393] T b6cc3e80f4f6411b89c21921f2929554 P 09ec138dff9842f0858adca947bc33fb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 39666a280cd648579a4ad0f800aa7261 in current term 1: Already voted for candidate 09ec138dff9842f0858adca947bc33fb in this term.
I20260709 12:23:35.647548 10382 leader_election.cc:304] T b6cc3e80f4f6411b89c21921f2929554 P 39666a280cd648579a4ad0f800aa7261 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39666a280cd648579a4ad0f800aa7261; no voters: 09ec138dff9842f0858adca947bc33fb, 62eb0e44cb794e9db922a20fcfb9d606
I20260709 12:23:35.648788 10237 catalog_manager.cc:5697] T 86d8ee5b13404484811b10e05818abc8 P 62eb0e44cb794e9db922a20fcfb9d606 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62eb0e44cb794e9db922a20fcfb9d606 (127.9.116.67). New cstate: current_term: 1 leader_uuid: "62eb0e44cb794e9db922a20fcfb9d606" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:35.650825 10589 raft_consensus.cc:2749] T b6cc3e80f4f6411b89c21921f2929554 P 39666a280cd648579a4ad0f800aa7261 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:23:35.651870 10530 ts_tablet_manager.cc:1434] T ddcced512029492fb6903fc4d42abd31 P 39666a280cd648579a4ad0f800aa7261: Time spent starting tablet: real 0.034s	user 0.009s	sys 0.000s
I20260709 12:23:35.639129 10546 leader_election.cc:290] T b6cc3e80f4f6411b89c21921f2929554 P 39666a280cd648579a4ad0f800aa7261 [CANDIDATE]: Term 1 election: Requested vote from peers 09ec138dff9842f0858adca947bc33fb (127.9.116.65:42825), 62eb0e44cb794e9db922a20fcfb9d606 (127.9.116.67:42127)
I20260709 12:23:35.656879 10530 tablet_bootstrap.cc:492] T ce98990ba39f44f4b792419973437b1c P 39666a280cd648579a4ad0f800aa7261: Bootstrap starting.
I20260709 12:23:35.637096 10571 leader_election.cc:290] T b6cc3e80f4f6411b89c21921f2929554 P 09ec138dff9842f0858adca947bc33fb [CANDIDATE]: Term 1 election: Requested vote from peers 39666a280cd648579a4ad0f800aa7261 (127.9.116.66:43111), 62eb0e44cb794e9db922a20fcfb9d606 (127.9.116.67:42127)
I20260709 12:23:35.662245 10490 raft_consensus.cc:2468] T b6cc3e80f4f6411b89c21921f2929554 P 62eb0e44cb794e9db922a20fcfb9d606 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09ec138dff9842f0858adca947bc33fb in term 1.
I20260709 12:23:35.663947 10304 leader_election.cc:304] T b6cc3e80f4f6411b89c21921f2929554 P 09ec138dff9842f0858adca947bc33fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09ec138dff9842f0858adca947bc33fb, 62eb0e44cb794e9db922a20fcfb9d606; no voters: 39666a280cd648579a4ad0f800aa7261
I20260709 12:23:35.665588 10571 raft_consensus.cc:2804] T b6cc3e80f4f6411b89c21921f2929554 P 09ec138dff9842f0858adca947bc33fb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:35.666225 10571 raft_consensus.cc:697] T b6cc3e80f4f6411b89c21921f2929554 P 09ec138dff9842f0858adca947bc33fb [term 1 LEADER]: Becoming Leader. State: Replica: 09ec138dff9842f0858adca947bc33fb, State: Running, Role: LEADER
I20260709 12:23:35.666823 10530 tablet_bootstrap.cc:654] T ce98990ba39f44f4b792419973437b1c P 39666a280cd648579a4ad0f800aa7261: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:35.666893 10574 consensus_queue.cc:1048] T f45d2ff8d4f540878e0ec1058a28f8d5 P 62eb0e44cb794e9db922a20fcfb9d606 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:35.667397 10571 consensus_queue.cc:237] T b6cc3e80f4f6411b89c21921f2929554 P 09ec138dff9842f0858adca947bc33fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:35.688187 10530 tablet_bootstrap.cc:492] T ce98990ba39f44f4b792419973437b1c P 39666a280cd648579a4ad0f800aa7261: No bootstrap required, opened a new log
I20260709 12:23:35.688786 10530 ts_tablet_manager.cc:1403] T ce98990ba39f44f4b792419973437b1c P 39666a280cd648579a4ad0f800aa7261: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.007s
I20260709 12:23:35.691042 10530 raft_consensus.cc:359] T ce98990ba39f44f4b792419973437b1c P 39666a280cd648579a4ad0f800aa7261 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:35.691583 10530 raft_consensus.cc:385] T ce98990ba39f44f4b792419973437b1c P 39666a280cd648579a4ad0f800aa7261 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:35.680187 10239 catalog_manager.cc:5697] T ddcced512029492fb6903fc4d42abd31 P 09ec138dff9842f0858adca947bc33fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 09ec138dff9842f0858adca947bc33fb (127.9.116.65). New cstate: current_term: 1 leader_uuid: "09ec138dff9842f0858adca947bc33fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:35.692730 10571 consensus_queue.cc:1048] T 5764d623ece6411d8e3adfbd095f0fe1 P 09ec138dff9842f0858adca947bc33fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:35.691880 10530 raft_consensus.cc:740] T ce98990ba39f44f4b792419973437b1c P 39666a280cd648579a4ad0f800aa7261 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39666a280cd648579a4ad0f800aa7261, State: Initialized, Role: FOLLOWER
I20260709 12:23:35.695356 10530 consensus_queue.cc:260] T ce98990ba39f44f4b792419973437b1c P 39666a280cd648579a4ad0f800aa7261 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:35.698837 10530 ts_tablet_manager.cc:1434] T ce98990ba39f44f4b792419973437b1c P 39666a280cd648579a4ad0f800aa7261: Time spent starting tablet: real 0.010s	user 0.001s	sys 0.004s
I20260709 12:23:35.702946 10537 consensus_queue.cc:1048] T f45d2ff8d4f540878e0ec1058a28f8d5 P 62eb0e44cb794e9db922a20fcfb9d606 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:35.719678 10569 consensus_queue.cc:1048] T 5764d623ece6411d8e3adfbd095f0fe1 P 09ec138dff9842f0858adca947bc33fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:35.720482 10239 catalog_manager.cc:5697] T b6cc3e80f4f6411b89c21921f2929554 P 09ec138dff9842f0858adca947bc33fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 09ec138dff9842f0858adca947bc33fb (127.9.116.65). New cstate: current_term: 1 leader_uuid: "09ec138dff9842f0858adca947bc33fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:35.735749 10574 consensus_queue.cc:1048] T 57fc852991f54b508ff41067c25fe854 P 62eb0e44cb794e9db922a20fcfb9d606 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:35.751044 10537 consensus_queue.cc:1048] T 57fc852991f54b508ff41067c25fe854 P 62eb0e44cb794e9db922a20fcfb9d606 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:35.801008 10546 raft_consensus.cc:493] T ddcced512029492fb6903fc4d42abd31 P 39666a280cd648579a4ad0f800aa7261 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.801595 10546 raft_consensus.cc:515] T ddcced512029492fb6903fc4d42abd31 P 39666a280cd648579a4ad0f800aa7261 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:35.804021 10546 leader_election.cc:290] T ddcced512029492fb6903fc4d42abd31 P 39666a280cd648579a4ad0f800aa7261 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09ec138dff9842f0858adca947bc33fb (127.9.116.65:42825), 62eb0e44cb794e9db922a20fcfb9d606 (127.9.116.67:42127)
I20260709 12:23:35.804977 10341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcced512029492fb6903fc4d42abd31" candidate_uuid: "39666a280cd648579a4ad0f800aa7261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09ec138dff9842f0858adca947bc33fb" is_pre_election: true
I20260709 12:23:35.805363 10490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcced512029492fb6903fc4d42abd31" candidate_uuid: "39666a280cd648579a4ad0f800aa7261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62eb0e44cb794e9db922a20fcfb9d606" is_pre_election: true
I20260709 12:23:35.805316 10569 consensus_queue.cc:1048] T b719323785d84477bf49a3ebbf366f37 P 09ec138dff9842f0858adca947bc33fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:35.806294 10490 raft_consensus.cc:2393] T ddcced512029492fb6903fc4d42abd31 P 62eb0e44cb794e9db922a20fcfb9d606 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39666a280cd648579a4ad0f800aa7261 in current term 1: Already voted for candidate 09ec138dff9842f0858adca947bc33fb in this term.
I20260709 12:23:35.807266 10379 leader_election.cc:304] T ddcced512029492fb6903fc4d42abd31 P 39666a280cd648579a4ad0f800aa7261 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39666a280cd648579a4ad0f800aa7261; no voters: 09ec138dff9842f0858adca947bc33fb, 62eb0e44cb794e9db922a20fcfb9d606
I20260709 12:23:35.808046 10546 raft_consensus.cc:3060] T ddcced512029492fb6903fc4d42abd31 P 39666a280cd648579a4ad0f800aa7261 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:35.814580 10546 raft_consensus.cc:2749] T ddcced512029492fb6903fc4d42abd31 P 39666a280cd648579a4ad0f800aa7261 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:35.818073 10569 consensus_queue.cc:1048] T b719323785d84477bf49a3ebbf366f37 P 09ec138dff9842f0858adca947bc33fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:35.825212 10554 consensus_queue.cc:1048] T 1763c604c9c84205be8b3bf019a15fa0 P 62eb0e44cb794e9db922a20fcfb9d606 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:35.841290 10574 consensus_queue.cc:1048] T 1763c604c9c84205be8b3bf019a15fa0 P 62eb0e44cb794e9db922a20fcfb9d606 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:35.852665 10569 raft_consensus.cc:493] T ce98990ba39f44f4b792419973437b1c P 09ec138dff9842f0858adca947bc33fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.853252 10569 raft_consensus.cc:515] T ce98990ba39f44f4b792419973437b1c P 09ec138dff9842f0858adca947bc33fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:35.855830 10569 leader_election.cc:290] T ce98990ba39f44f4b792419973437b1c P 09ec138dff9842f0858adca947bc33fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39666a280cd648579a4ad0f800aa7261 (127.9.116.66:43111), 62eb0e44cb794e9db922a20fcfb9d606 (127.9.116.67:42127)
I20260709 12:23:35.856902 10414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98990ba39f44f4b792419973437b1c" candidate_uuid: "09ec138dff9842f0858adca947bc33fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39666a280cd648579a4ad0f800aa7261" is_pre_election: true
I20260709 12:23:35.857569 10414 raft_consensus.cc:2468] T ce98990ba39f44f4b792419973437b1c P 39666a280cd648579a4ad0f800aa7261 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09ec138dff9842f0858adca947bc33fb in term 0.
I20260709 12:23:35.858799 10307 leader_election.cc:304] T ce98990ba39f44f4b792419973437b1c P 09ec138dff9842f0858adca947bc33fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09ec138dff9842f0858adca947bc33fb, 39666a280cd648579a4ad0f800aa7261; no voters: 
I20260709 12:23:35.859144 10490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98990ba39f44f4b792419973437b1c" candidate_uuid: "09ec138dff9842f0858adca947bc33fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62eb0e44cb794e9db922a20fcfb9d606" is_pre_election: true
I20260709 12:23:35.859647 10569 raft_consensus.cc:2804] T ce98990ba39f44f4b792419973437b1c P 09ec138dff9842f0858adca947bc33fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:35.859820 10490 raft_consensus.cc:2468] T ce98990ba39f44f4b792419973437b1c P 62eb0e44cb794e9db922a20fcfb9d606 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09ec138dff9842f0858adca947bc33fb in term 0.
I20260709 12:23:35.860052 10569 raft_consensus.cc:493] T ce98990ba39f44f4b792419973437b1c P 09ec138dff9842f0858adca947bc33fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:35.860445 10569 raft_consensus.cc:3060] T ce98990ba39f44f4b792419973437b1c P 09ec138dff9842f0858adca947bc33fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:35.866830 10569 raft_consensus.cc:515] T ce98990ba39f44f4b792419973437b1c P 09ec138dff9842f0858adca947bc33fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:35.868631 10569 leader_election.cc:290] T ce98990ba39f44f4b792419973437b1c P 09ec138dff9842f0858adca947bc33fb [CANDIDATE]: Term 1 election: Requested vote from peers 39666a280cd648579a4ad0f800aa7261 (127.9.116.66:43111), 62eb0e44cb794e9db922a20fcfb9d606 (127.9.116.67:42127)
I20260709 12:23:35.869808 10490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98990ba39f44f4b792419973437b1c" candidate_uuid: "09ec138dff9842f0858adca947bc33fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62eb0e44cb794e9db922a20fcfb9d606"
I20260709 12:23:35.869805 10414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98990ba39f44f4b792419973437b1c" candidate_uuid: "09ec138dff9842f0858adca947bc33fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39666a280cd648579a4ad0f800aa7261"
I20260709 12:23:35.870522 10414 raft_consensus.cc:3060] T ce98990ba39f44f4b792419973437b1c P 39666a280cd648579a4ad0f800aa7261 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:35.870476 10490 raft_consensus.cc:3060] T ce98990ba39f44f4b792419973437b1c P 62eb0e44cb794e9db922a20fcfb9d606 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:35.878553 10414 raft_consensus.cc:2468] T ce98990ba39f44f4b792419973437b1c P 39666a280cd648579a4ad0f800aa7261 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09ec138dff9842f0858adca947bc33fb in term 1.
I20260709 12:23:35.878553 10490 raft_consensus.cc:2468] T ce98990ba39f44f4b792419973437b1c P 62eb0e44cb794e9db922a20fcfb9d606 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09ec138dff9842f0858adca947bc33fb in term 1.
I20260709 12:23:35.880044 10307 leader_election.cc:304] T ce98990ba39f44f4b792419973437b1c P 09ec138dff9842f0858adca947bc33fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09ec138dff9842f0858adca947bc33fb, 39666a280cd648579a4ad0f800aa7261; no voters: 
I20260709 12:23:35.880697 10569 raft_consensus.cc:2804] T ce98990ba39f44f4b792419973437b1c P 09ec138dff9842f0858adca947bc33fb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:35.881161 10569 raft_consensus.cc:697] T ce98990ba39f44f4b792419973437b1c P 09ec138dff9842f0858adca947bc33fb [term 1 LEADER]: Becoming Leader. State: Replica: 09ec138dff9842f0858adca947bc33fb, State: Running, Role: LEADER
I20260709 12:23:35.881855 10569 consensus_queue.cc:237] T ce98990ba39f44f4b792419973437b1c P 09ec138dff9842f0858adca947bc33fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:35.890276 10239 catalog_manager.cc:5697] T ce98990ba39f44f4b792419973437b1c P 09ec138dff9842f0858adca947bc33fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 09ec138dff9842f0858adca947bc33fb (127.9.116.65). New cstate: current_term: 1 leader_uuid: "09ec138dff9842f0858adca947bc33fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:36.017293 10564 consensus_queue.cc:1048] T 86d8ee5b13404484811b10e05818abc8 P 62eb0e44cb794e9db922a20fcfb9d606 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:36.022405 10574 consensus_queue.cc:1048] T 86d8ee5b13404484811b10e05818abc8 P 62eb0e44cb794e9db922a20fcfb9d606 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:36.054445 10569 consensus_queue.cc:1048] T ddcced512029492fb6903fc4d42abd31 P 09ec138dff9842f0858adca947bc33fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:36.069692 10569 consensus_queue.cc:1048] T ddcced512029492fb6903fc4d42abd31 P 09ec138dff9842f0858adca947bc33fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:36.088647 10569 consensus_queue.cc:1048] T b6cc3e80f4f6411b89c21921f2929554 P 09ec138dff9842f0858adca947bc33fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:36.102806 10569 consensus_queue.cc:1048] T b6cc3e80f4f6411b89c21921f2929554 P 09ec138dff9842f0858adca947bc33fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:36.139689 10490 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f45d2ff8d4f540878e0ec1058a28f8d5"
dest_uuid: "62eb0e44cb794e9db922a20fcfb9d606"
mode: GRACEFUL
new_leader_uuid: "09ec138dff9842f0858adca947bc33fb"
 from {username='slave'} at 127.0.0.1:56122
I20260709 12:23:36.140265 10490 raft_consensus.cc:606] T f45d2ff8d4f540878e0ec1058a28f8d5 P 62eb0e44cb794e9db922a20fcfb9d606 [term 1 LEADER]: Received request to transfer leadership to TS 09ec138dff9842f0858adca947bc33fb
I20260709 12:23:36.149928 10490 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1763c604c9c84205be8b3bf019a15fa0"
dest_uuid: "62eb0e44cb794e9db922a20fcfb9d606"
mode: GRACEFUL
new_leader_uuid: "09ec138dff9842f0858adca947bc33fb"
 from {username='slave'} at 127.0.0.1:56122
I20260709 12:23:36.150595 10490 raft_consensus.cc:606] T 1763c604c9c84205be8b3bf019a15fa0 P 62eb0e44cb794e9db922a20fcfb9d606 [term 1 LEADER]: Received request to transfer leadership to TS 09ec138dff9842f0858adca947bc33fb
I20260709 12:23:36.167151 10414 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c8b3a5c008584867bf2282f87acb3cde"
dest_uuid: "39666a280cd648579a4ad0f800aa7261"
mode: GRACEFUL
new_leader_uuid: "09ec138dff9842f0858adca947bc33fb"
 from {username='slave'} at 127.0.0.1:35202
I20260709 12:23:36.167764 10414 raft_consensus.cc:606] T c8b3a5c008584867bf2282f87acb3cde P 39666a280cd648579a4ad0f800aa7261 [term 1 LEADER]: Received request to transfer leadership to TS 09ec138dff9842f0858adca947bc33fb
I20260709 12:23:36.173388 10490 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57fc852991f54b508ff41067c25fe854"
dest_uuid: "62eb0e44cb794e9db922a20fcfb9d606"
mode: GRACEFUL
new_leader_uuid: "09ec138dff9842f0858adca947bc33fb"
 from {username='slave'} at 127.0.0.1:56122
I20260709 12:23:36.173971 10490 raft_consensus.cc:606] T 57fc852991f54b508ff41067c25fe854 P 62eb0e44cb794e9db922a20fcfb9d606 [term 1 LEADER]: Received request to transfer leadership to TS 09ec138dff9842f0858adca947bc33fb
I20260709 12:23:36.190982 10341 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b719323785d84477bf49a3ebbf366f37"
dest_uuid: "09ec138dff9842f0858adca947bc33fb"
mode: GRACEFUL
new_leader_uuid: "39666a280cd648579a4ad0f800aa7261"
 from {username='slave'} at 127.0.0.1:44172
I20260709 12:23:36.191848 10341 raft_consensus.cc:606] T b719323785d84477bf49a3ebbf366f37 P 09ec138dff9842f0858adca947bc33fb [term 1 LEADER]: Received request to transfer leadership to TS 39666a280cd648579a4ad0f800aa7261
I20260709 12:23:36.198338 10341 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ddcced512029492fb6903fc4d42abd31"
dest_uuid: "09ec138dff9842f0858adca947bc33fb"
mode: GRACEFUL
new_leader_uuid: "39666a280cd648579a4ad0f800aa7261"
 from {username='slave'} at 127.0.0.1:44172
I20260709 12:23:36.199019 10341 raft_consensus.cc:606] T ddcced512029492fb6903fc4d42abd31 P 09ec138dff9842f0858adca947bc33fb [term 1 LEADER]: Received request to transfer leadership to TS 39666a280cd648579a4ad0f800aa7261
I20260709 12:23:36.205230 10537 raft_consensus.cc:993] T f45d2ff8d4f540878e0ec1058a28f8d5 P 62eb0e44cb794e9db922a20fcfb9d606: : Instructing follower 09ec138dff9842f0858adca947bc33fb to start an election
I20260709 12:23:36.204994 10490 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "86d8ee5b13404484811b10e05818abc8"
dest_uuid: "62eb0e44cb794e9db922a20fcfb9d606"
mode: GRACEFUL
new_leader_uuid: "39666a280cd648579a4ad0f800aa7261"
 from {username='slave'} at 127.0.0.1:56122
I20260709 12:23:36.205797 10537 raft_consensus.cc:1081] T f45d2ff8d4f540878e0ec1058a28f8d5 P 62eb0e44cb794e9db922a20fcfb9d606 [term 1 LEADER]: Signalling peer 09ec138dff9842f0858adca947bc33fb to start an election
I20260709 12:23:36.205749 10490 raft_consensus.cc:606] T 86d8ee5b13404484811b10e05818abc8 P 62eb0e44cb794e9db922a20fcfb9d606 [term 1 LEADER]: Received request to transfer leadership to TS 39666a280cd648579a4ad0f800aa7261
I20260709 12:23:36.208669 10341 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f45d2ff8d4f540878e0ec1058a28f8d5"
dest_uuid: "09ec138dff9842f0858adca947bc33fb"
 from {username='slave'} at 127.0.0.1:44166
I20260709 12:23:36.209474 10341 raft_consensus.cc:493] T f45d2ff8d4f540878e0ec1058a28f8d5 P 09ec138dff9842f0858adca947bc33fb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:36.209914 10341 raft_consensus.cc:3060] T f45d2ff8d4f540878e0ec1058a28f8d5 P 09ec138dff9842f0858adca947bc33fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:36.213130 10339 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b6cc3e80f4f6411b89c21921f2929554"
dest_uuid: "09ec138dff9842f0858adca947bc33fb"
mode: GRACEFUL
new_leader_uuid: "39666a280cd648579a4ad0f800aa7261"
 from {username='slave'} at 127.0.0.1:44172
I20260709 12:23:36.213806 10339 raft_consensus.cc:606] T b6cc3e80f4f6411b89c21921f2929554 P 09ec138dff9842f0858adca947bc33fb [term 1 LEADER]: Received request to transfer leadership to TS 39666a280cd648579a4ad0f800aa7261
I20260709 12:23:36.218235 10341 raft_consensus.cc:515] T f45d2ff8d4f540878e0ec1058a28f8d5 P 09ec138dff9842f0858adca947bc33fb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } } peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } }
I20260709 12:23:36.220587 10341 leader_election.cc:290] T f45d2ff8d4f540878e0ec1058a28f8d5 P 09ec138dff9842f0858adca947bc33fb [CANDIDATE]: Term 2 election: Requested vote from peers 39666a280cd648579a4ad0f800aa7261 (127.9.116.66:43111), 62eb0e44cb794e9db922a20fcfb9d606 (127.9.116.67:42127)
I20260709 12:23:36.220898 10414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f45d2ff8d4f540878e0ec1058a28f8d5" candidate_uuid: "09ec138dff9842f0858adca947bc33fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "39666a280cd648579a4ad0f800aa7261"
I20260709 12:23:36.220801 10339 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ce98990ba39f44f4b792419973437b1c"
dest_uuid: "09ec138dff9842f0858adca947bc33fb"
mode: GRACEFUL
new_leader_uuid: "62eb0e44cb794e9db922a20fcfb9d606"
 from {username='slave'} at 127.0.0.1:44172
I20260709 12:23:36.221585 10414 raft_consensus.cc:3060] T f45d2ff8d4f540878e0ec1058a28f8d5 P 39666a280cd648579a4ad0f800aa7261 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:36.222039 10339 raft_consensus.cc:606] T ce98990ba39f44f4b792419973437b1c P 09ec138dff9842f0858adca947bc33fb [term 1 LEADER]: Received request to transfer leadership to TS 62eb0e44cb794e9db922a20fcfb9d606
I20260709 12:23:36.228133 10490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f45d2ff8d4f540878e0ec1058a28f8d5" candidate_uuid: "09ec138dff9842f0858adca947bc33fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "62eb0e44cb794e9db922a20fcfb9d606"
I20260709 12:23:36.229138 10490 raft_consensus.cc:3055] T f45d2ff8d4f540878e0ec1058a28f8d5 P 62eb0e44cb794e9db922a20fcfb9d606 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:36.229633 10490 raft_consensus.cc:740] T f45d2ff8d4f540878e0ec1058a28f8d5 P 62eb0e44cb794e9db922a20fcfb9d606 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 62eb0e44cb794e9db922a20fcfb9d606, State: Running, Role: LEADER
I20260709 12:23:36.230407 10490 consensus_queue.cc:260] T f45d2ff8d4f540878e0ec1058a28f8d5 P 62eb0e44cb794e9db922a20fcfb9d606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } } peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } }
I20260709 12:23:36.231175 10414 raft_consensus.cc:2468] T f45d2ff8d4f540878e0ec1058a28f8d5 P 39666a280cd648579a4ad0f800aa7261 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09ec138dff9842f0858adca947bc33fb in term 2.
I20260709 12:23:36.231338 10490 raft_consensus.cc:3060] T f45d2ff8d4f540878e0ec1058a28f8d5 P 62eb0e44cb794e9db922a20fcfb9d606 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:36.232553 10307 leader_election.cc:304] T f45d2ff8d4f540878e0ec1058a28f8d5 P 09ec138dff9842f0858adca947bc33fb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09ec138dff9842f0858adca947bc33fb, 39666a280cd648579a4ad0f800aa7261; no voters: 
I20260709 12:23:36.233830 10569 raft_consensus.cc:2804] T f45d2ff8d4f540878e0ec1058a28f8d5 P 09ec138dff9842f0858adca947bc33fb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:36.234381 10569 raft_consensus.cc:697] T f45d2ff8d4f540878e0ec1058a28f8d5 P 09ec138dff9842f0858adca947bc33fb [term 2 LEADER]: Becoming Leader. State: Replica: 09ec138dff9842f0858adca947bc33fb, State: Running, Role: LEADER
I20260709 12:23:36.235304 10569 consensus_queue.cc:237] T f45d2ff8d4f540878e0ec1058a28f8d5 P 09ec138dff9842f0858adca947bc33fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } } peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } }
I20260709 12:23:36.236794 10490 raft_consensus.cc:2468] T f45d2ff8d4f540878e0ec1058a28f8d5 P 62eb0e44cb794e9db922a20fcfb9d606 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09ec138dff9842f0858adca947bc33fb in term 2.
I20260709 12:23:36.243286 10238 catalog_manager.cc:5697] T f45d2ff8d4f540878e0ec1058a28f8d5 P 09ec138dff9842f0858adca947bc33fb reported cstate change: term changed from 1 to 2, leader changed from 62eb0e44cb794e9db922a20fcfb9d606 (127.9.116.67) to 09ec138dff9842f0858adca947bc33fb (127.9.116.65). New cstate: current_term: 2 leader_uuid: "09ec138dff9842f0858adca947bc33fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:36.257968 10564 raft_consensus.cc:993] T 57fc852991f54b508ff41067c25fe854 P 62eb0e44cb794e9db922a20fcfb9d606: : Instructing follower 09ec138dff9842f0858adca947bc33fb to start an election
I20260709 12:23:36.258538 10537 raft_consensus.cc:1081] T 57fc852991f54b508ff41067c25fe854 P 62eb0e44cb794e9db922a20fcfb9d606 [term 1 LEADER]: Signalling peer 09ec138dff9842f0858adca947bc33fb to start an election
I20260709 12:23:36.260507 10339 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "57fc852991f54b508ff41067c25fe854"
dest_uuid: "09ec138dff9842f0858adca947bc33fb"
 from {username='slave'} at 127.0.0.1:44166
I20260709 12:23:36.261056 10339 raft_consensus.cc:493] T 57fc852991f54b508ff41067c25fe854 P 09ec138dff9842f0858adca947bc33fb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:36.261471 10339 raft_consensus.cc:3060] T 57fc852991f54b508ff41067c25fe854 P 09ec138dff9842f0858adca947bc33fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:36.266790 10339 raft_consensus.cc:515] T 57fc852991f54b508ff41067c25fe854 P 09ec138dff9842f0858adca947bc33fb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:36.269228 10339 leader_election.cc:290] T 57fc852991f54b508ff41067c25fe854 P 09ec138dff9842f0858adca947bc33fb [CANDIDATE]: Term 2 election: Requested vote from peers 39666a280cd648579a4ad0f800aa7261 (127.9.116.66:43111), 62eb0e44cb794e9db922a20fcfb9d606 (127.9.116.67:42127)
I20260709 12:23:36.270388 10490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fc852991f54b508ff41067c25fe854" candidate_uuid: "09ec138dff9842f0858adca947bc33fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "62eb0e44cb794e9db922a20fcfb9d606"
I20260709 12:23:36.270200 10414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fc852991f54b508ff41067c25fe854" candidate_uuid: "09ec138dff9842f0858adca947bc33fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "39666a280cd648579a4ad0f800aa7261"
I20260709 12:23:36.271153 10490 raft_consensus.cc:3055] T 57fc852991f54b508ff41067c25fe854 P 62eb0e44cb794e9db922a20fcfb9d606 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:36.271202 10414 raft_consensus.cc:3060] T 57fc852991f54b508ff41067c25fe854 P 39666a280cd648579a4ad0f800aa7261 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:36.271747 10490 raft_consensus.cc:740] T 57fc852991f54b508ff41067c25fe854 P 62eb0e44cb794e9db922a20fcfb9d606 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 62eb0e44cb794e9db922a20fcfb9d606, State: Running, Role: LEADER
I20260709 12:23:36.272630 10490 consensus_queue.cc:260] T 57fc852991f54b508ff41067c25fe854 P 62eb0e44cb794e9db922a20fcfb9d606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:36.274231 10490 raft_consensus.cc:3060] T 57fc852991f54b508ff41067c25fe854 P 62eb0e44cb794e9db922a20fcfb9d606 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:36.276171 10570 raft_consensus.cc:993] T b719323785d84477bf49a3ebbf366f37 P 09ec138dff9842f0858adca947bc33fb: : Instructing follower 39666a280cd648579a4ad0f800aa7261 to start an election
I20260709 12:23:36.276687 10570 raft_consensus.cc:1081] T b719323785d84477bf49a3ebbf366f37 P 09ec138dff9842f0858adca947bc33fb [term 1 LEADER]: Signalling peer 39666a280cd648579a4ad0f800aa7261 to start an election
I20260709 12:23:36.278908 10415 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b719323785d84477bf49a3ebbf366f37"
dest_uuid: "39666a280cd648579a4ad0f800aa7261"
 from {username='slave'} at 127.0.0.1:35196
I20260709 12:23:36.279790 10415 raft_consensus.cc:493] T b719323785d84477bf49a3ebbf366f37 P 39666a280cd648579a4ad0f800aa7261 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:36.280213 10415 raft_consensus.cc:3060] T b719323785d84477bf49a3ebbf366f37 P 39666a280cd648579a4ad0f800aa7261 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:36.281574 10414 raft_consensus.cc:2468] T 57fc852991f54b508ff41067c25fe854 P 39666a280cd648579a4ad0f800aa7261 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09ec138dff9842f0858adca947bc33fb in term 2.
I20260709 12:23:36.282116 10490 raft_consensus.cc:2468] T 57fc852991f54b508ff41067c25fe854 P 62eb0e44cb794e9db922a20fcfb9d606 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09ec138dff9842f0858adca947bc33fb in term 2.
I20260709 12:23:36.282892 10307 leader_election.cc:304] T 57fc852991f54b508ff41067c25fe854 P 09ec138dff9842f0858adca947bc33fb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09ec138dff9842f0858adca947bc33fb, 39666a280cd648579a4ad0f800aa7261; no voters: 
I20260709 12:23:36.284013 10569 raft_consensus.cc:2804] T 57fc852991f54b508ff41067c25fe854 P 09ec138dff9842f0858adca947bc33fb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:36.285374 10569 raft_consensus.cc:697] T 57fc852991f54b508ff41067c25fe854 P 09ec138dff9842f0858adca947bc33fb [term 2 LEADER]: Becoming Leader. State: Replica: 09ec138dff9842f0858adca947bc33fb, State: Running, Role: LEADER
I20260709 12:23:36.285943 10574 raft_consensus.cc:993] T 1763c604c9c84205be8b3bf019a15fa0 P 62eb0e44cb794e9db922a20fcfb9d606: : Instructing follower 09ec138dff9842f0858adca947bc33fb to start an election
I20260709 12:23:36.286435 10537 raft_consensus.cc:1081] T 1763c604c9c84205be8b3bf019a15fa0 P 62eb0e44cb794e9db922a20fcfb9d606 [term 1 LEADER]: Signalling peer 09ec138dff9842f0858adca947bc33fb to start an election
I20260709 12:23:36.286341 10569 consensus_queue.cc:237] T 57fc852991f54b508ff41067c25fe854 P 09ec138dff9842f0858adca947bc33fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:36.288250 10339 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1763c604c9c84205be8b3bf019a15fa0"
dest_uuid: "09ec138dff9842f0858adca947bc33fb"
 from {username='slave'} at 127.0.0.1:44166
I20260709 12:23:36.288834 10339 raft_consensus.cc:493] T 1763c604c9c84205be8b3bf019a15fa0 P 09ec138dff9842f0858adca947bc33fb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:36.289264 10339 raft_consensus.cc:3060] T 1763c604c9c84205be8b3bf019a15fa0 P 09ec138dff9842f0858adca947bc33fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:36.289278 10415 raft_consensus.cc:515] T b719323785d84477bf49a3ebbf366f37 P 39666a280cd648579a4ad0f800aa7261 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:36.292698 10341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719323785d84477bf49a3ebbf366f37" candidate_uuid: "39666a280cd648579a4ad0f800aa7261" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "09ec138dff9842f0858adca947bc33fb"
I20260709 12:23:36.292984 10490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719323785d84477bf49a3ebbf366f37" candidate_uuid: "39666a280cd648579a4ad0f800aa7261" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "62eb0e44cb794e9db922a20fcfb9d606"
I20260709 12:23:36.293632 10341 raft_consensus.cc:3055] T b719323785d84477bf49a3ebbf366f37 P 09ec138dff9842f0858adca947bc33fb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:36.294159 10341 raft_consensus.cc:740] T b719323785d84477bf49a3ebbf366f37 P 09ec138dff9842f0858adca947bc33fb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 09ec138dff9842f0858adca947bc33fb, State: Running, Role: LEADER
I20260709 12:23:36.294202 10490 raft_consensus.cc:3060] T b719323785d84477bf49a3ebbf366f37 P 62eb0e44cb794e9db922a20fcfb9d606 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:36.295048 10341 consensus_queue.cc:260] T b719323785d84477bf49a3ebbf366f37 P 09ec138dff9842f0858adca947bc33fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:36.295320 10238 catalog_manager.cc:5697] T 57fc852991f54b508ff41067c25fe854 P 09ec138dff9842f0858adca947bc33fb reported cstate change: term changed from 1 to 2, leader changed from 62eb0e44cb794e9db922a20fcfb9d606 (127.9.116.67) to 09ec138dff9842f0858adca947bc33fb (127.9.116.65). New cstate: current_term: 2 leader_uuid: "09ec138dff9842f0858adca947bc33fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:36.296334 10341 raft_consensus.cc:3060] T b719323785d84477bf49a3ebbf366f37 P 09ec138dff9842f0858adca947bc33fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:36.297618 10339 raft_consensus.cc:515] T 1763c604c9c84205be8b3bf019a15fa0 P 09ec138dff9842f0858adca947bc33fb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:36.300408 10339 leader_election.cc:290] T 1763c604c9c84205be8b3bf019a15fa0 P 09ec138dff9842f0858adca947bc33fb [CANDIDATE]: Term 2 election: Requested vote from peers 39666a280cd648579a4ad0f800aa7261 (127.9.116.66:43111), 62eb0e44cb794e9db922a20fcfb9d606 (127.9.116.67:42127)
I20260709 12:23:36.300642 10414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1763c604c9c84205be8b3bf019a15fa0" candidate_uuid: "09ec138dff9842f0858adca947bc33fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "39666a280cd648579a4ad0f800aa7261"
I20260709 12:23:36.301174 10415 leader_election.cc:290] T b719323785d84477bf49a3ebbf366f37 P 39666a280cd648579a4ad0f800aa7261 [CANDIDATE]: Term 2 election: Requested vote from peers 09ec138dff9842f0858adca947bc33fb (127.9.116.65:42825), 62eb0e44cb794e9db922a20fcfb9d606 (127.9.116.67:42127)
I20260709 12:23:36.301259 10414 raft_consensus.cc:3060] T 1763c604c9c84205be8b3bf019a15fa0 P 39666a280cd648579a4ad0f800aa7261 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:36.301635 10490 raft_consensus.cc:2468] T b719323785d84477bf49a3ebbf366f37 P 62eb0e44cb794e9db922a20fcfb9d606 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39666a280cd648579a4ad0f800aa7261 in term 2.
I20260709 12:23:36.302922 10379 leader_election.cc:304] T b719323785d84477bf49a3ebbf366f37 P 39666a280cd648579a4ad0f800aa7261 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39666a280cd648579a4ad0f800aa7261, 62eb0e44cb794e9db922a20fcfb9d606; no voters: 
I20260709 12:23:36.303747 10546 raft_consensus.cc:2804] T b719323785d84477bf49a3ebbf366f37 P 39666a280cd648579a4ad0f800aa7261 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:36.304239 10546 raft_consensus.cc:697] T b719323785d84477bf49a3ebbf366f37 P 39666a280cd648579a4ad0f800aa7261 [term 2 LEADER]: Becoming Leader. State: Replica: 39666a280cd648579a4ad0f800aa7261, State: Running, Role: LEADER
I20260709 12:23:36.305004 10546 consensus_queue.cc:237] T b719323785d84477bf49a3ebbf366f37 P 39666a280cd648579a4ad0f800aa7261 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:36.307086 10489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1763c604c9c84205be8b3bf019a15fa0" candidate_uuid: "09ec138dff9842f0858adca947bc33fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "62eb0e44cb794e9db922a20fcfb9d606"
I20260709 12:23:36.307760 10489 raft_consensus.cc:3055] T 1763c604c9c84205be8b3bf019a15fa0 P 62eb0e44cb794e9db922a20fcfb9d606 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:36.308100 10489 raft_consensus.cc:740] T 1763c604c9c84205be8b3bf019a15fa0 P 62eb0e44cb794e9db922a20fcfb9d606 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 62eb0e44cb794e9db922a20fcfb9d606, State: Running, Role: LEADER
I20260709 12:23:36.308444 10341 raft_consensus.cc:2468] T b719323785d84477bf49a3ebbf366f37 P 09ec138dff9842f0858adca947bc33fb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39666a280cd648579a4ad0f800aa7261 in term 2.
I20260709 12:23:36.308974 10489 consensus_queue.cc:260] T 1763c604c9c84205be8b3bf019a15fa0 P 62eb0e44cb794e9db922a20fcfb9d606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:36.310237 10489 raft_consensus.cc:3060] T 1763c604c9c84205be8b3bf019a15fa0 P 62eb0e44cb794e9db922a20fcfb9d606 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:36.315842 10414 raft_consensus.cc:2468] T 1763c604c9c84205be8b3bf019a15fa0 P 39666a280cd648579a4ad0f800aa7261 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09ec138dff9842f0858adca947bc33fb in term 2.
I20260709 12:23:36.314989 10238 catalog_manager.cc:5697] T b719323785d84477bf49a3ebbf366f37 P 39666a280cd648579a4ad0f800aa7261 reported cstate change: term changed from 1 to 2, leader changed from 09ec138dff9842f0858adca947bc33fb (127.9.116.65) to 39666a280cd648579a4ad0f800aa7261 (127.9.116.66). New cstate: current_term: 2 leader_uuid: "39666a280cd648579a4ad0f800aa7261" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:36.317157 10307 leader_election.cc:304] T 1763c604c9c84205be8b3bf019a15fa0 P 09ec138dff9842f0858adca947bc33fb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09ec138dff9842f0858adca947bc33fb, 39666a280cd648579a4ad0f800aa7261; no voters: 
I20260709 12:23:36.317533 10489 raft_consensus.cc:2468] T 1763c604c9c84205be8b3bf019a15fa0 P 62eb0e44cb794e9db922a20fcfb9d606 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09ec138dff9842f0858adca947bc33fb in term 2.
I20260709 12:23:36.318207 10539 raft_consensus.cc:2804] T 1763c604c9c84205be8b3bf019a15fa0 P 09ec138dff9842f0858adca947bc33fb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:36.318727 10539 raft_consensus.cc:697] T 1763c604c9c84205be8b3bf019a15fa0 P 09ec138dff9842f0858adca947bc33fb [term 2 LEADER]: Becoming Leader. State: Replica: 09ec138dff9842f0858adca947bc33fb, State: Running, Role: LEADER
I20260709 12:23:36.319555 10539 consensus_queue.cc:237] T 1763c604c9c84205be8b3bf019a15fa0 P 09ec138dff9842f0858adca947bc33fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:36.332139 10236 catalog_manager.cc:5697] T 1763c604c9c84205be8b3bf019a15fa0 P 09ec138dff9842f0858adca947bc33fb reported cstate change: term changed from 1 to 2, leader changed from 62eb0e44cb794e9db922a20fcfb9d606 (127.9.116.67) to 09ec138dff9842f0858adca947bc33fb (127.9.116.65). New cstate: current_term: 2 leader_uuid: "09ec138dff9842f0858adca947bc33fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:36.361194 10589 raft_consensus.cc:993] T c8b3a5c008584867bf2282f87acb3cde P 39666a280cd648579a4ad0f800aa7261: : Instructing follower 09ec138dff9842f0858adca947bc33fb to start an election
I20260709 12:23:36.361739 10546 raft_consensus.cc:1081] T c8b3a5c008584867bf2282f87acb3cde P 39666a280cd648579a4ad0f800aa7261 [term 1 LEADER]: Signalling peer 09ec138dff9842f0858adca947bc33fb to start an election
I20260709 12:23:36.363546 10341 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c8b3a5c008584867bf2282f87acb3cde"
dest_uuid: "09ec138dff9842f0858adca947bc33fb"
 from {username='slave'} at 127.0.0.1:44156
I20260709 12:23:36.364084 10341 raft_consensus.cc:493] T c8b3a5c008584867bf2282f87acb3cde P 09ec138dff9842f0858adca947bc33fb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:36.364401 10341 raft_consensus.cc:3060] T c8b3a5c008584867bf2282f87acb3cde P 09ec138dff9842f0858adca947bc33fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:36.370245 10341 raft_consensus.cc:515] T c8b3a5c008584867bf2282f87acb3cde P 09ec138dff9842f0858adca947bc33fb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:36.372704 10341 leader_election.cc:290] T c8b3a5c008584867bf2282f87acb3cde P 09ec138dff9842f0858adca947bc33fb [CANDIDATE]: Term 2 election: Requested vote from peers 39666a280cd648579a4ad0f800aa7261 (127.9.116.66:43111), 62eb0e44cb794e9db922a20fcfb9d606 (127.9.116.67:42127)
I20260709 12:23:36.373338 10539 consensus_queue.cc:1048] T ce98990ba39f44f4b792419973437b1c P 09ec138dff9842f0858adca947bc33fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:36.373484 10414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8b3a5c008584867bf2282f87acb3cde" candidate_uuid: "09ec138dff9842f0858adca947bc33fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "39666a280cd648579a4ad0f800aa7261"
I20260709 12:23:36.373742 10489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8b3a5c008584867bf2282f87acb3cde" candidate_uuid: "09ec138dff9842f0858adca947bc33fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "62eb0e44cb794e9db922a20fcfb9d606"
I20260709 12:23:36.374145 10414 raft_consensus.cc:3055] T c8b3a5c008584867bf2282f87acb3cde P 39666a280cd648579a4ad0f800aa7261 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:36.374243 10489 raft_consensus.cc:3060] T c8b3a5c008584867bf2282f87acb3cde P 62eb0e44cb794e9db922a20fcfb9d606 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:36.374552 10414 raft_consensus.cc:740] T c8b3a5c008584867bf2282f87acb3cde P 39666a280cd648579a4ad0f800aa7261 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 39666a280cd648579a4ad0f800aa7261, State: Running, Role: LEADER
I20260709 12:23:36.375902 10414 consensus_queue.cc:260] T c8b3a5c008584867bf2282f87acb3cde P 39666a280cd648579a4ad0f800aa7261 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:36.377280 10414 raft_consensus.cc:3060] T c8b3a5c008584867bf2282f87acb3cde P 39666a280cd648579a4ad0f800aa7261 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:36.384524 10414 raft_consensus.cc:2468] T c8b3a5c008584867bf2282f87acb3cde P 39666a280cd648579a4ad0f800aa7261 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09ec138dff9842f0858adca947bc33fb in term 2.
I20260709 12:23:36.386428 10307 leader_election.cc:304] T c8b3a5c008584867bf2282f87acb3cde P 09ec138dff9842f0858adca947bc33fb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09ec138dff9842f0858adca947bc33fb, 39666a280cd648579a4ad0f800aa7261; no voters: 
I20260709 12:23:36.387430 10570 raft_consensus.cc:2804] T c8b3a5c008584867bf2282f87acb3cde P 09ec138dff9842f0858adca947bc33fb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:36.387924 10489 raft_consensus.cc:2468] T c8b3a5c008584867bf2282f87acb3cde P 62eb0e44cb794e9db922a20fcfb9d606 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09ec138dff9842f0858adca947bc33fb in term 2.
I20260709 12:23:36.387987 10570 raft_consensus.cc:697] T c8b3a5c008584867bf2282f87acb3cde P 09ec138dff9842f0858adca947bc33fb [term 2 LEADER]: Becoming Leader. State: Replica: 09ec138dff9842f0858adca947bc33fb, State: Running, Role: LEADER
I20260709 12:23:36.387926 10539 consensus_queue.cc:1048] T ce98990ba39f44f4b792419973437b1c P 09ec138dff9842f0858adca947bc33fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:36.389452 10570 consensus_queue.cc:237] T c8b3a5c008584867bf2282f87acb3cde P 09ec138dff9842f0858adca947bc33fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:36.398259 10539 raft_consensus.cc:993] T ce98990ba39f44f4b792419973437b1c P 09ec138dff9842f0858adca947bc33fb: : Instructing follower 62eb0e44cb794e9db922a20fcfb9d606 to start an election
I20260709 12:23:36.398779 10570 raft_consensus.cc:1081] T ce98990ba39f44f4b792419973437b1c P 09ec138dff9842f0858adca947bc33fb [term 1 LEADER]: Signalling peer 62eb0e44cb794e9db922a20fcfb9d606 to start an election
I20260709 12:23:36.400316 10489 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ce98990ba39f44f4b792419973437b1c"
dest_uuid: "62eb0e44cb794e9db922a20fcfb9d606"
 from {username='slave'} at 127.0.0.1:56108
I20260709 12:23:36.400838 10489 raft_consensus.cc:493] T ce98990ba39f44f4b792419973437b1c P 62eb0e44cb794e9db922a20fcfb9d606 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:36.401187 10489 raft_consensus.cc:3060] T ce98990ba39f44f4b792419973437b1c P 62eb0e44cb794e9db922a20fcfb9d606 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:36.401180 10238 catalog_manager.cc:5697] T c8b3a5c008584867bf2282f87acb3cde P 09ec138dff9842f0858adca947bc33fb reported cstate change: term changed from 1 to 2, leader changed from 39666a280cd648579a4ad0f800aa7261 (127.9.116.66) to 09ec138dff9842f0858adca947bc33fb (127.9.116.65). New cstate: current_term: 2 leader_uuid: "09ec138dff9842f0858adca947bc33fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:36.408880 10489 raft_consensus.cc:515] T ce98990ba39f44f4b792419973437b1c P 62eb0e44cb794e9db922a20fcfb9d606 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:36.411486 10489 leader_election.cc:290] T ce98990ba39f44f4b792419973437b1c P 62eb0e44cb794e9db922a20fcfb9d606 [CANDIDATE]: Term 2 election: Requested vote from peers 09ec138dff9842f0858adca947bc33fb (127.9.116.65:42825), 39666a280cd648579a4ad0f800aa7261 (127.9.116.66:43111)
I20260709 12:23:36.412909 10414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98990ba39f44f4b792419973437b1c" candidate_uuid: "62eb0e44cb794e9db922a20fcfb9d606" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "39666a280cd648579a4ad0f800aa7261"
I20260709 12:23:36.413604 10414 raft_consensus.cc:3060] T ce98990ba39f44f4b792419973437b1c P 39666a280cd648579a4ad0f800aa7261 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:36.414045 10341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce98990ba39f44f4b792419973437b1c" candidate_uuid: "62eb0e44cb794e9db922a20fcfb9d606" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "09ec138dff9842f0858adca947bc33fb"
I20260709 12:23:36.414729 10341 raft_consensus.cc:3055] T ce98990ba39f44f4b792419973437b1c P 09ec138dff9842f0858adca947bc33fb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:36.415110 10341 raft_consensus.cc:740] T ce98990ba39f44f4b792419973437b1c P 09ec138dff9842f0858adca947bc33fb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 09ec138dff9842f0858adca947bc33fb, State: Running, Role: LEADER
I20260709 12:23:36.416060 10341 consensus_queue.cc:260] T ce98990ba39f44f4b792419973437b1c P 09ec138dff9842f0858adca947bc33fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:36.417454 10341 raft_consensus.cc:3060] T ce98990ba39f44f4b792419973437b1c P 09ec138dff9842f0858adca947bc33fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:36.423178 10414 raft_consensus.cc:2468] T ce98990ba39f44f4b792419973437b1c P 39666a280cd648579a4ad0f800aa7261 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62eb0e44cb794e9db922a20fcfb9d606 in term 2.
I20260709 12:23:36.424928 10456 leader_election.cc:304] T ce98990ba39f44f4b792419973437b1c P 62eb0e44cb794e9db922a20fcfb9d606 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39666a280cd648579a4ad0f800aa7261, 62eb0e44cb794e9db922a20fcfb9d606; no voters: 
I20260709 12:23:36.426002 10537 raft_consensus.cc:2804] T ce98990ba39f44f4b792419973437b1c P 62eb0e44cb794e9db922a20fcfb9d606 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:36.426599 10537 raft_consensus.cc:697] T ce98990ba39f44f4b792419973437b1c P 62eb0e44cb794e9db922a20fcfb9d606 [term 2 LEADER]: Becoming Leader. State: Replica: 62eb0e44cb794e9db922a20fcfb9d606, State: Running, Role: LEADER
I20260709 12:23:36.426961 10341 raft_consensus.cc:2468] T ce98990ba39f44f4b792419973437b1c P 09ec138dff9842f0858adca947bc33fb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62eb0e44cb794e9db922a20fcfb9d606 in term 2.
I20260709 12:23:36.427480 10537 consensus_queue.cc:237] T ce98990ba39f44f4b792419973437b1c P 62eb0e44cb794e9db922a20fcfb9d606 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:36.435344 10238 catalog_manager.cc:5697] T ce98990ba39f44f4b792419973437b1c P 62eb0e44cb794e9db922a20fcfb9d606 reported cstate change: term changed from 1 to 2, leader changed from 09ec138dff9842f0858adca947bc33fb (127.9.116.65) to 62eb0e44cb794e9db922a20fcfb9d606 (127.9.116.67). New cstate: current_term: 2 leader_uuid: "62eb0e44cb794e9db922a20fcfb9d606" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:36.526154 10539 raft_consensus.cc:993] T ddcced512029492fb6903fc4d42abd31 P 09ec138dff9842f0858adca947bc33fb: : Instructing follower 39666a280cd648579a4ad0f800aa7261 to start an election
I20260709 12:23:36.526937 10570 raft_consensus.cc:1081] T ddcced512029492fb6903fc4d42abd31 P 09ec138dff9842f0858adca947bc33fb [term 1 LEADER]: Signalling peer 39666a280cd648579a4ad0f800aa7261 to start an election
I20260709 12:23:36.528860 10414 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ddcced512029492fb6903fc4d42abd31"
dest_uuid: "39666a280cd648579a4ad0f800aa7261"
 from {username='slave'} at 127.0.0.1:35196
I20260709 12:23:36.529528 10414 raft_consensus.cc:493] T ddcced512029492fb6903fc4d42abd31 P 39666a280cd648579a4ad0f800aa7261 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:36.529902 10414 raft_consensus.cc:3060] T ddcced512029492fb6903fc4d42abd31 P 39666a280cd648579a4ad0f800aa7261 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:36.536825 10414 raft_consensus.cc:515] T ddcced512029492fb6903fc4d42abd31 P 39666a280cd648579a4ad0f800aa7261 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:36.538514 10414 leader_election.cc:290] T ddcced512029492fb6903fc4d42abd31 P 39666a280cd648579a4ad0f800aa7261 [CANDIDATE]: Term 2 election: Requested vote from peers 09ec138dff9842f0858adca947bc33fb (127.9.116.65:42825), 62eb0e44cb794e9db922a20fcfb9d606 (127.9.116.67:42127)
I20260709 12:23:36.539480 10341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcced512029492fb6903fc4d42abd31" candidate_uuid: "39666a280cd648579a4ad0f800aa7261" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "09ec138dff9842f0858adca947bc33fb"
I20260709 12:23:36.539708 10489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcced512029492fb6903fc4d42abd31" candidate_uuid: "39666a280cd648579a4ad0f800aa7261" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "62eb0e44cb794e9db922a20fcfb9d606"
I20260709 12:23:36.540047 10341 raft_consensus.cc:3055] T ddcced512029492fb6903fc4d42abd31 P 09ec138dff9842f0858adca947bc33fb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:36.540256 10489 raft_consensus.cc:3060] T ddcced512029492fb6903fc4d42abd31 P 62eb0e44cb794e9db922a20fcfb9d606 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:36.540409 10341 raft_consensus.cc:740] T ddcced512029492fb6903fc4d42abd31 P 09ec138dff9842f0858adca947bc33fb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 09ec138dff9842f0858adca947bc33fb, State: Running, Role: LEADER
I20260709 12:23:36.541249 10341 consensus_queue.cc:260] T ddcced512029492fb6903fc4d42abd31 P 09ec138dff9842f0858adca947bc33fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:36.542179 10341 raft_consensus.cc:3060] T ddcced512029492fb6903fc4d42abd31 P 09ec138dff9842f0858adca947bc33fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:36.545964 10489 raft_consensus.cc:2468] T ddcced512029492fb6903fc4d42abd31 P 62eb0e44cb794e9db922a20fcfb9d606 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39666a280cd648579a4ad0f800aa7261 in term 2.
I20260709 12:23:36.547446 10379 leader_election.cc:304] T ddcced512029492fb6903fc4d42abd31 P 39666a280cd648579a4ad0f800aa7261 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39666a280cd648579a4ad0f800aa7261, 62eb0e44cb794e9db922a20fcfb9d606; no voters: 
I20260709 12:23:36.548382 10546 raft_consensus.cc:2804] T ddcced512029492fb6903fc4d42abd31 P 39666a280cd648579a4ad0f800aa7261 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:36.548851 10546 raft_consensus.cc:697] T ddcced512029492fb6903fc4d42abd31 P 39666a280cd648579a4ad0f800aa7261 [term 2 LEADER]: Becoming Leader. State: Replica: 39666a280cd648579a4ad0f800aa7261, State: Running, Role: LEADER
I20260709 12:23:36.549950 10341 raft_consensus.cc:2468] T ddcced512029492fb6903fc4d42abd31 P 09ec138dff9842f0858adca947bc33fb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39666a280cd648579a4ad0f800aa7261 in term 2.
I20260709 12:23:36.549680 10546 consensus_queue.cc:237] T ddcced512029492fb6903fc4d42abd31 P 39666a280cd648579a4ad0f800aa7261 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:36.557933 10238 catalog_manager.cc:5697] T ddcced512029492fb6903fc4d42abd31 P 39666a280cd648579a4ad0f800aa7261 reported cstate change: term changed from 1 to 2, leader changed from 09ec138dff9842f0858adca947bc33fb (127.9.116.65) to 39666a280cd648579a4ad0f800aa7261 (127.9.116.66). New cstate: current_term: 2 leader_uuid: "39666a280cd648579a4ad0f800aa7261" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:36.576778 10569 raft_consensus.cc:993] T b6cc3e80f4f6411b89c21921f2929554 P 09ec138dff9842f0858adca947bc33fb: : Instructing follower 39666a280cd648579a4ad0f800aa7261 to start an election
I20260709 12:23:36.577353 10570 raft_consensus.cc:1081] T b6cc3e80f4f6411b89c21921f2929554 P 09ec138dff9842f0858adca947bc33fb [term 1 LEADER]: Signalling peer 39666a280cd648579a4ad0f800aa7261 to start an election
I20260709 12:23:36.578862 10414 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b6cc3e80f4f6411b89c21921f2929554"
dest_uuid: "39666a280cd648579a4ad0f800aa7261"
 from {username='slave'} at 127.0.0.1:35196
I20260709 12:23:36.579324 10414 raft_consensus.cc:493] T b6cc3e80f4f6411b89c21921f2929554 P 39666a280cd648579a4ad0f800aa7261 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:36.579608 10414 raft_consensus.cc:3060] T b6cc3e80f4f6411b89c21921f2929554 P 39666a280cd648579a4ad0f800aa7261 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:36.584321 10414 raft_consensus.cc:515] T b6cc3e80f4f6411b89c21921f2929554 P 39666a280cd648579a4ad0f800aa7261 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:36.586311 10414 leader_election.cc:290] T b6cc3e80f4f6411b89c21921f2929554 P 39666a280cd648579a4ad0f800aa7261 [CANDIDATE]: Term 2 election: Requested vote from peers 09ec138dff9842f0858adca947bc33fb (127.9.116.65:42825), 62eb0e44cb794e9db922a20fcfb9d606 (127.9.116.67:42127)
I20260709 12:23:36.587486 10341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6cc3e80f4f6411b89c21921f2929554" candidate_uuid: "39666a280cd648579a4ad0f800aa7261" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "09ec138dff9842f0858adca947bc33fb"
I20260709 12:23:36.587881 10489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6cc3e80f4f6411b89c21921f2929554" candidate_uuid: "39666a280cd648579a4ad0f800aa7261" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "62eb0e44cb794e9db922a20fcfb9d606"
I20260709 12:23:36.588146 10341 raft_consensus.cc:3055] T b6cc3e80f4f6411b89c21921f2929554 P 09ec138dff9842f0858adca947bc33fb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:36.588537 10489 raft_consensus.cc:3060] T b6cc3e80f4f6411b89c21921f2929554 P 62eb0e44cb794e9db922a20fcfb9d606 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:36.588816 10341 raft_consensus.cc:740] T b6cc3e80f4f6411b89c21921f2929554 P 09ec138dff9842f0858adca947bc33fb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 09ec138dff9842f0858adca947bc33fb, State: Running, Role: LEADER
I20260709 12:23:36.589725 10341 consensus_queue.cc:260] T b6cc3e80f4f6411b89c21921f2929554 P 09ec138dff9842f0858adca947bc33fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:36.590962 10341 raft_consensus.cc:3060] T b6cc3e80f4f6411b89c21921f2929554 P 09ec138dff9842f0858adca947bc33fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:36.595691 10489 raft_consensus.cc:2468] T b6cc3e80f4f6411b89c21921f2929554 P 62eb0e44cb794e9db922a20fcfb9d606 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39666a280cd648579a4ad0f800aa7261 in term 2.
I20260709 12:23:36.596972 10379 leader_election.cc:304] T b6cc3e80f4f6411b89c21921f2929554 P 39666a280cd648579a4ad0f800aa7261 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39666a280cd648579a4ad0f800aa7261, 62eb0e44cb794e9db922a20fcfb9d606; no voters: 
I20260709 12:23:36.597975 10546 raft_consensus.cc:2804] T b6cc3e80f4f6411b89c21921f2929554 P 39666a280cd648579a4ad0f800aa7261 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:36.598152 10341 raft_consensus.cc:2468] T b6cc3e80f4f6411b89c21921f2929554 P 09ec138dff9842f0858adca947bc33fb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39666a280cd648579a4ad0f800aa7261 in term 2.
I20260709 12:23:36.598543 10546 raft_consensus.cc:697] T b6cc3e80f4f6411b89c21921f2929554 P 39666a280cd648579a4ad0f800aa7261 [term 2 LEADER]: Becoming Leader. State: Replica: 39666a280cd648579a4ad0f800aa7261, State: Running, Role: LEADER
I20260709 12:23:36.599417 10546 consensus_queue.cc:237] T b6cc3e80f4f6411b89c21921f2929554 P 39666a280cd648579a4ad0f800aa7261 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:36.606639 10238 catalog_manager.cc:5697] T b6cc3e80f4f6411b89c21921f2929554 P 39666a280cd648579a4ad0f800aa7261 reported cstate change: term changed from 1 to 2, leader changed from 09ec138dff9842f0858adca947bc33fb (127.9.116.65) to 39666a280cd648579a4ad0f800aa7261 (127.9.116.66). New cstate: current_term: 2 leader_uuid: "39666a280cd648579a4ad0f800aa7261" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:36.650630 10574 raft_consensus.cc:993] T 86d8ee5b13404484811b10e05818abc8 P 62eb0e44cb794e9db922a20fcfb9d606: : Instructing follower 39666a280cd648579a4ad0f800aa7261 to start an election
I20260709 12:23:36.651235 10537 raft_consensus.cc:1081] T 86d8ee5b13404484811b10e05818abc8 P 62eb0e44cb794e9db922a20fcfb9d606 [term 1 LEADER]: Signalling peer 39666a280cd648579a4ad0f800aa7261 to start an election
I20260709 12:23:36.653585 10414 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "86d8ee5b13404484811b10e05818abc8"
dest_uuid: "39666a280cd648579a4ad0f800aa7261"
 from {username='slave'} at 127.0.0.1:35182
I20260709 12:23:36.654361 10414 raft_consensus.cc:493] T 86d8ee5b13404484811b10e05818abc8 P 39666a280cd648579a4ad0f800aa7261 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:36.654729 10414 raft_consensus.cc:3060] T 86d8ee5b13404484811b10e05818abc8 P 39666a280cd648579a4ad0f800aa7261 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:36.659633 10414 raft_consensus.cc:515] T 86d8ee5b13404484811b10e05818abc8 P 39666a280cd648579a4ad0f800aa7261 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:36.661325 10414 leader_election.cc:290] T 86d8ee5b13404484811b10e05818abc8 P 39666a280cd648579a4ad0f800aa7261 [CANDIDATE]: Term 2 election: Requested vote from peers 09ec138dff9842f0858adca947bc33fb (127.9.116.65:42825), 62eb0e44cb794e9db922a20fcfb9d606 (127.9.116.67:42127)
I20260709 12:23:36.662271 10341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d8ee5b13404484811b10e05818abc8" candidate_uuid: "39666a280cd648579a4ad0f800aa7261" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "09ec138dff9842f0858adca947bc33fb"
I20260709 12:23:36.662437 10489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d8ee5b13404484811b10e05818abc8" candidate_uuid: "39666a280cd648579a4ad0f800aa7261" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "62eb0e44cb794e9db922a20fcfb9d606"
I20260709 12:23:36.663013 10341 raft_consensus.cc:3060] T 86d8ee5b13404484811b10e05818abc8 P 09ec138dff9842f0858adca947bc33fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:36.663017 10489 raft_consensus.cc:3055] T 86d8ee5b13404484811b10e05818abc8 P 62eb0e44cb794e9db922a20fcfb9d606 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:36.663741 10489 raft_consensus.cc:740] T 86d8ee5b13404484811b10e05818abc8 P 62eb0e44cb794e9db922a20fcfb9d606 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 62eb0e44cb794e9db922a20fcfb9d606, State: Running, Role: LEADER
I20260709 12:23:36.664499 10489 consensus_queue.cc:260] T 86d8ee5b13404484811b10e05818abc8 P 62eb0e44cb794e9db922a20fcfb9d606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:36.665524 10489 raft_consensus.cc:3060] T 86d8ee5b13404484811b10e05818abc8 P 62eb0e44cb794e9db922a20fcfb9d606 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:36.670230 10341 raft_consensus.cc:2468] T 86d8ee5b13404484811b10e05818abc8 P 09ec138dff9842f0858adca947bc33fb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39666a280cd648579a4ad0f800aa7261 in term 2.
I20260709 12:23:36.670399 10489 raft_consensus.cc:2468] T 86d8ee5b13404484811b10e05818abc8 P 62eb0e44cb794e9db922a20fcfb9d606 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39666a280cd648579a4ad0f800aa7261 in term 2.
I20260709 12:23:36.671613 10382 leader_election.cc:304] T 86d8ee5b13404484811b10e05818abc8 P 39666a280cd648579a4ad0f800aa7261 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09ec138dff9842f0858adca947bc33fb, 39666a280cd648579a4ad0f800aa7261; no voters: 
I20260709 12:23:36.672453 10546 raft_consensus.cc:2804] T 86d8ee5b13404484811b10e05818abc8 P 39666a280cd648579a4ad0f800aa7261 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:36.672940 10546 raft_consensus.cc:697] T 86d8ee5b13404484811b10e05818abc8 P 39666a280cd648579a4ad0f800aa7261 [term 2 LEADER]: Becoming Leader. State: Replica: 39666a280cd648579a4ad0f800aa7261, State: Running, Role: LEADER
I20260709 12:23:36.673846 10546 consensus_queue.cc:237] T 86d8ee5b13404484811b10e05818abc8 P 39666a280cd648579a4ad0f800aa7261 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:36.680321 10238 catalog_manager.cc:5697] T 86d8ee5b13404484811b10e05818abc8 P 39666a280cd648579a4ad0f800aa7261 reported cstate change: term changed from 1 to 2, leader changed from 62eb0e44cb794e9db922a20fcfb9d606 (127.9.116.67) to 39666a280cd648579a4ad0f800aa7261 (127.9.116.66). New cstate: current_term: 2 leader_uuid: "39666a280cd648579a4ad0f800aa7261" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:36.700667 10414 raft_consensus.cc:1275] T 57fc852991f54b508ff41067c25fe854 P 39666a280cd648579a4ad0f800aa7261 [term 2 FOLLOWER]: Refusing update from remote peer 09ec138dff9842f0858adca947bc33fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:36.702585 10570 consensus_queue.cc:1048] T 57fc852991f54b508ff41067c25fe854 P 09ec138dff9842f0858adca947bc33fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:36.709321 10341 raft_consensus.cc:1275] T b719323785d84477bf49a3ebbf366f37 P 09ec138dff9842f0858adca947bc33fb [term 2 FOLLOWER]: Refusing update from remote peer 39666a280cd648579a4ad0f800aa7261: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:36.712163 10546 consensus_queue.cc:1048] T b719323785d84477bf49a3ebbf366f37 P 39666a280cd648579a4ad0f800aa7261 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:36.715919 10489 raft_consensus.cc:1275] T 57fc852991f54b508ff41067c25fe854 P 62eb0e44cb794e9db922a20fcfb9d606 [term 2 FOLLOWER]: Refusing update from remote peer 09ec138dff9842f0858adca947bc33fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:36.717701 10570 consensus_queue.cc:1048] T 57fc852991f54b508ff41067c25fe854 P 09ec138dff9842f0858adca947bc33fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:36.727813 10490 raft_consensus.cc:1275] T b719323785d84477bf49a3ebbf366f37 P 62eb0e44cb794e9db922a20fcfb9d606 [term 2 FOLLOWER]: Refusing update from remote peer 39666a280cd648579a4ad0f800aa7261: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:36.731875 10589 consensus_queue.cc:1048] T b719323785d84477bf49a3ebbf366f37 P 39666a280cd648579a4ad0f800aa7261 [LEADER]: Connected to new peer: Peer: permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:36.731009 10490 raft_consensus.cc:1275] T f45d2ff8d4f540878e0ec1058a28f8d5 P 62eb0e44cb794e9db922a20fcfb9d606 [term 2 FOLLOWER]: Refusing update from remote peer 09ec138dff9842f0858adca947bc33fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:36.737536 10489 raft_consensus.cc:1275] T 1763c604c9c84205be8b3bf019a15fa0 P 62eb0e44cb794e9db922a20fcfb9d606 [term 2 FOLLOWER]: Refusing update from remote peer 09ec138dff9842f0858adca947bc33fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:36.737825 10570 consensus_queue.cc:1048] T f45d2ff8d4f540878e0ec1058a28f8d5 P 09ec138dff9842f0858adca947bc33fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:36.739063 10569 consensus_queue.cc:1048] T 1763c604c9c84205be8b3bf019a15fa0 P 09ec138dff9842f0858adca947bc33fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:36.750181 10414 raft_consensus.cc:1275] T 1763c604c9c84205be8b3bf019a15fa0 P 39666a280cd648579a4ad0f800aa7261 [term 2 FOLLOWER]: Refusing update from remote peer 09ec138dff9842f0858adca947bc33fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:36.754468 10569 consensus_queue.cc:1048] T 1763c604c9c84205be8b3bf019a15fa0 P 09ec138dff9842f0858adca947bc33fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:36.754980 10414 raft_consensus.cc:1275] T f45d2ff8d4f540878e0ec1058a28f8d5 P 39666a280cd648579a4ad0f800aa7261 [term 2 FOLLOWER]: Refusing update from remote peer 09ec138dff9842f0858adca947bc33fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:36.756685 10539 consensus_queue.cc:1048] T f45d2ff8d4f540878e0ec1058a28f8d5 P 09ec138dff9842f0858adca947bc33fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:36.811167 10489 raft_consensus.cc:1275] T c8b3a5c008584867bf2282f87acb3cde P 62eb0e44cb794e9db922a20fcfb9d606 [term 2 FOLLOWER]: Refusing update from remote peer 09ec138dff9842f0858adca947bc33fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:36.812768 10539 consensus_queue.cc:1048] T c8b3a5c008584867bf2282f87acb3cde P 09ec138dff9842f0858adca947bc33fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:36.824241 10415 raft_consensus.cc:1275] T c8b3a5c008584867bf2282f87acb3cde P 39666a280cd648579a4ad0f800aa7261 [term 2 FOLLOWER]: Refusing update from remote peer 09ec138dff9842f0858adca947bc33fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:36.826023 10569 consensus_queue.cc:1048] T c8b3a5c008584867bf2282f87acb3cde P 09ec138dff9842f0858adca947bc33fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:36.895345 10341 raft_consensus.cc:1275] T ce98990ba39f44f4b792419973437b1c P 09ec138dff9842f0858adca947bc33fb [term 2 FOLLOWER]: Refusing update from remote peer 62eb0e44cb794e9db922a20fcfb9d606: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:36.897050 10537 consensus_queue.cc:1048] T ce98990ba39f44f4b792419973437b1c P 62eb0e44cb794e9db922a20fcfb9d606 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:36.906083 10415 raft_consensus.cc:1275] T ce98990ba39f44f4b792419973437b1c P 39666a280cd648579a4ad0f800aa7261 [term 2 FOLLOWER]: Refusing update from remote peer 62eb0e44cb794e9db922a20fcfb9d606: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:36.907699 10537 consensus_queue.cc:1048] T ce98990ba39f44f4b792419973437b1c P 62eb0e44cb794e9db922a20fcfb9d606 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:36.972087 10489 raft_consensus.cc:1275] T ddcced512029492fb6903fc4d42abd31 P 62eb0e44cb794e9db922a20fcfb9d606 [term 2 FOLLOWER]: Refusing update from remote peer 39666a280cd648579a4ad0f800aa7261: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:36.973763 10620 consensus_queue.cc:1048] T ddcced512029492fb6903fc4d42abd31 P 39666a280cd648579a4ad0f800aa7261 [LEADER]: Connected to new peer: Peer: permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:36.982713 10341 raft_consensus.cc:1275] T ddcced512029492fb6903fc4d42abd31 P 09ec138dff9842f0858adca947bc33fb [term 2 FOLLOWER]: Refusing update from remote peer 39666a280cd648579a4ad0f800aa7261: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:36.984246 10620 consensus_queue.cc:1048] T ddcced512029492fb6903fc4d42abd31 P 39666a280cd648579a4ad0f800aa7261 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:37.004820 10339 raft_consensus.cc:1275] T b6cc3e80f4f6411b89c21921f2929554 P 09ec138dff9842f0858adca947bc33fb [term 2 FOLLOWER]: Refusing update from remote peer 39666a280cd648579a4ad0f800aa7261: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:37.006780 10625 consensus_queue.cc:1048] T b6cc3e80f4f6411b89c21921f2929554 P 39666a280cd648579a4ad0f800aa7261 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:37.015548 10489 raft_consensus.cc:1275] T b6cc3e80f4f6411b89c21921f2929554 P 62eb0e44cb794e9db922a20fcfb9d606 [term 2 FOLLOWER]: Refusing update from remote peer 39666a280cd648579a4ad0f800aa7261: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:37.017359 10620 consensus_queue.cc:1048] T b6cc3e80f4f6411b89c21921f2929554 P 39666a280cd648579a4ad0f800aa7261 [LEADER]: Connected to new peer: Peer: permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:37.275060 10339 raft_consensus.cc:1275] T 86d8ee5b13404484811b10e05818abc8 P 09ec138dff9842f0858adca947bc33fb [term 2 FOLLOWER]: Refusing update from remote peer 39666a280cd648579a4ad0f800aa7261: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:37.276800 10620 consensus_queue.cc:1048] T 86d8ee5b13404484811b10e05818abc8 P 39666a280cd648579a4ad0f800aa7261 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:37.288715 10489 raft_consensus.cc:1275] T 86d8ee5b13404484811b10e05818abc8 P 62eb0e44cb794e9db922a20fcfb9d606 [term 2 FOLLOWER]: Refusing update from remote peer 39666a280cd648579a4ad0f800aa7261: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:37.290148 10625 consensus_queue.cc:1048] T 86d8ee5b13404484811b10e05818abc8 P 39666a280cd648579a4ad0f800aa7261 [LEADER]: Connected to new peer: Peer: permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:39.268646  9681 auto_leader_rebalancer-test.cc:365] The leader distribution is 
I20260709 12:23:39.269714  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:39.292248 10339 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57fc852991f54b508ff41067c25fe854"
dest_uuid: "09ec138dff9842f0858adca947bc33fb"
mode: GRACEFUL
new_leader_uuid: "62eb0e44cb794e9db922a20fcfb9d606"
 from {username='slave'} at 127.0.0.1:33384
I20260709 12:23:39.292819 10339 raft_consensus.cc:606] T 57fc852991f54b508ff41067c25fe854 P 09ec138dff9842f0858adca947bc33fb [term 2 LEADER]: Received request to transfer leadership to TS 62eb0e44cb794e9db922a20fcfb9d606
I20260709 12:23:39.295902 10339 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c8b3a5c008584867bf2282f87acb3cde"
dest_uuid: "09ec138dff9842f0858adca947bc33fb"
mode: GRACEFUL
new_leader_uuid: "62eb0e44cb794e9db922a20fcfb9d606"
 from {username='slave'} at 127.0.0.1:33384
I20260709 12:23:39.296455 10339 raft_consensus.cc:606] T c8b3a5c008584867bf2282f87acb3cde P 09ec138dff9842f0858adca947bc33fb [term 2 LEADER]: Received request to transfer leadership to TS 62eb0e44cb794e9db922a20fcfb9d606
I20260709 12:23:39.297834  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:23:39.298257  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:39.448336 10539 raft_consensus.cc:993] T c8b3a5c008584867bf2282f87acb3cde P 09ec138dff9842f0858adca947bc33fb: : Instructing follower 62eb0e44cb794e9db922a20fcfb9d606 to start an election
I20260709 12:23:39.449011 10629 raft_consensus.cc:1081] T c8b3a5c008584867bf2282f87acb3cde P 09ec138dff9842f0858adca947bc33fb [term 2 LEADER]: Signalling peer 62eb0e44cb794e9db922a20fcfb9d606 to start an election
I20260709 12:23:39.451283 10489 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c8b3a5c008584867bf2282f87acb3cde"
dest_uuid: "62eb0e44cb794e9db922a20fcfb9d606"
 from {username='slave'} at 127.0.0.1:56108
I20260709 12:23:39.451902 10489 raft_consensus.cc:493] T c8b3a5c008584867bf2282f87acb3cde P 62eb0e44cb794e9db922a20fcfb9d606 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:39.452172 10489 raft_consensus.cc:3060] T c8b3a5c008584867bf2282f87acb3cde P 62eb0e44cb794e9db922a20fcfb9d606 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:39.457365 10489 raft_consensus.cc:515] T c8b3a5c008584867bf2282f87acb3cde P 62eb0e44cb794e9db922a20fcfb9d606 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:39.458954 10489 leader_election.cc:290] T c8b3a5c008584867bf2282f87acb3cde P 62eb0e44cb794e9db922a20fcfb9d606 [CANDIDATE]: Term 3 election: Requested vote from peers 09ec138dff9842f0858adca947bc33fb (127.9.116.65:42825), 39666a280cd648579a4ad0f800aa7261 (127.9.116.66:43111)
I20260709 12:23:39.460302 10339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8b3a5c008584867bf2282f87acb3cde" candidate_uuid: "62eb0e44cb794e9db922a20fcfb9d606" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "09ec138dff9842f0858adca947bc33fb"
I20260709 12:23:39.460492 10415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8b3a5c008584867bf2282f87acb3cde" candidate_uuid: "62eb0e44cb794e9db922a20fcfb9d606" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "39666a280cd648579a4ad0f800aa7261"
I20260709 12:23:39.461002 10339 raft_consensus.cc:3055] T c8b3a5c008584867bf2282f87acb3cde P 09ec138dff9842f0858adca947bc33fb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:39.461115 10415 raft_consensus.cc:3060] T c8b3a5c008584867bf2282f87acb3cde P 39666a280cd648579a4ad0f800aa7261 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:39.461526 10339 raft_consensus.cc:740] T c8b3a5c008584867bf2282f87acb3cde P 09ec138dff9842f0858adca947bc33fb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 09ec138dff9842f0858adca947bc33fb, State: Running, Role: LEADER
I20260709 12:23:39.462430 10339 consensus_queue.cc:260] T c8b3a5c008584867bf2282f87acb3cde P 09ec138dff9842f0858adca947bc33fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:39.463445 10339 raft_consensus.cc:3060] T c8b3a5c008584867bf2282f87acb3cde P 09ec138dff9842f0858adca947bc33fb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:39.467255 10415 raft_consensus.cc:2468] T c8b3a5c008584867bf2282f87acb3cde P 39666a280cd648579a4ad0f800aa7261 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62eb0e44cb794e9db922a20fcfb9d606 in term 3.
I20260709 12:23:39.468647 10456 leader_election.cc:304] T c8b3a5c008584867bf2282f87acb3cde P 62eb0e44cb794e9db922a20fcfb9d606 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39666a280cd648579a4ad0f800aa7261, 62eb0e44cb794e9db922a20fcfb9d606; no voters: 
I20260709 12:23:39.469499 10628 raft_consensus.cc:2804] T c8b3a5c008584867bf2282f87acb3cde P 62eb0e44cb794e9db922a20fcfb9d606 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:39.469745 10339 raft_consensus.cc:2468] T c8b3a5c008584867bf2282f87acb3cde P 09ec138dff9842f0858adca947bc33fb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62eb0e44cb794e9db922a20fcfb9d606 in term 3.
I20260709 12:23:39.470597 10628 raft_consensus.cc:697] T c8b3a5c008584867bf2282f87acb3cde P 62eb0e44cb794e9db922a20fcfb9d606 [term 3 LEADER]: Becoming Leader. State: Replica: 62eb0e44cb794e9db922a20fcfb9d606, State: Running, Role: LEADER
I20260709 12:23:39.471455 10628 consensus_queue.cc:237] T c8b3a5c008584867bf2282f87acb3cde P 62eb0e44cb794e9db922a20fcfb9d606 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:39.480583 10238 catalog_manager.cc:5697] T c8b3a5c008584867bf2282f87acb3cde P 62eb0e44cb794e9db922a20fcfb9d606 reported cstate change: term changed from 2 to 3, leader changed from 09ec138dff9842f0858adca947bc33fb (127.9.116.65) to 62eb0e44cb794e9db922a20fcfb9d606 (127.9.116.67). New cstate: current_term: 3 leader_uuid: "62eb0e44cb794e9db922a20fcfb9d606" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:39.489916 10539 raft_consensus.cc:993] T 57fc852991f54b508ff41067c25fe854 P 09ec138dff9842f0858adca947bc33fb: : Instructing follower 62eb0e44cb794e9db922a20fcfb9d606 to start an election
I20260709 12:23:39.490561 10629 raft_consensus.cc:1081] T 57fc852991f54b508ff41067c25fe854 P 09ec138dff9842f0858adca947bc33fb [term 2 LEADER]: Signalling peer 62eb0e44cb794e9db922a20fcfb9d606 to start an election
I20260709 12:23:39.492892 10489 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "57fc852991f54b508ff41067c25fe854"
dest_uuid: "62eb0e44cb794e9db922a20fcfb9d606"
 from {username='slave'} at 127.0.0.1:56108
I20260709 12:23:39.493450 10489 raft_consensus.cc:493] T 57fc852991f54b508ff41067c25fe854 P 62eb0e44cb794e9db922a20fcfb9d606 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:39.493750 10489 raft_consensus.cc:3060] T 57fc852991f54b508ff41067c25fe854 P 62eb0e44cb794e9db922a20fcfb9d606 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:39.500265 10489 raft_consensus.cc:515] T 57fc852991f54b508ff41067c25fe854 P 62eb0e44cb794e9db922a20fcfb9d606 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:39.502218 10489 leader_election.cc:290] T 57fc852991f54b508ff41067c25fe854 P 62eb0e44cb794e9db922a20fcfb9d606 [CANDIDATE]: Term 3 election: Requested vote from peers 09ec138dff9842f0858adca947bc33fb (127.9.116.65:42825), 39666a280cd648579a4ad0f800aa7261 (127.9.116.66:43111)
I20260709 12:23:39.503459 10339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fc852991f54b508ff41067c25fe854" candidate_uuid: "62eb0e44cb794e9db922a20fcfb9d606" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "09ec138dff9842f0858adca947bc33fb"
I20260709 12:23:39.503579 10415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fc852991f54b508ff41067c25fe854" candidate_uuid: "62eb0e44cb794e9db922a20fcfb9d606" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "39666a280cd648579a4ad0f800aa7261"
I20260709 12:23:39.504491 10415 raft_consensus.cc:3060] T 57fc852991f54b508ff41067c25fe854 P 39666a280cd648579a4ad0f800aa7261 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:39.504487 10339 raft_consensus.cc:3055] T 57fc852991f54b508ff41067c25fe854 P 09ec138dff9842f0858adca947bc33fb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:39.511808 10339 raft_consensus.cc:740] T 57fc852991f54b508ff41067c25fe854 P 09ec138dff9842f0858adca947bc33fb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 09ec138dff9842f0858adca947bc33fb, State: Running, Role: LEADER
I20260709 12:23:39.511971 10415 raft_consensus.cc:2468] T 57fc852991f54b508ff41067c25fe854 P 39666a280cd648579a4ad0f800aa7261 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62eb0e44cb794e9db922a20fcfb9d606 in term 3.
I20260709 12:23:39.512754 10339 consensus_queue.cc:260] T 57fc852991f54b508ff41067c25fe854 P 09ec138dff9842f0858adca947bc33fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:39.513159 10456 leader_election.cc:304] T 57fc852991f54b508ff41067c25fe854 P 62eb0e44cb794e9db922a20fcfb9d606 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39666a280cd648579a4ad0f800aa7261, 62eb0e44cb794e9db922a20fcfb9d606; no voters: 
I20260709 12:23:39.514189 10628 raft_consensus.cc:2804] T 57fc852991f54b508ff41067c25fe854 P 62eb0e44cb794e9db922a20fcfb9d606 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:39.514243 10339 raft_consensus.cc:3060] T 57fc852991f54b508ff41067c25fe854 P 09ec138dff9842f0858adca947bc33fb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:39.514679 10628 raft_consensus.cc:697] T 57fc852991f54b508ff41067c25fe854 P 62eb0e44cb794e9db922a20fcfb9d606 [term 3 LEADER]: Becoming Leader. State: Replica: 62eb0e44cb794e9db922a20fcfb9d606, State: Running, Role: LEADER
I20260709 12:23:39.515439 10628 consensus_queue.cc:237] T 57fc852991f54b508ff41067c25fe854 P 62eb0e44cb794e9db922a20fcfb9d606 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:39.520057 10339 raft_consensus.cc:2468] T 57fc852991f54b508ff41067c25fe854 P 09ec138dff9842f0858adca947bc33fb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62eb0e44cb794e9db922a20fcfb9d606 in term 3.
I20260709 12:23:39.523111 10238 catalog_manager.cc:5697] T 57fc852991f54b508ff41067c25fe854 P 62eb0e44cb794e9db922a20fcfb9d606 reported cstate change: term changed from 2 to 3, leader changed from 09ec138dff9842f0858adca947bc33fb (127.9.116.65) to 62eb0e44cb794e9db922a20fcfb9d606 (127.9.116.67). New cstate: current_term: 3 leader_uuid: "62eb0e44cb794e9db922a20fcfb9d606" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:39.974015 10415 raft_consensus.cc:1275] T 57fc852991f54b508ff41067c25fe854 P 39666a280cd648579a4ad0f800aa7261 [term 3 FOLLOWER]: Refusing update from remote peer 62eb0e44cb794e9db922a20fcfb9d606: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:39.976261 10628 consensus_queue.cc:1048] T 57fc852991f54b508ff41067c25fe854 P 62eb0e44cb794e9db922a20fcfb9d606 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:39.989579 10339 raft_consensus.cc:1275] T c8b3a5c008584867bf2282f87acb3cde P 09ec138dff9842f0858adca947bc33fb [term 3 FOLLOWER]: Refusing update from remote peer 62eb0e44cb794e9db922a20fcfb9d606: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:39.989755 10341 raft_consensus.cc:1275] T 57fc852991f54b508ff41067c25fe854 P 09ec138dff9842f0858adca947bc33fb [term 3 FOLLOWER]: Refusing update from remote peer 62eb0e44cb794e9db922a20fcfb9d606: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:39.991885 10641 consensus_queue.cc:1048] T 57fc852991f54b508ff41067c25fe854 P 62eb0e44cb794e9db922a20fcfb9d606 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:39.992043 10632 consensus_queue.cc:1048] T c8b3a5c008584867bf2282f87acb3cde P 62eb0e44cb794e9db922a20fcfb9d606 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:40.014707 10415 raft_consensus.cc:1275] T c8b3a5c008584867bf2282f87acb3cde P 39666a280cd648579a4ad0f800aa7261 [term 3 FOLLOWER]: Refusing update from remote peer 62eb0e44cb794e9db922a20fcfb9d606: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:40.017690 10641 consensus_queue.cc:1048] T c8b3a5c008584867bf2282f87acb3cde P 62eb0e44cb794e9db922a20fcfb9d606 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:40.299278  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:40.306228  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:40.306789  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:41.308095  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:41.315701  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:41.316133  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:42.317239  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:42.324429  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:42.324962  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:43.326435  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:43.332468  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:43.332916  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:44.334035  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:44.342808  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:44.343343  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:45.344548  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:45.351713  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:45.352298  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:46.353643  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:46.360718  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:46.361515  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:47.362963  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:47.369933  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:47.370373  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:48.371467  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:48.378206  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:48.378698  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:49.419075  9681 auto_leader_rebalancer-test.cc:384] The leader distribution is 
I20260709 12:23:49.436517 10488 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c8b3a5c008584867bf2282f87acb3cde"
dest_uuid: "62eb0e44cb794e9db922a20fcfb9d606"
mode: GRACEFUL
new_leader_uuid: "09ec138dff9842f0858adca947bc33fb"
 from {username='slave'} at 127.0.0.1:56122
I20260709 12:23:49.437361 10488 raft_consensus.cc:606] T c8b3a5c008584867bf2282f87acb3cde P 62eb0e44cb794e9db922a20fcfb9d606 [term 3 LEADER]: Received request to transfer leadership to TS 09ec138dff9842f0858adca947bc33fb
I20260709 12:23:49.444329 10488 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57fc852991f54b508ff41067c25fe854"
dest_uuid: "62eb0e44cb794e9db922a20fcfb9d606"
mode: GRACEFUL
new_leader_uuid: "09ec138dff9842f0858adca947bc33fb"
 from {username='slave'} at 127.0.0.1:56122
I20260709 12:23:49.444856 10488 raft_consensus.cc:606] T 57fc852991f54b508ff41067c25fe854 P 62eb0e44cb794e9db922a20fcfb9d606 [term 3 LEADER]: Received request to transfer leadership to TS 09ec138dff9842f0858adca947bc33fb
I20260709 12:23:49.450853 10414 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b719323785d84477bf49a3ebbf366f37"
dest_uuid: "39666a280cd648579a4ad0f800aa7261"
mode: GRACEFUL
new_leader_uuid: "09ec138dff9842f0858adca947bc33fb"
 from {username='slave'} at 127.0.0.1:35202
I20260709 12:23:49.451762 10414 raft_consensus.cc:606] T b719323785d84477bf49a3ebbf366f37 P 39666a280cd648579a4ad0f800aa7261 [term 2 LEADER]: Received request to transfer leadership to TS 09ec138dff9842f0858adca947bc33fb
I20260709 12:23:49.457727 10414 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ddcced512029492fb6903fc4d42abd31"
dest_uuid: "39666a280cd648579a4ad0f800aa7261"
mode: GRACEFUL
new_leader_uuid: "09ec138dff9842f0858adca947bc33fb"
 from {username='slave'} at 127.0.0.1:35202
I20260709 12:23:49.458297 10414 raft_consensus.cc:606] T ddcced512029492fb6903fc4d42abd31 P 39666a280cd648579a4ad0f800aa7261 [term 2 LEADER]: Received request to transfer leadership to TS 09ec138dff9842f0858adca947bc33fb
I20260709 12:23:49.464272 10414 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "86d8ee5b13404484811b10e05818abc8"
dest_uuid: "39666a280cd648579a4ad0f800aa7261"
mode: GRACEFUL
new_leader_uuid: "09ec138dff9842f0858adca947bc33fb"
 from {username='slave'} at 127.0.0.1:35202
I20260709 12:23:49.464977 10414 raft_consensus.cc:606] T 86d8ee5b13404484811b10e05818abc8 P 39666a280cd648579a4ad0f800aa7261 [term 2 LEADER]: Received request to transfer leadership to TS 09ec138dff9842f0858adca947bc33fb
I20260709 12:23:49.644224 10658 raft_consensus.cc:993] T 57fc852991f54b508ff41067c25fe854 P 62eb0e44cb794e9db922a20fcfb9d606: : Instructing follower 09ec138dff9842f0858adca947bc33fb to start an election
I20260709 12:23:49.644914 10660 raft_consensus.cc:1081] T 57fc852991f54b508ff41067c25fe854 P 62eb0e44cb794e9db922a20fcfb9d606 [term 3 LEADER]: Signalling peer 09ec138dff9842f0858adca947bc33fb to start an election
I20260709 12:23:49.646880 10339 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "57fc852991f54b508ff41067c25fe854"
dest_uuid: "09ec138dff9842f0858adca947bc33fb"
 from {username='slave'} at 127.0.0.1:44166
I20260709 12:23:49.647444 10339 raft_consensus.cc:493] T 57fc852991f54b508ff41067c25fe854 P 09ec138dff9842f0858adca947bc33fb [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:49.647825 10339 raft_consensus.cc:3060] T 57fc852991f54b508ff41067c25fe854 P 09ec138dff9842f0858adca947bc33fb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:49.653579 10339 raft_consensus.cc:515] T 57fc852991f54b508ff41067c25fe854 P 09ec138dff9842f0858adca947bc33fb [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:49.656279 10339 leader_election.cc:290] T 57fc852991f54b508ff41067c25fe854 P 09ec138dff9842f0858adca947bc33fb [CANDIDATE]: Term 4 election: Requested vote from peers 39666a280cd648579a4ad0f800aa7261 (127.9.116.66:43111), 62eb0e44cb794e9db922a20fcfb9d606 (127.9.116.67:42127)
I20260709 12:23:49.657356 10488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fc852991f54b508ff41067c25fe854" candidate_uuid: "09ec138dff9842f0858adca947bc33fb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "62eb0e44cb794e9db922a20fcfb9d606"
I20260709 12:23:49.657356 10414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fc852991f54b508ff41067c25fe854" candidate_uuid: "09ec138dff9842f0858adca947bc33fb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "39666a280cd648579a4ad0f800aa7261"
I20260709 12:23:49.658313 10488 raft_consensus.cc:3055] T 57fc852991f54b508ff41067c25fe854 P 62eb0e44cb794e9db922a20fcfb9d606 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:49.658416 10414 raft_consensus.cc:3060] T 57fc852991f54b508ff41067c25fe854 P 39666a280cd648579a4ad0f800aa7261 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:49.658603 10488 raft_consensus.cc:740] T 57fc852991f54b508ff41067c25fe854 P 62eb0e44cb794e9db922a20fcfb9d606 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 62eb0e44cb794e9db922a20fcfb9d606, State: Running, Role: LEADER
I20260709 12:23:49.659420 10488 consensus_queue.cc:260] T 57fc852991f54b508ff41067c25fe854 P 62eb0e44cb794e9db922a20fcfb9d606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:49.660584 10488 raft_consensus.cc:3060] T 57fc852991f54b508ff41067c25fe854 P 62eb0e44cb794e9db922a20fcfb9d606 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:49.665442 10414 raft_consensus.cc:2468] T 57fc852991f54b508ff41067c25fe854 P 39666a280cd648579a4ad0f800aa7261 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09ec138dff9842f0858adca947bc33fb in term 4.
I20260709 12:23:49.667399 10307 leader_election.cc:304] T 57fc852991f54b508ff41067c25fe854 P 09ec138dff9842f0858adca947bc33fb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09ec138dff9842f0858adca947bc33fb, 39666a280cd648579a4ad0f800aa7261; no voters: 
I20260709 12:23:49.667716 10488 raft_consensus.cc:2468] T 57fc852991f54b508ff41067c25fe854 P 62eb0e44cb794e9db922a20fcfb9d606 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09ec138dff9842f0858adca947bc33fb in term 4.
I20260709 12:23:49.668519 10647 raft_consensus.cc:2804] T 57fc852991f54b508ff41067c25fe854 P 09ec138dff9842f0858adca947bc33fb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:49.669483 10647 raft_consensus.cc:697] T 57fc852991f54b508ff41067c25fe854 P 09ec138dff9842f0858adca947bc33fb [term 4 LEADER]: Becoming Leader. State: Replica: 09ec138dff9842f0858adca947bc33fb, State: Running, Role: LEADER
I20260709 12:23:49.670246 10647 consensus_queue.cc:237] T 57fc852991f54b508ff41067c25fe854 P 09ec138dff9842f0858adca947bc33fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:49.679138 10239 catalog_manager.cc:5697] T 57fc852991f54b508ff41067c25fe854 P 09ec138dff9842f0858adca947bc33fb reported cstate change: term changed from 3 to 4, leader changed from 62eb0e44cb794e9db922a20fcfb9d606 (127.9.116.67) to 09ec138dff9842f0858adca947bc33fb (127.9.116.65). New cstate: current_term: 4 leader_uuid: "09ec138dff9842f0858adca947bc33fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:49.760089 10658 raft_consensus.cc:993] T c8b3a5c008584867bf2282f87acb3cde P 62eb0e44cb794e9db922a20fcfb9d606: : Instructing follower 09ec138dff9842f0858adca947bc33fb to start an election
I20260709 12:23:49.760614 10658 raft_consensus.cc:1081] T c8b3a5c008584867bf2282f87acb3cde P 62eb0e44cb794e9db922a20fcfb9d606 [term 3 LEADER]: Signalling peer 09ec138dff9842f0858adca947bc33fb to start an election
I20260709 12:23:49.762213 10339 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c8b3a5c008584867bf2282f87acb3cde"
dest_uuid: "09ec138dff9842f0858adca947bc33fb"
 from {username='slave'} at 127.0.0.1:44166
I20260709 12:23:49.762669 10339 raft_consensus.cc:493] T c8b3a5c008584867bf2282f87acb3cde P 09ec138dff9842f0858adca947bc33fb [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:49.762952 10339 raft_consensus.cc:3060] T c8b3a5c008584867bf2282f87acb3cde P 09ec138dff9842f0858adca947bc33fb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:49.767740 10339 raft_consensus.cc:515] T c8b3a5c008584867bf2282f87acb3cde P 09ec138dff9842f0858adca947bc33fb [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:49.769503 10339 leader_election.cc:290] T c8b3a5c008584867bf2282f87acb3cde P 09ec138dff9842f0858adca947bc33fb [CANDIDATE]: Term 4 election: Requested vote from peers 39666a280cd648579a4ad0f800aa7261 (127.9.116.66:43111), 62eb0e44cb794e9db922a20fcfb9d606 (127.9.116.67:42127)
I20260709 12:23:49.770639 10414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8b3a5c008584867bf2282f87acb3cde" candidate_uuid: "09ec138dff9842f0858adca947bc33fb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "39666a280cd648579a4ad0f800aa7261"
I20260709 12:23:49.770721 10488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8b3a5c008584867bf2282f87acb3cde" candidate_uuid: "09ec138dff9842f0858adca947bc33fb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "62eb0e44cb794e9db922a20fcfb9d606"
I20260709 12:23:49.771461 10414 raft_consensus.cc:3060] T c8b3a5c008584867bf2282f87acb3cde P 39666a280cd648579a4ad0f800aa7261 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:49.771504 10488 raft_consensus.cc:3055] T c8b3a5c008584867bf2282f87acb3cde P 62eb0e44cb794e9db922a20fcfb9d606 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:49.772044 10488 raft_consensus.cc:740] T c8b3a5c008584867bf2282f87acb3cde P 62eb0e44cb794e9db922a20fcfb9d606 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 62eb0e44cb794e9db922a20fcfb9d606, State: Running, Role: LEADER
I20260709 12:23:49.772913 10488 consensus_queue.cc:260] T c8b3a5c008584867bf2282f87acb3cde P 62eb0e44cb794e9db922a20fcfb9d606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:49.774122 10488 raft_consensus.cc:3060] T c8b3a5c008584867bf2282f87acb3cde P 62eb0e44cb794e9db922a20fcfb9d606 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:49.778590 10414 raft_consensus.cc:2468] T c8b3a5c008584867bf2282f87acb3cde P 39666a280cd648579a4ad0f800aa7261 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09ec138dff9842f0858adca947bc33fb in term 4.
I20260709 12:23:49.780196 10307 leader_election.cc:304] T c8b3a5c008584867bf2282f87acb3cde P 09ec138dff9842f0858adca947bc33fb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09ec138dff9842f0858adca947bc33fb, 39666a280cd648579a4ad0f800aa7261; no voters: 
I20260709 12:23:49.781240 10647 raft_consensus.cc:2804] T c8b3a5c008584867bf2282f87acb3cde P 09ec138dff9842f0858adca947bc33fb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:49.781728 10647 raft_consensus.cc:697] T c8b3a5c008584867bf2282f87acb3cde P 09ec138dff9842f0858adca947bc33fb [term 4 LEADER]: Becoming Leader. State: Replica: 09ec138dff9842f0858adca947bc33fb, State: Running, Role: LEADER
I20260709 12:23:49.781525 10488 raft_consensus.cc:2468] T c8b3a5c008584867bf2282f87acb3cde P 62eb0e44cb794e9db922a20fcfb9d606 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09ec138dff9842f0858adca947bc33fb in term 4.
I20260709 12:23:49.782660 10647 consensus_queue.cc:237] T c8b3a5c008584867bf2282f87acb3cde P 09ec138dff9842f0858adca947bc33fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:49.789417 10239 catalog_manager.cc:5697] T c8b3a5c008584867bf2282f87acb3cde P 09ec138dff9842f0858adca947bc33fb reported cstate change: term changed from 3 to 4, leader changed from 62eb0e44cb794e9db922a20fcfb9d606 (127.9.116.67) to 09ec138dff9842f0858adca947bc33fb (127.9.116.65). New cstate: current_term: 4 leader_uuid: "09ec138dff9842f0858adca947bc33fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:49.844483 10667 raft_consensus.cc:993] T ddcced512029492fb6903fc4d42abd31 P 39666a280cd648579a4ad0f800aa7261: : Instructing follower 09ec138dff9842f0858adca947bc33fb to start an election
I20260709 12:23:49.845075 10654 raft_consensus.cc:1081] T ddcced512029492fb6903fc4d42abd31 P 39666a280cd648579a4ad0f800aa7261 [term 2 LEADER]: Signalling peer 09ec138dff9842f0858adca947bc33fb to start an election
I20260709 12:23:49.847172 10339 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ddcced512029492fb6903fc4d42abd31"
dest_uuid: "09ec138dff9842f0858adca947bc33fb"
 from {username='slave'} at 127.0.0.1:44156
I20260709 12:23:49.847882 10339 raft_consensus.cc:493] T ddcced512029492fb6903fc4d42abd31 P 09ec138dff9842f0858adca947bc33fb [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:49.848272 10339 raft_consensus.cc:3060] T ddcced512029492fb6903fc4d42abd31 P 09ec138dff9842f0858adca947bc33fb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:49.854292 10339 raft_consensus.cc:515] T ddcced512029492fb6903fc4d42abd31 P 09ec138dff9842f0858adca947bc33fb [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:49.856696 10339 leader_election.cc:290] T ddcced512029492fb6903fc4d42abd31 P 09ec138dff9842f0858adca947bc33fb [CANDIDATE]: Term 3 election: Requested vote from peers 39666a280cd648579a4ad0f800aa7261 (127.9.116.66:43111), 62eb0e44cb794e9db922a20fcfb9d606 (127.9.116.67:42127)
I20260709 12:23:49.858207 10488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcced512029492fb6903fc4d42abd31" candidate_uuid: "09ec138dff9842f0858adca947bc33fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "62eb0e44cb794e9db922a20fcfb9d606"
I20260709 12:23:49.858376 10414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcced512029492fb6903fc4d42abd31" candidate_uuid: "09ec138dff9842f0858adca947bc33fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "39666a280cd648579a4ad0f800aa7261"
I20260709 12:23:49.859176 10488 raft_consensus.cc:3060] T ddcced512029492fb6903fc4d42abd31 P 62eb0e44cb794e9db922a20fcfb9d606 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:49.859135 10414 raft_consensus.cc:3055] T ddcced512029492fb6903fc4d42abd31 P 39666a280cd648579a4ad0f800aa7261 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:49.860110 10414 raft_consensus.cc:740] T ddcced512029492fb6903fc4d42abd31 P 39666a280cd648579a4ad0f800aa7261 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 39666a280cd648579a4ad0f800aa7261, State: Running, Role: LEADER
I20260709 12:23:49.861486 10414 consensus_queue.cc:260] T ddcced512029492fb6903fc4d42abd31 P 39666a280cd648579a4ad0f800aa7261 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:49.863101 10414 raft_consensus.cc:3060] T ddcced512029492fb6903fc4d42abd31 P 39666a280cd648579a4ad0f800aa7261 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:49.869213 10488 raft_consensus.cc:2468] T ddcced512029492fb6903fc4d42abd31 P 62eb0e44cb794e9db922a20fcfb9d606 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09ec138dff9842f0858adca947bc33fb in term 3.
I20260709 12:23:49.870617 10304 leader_election.cc:304] T ddcced512029492fb6903fc4d42abd31 P 09ec138dff9842f0858adca947bc33fb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09ec138dff9842f0858adca947bc33fb, 62eb0e44cb794e9db922a20fcfb9d606; no voters: 
I20260709 12:23:49.871629 10647 raft_consensus.cc:2804] T ddcced512029492fb6903fc4d42abd31 P 09ec138dff9842f0858adca947bc33fb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:49.871728 10414 raft_consensus.cc:2468] T ddcced512029492fb6903fc4d42abd31 P 39666a280cd648579a4ad0f800aa7261 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09ec138dff9842f0858adca947bc33fb in term 3.
I20260709 12:23:49.872449 10647 raft_consensus.cc:697] T ddcced512029492fb6903fc4d42abd31 P 09ec138dff9842f0858adca947bc33fb [term 3 LEADER]: Becoming Leader. State: Replica: 09ec138dff9842f0858adca947bc33fb, State: Running, Role: LEADER
I20260709 12:23:49.873211 10647 consensus_queue.cc:237] T ddcced512029492fb6903fc4d42abd31 P 09ec138dff9842f0858adca947bc33fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:49.881438 10667 raft_consensus.cc:993] T b719323785d84477bf49a3ebbf366f37 P 39666a280cd648579a4ad0f800aa7261: : Instructing follower 09ec138dff9842f0858adca947bc33fb to start an election
I20260709 12:23:49.881928 10654 raft_consensus.cc:1081] T b719323785d84477bf49a3ebbf366f37 P 39666a280cd648579a4ad0f800aa7261 [term 2 LEADER]: Signalling peer 09ec138dff9842f0858adca947bc33fb to start an election
I20260709 12:23:49.883621 10339 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b719323785d84477bf49a3ebbf366f37"
dest_uuid: "09ec138dff9842f0858adca947bc33fb"
 from {username='slave'} at 127.0.0.1:44156
I20260709 12:23:49.884238 10339 raft_consensus.cc:493] T b719323785d84477bf49a3ebbf366f37 P 09ec138dff9842f0858adca947bc33fb [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:49.884622 10339 raft_consensus.cc:3060] T b719323785d84477bf49a3ebbf366f37 P 09ec138dff9842f0858adca947bc33fb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:49.885763 10239 catalog_manager.cc:5697] T ddcced512029492fb6903fc4d42abd31 P 09ec138dff9842f0858adca947bc33fb reported cstate change: term changed from 2 to 3, leader changed from 39666a280cd648579a4ad0f800aa7261 (127.9.116.66) to 09ec138dff9842f0858adca947bc33fb (127.9.116.65). New cstate: current_term: 3 leader_uuid: "09ec138dff9842f0858adca947bc33fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:49.891448 10339 raft_consensus.cc:515] T b719323785d84477bf49a3ebbf366f37 P 09ec138dff9842f0858adca947bc33fb [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:49.893572 10339 leader_election.cc:290] T b719323785d84477bf49a3ebbf366f37 P 09ec138dff9842f0858adca947bc33fb [CANDIDATE]: Term 3 election: Requested vote from peers 39666a280cd648579a4ad0f800aa7261 (127.9.116.66:43111), 62eb0e44cb794e9db922a20fcfb9d606 (127.9.116.67:42127)
I20260709 12:23:49.894560 10414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719323785d84477bf49a3ebbf366f37" candidate_uuid: "09ec138dff9842f0858adca947bc33fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "39666a280cd648579a4ad0f800aa7261"
I20260709 12:23:49.895033 10488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719323785d84477bf49a3ebbf366f37" candidate_uuid: "09ec138dff9842f0858adca947bc33fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "62eb0e44cb794e9db922a20fcfb9d606"
I20260709 12:23:49.895215 10414 raft_consensus.cc:3055] T b719323785d84477bf49a3ebbf366f37 P 39666a280cd648579a4ad0f800aa7261 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:49.895643 10488 raft_consensus.cc:3060] T b719323785d84477bf49a3ebbf366f37 P 62eb0e44cb794e9db922a20fcfb9d606 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:49.895637 10414 raft_consensus.cc:740] T b719323785d84477bf49a3ebbf366f37 P 39666a280cd648579a4ad0f800aa7261 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 39666a280cd648579a4ad0f800aa7261, State: Running, Role: LEADER
I20260709 12:23:49.898530 10414 consensus_queue.cc:260] T b719323785d84477bf49a3ebbf366f37 P 39666a280cd648579a4ad0f800aa7261 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:49.899787 10414 raft_consensus.cc:3060] T b719323785d84477bf49a3ebbf366f37 P 39666a280cd648579a4ad0f800aa7261 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:49.904043 10488 raft_consensus.cc:2468] T b719323785d84477bf49a3ebbf366f37 P 62eb0e44cb794e9db922a20fcfb9d606 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09ec138dff9842f0858adca947bc33fb in term 3.
I20260709 12:23:49.905606 10304 leader_election.cc:304] T b719323785d84477bf49a3ebbf366f37 P 09ec138dff9842f0858adca947bc33fb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09ec138dff9842f0858adca947bc33fb, 62eb0e44cb794e9db922a20fcfb9d606; no voters: 
I20260709 12:23:49.906627 10647 raft_consensus.cc:2804] T b719323785d84477bf49a3ebbf366f37 P 09ec138dff9842f0858adca947bc33fb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:49.907217 10647 raft_consensus.cc:697] T b719323785d84477bf49a3ebbf366f37 P 09ec138dff9842f0858adca947bc33fb [term 3 LEADER]: Becoming Leader. State: Replica: 09ec138dff9842f0858adca947bc33fb, State: Running, Role: LEADER
I20260709 12:23:49.908298 10647 consensus_queue.cc:237] T b719323785d84477bf49a3ebbf366f37 P 09ec138dff9842f0858adca947bc33fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:49.909410 10414 raft_consensus.cc:2468] T b719323785d84477bf49a3ebbf366f37 P 39666a280cd648579a4ad0f800aa7261 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09ec138dff9842f0858adca947bc33fb in term 3.
I20260709 12:23:49.919616 10239 catalog_manager.cc:5697] T b719323785d84477bf49a3ebbf366f37 P 09ec138dff9842f0858adca947bc33fb reported cstate change: term changed from 2 to 3, leader changed from 39666a280cd648579a4ad0f800aa7261 (127.9.116.66) to 09ec138dff9842f0858adca947bc33fb (127.9.116.65). New cstate: current_term: 3 leader_uuid: "09ec138dff9842f0858adca947bc33fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:49.979669 10667 raft_consensus.cc:993] T 86d8ee5b13404484811b10e05818abc8 P 39666a280cd648579a4ad0f800aa7261: : Instructing follower 09ec138dff9842f0858adca947bc33fb to start an election
I20260709 12:23:49.980156 10654 raft_consensus.cc:1081] T 86d8ee5b13404484811b10e05818abc8 P 39666a280cd648579a4ad0f800aa7261 [term 2 LEADER]: Signalling peer 09ec138dff9842f0858adca947bc33fb to start an election
I20260709 12:23:49.981918 10339 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "86d8ee5b13404484811b10e05818abc8"
dest_uuid: "09ec138dff9842f0858adca947bc33fb"
 from {username='slave'} at 127.0.0.1:44156
I20260709 12:23:49.982381 10339 raft_consensus.cc:493] T 86d8ee5b13404484811b10e05818abc8 P 09ec138dff9842f0858adca947bc33fb [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:49.982625 10339 raft_consensus.cc:3060] T 86d8ee5b13404484811b10e05818abc8 P 09ec138dff9842f0858adca947bc33fb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:49.987425 10339 raft_consensus.cc:515] T 86d8ee5b13404484811b10e05818abc8 P 09ec138dff9842f0858adca947bc33fb [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:49.989630 10339 leader_election.cc:290] T 86d8ee5b13404484811b10e05818abc8 P 09ec138dff9842f0858adca947bc33fb [CANDIDATE]: Term 3 election: Requested vote from peers 39666a280cd648579a4ad0f800aa7261 (127.9.116.66:43111), 62eb0e44cb794e9db922a20fcfb9d606 (127.9.116.67:42127)
I20260709 12:23:49.990530 10414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d8ee5b13404484811b10e05818abc8" candidate_uuid: "09ec138dff9842f0858adca947bc33fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "39666a280cd648579a4ad0f800aa7261"
I20260709 12:23:49.990677 10488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d8ee5b13404484811b10e05818abc8" candidate_uuid: "09ec138dff9842f0858adca947bc33fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "62eb0e44cb794e9db922a20fcfb9d606"
I20260709 12:23:49.991114 10414 raft_consensus.cc:3055] T 86d8ee5b13404484811b10e05818abc8 P 39666a280cd648579a4ad0f800aa7261 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:49.991217 10488 raft_consensus.cc:3060] T 86d8ee5b13404484811b10e05818abc8 P 62eb0e44cb794e9db922a20fcfb9d606 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:49.991413 10414 raft_consensus.cc:740] T 86d8ee5b13404484811b10e05818abc8 P 39666a280cd648579a4ad0f800aa7261 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 39666a280cd648579a4ad0f800aa7261, State: Running, Role: LEADER
I20260709 12:23:49.992233 10414 consensus_queue.cc:260] T 86d8ee5b13404484811b10e05818abc8 P 39666a280cd648579a4ad0f800aa7261 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:49.993116 10414 raft_consensus.cc:3060] T 86d8ee5b13404484811b10e05818abc8 P 39666a280cd648579a4ad0f800aa7261 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:49.996640 10488 raft_consensus.cc:2468] T 86d8ee5b13404484811b10e05818abc8 P 62eb0e44cb794e9db922a20fcfb9d606 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09ec138dff9842f0858adca947bc33fb in term 3.
I20260709 12:23:49.997608 10414 raft_consensus.cc:2468] T 86d8ee5b13404484811b10e05818abc8 P 39666a280cd648579a4ad0f800aa7261 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09ec138dff9842f0858adca947bc33fb in term 3.
I20260709 12:23:49.997882 10304 leader_election.cc:304] T 86d8ee5b13404484811b10e05818abc8 P 09ec138dff9842f0858adca947bc33fb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09ec138dff9842f0858adca947bc33fb, 62eb0e44cb794e9db922a20fcfb9d606; no voters: 
I20260709 12:23:49.998931 10647 raft_consensus.cc:2804] T 86d8ee5b13404484811b10e05818abc8 P 09ec138dff9842f0858adca947bc33fb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:49.999644 10647 raft_consensus.cc:697] T 86d8ee5b13404484811b10e05818abc8 P 09ec138dff9842f0858adca947bc33fb [term 3 LEADER]: Becoming Leader. State: Replica: 09ec138dff9842f0858adca947bc33fb, State: Running, Role: LEADER
I20260709 12:23:50.000494 10647 consensus_queue.cc:237] T 86d8ee5b13404484811b10e05818abc8 P 09ec138dff9842f0858adca947bc33fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:50.008855 10239 catalog_manager.cc:5697] T 86d8ee5b13404484811b10e05818abc8 P 09ec138dff9842f0858adca947bc33fb reported cstate change: term changed from 2 to 3, leader changed from 39666a280cd648579a4ad0f800aa7261 (127.9.116.66) to 09ec138dff9842f0858adca947bc33fb (127.9.116.65). New cstate: current_term: 3 leader_uuid: "09ec138dff9842f0858adca947bc33fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:50.170003 10488 raft_consensus.cc:1275] T 57fc852991f54b508ff41067c25fe854 P 62eb0e44cb794e9db922a20fcfb9d606 [term 4 FOLLOWER]: Refusing update from remote peer 09ec138dff9842f0858adca947bc33fb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:23:50.171694 10659 consensus_queue.cc:1048] T 57fc852991f54b508ff41067c25fe854 P 09ec138dff9842f0858adca947bc33fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:50.188375 10414 raft_consensus.cc:1275] T 57fc852991f54b508ff41067c25fe854 P 39666a280cd648579a4ad0f800aa7261 [term 4 FOLLOWER]: Refusing update from remote peer 09ec138dff9842f0858adca947bc33fb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:23:50.190609 10659 consensus_queue.cc:1048] T 57fc852991f54b508ff41067c25fe854 P 09ec138dff9842f0858adca947bc33fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:50.197598 10488 raft_consensus.cc:1275] T c8b3a5c008584867bf2282f87acb3cde P 62eb0e44cb794e9db922a20fcfb9d606 [term 4 FOLLOWER]: Refusing update from remote peer 09ec138dff9842f0858adca947bc33fb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:23:50.199278 10659 consensus_queue.cc:1048] T c8b3a5c008584867bf2282f87acb3cde P 09ec138dff9842f0858adca947bc33fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:50.215672 10414 raft_consensus.cc:1275] T c8b3a5c008584867bf2282f87acb3cde P 39666a280cd648579a4ad0f800aa7261 [term 4 FOLLOWER]: Refusing update from remote peer 09ec138dff9842f0858adca947bc33fb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:23:50.218343 10672 consensus_queue.cc:1048] T c8b3a5c008584867bf2282f87acb3cde P 09ec138dff9842f0858adca947bc33fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:50.287456 10414 raft_consensus.cc:1275] T ddcced512029492fb6903fc4d42abd31 P 39666a280cd648579a4ad0f800aa7261 [term 3 FOLLOWER]: Refusing update from remote peer 09ec138dff9842f0858adca947bc33fb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:50.288993 10672 consensus_queue.cc:1048] T ddcced512029492fb6903fc4d42abd31 P 09ec138dff9842f0858adca947bc33fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:50.300462 10488 raft_consensus.cc:1275] T ddcced512029492fb6903fc4d42abd31 P 62eb0e44cb794e9db922a20fcfb9d606 [term 3 FOLLOWER]: Refusing update from remote peer 09ec138dff9842f0858adca947bc33fb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:50.301970 10659 consensus_queue.cc:1048] T ddcced512029492fb6903fc4d42abd31 P 09ec138dff9842f0858adca947bc33fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:50.405210 10488 raft_consensus.cc:1275] T b719323785d84477bf49a3ebbf366f37 P 62eb0e44cb794e9db922a20fcfb9d606 [term 3 FOLLOWER]: Refusing update from remote peer 09ec138dff9842f0858adca947bc33fb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:50.406605 10659 consensus_queue.cc:1048] T b719323785d84477bf49a3ebbf366f37 P 09ec138dff9842f0858adca947bc33fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:50.417210 10415 raft_consensus.cc:1275] T b719323785d84477bf49a3ebbf366f37 P 39666a280cd648579a4ad0f800aa7261 [term 3 FOLLOWER]: Refusing update from remote peer 09ec138dff9842f0858adca947bc33fb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:50.418776 10647 consensus_queue.cc:1048] T b719323785d84477bf49a3ebbf366f37 P 09ec138dff9842f0858adca947bc33fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:50.521747 10488 raft_consensus.cc:1275] T 86d8ee5b13404484811b10e05818abc8 P 62eb0e44cb794e9db922a20fcfb9d606 [term 3 FOLLOWER]: Refusing update from remote peer 09ec138dff9842f0858adca947bc33fb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:50.523375 10647 consensus_queue.cc:1048] T 86d8ee5b13404484811b10e05818abc8 P 09ec138dff9842f0858adca947bc33fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:50.532763 10415 raft_consensus.cc:1275] T 86d8ee5b13404484811b10e05818abc8 P 39666a280cd648579a4ad0f800aa7261 [term 3 FOLLOWER]: Refusing update from remote peer 09ec138dff9842f0858adca947bc33fb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:50.534516 10659 consensus_queue.cc:1048] T 86d8ee5b13404484811b10e05818abc8 P 09ec138dff9842f0858adca947bc33fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:52.517262  9681 auto_leader_rebalancer-test.cc:399] The leader distribution is 
I20260709 12:23:52.518487  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:52.529197 10339 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1763c604c9c84205be8b3bf019a15fa0"
dest_uuid: "09ec138dff9842f0858adca947bc33fb"
mode: GRACEFUL
new_leader_uuid: "39666a280cd648579a4ad0f800aa7261"
 from {username='slave'} at 127.0.0.1:33384
I20260709 12:23:52.529925 10339 raft_consensus.cc:606] T 1763c604c9c84205be8b3bf019a15fa0 P 09ec138dff9842f0858adca947bc33fb [term 2 LEADER]: Received request to transfer leadership to TS 39666a280cd648579a4ad0f800aa7261
I20260709 12:23:52.533286 10339 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "86d8ee5b13404484811b10e05818abc8"
dest_uuid: "09ec138dff9842f0858adca947bc33fb"
mode: GRACEFUL
new_leader_uuid: "39666a280cd648579a4ad0f800aa7261"
 from {username='slave'} at 127.0.0.1:33384
I20260709 12:23:52.533835 10339 raft_consensus.cc:606] T 86d8ee5b13404484811b10e05818abc8 P 09ec138dff9842f0858adca947bc33fb [term 3 LEADER]: Received request to transfer leadership to TS 39666a280cd648579a4ad0f800aa7261
I20260709 12:23:52.537137 10339 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b719323785d84477bf49a3ebbf366f37"
dest_uuid: "09ec138dff9842f0858adca947bc33fb"
mode: GRACEFUL
new_leader_uuid: "62eb0e44cb794e9db922a20fcfb9d606"
 from {username='slave'} at 127.0.0.1:33384
I20260709 12:23:52.537962 10339 raft_consensus.cc:606] T b719323785d84477bf49a3ebbf366f37 P 09ec138dff9842f0858adca947bc33fb [term 3 LEADER]: Received request to transfer leadership to TS 62eb0e44cb794e9db922a20fcfb9d606
I20260709 12:23:52.541447 10339 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c8b3a5c008584867bf2282f87acb3cde"
dest_uuid: "09ec138dff9842f0858adca947bc33fb"
mode: GRACEFUL
new_leader_uuid: "62eb0e44cb794e9db922a20fcfb9d606"
 from {username='slave'} at 127.0.0.1:33384
I20260709 12:23:52.542001 10339 raft_consensus.cc:606] T c8b3a5c008584867bf2282f87acb3cde P 09ec138dff9842f0858adca947bc33fb [term 4 LEADER]: Received request to transfer leadership to TS 62eb0e44cb794e9db922a20fcfb9d606
I20260709 12:23:52.543216  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:23:52.543751  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:52.594146 10686 raft_consensus.cc:993] T 1763c604c9c84205be8b3bf019a15fa0 P 09ec138dff9842f0858adca947bc33fb: : Instructing follower 39666a280cd648579a4ad0f800aa7261 to start an election
I20260709 12:23:52.594619 10686 raft_consensus.cc:1081] T 1763c604c9c84205be8b3bf019a15fa0 P 09ec138dff9842f0858adca947bc33fb [term 2 LEADER]: Signalling peer 39666a280cd648579a4ad0f800aa7261 to start an election
I20260709 12:23:52.596715 10415 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1763c604c9c84205be8b3bf019a15fa0"
dest_uuid: "39666a280cd648579a4ad0f800aa7261"
 from {username='slave'} at 127.0.0.1:35196
I20260709 12:23:52.597409 10415 raft_consensus.cc:493] T 1763c604c9c84205be8b3bf019a15fa0 P 39666a280cd648579a4ad0f800aa7261 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:52.597744 10415 raft_consensus.cc:3060] T 1763c604c9c84205be8b3bf019a15fa0 P 39666a280cd648579a4ad0f800aa7261 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:52.605216 10415 raft_consensus.cc:515] T 1763c604c9c84205be8b3bf019a15fa0 P 39666a280cd648579a4ad0f800aa7261 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:52.607669 10415 leader_election.cc:290] T 1763c604c9c84205be8b3bf019a15fa0 P 39666a280cd648579a4ad0f800aa7261 [CANDIDATE]: Term 3 election: Requested vote from peers 09ec138dff9842f0858adca947bc33fb (127.9.116.65:42825), 62eb0e44cb794e9db922a20fcfb9d606 (127.9.116.67:42127)
I20260709 12:23:52.608973 10339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1763c604c9c84205be8b3bf019a15fa0" candidate_uuid: "39666a280cd648579a4ad0f800aa7261" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "09ec138dff9842f0858adca947bc33fb"
I20260709 12:23:52.609333 10488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1763c604c9c84205be8b3bf019a15fa0" candidate_uuid: "39666a280cd648579a4ad0f800aa7261" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "62eb0e44cb794e9db922a20fcfb9d606"
I20260709 12:23:52.609872 10339 raft_consensus.cc:3055] T 1763c604c9c84205be8b3bf019a15fa0 P 09ec138dff9842f0858adca947bc33fb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:52.609874 10488 raft_consensus.cc:3060] T 1763c604c9c84205be8b3bf019a15fa0 P 62eb0e44cb794e9db922a20fcfb9d606 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:52.610412 10339 raft_consensus.cc:740] T 1763c604c9c84205be8b3bf019a15fa0 P 09ec138dff9842f0858adca947bc33fb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 09ec138dff9842f0858adca947bc33fb, State: Running, Role: LEADER
I20260709 12:23:52.611685 10339 consensus_queue.cc:260] T 1763c604c9c84205be8b3bf019a15fa0 P 09ec138dff9842f0858adca947bc33fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:52.613488 10339 raft_consensus.cc:3060] T 1763c604c9c84205be8b3bf019a15fa0 P 09ec138dff9842f0858adca947bc33fb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:52.618752 10488 raft_consensus.cc:2468] T 1763c604c9c84205be8b3bf019a15fa0 P 62eb0e44cb794e9db922a20fcfb9d606 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39666a280cd648579a4ad0f800aa7261 in term 3.
I20260709 12:23:52.620335 10379 leader_election.cc:304] T 1763c604c9c84205be8b3bf019a15fa0 P 39666a280cd648579a4ad0f800aa7261 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39666a280cd648579a4ad0f800aa7261, 62eb0e44cb794e9db922a20fcfb9d606; no voters: 
I20260709 12:23:52.621301 10339 raft_consensus.cc:2468] T 1763c604c9c84205be8b3bf019a15fa0 P 09ec138dff9842f0858adca947bc33fb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39666a280cd648579a4ad0f800aa7261 in term 3.
I20260709 12:23:52.621363 10654 raft_consensus.cc:2804] T 1763c604c9c84205be8b3bf019a15fa0 P 39666a280cd648579a4ad0f800aa7261 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:52.622630 10654 raft_consensus.cc:697] T 1763c604c9c84205be8b3bf019a15fa0 P 39666a280cd648579a4ad0f800aa7261 [term 3 LEADER]: Becoming Leader. State: Replica: 39666a280cd648579a4ad0f800aa7261, State: Running, Role: LEADER
I20260709 12:23:52.623881 10654 consensus_queue.cc:237] T 1763c604c9c84205be8b3bf019a15fa0 P 39666a280cd648579a4ad0f800aa7261 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:52.633132 10239 catalog_manager.cc:5697] T 1763c604c9c84205be8b3bf019a15fa0 P 39666a280cd648579a4ad0f800aa7261 reported cstate change: term changed from 2 to 3, leader changed from 09ec138dff9842f0858adca947bc33fb (127.9.116.65) to 39666a280cd648579a4ad0f800aa7261 (127.9.116.66). New cstate: current_term: 3 leader_uuid: "39666a280cd648579a4ad0f800aa7261" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:52.674999 10659 raft_consensus.cc:993] T 86d8ee5b13404484811b10e05818abc8 P 09ec138dff9842f0858adca947bc33fb: : Instructing follower 39666a280cd648579a4ad0f800aa7261 to start an election
I20260709 12:23:52.675611 10686 raft_consensus.cc:1081] T 86d8ee5b13404484811b10e05818abc8 P 09ec138dff9842f0858adca947bc33fb [term 3 LEADER]: Signalling peer 39666a280cd648579a4ad0f800aa7261 to start an election
I20260709 12:23:52.677762 10415 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "86d8ee5b13404484811b10e05818abc8"
dest_uuid: "39666a280cd648579a4ad0f800aa7261"
 from {username='slave'} at 127.0.0.1:35196
I20260709 12:23:52.678386 10415 raft_consensus.cc:493] T 86d8ee5b13404484811b10e05818abc8 P 39666a280cd648579a4ad0f800aa7261 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:52.678711 10415 raft_consensus.cc:3060] T 86d8ee5b13404484811b10e05818abc8 P 39666a280cd648579a4ad0f800aa7261 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:52.684526 10415 raft_consensus.cc:515] T 86d8ee5b13404484811b10e05818abc8 P 39666a280cd648579a4ad0f800aa7261 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:52.686352 10415 leader_election.cc:290] T 86d8ee5b13404484811b10e05818abc8 P 39666a280cd648579a4ad0f800aa7261 [CANDIDATE]: Term 4 election: Requested vote from peers 09ec138dff9842f0858adca947bc33fb (127.9.116.65:42825), 62eb0e44cb794e9db922a20fcfb9d606 (127.9.116.67:42127)
I20260709 12:23:52.687623 10339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d8ee5b13404484811b10e05818abc8" candidate_uuid: "39666a280cd648579a4ad0f800aa7261" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "09ec138dff9842f0858adca947bc33fb"
I20260709 12:23:52.687853 10488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d8ee5b13404484811b10e05818abc8" candidate_uuid: "39666a280cd648579a4ad0f800aa7261" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "62eb0e44cb794e9db922a20fcfb9d606"
I20260709 12:23:52.688215 10339 raft_consensus.cc:3055] T 86d8ee5b13404484811b10e05818abc8 P 09ec138dff9842f0858adca947bc33fb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:52.688510 10488 raft_consensus.cc:3060] T 86d8ee5b13404484811b10e05818abc8 P 62eb0e44cb794e9db922a20fcfb9d606 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:52.688647 10339 raft_consensus.cc:740] T 86d8ee5b13404484811b10e05818abc8 P 09ec138dff9842f0858adca947bc33fb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 09ec138dff9842f0858adca947bc33fb, State: Running, Role: LEADER
I20260709 12:23:52.689500 10339 consensus_queue.cc:260] T 86d8ee5b13404484811b10e05818abc8 P 09ec138dff9842f0858adca947bc33fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:52.690461 10339 raft_consensus.cc:3060] T 86d8ee5b13404484811b10e05818abc8 P 09ec138dff9842f0858adca947bc33fb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:52.694393 10488 raft_consensus.cc:2468] T 86d8ee5b13404484811b10e05818abc8 P 62eb0e44cb794e9db922a20fcfb9d606 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39666a280cd648579a4ad0f800aa7261 in term 4.
I20260709 12:23:52.695552 10379 leader_election.cc:304] T 86d8ee5b13404484811b10e05818abc8 P 39666a280cd648579a4ad0f800aa7261 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39666a280cd648579a4ad0f800aa7261, 62eb0e44cb794e9db922a20fcfb9d606; no voters: 
I20260709 12:23:52.696326 10654 raft_consensus.cc:2804] T 86d8ee5b13404484811b10e05818abc8 P 39666a280cd648579a4ad0f800aa7261 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:52.696362 10339 raft_consensus.cc:2468] T 86d8ee5b13404484811b10e05818abc8 P 09ec138dff9842f0858adca947bc33fb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39666a280cd648579a4ad0f800aa7261 in term 4.
I20260709 12:23:52.696913 10654 raft_consensus.cc:697] T 86d8ee5b13404484811b10e05818abc8 P 39666a280cd648579a4ad0f800aa7261 [term 4 LEADER]: Becoming Leader. State: Replica: 39666a280cd648579a4ad0f800aa7261, State: Running, Role: LEADER
I20260709 12:23:52.697925 10654 consensus_queue.cc:237] T 86d8ee5b13404484811b10e05818abc8 P 39666a280cd648579a4ad0f800aa7261 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:52.705257 10239 catalog_manager.cc:5697] T 86d8ee5b13404484811b10e05818abc8 P 39666a280cd648579a4ad0f800aa7261 reported cstate change: term changed from 3 to 4, leader changed from 09ec138dff9842f0858adca947bc33fb (127.9.116.65) to 39666a280cd648579a4ad0f800aa7261 (127.9.116.66). New cstate: current_term: 4 leader_uuid: "39666a280cd648579a4ad0f800aa7261" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:52.741899 10659 raft_consensus.cc:993] T c8b3a5c008584867bf2282f87acb3cde P 09ec138dff9842f0858adca947bc33fb: : Instructing follower 62eb0e44cb794e9db922a20fcfb9d606 to start an election
I20260709 12:23:52.742525 10659 raft_consensus.cc:1081] T c8b3a5c008584867bf2282f87acb3cde P 09ec138dff9842f0858adca947bc33fb [term 4 LEADER]: Signalling peer 62eb0e44cb794e9db922a20fcfb9d606 to start an election
I20260709 12:23:52.744549 10488 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c8b3a5c008584867bf2282f87acb3cde"
dest_uuid: "62eb0e44cb794e9db922a20fcfb9d606"
 from {username='slave'} at 127.0.0.1:56108
I20260709 12:23:52.745062 10488 raft_consensus.cc:493] T c8b3a5c008584867bf2282f87acb3cde P 62eb0e44cb794e9db922a20fcfb9d606 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:52.745344 10488 raft_consensus.cc:3060] T c8b3a5c008584867bf2282f87acb3cde P 62eb0e44cb794e9db922a20fcfb9d606 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:52.751675 10488 raft_consensus.cc:515] T c8b3a5c008584867bf2282f87acb3cde P 62eb0e44cb794e9db922a20fcfb9d606 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:52.754276 10488 leader_election.cc:290] T c8b3a5c008584867bf2282f87acb3cde P 62eb0e44cb794e9db922a20fcfb9d606 [CANDIDATE]: Term 5 election: Requested vote from peers 09ec138dff9842f0858adca947bc33fb (127.9.116.65:42825), 39666a280cd648579a4ad0f800aa7261 (127.9.116.66:43111)
I20260709 12:23:52.755671 10339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8b3a5c008584867bf2282f87acb3cde" candidate_uuid: "62eb0e44cb794e9db922a20fcfb9d606" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "09ec138dff9842f0858adca947bc33fb"
I20260709 12:23:52.756011 10415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8b3a5c008584867bf2282f87acb3cde" candidate_uuid: "62eb0e44cb794e9db922a20fcfb9d606" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "39666a280cd648579a4ad0f800aa7261"
I20260709 12:23:52.756429 10339 raft_consensus.cc:3055] T c8b3a5c008584867bf2282f87acb3cde P 09ec138dff9842f0858adca947bc33fb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:23:52.756916 10339 raft_consensus.cc:740] T c8b3a5c008584867bf2282f87acb3cde P 09ec138dff9842f0858adca947bc33fb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 09ec138dff9842f0858adca947bc33fb, State: Running, Role: LEADER
I20260709 12:23:52.756497 10415 raft_consensus.cc:3060] T c8b3a5c008584867bf2282f87acb3cde P 39666a280cd648579a4ad0f800aa7261 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:52.757730 10339 consensus_queue.cc:260] T c8b3a5c008584867bf2282f87acb3cde P 09ec138dff9842f0858adca947bc33fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:52.758819 10339 raft_consensus.cc:3060] T c8b3a5c008584867bf2282f87acb3cde P 09ec138dff9842f0858adca947bc33fb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:52.762513 10415 raft_consensus.cc:2468] T c8b3a5c008584867bf2282f87acb3cde P 39666a280cd648579a4ad0f800aa7261 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62eb0e44cb794e9db922a20fcfb9d606 in term 5.
I20260709 12:23:52.763860 10339 raft_consensus.cc:2468] T c8b3a5c008584867bf2282f87acb3cde P 09ec138dff9842f0858adca947bc33fb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62eb0e44cb794e9db922a20fcfb9d606 in term 5.
I20260709 12:23:52.764246 10456 leader_election.cc:304] T c8b3a5c008584867bf2282f87acb3cde P 62eb0e44cb794e9db922a20fcfb9d606 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39666a280cd648579a4ad0f800aa7261, 62eb0e44cb794e9db922a20fcfb9d606; no voters: 
I20260709 12:23:52.765439 10658 raft_consensus.cc:2804] T c8b3a5c008584867bf2282f87acb3cde P 62eb0e44cb794e9db922a20fcfb9d606 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:52.766759 10658 raft_consensus.cc:697] T c8b3a5c008584867bf2282f87acb3cde P 62eb0e44cb794e9db922a20fcfb9d606 [term 5 LEADER]: Becoming Leader. State: Replica: 62eb0e44cb794e9db922a20fcfb9d606, State: Running, Role: LEADER
I20260709 12:23:52.767721 10658 consensus_queue.cc:237] T c8b3a5c008584867bf2282f87acb3cde P 62eb0e44cb794e9db922a20fcfb9d606 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:52.775717 10239 catalog_manager.cc:5697] T c8b3a5c008584867bf2282f87acb3cde P 62eb0e44cb794e9db922a20fcfb9d606 reported cstate change: term changed from 4 to 5, leader changed from 09ec138dff9842f0858adca947bc33fb (127.9.116.65) to 62eb0e44cb794e9db922a20fcfb9d606 (127.9.116.67). New cstate: current_term: 5 leader_uuid: "62eb0e44cb794e9db922a20fcfb9d606" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:52.894863 10686 raft_consensus.cc:993] T b719323785d84477bf49a3ebbf366f37 P 09ec138dff9842f0858adca947bc33fb: : Instructing follower 62eb0e44cb794e9db922a20fcfb9d606 to start an election
I20260709 12:23:52.895305 10659 raft_consensus.cc:1081] T b719323785d84477bf49a3ebbf366f37 P 09ec138dff9842f0858adca947bc33fb [term 3 LEADER]: Signalling peer 62eb0e44cb794e9db922a20fcfb9d606 to start an election
I20260709 12:23:52.897608 10488 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b719323785d84477bf49a3ebbf366f37"
dest_uuid: "62eb0e44cb794e9db922a20fcfb9d606"
 from {username='slave'} at 127.0.0.1:56108
I20260709 12:23:52.898270 10488 raft_consensus.cc:493] T b719323785d84477bf49a3ebbf366f37 P 62eb0e44cb794e9db922a20fcfb9d606 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:52.898772 10488 raft_consensus.cc:3060] T b719323785d84477bf49a3ebbf366f37 P 62eb0e44cb794e9db922a20fcfb9d606 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:52.903430 10488 raft_consensus.cc:515] T b719323785d84477bf49a3ebbf366f37 P 62eb0e44cb794e9db922a20fcfb9d606 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:52.905128 10488 leader_election.cc:290] T b719323785d84477bf49a3ebbf366f37 P 62eb0e44cb794e9db922a20fcfb9d606 [CANDIDATE]: Term 4 election: Requested vote from peers 09ec138dff9842f0858adca947bc33fb (127.9.116.65:42825), 39666a280cd648579a4ad0f800aa7261 (127.9.116.66:43111)
I20260709 12:23:52.906213 10339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719323785d84477bf49a3ebbf366f37" candidate_uuid: "62eb0e44cb794e9db922a20fcfb9d606" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "09ec138dff9842f0858adca947bc33fb"
I20260709 12:23:52.906772 10339 raft_consensus.cc:3055] T b719323785d84477bf49a3ebbf366f37 P 09ec138dff9842f0858adca947bc33fb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:52.907055 10339 raft_consensus.cc:740] T b719323785d84477bf49a3ebbf366f37 P 09ec138dff9842f0858adca947bc33fb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 09ec138dff9842f0858adca947bc33fb, State: Running, Role: LEADER
I20260709 12:23:52.906890 10415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719323785d84477bf49a3ebbf366f37" candidate_uuid: "62eb0e44cb794e9db922a20fcfb9d606" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "39666a280cd648579a4ad0f800aa7261"
I20260709 12:23:52.907652 10415 raft_consensus.cc:3060] T b719323785d84477bf49a3ebbf366f37 P 39666a280cd648579a4ad0f800aa7261 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:52.907922 10339 consensus_queue.cc:260] T b719323785d84477bf49a3ebbf366f37 P 09ec138dff9842f0858adca947bc33fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:52.908871 10339 raft_consensus.cc:3060] T b719323785d84477bf49a3ebbf366f37 P 09ec138dff9842f0858adca947bc33fb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:52.912160 10415 raft_consensus.cc:2468] T b719323785d84477bf49a3ebbf366f37 P 39666a280cd648579a4ad0f800aa7261 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62eb0e44cb794e9db922a20fcfb9d606 in term 4.
I20260709 12:23:52.913344 10456 leader_election.cc:304] T b719323785d84477bf49a3ebbf366f37 P 62eb0e44cb794e9db922a20fcfb9d606 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39666a280cd648579a4ad0f800aa7261, 62eb0e44cb794e9db922a20fcfb9d606; no voters: 
I20260709 12:23:52.914287 10658 raft_consensus.cc:2804] T b719323785d84477bf49a3ebbf366f37 P 62eb0e44cb794e9db922a20fcfb9d606 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:52.914740 10658 raft_consensus.cc:697] T b719323785d84477bf49a3ebbf366f37 P 62eb0e44cb794e9db922a20fcfb9d606 [term 4 LEADER]: Becoming Leader. State: Replica: 62eb0e44cb794e9db922a20fcfb9d606, State: Running, Role: LEADER
I20260709 12:23:52.915647 10658 consensus_queue.cc:237] T b719323785d84477bf49a3ebbf366f37 P 62eb0e44cb794e9db922a20fcfb9d606 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } }
I20260709 12:23:52.916070 10339 raft_consensus.cc:2468] T b719323785d84477bf49a3ebbf366f37 P 09ec138dff9842f0858adca947bc33fb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62eb0e44cb794e9db922a20fcfb9d606 in term 4.
I20260709 12:23:52.925110 10239 catalog_manager.cc:5697] T b719323785d84477bf49a3ebbf366f37 P 62eb0e44cb794e9db922a20fcfb9d606 reported cstate change: term changed from 3 to 4, leader changed from 09ec138dff9842f0858adca947bc33fb (127.9.116.65) to 62eb0e44cb794e9db922a20fcfb9d606 (127.9.116.67). New cstate: current_term: 4 leader_uuid: "62eb0e44cb794e9db922a20fcfb9d606" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:53.087956 10488 raft_consensus.cc:1275] T 86d8ee5b13404484811b10e05818abc8 P 62eb0e44cb794e9db922a20fcfb9d606 [term 4 FOLLOWER]: Refusing update from remote peer 39666a280cd648579a4ad0f800aa7261: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:23:53.089600 10654 consensus_queue.cc:1048] T 86d8ee5b13404484811b10e05818abc8 P 39666a280cd648579a4ad0f800aa7261 [LEADER]: Connected to new peer: Peer: permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:53.103283 10339 raft_consensus.cc:1275] T 86d8ee5b13404484811b10e05818abc8 P 09ec138dff9842f0858adca947bc33fb [term 4 FOLLOWER]: Refusing update from remote peer 39666a280cd648579a4ad0f800aa7261: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:23:53.105787 10700 consensus_queue.cc:1048] T 86d8ee5b13404484811b10e05818abc8 P 39666a280cd648579a4ad0f800aa7261 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:53.114436 10339 raft_consensus.cc:1275] T 1763c604c9c84205be8b3bf019a15fa0 P 09ec138dff9842f0858adca947bc33fb [term 3 FOLLOWER]: Refusing update from remote peer 39666a280cd648579a4ad0f800aa7261: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:53.115774 10700 consensus_queue.cc:1048] T 1763c604c9c84205be8b3bf019a15fa0 P 39666a280cd648579a4ad0f800aa7261 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:53.127259 10488 raft_consensus.cc:1275] T 1763c604c9c84205be8b3bf019a15fa0 P 62eb0e44cb794e9db922a20fcfb9d606 [term 3 FOLLOWER]: Refusing update from remote peer 39666a280cd648579a4ad0f800aa7261: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:53.128978 10654 consensus_queue.cc:1048] T 1763c604c9c84205be8b3bf019a15fa0 P 39666a280cd648579a4ad0f800aa7261 [LEADER]: Connected to new peer: Peer: permanent_uuid: "62eb0e44cb794e9db922a20fcfb9d606" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:53.203114 10339 raft_consensus.cc:1275] T c8b3a5c008584867bf2282f87acb3cde P 09ec138dff9842f0858adca947bc33fb [term 5 FOLLOWER]: Refusing update from remote peer 62eb0e44cb794e9db922a20fcfb9d606: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:23:53.204875 10658 consensus_queue.cc:1048] T c8b3a5c008584867bf2282f87acb3cde P 62eb0e44cb794e9db922a20fcfb9d606 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:53.215493 10415 raft_consensus.cc:1275] T c8b3a5c008584867bf2282f87acb3cde P 39666a280cd648579a4ad0f800aa7261 [term 5 FOLLOWER]: Refusing update from remote peer 62eb0e44cb794e9db922a20fcfb9d606: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:23:53.216967 10707 consensus_queue.cc:1048] T c8b3a5c008584867bf2282f87acb3cde P 62eb0e44cb794e9db922a20fcfb9d606 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:53.364127 10415 raft_consensus.cc:1275] T b719323785d84477bf49a3ebbf366f37 P 39666a280cd648579a4ad0f800aa7261 [term 4 FOLLOWER]: Refusing update from remote peer 62eb0e44cb794e9db922a20fcfb9d606: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:23:53.365525 10707 consensus_queue.cc:1048] T b719323785d84477bf49a3ebbf366f37 P 62eb0e44cb794e9db922a20fcfb9d606 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39666a280cd648579a4ad0f800aa7261" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:53.376722 10339 raft_consensus.cc:1275] T b719323785d84477bf49a3ebbf366f37 P 09ec138dff9842f0858adca947bc33fb [term 4 FOLLOWER]: Refusing update from remote peer 62eb0e44cb794e9db922a20fcfb9d606: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:23:53.378813 10658 consensus_queue.cc:1048] T b719323785d84477bf49a3ebbf366f37 P 62eb0e44cb794e9db922a20fcfb9d606 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09ec138dff9842f0858adca947bc33fb" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:53.545238  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:53.553159  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:53.553690  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:54.554656  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:54.561619  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:54.562359  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:55.563673  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:55.569965  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:55.570508  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:56.571445  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:56.576869  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:56.577370  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:57.578904  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:57.586920  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:57.587617  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:58.589003  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:58.595961  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:58.596448  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:59.597856  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:59.605504  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:59.606129  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:00.607358  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:00.613222  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:24:00.613658  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:01.615006  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:01.621454  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:24:01.622022  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:02.669400  9681 auto_leader_rebalancer-test.cc:410] The leader distribution is 
I20260709 12:24:02.670418  9681 tablet_server.cc:179] TabletServer@127.9.116.65:0 shutting down...
I20260709 12:24:02.719188  9681 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:24:02.720242  9681 tablet_replica.cc:333] T b719323785d84477bf49a3ebbf366f37 P 09ec138dff9842f0858adca947bc33fb: stopping tablet replica
I20260709 12:24:02.721065  9681 raft_consensus.cc:2243] T b719323785d84477bf49a3ebbf366f37 P 09ec138dff9842f0858adca947bc33fb [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:02.722360  9681 raft_consensus.cc:2272] T b719323785d84477bf49a3ebbf366f37 P 09ec138dff9842f0858adca947bc33fb [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:02.725085  9681 tablet_replica.cc:333] T f45d2ff8d4f540878e0ec1058a28f8d5 P 09ec138dff9842f0858adca947bc33fb: stopping tablet replica
I20260709 12:24:02.725782  9681 raft_consensus.cc:2243] T f45d2ff8d4f540878e0ec1058a28f8d5 P 09ec138dff9842f0858adca947bc33fb [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:02.726990  9681 raft_consensus.cc:2272] T f45d2ff8d4f540878e0ec1058a28f8d5 P 09ec138dff9842f0858adca947bc33fb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:02.729452  9681 tablet_replica.cc:333] T 57fc852991f54b508ff41067c25fe854 P 09ec138dff9842f0858adca947bc33fb: stopping tablet replica
I20260709 12:24:02.730249  9681 raft_consensus.cc:2243] T 57fc852991f54b508ff41067c25fe854 P 09ec138dff9842f0858adca947bc33fb [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:24:02.731297  9681 raft_consensus.cc:2272] T 57fc852991f54b508ff41067c25fe854 P 09ec138dff9842f0858adca947bc33fb [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:02.733767  9681 tablet_replica.cc:333] T c8b3a5c008584867bf2282f87acb3cde P 09ec138dff9842f0858adca947bc33fb: stopping tablet replica
I20260709 12:24:02.734428  9681 raft_consensus.cc:2243] T c8b3a5c008584867bf2282f87acb3cde P 09ec138dff9842f0858adca947bc33fb [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:02.735085  9681 raft_consensus.cc:2272] T c8b3a5c008584867bf2282f87acb3cde P 09ec138dff9842f0858adca947bc33fb [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:02.737478  9681 tablet_replica.cc:333] T ce98990ba39f44f4b792419973437b1c P 09ec138dff9842f0858adca947bc33fb: stopping tablet replica
I20260709 12:24:02.738142  9681 raft_consensus.cc:2243] T ce98990ba39f44f4b792419973437b1c P 09ec138dff9842f0858adca947bc33fb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:02.738780  9681 raft_consensus.cc:2272] T ce98990ba39f44f4b792419973437b1c P 09ec138dff9842f0858adca947bc33fb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:02.741029  9681 tablet_replica.cc:333] T b6cc3e80f4f6411b89c21921f2929554 P 09ec138dff9842f0858adca947bc33fb: stopping tablet replica
I20260709 12:24:02.741628  9681 raft_consensus.cc:2243] T b6cc3e80f4f6411b89c21921f2929554 P 09ec138dff9842f0858adca947bc33fb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:02.742147  9681 raft_consensus.cc:2272] T b6cc3e80f4f6411b89c21921f2929554 P 09ec138dff9842f0858adca947bc33fb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:02.744371  9681 tablet_replica.cc:333] T 1763c604c9c84205be8b3bf019a15fa0 P 09ec138dff9842f0858adca947bc33fb: stopping tablet replica
I20260709 12:24:02.744984  9681 raft_consensus.cc:2243] T 1763c604c9c84205be8b3bf019a15fa0 P 09ec138dff9842f0858adca947bc33fb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:02.745487  9681 raft_consensus.cc:2272] T 1763c604c9c84205be8b3bf019a15fa0 P 09ec138dff9842f0858adca947bc33fb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:02.747686  9681 tablet_replica.cc:333] T 86d8ee5b13404484811b10e05818abc8 P 09ec138dff9842f0858adca947bc33fb: stopping tablet replica
I20260709 12:24:02.748209  9681 raft_consensus.cc:2243] T 86d8ee5b13404484811b10e05818abc8 P 09ec138dff9842f0858adca947bc33fb [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:02.748662  9681 raft_consensus.cc:2272] T 86d8ee5b13404484811b10e05818abc8 P 09ec138dff9842f0858adca947bc33fb [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:02.750982  9681 tablet_replica.cc:333] T ddcced512029492fb6903fc4d42abd31 P 09ec138dff9842f0858adca947bc33fb: stopping tablet replica
I20260709 12:24:02.751848  9681 raft_consensus.cc:2243] T ddcced512029492fb6903fc4d42abd31 P 09ec138dff9842f0858adca947bc33fb [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:24:02.753099  9681 raft_consensus.cc:2272] T ddcced512029492fb6903fc4d42abd31 P 09ec138dff9842f0858adca947bc33fb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:02.755170  9681 tablet_replica.cc:333] T 5764d623ece6411d8e3adfbd095f0fe1 P 09ec138dff9842f0858adca947bc33fb: stopping tablet replica
I20260709 12:24:02.755815  9681 raft_consensus.cc:2243] T 5764d623ece6411d8e3adfbd095f0fe1 P 09ec138dff9842f0858adca947bc33fb [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:02.757148  9681 raft_consensus.cc:2272] T 5764d623ece6411d8e3adfbd095f0fe1 P 09ec138dff9842f0858adca947bc33fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:02.795384  9681 tablet_server.cc:196] TabletServer@127.9.116.65:0 shutdown complete.
I20260709 12:24:02.821200  9681 tablet_server.cc:179] TabletServer@127.9.116.66:0 shutting down...
I20260709 12:24:02.862025  9681 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:24:02.863126  9681 tablet_replica.cc:333] T b719323785d84477bf49a3ebbf366f37 P 39666a280cd648579a4ad0f800aa7261: stopping tablet replica
I20260709 12:24:02.864428  9681 raft_consensus.cc:2243] T b719323785d84477bf49a3ebbf366f37 P 39666a280cd648579a4ad0f800aa7261 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:02.865348  9681 raft_consensus.cc:2272] T b719323785d84477bf49a3ebbf366f37 P 39666a280cd648579a4ad0f800aa7261 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:02.867753  9681 tablet_replica.cc:333] T f45d2ff8d4f540878e0ec1058a28f8d5 P 39666a280cd648579a4ad0f800aa7261: stopping tablet replica
I20260709 12:24:02.868386  9681 raft_consensus.cc:2243] T f45d2ff8d4f540878e0ec1058a28f8d5 P 39666a280cd648579a4ad0f800aa7261 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:02.869349  9681 raft_consensus.cc:2272] T f45d2ff8d4f540878e0ec1058a28f8d5 P 39666a280cd648579a4ad0f800aa7261 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:02.871438  9681 tablet_replica.cc:333] T ce98990ba39f44f4b792419973437b1c P 39666a280cd648579a4ad0f800aa7261: stopping tablet replica
I20260709 12:24:02.872104  9681 raft_consensus.cc:2243] T ce98990ba39f44f4b792419973437b1c P 39666a280cd648579a4ad0f800aa7261 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:02.872567  9681 raft_consensus.cc:2272] T ce98990ba39f44f4b792419973437b1c P 39666a280cd648579a4ad0f800aa7261 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:02.874953  9681 tablet_replica.cc:333] T b6cc3e80f4f6411b89c21921f2929554 P 39666a280cd648579a4ad0f800aa7261: stopping tablet replica
I20260709 12:24:02.875645  9681 raft_consensus.cc:2243] T b6cc3e80f4f6411b89c21921f2929554 P 39666a280cd648579a4ad0f800aa7261 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:02.876632  9681 raft_consensus.cc:2272] T b6cc3e80f4f6411b89c21921f2929554 P 39666a280cd648579a4ad0f800aa7261 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:02.878165 10382 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.116.65:42825: connect: Connection refused (error 111) [suppressed 4 similar messages]
I20260709 12:24:02.878868  9681 tablet_replica.cc:333] T 1763c604c9c84205be8b3bf019a15fa0 P 39666a280cd648579a4ad0f800aa7261: stopping tablet replica
I20260709 12:24:02.879457  9681 raft_consensus.cc:2243] T 1763c604c9c84205be8b3bf019a15fa0 P 39666a280cd648579a4ad0f800aa7261 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:24:02.880569  9681 raft_consensus.cc:2272] T 1763c604c9c84205be8b3bf019a15fa0 P 39666a280cd648579a4ad0f800aa7261 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:02.882556  9681 tablet_replica.cc:333] T ddcced512029492fb6903fc4d42abd31 P 39666a280cd648579a4ad0f800aa7261: stopping tablet replica
I20260709 12:24:02.883122  9681 raft_consensus.cc:2243] T ddcced512029492fb6903fc4d42abd31 P 39666a280cd648579a4ad0f800aa7261 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:02.883723  9681 raft_consensus.cc:2272] T ddcced512029492fb6903fc4d42abd31 P 39666a280cd648579a4ad0f800aa7261 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:02.885530  9681 tablet_replica.cc:333] T 86d8ee5b13404484811b10e05818abc8 P 39666a280cd648579a4ad0f800aa7261: stopping tablet replica
I20260709 12:24:02.886093  9681 raft_consensus.cc:2243] T 86d8ee5b13404484811b10e05818abc8 P 39666a280cd648579a4ad0f800aa7261 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:24:02.887142  9681 raft_consensus.cc:2272] T 86d8ee5b13404484811b10e05818abc8 P 39666a280cd648579a4ad0f800aa7261 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:02.889490  9681 tablet_replica.cc:333] T 5764d623ece6411d8e3adfbd095f0fe1 P 39666a280cd648579a4ad0f800aa7261: stopping tablet replica
I20260709 12:24:02.890220  9681 raft_consensus.cc:2243] T 5764d623ece6411d8e3adfbd095f0fe1 P 39666a280cd648579a4ad0f800aa7261 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:02.890893  9681 raft_consensus.cc:2272] T 5764d623ece6411d8e3adfbd095f0fe1 P 39666a280cd648579a4ad0f800aa7261 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:02.893368  9681 tablet_replica.cc:333] T c8b3a5c008584867bf2282f87acb3cde P 39666a280cd648579a4ad0f800aa7261: stopping tablet replica
W20260709 12:24:02.893530 10456 consensus_peers.cc:597] T b719323785d84477bf49a3ebbf366f37 P 62eb0e44cb794e9db922a20fcfb9d606 -> Peer 39666a280cd648579a4ad0f800aa7261 (127.9.116.66:43111): Couldn't send request to peer 39666a280cd648579a4ad0f800aa7261. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:02.894251  9681 raft_consensus.cc:2243] T c8b3a5c008584867bf2282f87acb3cde P 39666a280cd648579a4ad0f800aa7261 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:02.894798  9681 raft_consensus.cc:2272] T c8b3a5c008584867bf2282f87acb3cde P 39666a280cd648579a4ad0f800aa7261 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:02.896936  9681 tablet_replica.cc:333] T 57fc852991f54b508ff41067c25fe854 P 39666a280cd648579a4ad0f800aa7261: stopping tablet replica
I20260709 12:24:02.897369  9681 raft_consensus.cc:2243] T 57fc852991f54b508ff41067c25fe854 P 39666a280cd648579a4ad0f800aa7261 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:02.897781  9681 raft_consensus.cc:2272] T 57fc852991f54b508ff41067c25fe854 P 39666a280cd648579a4ad0f800aa7261 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:02.929314  9681 tablet_server.cc:196] TabletServer@127.9.116.66:0 shutdown complete.
I20260709 12:24:02.956707  9681 tablet_server.cc:179] TabletServer@127.9.116.67:0 shutting down...
I20260709 12:24:02.993273  9681 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:24:02.994096  9681 tablet_replica.cc:333] T b719323785d84477bf49a3ebbf366f37 P 62eb0e44cb794e9db922a20fcfb9d606: stopping tablet replica
I20260709 12:24:02.995173  9681 raft_consensus.cc:2243] T b719323785d84477bf49a3ebbf366f37 P 62eb0e44cb794e9db922a20fcfb9d606 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:24:02.996495  9681 raft_consensus.cc:2272] T b719323785d84477bf49a3ebbf366f37 P 62eb0e44cb794e9db922a20fcfb9d606 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:02.998723  9681 tablet_replica.cc:333] T f45d2ff8d4f540878e0ec1058a28f8d5 P 62eb0e44cb794e9db922a20fcfb9d606: stopping tablet replica
I20260709 12:24:02.999390  9681 raft_consensus.cc:2243] T f45d2ff8d4f540878e0ec1058a28f8d5 P 62eb0e44cb794e9db922a20fcfb9d606 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:02.999975  9681 raft_consensus.cc:2272] T f45d2ff8d4f540878e0ec1058a28f8d5 P 62eb0e44cb794e9db922a20fcfb9d606 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:03.002193  9681 tablet_replica.cc:333] T ddcced512029492fb6903fc4d42abd31 P 62eb0e44cb794e9db922a20fcfb9d606: stopping tablet replica
I20260709 12:24:03.002800  9681 raft_consensus.cc:2243] T ddcced512029492fb6903fc4d42abd31 P 62eb0e44cb794e9db922a20fcfb9d606 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:03.003371  9681 raft_consensus.cc:2272] T ddcced512029492fb6903fc4d42abd31 P 62eb0e44cb794e9db922a20fcfb9d606 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:03.005477  9681 tablet_replica.cc:333] T 86d8ee5b13404484811b10e05818abc8 P 62eb0e44cb794e9db922a20fcfb9d606: stopping tablet replica
I20260709 12:24:03.006042  9681 raft_consensus.cc:2243] T 86d8ee5b13404484811b10e05818abc8 P 62eb0e44cb794e9db922a20fcfb9d606 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:03.006630  9681 raft_consensus.cc:2272] T 86d8ee5b13404484811b10e05818abc8 P 62eb0e44cb794e9db922a20fcfb9d606 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:03.008939  9681 tablet_replica.cc:333] T 5764d623ece6411d8e3adfbd095f0fe1 P 62eb0e44cb794e9db922a20fcfb9d606: stopping tablet replica
I20260709 12:24:03.009585  9681 raft_consensus.cc:2243] T 5764d623ece6411d8e3adfbd095f0fe1 P 62eb0e44cb794e9db922a20fcfb9d606 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:03.010109  9681 raft_consensus.cc:2272] T 5764d623ece6411d8e3adfbd095f0fe1 P 62eb0e44cb794e9db922a20fcfb9d606 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:03.011888  9681 tablet_replica.cc:333] T ce98990ba39f44f4b792419973437b1c P 62eb0e44cb794e9db922a20fcfb9d606: stopping tablet replica
I20260709 12:24:03.012398  9681 raft_consensus.cc:2243] T ce98990ba39f44f4b792419973437b1c P 62eb0e44cb794e9db922a20fcfb9d606 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:03.013274  9681 raft_consensus.cc:2272] T ce98990ba39f44f4b792419973437b1c P 62eb0e44cb794e9db922a20fcfb9d606 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:03.015107  9681 tablet_replica.cc:333] T b6cc3e80f4f6411b89c21921f2929554 P 62eb0e44cb794e9db922a20fcfb9d606: stopping tablet replica
I20260709 12:24:03.015662  9681 raft_consensus.cc:2243] T b6cc3e80f4f6411b89c21921f2929554 P 62eb0e44cb794e9db922a20fcfb9d606 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:03.016095  9681 raft_consensus.cc:2272] T b6cc3e80f4f6411b89c21921f2929554 P 62eb0e44cb794e9db922a20fcfb9d606 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:03.017791  9681 tablet_replica.cc:333] T 1763c604c9c84205be8b3bf019a15fa0 P 62eb0e44cb794e9db922a20fcfb9d606: stopping tablet replica
I20260709 12:24:03.018671  9681 raft_consensus.cc:2243] T 1763c604c9c84205be8b3bf019a15fa0 P 62eb0e44cb794e9db922a20fcfb9d606 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:03.019188  9681 raft_consensus.cc:2272] T 1763c604c9c84205be8b3bf019a15fa0 P 62eb0e44cb794e9db922a20fcfb9d606 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:03.022166  9681 tablet_replica.cc:333] T 57fc852991f54b508ff41067c25fe854 P 62eb0e44cb794e9db922a20fcfb9d606: stopping tablet replica
I20260709 12:24:03.022890  9681 raft_consensus.cc:2243] T 57fc852991f54b508ff41067c25fe854 P 62eb0e44cb794e9db922a20fcfb9d606 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:03.023465  9681 raft_consensus.cc:2272] T 57fc852991f54b508ff41067c25fe854 P 62eb0e44cb794e9db922a20fcfb9d606 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:03.025658  9681 tablet_replica.cc:333] T c8b3a5c008584867bf2282f87acb3cde P 62eb0e44cb794e9db922a20fcfb9d606: stopping tablet replica
I20260709 12:24:03.026201  9681 raft_consensus.cc:2243] T c8b3a5c008584867bf2282f87acb3cde P 62eb0e44cb794e9db922a20fcfb9d606 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:24:03.027258  9681 raft_consensus.cc:2272] T c8b3a5c008584867bf2282f87acb3cde P 62eb0e44cb794e9db922a20fcfb9d606 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:03.060441  9681 tablet_server.cc:196] TabletServer@127.9.116.67:0 shutdown complete.
I20260709 12:24:03.086890  9681 master.cc:562] Master@127.9.116.126:41725 shutting down...
I20260709 12:24:03.120115  9681 raft_consensus.cc:2243] T 00000000000000000000000000000000 P fcc36cd2576f4384a986fa531b21cf59 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:03.121038  9681 raft_consensus.cc:2272] T 00000000000000000000000000000000 P fcc36cd2576f4384a986fa531b21cf59 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:03.121608  9681 tablet_replica.cc:333] T 00000000000000000000000000000000 P fcc36cd2576f4384a986fa531b21cf59: stopping tablet replica
I20260709 12:24:03.145761  9681 master.cc:584] Master@127.9.116.126:41725 shutdown complete.
09ec138dff9842f0858adca947bc33fb  5
39666a280cd648579a4ad0f800aa7261  4
62eb0e44cb794e9db922a20fcfb9d606  1
09ec138dff9842f0858adca947bc33fb  3
39666a280cd648579a4ad0f800aa7261  4
62eb0e44cb794e9db922a20fcfb9d606  3
09ec138dff9842f0858adca947bc33fb  8
39666a280cd648579a4ad0f800aa7261  1
62eb0e44cb794e9db922a20fcfb9d606  1
09ec138dff9842f0858adca947bc33fb  4
39666a280cd648579a4ad0f800aa7261  3
62eb0e44cb794e9db922a20fcfb9d606  3
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (29441 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 12:24:03.204468  9681 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.9.116.126:44563
I20260709 12:24:03.205928  9681 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:24:03.213464 10727 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:03.214639 10728 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:03.215459 10730 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:03.217139  9681 server_base.cc:1061] running on GCE node
I20260709 12:24:03.218273  9681 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:24:03.218508  9681 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:24:03.218679  9681 hybrid_clock.cc:648] HybridClock initialized: now 1783599843218664 us; error 0 us; skew 500 ppm
I20260709 12:24:03.219233  9681 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:24:03.222617  9681 webserver.cc:533] Webserver started at http://127.9.116.126:39115/ using document root <none> and password file <none>
I20260709 12:24:03.223377  9681 fs_manager.cc:362] Metadata directory not provided
I20260709 12:24:03.223663  9681 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:24:03.224018  9681 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:24:03.225417  9681 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599781984018-9681-0/minicluster-data/master-0-root/instance:
uuid: "9619ad7a9e7f4d9b8039487e3ee77243"
format_stamp: "Formatted at 2026-07-09 12:24:03 on dist-test-slave-zk51"
I20260709 12:24:03.231305  9681 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.001s
I20260709 12:24:03.236002 10735 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:03.237286  9681 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:24:03.237874  9681 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599781984018-9681-0/minicluster-data/master-0-root
uuid: "9619ad7a9e7f4d9b8039487e3ee77243"
format_stamp: "Formatted at 2026-07-09 12:24:03 on dist-test-slave-zk51"
I20260709 12:24:03.238559  9681 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599781984018-9681-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599781984018-9681-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599781984018-9681-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:24:03.271236  9681 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:24:03.272748  9681 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:24:03.322291  9681 rpc_server.cc:307] RPC server started. Bound to: 127.9.116.126:44563
I20260709 12:24:03.322381 10786 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.116.126:44563 every 8 connection(s)
I20260709 12:24:03.327792 10787 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:03.340849 10787 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9619ad7a9e7f4d9b8039487e3ee77243: Bootstrap starting.
I20260709 12:24:03.347157 10787 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9619ad7a9e7f4d9b8039487e3ee77243: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:03.351866 10787 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9619ad7a9e7f4d9b8039487e3ee77243: No bootstrap required, opened a new log
I20260709 12:24:03.354269 10787 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9619ad7a9e7f4d9b8039487e3ee77243 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9619ad7a9e7f4d9b8039487e3ee77243" member_type: VOTER }
I20260709 12:24:03.354736 10787 raft_consensus.cc:385] T 00000000000000000000000000000000 P 9619ad7a9e7f4d9b8039487e3ee77243 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:03.354948 10787 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9619ad7a9e7f4d9b8039487e3ee77243 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9619ad7a9e7f4d9b8039487e3ee77243, State: Initialized, Role: FOLLOWER
I20260709 12:24:03.355592 10787 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9619ad7a9e7f4d9b8039487e3ee77243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9619ad7a9e7f4d9b8039487e3ee77243" member_type: VOTER }
I20260709 12:24:03.356101 10787 raft_consensus.cc:399] T 00000000000000000000000000000000 P 9619ad7a9e7f4d9b8039487e3ee77243 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:24:03.356298 10787 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9619ad7a9e7f4d9b8039487e3ee77243 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:24:03.356529 10787 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9619ad7a9e7f4d9b8039487e3ee77243 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:03.362134 10787 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9619ad7a9e7f4d9b8039487e3ee77243 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9619ad7a9e7f4d9b8039487e3ee77243" member_type: VOTER }
I20260709 12:24:03.362949 10787 leader_election.cc:304] T 00000000000000000000000000000000 P 9619ad7a9e7f4d9b8039487e3ee77243 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9619ad7a9e7f4d9b8039487e3ee77243; no voters: 
I20260709 12:24:03.364701 10787 leader_election.cc:290] T 00000000000000000000000000000000 P 9619ad7a9e7f4d9b8039487e3ee77243 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:24:03.365347 10790 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9619ad7a9e7f4d9b8039487e3ee77243 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:03.367314 10790 raft_consensus.cc:697] T 00000000000000000000000000000000 P 9619ad7a9e7f4d9b8039487e3ee77243 [term 1 LEADER]: Becoming Leader. State: Replica: 9619ad7a9e7f4d9b8039487e3ee77243, State: Running, Role: LEADER
I20260709 12:24:03.368008 10787 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9619ad7a9e7f4d9b8039487e3ee77243 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:24:03.368234 10790 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9619ad7a9e7f4d9b8039487e3ee77243 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9619ad7a9e7f4d9b8039487e3ee77243" member_type: VOTER }
I20260709 12:24:03.373919 10791 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9619ad7a9e7f4d9b8039487e3ee77243 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9619ad7a9e7f4d9b8039487e3ee77243" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9619ad7a9e7f4d9b8039487e3ee77243" member_type: VOTER } }
I20260709 12:24:03.374647 10791 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9619ad7a9e7f4d9b8039487e3ee77243 [sys.catalog]: This master's current role is: LEADER
I20260709 12:24:03.374711 10792 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9619ad7a9e7f4d9b8039487e3ee77243 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9619ad7a9e7f4d9b8039487e3ee77243. Latest consensus state: current_term: 1 leader_uuid: "9619ad7a9e7f4d9b8039487e3ee77243" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9619ad7a9e7f4d9b8039487e3ee77243" member_type: VOTER } }
I20260709 12:24:03.375281 10792 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9619ad7a9e7f4d9b8039487e3ee77243 [sys.catalog]: This master's current role is: LEADER
I20260709 12:24:03.377976 10798 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:24:03.388141 10798 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:24:03.389369  9681 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:24:03.400110 10798 catalog_manager.cc:1383] Generated new cluster ID: 59831700301d4bbe8e561ee38ef5ef7e
I20260709 12:24:03.400454 10798 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:24:03.425650 10798 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:24:03.427326 10798 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:24:03.446921 10798 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 9619ad7a9e7f4d9b8039487e3ee77243: Generated new TSK 0
I20260709 12:24:03.447609 10798 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:24:03.456670  9681 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:24:03.462940 10808 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:03.464769 10809 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:03.466753 10811 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:03.468191  9681 server_base.cc:1061] running on GCE node
I20260709 12:24:03.469174  9681 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:24:03.469393  9681 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:24:03.469581  9681 hybrid_clock.cc:648] HybridClock initialized: now 1783599843469558 us; error 0 us; skew 500 ppm
I20260709 12:24:03.470292  9681 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:24:03.473325  9681 webserver.cc:533] Webserver started at http://127.9.116.65:35505/ using document root <none> and password file <none>
I20260709 12:24:03.473896  9681 fs_manager.cc:362] Metadata directory not provided
I20260709 12:24:03.474071  9681 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:24:03.474436  9681 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:24:03.475770  9681 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599781984018-9681-0/minicluster-data/ts-0-root/instance:
uuid: "80cd7d227db44f34a6108591dad9c040"
format_stamp: "Formatted at 2026-07-09 12:24:03 on dist-test-slave-zk51"
I20260709 12:24:03.481199  9681 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:24:03.486047 10816 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:03.487136  9681 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:24:03.487618  9681 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599781984018-9681-0/minicluster-data/ts-0-root
uuid: "80cd7d227db44f34a6108591dad9c040"
format_stamp: "Formatted at 2026-07-09 12:24:03 on dist-test-slave-zk51"
I20260709 12:24:03.487996  9681 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599781984018-9681-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599781984018-9681-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599781984018-9681-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:24:03.530843  9681 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:24:03.532815  9681 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:24:03.534489  9681 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:24:03.536916  9681 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:24:03.537175  9681 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:03.537442  9681 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:24:03.537635  9681 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:03.591651  9681 rpc_server.cc:307] RPC server started. Bound to: 127.9.116.65:46265
I20260709 12:24:03.591776 10878 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.116.65:46265 every 8 connection(s)
I20260709 12:24:03.597038  9681 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:24:03.607012 10884 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:03.609048 10886 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:03.607784 10883 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:03.610620  9681 server_base.cc:1061] running on GCE node
I20260709 12:24:03.612754  9681 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:24:03.613037  9681 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:24:03.613273  9681 hybrid_clock.cc:648] HybridClock initialized: now 1783599843613251 us; error 0 us; skew 500 ppm
I20260709 12:24:03.614140  9681 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:24:03.617936  9681 webserver.cc:533] Webserver started at http://127.9.116.66:40671/ using document root <none> and password file <none>
I20260709 12:24:03.618839  9681 fs_manager.cc:362] Metadata directory not provided
I20260709 12:24:03.619110  9681 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:24:03.619463  9681 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:24:03.620428 10879 heartbeater.cc:344] Connected to a master server at 127.9.116.126:44563
I20260709 12:24:03.621124 10879 heartbeater.cc:461] Registering TS with master...
I20260709 12:24:03.621188  9681 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599781984018-9681-0/minicluster-data/ts-1-root/instance:
uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
format_stamp: "Formatted at 2026-07-09 12:24:03 on dist-test-slave-zk51"
I20260709 12:24:03.622483 10879 heartbeater.cc:507] Master 127.9.116.126:44563 requested a full tablet report, sending...
I20260709 12:24:03.625408 10752 ts_manager.cc:194] Registered new tserver with Master: 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265)
I20260709 12:24:03.627763  9681 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:24:03.628159 10752 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60730
I20260709 12:24:03.632323 10891 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:03.633486  9681 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:24:03.633898  9681 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599781984018-9681-0/minicluster-data/ts-1-root
uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
format_stamp: "Formatted at 2026-07-09 12:24:03 on dist-test-slave-zk51"
I20260709 12:24:03.634285  9681 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599781984018-9681-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599781984018-9681-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599781984018-9681-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:24:03.650007  9681 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:24:03.651746  9681 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:24:03.653626  9681 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:24:03.656661  9681 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:24:03.656973  9681 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:03.657260  9681 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:24:03.657452  9681 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:03.709255  9681 rpc_server.cc:307] RPC server started. Bound to: 127.9.116.66:39339
I20260709 12:24:03.709349 10953 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.116.66:39339 every 8 connection(s)
I20260709 12:24:03.715538  9681 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:24:03.725208 10957 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:03.727752 10958 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:03.735008 10960 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:03.736411  9681 server_base.cc:1061] running on GCE node
I20260709 12:24:03.738962  9681 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:24:03.739221 10954 heartbeater.cc:344] Connected to a master server at 127.9.116.126:44563
W20260709 12:24:03.739346  9681 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:24:03.739691  9681 hybrid_clock.cc:648] HybridClock initialized: now 1783599843739663 us; error 0 us; skew 500 ppm
I20260709 12:24:03.739863 10954 heartbeater.cc:461] Registering TS with master...
I20260709 12:24:03.740700  9681 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:24:03.741110 10954 heartbeater.cc:507] Master 127.9.116.126:44563 requested a full tablet report, sending...
I20260709 12:24:03.744975  9681 webserver.cc:533] Webserver started at http://127.9.116.67:43947/ using document root <none> and password file <none>
I20260709 12:24:03.744974 10752 ts_manager.cc:194] Registered new tserver with Master: e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:03.746032  9681 fs_manager.cc:362] Metadata directory not provided
I20260709 12:24:03.746371  9681 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:24:03.746763  9681 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:24:03.747750 10752 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60734
I20260709 12:24:03.748756  9681 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599781984018-9681-0/minicluster-data/ts-2-root/instance:
uuid: "edcc56ddd3264984b4da6c1db59e7f08"
format_stamp: "Formatted at 2026-07-09 12:24:03 on dist-test-slave-zk51"
I20260709 12:24:03.754617  9681 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:24:03.759135 10965 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:03.760368  9681 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:24:03.760741  9681 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599781984018-9681-0/minicluster-data/ts-2-root
uuid: "edcc56ddd3264984b4da6c1db59e7f08"
format_stamp: "Formatted at 2026-07-09 12:24:03 on dist-test-slave-zk51"
I20260709 12:24:03.761340  9681 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599781984018-9681-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599781984018-9681-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599781984018-9681-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:24:03.776889  9681 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:24:03.778429  9681 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:24:03.780459  9681 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:24:03.783545  9681 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:24:03.784024  9681 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:24:03.784329  9681 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:24:03.784488  9681 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:03.834401  9681 rpc_server.cc:307] RPC server started. Bound to: 127.9.116.67:39945
I20260709 12:24:03.834543 11027 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.116.67:39945 every 8 connection(s)
I20260709 12:24:03.851773 11028 heartbeater.cc:344] Connected to a master server at 127.9.116.126:44563
I20260709 12:24:03.852303 11028 heartbeater.cc:461] Registering TS with master...
I20260709 12:24:03.853158 11028 heartbeater.cc:507] Master 127.9.116.126:44563 requested a full tablet report, sending...
I20260709 12:24:03.855983 10752 ts_manager.cc:194] Registered new tserver with Master: edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:03.856243  9681 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.018067523s
I20260709 12:24:03.858269 10752 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60736
I20260709 12:24:03.890349 10752 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60750:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:24:03.897521 10752 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:24:04.130121 10919 tablet_service.cc:1511] Processing CreateTablet for tablet 26c7a4ac9606419a90700eec61a02bd8 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:24:04.132140 10918 tablet_service.cc:1511] Processing CreateTablet for tablet 3ad755c012434396a53498486697a9b4 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:24:04.133626 10919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26c7a4ac9606419a90700eec61a02bd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.134673 10915 tablet_service.cc:1511] Processing CreateTablet for tablet 442726a7f1e441248ec80a98b31eb341 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:24:04.136454 10915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 442726a7f1e441248ec80a98b31eb341. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.136797 10916 tablet_service.cc:1511] Processing CreateTablet for tablet 9b5cbc6740ba4e518cfc3499d4a01d2a (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:24:04.138514 10916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b5cbc6740ba4e518cfc3499d4a01d2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.134802 10917 tablet_service.cc:1511] Processing CreateTablet for tablet 9211e3b6d81447798824045b9515c0ee (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:24:04.142318 10917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9211e3b6d81447798824045b9515c0ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.148082 10918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ad755c012434396a53498486697a9b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.164484 11043 tablet_bootstrap.cc:492] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea: Bootstrap starting.
I20260709 12:24:04.165971 10993 tablet_service.cc:1511] Processing CreateTablet for tablet 26c7a4ac9606419a90700eec61a02bd8 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:24:04.167725 10993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26c7a4ac9606419a90700eec61a02bd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.175067 10915 tablet_service.cc:1511] Processing CreateTablet for tablet 1e97a41f10c041deb11464b469d0b5dd (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:24:04.175949 10992 tablet_service.cc:1511] Processing CreateTablet for tablet 3ad755c012434396a53498486697a9b4 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:24:04.176589 10915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e97a41f10c041deb11464b469d0b5dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.177331 10992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ad755c012434396a53498486697a9b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.178258 10989 tablet_service.cc:1511] Processing CreateTablet for tablet 442726a7f1e441248ec80a98b31eb341 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:24:04.179678 10989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 442726a7f1e441248ec80a98b31eb341. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.184938 10990 tablet_service.cc:1511] Processing CreateTablet for tablet 9b5cbc6740ba4e518cfc3499d4a01d2a (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:24:04.186609 10990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b5cbc6740ba4e518cfc3499d4a01d2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.188020 11043 tablet_bootstrap.cc:654] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:04.188822 10991 tablet_service.cc:1511] Processing CreateTablet for tablet 9211e3b6d81447798824045b9515c0ee (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:24:04.190155 10991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9211e3b6d81447798824045b9515c0ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.194981 10988 tablet_service.cc:1511] Processing CreateTablet for tablet 1e97a41f10c041deb11464b469d0b5dd (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:24:04.196468 10988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e97a41f10c041deb11464b469d0b5dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.209757 10844 tablet_service.cc:1511] Processing CreateTablet for tablet 26c7a4ac9606419a90700eec61a02bd8 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:24:04.211202 10844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26c7a4ac9606419a90700eec61a02bd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.212911 10843 tablet_service.cc:1511] Processing CreateTablet for tablet 3ad755c012434396a53498486697a9b4 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:24:04.214428 10843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ad755c012434396a53498486697a9b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.214728 10839 tablet_service.cc:1511] Processing CreateTablet for tablet 1e97a41f10c041deb11464b469d0b5dd (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:24:04.216159 10839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e97a41f10c041deb11464b469d0b5dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.221048 10838 tablet_service.cc:1511] Processing CreateTablet for tablet 63acd3ecccdf41f5856ce30bc68864e8 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:24:04.222812 10838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63acd3ecccdf41f5856ce30bc68864e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.223233 10841 tablet_service.cc:1511] Processing CreateTablet for tablet 9b5cbc6740ba4e518cfc3499d4a01d2a (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:24:04.225082 10841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b5cbc6740ba4e518cfc3499d4a01d2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.221047 10840 tablet_service.cc:1511] Processing CreateTablet for tablet 442726a7f1e441248ec80a98b31eb341 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:24:04.228614 10840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 442726a7f1e441248ec80a98b31eb341. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.229112 10842 tablet_service.cc:1511] Processing CreateTablet for tablet 9211e3b6d81447798824045b9515c0ee (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:24:04.230624 10842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9211e3b6d81447798824045b9515c0ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.245142 11045 tablet_bootstrap.cc:492] T 442726a7f1e441248ec80a98b31eb341 P edcc56ddd3264984b4da6c1db59e7f08: Bootstrap starting.
I20260709 12:24:04.252976 11045 tablet_bootstrap.cc:654] T 442726a7f1e441248ec80a98b31eb341 P edcc56ddd3264984b4da6c1db59e7f08: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:04.262224 10917 tablet_service.cc:1511] Processing CreateTablet for tablet 63acd3ecccdf41f5856ce30bc68864e8 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:24:04.264189 10989 tablet_service.cc:1511] Processing CreateTablet for tablet 63acd3ecccdf41f5856ce30bc68864e8 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:24:04.265033 10917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63acd3ecccdf41f5856ce30bc68864e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.265175 10837 tablet_service.cc:1511] Processing CreateTablet for tablet 9f0dd1f84a304be0be5f4e4bf2aae6de (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:24:04.265647 10989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63acd3ecccdf41f5856ce30bc68864e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.266845 10837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f0dd1f84a304be0be5f4e4bf2aae6de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.270828 11043 tablet_bootstrap.cc:492] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea: No bootstrap required, opened a new log
I20260709 12:24:04.271399 11043 ts_tablet_manager.cc:1403] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent bootstrapping tablet: real 0.108s	user 0.018s	sys 0.004s
I20260709 12:24:04.285250 11043 raft_consensus.cc:359] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:04.286281 11043 raft_consensus.cc:385] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:04.286681 11043 raft_consensus.cc:740] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Initialized, Role: FOLLOWER
I20260709 12:24:04.290194 10916 tablet_service.cc:1511] Processing CreateTablet for tablet 9f0dd1f84a304be0be5f4e4bf2aae6de (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:24:04.291599 10916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f0dd1f84a304be0be5f4e4bf2aae6de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.298623 10992 tablet_service.cc:1511] Processing CreateTablet for tablet 9f0dd1f84a304be0be5f4e4bf2aae6de (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:24:04.300060 10992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f0dd1f84a304be0be5f4e4bf2aae6de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.302268 11045 tablet_bootstrap.cc:492] T 442726a7f1e441248ec80a98b31eb341 P edcc56ddd3264984b4da6c1db59e7f08: No bootstrap required, opened a new log
I20260709 12:24:04.302914 11045 ts_tablet_manager.cc:1403] T 442726a7f1e441248ec80a98b31eb341 P edcc56ddd3264984b4da6c1db59e7f08: Time spent bootstrapping tablet: real 0.058s	user 0.015s	sys 0.006s
I20260709 12:24:04.305119 11047 tablet_bootstrap.cc:492] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040: Bootstrap starting.
I20260709 12:24:04.306922 11045 raft_consensus.cc:359] T 442726a7f1e441248ec80a98b31eb341 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:04.306784 10840 tablet_service.cc:1511] Processing CreateTablet for tablet e3d9a61ecaf84695b70f8519ee57706f (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:24:04.308085 11045 raft_consensus.cc:385] T 442726a7f1e441248ec80a98b31eb341 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:04.308466 11045 raft_consensus.cc:740] T 442726a7f1e441248ec80a98b31eb341 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Initialized, Role: FOLLOWER
I20260709 12:24:04.309486 10840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3d9a61ecaf84695b70f8519ee57706f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.309223 11045 consensus_queue.cc:260] T 442726a7f1e441248ec80a98b31eb341 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:04.312548 10918 tablet_service.cc:1511] Processing CreateTablet for tablet e3d9a61ecaf84695b70f8519ee57706f (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:24:04.314182 10988 tablet_service.cc:1511] Processing CreateTablet for tablet e3d9a61ecaf84695b70f8519ee57706f (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:24:04.322064 10918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3d9a61ecaf84695b70f8519ee57706f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.322928 10988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3d9a61ecaf84695b70f8519ee57706f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.327116 11028 heartbeater.cc:499] Master 127.9.116.126:44563 was elected leader, sending a full tablet report...
I20260709 12:24:04.327813 11045 ts_tablet_manager.cc:1434] T 442726a7f1e441248ec80a98b31eb341 P edcc56ddd3264984b4da6c1db59e7f08: Time spent starting tablet: real 0.025s	user 0.010s	sys 0.006s
I20260709 12:24:04.328886 11045 tablet_bootstrap.cc:492] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08: Bootstrap starting.
I20260709 12:24:04.312543 11043 consensus_queue.cc:260] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:04.340058 10841 tablet_service.cc:1511] Processing CreateTablet for tablet 07a194e99ec5435b9e871484ecb661a1 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:24:04.341496 10841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07a194e99ec5435b9e871484ecb661a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.347664 11045 tablet_bootstrap.cc:654] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:04.348198 10916 tablet_service.cc:1511] Processing CreateTablet for tablet 07a194e99ec5435b9e871484ecb661a1 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:24:04.349627 10916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07a194e99ec5435b9e871484ecb661a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.350416 11047 tablet_bootstrap.cc:654] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:04.360867 10842 tablet_service.cc:1511] Processing CreateTablet for tablet a6a28416571247df878823d464c05f1e (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:24:04.362841 10842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6a28416571247df878823d464c05f1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.365201 10988 tablet_service.cc:1511] Processing CreateTablet for tablet 07a194e99ec5435b9e871484ecb661a1 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:24:04.367223 10988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07a194e99ec5435b9e871484ecb661a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.368209 11048 raft_consensus.cc:493] T 442726a7f1e441248ec80a98b31eb341 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:04.368865 11048 raft_consensus.cc:515] T 442726a7f1e441248ec80a98b31eb341 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:04.369506 10917 tablet_service.cc:1511] Processing CreateTablet for tablet a6a28416571247df878823d464c05f1e (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:24:04.370915 10917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6a28416571247df878823d464c05f1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.377338 10954 heartbeater.cc:499] Master 127.9.116.126:44563 was elected leader, sending a full tablet report...
I20260709 12:24:04.379173 11043 ts_tablet_manager.cc:1434] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent starting tablet: real 0.103s	user 0.011s	sys 0.002s
I20260709 12:24:04.380638 11043 tablet_bootstrap.cc:492] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea: Bootstrap starting.
W20260709 12:24:04.381759 10800 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:24:04.377337 11048 leader_election.cc:290] T 442726a7f1e441248ec80a98b31eb341 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:04.389982 11047 tablet_bootstrap.cc:492] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040: No bootstrap required, opened a new log
I20260709 12:24:04.390499 11047 ts_tablet_manager.cc:1403] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040: Time spent bootstrapping tablet: real 0.086s	user 0.013s	sys 0.000s
I20260709 12:24:04.393512 11047 raft_consensus.cc:359] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:04.393726 10990 tablet_service.cc:1511] Processing CreateTablet for tablet a6a28416571247df878823d464c05f1e (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:24:04.394263 11047 raft_consensus.cc:385] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:04.394639 11047 raft_consensus.cc:740] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Initialized, Role: FOLLOWER
I20260709 12:24:04.395210 10990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6a28416571247df878823d464c05f1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.398428 11043 tablet_bootstrap.cc:654] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:04.405922 11047 consensus_queue.cc:260] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:04.418574 11045 tablet_bootstrap.cc:492] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08: No bootstrap required, opened a new log
I20260709 12:24:04.419153 11045 ts_tablet_manager.cc:1403] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08: Time spent bootstrapping tablet: real 0.091s	user 0.027s	sys 0.019s
I20260709 12:24:04.425033 11045 raft_consensus.cc:359] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:04.427134 10879 heartbeater.cc:499] Master 127.9.116.126:44563 was elected leader, sending a full tablet report...
I20260709 12:24:04.427385 11045 raft_consensus.cc:385] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:04.427786 11045 raft_consensus.cc:740] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Initialized, Role: FOLLOWER
I20260709 12:24:04.428495 10916 tablet_service.cc:1511] Processing CreateTablet for tablet 1bf2fcbf6a2d4432a846a1e5cfa1c52a (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:24:04.429423 10840 tablet_service.cc:1511] Processing CreateTablet for tablet 1bf2fcbf6a2d4432a846a1e5cfa1c52a (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:24:04.429867 10916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bf2fcbf6a2d4432a846a1e5cfa1c52a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.430670 10840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bf2fcbf6a2d4432a846a1e5cfa1c52a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.428536 11045 consensus_queue.cc:260] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:04.433787 10992 tablet_service.cc:1511] Processing CreateTablet for tablet 1bf2fcbf6a2d4432a846a1e5cfa1c52a (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:24:04.435118 10992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bf2fcbf6a2d4432a846a1e5cfa1c52a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.435356 11045 ts_tablet_manager.cc:1434] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.004s
I20260709 12:24:04.449522 10989 tablet_service.cc:1511] Processing CreateTablet for tablet 438b1d5ca177401b94c157e6f4836150 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:24:04.449594 10918 tablet_service.cc:1511] Processing CreateTablet for tablet 438b1d5ca177401b94c157e6f4836150 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:24:04.451152 10918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 438b1d5ca177401b94c157e6f4836150. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.455986 11043 tablet_bootstrap.cc:492] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea: No bootstrap required, opened a new log
I20260709 12:24:04.456730 11043 ts_tablet_manager.cc:1403] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent bootstrapping tablet: real 0.076s	user 0.015s	sys 0.014s
I20260709 12:24:04.451118 10989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 438b1d5ca177401b94c157e6f4836150. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.458137 11045 tablet_bootstrap.cc:492] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08: Bootstrap starting.
I20260709 12:24:04.464954 11047 ts_tablet_manager.cc:1434] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040: Time spent starting tablet: real 0.074s	user 0.001s	sys 0.007s
I20260709 12:24:04.466879 10841 tablet_service.cc:1511] Processing CreateTablet for tablet 438b1d5ca177401b94c157e6f4836150 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:24:04.473256 10841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 438b1d5ca177401b94c157e6f4836150. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.470515 11047 tablet_bootstrap.cc:492] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040: Bootstrap starting.
I20260709 12:24:04.476794 11049 raft_consensus.cc:493] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:04.477340 11049 raft_consensus.cc:515] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:04.471673 11043 raft_consensus.cc:359] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } }
I20260709 12:24:04.479399 11043 raft_consensus.cc:385] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:04.479791 11043 raft_consensus.cc:740] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Initialized, Role: FOLLOWER
I20260709 12:24:04.481824 11049 leader_election.cc:290] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:04.486384 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
W20260709 12:24:04.488461 10968 leader_election.cc:343] T 442726a7f1e441248ec80a98b31eb341 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:04.483546 11043 consensus_queue.cc:260] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } }
I20260709 12:24:04.499737 11043 ts_tablet_manager.cc:1434] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.003s
I20260709 12:24:04.499452 10842 tablet_service.cc:1511] Processing CreateTablet for tablet 266989ea58c040cea1d5f1b425ba2d3b (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:24:04.501509 11043 tablet_bootstrap.cc:492] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea: Bootstrap starting.
I20260709 12:24:04.501730 10842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 266989ea58c040cea1d5f1b425ba2d3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.514830 11043 tablet_bootstrap.cc:654] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:04.523028 11045 tablet_bootstrap.cc:654] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:04.533902 10917 tablet_service.cc:1511] Processing CreateTablet for tablet 266989ea58c040cea1d5f1b425ba2d3b (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:24:04.537358 11047 tablet_bootstrap.cc:654] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:04.544906 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:04.550007 10929 raft_consensus.cc:2468] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 0.
I20260709 12:24:04.550853 10844 tablet_service.cc:1511] Processing CreateTablet for tablet 8b297008d51d40b98784ce74e225b8f5 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:24:04.553399 10844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b297008d51d40b98784ce74e225b8f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.553929 10992 tablet_service.cc:1511] Processing CreateTablet for tablet 266989ea58c040cea1d5f1b425ba2d3b (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:24:04.555876 10992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 266989ea58c040cea1d5f1b425ba2d3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.545279 10917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 266989ea58c040cea1d5f1b425ba2d3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.563381 11043 tablet_bootstrap.cc:492] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea: No bootstrap required, opened a new log
I20260709 12:24:04.564067 11043 ts_tablet_manager.cc:1403] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea: Time spent bootstrapping tablet: real 0.063s	user 0.021s	sys 0.009s
I20260709 12:24:04.564940 10918 tablet_service.cc:1511] Processing CreateTablet for tablet 8b297008d51d40b98784ce74e225b8f5 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:24:04.566360 10918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b297008d51d40b98784ce74e225b8f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.568005 11043 raft_consensus.cc:359] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:04.568295 10968 leader_election.cc:304] T 442726a7f1e441248ec80a98b31eb341 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:24:04.571046 11048 raft_consensus.cc:2804] T 442726a7f1e441248ec80a98b31eb341 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:04.571444 11048 raft_consensus.cc:493] T 442726a7f1e441248ec80a98b31eb341 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:04.571848 11048 raft_consensus.cc:3060] T 442726a7f1e441248ec80a98b31eb341 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:04.572695 10988 tablet_service.cc:1511] Processing CreateTablet for tablet 8b297008d51d40b98784ce74e225b8f5 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:24:04.574113 10988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b297008d51d40b98784ce74e225b8f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.579290 10915 tablet_service.cc:1511] Processing CreateTablet for tablet 02a088f690eb45beb958d74519a39b7f (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:24:04.579732 10919 tablet_service.cc:1511] Processing CreateTablet for tablet 60dca008c268416c8e63091506d1653e (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:24:04.580734 10915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02a088f690eb45beb958d74519a39b7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.581259 10990 tablet_service.cc:1511] Processing CreateTablet for tablet 02a088f690eb45beb958d74519a39b7f (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:24:04.581786 10993 tablet_service.cc:1511] Processing CreateTablet for tablet 60dca008c268416c8e63091506d1653e (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:24:04.582508 10990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02a088f690eb45beb958d74519a39b7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.583117 10919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60dca008c268416c8e63091506d1653e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.584589 10837 tablet_service.cc:1511] Processing CreateTablet for tablet 60dca008c268416c8e63091506d1653e (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:24:04.585834 10837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60dca008c268416c8e63091506d1653e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.588016 10993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60dca008c268416c8e63091506d1653e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.569303 11043 raft_consensus.cc:385] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:04.595940 11043 raft_consensus.cc:740] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Initialized, Role: FOLLOWER
I20260709 12:24:04.597703 10842 tablet_service.cc:1511] Processing CreateTablet for tablet 02a088f690eb45beb958d74519a39b7f (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:24:04.599067 10842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02a088f690eb45beb958d74519a39b7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.606083 10839 tablet_service.cc:1511] Processing CreateTablet for tablet 1f0741f995c74b5c91290f42110a3187 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:24:04.607695 10839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f0741f995c74b5c91290f42110a3187. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.613145 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
W20260709 12:24:04.615770 10894 leader_election.cc:343] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:04.615947 11043 consensus_queue.cc:260] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:04.620216 11043 ts_tablet_manager.cc:1434] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea: Time spent starting tablet: real 0.056s	user 0.008s	sys 0.001s
I20260709 12:24:04.627303 10916 tablet_service.cc:1511] Processing CreateTablet for tablet 1f0741f995c74b5c91290f42110a3187 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:24:04.628159 11043 tablet_bootstrap.cc:492] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea: Bootstrap starting.
I20260709 12:24:04.629228 10916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f0741f995c74b5c91290f42110a3187. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.632740 10989 tablet_service.cc:1511] Processing CreateTablet for tablet 1f0741f995c74b5c91290f42110a3187 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:24:04.634256 10989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f0741f995c74b5c91290f42110a3187. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.637457 11054 raft_consensus.cc:493] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:04.637992 11054 raft_consensus.cc:515] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:04.587971 11048 raft_consensus.cc:515] T 442726a7f1e441248ec80a98b31eb341 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:04.648475 11054 leader_election.cc:290] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:04.651494 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:04.652848 11003 raft_consensus.cc:2393] T 442726a7f1e441248ec80a98b31eb341 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 1: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:24:04.655045 10895 leader_election.cc:304] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:04.656425 11049 raft_consensus.cc:3060] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:04.657104 11045 tablet_bootstrap.cc:492] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08: No bootstrap required, opened a new log
I20260709 12:24:04.657632 11045 ts_tablet_manager.cc:1403] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08: Time spent bootstrapping tablet: real 0.200s	user 0.014s	sys 0.017s
I20260709 12:24:04.658949 11043 tablet_bootstrap.cc:654] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:04.659890 11048 leader_election.cc:290] T 442726a7f1e441248ec80a98b31eb341 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:04.661567 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:04.669474 11047 tablet_bootstrap.cc:492] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040: No bootstrap required, opened a new log
I20260709 12:24:04.670655 11047 ts_tablet_manager.cc:1403] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040: Time spent bootstrapping tablet: real 0.200s	user 0.020s	sys 0.001s
I20260709 12:24:04.665957 11049 raft_consensus.cc:2749] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:04.680406 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:04.680583 10991 tablet_service.cc:1511] Processing CreateTablet for tablet 54df1a3d45b746398c2831883d796c6d (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:24:04.682154 10991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54df1a3d45b746398c2831883d796c6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.682310 10844 tablet_service.cc:1511] Processing CreateTablet for tablet 54df1a3d45b746398c2831883d796c6d (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:24:04.683635 10844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54df1a3d45b746398c2831883d796c6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.687626 10917 tablet_service.cc:1511] Processing CreateTablet for tablet 54df1a3d45b746398c2831883d796c6d (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:24:04.689059 10917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54df1a3d45b746398c2831883d796c6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.691221 10915 tablet_service.cc:1511] Processing CreateTablet for tablet 53b0e2cbee394228af2190d22e7ea9ef (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:24:04.693102 10915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53b0e2cbee394228af2190d22e7ea9ef. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:24:04.701985 10968 leader_election.cc:343] T 442726a7f1e441248ec80a98b31eb341 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:04.709017 10987 tablet_service.cc:1511] Processing CreateTablet for tablet 53b0e2cbee394228af2190d22e7ea9ef (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:24:04.710656 10987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53b0e2cbee394228af2190d22e7ea9ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.711160 11047 raft_consensus.cc:359] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:04.712239 11047 raft_consensus.cc:385] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:04.712689 11047 raft_consensus.cc:740] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Initialized, Role: FOLLOWER
I20260709 12:24:04.724764 11043 tablet_bootstrap.cc:492] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea: No bootstrap required, opened a new log
I20260709 12:24:04.725402 11043 ts_tablet_manager.cc:1403] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent bootstrapping tablet: real 0.098s	user 0.009s	sys 0.006s
I20260709 12:24:04.727421 11047 consensus_queue.cc:260] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:04.731319 11054 raft_consensus.cc:493] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:04.731953 11054 raft_consensus.cc:515] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:04.733237 10839 tablet_service.cc:1511] Processing CreateTablet for tablet 53b0e2cbee394228af2190d22e7ea9ef (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:24:04.734220 11054 leader_election.cc:290] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:04.734710 10839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53b0e2cbee394228af2190d22e7ea9ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.735360 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:04.735831 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:04.736148 10928 raft_consensus.cc:2468] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 0.
I20260709 12:24:04.737658 10819 leader_election.cc:304] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:04.739061 11054 raft_consensus.cc:2804] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:04.739500 11054 raft_consensus.cc:493] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:04.739921 11054 raft_consensus.cc:3060] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:04.736166 11047 ts_tablet_manager.cc:1434] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040: Time spent starting tablet: real 0.061s	user 0.007s	sys 0.000s
I20260709 12:24:04.741236 10929 raft_consensus.cc:2468] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 1.
I20260709 12:24:04.741688 11047 tablet_bootstrap.cc:492] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040: Bootstrap starting.
I20260709 12:24:04.744318 11045 raft_consensus.cc:359] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } }
I20260709 12:24:04.745112 11045 raft_consensus.cc:385] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:04.745424 11045 raft_consensus.cc:740] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Initialized, Role: FOLLOWER
I20260709 12:24:04.746402 11045 consensus_queue.cc:260] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } }
I20260709 12:24:04.751391 11043 raft_consensus.cc:359] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:04.752297 11043 raft_consensus.cc:385] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:04.752614 11043 raft_consensus.cc:740] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Initialized, Role: FOLLOWER
I20260709 12:24:04.755053 11054 raft_consensus.cc:515] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:04.757961 10841 tablet_service.cc:1511] Processing CreateTablet for tablet cb220f7497ef4e739938460527b9d6f0 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:24:04.759402 10841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb220f7497ef4e739938460527b9d6f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.760640 10914 tablet_service.cc:1511] Processing CreateTablet for tablet cb220f7497ef4e739938460527b9d6f0 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:24:04.762096 10914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb220f7497ef4e739938460527b9d6f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.762573 10989 tablet_service.cc:1511] Processing CreateTablet for tablet cb220f7497ef4e739938460527b9d6f0 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:24:04.763836 10989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb220f7497ef4e739938460527b9d6f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.766721 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:24:04.769428 10820 leader_election.cc:343] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:04.771327 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:04.771900 11049 raft_consensus.cc:493] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:04.772166 11003 raft_consensus.cc:2393] T 442726a7f1e441248ec80a98b31eb341 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 1: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:24:04.772411 11049 raft_consensus.cc:515] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } }
I20260709 12:24:04.773505 10820 leader_election.cc:304] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:04.775144 11049 leader_election.cc:290] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265)
I20260709 12:24:04.776788 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:04.777216 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:04.778029 11003 raft_consensus.cc:2468] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 0.
W20260709 12:24:04.778504 10894 leader_election.cc:343] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:04.779964 10895 leader_election.cc:304] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:24:04.779520 11043 consensus_queue.cc:260] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:04.784670 11049 raft_consensus.cc:493] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:04.785542 11045 ts_tablet_manager.cc:1434] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08: Time spent starting tablet: real 0.128s	user 0.007s	sys 0.002s
I20260709 12:24:04.785140 11049 raft_consensus.cc:515] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:04.786603 11045 tablet_bootstrap.cc:492] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08: Bootstrap starting.
I20260709 12:24:04.796435 10991 tablet_service.cc:1511] Processing CreateTablet for tablet 73f1f3589fd343ba9289b327b8b35837 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:24:04.797799 10991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73f1f3589fd343ba9289b327b8b35837. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.798381 11047 tablet_bootstrap.cc:654] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:04.802953 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
W20260709 12:24:04.813239 10894 leader_election.cc:343] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:04.822495 11043 ts_tablet_manager.cc:1434] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent starting tablet: real 0.097s	user 0.000s	sys 0.018s
I20260709 12:24:04.824220 11043 tablet_bootstrap.cc:492] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea: Bootstrap starting.
I20260709 12:24:04.829758 11064 raft_consensus.cc:3060] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:04.835332 11054 leader_election.cc:290] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:24:04.836514 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 56672.4us
I20260709 12:24:04.836707 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:04.837376 10929 raft_consensus.cc:3060] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:04.837714 10968 leader_election.cc:304] T 442726a7f1e441248ec80a98b31eb341 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:24:04.839150 11048 raft_consensus.cc:2804] T 442726a7f1e441248ec80a98b31eb341 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:04.844918 11065 raft_consensus.cc:2804] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:04.845368 11065 raft_consensus.cc:493] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:04.845710 11065 raft_consensus.cc:3060] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:04.846310 10914 tablet_service.cc:1511] Processing CreateTablet for tablet 577c93bfc0d84ec6ad610cad0cf16899 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:24:04.850453 10929 raft_consensus.cc:2468] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 1.
I20260709 12:24:04.851292 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:24:04.831300 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 57892us
I20260709 12:24:04.852216 10914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 577c93bfc0d84ec6ad610cad0cf16899. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.853370 11065 raft_consensus.cc:515] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } }
I20260709 12:24:04.855710 11043 tablet_bootstrap.cc:654] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea: Neither blocks nor log segments found. Creating new log.
W20260709 12:24:04.870636 10895 leader_election.cc:343] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:04.856179 10916 tablet_service.cc:1511] Processing CreateTablet for tablet 73f1f3589fd343ba9289b327b8b35837 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:24:04.858695 10990 tablet_service.cc:1511] Processing CreateTablet for tablet 577c93bfc0d84ec6ad610cad0cf16899 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:24:04.859556 11045 tablet_bootstrap.cc:654] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:04.862493 10915 tablet_service.cc:1511] Processing CreateTablet for tablet 73d7ffc5e5d146d1b661abde11cf2f04 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:24:04.832347 11049 leader_election.cc:290] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:04.871351 10895 leader_election.cc:304] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:04.879766 10819 leader_election.cc:304] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:04.880319 10990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 577c93bfc0d84ec6ad610cad0cf16899. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.879765 10916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73f1f3589fd343ba9289b327b8b35837. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.881841 11048 raft_consensus.cc:697] T 442726a7f1e441248ec80a98b31eb341 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:04.883121 11054 raft_consensus.cc:2804] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:04.884033 10989 tablet_service.cc:1511] Processing CreateTablet for tablet 73d7ffc5e5d146d1b661abde11cf2f04 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:24:04.887732 11049 raft_consensus.cc:2749] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:04.891765 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:04.892737 10842 tablet_service.cc:1511] Processing CreateTablet for tablet 73f1f3589fd343ba9289b327b8b35837 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:24:04.893432 10989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73d7ffc5e5d146d1b661abde11cf2f04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.894157 10842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73f1f3589fd343ba9289b327b8b35837. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.897261 10841 tablet_service.cc:1511] Processing CreateTablet for tablet 577c93bfc0d84ec6ad610cad0cf16899 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:24:04.903483 10841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 577c93bfc0d84ec6ad610cad0cf16899. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.910053 10915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73d7ffc5e5d146d1b661abde11cf2f04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.921644 11069 raft_consensus.cc:493] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:04.900403 11064 raft_consensus.cc:2749] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:04.929018 10844 tablet_service.cc:1511] Processing CreateTablet for tablet 73d7ffc5e5d146d1b661abde11cf2f04 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:24:04.929752 10987 tablet_service.cc:1511] Processing CreateTablet for tablet e9331e5342644ca2bae19187b083a7d5 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:24:04.930758 10844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73d7ffc5e5d146d1b661abde11cf2f04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.931389 10987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9331e5342644ca2bae19187b083a7d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.935060 10917 tablet_service.cc:1511] Processing CreateTablet for tablet e9331e5342644ca2bae19187b083a7d5 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:24:04.936527 11043 tablet_bootstrap.cc:492] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea: No bootstrap required, opened a new log
I20260709 12:24:04.937054 10917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9331e5342644ca2bae19187b083a7d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.937258 11043 ts_tablet_manager.cc:1403] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea: Time spent bootstrapping tablet: real 0.114s	user 0.018s	sys 0.012s
I20260709 12:24:04.944687 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:04.944905 11043 raft_consensus.cc:359] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:04.945401 11003 raft_consensus.cc:3060] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:04.945649 11043 raft_consensus.cc:385] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:04.945972 11043 raft_consensus.cc:740] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Initialized, Role: FOLLOWER
I20260709 12:24:04.947403 11043 consensus_queue.cc:260] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:04.949330 10839 tablet_service.cc:1511] Processing CreateTablet for tablet e9331e5342644ca2bae19187b083a7d5 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:24:04.949926 11043 ts_tablet_manager.cc:1434] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:24:04.950784 10839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9331e5342644ca2bae19187b083a7d5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:24:04.953809 10820 leader_election.cc:343] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:04.924593 11069 raft_consensus.cc:515] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:04.969933 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:04.970568 11069 leader_election.cc:290] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:24:04.971901 10894 leader_election.cc:343] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:04.969785 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:24:04.973834 10968 leader_election.cc:343] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:04.972985 11047 tablet_bootstrap.cc:492] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040: No bootstrap required, opened a new log
I20260709 12:24:04.975415 11047 ts_tablet_manager.cc:1403] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040: Time spent bootstrapping tablet: real 0.234s	user 0.020s	sys 0.002s
I20260709 12:24:04.975692 11065 leader_election.cc:290] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 election: Requested vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265)
I20260709 12:24:04.976316 11048 consensus_queue.cc:237] T 442726a7f1e441248ec80a98b31eb341 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:04.983004 11003 raft_consensus.cc:2468] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 1.
I20260709 12:24:04.951479 11043 tablet_bootstrap.cc:492] T 9211e3b6d81447798824045b9515c0ee P e2d5c637307a407ab688f5ccd6f0fcea: Bootstrap starting.
I20260709 12:24:04.978729 11054 raft_consensus.cc:697] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 1 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:04.988968 10895 leader_election.cc:304] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:24:04.991957 10916 tablet_service.cc:1511] Processing CreateTablet for tablet cb3b4ab419804fabb71d2a98c266b209 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:24:05.008587 11045 tablet_bootstrap.cc:492] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08: No bootstrap required, opened a new log
I20260709 12:24:04.993496 11047 raft_consensus.cc:359] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:05.001811 10991 tablet_service.cc:1511] Processing CreateTablet for tablet cb3b4ab419804fabb71d2a98c266b209 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:24:05.005880 11065 raft_consensus.cc:2804] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:05.009514 11047 raft_consensus.cc:385] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:05.009766 11065 raft_consensus.cc:697] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:05.010226 10991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb3b4ab419804fabb71d2a98c266b209. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:05.010007 11047 raft_consensus.cc:740] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Initialized, Role: FOLLOWER
I20260709 12:24:05.010788 11065 consensus_queue.cc:237] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } }
I20260709 12:24:05.011211 11047 consensus_queue.cc:260] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:05.007330 11054 consensus_queue.cc:237] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:05.009160 11045 ts_tablet_manager.cc:1403] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08: Time spent bootstrapping tablet: real 0.223s	user 0.019s	sys 0.037s
I20260709 12:24:05.020139 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:05.020610 10918 tablet_service.cc:1511] Processing CreateTablet for tablet ad766f48812a4ddeb383179b1d84907b (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:24:05.024101 10916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb3b4ab419804fabb71d2a98c266b209. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:05.024811 10918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad766f48812a4ddeb383179b1d84907b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:05.026106 10837 tablet_service.cc:1511] Processing CreateTablet for tablet cb3b4ab419804fabb71d2a98c266b209 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:24:05.026482 10840 tablet_service.cc:1511] Processing CreateTablet for tablet ad766f48812a4ddeb383179b1d84907b (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:24:05.027661 10837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb3b4ab419804fabb71d2a98c266b209. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:05.028394 10840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad766f48812a4ddeb383179b1d84907b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:24:05.031419 10968 leader_election.cc:343] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:05.031996 10968 leader_election.cc:304] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:05.033264 11069 raft_consensus.cc:2749] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:05.022039 11045 raft_consensus.cc:359] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:05.037384 11045 raft_consensus.cc:385] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:05.034785 10989 tablet_service.cc:1511] Processing CreateTablet for tablet ad766f48812a4ddeb383179b1d84907b (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:24:05.045815 10919 tablet_service.cc:1511] Processing CreateTablet for tablet 5794ba618e514e28a7542ab6af39d8c9 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:24:05.046334 10989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad766f48812a4ddeb383179b1d84907b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:05.035506 11043 tablet_bootstrap.cc:654] T 9211e3b6d81447798824045b9515c0ee P e2d5c637307a407ab688f5ccd6f0fcea: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:05.051153 10919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5794ba618e514e28a7542ab6af39d8c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:05.053925 11047 ts_tablet_manager.cc:1434] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040: Time spent starting tablet: real 0.078s	user 0.010s	sys 0.000s
I20260709 12:24:05.055199 11047 tablet_bootstrap.cc:492] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040: Bootstrap starting.
I20260709 12:24:05.056164 10990 tablet_service.cc:1511] Processing CreateTablet for tablet 5794ba618e514e28a7542ab6af39d8c9 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:24:05.058004 10990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5794ba618e514e28a7542ab6af39d8c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:05.060180 10913 tablet_service.cc:1511] Processing CreateTablet for tablet ee998be153d94f6f91c39dace2c32f19 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:24:05.061848 10913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee998be153d94f6f91c39dace2c32f19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:05.061901 10750 catalog_manager.cc:5697] T 442726a7f1e441248ec80a98b31eb341 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 0 to 1, leader changed from <none> to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 1 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:05.042164 11045 raft_consensus.cc:740] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Initialized, Role: FOLLOWER
I20260709 12:24:05.076097 10838 tablet_service.cc:1511] Processing CreateTablet for tablet 5794ba618e514e28a7542ab6af39d8c9 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:24:05.076879 10993 tablet_service.cc:1511] Processing CreateTablet for tablet ee998be153d94f6f91c39dace2c32f19 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:24:05.077648 10838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5794ba618e514e28a7542ab6af39d8c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:05.078060 10993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee998be153d94f6f91c39dace2c32f19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:05.085947 10751 catalog_manager.cc:5697] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 0 to 1, leader changed from <none> to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 1 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:05.098378 10912 tablet_service.cc:1511] Processing CreateTablet for tablet 928860b1f6314ad3bd3582c7f89e460e (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:24:05.100385 10912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 928860b1f6314ad3bd3582c7f89e460e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:05.102298 11043 tablet_bootstrap.cc:492] T 9211e3b6d81447798824045b9515c0ee P e2d5c637307a407ab688f5ccd6f0fcea: No bootstrap required, opened a new log
I20260709 12:24:05.113610 10844 tablet_service.cc:1511] Processing CreateTablet for tablet ee998be153d94f6f91c39dace2c32f19 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:24:05.115070 10844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee998be153d94f6f91c39dace2c32f19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:05.114787 10992 tablet_service.cc:1511] Processing CreateTablet for tablet 928860b1f6314ad3bd3582c7f89e460e (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:24:05.116839 10911 tablet_service.cc:1511] Processing CreateTablet for tablet f5b822586ed04f2cb681fefd045b3f6d (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:24:05.114485 11045 consensus_queue.cc:260] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:05.118245 10911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5b822586ed04f2cb681fefd045b3f6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:05.120656 10843 tablet_service.cc:1511] Processing CreateTablet for tablet 928860b1f6314ad3bd3582c7f89e460e (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:24:05.122061 10843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 928860b1f6314ad3bd3582c7f89e460e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:05.123659 11045 ts_tablet_manager.cc:1434] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08: Time spent starting tablet: real 0.105s	user 0.004s	sys 0.005s
I20260709 12:24:05.124719 10836 tablet_service.cc:1511] Processing CreateTablet for tablet f5b822586ed04f2cb681fefd045b3f6d (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:24:05.127120 10988 tablet_service.cc:1511] Processing CreateTablet for tablet f5b822586ed04f2cb681fefd045b3f6d (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:24:05.131524 10992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 928860b1f6314ad3bd3582c7f89e460e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:05.132638 10749 catalog_manager.cc:5697] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 0 to 1, leader changed from <none> to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 1 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:05.134771 11047 tablet_bootstrap.cc:654] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:05.136677 10836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5b822586ed04f2cb681fefd045b3f6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:05.136897 10988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5b822586ed04f2cb681fefd045b3f6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:05.130384 11043 ts_tablet_manager.cc:1403] T 9211e3b6d81447798824045b9515c0ee P e2d5c637307a407ab688f5ccd6f0fcea: Time spent bootstrapping tablet: real 0.179s	user 0.019s	sys 0.011s
I20260709 12:24:05.146303 10842 tablet_service.cc:1511] Processing CreateTablet for tablet 114b16c8c992413dab64ab31b16cb06f (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:24:05.156373 10842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 114b16c8c992413dab64ab31b16cb06f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:05.158578 11043 raft_consensus.cc:359] T 9211e3b6d81447798824045b9515c0ee P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:05.159348 11043 raft_consensus.cc:385] T 9211e3b6d81447798824045b9515c0ee P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:05.159652 11043 raft_consensus.cc:740] T 9211e3b6d81447798824045b9515c0ee P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Initialized, Role: FOLLOWER
I20260709 12:24:05.160565 11043 consensus_queue.cc:260] T 9211e3b6d81447798824045b9515c0ee P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:05.163255 11043 ts_tablet_manager.cc:1434] T 9211e3b6d81447798824045b9515c0ee P e2d5c637307a407ab688f5ccd6f0fcea: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.002s
I20260709 12:24:05.164418 11043 tablet_bootstrap.cc:492] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea: Bootstrap starting.
I20260709 12:24:05.166466 11045 tablet_bootstrap.cc:492] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08: Bootstrap starting.
I20260709 12:24:05.173285 10916 tablet_service.cc:1511] Processing CreateTablet for tablet 114b16c8c992413dab64ab31b16cb06f (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:24:05.175313 10916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 114b16c8c992413dab64ab31b16cb06f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:05.174906 10839 tablet_service.cc:1511] Processing CreateTablet for tablet c72fddfc26044838a71a798f3371636b (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:24:05.176579 10839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c72fddfc26044838a71a798f3371636b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:05.173290 10991 tablet_service.cc:1511] Processing CreateTablet for tablet 114b16c8c992413dab64ab31b16cb06f (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:24:05.178099 10991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 114b16c8c992413dab64ab31b16cb06f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:05.213833 10915 tablet_service.cc:1511] Processing CreateTablet for tablet c72fddfc26044838a71a798f3371636b (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:24:05.215902 10988 tablet_service.cc:1511] Processing CreateTablet for tablet c72fddfc26044838a71a798f3371636b (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:24:05.216534 10840 tablet_service.cc:1511] Processing CreateTablet for tablet ab816bcc6183447994a2cc013e46c5f8 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:24:05.217396 10988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c72fddfc26044838a71a798f3371636b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:05.217906 11043 tablet_bootstrap.cc:654] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:05.217918 10840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab816bcc6183447994a2cc013e46c5f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:05.228099 10917 tablet_service.cc:1511] Processing CreateTablet for tablet ab816bcc6183447994a2cc013e46c5f8 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:24:05.236342 10915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c72fddfc26044838a71a798f3371636b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:05.258903 10993 tablet_service.cc:1511] Processing CreateTablet for tablet ab816bcc6183447994a2cc013e46c5f8 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:24:05.259068 10835 tablet_service.cc:1511] Processing CreateTablet for tablet f52e71e935934a298445f2f87c913f9e (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:24:05.264631 10993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab816bcc6183447994a2cc013e46c5f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:05.264727 10835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f52e71e935934a298445f2f87c913f9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:05.266794 11065 raft_consensus.cc:493] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:05.268286 11065 raft_consensus.cc:515] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:05.270917 11065 leader_election.cc:290] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:05.272087 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:05.273460 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:05.276423 10916 tablet_service.cc:1511] Processing CreateTablet for tablet f52e71e935934a298445f2f87c913f9e (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:24:05.280712 10917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab816bcc6183447994a2cc013e46c5f8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:24:05.280222 10894 leader_election.cc:343] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:24:05.288962 10895 leader_election.cc:343] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:05.291958 10895 leader_election.cc:304] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:05.293620 11065 raft_consensus.cc:2749] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:05.295333 11065 raft_consensus.cc:493] T 9211e3b6d81447798824045b9515c0ee P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:05.295855 11065 raft_consensus.cc:515] T 9211e3b6d81447798824045b9515c0ee P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:05.296041 11054 raft_consensus.cc:493] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:05.296962 11054 raft_consensus.cc:515] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:05.299001 11065 leader_election.cc:290] T 9211e3b6d81447798824045b9515c0ee P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:05.301294 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:05.303639 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:05.304533 10929 raft_consensus.cc:2468] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 0.
I20260709 12:24:05.305712 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:05.306360 11003 raft_consensus.cc:2468] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 0.
I20260709 12:24:05.306605 10819 leader_election.cc:304] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:05.307909 11071 raft_consensus.cc:2804] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:05.308082 10895 leader_election.cc:304] T 9211e3b6d81447798824045b9515c0ee P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:05.308452 11071 raft_consensus.cc:493] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:05.308915 11071 raft_consensus.cc:3060] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:05.309122 11065 raft_consensus.cc:2804] T 9211e3b6d81447798824045b9515c0ee P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:05.309666 11065 raft_consensus.cc:493] T 9211e3b6d81447798824045b9515c0ee P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:05.310075 11065 raft_consensus.cc:3060] T 9211e3b6d81447798824045b9515c0ee P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:24:05.312165 10894 leader_election.cc:343] T 9211e3b6d81447798824045b9515c0ee P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:05.313565 10987 tablet_service.cc:1511] Processing CreateTablet for tablet f52e71e935934a298445f2f87c913f9e (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:24:05.314981 10987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f52e71e935934a298445f2f87c913f9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:05.313566 11054 leader_election.cc:290] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:05.316264 10916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f52e71e935934a298445f2f87c913f9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:05.321058 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:05.318041 10986 tablet_service.cc:1511] Processing CreateTablet for tablet 7ac83709373b4efd9c3aa1472a9f9022 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:24:05.321966 11047 tablet_bootstrap.cc:492] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040: No bootstrap required, opened a new log
I20260709 12:24:05.322678 11047 ts_tablet_manager.cc:1403] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040: Time spent bootstrapping tablet: real 0.268s	user 0.011s	sys 0.005s
I20260709 12:24:05.318351 10918 tablet_service.cc:1511] Processing CreateTablet for tablet 7ac83709373b4efd9c3aa1472a9f9022 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:24:05.323904 10841 tablet_service.cc:1511] Processing CreateTablet for tablet 69fd8fdac2fa449e9e184f3d668ea1a7 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:24:05.325353 10841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69fd8fdac2fa449e9e184f3d668ea1a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:05.316378 10837 tablet_service.cc:1511] Processing CreateTablet for tablet 7ac83709373b4efd9c3aa1472a9f9022 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:24:05.327003 10837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ac83709373b4efd9c3aa1472a9f9022. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:05.322854 10986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ac83709373b4efd9c3aa1472a9f9022. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:05.321864 11003 raft_consensus.cc:2468] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 0.
I20260709 12:24:05.337914 10918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ac83709373b4efd9c3aa1472a9f9022. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:05.345856 10985 tablet_service.cc:1511] Processing CreateTablet for tablet 69fd8fdac2fa449e9e184f3d668ea1a7 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:24:05.347452 10985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69fd8fdac2fa449e9e184f3d668ea1a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:05.347815 11047 raft_consensus.cc:359] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:05.349686 10914 tablet_service.cc:1511] Processing CreateTablet for tablet 69fd8fdac2fa449e9e184f3d668ea1a7 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:24:05.354615 10914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69fd8fdac2fa449e9e184f3d668ea1a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:05.353602 11047 raft_consensus.cc:385] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:05.358069 11047 raft_consensus.cc:740] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Initialized, Role: FOLLOWER
I20260709 12:24:05.358197 11071 raft_consensus.cc:515] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:05.360052 11043 tablet_bootstrap.cc:492] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea: No bootstrap required, opened a new log
W20260709 12:24:05.360450 11029 tablet.cc:2406] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:24:05.360597 11043 ts_tablet_manager.cc:1403] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea: Time spent bootstrapping tablet: real 0.196s	user 0.047s	sys 0.042s
I20260709 12:24:05.368039 11045 tablet_bootstrap.cc:654] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:05.373598 11065 raft_consensus.cc:515] T 9211e3b6d81447798824045b9515c0ee P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:05.381469 11043 raft_consensus.cc:359] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:05.362601 11047 consensus_queue.cc:260] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:05.384481 10800 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:24:05.386350 10838 tablet_service.cc:1511] Processing CreateTablet for tablet 352aa49c65194abbb863d7553a091f11 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:24:05.391757 11043 raft_consensus.cc:385] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:05.398460 11043 raft_consensus.cc:740] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Initialized, Role: FOLLOWER
I20260709 12:24:05.400892 10988 tablet_service.cc:1511] Processing CreateTablet for tablet 352aa49c65194abbb863d7553a091f11 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:24:05.401032 11043 consensus_queue.cc:260] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:05.402307 10988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 352aa49c65194abbb863d7553a091f11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:05.403281 11047 ts_tablet_manager.cc:1434] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040: Time spent starting tablet: real 0.080s	user 0.008s	sys 0.000s
I20260709 12:24:05.403860 11043 ts_tablet_manager.cc:1434] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.002s
I20260709 12:24:05.404645 10838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 352aa49c65194abbb863d7553a091f11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:05.404982 10912 tablet_service.cc:1511] Processing CreateTablet for tablet 352aa49c65194abbb863d7553a091f11 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:24:05.406278 10912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 352aa49c65194abbb863d7553a091f11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:05.407980 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:05.408595 10929 raft_consensus.cc:3060] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:05.412307 11047 tablet_bootstrap.cc:492] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040: Bootstrap starting.
I20260709 12:24:05.420951 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:05.422268 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
W20260709 12:24:05.422611 10894 leader_election.cc:343] T 9211e3b6d81447798824045b9515c0ee P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:05.422861 11003 raft_consensus.cc:3060] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:05.424670 11065 leader_election.cc:290] T 9211e3b6d81447798824045b9515c0ee P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:05.404983 11043 tablet_bootstrap.cc:492] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea: Bootstrap starting.
I20260709 12:24:05.441226 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:05.442575 11002 raft_consensus.cc:3060] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:05.444837 11047 tablet_bootstrap.cc:654] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:05.431684 11071 leader_election.cc:290] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:05.456039 10919 tablet_service.cc:1511] Processing CreateTablet for tablet 3357adbb6a514faf958aff009c4e4af8 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:24:05.457259 10840 tablet_service.cc:1511] Processing CreateTablet for tablet 3357adbb6a514faf958aff009c4e4af8 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:24:05.498234 10919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3357adbb6a514faf958aff009c4e4af8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:05.498857 10840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3357adbb6a514faf958aff009c4e4af8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:05.499851 10911 tablet_service.cc:1511] Processing CreateTablet for tablet 3f8a389131ef4c77a3e08488aa4759eb (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:24:05.501178 10911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f8a389131ef4c77a3e08488aa4759eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:05.502055 10929 raft_consensus.cc:2468] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 1.
I20260709 12:24:05.459097 11069 consensus_queue.cc:1048] T 442726a7f1e441248ec80a98b31eb341 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:05.468660 11054 raft_consensus.cc:493] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:05.504520 11054 raft_consensus.cc:515] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:05.507112 11002 raft_consensus.cc:2468] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 1.
I20260709 12:24:05.479279 10913 tablet_service.cc:1511] Processing CreateTablet for tablet 87cb7b380c8446e6ab1355c203218967 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
W20260709 12:24:05.480398 10894 consensus_peers.cc:597] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:05.482367 10836 tablet_service.cc:1511] Processing CreateTablet for tablet 18294423a68a4671bf6c5a0f98645e4c (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:24:05.483790 10910 tablet_service.cc:1511] Processing CreateTablet for tablet 18294423a68a4671bf6c5a0f98645e4c (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:24:05.509282 10913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87cb7b380c8446e6ab1355c203218967. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:05.477229 10843 tablet_service.cc:1511] Processing CreateTablet for tablet 87cb7b380c8446e6ab1355c203218967 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:24:05.487485 10844 tablet_service.cc:1511] Processing CreateTablet for tablet 3f8a389131ef4c77a3e08488aa4759eb (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:24:05.489841 11045 tablet_bootstrap.cc:492] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08: No bootstrap required, opened a new log
I20260709 12:24:05.494374 11003 raft_consensus.cc:2468] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 1.
I20260709 12:24:05.498230 10838 tablet_service.cc:1511] Processing CreateTablet for tablet c2937f569e8041d9a71a575dc1b9d74d (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:24:05.510613 10836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18294423a68a4671bf6c5a0f98645e4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:05.513486 10895 leader_election.cc:304] T 9211e3b6d81447798824045b9515c0ee P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:24:05.514461 11065 raft_consensus.cc:2804] T 9211e3b6d81447798824045b9515c0ee P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:05.509891 11048 consensus_queue.cc:1048] T 442726a7f1e441248ec80a98b31eb341 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:24:05.514993 11065 raft_consensus.cc:697] T 9211e3b6d81447798824045b9515c0ee P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:05.515934 11065 consensus_queue.cc:237] T 9211e3b6d81447798824045b9515c0ee P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:05.516669 10844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f8a389131ef4c77a3e08488aa4759eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:05.521256 10916 tablet_service.cc:1511] Processing CreateTablet for tablet c2937f569e8041d9a71a575dc1b9d74d (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:24:05.507264 11054 leader_election.cc:290] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:05.530560 10819 leader_election.cc:304] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:05.531870 11045 ts_tablet_manager.cc:1403] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08: Time spent bootstrapping tablet: real 0.366s	user 0.019s	sys 0.004s
I20260709 12:24:05.532248 11049 raft_consensus.cc:493] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:05.532866 11049 raft_consensus.cc:515] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:05.535226 11049 leader_election.cc:290] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:05.531816 11054 raft_consensus.cc:2804] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:05.527228 10991 tablet_service.cc:1511] Processing CreateTablet for tablet 3357adbb6a514faf958aff009c4e4af8 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:24:05.544474 10910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18294423a68a4671bf6c5a0f98645e4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:05.538018 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:05.547744 10916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2937f569e8041d9a71a575dc1b9d74d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:05.535425 10838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2937f569e8041d9a71a575dc1b9d74d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:05.561702 11045 raft_consensus.cc:359] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:05.590229 11045 raft_consensus.cc:385] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:05.590821 11045 raft_consensus.cc:740] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Initialized, Role: FOLLOWER
I20260709 12:24:05.599252 10843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87cb7b380c8446e6ab1355c203218967. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:05.600790 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:05.577879 11054 raft_consensus.cc:697] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [term 1 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
W20260709 12:24:05.622697 10739 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 73412.4us
W20260709 12:24:05.621520 10819 leader_election.cc:343] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:24:05.629523 10894 leader_election.cc:343] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:05.631052 11054 consensus_queue.cc:237] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:05.640101 10991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3357adbb6a514faf958aff009c4e4af8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:05.650679 10992 tablet_service.cc:1511] Processing CreateTablet for tablet 87cb7b380c8446e6ab1355c203218967 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:24:05.652053 10992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87cb7b380c8446e6ab1355c203218967. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:05.662427 11071 consensus_queue.cc:1048] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:05.671778 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:05.671864 11043 tablet_bootstrap.cc:654] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:05.681267 11065 consensus_queue.cc:1048] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:24:05.681778 10895 leader_election.cc:343] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:05.682240 10895 leader_election.cc:304] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:05.682622 10987 tablet_service.cc:1511] Processing CreateTablet for tablet 18294423a68a4671bf6c5a0f98645e4c (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:24:05.688885 10987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18294423a68a4671bf6c5a0f98645e4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:05.684799 11065 raft_consensus.cc:2749] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:05.701195 10985 tablet_service.cc:1511] Processing CreateTablet for tablet 3f8a389131ef4c77a3e08488aa4759eb (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:24:05.702754 10985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f8a389131ef4c77a3e08488aa4759eb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:24:05.703042 10820 consensus_peers.cc:597] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 -> Peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): Couldn't send request to peer edcc56ddd3264984b4da6c1db59e7f08. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:05.704795 10993 tablet_service.cc:1511] Processing CreateTablet for tablet c2937f569e8041d9a71a575dc1b9d74d (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:24:05.615808 11045 consensus_queue.cc:260] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:05.706161 10993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2937f569e8041d9a71a575dc1b9d74d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:05.713552 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:24:05.716044 10820 leader_election.cc:343] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:05.716579 10820 leader_election.cc:304] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:05.716741 10989 tablet_service.cc:1511] Processing CreateTablet for tablet 3589745d67944a8a9a5c66ee8d04fc62 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:24:05.717587 11071 raft_consensus.cc:2749] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:05.718765 10986 tablet_service.cc:1511] Processing CreateTablet for tablet cd87c382c98f42fdb9ced96cf57e9714 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:24:05.727259 10989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3589745d67944a8a9a5c66ee8d04fc62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:05.730019 10918 tablet_service.cc:1511] Processing CreateTablet for tablet cd87c382c98f42fdb9ced96cf57e9714 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:24:05.732026 10986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd87c382c98f42fdb9ced96cf57e9714. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:05.734423 10918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd87c382c98f42fdb9ced96cf57e9714. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:05.710198 10839 tablet_service.cc:1511] Processing CreateTablet for tablet cd87c382c98f42fdb9ced96cf57e9714 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:24:05.753868 10839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd87c382c98f42fdb9ced96cf57e9714. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:05.774581 10990 tablet_service.cc:1511] Processing CreateTablet for tablet f6820c5c64094058b98e641fdb7ffe67 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:24:05.776134 10990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6820c5c64094058b98e641fdb7ffe67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:05.777289 10749 catalog_manager.cc:5697] T 9211e3b6d81447798824045b9515c0ee P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 0 to 1, leader changed from <none> to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 1 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:05.783452 10911 tablet_service.cc:1511] Processing CreateTablet for tablet 3589745d67944a8a9a5c66ee8d04fc62 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:24:05.785362 10911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3589745d67944a8a9a5c66ee8d04fc62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:05.777184 11045 ts_tablet_manager.cc:1434] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08: Time spent starting tablet: real 0.245s	user 0.009s	sys 0.001s
I20260709 12:24:05.817281 11047 tablet_bootstrap.cc:492] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040: No bootstrap required, opened a new log
I20260709 12:24:05.817842 11047 ts_tablet_manager.cc:1403] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040: Time spent bootstrapping tablet: real 0.406s	user 0.025s	sys 0.061s
I20260709 12:24:05.821097 10912 tablet_service.cc:1511] Processing CreateTablet for tablet f6820c5c64094058b98e641fdb7ffe67 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:24:05.822572 10912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6820c5c64094058b98e641fdb7ffe67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:05.832603 10844 tablet_service.cc:1511] Processing CreateTablet for tablet 3589745d67944a8a9a5c66ee8d04fc62 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:24:05.834794 10844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3589745d67944a8a9a5c66ee8d04fc62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:05.837170 10988 tablet_service.cc:1511] Processing CreateTablet for tablet 53f8ad7184804b8da671a0b32db088ba (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
W20260709 12:24:05.806236 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 94994.7us
I20260709 12:24:05.840207 10988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53f8ad7184804b8da671a0b32db088ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:05.850199 10919 tablet_service.cc:1511] Processing CreateTablet for tablet 53f8ad7184804b8da671a0b32db088ba (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:24:05.854281 10841 tablet_service.cc:1511] Processing CreateTablet for tablet c63ecfc9bd3945818cfe15c03f001315 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:24:05.855790 10841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c63ecfc9bd3945818cfe15c03f001315. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:05.859768 10919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53f8ad7184804b8da671a0b32db088ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:05.860155 11045 tablet_bootstrap.cc:492] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08: Bootstrap starting.
I20260709 12:24:05.870668 10989 tablet_service.cc:1511] Processing CreateTablet for tablet c63ecfc9bd3945818cfe15c03f001315 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:24:05.871995 10989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c63ecfc9bd3945818cfe15c03f001315. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:05.841457 10840 tablet_service.cc:1511] Processing CreateTablet for tablet f6820c5c64094058b98e641fdb7ffe67 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:24:05.880959 10840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6820c5c64094058b98e641fdb7ffe67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:05.883776 10836 tablet_service.cc:1511] Processing CreateTablet for tablet 53f8ad7184804b8da671a0b32db088ba (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:24:05.885150 10836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53f8ad7184804b8da671a0b32db088ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:05.885270 10914 tablet_service.cc:1511] Processing CreateTablet for tablet c63ecfc9bd3945818cfe15c03f001315 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:24:05.886637 10914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c63ecfc9bd3945818cfe15c03f001315. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:05.890133 11047 raft_consensus.cc:359] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } }
I20260709 12:24:05.891250 11047 raft_consensus.cc:385] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:05.891659 11047 raft_consensus.cc:740] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Initialized, Role: FOLLOWER
I20260709 12:24:05.892679 11047 consensus_queue.cc:260] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } }
I20260709 12:24:05.893431 10749 catalog_manager.cc:5697] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 0 to 1, leader changed from <none> to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 1 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:05.912420 11043 tablet_bootstrap.cc:492] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea: No bootstrap required, opened a new log
I20260709 12:24:05.913149 11043 ts_tablet_manager.cc:1403] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent bootstrapping tablet: real 0.508s	user 0.014s	sys 0.012s
I20260709 12:24:05.932021 11043 raft_consensus.cc:359] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:05.934028 11043 raft_consensus.cc:385] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:05.934321 11043 raft_consensus.cc:740] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Initialized, Role: FOLLOWER
I20260709 12:24:05.942785 11043 consensus_queue.cc:260] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:05.920107 10843 tablet_service.cc:1511] Processing CreateTablet for tablet b289bc89d592435fb63c7fcf580d95a4 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:24:05.941866 11054 raft_consensus.cc:493] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:05.961797 10843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b289bc89d592435fb63c7fcf580d95a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:05.961601 11054 raft_consensus.cc:515] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } }
I20260709 12:24:05.964653 11054 leader_election.cc:290] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:05.967588 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:05.982314 11047 ts_tablet_manager.cc:1434] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040: Time spent starting tablet: real 0.164s	user 0.010s	sys 0.000s
I20260709 12:24:05.983484 11047 tablet_bootstrap.cc:492] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040: Bootstrap starting.
I20260709 12:24:05.969367 11002 raft_consensus.cc:3060] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:06.009292 10838 tablet_service.cc:1511] Processing CreateTablet for tablet 4ef3220c51df47db8859f07ab745fad5 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:24:06.010995 10838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ef3220c51df47db8859f07ab745fad5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:06.010982 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:06.018384 10820 leader_election.cc:304] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:06.019337 11064 raft_consensus.cc:2749] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:06.024682 10918 tablet_service.cc:1511] Processing CreateTablet for tablet b289bc89d592435fb63c7fcf580d95a4 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:24:06.026800 10918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b289bc89d592435fb63c7fcf580d95a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:06.033016 10985 tablet_service.cc:1511] Processing CreateTablet for tablet b289bc89d592435fb63c7fcf580d95a4 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:24:06.034906 10985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b289bc89d592435fb63c7fcf580d95a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:06.043354 10991 tablet_service.cc:1511] Processing CreateTablet for tablet 4ef3220c51df47db8859f07ab745fad5 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:24:06.045424 10991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ef3220c51df47db8859f07ab745fad5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:06.046937 10914 tablet_service.cc:1511] Processing CreateTablet for tablet 4ef3220c51df47db8859f07ab745fad5 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:24:06.048429 10914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ef3220c51df47db8859f07ab745fad5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:06.050330 11086 consensus_queue.cc:1048] T 9211e3b6d81447798824045b9515c0ee P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:06.062417 11045 tablet_bootstrap.cc:700] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08: Time spent opening tablet: real 0.143s	user 0.005s	sys 0.001s
I20260709 12:24:06.063483 11045 tablet_bootstrap.cc:654] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:06.075477 11064 consensus_queue.cc:1048] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:06.083606 11043 ts_tablet_manager.cc:1434] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent starting tablet: real 0.170s	user 0.030s	sys 0.015s
I20260709 12:24:06.085245 11043 tablet_bootstrap.cc:492] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea: Bootstrap starting.
I20260709 12:24:06.111503 10836 tablet_service.cc:1511] Processing CreateTablet for tablet 2ac8522e549a46e09593fa4c2e175557 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:24:06.113020 10836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ac8522e549a46e09593fa4c2e175557. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:06.118820 11064 consensus_queue.cc:1048] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:24:06.128209 11047 tablet_bootstrap.cc:654] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:06.139256 11043 tablet_bootstrap.cc:654] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:06.158874 10853 raft_consensus.cc:3060] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:06.159299 10841 tablet_service.cc:1511] Processing CreateTablet for tablet dad6a1da21304fcfacab384a6afc4101 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:24:06.160750 10841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dad6a1da21304fcfacab384a6afc4101. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:06.169293 10912 tablet_service.cc:1511] Processing CreateTablet for tablet dad6a1da21304fcfacab384a6afc4101 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:24:06.181950 10988 tablet_service.cc:1511] Processing CreateTablet for tablet 2ac8522e549a46e09593fa4c2e175557 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:24:06.183728 10988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ac8522e549a46e09593fa4c2e175557. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:06.185035 10912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dad6a1da21304fcfacab384a6afc4101. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:06.189142 10990 tablet_service.cc:1511] Processing CreateTablet for tablet dad6a1da21304fcfacab384a6afc4101 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:24:06.175160 10919 tablet_service.cc:1511] Processing CreateTablet for tablet 2ac8522e549a46e09593fa4c2e175557 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
W20260709 12:24:06.192325 10894 consensus_peers.cc:597] T 9211e3b6d81447798824045b9515c0ee P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:06.192629 10919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ac8522e549a46e09593fa4c2e175557. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:06.195940 10990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dad6a1da21304fcfacab384a6afc4101. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:06.209394 10986 tablet_service.cc:1511] Processing CreateTablet for tablet 24c913e527ff46578e084c41eab7bb9d (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:24:06.215461 10986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24c913e527ff46578e084c41eab7bb9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:06.216730 10914 tablet_service.cc:1511] Processing CreateTablet for tablet 24c913e527ff46578e084c41eab7bb9d (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:24:06.218807 10914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24c913e527ff46578e084c41eab7bb9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:06.214506 10835 tablet_service.cc:1511] Processing CreateTablet for tablet 12c494f15d054d2bba575010ccfbb60f (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:24:06.204494 10839 tablet_service.cc:1511] Processing CreateTablet for tablet 24c913e527ff46578e084c41eab7bb9d (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:24:06.229591 10835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12c494f15d054d2bba575010ccfbb60f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:06.231432 10911 tablet_service.cc:1511] Processing CreateTablet for tablet 12c494f15d054d2bba575010ccfbb60f (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:24:06.232923 10911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12c494f15d054d2bba575010ccfbb60f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:06.268028 10839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24c913e527ff46578e084c41eab7bb9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:06.279536 11069 raft_consensus.cc:493] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:06.280203 11069 raft_consensus.cc:515] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:06.285104 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:06.287914 11069 leader_election.cc:290] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:06.288053 11047 tablet_bootstrap.cc:492] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040: No bootstrap required, opened a new log
I20260709 12:24:06.288825 11047 ts_tablet_manager.cc:1403] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040: Time spent bootstrapping tablet: real 0.306s	user 0.014s	sys 0.005s
I20260709 12:24:06.289631 10918 tablet_service.cc:1511] Processing CreateTablet for tablet 834361a055d34950b4edecba39f07657 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:24:06.291285 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:06.298637 10918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 834361a055d34950b4edecba39f07657. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:06.297608 11045 tablet_bootstrap.cc:492] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08: No bootstrap required, opened a new log
I20260709 12:24:06.299880 11045 ts_tablet_manager.cc:1403] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08: Time spent bootstrapping tablet: real 0.458s	user 0.032s	sys 0.036s
I20260709 12:24:06.291289 10988 tablet_service.cc:1511] Processing CreateTablet for tablet 12c494f15d054d2bba575010ccfbb60f (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:24:06.304973 10988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12c494f15d054d2bba575010ccfbb60f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:06.307617 10968 leader_election.cc:304] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:06.308542 11069 raft_consensus.cc:2749] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:06.310086 10913 tablet_service.cc:1511] Processing CreateTablet for tablet 435d66c6d38c4d8a90a81975a6a0cb13 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:24:06.312039 10913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 435d66c6d38c4d8a90a81975a6a0cb13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:06.321007 11065 raft_consensus.cc:493] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:06.321826 11065 raft_consensus.cc:515] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:06.324703 11065 leader_election.cc:290] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:06.325743 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:06.327270 10854 raft_consensus.cc:2468] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 0.
I20260709 12:24:06.329627 10894 leader_election.cc:304] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:06.330924 11065 raft_consensus.cc:2804] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:06.331444 11065 raft_consensus.cc:493] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:06.331905 11065 raft_consensus.cc:3060] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:06.331682 10843 tablet_service.cc:1511] Processing CreateTablet for tablet 435d66c6d38c4d8a90a81975a6a0cb13 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:24:06.334297 10843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 435d66c6d38c4d8a90a81975a6a0cb13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:06.305780 11045 raft_consensus.cc:359] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:06.348804 10838 tablet_service.cc:1511] Processing CreateTablet for tablet d5b6ea992cd64650b1c2da6c548d012f (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:24:06.347321 10986 tablet_service.cc:1511] Processing CreateTablet for tablet 435d66c6d38c4d8a90a81975a6a0cb13 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:24:06.336154 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:06.341684 11047 raft_consensus.cc:359] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:06.364830 10986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 435d66c6d38c4d8a90a81975a6a0cb13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:06.364923 11047 raft_consensus.cc:385] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:06.365626 11047 raft_consensus.cc:740] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Initialized, Role: FOLLOWER
I20260709 12:24:06.367292 10838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5b6ea992cd64650b1c2da6c548d012f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:06.371696 11045 raft_consensus.cc:385] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:06.372053 11045 raft_consensus.cc:740] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Initialized, Role: FOLLOWER
I20260709 12:24:06.372488 10841 tablet_service.cc:1511] Processing CreateTablet for tablet 834361a055d34950b4edecba39f07657 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:24:06.372937 11045 consensus_queue.cc:260] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:06.373741 10841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 834361a055d34950b4edecba39f07657. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:06.375962 11047 consensus_queue.cc:260] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:06.378587 11047 ts_tablet_manager.cc:1434] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040: Time spent starting tablet: real 0.089s	user 0.005s	sys 0.003s
I20260709 12:24:06.379194 10919 tablet_service.cc:1511] Processing CreateTablet for tablet d5b6ea992cd64650b1c2da6c548d012f (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:24:06.379695 11003 raft_consensus.cc:2468] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 0.
I20260709 12:24:06.380399 10989 tablet_service.cc:1511] Processing CreateTablet for tablet d5b6ea992cd64650b1c2da6c548d012f (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:24:06.381913 10989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5b6ea992cd64650b1c2da6c548d012f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:06.383849 11064 raft_consensus.cc:493] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:06.384315 11064 raft_consensus.cc:515] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:06.387144 10912 tablet_service.cc:1511] Processing CreateTablet for tablet e8b17195a94142039c40f598ed006c94 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:24:06.387290 11064 leader_election.cc:290] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:06.390095 10844 tablet_service.cc:1511] Processing CreateTablet for tablet d0aed74af73a488f8b691578ca370226 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:24:06.390714 10993 tablet_service.cc:1511] Processing CreateTablet for tablet e8b17195a94142039c40f598ed006c94 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:24:06.392097 10993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8b17195a94142039c40f598ed006c94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:06.392702 10844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0aed74af73a488f8b691578ca370226. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:06.395563 10992 tablet_service.cc:1511] Processing CreateTablet for tablet d0aed74af73a488f8b691578ca370226 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:24:06.397266 10992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0aed74af73a488f8b691578ca370226. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:06.397661 10911 tablet_service.cc:1511] Processing CreateTablet for tablet d0aed74af73a488f8b691578ca370226 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:24:06.405287 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:06.406278 10929 raft_consensus.cc:2468] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 0.
I20260709 12:24:06.360090 11043 tablet_bootstrap.cc:492] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea: No bootstrap required, opened a new log
I20260709 12:24:06.407995 11043 ts_tablet_manager.cc:1403] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea: Time spent bootstrapping tablet: real 0.323s	user 0.014s	sys 0.007s
I20260709 12:24:06.408321 10819 leader_election.cc:304] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:06.409524 11064 raft_consensus.cc:2804] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:06.380920 10919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5b6ea992cd64650b1c2da6c548d012f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:06.409937 11064 raft_consensus.cc:493] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:06.410326 11064 raft_consensus.cc:3060] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:06.414335 11045 ts_tablet_manager.cc:1434] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08: Time spent starting tablet: real 0.114s	user 0.006s	sys 0.001s
I20260709 12:24:06.416652 10911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0aed74af73a488f8b691578ca370226. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:24:06.422123 10800 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:24:06.422916 10912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8b17195a94142039c40f598ed006c94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:06.357064 10985 tablet_service.cc:1511] Processing CreateTablet for tablet 834361a055d34950b4edecba39f07657 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:24:06.424749 10835 tablet_service.cc:1511] Processing CreateTablet for tablet e8b17195a94142039c40f598ed006c94 (DEFAULT_TABLE table=test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:24:06.425448 10985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 834361a055d34950b4edecba39f07657. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:06.428169 11047 tablet_bootstrap.cc:492] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040: Bootstrap starting.
I20260709 12:24:06.411091 11043 raft_consensus.cc:359] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:06.446733 11043 raft_consensus.cc:385] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:06.447213 11043 raft_consensus.cc:740] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Initialized, Role: FOLLOWER
I20260709 12:24:06.447769 11064 raft_consensus.cc:515] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:06.448115 11043 consensus_queue.cc:260] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:06.426224 10835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8b17195a94142039c40f598ed006c94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:06.426152 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:06.453521 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:06.451333 11045 tablet_bootstrap.cc:492] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08: Bootstrap starting.
I20260709 12:24:06.466501 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:06.467195 10927 raft_consensus.cc:3060] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:06.429718 11065 raft_consensus.cc:515] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:06.469136 11047 tablet_bootstrap.cc:654] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:06.467097 11064 leader_election.cc:290] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:06.470079 11065 leader_election.cc:290] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:06.472298 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:06.472905 11002 raft_consensus.cc:3060] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:06.475171 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:06.475936 10853 raft_consensus.cc:3060] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:06.450500 11043 ts_tablet_manager.cc:1434] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea: Time spent starting tablet: real 0.042s	user 0.005s	sys 0.000s
I20260709 12:24:06.478325 11043 tablet_bootstrap.cc:492] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea: Bootstrap starting.
W20260709 12:24:06.478788 10820 leader_election.cc:343] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:24:06.484220 10820 leader_election.cc:343] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:06.521956 11002 raft_consensus.cc:2468] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 1.
I20260709 12:24:06.522591 11045 tablet_bootstrap.cc:654] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:06.525992 10853 raft_consensus.cc:2468] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 1.
I20260709 12:24:06.526333 10895 leader_election.cc:304] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:06.528340 11065 raft_consensus.cc:2804] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:06.529111 11065 raft_consensus.cc:697] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:06.527315 10927 raft_consensus.cc:2468] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 1.
I20260709 12:24:06.530400 11065 consensus_queue.cc:237] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:06.530938 10819 leader_election.cc:304] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:06.532416 11043 tablet_bootstrap.cc:654] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:06.537438 11071 raft_consensus.cc:2804] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:06.538033 11071 raft_consensus.cc:697] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 1 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:06.538952 11071 consensus_queue.cc:237] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:06.562999 11047 tablet_bootstrap.cc:492] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040: No bootstrap required, opened a new log
I20260709 12:24:06.563830 11047 ts_tablet_manager.cc:1403] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040: Time spent bootstrapping tablet: real 0.136s	user 0.019s	sys 0.024s
I20260709 12:24:06.571542 11047 raft_consensus.cc:359] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:06.572533 11047 raft_consensus.cc:385] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:06.575016 11047 raft_consensus.cc:740] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Initialized, Role: FOLLOWER
I20260709 12:24:06.576749 11047 consensus_queue.cc:260] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:06.578709 11045 tablet_bootstrap.cc:492] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08: No bootstrap required, opened a new log
I20260709 12:24:06.579286 11045 ts_tablet_manager.cc:1403] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08: Time spent bootstrapping tablet: real 0.164s	user 0.021s	sys 0.022s
I20260709 12:24:06.580134 11043 tablet_bootstrap.cc:492] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea: No bootstrap required, opened a new log
I20260709 12:24:06.580801 11043 ts_tablet_manager.cc:1403] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent bootstrapping tablet: real 0.103s	user 0.032s	sys 0.018s
I20260709 12:24:06.581529 11047 ts_tablet_manager.cc:1434] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.003s
I20260709 12:24:06.582580 11047 tablet_bootstrap.cc:492] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040: Bootstrap starting.
I20260709 12:24:06.582531 11045 raft_consensus.cc:359] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:06.583436 11045 raft_consensus.cc:385] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:06.583817 11045 raft_consensus.cc:740] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Initialized, Role: FOLLOWER
I20260709 12:24:06.583639 11043 raft_consensus.cc:359] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:06.584565 11043 raft_consensus.cc:385] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:06.584937 11043 raft_consensus.cc:740] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Initialized, Role: FOLLOWER
I20260709 12:24:06.584757 11045 consensus_queue.cc:260] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:06.588047 11045 ts_tablet_manager.cc:1434] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:24:06.588220 10751 catalog_manager.cc:5697] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 0 to 1, leader changed from <none> to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 1 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:06.589869 11045 tablet_bootstrap.cc:492] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08: Bootstrap starting.
I20260709 12:24:06.585903 11043 consensus_queue.cc:260] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:06.594393 11043 ts_tablet_manager.cc:1434] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:24:06.598320 10749 catalog_manager.cc:5697] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 0 to 1, leader changed from <none> to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 1 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:06.603107 11043 tablet_bootstrap.cc:492] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea: Bootstrap starting.
I20260709 12:24:06.603816 11047 tablet_bootstrap.cc:654] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:06.607372 11045 tablet_bootstrap.cc:654] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:06.608062 11102 raft_consensus.cc:493] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:06.608676 11102 raft_consensus.cc:515] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:06.613459 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
W20260709 12:24:06.616150 10894 leader_election.cc:343] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:06.619027 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:06.619858 11045 tablet_bootstrap.cc:492] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08: No bootstrap required, opened a new log
I20260709 12:24:06.620412 11045 ts_tablet_manager.cc:1403] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08: Time spent bootstrapping tablet: real 0.031s	user 0.018s	sys 0.000s
W20260709 12:24:06.620585 10895 leader_election.cc:343] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:06.621006 10895 leader_election.cc:304] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:06.621801 11102 leader_election.cc:290] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:06.622010 11065 raft_consensus.cc:2749] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:06.623173 11045 raft_consensus.cc:359] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:06.623929 11045 raft_consensus.cc:385] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:06.624195 11045 raft_consensus.cc:740] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Initialized, Role: FOLLOWER
I20260709 12:24:06.624788 11043 tablet_bootstrap.cc:654] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:06.625185 11045 consensus_queue.cc:260] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:06.627691 11045 ts_tablet_manager.cc:1434] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:24:06.629453 11045 tablet_bootstrap.cc:492] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08: Bootstrap starting.
I20260709 12:24:06.633867 11047 tablet_bootstrap.cc:492] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040: No bootstrap required, opened a new log
I20260709 12:24:06.634821 11047 ts_tablet_manager.cc:1403] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040: Time spent bootstrapping tablet: real 0.052s	user 0.015s	sys 0.016s
I20260709 12:24:06.637957 11045 tablet_bootstrap.cc:654] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:06.639132 11047 raft_consensus.cc:359] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:06.640312 11047 raft_consensus.cc:385] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:06.640882 11047 raft_consensus.cc:740] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Initialized, Role: FOLLOWER
I20260709 12:24:06.642059 11043 tablet_bootstrap.cc:492] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea: No bootstrap required, opened a new log
I20260709 12:24:06.641888 11047 consensus_queue.cc:260] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:06.642590 11043 ts_tablet_manager.cc:1403] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea: Time spent bootstrapping tablet: real 0.040s	user 0.014s	sys 0.003s
I20260709 12:24:06.645131 11047 ts_tablet_manager.cc:1434] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:24:06.645710 11043 raft_consensus.cc:359] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:06.646525 11043 raft_consensus.cc:385] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:06.646844 11043 raft_consensus.cc:740] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Initialized, Role: FOLLOWER
I20260709 12:24:06.646895 11047 tablet_bootstrap.cc:492] T e3d9a61ecaf84695b70f8519ee57706f P 80cd7d227db44f34a6108591dad9c040: Bootstrap starting.
I20260709 12:24:06.648068 11043 consensus_queue.cc:260] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:06.654345 11045 tablet_bootstrap.cc:492] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08: No bootstrap required, opened a new log
I20260709 12:24:06.658388 11043 ts_tablet_manager.cc:1434] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 12:24:06.658707 11045 ts_tablet_manager.cc:1403] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08: Time spent bootstrapping tablet: real 0.030s	user 0.017s	sys 0.000s
I20260709 12:24:06.659495 11043 tablet_bootstrap.cc:492] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea: Bootstrap starting.
I20260709 12:24:06.662009 11045 raft_consensus.cc:359] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:06.662726 11045 raft_consensus.cc:385] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:06.663017 11045 raft_consensus.cc:740] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Initialized, Role: FOLLOWER
I20260709 12:24:06.663858 11045 consensus_queue.cc:260] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:06.665990 11045 ts_tablet_manager.cc:1434] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:24:06.666949 11045 tablet_bootstrap.cc:492] T a6a28416571247df878823d464c05f1e P edcc56ddd3264984b4da6c1db59e7f08: Bootstrap starting.
I20260709 12:24:06.670272 11043 tablet_bootstrap.cc:654] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:06.673377 11045 tablet_bootstrap.cc:654] T a6a28416571247df878823d464c05f1e P edcc56ddd3264984b4da6c1db59e7f08: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:06.676723 11047 tablet_bootstrap.cc:654] T e3d9a61ecaf84695b70f8519ee57706f P 80cd7d227db44f34a6108591dad9c040: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:06.679947 11043 tablet_bootstrap.cc:492] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea: No bootstrap required, opened a new log
I20260709 12:24:06.680456 11043 ts_tablet_manager.cc:1403] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.000s
I20260709 12:24:06.682173 11045 tablet_bootstrap.cc:492] T a6a28416571247df878823d464c05f1e P edcc56ddd3264984b4da6c1db59e7f08: No bootstrap required, opened a new log
I20260709 12:24:06.682951 11047 tablet_bootstrap.cc:492] T e3d9a61ecaf84695b70f8519ee57706f P 80cd7d227db44f34a6108591dad9c040: No bootstrap required, opened a new log
I20260709 12:24:06.682951 11045 ts_tablet_manager.cc:1403] T a6a28416571247df878823d464c05f1e P edcc56ddd3264984b4da6c1db59e7f08: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.003s
I20260709 12:24:06.683539 11047 ts_tablet_manager.cc:1403] T e3d9a61ecaf84695b70f8519ee57706f P 80cd7d227db44f34a6108591dad9c040: Time spent bootstrapping tablet: real 0.037s	user 0.013s	sys 0.000s
I20260709 12:24:06.683249 11043 raft_consensus.cc:359] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:06.683996 11043 raft_consensus.cc:385] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:06.684309 11043 raft_consensus.cc:740] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Initialized, Role: FOLLOWER
I20260709 12:24:06.684975 11043 consensus_queue.cc:260] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:06.686548 11043 ts_tablet_manager.cc:1434] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:24:06.686698 11047 raft_consensus.cc:359] T e3d9a61ecaf84695b70f8519ee57706f P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:06.687384 11047 raft_consensus.cc:385] T e3d9a61ecaf84695b70f8519ee57706f P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:06.687515 11043 tablet_bootstrap.cc:492] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea: Bootstrap starting.
I20260709 12:24:06.687711 11047 raft_consensus.cc:740] T e3d9a61ecaf84695b70f8519ee57706f P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Initialized, Role: FOLLOWER
I20260709 12:24:06.688632 11045 raft_consensus.cc:359] T a6a28416571247df878823d464c05f1e P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:06.688661 11047 consensus_queue.cc:260] T e3d9a61ecaf84695b70f8519ee57706f P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:06.689728 11045 raft_consensus.cc:385] T a6a28416571247df878823d464c05f1e P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:06.690280 11045 raft_consensus.cc:740] T a6a28416571247df878823d464c05f1e P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Initialized, Role: FOLLOWER
I20260709 12:24:06.691188 11045 consensus_queue.cc:260] T a6a28416571247df878823d464c05f1e P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:06.694933 11043 tablet_bootstrap.cc:654] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:06.697932 11045 ts_tablet_manager.cc:1434] T a6a28416571247df878823d464c05f1e P edcc56ddd3264984b4da6c1db59e7f08: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.004s
I20260709 12:24:06.699050 11045 tablet_bootstrap.cc:492] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08: Bootstrap starting.
I20260709 12:24:06.700147 11047 ts_tablet_manager.cc:1434] T e3d9a61ecaf84695b70f8519ee57706f P 80cd7d227db44f34a6108591dad9c040: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:24:06.707063 11047 tablet_bootstrap.cc:492] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040: Bootstrap starting.
I20260709 12:24:06.708942 11045 tablet_bootstrap.cc:654] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:06.714149 11047 tablet_bootstrap.cc:654] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:06.722317 11043 tablet_bootstrap.cc:492] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea: No bootstrap required, opened a new log
I20260709 12:24:06.722946 11043 ts_tablet_manager.cc:1403] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea: Time spent bootstrapping tablet: real 0.036s	user 0.012s	sys 0.012s
I20260709 12:24:06.723194 11045 tablet_bootstrap.cc:492] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08: No bootstrap required, opened a new log
I20260709 12:24:06.723753 11045 ts_tablet_manager.cc:1403] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08: Time spent bootstrapping tablet: real 0.025s	user 0.019s	sys 0.000s
I20260709 12:24:06.726054 11047 tablet_bootstrap.cc:492] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040: No bootstrap required, opened a new log
I20260709 12:24:06.726114 11043 raft_consensus.cc:359] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:06.726819 11047 ts_tablet_manager.cc:1403] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.000s
I20260709 12:24:06.727038 11043 raft_consensus.cc:385] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:06.726970 11045 raft_consensus.cc:359] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:06.727663 11043 raft_consensus.cc:740] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Initialized, Role: FOLLOWER
I20260709 12:24:06.728081 11045 raft_consensus.cc:385] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:06.728503 11045 raft_consensus.cc:740] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Initialized, Role: FOLLOWER
I20260709 12:24:06.728578 11043 consensus_queue.cc:260] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:06.729192 11045 consensus_queue.cc:260] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:06.729673 11047 raft_consensus.cc:359] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:06.730337 11047 raft_consensus.cc:385] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:06.730577 11047 raft_consensus.cc:740] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Initialized, Role: FOLLOWER
I20260709 12:24:06.731462 11045 ts_tablet_manager.cc:1434] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:24:06.731495 11047 consensus_queue.cc:260] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:06.732945 11045 tablet_bootstrap.cc:492] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08: Bootstrap starting.
I20260709 12:24:06.735064 11043 ts_tablet_manager.cc:1434] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.001s
I20260709 12:24:06.736238 11043 tablet_bootstrap.cc:492] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea: Bootstrap starting.
I20260709 12:24:06.738811 11047 ts_tablet_manager.cc:1434] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 12:24:06.739507 11045 tablet_bootstrap.cc:654] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:06.740170 11047 tablet_bootstrap.cc:492] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040: Bootstrap starting.
I20260709 12:24:06.742655 11043 tablet_bootstrap.cc:654] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:06.752017 11045 tablet_bootstrap.cc:492] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08: No bootstrap required, opened a new log
I20260709 12:24:06.752655 11045 ts_tablet_manager.cc:1403] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.003s
I20260709 12:24:06.753121 11047 tablet_bootstrap.cc:654] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:06.756549 11045 raft_consensus.cc:359] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:06.758857 11045 raft_consensus.cc:385] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:06.759128 11045 raft_consensus.cc:740] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Initialized, Role: FOLLOWER
I20260709 12:24:06.759873 11043 tablet_bootstrap.cc:492] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea: No bootstrap required, opened a new log
I20260709 12:24:06.759951 11045 consensus_queue.cc:260] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:06.760416 11043 ts_tablet_manager.cc:1403] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.008s
I20260709 12:24:06.762874 11045 ts_tablet_manager.cc:1434] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.003s
I20260709 12:24:06.763273 11043 raft_consensus.cc:359] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:06.763799 11045 tablet_bootstrap.cc:492] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08: Bootstrap starting.
I20260709 12:24:06.764067 11043 raft_consensus.cc:385] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:06.764350 11043 raft_consensus.cc:740] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Initialized, Role: FOLLOWER
I20260709 12:24:06.765175 11043 consensus_queue.cc:260] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:06.767596 11043 ts_tablet_manager.cc:1434] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:24:06.770486 11045 tablet_bootstrap.cc:654] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:06.772128 11065 raft_consensus.cc:493] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:06.772818 11065 raft_consensus.cc:515] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:06.773876 11043 tablet_bootstrap.cc:492] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea: Bootstrap starting.
I20260709 12:24:06.777103 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:06.780402 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:06.781157 11002 raft_consensus.cc:2468] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 0.
I20260709 12:24:06.782357 11043 tablet_bootstrap.cc:654] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea: Neither blocks nor log segments found. Creating new log.
W20260709 12:24:06.780404 10894 leader_election.cc:343] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:06.783056 11045 tablet_bootstrap.cc:492] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08: No bootstrap required, opened a new log
I20260709 12:24:06.775283 11065 leader_election.cc:290] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:06.783547 11045 ts_tablet_manager.cc:1403] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08: Time spent bootstrapping tablet: real 0.020s	user 0.006s	sys 0.010s
I20260709 12:24:06.783424 10895 leader_election.cc:304] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:24:06.784659 11065 raft_consensus.cc:2804] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:06.785035 11065 raft_consensus.cc:493] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:06.785380 11065 raft_consensus.cc:3060] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:06.787822 11045 raft_consensus.cc:359] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:06.788513 11045 raft_consensus.cc:385] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:06.788811 11045 raft_consensus.cc:740] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Initialized, Role: FOLLOWER
I20260709 12:24:06.789655 11045 consensus_queue.cc:260] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:06.792254 11045 ts_tablet_manager.cc:1434] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:24:06.793188 11045 tablet_bootstrap.cc:492] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08: Bootstrap starting.
I20260709 12:24:06.794588 11047 tablet_bootstrap.cc:492] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040: No bootstrap required, opened a new log
I20260709 12:24:06.795182 11047 ts_tablet_manager.cc:1403] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040: Time spent bootstrapping tablet: real 0.055s	user 0.007s	sys 0.013s
I20260709 12:24:06.797019 11065 raft_consensus.cc:515] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:06.798296 11047 raft_consensus.cc:359] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:06.798979 11047 raft_consensus.cc:385] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:06.799731 11045 tablet_bootstrap.cc:654] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:06.800350 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:06.799242 11047 raft_consensus.cc:740] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Initialized, Role: FOLLOWER
I20260709 12:24:06.801410 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:06.803051 11002 raft_consensus.cc:3060] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:06.803184 11065 leader_election.cc:290] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:24:06.801879 10894 leader_election.cc:343] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:06.805122 11043 tablet_bootstrap.cc:492] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea: No bootstrap required, opened a new log
I20260709 12:24:06.804893 11047 consensus_queue.cc:260] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:06.806118 11043 ts_tablet_manager.cc:1403] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.004s
I20260709 12:24:06.807516 11047 ts_tablet_manager.cc:1434] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040: Time spent starting tablet: real 0.012s	user 0.002s	sys 0.006s
I20260709 12:24:06.807747 11045 tablet_bootstrap.cc:492] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08: No bootstrap required, opened a new log
I20260709 12:24:06.808262 11045 ts_tablet_manager.cc:1403] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08: Time spent bootstrapping tablet: real 0.015s	user 0.007s	sys 0.004s
I20260709 12:24:06.809414 11043 raft_consensus.cc:359] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:06.810093 11043 raft_consensus.cc:385] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:06.810348 11043 raft_consensus.cc:740] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Initialized, Role: FOLLOWER
I20260709 12:24:06.810983 11043 consensus_queue.cc:260] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:06.810895 11045 raft_consensus.cc:359] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:06.811784 11045 raft_consensus.cc:385] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:06.812142 11045 raft_consensus.cc:740] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Initialized, Role: FOLLOWER
I20260709 12:24:06.812279 11047 tablet_bootstrap.cc:492] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040: Bootstrap starting.
I20260709 12:24:06.813246 11043 ts_tablet_manager.cc:1434] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:24:06.813037 11045 consensus_queue.cc:260] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:06.814221 11043 tablet_bootstrap.cc:492] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea: Bootstrap starting.
I20260709 12:24:06.819509 11045 ts_tablet_manager.cc:1434] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.001s
I20260709 12:24:06.820811 11047 tablet_bootstrap.cc:654] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:06.821520 11045 tablet_bootstrap.cc:492] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08: Bootstrap starting.
I20260709 12:24:06.828354 11045 tablet_bootstrap.cc:654] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:06.830964 11069 raft_consensus.cc:493] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:06.831687 11069 raft_consensus.cc:515] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:06.836167 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d9a61ecaf84695b70f8519ee57706f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:06.836876 11069 leader_election.cc:290] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:06.837414 10853 raft_consensus.cc:2468] T e3d9a61ecaf84695b70f8519ee57706f P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 0.
I20260709 12:24:06.839601 11065 raft_consensus.cc:493] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:06.839459 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d9a61ecaf84695b70f8519ee57706f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:06.839998 10968 leader_election.cc:304] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:06.840312 10927 raft_consensus.cc:2468] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 0.
I20260709 12:24:06.840106 11065 raft_consensus.cc:515] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:06.841499 11069 raft_consensus.cc:2804] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:06.842015 11069 raft_consensus.cc:493] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:06.842449 11069 raft_consensus.cc:3060] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:06.842588 11065 leader_election.cc:290] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:06.846407 11045 tablet_bootstrap.cc:492] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08: No bootstrap required, opened a new log
I20260709 12:24:06.848352 11043 tablet_bootstrap.cc:654] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:06.848451 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:06.848989 11045 ts_tablet_manager.cc:1403] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.005s
W20260709 12:24:06.851621 10894 leader_election.cc:343] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:06.852618 11071 raft_consensus.cc:493] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:06.853214 11071 raft_consensus.cc:515] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:06.855765 11047 tablet_bootstrap.cc:492] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040: No bootstrap required, opened a new log
I20260709 12:24:06.856101 11071 leader_election.cc:290] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:06.856576 11047 ts_tablet_manager.cc:1403] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040: Time spent bootstrapping tablet: real 0.044s	user 0.020s	sys 0.022s
I20260709 12:24:06.855515 11045 raft_consensus.cc:359] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:06.857991 11045 raft_consensus.cc:385] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:06.858724 11045 raft_consensus.cc:740] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Initialized, Role: FOLLOWER
I20260709 12:24:06.858146 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:06.860528 11002 raft_consensus.cc:2468] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 1.
I20260709 12:24:06.859982 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:06.861817 10895 leader_election.cc:304] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:24:06.863617 11065 raft_consensus.cc:2804] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:06.864485 10819 leader_election.cc:304] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:06.864612 11065 raft_consensus.cc:697] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:06.865902 11071 raft_consensus.cc:2749] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:06.859936 11047 raft_consensus.cc:359] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:06.866827 11047 raft_consensus.cc:385] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:06.866601 11069 raft_consensus.cc:515] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:06.867107 11047 raft_consensus.cc:740] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Initialized, Role: FOLLOWER
I20260709 12:24:06.866099 11065 consensus_queue.cc:237] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:06.869064 11045 consensus_queue.cc:260] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:06.870229 11138 raft_consensus.cc:493] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:06.871992 11047 consensus_queue.cc:260] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:06.876896 11047 ts_tablet_manager.cc:1434] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.003s
I20260709 12:24:06.882870 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d9a61ecaf84695b70f8519ee57706f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:06.881050 11047 tablet_bootstrap.cc:492] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040: Bootstrap starting.
I20260709 12:24:06.883847 10853 raft_consensus.cc:3060] T e3d9a61ecaf84695b70f8519ee57706f P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:06.885087 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d9a61ecaf84695b70f8519ee57706f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:06.879514 11069 leader_election.cc:290] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:06.885699 10927 raft_consensus.cc:3060] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:06.874006 11138 raft_consensus.cc:515] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:06.913059 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:06.917999 10854 raft_consensus.cc:3060] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:06.920742 11071 raft_consensus.cc:493] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:06.921626 11071 raft_consensus.cc:515] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:06.927794 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:06.929106 11071 leader_election.cc:290] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:06.929605 10929 raft_consensus.cc:2393] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 1: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:24:06.931926 11069 raft_consensus.cc:493] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:06.932683 11069 raft_consensus.cc:515] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:06.937410 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:06.940058 10929 raft_consensus.cc:2468] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 0.
I20260709 12:24:06.942250 11102 consensus_queue.cc:1048] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:06.942636 10968 leader_election.cc:304] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:06.944751 11069 leader_election.cc:290] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:06.945644 11069 raft_consensus.cc:3060] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:06.948797 10819 leader_election.cc:304] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:06.950460 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:06.952060 10929 raft_consensus.cc:2468] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 0.
I20260709 12:24:06.942642 11047 tablet_bootstrap.cc:654] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:06.954386 11054 raft_consensus.cc:2804] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:06.927017 11138 leader_election.cc:290] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:06.960080 11054 raft_consensus.cc:493] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:06.982306 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:06.983085 11003 raft_consensus.cc:2468] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 0.
I20260709 12:24:06.984436 10895 leader_election.cc:304] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:24:06.985531 11065 raft_consensus.cc:2804] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:06.964548 11054 raft_consensus.cc:3060] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:06.986209 11065 raft_consensus.cc:493] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:06.968093 11138 raft_consensus.cc:493] T a6a28416571247df878823d464c05f1e P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:06.979053 10927 raft_consensus.cc:2468] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 1.
I20260709 12:24:06.997673 11138 raft_consensus.cc:515] T a6a28416571247df878823d464c05f1e P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:06.996840 11065 raft_consensus.cc:3060] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:07.004187 11138 leader_election.cc:290] T a6a28416571247df878823d464c05f1e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:07.004858 11138 raft_consensus.cc:493] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:07.005334 11138 raft_consensus.cc:515] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:07.021296 11138 leader_election.cc:290] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:07.030279 11045 ts_tablet_manager.cc:1434] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08: Time spent starting tablet: real 0.180s	user 0.014s	sys 0.011s
I20260709 12:24:07.031968 11045 tablet_bootstrap.cc:492] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08: Bootstrap starting.
I20260709 12:24:07.037868 11102 raft_consensus.cc:493] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:07.038980 11102 raft_consensus.cc:515] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:07.037348 11064 raft_consensus.cc:493] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:07.053403 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:07.054145 11003 raft_consensus.cc:2468] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 0.
I20260709 12:24:07.053917 11064 raft_consensus.cc:515] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:06.987670 10968 leader_election.cc:304] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
W20260709 12:24:07.063446 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 90769.5us
I20260709 12:24:07.065096 11064 leader_election.cc:290] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:07.065593 11138 raft_consensus.cc:2804] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:07.065045 11043 tablet_bootstrap.cc:492] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea: No bootstrap required, opened a new log
I20260709 12:24:07.066164 11138 raft_consensus.cc:493] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:07.066736 11138 raft_consensus.cc:3060] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:07.066323 11054 raft_consensus.cc:515] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:07.074694 11054 leader_election.cc:290] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:07.066726 11043 ts_tablet_manager.cc:1403] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea: Time spent bootstrapping tablet: real 0.253s	user 0.044s	sys 0.077s
I20260709 12:24:07.078749 11043 raft_consensus.cc:359] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:07.080945 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:07.084983 10926 raft_consensus.cc:2468] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 0.
I20260709 12:24:07.081920 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:07.082373 11047 tablet_bootstrap.cc:492] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040: No bootstrap required, opened a new log
I20260709 12:24:07.083825 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:07.086409 11043 raft_consensus.cc:385] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:07.086712 11047 ts_tablet_manager.cc:1403] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040: Time spent bootstrapping tablet: real 0.206s	user 0.011s	sys 0.010s
I20260709 12:24:07.086722 11043 raft_consensus.cc:740] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Initialized, Role: FOLLOWER
I20260709 12:24:07.086119 10925 raft_consensus.cc:3060] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:07.084391 11138 raft_consensus.cc:515] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:07.098455 11069 raft_consensus.cc:2749] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:07.098621 10853 raft_consensus.cc:2468] T e3d9a61ecaf84695b70f8519ee57706f P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 1.
I20260709 12:24:07.092566 10851 raft_consensus.cc:2468] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 0.
I20260709 12:24:07.108824 11069 raft_consensus.cc:493] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:07.109613 11069 raft_consensus.cc:515] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:07.110066 11102 leader_election.cc:290] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:07.112087 11069 leader_election.cc:290] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:07.112176 11138 leader_election.cc:290] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:07.093796 10819 leader_election.cc:304] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:07.114153 11047 raft_consensus.cc:359] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:07.115178 11047 raft_consensus.cc:385] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:07.115293 11143 consensus_queue.cc:1048] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.030s
I20260709 12:24:07.115561 11047 raft_consensus.cc:740] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Initialized, Role: FOLLOWER
I20260709 12:24:07.116362 11047 consensus_queue.cc:260] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:07.121162 11144 raft_consensus.cc:493] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:07.121749 11144 raft_consensus.cc:515] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:07.122308 10894 leader_election.cc:304] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:07.118955 10968 leader_election.cc:304] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:07.123471 11138 raft_consensus.cc:2804] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:07.123999 11138 raft_consensus.cc:697] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 1 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:07.125080 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:07.124930 11138 consensus_queue.cc:237] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:07.124930 11047 ts_tablet_manager.cc:1434] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.002s
I20260709 12:24:07.128104 11146 raft_consensus.cc:2804] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:07.128566 11146 raft_consensus.cc:493] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:07.128857 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:07.128960 11146 raft_consensus.cc:3060] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:07.129518 11002 raft_consensus.cc:2468] T a6a28416571247df878823d464c05f1e P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 0.
I20260709 12:24:07.123978 11144 leader_election.cc:290] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:07.126037 11143 raft_consensus.cc:2804] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:07.137509 11143 raft_consensus.cc:493] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:07.138536 11143 raft_consensus.cc:3060] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:07.134476 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:07.141247 10853 raft_consensus.cc:2468] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 0.
I20260709 12:24:07.143365 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:07.150800 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:07.154968 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:07.158066 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:07.157003 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:07.158773 11002 raft_consensus.cc:2468] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 0.
I20260709 12:24:07.162218 11043 consensus_queue.cc:260] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:07.163331 11047 tablet_bootstrap.cc:492] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040: Bootstrap starting.
I20260709 12:24:07.167428 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:07.168215 11002 raft_consensus.cc:3060] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:07.168388 10751 catalog_manager.cc:5697] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 0 to 1, leader changed from <none> to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 1 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:07.171936 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:07.177383 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:07.180943 10850 raft_consensus.cc:2393] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 1: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
W20260709 12:24:07.185206 10968 leader_election.cc:343] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:07.185904 11102 raft_consensus.cc:493] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:07.186322 10968 leader_election.cc:304] T a6a28416571247df878823d464c05f1e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:07.186424 11102 raft_consensus.cc:515] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:07.187222 11069 raft_consensus.cc:2804] T a6a28416571247df878823d464c05f1e P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:07.190358 11043 ts_tablet_manager.cc:1434] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea: Time spent starting tablet: real 0.114s	user 0.022s	sys 0.001s
I20260709 12:24:07.191951 11043 tablet_bootstrap.cc:492] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea: Bootstrap starting.
I20260709 12:24:07.187664 11069 raft_consensus.cc:493] T a6a28416571247df878823d464c05f1e P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:07.191300 10968 leader_election.cc:343] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:07.195521 11069 raft_consensus.cc:3060] T a6a28416571247df878823d464c05f1e P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:07.188076 11002 raft_consensus.cc:2468] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 1.
I20260709 12:24:07.199815 11065 raft_consensus.cc:515] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:07.202132 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:07.203083 10924 raft_consensus.cc:2468] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 0.
I20260709 12:24:07.203112 10926 raft_consensus.cc:2393] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 1: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:24:07.201433 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:07.208248 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:07.209340 11142 raft_consensus.cc:493] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:07.210587 11003 raft_consensus.cc:2468] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 0.
I20260709 12:24:07.210721 11142 raft_consensus.cc:515] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:07.212105 10894 leader_election.cc:343] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:07.214664 10925 raft_consensus.cc:2468] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 1.
I20260709 12:24:07.214401 11146 raft_consensus.cc:515] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:07.215961 10928 raft_consensus.cc:2393] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 1: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:24:07.216116 11102 leader_election.cc:290] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:07.218653 11142 leader_election.cc:290] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:07.218827 10819 leader_election.cc:304] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:07.219812 11144 raft_consensus.cc:2804] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:07.220100 10752 catalog_manager.cc:5697] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 0 to 1, leader changed from <none> to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 1 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:07.221935 11144 raft_consensus.cc:697] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 1 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:07.248008 11069 raft_consensus.cc:515] T a6a28416571247df878823d464c05f1e P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:07.276324 11152 log.cc:927] Time spent T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:24:07.255261 11069 leader_election.cc:290] T a6a28416571247df878823d464c05f1e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:07.282366 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:07.283946 11144 consensus_queue.cc:237] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:07.298558 11065 leader_election.cc:290] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:07.299506 10968 leader_election.cc:304] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:07.294267 10925 raft_consensus.cc:3060] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:07.302426 10820 leader_election.cc:304] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:07.304572 11045 tablet_bootstrap.cc:654] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:07.303851 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:07.309854 11054 raft_consensus.cc:2804] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:07.310281 11054 raft_consensus.cc:493] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:07.310745 11054 raft_consensus.cc:3060] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:07.317008 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:07.317385 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:07.318018 10850 raft_consensus.cc:3060] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:07.319726 11146 leader_election.cc:290] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:07.305598 11065 consensus_queue.cc:1048] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 12:24:07.295059 11143 raft_consensus.cc:515] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:07.323423 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:07.324409 10849 raft_consensus.cc:2393] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 1: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:24:07.325845 11071 consensus_queue.cc:1048] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:07.326486 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:07.327869 11143 leader_election.cc:290] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:07.308290 11069 raft_consensus.cc:2749] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:07.332551 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
W20260709 12:24:07.332756 10895 leader_election.cc:343] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:07.333252 10927 raft_consensus.cc:3060] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:07.337981 10925 raft_consensus.cc:2468] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 1.
I20260709 12:24:07.337939 10968 leader_election.cc:304] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:07.339174 11142 raft_consensus.cc:2804] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:07.339607 11142 raft_consensus.cc:493] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:07.339972 11142 raft_consensus.cc:3060] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:07.348133 11047 tablet_bootstrap.cc:654] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:07.333276 10895 leader_election.cc:304] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:07.344019 11054 raft_consensus.cc:515] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:07.358258 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:07.367002 10852 raft_consensus.cc:2393] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 1: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:24:07.357702 11102 raft_consensus.cc:2749] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:07.376302 11054 leader_election.cc:290] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:24:07.373235 10968 leader_election.cc:343] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:07.379217 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:07.380267 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:07.380623 11002 raft_consensus.cc:3060] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:07.380875 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:07.381104 10926 raft_consensus.cc:2393] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 1: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:24:07.381857 11142 raft_consensus.cc:515] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:07.383061 11003 raft_consensus.cc:2393] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 1: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:24:07.389489 11043 tablet_bootstrap.cc:654] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:07.371153 10850 raft_consensus.cc:2468] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 1.
I20260709 12:24:07.395923 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:07.394529 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:07.386256 11102 raft_consensus.cc:493] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:07.401275 10925 raft_consensus.cc:2393] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 1: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:24:07.401054 11102 raft_consensus.cc:515] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:07.390671 10968 leader_election.cc:304] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:24:07.399163 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:07.402842 10999 raft_consensus.cc:2393] T a6a28416571247df878823d464c05f1e P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 1: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:24:07.403777 11045 tablet_bootstrap.cc:492] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08: No bootstrap required, opened a new log
I20260709 12:24:07.403695 11102 leader_election.cc:290] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:07.404759 11045 ts_tablet_manager.cc:1403] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08: Time spent bootstrapping tablet: real 0.373s	user 0.012s	sys 0.008s
I20260709 12:24:07.399431 11142 leader_election.cc:290] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:07.407148 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:07.411696 10894 leader_election.cc:304] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:07.412906 11102 raft_consensus.cc:2804] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:07.413511 11102 raft_consensus.cc:697] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:07.414347 11102 consensus_queue.cc:237] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:07.410952 11069 raft_consensus.cc:2804] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:07.416169 11069 raft_consensus.cc:697] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:07.416078 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:07.418915 10895 leader_election.cc:304] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:07.419991 11002 raft_consensus.cc:2468] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 1.
I20260709 12:24:07.421334 11065 raft_consensus.cc:2749] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 12:24:07.421530 10968 leader_election.cc:343] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:07.422173 10968 leader_election.cc:304] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:07.423167 11138 raft_consensus.cc:2749] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:07.423559 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:07.424041 10820 leader_election.cc:304] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:07.425150 11054 raft_consensus.cc:2804] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:07.425623 11054 raft_consensus.cc:697] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 1 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:07.426359 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:07.426513 11054 consensus_queue.cc:237] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:07.427245 10852 raft_consensus.cc:2393] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 1: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:24:07.430433 10968 leader_election.cc:304] T a6a28416571247df878823d464c05f1e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
W20260709 12:24:07.431411 10894 leader_election.cc:343] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:07.437693 11045 raft_consensus.cc:359] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:07.438362 11045 raft_consensus.cc:385] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:07.438598 11045 raft_consensus.cc:740] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Initialized, Role: FOLLOWER
I20260709 12:24:07.440222 11045 consensus_queue.cc:260] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:07.439260 11142 raft_consensus.cc:2749] T a6a28416571247df878823d464c05f1e P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:24:07.448531 11045 ts_tablet_manager.cc:1434] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08: Time spent starting tablet: real 0.043s	user 0.009s	sys 0.000s
I20260709 12:24:07.418008 11069 consensus_queue.cc:237] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:07.439175 10895 leader_election.cc:343] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:07.451792 11045 tablet_bootstrap.cc:492] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08: Bootstrap starting.
I20260709 12:24:07.457571 10968 leader_election.cc:304] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:07.459223 11140 raft_consensus.cc:2749] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:24:07.459698 10927 raft_consensus.cc:2468] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 1.
I20260709 12:24:07.460980 10819 leader_election.cc:304] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:07.463395 11071 raft_consensus.cc:2804] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:07.464231 11071 raft_consensus.cc:697] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 1 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:07.465161 11071 consensus_queue.cc:237] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:07.468806 10800 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:24:07.454510 10895 leader_election.cc:304] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:07.488080 11140 raft_consensus.cc:493] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:07.488708 11140 raft_consensus.cc:515] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:07.489581 11102 raft_consensus.cc:2749] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:07.493526 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:07.495231 10850 raft_consensus.cc:3060] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:24:07.495564 10968 leader_election.cc:343] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:07.491329 11140 leader_election.cc:290] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:24:07.488139 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 51126.8us
I20260709 12:24:07.510344 11045 tablet_bootstrap.cc:654] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:07.517510 11047 tablet_bootstrap.cc:492] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040: No bootstrap required, opened a new log
I20260709 12:24:07.518044 11047 ts_tablet_manager.cc:1403] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040: Time spent bootstrapping tablet: real 0.355s	user 0.018s	sys 0.000s
I20260709 12:24:07.520697 11043 tablet_bootstrap.cc:492] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea: No bootstrap required, opened a new log
I20260709 12:24:07.521281 11043 ts_tablet_manager.cc:1403] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent bootstrapping tablet: real 0.330s	user 0.051s	sys 0.065s
I20260709 12:24:07.518675 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:07.524816 11043 raft_consensus.cc:359] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:07.525432 10968 leader_election.cc:343] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:07.525631 11043 raft_consensus.cc:385] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:07.525983 10968 leader_election.cc:304] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:07.526453 11043 raft_consensus.cc:740] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Initialized, Role: FOLLOWER
I20260709 12:24:07.527135 11102 consensus_queue.cc:1048] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:07.529222 11047 raft_consensus.cc:359] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:07.529758 11047 raft_consensus.cc:385] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:07.530058 11047 raft_consensus.cc:740] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Initialized, Role: FOLLOWER
I20260709 12:24:07.530717 11047 consensus_queue.cc:260] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:07.533178 11047 ts_tablet_manager.cc:1434] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:24:07.534385 11047 tablet_bootstrap.cc:492] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040: Bootstrap starting.
I20260709 12:24:07.533977 11069 raft_consensus.cc:2749] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:07.538635 10752 catalog_manager.cc:5697] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 0 to 1, leader changed from <none> to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 1 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:07.542040 11043 consensus_queue.cc:260] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:07.544759 11043 ts_tablet_manager.cc:1434] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 12:24:07.548981 11043 tablet_bootstrap.cc:492] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea: Bootstrap starting.
I20260709 12:24:07.554394 11071 raft_consensus.cc:493] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:07.554960 11071 raft_consensus.cc:515] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:07.555596 11102 consensus_queue.cc:1048] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:07.560088 11140 consensus_queue.cc:1048] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:07.554574 10750 catalog_manager.cc:5697] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 0 to 1, leader changed from <none> to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 1 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:07.561941 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:07.563381 11047 tablet_bootstrap.cc:654] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:07.562955 10750 catalog_manager.cc:5697] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 0 to 1, leader changed from <none> to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 1 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:07.564177 11071 leader_election.cc:290] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:07.564900 10750 catalog_manager.cc:5697] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 0 to 1, leader changed from <none> to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 1 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:07.566354 11045 tablet_bootstrap.cc:492] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08: No bootstrap required, opened a new log
I20260709 12:24:07.566589 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:07.566824 11045 ts_tablet_manager.cc:1403] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08: Time spent bootstrapping tablet: real 0.115s	user 0.013s	sys 0.004s
I20260709 12:24:07.567988 11043 tablet_bootstrap.cc:654] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:07.568374 10820 leader_election.cc:304] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:07.571225 11045 raft_consensus.cc:359] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:07.572404 11045 raft_consensus.cc:385] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:07.572801 11045 raft_consensus.cc:740] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Initialized, Role: FOLLOWER
I20260709 12:24:07.573844 11045 consensus_queue.cc:260] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:07.575726 11071 raft_consensus.cc:2749] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:07.576188 11069 raft_consensus.cc:493] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:07.576965 11069 raft_consensus.cc:515] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:07.577629 11045 ts_tablet_manager.cc:1434] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:24:07.578730 11045 tablet_bootstrap.cc:492] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08: Bootstrap starting.
I20260709 12:24:07.579591 11069 leader_election.cc:290] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:07.581578 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:07.582864 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:07.583546 10927 raft_consensus.cc:2468] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 0.
I20260709 12:24:07.586345 10968 leader_election.cc:304] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
W20260709 12:24:07.587512 10968 leader_election.cc:343] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:07.594571 11043 tablet_bootstrap.cc:492] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea: No bootstrap required, opened a new log
I20260709 12:24:07.594882 11045 tablet_bootstrap.cc:654] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:07.595052 11043 ts_tablet_manager.cc:1403] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent bootstrapping tablet: real 0.046s	user 0.013s	sys 0.005s
I20260709 12:24:07.598093 11043 raft_consensus.cc:359] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:07.598778 11043 raft_consensus.cc:385] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:07.599035 11043 raft_consensus.cc:740] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Initialized, Role: FOLLOWER
I20260709 12:24:07.599488 11045 tablet_bootstrap.cc:492] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08: No bootstrap required, opened a new log
I20260709 12:24:07.599946 11045 ts_tablet_manager.cc:1403] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.003s
I20260709 12:24:07.603122 11045 raft_consensus.cc:359] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:07.606415 11045 raft_consensus.cc:385] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:07.606770 11045 raft_consensus.cc:740] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Initialized, Role: FOLLOWER
I20260709 12:24:07.599783 11043 consensus_queue.cc:260] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:07.604274 11069 raft_consensus.cc:2804] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:07.608217 11069 raft_consensus.cc:493] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:07.608850 11069 raft_consensus.cc:3060] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:07.609535 11043 ts_tablet_manager.cc:1434] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.004s
I20260709 12:24:07.610785 11043 tablet_bootstrap.cc:492] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea: Bootstrap starting.
I20260709 12:24:07.613853 10751 catalog_manager.cc:5697] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 0 to 1, leader changed from <none> to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 1 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:07.617764 11043 tablet_bootstrap.cc:654] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:07.619876 11045 consensus_queue.cc:260] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:07.622048 11045 ts_tablet_manager.cc:1434] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260709 12:24:07.623025 11045 tablet_bootstrap.cc:492] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08: Bootstrap starting.
I20260709 12:24:07.629510 11045 tablet_bootstrap.cc:654] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:07.644028 11047 tablet_bootstrap.cc:492] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040: No bootstrap required, opened a new log
I20260709 12:24:07.644536 11047 ts_tablet_manager.cc:1403] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040: Time spent bootstrapping tablet: real 0.110s	user 0.029s	sys 0.035s
I20260709 12:24:07.647230 11047 raft_consensus.cc:359] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:07.648334 11047 raft_consensus.cc:385] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:07.648764 11047 raft_consensus.cc:740] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Initialized, Role: FOLLOWER
I20260709 12:24:07.649837 11047 consensus_queue.cc:260] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:07.652662 11047 ts_tablet_manager.cc:1434] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:24:07.653981 11047 tablet_bootstrap.cc:492] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040: Bootstrap starting.
I20260709 12:24:07.655764 11043 tablet_bootstrap.cc:492] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea: No bootstrap required, opened a new log
I20260709 12:24:07.656332 11043 ts_tablet_manager.cc:1403] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent bootstrapping tablet: real 0.046s	user 0.012s	sys 0.015s
I20260709 12:24:07.660585 11047 tablet_bootstrap.cc:654] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:07.661036 11045 tablet_bootstrap.cc:492] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08: No bootstrap required, opened a new log
I20260709 12:24:07.661505 11045 ts_tablet_manager.cc:1403] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08: Time spent bootstrapping tablet: real 0.039s	user 0.012s	sys 0.003s
I20260709 12:24:07.662683 11069 raft_consensus.cc:515] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:07.664009 11045 raft_consensus.cc:359] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:07.664705 11045 raft_consensus.cc:385] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:07.665004 11045 raft_consensus.cc:740] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Initialized, Role: FOLLOWER
I20260709 12:24:07.665513 11043 raft_consensus.cc:359] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:07.665733 11045 consensus_queue.cc:260] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:07.666262 11043 raft_consensus.cc:385] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:07.666695 11043 raft_consensus.cc:740] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Initialized, Role: FOLLOWER
I20260709 12:24:07.667565 11043 consensus_queue.cc:260] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:07.670015 11043 ts_tablet_manager.cc:1434] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.001s
I20260709 12:24:07.671101 11043 tablet_bootstrap.cc:492] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea: Bootstrap starting.
I20260709 12:24:07.673125 11045 ts_tablet_manager.cc:1434] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.003s
I20260709 12:24:07.673625 11047 tablet_bootstrap.cc:492] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040: No bootstrap required, opened a new log
I20260709 12:24:07.674213 11047 ts_tablet_manager.cc:1403] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.003s
I20260709 12:24:07.675210 11045 tablet_bootstrap.cc:492] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08: Bootstrap starting.
I20260709 12:24:07.677321 11138 consensus_queue.cc:1048] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:07.678265 11047 raft_consensus.cc:359] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:07.681916 11045 tablet_bootstrap.cc:654] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:07.682924 11043 tablet_bootstrap.cc:654] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:07.679085 11047 raft_consensus.cc:385] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:07.687992 11047 raft_consensus.cc:740] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Initialized, Role: FOLLOWER
I20260709 12:24:07.688794 11142 raft_consensus.cc:493] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:07.688998 11047 consensus_queue.cc:260] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:07.689399 11142 raft_consensus.cc:515] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:07.691874 11047 ts_tablet_manager.cc:1434] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040: Time spent starting tablet: real 0.017s	user 0.011s	sys 0.000s
I20260709 12:24:07.692036 11142 leader_election.cc:290] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:07.693014 11047 tablet_bootstrap.cc:492] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040: Bootstrap starting.
I20260709 12:24:07.694073 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:07.694211 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:07.694787 10925 raft_consensus.cc:2468] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 0.
W20260709 12:24:07.696660 10968 leader_election.cc:343] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:07.697460 10968 leader_election.cc:304] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:24:07.698872 11142 raft_consensus.cc:2804] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:07.699290 11142 raft_consensus.cc:493] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:07.699723 11142 raft_consensus.cc:3060] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:07.701099 11047 tablet_bootstrap.cc:654] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:07.707759 11045 tablet_bootstrap.cc:492] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08: No bootstrap required, opened a new log
I20260709 12:24:07.708482 11045 ts_tablet_manager.cc:1403] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08: Time spent bootstrapping tablet: real 0.033s	user 0.017s	sys 0.011s
I20260709 12:24:07.716230 11045 raft_consensus.cc:359] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:07.718461 11045 raft_consensus.cc:385] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:07.719002 11045 raft_consensus.cc:740] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Initialized, Role: FOLLOWER
I20260709 12:24:07.717068 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:07.721014 11045 consensus_queue.cc:260] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:07.722805 10968 leader_election.cc:343] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:07.726179 11045 ts_tablet_manager.cc:1434] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 12:24:07.727800 11045 tablet_bootstrap.cc:492] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08: Bootstrap starting.
I20260709 12:24:07.737165 11045 tablet_bootstrap.cc:654] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:07.746153 11071 raft_consensus.cc:493] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:07.746996 11071 raft_consensus.cc:515] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:07.751639 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:07.752508 11045 tablet_bootstrap.cc:492] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08: No bootstrap required, opened a new log
I20260709 12:24:07.753090 10925 raft_consensus.cc:2393] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 1: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:24:07.753468 11045 ts_tablet_manager.cc:1403] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08: Time spent bootstrapping tablet: real 0.026s	user 0.017s	sys 0.007s
I20260709 12:24:07.757362 11045 raft_consensus.cc:359] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:07.757891 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:07.758477 11045 raft_consensus.cc:385] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:07.759047 11045 raft_consensus.cc:740] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Initialized, Role: FOLLOWER
I20260709 12:24:07.760133 11045 consensus_queue.cc:260] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:07.763635 11045 ts_tablet_manager.cc:1434] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:24:07.765079 11045 tablet_bootstrap.cc:492] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08: Bootstrap starting.
I20260709 12:24:07.766584 10820 leader_election.cc:304] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:07.767791 11143 raft_consensus.cc:3060] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:07.774394 11045 tablet_bootstrap.cc:654] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:07.783718 11054 consensus_queue.cc:1048] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:07.788949 11045 tablet_bootstrap.cc:492] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08: No bootstrap required, opened a new log
I20260709 12:24:07.790146 11045 ts_tablet_manager.cc:1403] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08: Time spent bootstrapping tablet: real 0.025s	user 0.021s	sys 0.003s
I20260709 12:24:07.794462 11045 raft_consensus.cc:359] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:07.795710 11045 raft_consensus.cc:385] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:07.796173 11045 raft_consensus.cc:740] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Initialized, Role: FOLLOWER
I20260709 12:24:07.797405 11045 consensus_queue.cc:260] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:07.800282 11045 ts_tablet_manager.cc:1434] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:24:07.801736 11045 tablet_bootstrap.cc:492] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08: Bootstrap starting.
I20260709 12:24:07.807261 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:07.808460 10925 raft_consensus.cc:3060] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:07.810721 11045 tablet_bootstrap.cc:654] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:07.816005 11071 leader_election.cc:290] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:07.816921 11138 raft_consensus.cc:493] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:07.817710 11069 leader_election.cc:290] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:07.817710 11138 raft_consensus.cc:515] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:07.820537 11143 raft_consensus.cc:2749] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:07.825269 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:24:07.827523 10968 leader_election.cc:343] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:07.834226 11138 leader_election.cc:290] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:07.837193 11043 tablet_bootstrap.cc:492] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea: No bootstrap required, opened a new log
I20260709 12:24:07.837026 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:07.837708 11043 ts_tablet_manager.cc:1403] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea: Time spent bootstrapping tablet: real 0.167s	user 0.067s	sys 0.081s
I20260709 12:24:07.840509 11043 raft_consensus.cc:359] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:07.841401 11043 raft_consensus.cc:385] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:07.841725 11043 raft_consensus.cc:740] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Initialized, Role: FOLLOWER
I20260709 12:24:07.832860 11142 raft_consensus.cc:515] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:07.842636 11043 consensus_queue.cc:260] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:07.845678 11043 ts_tablet_manager.cc:1434] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:24:07.847011 11043 tablet_bootstrap.cc:492] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea: Bootstrap starting.
I20260709 12:24:07.851233 11047 tablet_bootstrap.cc:492] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040: No bootstrap required, opened a new log
I20260709 12:24:07.851958 11047 ts_tablet_manager.cc:1403] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040: Time spent bootstrapping tablet: real 0.159s	user 0.068s	sys 0.075s
I20260709 12:24:07.854310 11043 tablet_bootstrap.cc:654] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:07.856002 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:07.856796 10926 raft_consensus.cc:3060] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:07.857399 11054 consensus_queue.cc:1048] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:07.864521 11146 consensus_queue.cc:1048] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:24:07.872164 10968 leader_election.cc:343] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:07.872887 10968 leader_election.cc:304] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:07.873121 11047 raft_consensus.cc:359] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:07.873955 11047 raft_consensus.cc:385] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:07.874250 11047 raft_consensus.cc:740] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Initialized, Role: FOLLOWER
I20260709 12:24:07.874416 11069 raft_consensus.cc:2749] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:07.878526 11047 consensus_queue.cc:260] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:07.881359 11142 leader_election.cc:290] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:07.883559 11045 tablet_bootstrap.cc:492] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08: No bootstrap required, opened a new log
I20260709 12:24:07.888891 11054 consensus_queue.cc:1048] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:07.883790 10925 raft_consensus.cc:2468] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 1.
I20260709 12:24:07.889442 11045 ts_tablet_manager.cc:1403] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08: Time spent bootstrapping tablet: real 0.088s	user 0.029s	sys 0.020s
I20260709 12:24:07.894783 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:07.895251 11047 ts_tablet_manager.cc:1434] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.002s
I20260709 12:24:07.896296 11047 tablet_bootstrap.cc:492] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040: Bootstrap starting.
I20260709 12:24:07.896158 10968 leader_election.cc:304] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
W20260709 12:24:07.898077 10968 leader_election.cc:343] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:07.902212 10926 raft_consensus.cc:2468] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 1.
I20260709 12:24:07.904363 11045 raft_consensus.cc:359] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:07.905210 11045 raft_consensus.cc:385] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:07.904985 10968 leader_election.cc:304] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:24:07.898097 11142 raft_consensus.cc:2804] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:07.906057 11142 raft_consensus.cc:697] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:07.906365 11138 raft_consensus.cc:2804] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:07.906991 11138 raft_consensus.cc:697] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 1 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:07.907292 11142 consensus_queue.cc:237] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:07.907946 11138 consensus_queue.cc:237] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:07.915606 11045 raft_consensus.cc:740] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Initialized, Role: FOLLOWER
I20260709 12:24:07.916494 11045 consensus_queue.cc:260] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:07.918790 11045 ts_tablet_manager.cc:1434] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08: Time spent starting tablet: real 0.028s	user 0.003s	sys 0.001s
I20260709 12:24:07.920487 11047 tablet_bootstrap.cc:654] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:07.924101 11045 tablet_bootstrap.cc:492] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08: Bootstrap starting.
I20260709 12:24:07.927453 11153 consensus_queue.cc:1048] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:07.929277 11054 consensus_queue.cc:1048] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:07.933506 11043 tablet_bootstrap.cc:492] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea: No bootstrap required, opened a new log
I20260709 12:24:07.934051 11043 ts_tablet_manager.cc:1403] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea: Time spent bootstrapping tablet: real 0.087s	user 0.015s	sys 0.005s
I20260709 12:24:07.939512 11043 raft_consensus.cc:359] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:07.940245 11043 raft_consensus.cc:385] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:07.940538 11043 raft_consensus.cc:740] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Initialized, Role: FOLLOWER
I20260709 12:24:07.941660 11143 raft_consensus.cc:493] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:07.942196 11143 raft_consensus.cc:515] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:07.943179 11069 consensus_queue.cc:1048] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:07.944607 11143 leader_election.cc:290] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:07.945848 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:07.946623 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:07.946722 10998 raft_consensus.cc:2468] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 0.
I20260709 12:24:07.947304 10927 raft_consensus.cc:2468] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 0.
I20260709 12:24:07.948364 11045 tablet_bootstrap.cc:654] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:07.948782 10819 leader_election.cc:304] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:07.950099 11043 consensus_queue.cc:260] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:07.950693 11143 raft_consensus.cc:2804] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:07.951098 11143 raft_consensus.cc:493] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:07.951784 11143 raft_consensus.cc:3060] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:07.952598 11043 ts_tablet_manager.cc:1434] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 12:24:07.953652 11043 tablet_bootstrap.cc:492] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea: Bootstrap starting.
I20260709 12:24:07.955854 11071 consensus_queue.cc:1048] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:07.976341 11043 tablet_bootstrap.cc:654] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:07.978488 11054 consensus_queue.cc:1048] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:07.988722 11143 raft_consensus.cc:515] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:07.998731 11065 raft_consensus.cc:493] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:07.999445 11065 raft_consensus.cc:515] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:08.004659 11065 leader_election.cc:290] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:08.005065 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:08.005764 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:08.006043 11001 raft_consensus.cc:2468] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 0.
W20260709 12:24:08.007838 10894 leader_election.cc:343] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:08.008697 10895 leader_election.cc:304] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:24:08.010290 11065 raft_consensus.cc:2804] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:08.010798 11065 raft_consensus.cc:493] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:08.011231 11065 raft_consensus.cc:3060] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:08.035192 11069 raft_consensus.cc:493] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:08.036327 11069 raft_consensus.cc:515] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:08.042096 11069 leader_election.cc:290] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:08.042863 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:08.043641 10927 raft_consensus.cc:2468] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 0.
I20260709 12:24:08.046022 10968 leader_election.cc:304] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:08.049302 11069 raft_consensus.cc:2804] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:08.050763 11069 raft_consensus.cc:493] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:08.051367 11069 raft_consensus.cc:3060] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:08.057425 11153 raft_consensus.cc:493] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:08.058537 11153 raft_consensus.cc:515] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:08.064296 11153 leader_election.cc:290] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:08.065371 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:08.066453 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:08.066619 10999 raft_consensus.cc:2468] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 0.
I20260709 12:24:08.067116 10852 raft_consensus.cc:2468] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 0.
I20260709 12:24:08.068589 10895 leader_election.cc:304] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:08.070621 11153 raft_consensus.cc:2804] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:08.071164 11153 raft_consensus.cc:493] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:08.071646 11153 raft_consensus.cc:3060] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:08.098263 11069 raft_consensus.cc:515] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:08.100797 11043 tablet_bootstrap.cc:492] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea: No bootstrap required, opened a new log
I20260709 12:24:08.116773 11043 ts_tablet_manager.cc:1403] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent bootstrapping tablet: real 0.163s	user 0.023s	sys 0.016s
I20260709 12:24:08.102933 11143 leader_election.cc:290] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:08.103809 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:08.104667 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:08.108367 11153 raft_consensus.cc:515] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:08.118916 11069 leader_election.cc:290] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:08.120318 11043 raft_consensus.cc:359] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:08.120602 10926 raft_consensus.cc:3060] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:08.125831 11043 raft_consensus.cc:385] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:08.126405 11043 raft_consensus.cc:740] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Initialized, Role: FOLLOWER
I20260709 12:24:08.123533 10751 catalog_manager.cc:5697] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 0 to 1, leader changed from <none> to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 1 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:08.129102 11043 consensus_queue.cc:260] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:08.128743 10751 catalog_manager.cc:5697] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 0 to 1, leader changed from <none> to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 1 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:08.124056 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:08.145193 11043 ts_tablet_manager.cc:1434] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 12:24:08.154273 11065 raft_consensus.cc:515] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:08.158960 11153 leader_election.cc:290] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:08.139518 11001 raft_consensus.cc:3060] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:08.164790 11043 tablet_bootstrap.cc:492] T e9331e5342644ca2bae19187b083a7d5 P e2d5c637307a407ab688f5ccd6f0fcea: Bootstrap starting.
I20260709 12:24:08.167732 11143 raft_consensus.cc:493] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:08.131758 11142 consensus_queue.cc:1048] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.032s
I20260709 12:24:08.175134 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:08.175894 10998 raft_consensus.cc:3060] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:08.176409 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:08.208974 11045 tablet_bootstrap.cc:492] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08: No bootstrap required, opened a new log
I20260709 12:24:08.212126 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:08.589036 11045 ts_tablet_manager.cc:1403] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08: Time spent bootstrapping tablet: real 0.665s	user 0.091s	sys 0.143s
I20260709 12:24:08.587879 10926 raft_consensus.cc:2468] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 1.
I20260709 12:24:08.316413 11146 raft_consensus.cc:493] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:08.297106 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 48209.4us
I20260709 12:24:08.593207 11069 raft_consensus.cc:493] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:08.601708 10851 raft_consensus.cc:3060] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:08.588533 11047 tablet_bootstrap.cc:492] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040: No bootstrap required, opened a new log
I20260709 12:24:08.614569 11047 ts_tablet_manager.cc:1403] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040: Time spent bootstrapping tablet: real 0.718s	user 0.045s	sys 0.057s
I20260709 12:24:08.212879 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:08.170552 11143 raft_consensus.cc:515] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:08.619366 11045 raft_consensus.cc:359] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:08.239241 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:08.625257 11045 raft_consensus.cc:385] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:08.626039 11045 raft_consensus.cc:740] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Initialized, Role: FOLLOWER
I20260709 12:24:08.320219 10998 raft_consensus.cc:2468] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 1.
I20260709 12:24:08.627092 11045 consensus_queue.cc:260] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:08.613194 11065 leader_election.cc:290] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:24:08.444366 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 96512.9us
I20260709 12:24:08.618045 11069 raft_consensus.cc:515] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:08.629101 10925 raft_consensus.cc:3060] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:08.631482 11102 raft_consensus.cc:493] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:08.639437 11102 raft_consensus.cc:515] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:08.642436 11102 leader_election.cc:290] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:08.644457 11001 raft_consensus.cc:2468] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 1.
I20260709 12:24:08.647760 10925 raft_consensus.cc:2468] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 1.
I20260709 12:24:08.616603 11146 raft_consensus.cc:515] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:08.658923 11069 leader_election.cc:290] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:24:08.213344 10968 leader_election.cc:343] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:08.697026 11146 leader_election.cc:290] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:08.679272 10819 leader_election.cc:304] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:08.706928 11047 raft_consensus.cc:359] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:08.707670 11047 raft_consensus.cc:385] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:08.707989 11047 raft_consensus.cc:740] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Initialized, Role: FOLLOWER
I20260709 12:24:08.708758 11045 ts_tablet_manager.cc:1434] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08: Time spent starting tablet: real 0.109s	user 0.011s	sys 0.007s
I20260709 12:24:08.708938 11047 consensus_queue.cc:260] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:08.710711 11045 tablet_bootstrap.cc:492] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08: Bootstrap starting.
I20260709 12:24:08.711856 10851 raft_consensus.cc:2468] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 1.
I20260709 12:24:08.710799 11143 leader_election.cc:290] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:08.712183 11213 raft_consensus.cc:2804] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:24:08.702109 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 488796us
I20260709 12:24:08.713336 11043 tablet_bootstrap.cc:654] T e9331e5342644ca2bae19187b083a7d5 P e2d5c637307a407ab688f5ccd6f0fcea: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:08.718071 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:08.718887 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:08.725466 11047 ts_tablet_manager.cc:1434] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040: Time spent starting tablet: real 0.111s	user 0.009s	sys 0.000s
I20260709 12:24:08.727793 11047 tablet_bootstrap.cc:492] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040: Bootstrap starting.
I20260709 12:24:08.741323 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:08.742668 10927 raft_consensus.cc:2393] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 1: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:24:08.750557 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:08.753212 11000 raft_consensus.cc:2468] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 0.
I20260709 12:24:08.725414 10999 raft_consensus.cc:2468] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 0.
I20260709 12:24:08.736016 10998 raft_consensus.cc:3060] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:08.746515 10895 leader_election.cc:304] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:08.765252 11210 raft_consensus.cc:2804] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:08.765848 10895 leader_election.cc:304] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:08.766026 11210 raft_consensus.cc:697] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
W20260709 12:24:08.747026 10968 leader_election.cc:343] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:08.767544 11207 raft_consensus.cc:2804] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:08.767784 11210 consensus_queue.cc:237] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:08.769670 10895 leader_election.cc:304] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:08.767943 11207 raft_consensus.cc:493] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:08.772274 11206 raft_consensus.cc:2804] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:08.772710 11207 raft_consensus.cc:3060] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:08.772998 11206 raft_consensus.cc:493] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:08.773499 11206 raft_consensus.cc:3060] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:08.747514 11213 raft_consensus.cc:697] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [term 1 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:08.777092 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:08.786397 11213 consensus_queue.cc:237] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:08.789490 11047 tablet_bootstrap.cc:654] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:08.797226 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:08.799147 10850 raft_consensus.cc:3060] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:24:08.811144 10800 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:24:08.821686 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:08.787870 10968 leader_election.cc:304] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:24:08.825068 11215 raft_consensus.cc:2804] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:08.825698 11215 raft_consensus.cc:697] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:08.826738 11215 consensus_queue.cc:237] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:08.836027 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 57429.9us
I20260709 12:24:08.853669 10998 raft_consensus.cc:2468] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 1.
I20260709 12:24:08.868310 11216 consensus_queue.cc:1048] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:24:08.969621 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:08.969672 11207 raft_consensus.cc:515] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:08.981235 11207 leader_election.cc:290] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:24:09.002887 11217 log.cc:927] Time spent T 00000000000000000000000000000000 P 9619ad7a9e7f4d9b8039487e3ee77243: Append to log took a long time: real 0.149s	user 0.000s	sys 0.002s
W20260709 12:24:08.906198 10894 leader_election.cc:343] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:09.013845 11043 tablet_bootstrap.cc:492] T e9331e5342644ca2bae19187b083a7d5 P e2d5c637307a407ab688f5ccd6f0fcea: No bootstrap required, opened a new log
I20260709 12:24:09.016115 11043 ts_tablet_manager.cc:1403] T e9331e5342644ca2bae19187b083a7d5 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent bootstrapping tablet: real 0.852s	user 0.033s	sys 0.012s
I20260709 12:24:09.013175 11069 raft_consensus.cc:493] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:09.020538 11045 tablet_bootstrap.cc:654] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:09.020670 11069 raft_consensus.cc:515] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:09.020565 11140 consensus_queue.cc:1048] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:09.025236 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:09.027035 11069 leader_election.cc:290] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:24:09.011540 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 105923us
I20260709 12:24:09.033141 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:09.044245 10895 leader_election.cc:304] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:24:09.047926 10820 leader_election.cc:304] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:09.053349 11047 tablet_bootstrap.cc:492] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040: No bootstrap required, opened a new log
I20260709 12:24:09.053823 11047 ts_tablet_manager.cc:1403] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040: Time spent bootstrapping tablet: real 0.326s	user 0.011s	sys 0.019s
I20260709 12:24:09.054399 11212 raft_consensus.cc:2749] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:09.018863 11206 raft_consensus.cc:515] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:09.059178 10968 leader_election.cc:343] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:09.064834 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:09.065557 10998 raft_consensus.cc:3060] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:24:09.068874 10968 leader_election.cc:343] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:09.069464 10968 leader_election.cc:304] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:09.070281 11142 raft_consensus.cc:2749] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:09.072631 11142 consensus_queue.cc:1048] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:09.074220 11206 leader_election.cc:290] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:24:09.074654 10968 consensus_peers.cc:597] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:09.076587 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:24:09.077980 10968 leader_election.cc:343] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:09.053064 11210 raft_consensus.cc:2804] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:09.080320 11212 raft_consensus.cc:493] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:09.090698 11212 raft_consensus.cc:515] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:09.095391 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:09.095559 11212 leader_election.cc:290] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:09.095453 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:09.084698 11210 raft_consensus.cc:697] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:09.096478 10999 raft_consensus.cc:3060] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:09.097209 11210 consensus_queue.cc:237] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:09.099195 10968 leader_election.cc:343] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:09.116027 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:09.117170 11001 raft_consensus.cc:2393] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 1: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
W20260709 12:24:09.112879 11223 log.cc:927] Time spent T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:24:09.122171 11047 raft_consensus.cc:359] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:09.123255 11047 raft_consensus.cc:385] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:09.123656 11047 raft_consensus.cc:740] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Initialized, Role: FOLLOWER
I20260709 12:24:09.124605 11047 consensus_queue.cc:260] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:09.131079 11213 raft_consensus.cc:493] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:09.100554 10894 leader_election.cc:343] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:09.131649 11213 raft_consensus.cc:515] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:09.132697 11043 raft_consensus.cc:359] T e9331e5342644ca2bae19187b083a7d5 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:09.135509 11043 raft_consensus.cc:385] T e9331e5342644ca2bae19187b083a7d5 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:09.136385 11045 tablet_bootstrap.cc:492] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08: No bootstrap required, opened a new log
I20260709 12:24:09.136286 11043 raft_consensus.cc:740] T e9331e5342644ca2bae19187b083a7d5 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Initialized, Role: FOLLOWER
I20260709 12:24:09.137070 11045 ts_tablet_manager.cc:1403] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08: Time spent bootstrapping tablet: real 0.427s	user 0.001s	sys 0.023s
I20260709 12:24:09.127799 10968 leader_election.cc:304] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:09.137521 11043 consensus_queue.cc:260] T e9331e5342644ca2bae19187b083a7d5 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:09.135619 11047 ts_tablet_manager.cc:1434] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040: Time spent starting tablet: real 0.081s	user 0.009s	sys 0.002s
I20260709 12:24:09.140731 11047 tablet_bootstrap.cc:492] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040: Bootstrap starting.
I20260709 12:24:09.145910 11043 ts_tablet_manager.cc:1434] T e9331e5342644ca2bae19187b083a7d5 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent starting tablet: real 0.129s	user 0.006s	sys 0.005s
I20260709 12:24:09.147344 11043 tablet_bootstrap.cc:492] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea: Bootstrap starting.
I20260709 12:24:09.138036 10998 raft_consensus.cc:2468] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 1.
I20260709 12:24:09.148628 11142 raft_consensus.cc:2749] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:24:09.149757 10894 leader_election.cc:343] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:24:09.154191 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 54932.5us
I20260709 12:24:09.176728 10819 leader_election.cc:304] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:09.178265 11143 raft_consensus.cc:3060] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:09.178669 11045 raft_consensus.cc:359] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:09.179260 11045 raft_consensus.cc:385] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:09.179685 11045 raft_consensus.cc:740] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Initialized, Role: FOLLOWER
I20260709 12:24:09.180426 11045 consensus_queue.cc:260] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:09.182538 11045 ts_tablet_manager.cc:1434] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08: Time spent starting tablet: real 0.045s	user 0.000s	sys 0.005s
I20260709 12:24:09.183315 11045 tablet_bootstrap.cc:492] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08: Bootstrap starting.
I20260709 12:24:09.184454 11213 leader_election.cc:290] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:09.186887 10999 raft_consensus.cc:2468] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 1.
I20260709 12:24:09.187537 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:09.192308 10927 raft_consensus.cc:2393] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 1: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:24:09.187613 10895 leader_election.cc:304] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:09.192296 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:09.194913 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:09.199643 11047 tablet_bootstrap.cc:654] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:09.195540 11207 raft_consensus.cc:2804] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:09.196163 10895 leader_election.cc:304] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:09.205615 11207 raft_consensus.cc:697] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:09.206283 11206 raft_consensus.cc:2804] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:09.206923 11206 raft_consensus.cc:697] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:09.210480 11206 consensus_queue.cc:237] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:09.212081 10894 leader_election.cc:343] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:09.193917 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:09.214174 10849 raft_consensus.cc:3060] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:09.206894 11207 consensus_queue.cc:237] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:09.221599 11143 raft_consensus.cc:2749] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:09.223308 11146 raft_consensus.cc:493] T e9331e5342644ca2bae19187b083a7d5 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:09.223872 11146 raft_consensus.cc:515] T e9331e5342644ca2bae19187b083a7d5 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:09.225505 11045 tablet_bootstrap.cc:654] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:09.226078 11146 leader_election.cc:290] T e9331e5342644ca2bae19187b083a7d5 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:09.226785 10998 raft_consensus.cc:2393] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 1: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:24:09.230522 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9331e5342644ca2bae19187b083a7d5" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:09.231678 10820 leader_election.cc:304] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:09.233687 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9331e5342644ca2bae19187b083a7d5" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:09.234887 11001 raft_consensus.cc:2468] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 0.
W20260709 12:24:09.240232 10894 leader_election.cc:343] T e9331e5342644ca2bae19187b083a7d5 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:09.244202 10751 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60736 (request call id 35) took 1131 ms. Trace:
I20260709 12:24:09.246832 10752 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60730 (request call id 29) took 1071 ms. Trace:
I20260709 12:24:09.270574 10750 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60734 (request call id 33) took 1092 ms. Trace:
I20260709 12:24:09.272771 10750 rpcz_store.cc:276] 0709 12:24:08.180086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:08.589331 (+409245us) service_pool.cc:224] Handling call
0709 12:24:09.270506 (+681175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4050,"reported_tablets":7}
I20260709 12:24:09.260434 10752 rpcz_store.cc:276] 0709 12:24:08.175805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:08.177880 (+  2075us) service_pool.cc:224] Handling call
0709 12:24:09.246753 (+1068873us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":345,"reported_tablets":3}
I20260709 12:24:09.267899 10895 leader_election.cc:304] T e9331e5342644ca2bae19187b083a7d5 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:24:09.282493 11043 tablet_bootstrap.cc:654] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:09.282778 11207 raft_consensus.cc:2804] T e9331e5342644ca2bae19187b083a7d5 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:09.283315 11207 raft_consensus.cc:493] T e9331e5342644ca2bae19187b083a7d5 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:09.284473 11207 raft_consensus.cc:3060] T e9331e5342644ca2bae19187b083a7d5 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:09.260167 10751 rpcz_store.cc:276] 0709 12:24:08.112332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:08.112493 (+   161us) service_pool.cc:224] Handling call
0709 12:24:09.244140 (+1131647us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:08.621725 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:08.622306 (+   581us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:08.622347 (+    41us) write_op.cc:435] Acquired schema lock
0709 12:24:08.622374 (+    27us) tablet.cc:662] Decoding operations
0709 12:24:08.655775 (+ 33401us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:08.658334 (+  2559us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:08.658817 (+   483us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:24:08.667393 (+  8576us) tablet.cc:701] Row locks acquired
0709 12:24:08.669376 (+  1983us) write_op.cc:260] PREPARE: finished
0709 12:24:08.675034 (+  5658us) write_op.cc:270] Start()
0709 12:24:08.679921 (+  4887us) write_op.cc:276] Timestamp: P: 1783599848674969 usec, L: 0
0709 12:24:08.681955 (+  2034us) op_driver.cc:348] REPLICATION: starting
0709 12:24:08.710170 (+ 28215us) log.cc:844] Serialized 922 byte log entry
0709 12:24:09.112347 (+402177us) op_driver.cc:464] REPLICATION: finished
0709 12:24:09.174060 (+ 61713us) write_op.cc:301] APPLY: starting
0709 12:24:09.186252 (+ 12192us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:09.189970 (+  3718us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:09.190475 (+   505us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:09.213360 (+ 22885us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:09.213528 (+   168us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:24:09.213577 (+    49us) write_op.cc:312] APPLY: finished
0709 12:24:09.213781 (+   204us) log.cc:844] Serialized 28 byte log entry
0709 12:24:09.214599 (+   818us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:09.214690 (+    91us) write_op.cc:454] Released schema lock
0709 12:24:09.214747 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:09.215678 (+   931us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:09.215706 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":50839,"apply.run_cpu_time_us":2492,"apply.run_wall_time_us":46427,"num_ops":2,"prepare.queue_time_us":484162,"prepare.run_cpu_time_us":20523,"prepare.run_wall_time_us":113649,"raft.queue_time_us":52603,"raft.run_cpu_time_us":9704,"raft.run_wall_time_us":57655,"replication_time_us":420072,"thread_start_us":89551,"threads_started":4,"wal-append.queue_time_us":32630}]]}
W20260709 12:24:09.301680 10968 consensus_peers.cc:597] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:09.317670 10849 raft_consensus.cc:2468] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 1.
I20260709 12:24:09.319615 11146 consensus_queue.cc:1048] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:24:09.319185 11143 raft_consensus.cc:2749] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:09.326004 11047 tablet_bootstrap.cc:492] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040: No bootstrap required, opened a new log
I20260709 12:24:09.326542 11047 ts_tablet_manager.cc:1403] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040: Time spent bootstrapping tablet: real 0.186s	user 0.029s	sys 0.009s
I20260709 12:24:09.328037 11207 raft_consensus.cc:515] T e9331e5342644ca2bae19187b083a7d5 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:09.331473 11045 tablet_bootstrap.cc:492] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08: No bootstrap required, opened a new log
I20260709 12:24:09.334357 11045 ts_tablet_manager.cc:1403] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08: Time spent bootstrapping tablet: real 0.151s	user 0.008s	sys 0.015s
I20260709 12:24:09.339309 10751 catalog_manager.cc:5697] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 0 to 1, leader changed from <none> to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 1 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:09.345985 11045 raft_consensus.cc:359] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:09.347048 11045 raft_consensus.cc:385] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:09.347913 11047 raft_consensus.cc:359] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:09.349051 11047 raft_consensus.cc:385] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:09.349571 11047 raft_consensus.cc:740] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Initialized, Role: FOLLOWER
I20260709 12:24:09.347431 11045 raft_consensus.cc:740] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Initialized, Role: FOLLOWER
I20260709 12:24:09.351409 11045 consensus_queue.cc:260] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:09.351532 11047 consensus_queue.cc:260] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:09.353642 11045 ts_tablet_manager.cc:1434] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:24:09.354729 11045 tablet_bootstrap.cc:492] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08: Bootstrap starting.
I20260709 12:24:09.355304 11047 ts_tablet_manager.cc:1434] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040: Time spent starting tablet: real 0.028s	user 0.010s	sys 0.000s
I20260709 12:24:09.358099 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9331e5342644ca2bae19187b083a7d5" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:09.358358 11043 tablet_bootstrap.cc:492] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea: No bootstrap required, opened a new log
I20260709 12:24:09.359220 11043 ts_tablet_manager.cc:1403] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent bootstrapping tablet: real 0.212s	user 0.016s	sys 0.001s
I20260709 12:24:09.359897 11207 leader_election.cc:290] T e9331e5342644ca2bae19187b083a7d5 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:24:09.359921 10894 leader_election.cc:343] T e9331e5342644ca2bae19187b083a7d5 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:09.361443 11211 consensus_queue.cc:1048] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:24:09.370872 11047 tablet_bootstrap.cc:492] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040: Bootstrap starting.
I20260709 12:24:09.371515 11043 raft_consensus.cc:359] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:09.373044 11043 raft_consensus.cc:385] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:09.373608 11043 raft_consensus.cc:740] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Initialized, Role: FOLLOWER
I20260709 12:24:09.374382 11043 consensus_queue.cc:260] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:09.382859 11212 consensus_queue.cc:1048] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:09.387408 11143 consensus_queue.cc:1048] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:24:09.391809 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9331e5342644ca2bae19187b083a7d5" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:09.392204 11043 ts_tablet_manager.cc:1434] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent starting tablet: real 0.032s	user 0.011s	sys 0.003s
I20260709 12:24:09.392500 10999 raft_consensus.cc:3060] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:09.395639 11043 tablet_bootstrap.cc:492] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea: Bootstrap starting.
I20260709 12:24:09.398456 10752 catalog_manager.cc:5697] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 0 to 1, leader changed from <none> to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 1 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:09.402886 10752 catalog_manager.cc:5697] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 0 to 1, leader changed from <none> to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 1 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:09.404438 10752 catalog_manager.cc:5697] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 0 to 1, leader changed from <none> to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 1 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:09.408707 11140 consensus_queue.cc:1048] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:09.412070 10752 catalog_manager.cc:5697] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 0 to 1, leader changed from <none> to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 1 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:09.419474 11045 tablet_bootstrap.cc:654] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:09.423844 10751 catalog_manager.cc:5697] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 1 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } }
I20260709 12:24:09.434446 11047 tablet_bootstrap.cc:654] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:09.473203 10999 raft_consensus.cc:2468] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 1.
I20260709 12:24:09.477671 10895 leader_election.cc:304] T e9331e5342644ca2bae19187b083a7d5 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:24:09.483745 11206 raft_consensus.cc:2804] T e9331e5342644ca2bae19187b083a7d5 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:09.484329 11206 raft_consensus.cc:697] T e9331e5342644ca2bae19187b083a7d5 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:09.485203 11206 consensus_queue.cc:237] T e9331e5342644ca2bae19187b083a7d5 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:09.487607 11047 tablet_bootstrap.cc:492] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040: No bootstrap required, opened a new log
I20260709 12:24:09.488107 11047 ts_tablet_manager.cc:1403] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040: Time spent bootstrapping tablet: real 0.118s	user 0.014s	sys 0.009s
I20260709 12:24:09.492617 11045 tablet_bootstrap.cc:492] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08: No bootstrap required, opened a new log
I20260709 12:24:09.493196 11045 ts_tablet_manager.cc:1403] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08: Time spent bootstrapping tablet: real 0.139s	user 0.019s	sys 0.003s
I20260709 12:24:09.485204 11043 tablet_bootstrap.cc:654] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:09.496825 11047 raft_consensus.cc:359] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:09.497532 11047 raft_consensus.cc:385] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:09.497810 11047 raft_consensus.cc:740] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Initialized, Role: FOLLOWER
I20260709 12:24:09.498447 11047 consensus_queue.cc:260] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:09.500487 11047 ts_tablet_manager.cc:1434] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:24:09.501391 11047 tablet_bootstrap.cc:492] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040: Bootstrap starting.
I20260709 12:24:09.504397 11045 raft_consensus.cc:359] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:09.505221 11045 raft_consensus.cc:385] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:09.505534 11045 raft_consensus.cc:740] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Initialized, Role: FOLLOWER
I20260709 12:24:09.506278 11045 consensus_queue.cc:260] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:09.511394 11047 tablet_bootstrap.cc:654] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:09.513774 11043 tablet_bootstrap.cc:492] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea: No bootstrap required, opened a new log
I20260709 12:24:09.514261 11043 ts_tablet_manager.cc:1403] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent bootstrapping tablet: real 0.121s	user 0.011s	sys 0.002s
I20260709 12:24:09.519788 11045 ts_tablet_manager.cc:1434] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 12:24:09.520960 11045 tablet_bootstrap.cc:492] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08: Bootstrap starting.
I20260709 12:24:09.523164 11047 tablet_bootstrap.cc:492] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040: No bootstrap required, opened a new log
I20260709 12:24:09.523674 11047 ts_tablet_manager.cc:1403] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.004s
I20260709 12:24:09.526551 11047 raft_consensus.cc:359] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:09.527218 11047 raft_consensus.cc:385] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:09.527496 11047 raft_consensus.cc:740] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Initialized, Role: FOLLOWER
I20260709 12:24:09.528223 11043 raft_consensus.cc:359] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:09.528358 11047 consensus_queue.cc:260] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:09.529006 11043 raft_consensus.cc:385] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:09.529337 11043 raft_consensus.cc:740] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Initialized, Role: FOLLOWER
I20260709 12:24:09.530475 11047 ts_tablet_manager.cc:1434] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:24:09.530596 11043 consensus_queue.cc:260] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:09.531394 11047 tablet_bootstrap.cc:492] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040: Bootstrap starting.
I20260709 12:24:09.534085 11045 tablet_bootstrap.cc:654] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:09.523221 10750 catalog_manager.cc:5697] T e9331e5342644ca2bae19187b083a7d5 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 0 to 1, leader changed from <none> to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 1 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:09.533303 11043 ts_tablet_manager.cc:1434] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 12:24:09.538424 11043 tablet_bootstrap.cc:492] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea: Bootstrap starting.
I20260709 12:24:09.538592 11047 tablet_bootstrap.cc:654] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:09.546075 11043 tablet_bootstrap.cc:654] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:09.553696 11045 tablet_bootstrap.cc:492] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08: No bootstrap required, opened a new log
I20260709 12:24:09.564992 11045 ts_tablet_manager.cc:1403] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08: Time spent bootstrapping tablet: real 0.044s	user 0.014s	sys 0.000s
I20260709 12:24:09.568145 11045 raft_consensus.cc:359] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:09.569213 11045 raft_consensus.cc:385] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:09.569962 11045 raft_consensus.cc:740] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Initialized, Role: FOLLOWER
I20260709 12:24:09.570850 11045 consensus_queue.cc:260] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:09.573065 11045 ts_tablet_manager.cc:1434] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:24:09.575470 11043 tablet_bootstrap.cc:492] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea: No bootstrap required, opened a new log
I20260709 12:24:09.576143 11043 ts_tablet_manager.cc:1403] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent bootstrapping tablet: real 0.038s	user 0.009s	sys 0.004s
I20260709 12:24:09.577950 11047 tablet_bootstrap.cc:492] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040: No bootstrap required, opened a new log
I20260709 12:24:09.578493 11047 ts_tablet_manager.cc:1403] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040: Time spent bootstrapping tablet: real 0.047s	user 0.026s	sys 0.005s
I20260709 12:24:09.579141 11043 raft_consensus.cc:359] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:09.581688 11047 raft_consensus.cc:359] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:09.582465 11047 raft_consensus.cc:385] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:09.582803 11047 raft_consensus.cc:740] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Initialized, Role: FOLLOWER
I20260709 12:24:09.579947 11043 raft_consensus.cc:385] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:09.583420 11043 raft_consensus.cc:740] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Initialized, Role: FOLLOWER
I20260709 12:24:09.583850 11047 consensus_queue.cc:260] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:09.584164 11242 consensus_queue.cc:1048] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:09.582898 11045 tablet_bootstrap.cc:492] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08: Bootstrap starting.
I20260709 12:24:09.586321 11047 ts_tablet_manager.cc:1434] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:24:09.587656 11047 tablet_bootstrap.cc:492] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040: Bootstrap starting.
I20260709 12:24:09.584141 11043 consensus_queue.cc:260] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:09.591243 11242 raft_consensus.cc:493] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:09.591962 11242 raft_consensus.cc:515] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:09.594014 11047 tablet_bootstrap.cc:654] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:09.595887 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
W20260709 12:24:09.597878 10894 leader_election.cc:343] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:09.599037 11242 leader_election.cc:290] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:09.601670 11043 ts_tablet_manager.cc:1434] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 12:24:09.602807 11043 tablet_bootstrap.cc:492] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea: Bootstrap starting.
I20260709 12:24:09.604800 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:09.605674 11001 raft_consensus.cc:2468] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 0.
I20260709 12:24:09.606101 11045 tablet_bootstrap.cc:654] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:09.607760 11206 consensus_queue.cc:1048] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:09.607076 10895 leader_election.cc:304] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:24:09.609336 11047 tablet_bootstrap.cc:492] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040: No bootstrap required, opened a new log
I20260709 12:24:09.609865 11047 ts_tablet_manager.cc:1403] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040: Time spent bootstrapping tablet: real 0.022s	user 0.003s	sys 0.015s
I20260709 12:24:09.610615 11206 raft_consensus.cc:2804] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:09.611048 11206 raft_consensus.cc:493] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:09.611430 11206 raft_consensus.cc:3060] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:09.618638 11047 raft_consensus.cc:359] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:09.619498 11047 raft_consensus.cc:385] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:09.619889 11047 raft_consensus.cc:740] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Initialized, Role: FOLLOWER
I20260709 12:24:09.620620 11047 consensus_queue.cc:260] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:09.623661 11047 ts_tablet_manager.cc:1434] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:24:09.624680 11047 tablet_bootstrap.cc:492] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040: Bootstrap starting.
I20260709 12:24:09.632378 11206 raft_consensus.cc:515] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:09.642300 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:09.643110 11206 leader_election.cc:290] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:24:09.649333 10894 leader_election.cc:343] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:09.650110 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:09.650866 10998 raft_consensus.cc:3060] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:09.656196 10849 raft_consensus.cc:3060] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:09.657588 11047 tablet_bootstrap.cc:654] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:09.668264 11214 raft_consensus.cc:493] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:09.668919 11214 raft_consensus.cc:515] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:09.669392 11043 tablet_bootstrap.cc:654] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:09.672668 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:09.673534 11002 raft_consensus.cc:2393] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 1: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:24:09.674741 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:09.673563 11214 leader_election.cc:290] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:09.676719 11216 raft_consensus.cc:493] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:09.677071 11211 consensus_queue.cc:1048] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:09.675041 11242 consensus_queue.cc:1048] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:24:09.682626 10820 leader_election.cc:304] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:09.677284 11216 raft_consensus.cc:515] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:09.689355 11214 raft_consensus.cc:3060] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:09.727867 11242 consensus_queue.cc:1048] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:09.729933 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
W20260709 12:24:09.731961 10968 leader_election.cc:343] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:09.733474 11216 leader_election.cc:290] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:09.739048 11045 tablet_bootstrap.cc:492] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08: No bootstrap required, opened a new log
I20260709 12:24:09.740844 11045 ts_tablet_manager.cc:1403] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08: Time spent bootstrapping tablet: real 0.158s	user 0.018s	sys 0.008s
I20260709 12:24:09.740206 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:09.744182 10927 raft_consensus.cc:2468] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 0.
I20260709 12:24:09.753877 11214 raft_consensus.cc:2749] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:09.754586 11045 raft_consensus.cc:359] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:09.760391 11045 raft_consensus.cc:385] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:09.750726 11242 raft_consensus.cc:493] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:09.757345 10968 leader_election.cc:304] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:24:09.758265 10854 raft_consensus.cc:3060] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:09.760970 11045 raft_consensus.cc:740] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Initialized, Role: FOLLOWER
I20260709 12:24:09.762576 11140 raft_consensus.cc:2804] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:09.766673 11140 raft_consensus.cc:493] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:09.767226 11140 raft_consensus.cc:3060] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:09.770150 11047 tablet_bootstrap.cc:492] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040: No bootstrap required, opened a new log
I20260709 12:24:09.770784 11047 ts_tablet_manager.cc:1403] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040: Time spent bootstrapping tablet: real 0.146s	user 0.029s	sys 0.013s
I20260709 12:24:09.780478 11043 tablet_bootstrap.cc:492] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea: No bootstrap required, opened a new log
I20260709 12:24:09.781097 11043 ts_tablet_manager.cc:1403] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea: Time spent bootstrapping tablet: real 0.179s	user 0.016s	sys 0.006s
I20260709 12:24:09.784839 11211 consensus_queue.cc:1048] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:09.788514 11045 consensus_queue.cc:260] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:09.768293 11242 raft_consensus.cc:515] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:09.794631 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:09.763535 10998 raft_consensus.cc:2468] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 1.
I20260709 12:24:09.795269 11045 ts_tablet_manager.cc:1434] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08: Time spent starting tablet: real 0.052s	user 0.004s	sys 0.006s
I20260709 12:24:09.797387 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:09.798720 11045 tablet_bootstrap.cc:492] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08: Bootstrap starting.
I20260709 12:24:09.801374 11043 raft_consensus.cc:359] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:09.802070 11043 raft_consensus.cc:385] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:09.802336 11043 raft_consensus.cc:740] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Initialized, Role: FOLLOWER
I20260709 12:24:09.802953 11242 leader_election.cc:290] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:09.803897 11043 consensus_queue.cc:260] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:09.806573 11047 raft_consensus.cc:359] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:09.807370 11047 raft_consensus.cc:385] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:09.807677 11047 raft_consensus.cc:740] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Initialized, Role: FOLLOWER
I20260709 12:24:09.808590 11047 consensus_queue.cc:260] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:09.809047 10894 leader_election.cc:343] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:09.810707 11043 ts_tablet_manager.cc:1434] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.001s
I20260709 12:24:09.810761 11047 ts_tablet_manager.cc:1434] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.001s
I20260709 12:24:09.812342 11047 tablet_bootstrap.cc:492] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040: Bootstrap starting.
I20260709 12:24:09.816515 11043 tablet_bootstrap.cc:492] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea: Bootstrap starting.
I20260709 12:24:09.833855 11045 tablet_bootstrap.cc:654] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:09.821162 10895 leader_election.cc:304] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:24:09.848160 11242 raft_consensus.cc:2804] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:09.848948 11242 raft_consensus.cc:697] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:09.849852 11242 consensus_queue.cc:237] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:09.855908 11216 raft_consensus.cc:493] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:09.856775 11216 raft_consensus.cc:515] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:09.857957 11215 raft_consensus.cc:493] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:09.858500 11215 raft_consensus.cc:515] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:09.859889 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:09.860682 11215 leader_election.cc:290] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:09.865774 11216 leader_election.cc:290] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:24:09.873610 10968 leader_election.cc:343] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:09.875365 11047 tablet_bootstrap.cc:654] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:09.887660 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
W20260709 12:24:09.894078 10968 leader_election.cc:343] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:09.906672 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:09.910897 11140 raft_consensus.cc:515] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:09.912796 10999 raft_consensus.cc:2393] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 1: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:24:09.914919 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:09.915689 11140 leader_election.cc:290] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:24:09.916941 10968 leader_election.cc:343] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:09.922363 11043 tablet_bootstrap.cc:654] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:09.925519 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:24:09.932556 10968 leader_election.cc:343] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:09.933542 10968 leader_election.cc:304] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
W20260709 12:24:09.935138 10968 leader_election.cc:343] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:09.935671 10968 leader_election.cc:304] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:09.936088 11213 raft_consensus.cc:493] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:09.938611 10750 catalog_manager.cc:5697] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 0 to 1, leader changed from <none> to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 1 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:09.938771 11213 raft_consensus.cc:515] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:09.943432 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:09.944175 10927 raft_consensus.cc:2468] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 0.
I20260709 12:24:09.936736 11140 raft_consensus.cc:2749] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:09.946305 10819 leader_election.cc:304] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:09.946779 11047 tablet_bootstrap.cc:492] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040: No bootstrap required, opened a new log
I20260709 12:24:09.948066 11212 raft_consensus.cc:2804] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:09.948591 11047 ts_tablet_manager.cc:1403] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040: Time spent bootstrapping tablet: real 0.137s	user 0.012s	sys 0.008s
I20260709 12:24:09.948820 11140 raft_consensus.cc:2749] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:09.944608 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:09.950908 10999 raft_consensus.cc:2468] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 0.
I20260709 12:24:09.945106 10895 leader_election.cc:304] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:09.948770 11212 raft_consensus.cc:493] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:09.949698 10800 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:24:09.955616 11212 raft_consensus.cc:3060] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:09.956470 11047 raft_consensus.cc:359] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:09.957943 11047 raft_consensus.cc:385] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:09.959008 11211 raft_consensus.cc:3060] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:09.959482 11047 raft_consensus.cc:740] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Initialized, Role: FOLLOWER
I20260709 12:24:09.961475 11045 tablet_bootstrap.cc:492] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08: No bootstrap required, opened a new log
I20260709 12:24:09.961956 11045 ts_tablet_manager.cc:1403] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08: Time spent bootstrapping tablet: real 0.165s	user 0.009s	sys 0.007s
I20260709 12:24:09.947800 11213 leader_election.cc:290] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:09.970103 11212 raft_consensus.cc:515] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:09.973726 11045 raft_consensus.cc:359] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:09.974830 11045 raft_consensus.cc:385] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:09.974661 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:09.960755 11047 consensus_queue.cc:260] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:09.975555 10927 raft_consensus.cc:3060] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:09.975608 11211 raft_consensus.cc:2749] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:09.975301 11045 raft_consensus.cc:740] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Initialized, Role: FOLLOWER
I20260709 12:24:09.978418 11045 consensus_queue.cc:260] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:09.980942 11045 ts_tablet_manager.cc:1434] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 12:24:09.984833 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:09.985150 11045 tablet_bootstrap.cc:492] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08: Bootstrap starting.
I20260709 12:24:09.985842 10927 raft_consensus.cc:2468] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 1.
I20260709 12:24:09.987231 10819 leader_election.cc:304] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:09.989568 11212 leader_election.cc:290] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:09.991679 11213 raft_consensus.cc:2804] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:09.996801 11213 raft_consensus.cc:697] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [term 1 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:09.997933 11213 consensus_queue.cc:237] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:10.002326 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:10.003103 10998 raft_consensus.cc:3060] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:10.007213 11047 ts_tablet_manager.cc:1434] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040: Time spent starting tablet: real 0.058s	user 0.010s	sys 0.000s
I20260709 12:24:10.008371 11043 tablet_bootstrap.cc:492] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea: No bootstrap required, opened a new log
I20260709 12:24:10.008529 11047 tablet_bootstrap.cc:492] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040: Bootstrap starting.
I20260709 12:24:10.008993 11043 ts_tablet_manager.cc:1403] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea: Time spent bootstrapping tablet: real 0.193s	user 0.026s	sys 0.017s
I20260709 12:24:10.010715 10926 raft_consensus.cc:2468] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 1.
I20260709 12:24:10.016830 11043 raft_consensus.cc:359] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:10.017773 11043 raft_consensus.cc:385] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:10.018152 11043 raft_consensus.cc:740] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Initialized, Role: FOLLOWER
I20260709 12:24:10.019191 11043 consensus_queue.cc:260] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:10.026101 11043 ts_tablet_manager.cc:1434] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 12:24:10.027566 11043 tablet_bootstrap.cc:492] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea: Bootstrap starting.
I20260709 12:24:10.030251 11212 raft_consensus.cc:493] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.036356 10968 leader_election.cc:304] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:24:10.036863 11045 tablet_bootstrap.cc:654] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:10.034811 11212 raft_consensus.cc:515] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:10.037911 11216 raft_consensus.cc:2804] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:10.038502 11216 raft_consensus.cc:697] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:10.039853 11216 consensus_queue.cc:237] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:10.044284 11212 leader_election.cc:290] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:10.048482 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9331e5342644ca2bae19187b083a7d5" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:10.048573 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9331e5342644ca2bae19187b083a7d5" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:10.050202 10999 raft_consensus.cc:2393] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 1: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:24:10.040974 10998 raft_consensus.cc:2468] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 1.
I20260709 12:24:10.051987 10852 raft_consensus.cc:3060] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:10.056144 10750 catalog_manager.cc:5697] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 0 to 1, leader changed from <none> to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 1 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:10.058262 10820 leader_election.cc:304] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:10.063030 11043 tablet_bootstrap.cc:654] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:10.064317 11242 consensus_queue.cc:1048] T e9331e5342644ca2bae19187b083a7d5 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:10.063908 10751 catalog_manager.cc:5697] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 0 to 1, leader changed from <none> to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 1 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:10.083688 11047 tablet_bootstrap.cc:654] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:10.084578 11212 raft_consensus.cc:2749] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:10.084326 11213 raft_consensus.cc:493] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.086385 11043 tablet_bootstrap.cc:492] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea: No bootstrap required, opened a new log
I20260709 12:24:10.086041 11213 raft_consensus.cc:515] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:10.086916 11043 ts_tablet_manager.cc:1403] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea: Time spent bootstrapping tablet: real 0.060s	user 0.018s	sys 0.006s
I20260709 12:24:10.089545 11213 leader_election.cc:290] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:10.091121 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:10.091470 11242 consensus_queue.cc:1048] T e9331e5342644ca2bae19187b083a7d5 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:10.092383 10999 raft_consensus.cc:2393] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 1: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:24:10.093343 11045 tablet_bootstrap.cc:492] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08: No bootstrap required, opened a new log
I20260709 12:24:10.094427 11045 ts_tablet_manager.cc:1403] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08: Time spent bootstrapping tablet: real 0.109s	user 0.024s	sys 0.007s
I20260709 12:24:10.093266 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:10.099315 10820 leader_election.cc:304] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:10.099531 11045 raft_consensus.cc:359] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:10.100455 11045 raft_consensus.cc:385] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:10.100777 11045 raft_consensus.cc:740] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Initialized, Role: FOLLOWER
I20260709 12:24:10.095533 11043 raft_consensus.cc:359] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:10.101925 11212 raft_consensus.cc:3060] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:10.102936 11045 consensus_queue.cc:260] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:10.105015 11045 ts_tablet_manager.cc:1434] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:24:10.105830 11045 tablet_bootstrap.cc:492] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08: Bootstrap starting.
I20260709 12:24:10.101677 11043 raft_consensus.cc:385] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:10.108858 11043 raft_consensus.cc:740] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Initialized, Role: FOLLOWER
I20260709 12:24:10.110474 11043 consensus_queue.cc:260] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:10.114200 11045 tablet_bootstrap.cc:654] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:10.115422 11212 raft_consensus.cc:2749] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:10.117517 11212 raft_consensus.cc:493] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.118223 11212 raft_consensus.cc:515] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:10.112854 11043 ts_tablet_manager.cc:1434] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.002s
I20260709 12:24:10.176970 11043 tablet_bootstrap.cc:492] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea: Bootstrap starting.
I20260709 12:24:10.183473 11043 tablet_bootstrap.cc:654] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:10.206501 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad766f48812a4ddeb383179b1d84907b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:10.207235 10926 raft_consensus.cc:2468] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 0.
I20260709 12:24:10.208515 10819 leader_election.cc:304] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:10.209403 11214 raft_consensus.cc:2804] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:10.209771 11214 raft_consensus.cc:493] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:10.210131 11214 raft_consensus.cc:3060] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:10.210461 11212 leader_election.cc:290] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:10.220597 11047 tablet_bootstrap.cc:492] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040: No bootstrap required, opened a new log
I20260709 12:24:10.221486 11047 ts_tablet_manager.cc:1403] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040: Time spent bootstrapping tablet: real 0.213s	user 0.017s	sys 0.003s
I20260709 12:24:10.230185 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad766f48812a4ddeb383179b1d84907b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:10.230800 11047 raft_consensus.cc:359] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:10.231705 11047 raft_consensus.cc:385] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:10.232028 11047 raft_consensus.cc:740] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Initialized, Role: FOLLOWER
I20260709 12:24:10.231158 11000 raft_consensus.cc:2468] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 0.
I20260709 12:24:10.234531 11047 consensus_queue.cc:260] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:10.236714 11047 ts_tablet_manager.cc:1434] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:24:10.237622 11047 tablet_bootstrap.cc:492] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040: Bootstrap starting.
I20260709 12:24:10.248976 11216 raft_consensus.cc:493] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.249588 11216 raft_consensus.cc:515] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:10.252668 11214 raft_consensus.cc:515] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:10.253306 11216 leader_election.cc:290] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:10.256662 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad766f48812a4ddeb383179b1d84907b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:10.256983 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5794ba618e514e28a7542ab6af39d8c9" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:10.257284 10925 raft_consensus.cc:3060] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:10.257861 11214 leader_election.cc:290] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:24:10.258481 10968 leader_election.cc:343] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:10.262167 11045 tablet_bootstrap.cc:492] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08: No bootstrap required, opened a new log
I20260709 12:24:10.262678 11045 ts_tablet_manager.cc:1403] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08: Time spent bootstrapping tablet: real 0.157s	user 0.018s	sys 0.022s
I20260709 12:24:10.265057 11047 tablet_bootstrap.cc:654] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:10.265702 10925 raft_consensus.cc:2468] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 1.
I20260709 12:24:10.266080 11045 raft_consensus.cc:359] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:10.266994 11045 raft_consensus.cc:385] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:10.267283 11045 raft_consensus.cc:740] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Initialized, Role: FOLLOWER
I20260709 12:24:10.267707 10819 leader_election.cc:304] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:10.268293 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad766f48812a4ddeb383179b1d84907b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:10.269450 11140 raft_consensus.cc:493] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.269336 11000 raft_consensus.cc:3060] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:10.270087 11140 raft_consensus.cc:515] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:10.271551 11043 tablet_bootstrap.cc:492] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea: No bootstrap required, opened a new log
I20260709 12:24:10.272112 11043 ts_tablet_manager.cc:1403] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent bootstrapping tablet: real 0.095s	user 0.012s	sys 0.001s
I20260709 12:24:10.272125 11140 leader_election.cc:290] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:10.268324 11045 consensus_queue.cc:260] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:10.273849 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:10.275727 11045 ts_tablet_manager.cc:1434] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.004s
I20260709 12:24:10.276659 11143 raft_consensus.cc:2804] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:10.277254 11143 raft_consensus.cc:697] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [term 1 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
W20260709 12:24:10.277333 10968 leader_election.cc:343] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:10.275856 11043 raft_consensus.cc:359] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:10.277546 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5794ba618e514e28a7542ab6af39d8c9" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:10.278076 11043 raft_consensus.cc:385] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:10.278402 11043 raft_consensus.cc:740] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Initialized, Role: FOLLOWER
I20260709 12:24:10.278205 11143 consensus_queue.cc:237] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:10.279083 11043 consensus_queue.cc:260] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:10.281220 11043 ts_tablet_manager.cc:1434] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:24:10.282145 11043 tablet_bootstrap.cc:492] T 5794ba618e514e28a7542ab6af39d8c9 P e2d5c637307a407ab688f5ccd6f0fcea: Bootstrap starting.
I20260709 12:24:10.283187 11045 tablet_bootstrap.cc:492] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08: Bootstrap starting.
I20260709 12:24:10.290606 11047 tablet_bootstrap.cc:492] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040: No bootstrap required, opened a new log
I20260709 12:24:10.291080 11047 ts_tablet_manager.cc:1403] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040: Time spent bootstrapping tablet: real 0.054s	user 0.006s	sys 0.006s
I20260709 12:24:10.290328 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:10.294265 11047 raft_consensus.cc:359] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:10.298774 11047 raft_consensus.cc:385] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:10.299098 11047 raft_consensus.cc:740] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Initialized, Role: FOLLOWER
I20260709 12:24:10.298810 11045 tablet_bootstrap.cc:654] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:10.299798 11047 consensus_queue.cc:260] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:10.300058 11000 raft_consensus.cc:2468] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 1.
I20260709 12:24:10.302248 11047 ts_tablet_manager.cc:1434] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.004s
W20260709 12:24:10.302496 10968 leader_election.cc:343] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:10.304180 11043 tablet_bootstrap.cc:654] T 5794ba618e514e28a7542ab6af39d8c9 P e2d5c637307a407ab688f5ccd6f0fcea: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:10.303244 11047 tablet_bootstrap.cc:492] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040: Bootstrap starting.
I20260709 12:24:10.303304 10968 leader_election.cc:304] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:10.311861 11045 tablet_bootstrap.cc:492] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08: No bootstrap required, opened a new log
I20260709 12:24:10.312150 11215 raft_consensus.cc:2749] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:10.312414 11045 ts_tablet_manager.cc:1403] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.001s
W20260709 12:24:10.311336 10968 leader_election.cc:343] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:10.314980 11047 tablet_bootstrap.cc:654] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:10.323640 11045 raft_consensus.cc:359] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:10.324488 11045 raft_consensus.cc:385] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:10.324769 11045 raft_consensus.cc:740] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Initialized, Role: FOLLOWER
I20260709 12:24:10.325453 11045 consensus_queue.cc:260] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:10.314968 10968 leader_election.cc:304] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:10.327613 11140 raft_consensus.cc:2749] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:10.327732 11045 ts_tablet_manager.cc:1434] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.003s
I20260709 12:24:10.334460 11045 tablet_bootstrap.cc:492] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08: Bootstrap starting.
I20260709 12:24:10.349068 11045 tablet_bootstrap.cc:654] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:10.363087 11043 tablet_bootstrap.cc:492] T 5794ba618e514e28a7542ab6af39d8c9 P e2d5c637307a407ab688f5ccd6f0fcea: No bootstrap required, opened a new log
I20260709 12:24:10.363588 11047 tablet_bootstrap.cc:492] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040: No bootstrap required, opened a new log
I20260709 12:24:10.363667 11045 tablet_bootstrap.cc:492] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08: No bootstrap required, opened a new log
I20260709 12:24:10.364207 11047 ts_tablet_manager.cc:1403] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040: Time spent bootstrapping tablet: real 0.061s	user 0.011s	sys 0.004s
I20260709 12:24:10.363375 10750 catalog_manager.cc:5697] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 0 to 1, leader changed from <none> to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 1 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:10.364441 11043 ts_tablet_manager.cc:1403] T 5794ba618e514e28a7542ab6af39d8c9 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent bootstrapping tablet: real 0.082s	user 0.023s	sys 0.026s
I20260709 12:24:10.364511 11045 ts_tablet_manager.cc:1403] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08: Time spent bootstrapping tablet: real 0.030s	user 0.016s	sys 0.005s
I20260709 12:24:10.367024 11047 raft_consensus.cc:359] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:10.367620 11047 raft_consensus.cc:385] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:10.368048 11047 raft_consensus.cc:740] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Initialized, Role: FOLLOWER
I20260709 12:24:10.367553 11043 raft_consensus.cc:359] T 5794ba618e514e28a7542ab6af39d8c9 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:10.368741 11043 raft_consensus.cc:385] T 5794ba618e514e28a7542ab6af39d8c9 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:10.369091 11043 raft_consensus.cc:740] T 5794ba618e514e28a7542ab6af39d8c9 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Initialized, Role: FOLLOWER
I20260709 12:24:10.369848 11043 consensus_queue.cc:260] T 5794ba618e514e28a7542ab6af39d8c9 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:10.370584 11045 raft_consensus.cc:359] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:10.371438 11045 raft_consensus.cc:385] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:10.371815 11045 raft_consensus.cc:740] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Initialized, Role: FOLLOWER
I20260709 12:24:10.372629 11043 ts_tablet_manager.cc:1434] T 5794ba618e514e28a7542ab6af39d8c9 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:24:10.372545 11045 consensus_queue.cc:260] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:10.374105 11043 tablet_bootstrap.cc:492] T ab816bcc6183447994a2cc013e46c5f8 P e2d5c637307a407ab688f5ccd6f0fcea: Bootstrap starting.
I20260709 12:24:10.369107 11047 consensus_queue.cc:260] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:10.382302 11043 tablet_bootstrap.cc:654] T ab816bcc6183447994a2cc013e46c5f8 P e2d5c637307a407ab688f5ccd6f0fcea: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:10.383700 11047 ts_tablet_manager.cc:1434] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 12:24:10.384704 11047 tablet_bootstrap.cc:492] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040: Bootstrap starting.
I20260709 12:24:10.387384 11043 tablet_bootstrap.cc:492] T ab816bcc6183447994a2cc013e46c5f8 P e2d5c637307a407ab688f5ccd6f0fcea: No bootstrap required, opened a new log
I20260709 12:24:10.387907 11043 ts_tablet_manager.cc:1403] T ab816bcc6183447994a2cc013e46c5f8 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.003s
I20260709 12:24:10.388886 11045 ts_tablet_manager.cc:1434] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08: Time spent starting tablet: real 0.022s	user 0.000s	sys 0.007s
I20260709 12:24:10.389851 11045 tablet_bootstrap.cc:492] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08: Bootstrap starting.
I20260709 12:24:10.390559 11043 raft_consensus.cc:359] T ab816bcc6183447994a2cc013e46c5f8 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:10.391238 11043 raft_consensus.cc:385] T ab816bcc6183447994a2cc013e46c5f8 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:10.391397 11047 tablet_bootstrap.cc:654] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:10.391507 11043 raft_consensus.cc:740] T ab816bcc6183447994a2cc013e46c5f8 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Initialized, Role: FOLLOWER
I20260709 12:24:10.392467 11043 consensus_queue.cc:260] T ab816bcc6183447994a2cc013e46c5f8 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:10.395231 11043 ts_tablet_manager.cc:1434] T ab816bcc6183447994a2cc013e46c5f8 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:24:10.398837 11047 tablet_bootstrap.cc:492] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040: No bootstrap required, opened a new log
I20260709 12:24:10.399924 11045 tablet_bootstrap.cc:654] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:10.399384 11047 ts_tablet_manager.cc:1403] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040: Time spent bootstrapping tablet: real 0.015s	user 0.006s	sys 0.006s
I20260709 12:24:10.403894 11047 raft_consensus.cc:359] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:10.404636 11047 raft_consensus.cc:385] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:10.404927 11047 raft_consensus.cc:740] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Initialized, Role: FOLLOWER
I20260709 12:24:10.405777 11047 consensus_queue.cc:260] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:10.406704 11211 raft_consensus.cc:493] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.407410 11211 raft_consensus.cc:515] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:10.411557 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:10.412632 11000 raft_consensus.cc:2468] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 0.
I20260709 12:24:10.414754 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:10.416450 11043 tablet_bootstrap.cc:492] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea: Bootstrap starting.
I20260709 12:24:10.417156 10895 leader_election.cc:304] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:10.418130 11242 raft_consensus.cc:2804] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:10.415131 11047 ts_tablet_manager.cc:1434] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 12:24:10.418497 11242 raft_consensus.cc:493] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:10.418958 11242 raft_consensus.cc:3060] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:10.419445 11047 tablet_bootstrap.cc:492] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040: Bootstrap starting.
I20260709 12:24:10.425487 11043 tablet_bootstrap.cc:654] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:10.426080 11143 raft_consensus.cc:493] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.426656 11143 raft_consensus.cc:515] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:10.429014 11143 leader_election.cc:290] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:10.430987 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:10.431965 11000 raft_consensus.cc:2468] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 0.
I20260709 12:24:10.433769 10820 leader_election.cc:304] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:10.434931 11143 raft_consensus.cc:2804] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:10.435426 11143 raft_consensus.cc:493] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:10.435911 11143 raft_consensus.cc:3060] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:10.437171 11047 tablet_bootstrap.cc:654] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:10.441108 11207 consensus_queue.cc:1048] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:10.442397 11043 tablet_bootstrap.cc:492] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea: No bootstrap required, opened a new log
I20260709 12:24:10.443053 11043 ts_tablet_manager.cc:1403] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.003s
I20260709 12:24:10.444587 11213 raft_consensus.cc:493] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.445140 11213 raft_consensus.cc:515] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:10.446906 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:10.448218 11043 raft_consensus.cc:359] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:10.448920 11043 raft_consensus.cc:385] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:10.448994 11211 leader_election.cc:290] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:10.449414 11043 raft_consensus.cc:740] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Initialized, Role: FOLLOWER
I20260709 12:24:10.451610 11213 leader_election.cc:290] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:10.454032 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:10.457656 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:10.458678 10926 raft_consensus.cc:2393] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 1: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:24:10.450127 11043 consensus_queue.cc:260] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:10.464409 11043 ts_tablet_manager.cc:1434] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.005s
I20260709 12:24:10.465358 11043 tablet_bootstrap.cc:492] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea: Bootstrap starting.
I20260709 12:24:10.471710 10819 leader_election.cc:304] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:10.474851 11214 raft_consensus.cc:3060] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:10.472110 11297 raft_consensus.cc:493] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.475987 11297 raft_consensus.cc:515] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:10.477977 11213 consensus_queue.cc:1048] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:10.479081 11297 leader_election.cc:290] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:10.481065 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:10.482030 10850 raft_consensus.cc:2468] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 0.
I20260709 12:24:10.484886 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:10.485770 10999 raft_consensus.cc:2468] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 0.
I20260709 12:24:10.487236 11211 raft_consensus.cc:493] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.487921 11211 raft_consensus.cc:515] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:10.492147 10895 leader_election.cc:304] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:10.494546 11297 raft_consensus.cc:2804] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:10.495033 11297 raft_consensus.cc:493] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:10.495517 11297 raft_consensus.cc:3060] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:10.493224 11211 leader_election.cc:290] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:10.495081 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:10.496599 10999 raft_consensus.cc:2468] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 0.
I20260709 12:24:10.498545 11047 tablet_bootstrap.cc:492] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040: No bootstrap required, opened a new log
I20260709 12:24:10.499214 11047 ts_tablet_manager.cc:1403] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040: Time spent bootstrapping tablet: real 0.080s	user 0.016s	sys 0.002s
I20260709 12:24:10.500634 10895 leader_election.cc:304] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:10.503198 11207 raft_consensus.cc:2804] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:10.503865 11207 raft_consensus.cc:493] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:10.504345 11207 raft_consensus.cc:3060] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:10.506731 11043 tablet_bootstrap.cc:654] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:10.491101 11242 raft_consensus.cc:515] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:10.513216 11143 raft_consensus.cc:515] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:10.523653 11212 consensus_queue.cc:1048] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:10.526814 11143 leader_election.cc:290] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:10.528199 10852 raft_consensus.cc:2393] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 1: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:24:10.533591 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:10.533501 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:10.535382 10999 raft_consensus.cc:3060] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:10.536121 11242 leader_election.cc:290] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:10.537007 10925 raft_consensus.cc:2393] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 1: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:24:10.544675 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:10.547020 11297 raft_consensus.cc:515] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:10.553174 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:10.552992 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:10.543560 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:10.554046 10852 raft_consensus.cc:3060] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:10.554620 10850 raft_consensus.cc:2393] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 1: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:24:10.549502 11242 consensus_queue.cc:1048] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
W20260709 12:24:10.562451 10894 leader_election.cc:343] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:10.565598 11271 raft_consensus.cc:493] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.566291 11271 raft_consensus.cc:515] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:10.568262 10852 raft_consensus.cc:2468] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 1.
I20260709 12:24:10.570201 11143 raft_consensus.cc:493] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.570761 11143 raft_consensus.cc:515] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:10.568606 11271 leader_election.cc:290] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:10.574362 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5794ba618e514e28a7542ab6af39d8c9" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:10.574728 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5794ba618e514e28a7542ab6af39d8c9" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:10.575013 10925 raft_consensus.cc:2468] T 5794ba618e514e28a7542ab6af39d8c9 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 0.
I20260709 12:24:10.575655 11001 raft_consensus.cc:2468] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 0.
I20260709 12:24:10.576756 10819 leader_election.cc:304] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:10.569727 10999 raft_consensus.cc:2468] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 1.
I20260709 12:24:10.578480 10820 leader_election.cc:304] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:10.580044 11212 raft_consensus.cc:2804] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:10.581596 11213 raft_consensus.cc:2804] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:10.582211 11213 raft_consensus.cc:493] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:10.582625 11213 raft_consensus.cc:3060] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:10.553471 11214 raft_consensus.cc:2749] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:10.591758 11143 leader_election.cc:290] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:10.596755 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:10.598400 10895 leader_election.cc:304] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:10.616087 11207 raft_consensus.cc:515] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:10.618405 11207 leader_election.cc:290] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:10.618858 11045 tablet_bootstrap.cc:492] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08: No bootstrap required, opened a new log
I20260709 12:24:10.619082 11211 raft_consensus.cc:2749] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:24:10.619666 11045 ts_tablet_manager.cc:1403] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08: Time spent bootstrapping tablet: real 0.230s	user 0.071s	sys 0.115s
I20260709 12:24:10.623535 11047 raft_consensus.cc:359] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:10.624496 11047 raft_consensus.cc:385] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:10.624863 11047 raft_consensus.cc:740] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Initialized, Role: FOLLOWER
I20260709 12:24:10.625872 11043 tablet_bootstrap.cc:492] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea: No bootstrap required, opened a new log
I20260709 12:24:10.625662 11047 consensus_queue.cc:260] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:10.627264 11043 ts_tablet_manager.cc:1403] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea: Time spent bootstrapping tablet: real 0.162s	user 0.014s	sys 0.018s
I20260709 12:24:10.632807 11043 raft_consensus.cc:359] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:10.633688 11043 raft_consensus.cc:385] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:10.634141 11043 raft_consensus.cc:740] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Initialized, Role: FOLLOWER
I20260709 12:24:10.635072 11213 raft_consensus.cc:515] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:10.636026 10895 leader_election.cc:343] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:10.636638 11043 consensus_queue.cc:260] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:10.637292 10894 leader_election.cc:304] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:10.638348 11242 raft_consensus.cc:2804] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:10.638679 11213 leader_election.cc:290] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:10.634233 11297 leader_election.cc:290] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:10.640493 11045 raft_consensus.cc:359] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:10.641757 11045 raft_consensus.cc:385] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:10.642513 11045 raft_consensus.cc:740] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Initialized, Role: FOLLOWER
I20260709 12:24:10.641659 11212 raft_consensus.cc:697] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040 [term 1 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:10.645126 11212 consensus_queue.cc:237] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:10.643324 11045 consensus_queue.cc:260] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:10.648481 11043 ts_tablet_manager.cc:1434] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:24:10.649688 11043 tablet_bootstrap.cc:492] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea: Bootstrap starting.
I20260709 12:24:10.652505 11045 ts_tablet_manager.cc:1434] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.000s
I20260709 12:24:10.654312 11045 tablet_bootstrap.cc:492] T 69fd8fdac2fa449e9e184f3d668ea1a7 P edcc56ddd3264984b4da6c1db59e7f08: Bootstrap starting.
I20260709 12:24:10.664059 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:10.664494 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:10.664911 11002 raft_consensus.cc:3060] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:10.665187 10997 raft_consensus.cc:3060] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:10.678282 11047 ts_tablet_manager.cc:1434] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040: Time spent starting tablet: real 0.179s	user 0.012s	sys 0.000s
I20260709 12:24:10.679328 11047 tablet_bootstrap.cc:492] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040: Bootstrap starting.
I20260709 12:24:10.682828 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5794ba618e514e28a7542ab6af39d8c9" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:10.668958 11242 raft_consensus.cc:697] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:10.691743 11043 tablet_bootstrap.cc:654] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:10.701385 11216 consensus_queue.cc:1048] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:10.701601 11242 consensus_queue.cc:237] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:10.704869 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5794ba618e514e28a7542ab6af39d8c9" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:10.708184 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:10.686786 10999 raft_consensus.cc:3060] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:10.716369 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:10.705634 10926 raft_consensus.cc:3060] T 5794ba618e514e28a7542ab6af39d8c9 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:24:10.725584 10894 leader_election.cc:343] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:24:10.733651 10894 leader_election.cc:343] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:10.734280 10894 leader_election.cc:304] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:10.749280 11140 raft_consensus.cc:493] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.750133 11140 raft_consensus.cc:515] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:10.752092 11211 raft_consensus.cc:493] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.755105 11140 leader_election.cc:290] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:10.735739 11305 raft_consensus.cc:2749] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:10.752693 11211 raft_consensus.cc:515] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:10.767727 11045 tablet_bootstrap.cc:654] T 69fd8fdac2fa449e9e184f3d668ea1a7 P edcc56ddd3264984b4da6c1db59e7f08: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:10.781466 11002 raft_consensus.cc:2468] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 1.
I20260709 12:24:10.769846 11215 raft_consensus.cc:493] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.803836 10895 leader_election.cc:304] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:24:10.788165 10749 catalog_manager.cc:5697] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 0 to 1, leader changed from <none> to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 1 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:10.809387 11211 leader_election.cc:290] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:10.806454 11305 raft_consensus.cc:2804] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:10.799428 11215 raft_consensus.cc:515] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:10.804520 11304 consensus_queue.cc:1048] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
W20260709 12:24:10.821614 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 124092us
I20260709 12:24:10.820936 11305 raft_consensus.cc:697] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:10.820168 10997 raft_consensus.cc:2468] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 1.
I20260709 12:24:10.849402 11047 tablet_bootstrap.cc:654] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:10.849673 10999 raft_consensus.cc:2468] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 1.
I20260709 12:24:10.851365 11043 tablet_bootstrap.cc:492] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea: No bootstrap required, opened a new log
I20260709 12:24:10.851601 11215 leader_election.cc:290] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:10.852376 11305 consensus_queue.cc:237] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:10.856302 11043 ts_tablet_manager.cc:1403] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea: Time spent bootstrapping tablet: real 0.207s	user 0.022s	sys 0.001s
I20260709 12:24:10.835659 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:10.840955 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:10.863348 10850 raft_consensus.cc:2468] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 0.
I20260709 12:24:10.837674 11212 consensus_queue.cc:1048] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260709 12:24:10.862599 11001 raft_consensus.cc:2468] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 0.
I20260709 12:24:10.869053 10895 leader_election.cc:304] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:10.867242 11242 raft_consensus.cc:493] T ab816bcc6183447994a2cc013e46c5f8 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.871884 11242 raft_consensus.cc:515] T ab816bcc6183447994a2cc013e46c5f8 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:10.873214 10926 raft_consensus.cc:2468] T 5794ba618e514e28a7542ab6af39d8c9 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 1.
I20260709 12:24:10.873461 11306 raft_consensus.cc:2804] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:10.876401 11306 raft_consensus.cc:493] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:10.882890 11306 raft_consensus.cc:3060] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:10.861619 11216 consensus_queue.cc:1048] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 12:24:10.889113 11242 leader_election.cc:290] T ab816bcc6183447994a2cc013e46c5f8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:10.890254 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab816bcc6183447994a2cc013e46c5f8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:10.893548 11001 raft_consensus.cc:2468] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 0.
I20260709 12:24:10.895664 10895 leader_election.cc:304] T ab816bcc6183447994a2cc013e46c5f8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:10.897152 11242 raft_consensus.cc:2804] T ab816bcc6183447994a2cc013e46c5f8 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:10.897727 11242 raft_consensus.cc:493] T ab816bcc6183447994a2cc013e46c5f8 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:10.898187 11242 raft_consensus.cc:3060] T ab816bcc6183447994a2cc013e46c5f8 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:10.891515 10820 leader_election.cc:304] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:10.905196 11043 raft_consensus.cc:359] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:10.906280 11043 raft_consensus.cc:385] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:10.907146 11043 raft_consensus.cc:740] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Initialized, Role: FOLLOWER
I20260709 12:24:10.916020 11043 consensus_queue.cc:260] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:10.921033 11307 log.cc:927] Time spent T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.097s	user 0.002s	sys 0.000s
I20260709 12:24:10.917022 11315 raft_consensus.cc:2804] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:10.929767 11043 ts_tablet_manager.cc:1434] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea: Time spent starting tablet: real 0.071s	user 0.009s	sys 0.000s
I20260709 12:24:10.933630 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab816bcc6183447994a2cc013e46c5f8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
W20260709 12:24:10.938295 10894 leader_election.cc:343] T ab816bcc6183447994a2cc013e46c5f8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:10.951681 11043 tablet_bootstrap.cc:492] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea: Bootstrap starting.
I20260709 12:24:10.944042 11315 raft_consensus.cc:697] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [term 1 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:10.971161 10751 catalog_manager.cc:5697] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 0 to 1, leader changed from <none> to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 1 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:10.968864 11315 consensus_queue.cc:237] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:10.973610 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab816bcc6183447994a2cc013e46c5f8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:10.978925 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab816bcc6183447994a2cc013e46c5f8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:10.959846 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac83709373b4efd9c3aa1472a9f9022" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:10.978228 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac83709373b4efd9c3aa1472a9f9022" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:11.000109 11045 tablet_bootstrap.cc:492] T 69fd8fdac2fa449e9e184f3d668ea1a7 P edcc56ddd3264984b4da6c1db59e7f08: No bootstrap required, opened a new log
I20260709 12:24:11.000586 11045 ts_tablet_manager.cc:1403] T 69fd8fdac2fa449e9e184f3d668ea1a7 P edcc56ddd3264984b4da6c1db59e7f08: Time spent bootstrapping tablet: real 0.347s	user 0.029s	sys 0.036s
I20260709 12:24:10.984205 11306 raft_consensus.cc:515] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:11.009902 11306 leader_election.cc:290] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:11.014084 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:11.014453 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:11.015923 10997 raft_consensus.cc:3060] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:11.016098 10849 raft_consensus.cc:3060] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:11.026388 11242 raft_consensus.cc:515] T ab816bcc6183447994a2cc013e46c5f8 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:11.040683 10924 raft_consensus.cc:2393] T ab816bcc6183447994a2cc013e46c5f8 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 1: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:24:11.044839 11043 tablet_bootstrap.cc:654] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:11.045425 11045 raft_consensus.cc:359] T 69fd8fdac2fa449e9e184f3d668ea1a7 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:11.046139 11045 raft_consensus.cc:385] T 69fd8fdac2fa449e9e184f3d668ea1a7 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:11.046454 11045 raft_consensus.cc:740] T 69fd8fdac2fa449e9e184f3d668ea1a7 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Initialized, Role: FOLLOWER
I20260709 12:24:11.050643 11242 leader_election.cc:290] T ab816bcc6183447994a2cc013e46c5f8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:24:11.020852 10968 leader_election.cc:343] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:11.047124 11045 consensus_queue.cc:260] T 69fd8fdac2fa449e9e184f3d668ea1a7 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:11.066958 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab816bcc6183447994a2cc013e46c5f8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:11.067907 11000 raft_consensus.cc:3060] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:24:11.069597 10968 leader_election.cc:343] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:11.061022 10997 raft_consensus.cc:2468] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 1.
I20260709 12:24:11.053221 10849 raft_consensus.cc:2468] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 1.
I20260709 12:24:11.073477 10895 leader_election.cc:304] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:11.074052 11045 ts_tablet_manager.cc:1434] T 69fd8fdac2fa449e9e184f3d668ea1a7 P edcc56ddd3264984b4da6c1db59e7f08: Time spent starting tablet: real 0.073s	user 0.009s	sys 0.000s
I20260709 12:24:11.075330 11045 tablet_bootstrap.cc:492] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08: Bootstrap starting.
I20260709 12:24:11.078779 11314 consensus_queue.cc:1048] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:24:11.080634 11242 raft_consensus.cc:2804] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:11.087920 11242 raft_consensus.cc:697] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:11.089535 11242 consensus_queue.cc:237] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:11.089600 10751 catalog_manager.cc:5697] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 0 to 1, leader changed from <none> to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 1 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:11.109285 10968 leader_election.cc:304] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:11.110164 11047 tablet_bootstrap.cc:492] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040: No bootstrap required, opened a new log
I20260709 12:24:11.110817 11047 ts_tablet_manager.cc:1403] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040: Time spent bootstrapping tablet: real 0.432s	user 0.018s	sys 0.000s
W20260709 12:24:11.105188 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 63485.2us
I20260709 12:24:11.150278 11047 raft_consensus.cc:359] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:11.151693 11047 raft_consensus.cc:385] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:11.152094 11047 raft_consensus.cc:740] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Initialized, Role: FOLLOWER
I20260709 12:24:11.153074 11047 consensus_queue.cc:260] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:11.162598 11047 ts_tablet_manager.cc:1434] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040: Time spent starting tablet: real 0.051s	user 0.011s	sys 0.000s
I20260709 12:24:11.169299 11047 tablet_bootstrap.cc:492] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040: Bootstrap starting.
W20260709 12:24:11.154408 10968 leader_election.cc:343] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:11.173091 10968 leader_election.cc:304] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:11.174062 11215 raft_consensus.cc:2749] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:11.157037 11045 tablet_bootstrap.cc:654] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:11.176570 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab816bcc6183447994a2cc013e46c5f8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:11.177232 10849 raft_consensus.cc:3060] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:11.178400 11315 consensus_queue.cc:1048] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:11.154209 11043 tablet_bootstrap.cc:492] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea: No bootstrap required, opened a new log
I20260709 12:24:11.179836 11043 ts_tablet_manager.cc:1403] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea: Time spent bootstrapping tablet: real 0.230s	user 0.040s	sys 0.020s
I20260709 12:24:11.199527 11211 raft_consensus.cc:493] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:11.201850 10749 catalog_manager.cc:5697] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 0 to 1, leader changed from <none> to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 1 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:11.204587 11211 raft_consensus.cc:515] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:11.206911 11211 leader_election.cc:290] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:11.208828 11043 raft_consensus.cc:359] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:11.209278 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:11.212385 11043 raft_consensus.cc:385] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:11.213390 11001 raft_consensus.cc:2468] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 0.
I20260709 12:24:11.219269 11043 raft_consensus.cc:740] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Initialized, Role: FOLLOWER
I20260709 12:24:11.220587 11043 consensus_queue.cc:260] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:11.225370 10895 leader_election.cc:304] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:11.228657 11043 ts_tablet_manager.cc:1434] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.001s
I20260709 12:24:11.230443 11215 raft_consensus.cc:493] T 69fd8fdac2fa449e9e184f3d668ea1a7 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:11.231359 11306 raft_consensus.cc:2804] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:11.231822 11306 raft_consensus.cc:493] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:11.231527 11215 raft_consensus.cc:515] T 69fd8fdac2fa449e9e184f3d668ea1a7 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:11.232203 11306 raft_consensus.cc:3060] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:11.233898 11215 leader_election.cc:290] T 69fd8fdac2fa449e9e184f3d668ea1a7 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:11.235014 10849 raft_consensus.cc:2468] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 1.
I20260709 12:24:11.236889 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:11.242259 11047 tablet_bootstrap.cc:654] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:11.245847 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fd8fdac2fa449e9e184f3d668ea1a7" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:11.223734 11000 raft_consensus.cc:2468] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 1.
I20260709 12:24:11.248834 11216 raft_consensus.cc:2749] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:11.250057 11043 tablet_bootstrap.cc:492] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea: Bootstrap starting.
I20260709 12:24:11.253538 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fd8fdac2fa449e9e184f3d668ea1a7" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:24:11.257838 10968 leader_election.cc:343] T 69fd8fdac2fa449e9e184f3d668ea1a7 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:11.257915 10895 leader_election.cc:304] T ab816bcc6183447994a2cc013e46c5f8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:11.268065 11324 raft_consensus.cc:2804] T ab816bcc6183447994a2cc013e46c5f8 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:11.269755 11324 raft_consensus.cc:697] T ab816bcc6183447994a2cc013e46c5f8 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:11.271152 11045 tablet_bootstrap.cc:492] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08: No bootstrap required, opened a new log
I20260709 12:24:11.271785 11045 ts_tablet_manager.cc:1403] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08: Time spent bootstrapping tablet: real 0.197s	user 0.023s	sys 0.000s
I20260709 12:24:11.270946 11324 consensus_queue.cc:237] T ab816bcc6183447994a2cc013e46c5f8 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:11.275908 10968 leader_election.cc:343] T 69fd8fdac2fa449e9e184f3d668ea1a7 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:11.281256 10968 leader_election.cc:304] T 69fd8fdac2fa449e9e184f3d668ea1a7 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
W20260709 12:24:11.282981 10894 leader_election.cc:343] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:11.290817 11043 tablet_bootstrap.cc:654] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:11.280123 11306 raft_consensus.cc:515] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:11.294211 11216 raft_consensus.cc:2749] T 69fd8fdac2fa449e9e184f3d668ea1a7 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:11.294523 11306 leader_election.cc:290] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:11.298154 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:11.298980 11001 raft_consensus.cc:3060] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:11.299435 11045 raft_consensus.cc:359] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:11.300679 11045 raft_consensus.cc:385] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:11.301025 11045 raft_consensus.cc:740] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Initialized, Role: FOLLOWER
I20260709 12:24:11.301995 11045 consensus_queue.cc:260] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:11.285825 10752 catalog_manager.cc:5697] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 0 to 1, leader changed from <none> to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 1 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:11.331025 11047 tablet_bootstrap.cc:492] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040: No bootstrap required, opened a new log
I20260709 12:24:11.331984 11047 ts_tablet_manager.cc:1403] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040: Time spent bootstrapping tablet: real 0.163s	user 0.023s	sys 0.016s
I20260709 12:24:11.333029 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:11.333491 11045 ts_tablet_manager.cc:1434] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08: Time spent starting tablet: real 0.061s	user 0.009s	sys 0.000s
I20260709 12:24:11.334906 11047 raft_consensus.cc:359] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:11.335707 11047 raft_consensus.cc:385] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:24:11.335346 10894 leader_election.cc:343] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:11.336062 11047 raft_consensus.cc:740] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Initialized, Role: FOLLOWER
I20260709 12:24:11.343773 11045 tablet_bootstrap.cc:492] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08: Bootstrap starting.
I20260709 12:24:11.336854 11047 consensus_queue.cc:260] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:11.348948 11047 ts_tablet_manager.cc:1434] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.001s
I20260709 12:24:11.350737 11047 tablet_bootstrap.cc:492] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040: Bootstrap starting.
I20260709 12:24:11.356837 10751 catalog_manager.cc:5697] T ab816bcc6183447994a2cc013e46c5f8 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 0 to 1, leader changed from <none> to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 1 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:11.359464 11043 tablet_bootstrap.cc:492] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea: No bootstrap required, opened a new log
I20260709 12:24:11.360059 11043 ts_tablet_manager.cc:1403] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent bootstrapping tablet: real 0.110s	user 0.009s	sys 0.018s
W20260709 12:24:11.369503 10800 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:24:11.369499 11001 raft_consensus.cc:2468] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 1.
I20260709 12:24:11.371413 11043 raft_consensus.cc:359] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:11.372223 11043 raft_consensus.cc:385] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:11.372538 11043 raft_consensus.cc:740] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Initialized, Role: FOLLOWER
I20260709 12:24:11.373238 11043 consensus_queue.cc:260] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:11.375794 11047 tablet_bootstrap.cc:654] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:11.376350 10895 leader_election.cc:304] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:24:11.378486 11211 raft_consensus.cc:2804] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:11.379027 11211 raft_consensus.cc:697] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:11.382665 11315 consensus_queue.cc:1048] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:11.384143 11045 tablet_bootstrap.cc:654] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:11.388537 11324 consensus_queue.cc:1048] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:11.392185 11043 ts_tablet_manager.cc:1434] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.000s
I20260709 12:24:11.393525 11043 tablet_bootstrap.cc:492] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea: Bootstrap starting.
I20260709 12:24:11.393621 11211 consensus_queue.cc:237] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:11.408072 11045 tablet_bootstrap.cc:492] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08: No bootstrap required, opened a new log
I20260709 12:24:11.408744 11045 ts_tablet_manager.cc:1403] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08: Time spent bootstrapping tablet: real 0.070s	user 0.012s	sys 0.000s
I20260709 12:24:11.412039 11306 consensus_queue.cc:1048] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:11.412508 11045 raft_consensus.cc:359] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:11.413425 11045 raft_consensus.cc:385] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:11.413774 11045 raft_consensus.cc:740] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Initialized, Role: FOLLOWER
I20260709 12:24:11.414117 11306 consensus_queue.cc:1048] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:11.415257 11045 consensus_queue.cc:260] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:11.418061 11045 ts_tablet_manager.cc:1434] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:24:11.418954 11043 tablet_bootstrap.cc:654] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:11.426338 11045 tablet_bootstrap.cc:492] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08: Bootstrap starting.
I20260709 12:24:11.433032 11043 tablet_bootstrap.cc:492] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea: No bootstrap required, opened a new log
I20260709 12:24:11.433559 11043 ts_tablet_manager.cc:1403] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent bootstrapping tablet: real 0.040s	user 0.006s	sys 0.009s
I20260709 12:24:11.439805 11047 tablet_bootstrap.cc:492] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040: No bootstrap required, opened a new log
I20260709 12:24:11.440356 11047 ts_tablet_manager.cc:1403] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040: Time spent bootstrapping tablet: real 0.090s	user 0.014s	sys 0.016s
I20260709 12:24:11.440528 10852 raft_consensus.cc:3060] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:11.443238 11047 raft_consensus.cc:359] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:11.442111 10752 catalog_manager.cc:5697] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 0 to 1, leader changed from <none> to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 1 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:11.444031 11047 raft_consensus.cc:385] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:11.444363 11047 raft_consensus.cc:740] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Initialized, Role: FOLLOWER
I20260709 12:24:11.445009 11047 consensus_queue.cc:260] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:11.447131 11047 ts_tablet_manager.cc:1434] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:24:11.447634 11212 consensus_queue.cc:1048] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:11.448177 11047 tablet_bootstrap.cc:492] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040: Bootstrap starting.
I20260709 12:24:11.454455 11043 raft_consensus.cc:359] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:11.455724 11043 raft_consensus.cc:385] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:11.456049 11043 raft_consensus.cc:740] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Initialized, Role: FOLLOWER
I20260709 12:24:11.460227 11043 consensus_queue.cc:260] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:11.466977 11047 tablet_bootstrap.cc:654] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:11.469650 11045 tablet_bootstrap.cc:654] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:11.471655 11242 consensus_queue.cc:1048] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:11.476084 11043 ts_tablet_manager.cc:1434] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent starting tablet: real 0.042s	user 0.003s	sys 0.005s
I20260709 12:24:11.477103 11043 tablet_bootstrap.cc:492] T 352aa49c65194abbb863d7553a091f11 P e2d5c637307a407ab688f5ccd6f0fcea: Bootstrap starting.
I20260709 12:24:11.481753 11211 raft_consensus.cc:493] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:11.483765 11043 tablet_bootstrap.cc:654] T 352aa49c65194abbb863d7553a091f11 P e2d5c637307a407ab688f5ccd6f0fcea: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:11.492141 11216 raft_consensus.cc:493] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:11.493039 11216 raft_consensus.cc:515] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:11.496497 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:11.497617 11047 tablet_bootstrap.cc:492] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040: No bootstrap required, opened a new log
I20260709 12:24:11.498132 11047 ts_tablet_manager.cc:1403] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040: Time spent bootstrapping tablet: real 0.050s	user 0.012s	sys 0.003s
W20260709 12:24:11.497872 10968 leader_election.cc:343] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:11.500121 11216 leader_election.cc:290] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:11.501353 11047 raft_consensus.cc:359] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:11.502111 11047 raft_consensus.cc:385] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:11.502396 11047 raft_consensus.cc:740] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Initialized, Role: FOLLOWER
I20260709 12:24:11.503103 11047 consensus_queue.cc:260] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:11.504578 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:11.505275 10926 raft_consensus.cc:2468] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 0.
I20260709 12:24:11.506492 10968 leader_election.cc:304] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:24:11.504686 11047 ts_tablet_manager.cc:1434] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:24:11.509176 11047 tablet_bootstrap.cc:492] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040: Bootstrap starting.
I20260709 12:24:11.482316 11211 raft_consensus.cc:515] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:11.512681 11216 raft_consensus.cc:2804] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:11.513206 11216 raft_consensus.cc:493] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:11.513573 11216 raft_consensus.cc:3060] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:11.516876 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
W20260709 12:24:11.520354 10894 leader_election.cc:343] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:11.520336 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:11.522564 11216 raft_consensus.cc:515] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:11.523649 10895 leader_election.cc:343] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:11.524246 10895 leader_election.cc:304] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:11.524962 11047 tablet_bootstrap.cc:654] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:11.525144 11324 raft_consensus.cc:2749] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:11.526310 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:11.527938 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
W20260709 12:24:11.527951 10968 leader_election.cc:343] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:11.528595 10926 raft_consensus.cc:3060] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:11.527244 11216 leader_election.cc:290] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:11.533676 11047 tablet_bootstrap.cc:492] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040: No bootstrap required, opened a new log
I20260709 12:24:11.534209 11047 ts_tablet_manager.cc:1403] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040: Time spent bootstrapping tablet: real 0.025s	user 0.007s	sys 0.003s
I20260709 12:24:11.536768 10926 raft_consensus.cc:2468] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 1.
I20260709 12:24:11.537011 11047 raft_consensus.cc:359] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:11.537742 11047 raft_consensus.cc:385] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:11.538043 11047 raft_consensus.cc:740] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Initialized, Role: FOLLOWER
I20260709 12:24:11.538714 11047 consensus_queue.cc:260] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:11.539116 10968 leader_election.cc:304] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:24:11.540045 11216 raft_consensus.cc:2804] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:11.542001 11216 raft_consensus.cc:697] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 1 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:11.543211 11216 consensus_queue.cc:237] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:11.547678 11211 leader_election.cc:290] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:11.547932 11047 ts_tablet_manager.cc:1434] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.002s
I20260709 12:24:11.550678 11047 tablet_bootstrap.cc:492] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040: Bootstrap starting.
I20260709 12:24:11.564771 11043 tablet_bootstrap.cc:492] T 352aa49c65194abbb863d7553a091f11 P e2d5c637307a407ab688f5ccd6f0fcea: No bootstrap required, opened a new log
I20260709 12:24:11.565558 11043 ts_tablet_manager.cc:1403] T 352aa49c65194abbb863d7553a091f11 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent bootstrapping tablet: real 0.089s	user 0.015s	sys 0.027s
I20260709 12:24:11.566665 11045 tablet_bootstrap.cc:492] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08: No bootstrap required, opened a new log
I20260709 12:24:11.567166 11045 ts_tablet_manager.cc:1403] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08: Time spent bootstrapping tablet: real 0.141s	user 0.012s	sys 0.004s
I20260709 12:24:11.569087 11047 tablet_bootstrap.cc:654] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:11.569970 11045 raft_consensus.cc:359] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:11.570851 11045 raft_consensus.cc:385] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:11.570596 11043 raft_consensus.cc:359] T 352aa49c65194abbb863d7553a091f11 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:11.571159 11045 raft_consensus.cc:740] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Initialized, Role: FOLLOWER
I20260709 12:24:11.571336 11043 raft_consensus.cc:385] T 352aa49c65194abbb863d7553a091f11 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:11.571971 11045 consensus_queue.cc:260] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:11.571765 10750 catalog_manager.cc:5697] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 0 to 1, leader changed from <none> to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 1 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:11.572906 11043 raft_consensus.cc:740] T 352aa49c65194abbb863d7553a091f11 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Initialized, Role: FOLLOWER
I20260709 12:24:11.573632 11043 consensus_queue.cc:260] T 352aa49c65194abbb863d7553a091f11 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:11.575358 11212 raft_consensus.cc:493] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:11.576311 11043 ts_tablet_manager.cc:1434] T 352aa49c65194abbb863d7553a091f11 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.002s
I20260709 12:24:11.576465 11212 raft_consensus.cc:515] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:11.577293 11043 tablet_bootstrap.cc:492] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea: Bootstrap starting.
I20260709 12:24:11.581770 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352aa49c65194abbb863d7553a091f11" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:11.582515 10926 raft_consensus.cc:2468] T 352aa49c65194abbb863d7553a091f11 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 0.
I20260709 12:24:11.584161 11043 tablet_bootstrap.cc:654] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:11.584051 10819 leader_election.cc:304] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:11.585913 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352aa49c65194abbb863d7553a091f11" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:11.586731 11000 raft_consensus.cc:2468] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 0.
I20260709 12:24:11.588392 11143 raft_consensus.cc:2804] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:11.588973 11143 raft_consensus.cc:493] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:11.589407 11143 raft_consensus.cc:3060] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:11.589836 11045 ts_tablet_manager.cc:1434] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 12:24:11.589982 11047 tablet_bootstrap.cc:492] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040: No bootstrap required, opened a new log
I20260709 12:24:11.590827 11045 tablet_bootstrap.cc:492] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08: Bootstrap starting.
I20260709 12:24:11.599363 11212 leader_election.cc:290] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:11.602286 11045 tablet_bootstrap.cc:654] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:11.600445 11047 ts_tablet_manager.cc:1403] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040: Time spent bootstrapping tablet: real 0.050s	user 0.016s	sys 0.003s
I20260709 12:24:11.609407 11211 consensus_queue.cc:1048] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:11.610038 11143 raft_consensus.cc:515] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:11.612980 11143 leader_election.cc:290] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:11.614506 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352aa49c65194abbb863d7553a091f11" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:11.615644 11000 raft_consensus.cc:3060] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:11.616413 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352aa49c65194abbb863d7553a091f11" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:11.617350 10926 raft_consensus.cc:3060] T 352aa49c65194abbb863d7553a091f11 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:11.620173 11043 tablet_bootstrap.cc:492] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea: No bootstrap required, opened a new log
I20260709 12:24:11.620684 11043 ts_tablet_manager.cc:1403] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea: Time spent bootstrapping tablet: real 0.044s	user 0.017s	sys 0.007s
I20260709 12:24:11.623512 11043 raft_consensus.cc:359] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:11.624275 11043 raft_consensus.cc:385] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:11.624549 11043 raft_consensus.cc:740] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Initialized, Role: FOLLOWER
I20260709 12:24:11.625232 11043 consensus_queue.cc:260] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:11.627465 11043 ts_tablet_manager.cc:1434] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:24:11.628741 11043 tablet_bootstrap.cc:492] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea: Bootstrap starting.
I20260709 12:24:11.639528 11047 raft_consensus.cc:359] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:11.640722 11047 raft_consensus.cc:385] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:11.641016 11047 raft_consensus.cc:740] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Initialized, Role: FOLLOWER
I20260709 12:24:11.646488 11047 consensus_queue.cc:260] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:11.650520 11000 raft_consensus.cc:2468] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 1.
I20260709 12:24:11.659930 11047 ts_tablet_manager.cc:1434] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040: Time spent starting tablet: real 0.054s	user 0.006s	sys 0.003s
I20260709 12:24:11.661419 11047 tablet_bootstrap.cc:492] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040: Bootstrap starting.
I20260709 12:24:11.658152 10926 raft_consensus.cc:2468] T 352aa49c65194abbb863d7553a091f11 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 1.
I20260709 12:24:11.662752 10819 leader_election.cc:304] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:11.664117 11211 raft_consensus.cc:493] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:11.659934 11043 tablet_bootstrap.cc:654] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:11.665040 11045 tablet_bootstrap.cc:492] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08: No bootstrap required, opened a new log
I20260709 12:24:11.666196 11045 ts_tablet_manager.cc:1403] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08: Time spent bootstrapping tablet: real 0.076s	user 0.016s	sys 0.003s
I20260709 12:24:11.664719 11212 raft_consensus.cc:2804] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:11.664674 11211 raft_consensus.cc:515] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:11.667378 11212 raft_consensus.cc:697] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [term 1 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:11.669394 11211 leader_election.cc:290] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:11.669334 11212 consensus_queue.cc:237] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:11.670787 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fd8fdac2fa449e9e184f3d668ea1a7" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:11.671422 10854 raft_consensus.cc:2468] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 0.
I20260709 12:24:11.671458 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fd8fdac2fa449e9e184f3d668ea1a7" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:11.671808 11143 raft_consensus.cc:493] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:11.672348 11001 raft_consensus.cc:2468] T 69fd8fdac2fa449e9e184f3d668ea1a7 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 0.
I20260709 12:24:11.672821 10894 leader_election.cc:304] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:11.673884 11242 raft_consensus.cc:2804] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:11.674227 11242 raft_consensus.cc:493] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:11.674490 11242 raft_consensus.cc:3060] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:11.678843 11047 tablet_bootstrap.cc:654] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:11.672344 11143 raft_consensus.cc:515] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:11.682001 11242 raft_consensus.cc:515] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:11.683756 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:11.687763 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fd8fdac2fa449e9e184f3d668ea1a7" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:11.684806 11045 raft_consensus.cc:359] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:11.688570 10852 raft_consensus.cc:3060] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:11.688829 11045 raft_consensus.cc:385] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:11.689495 11045 raft_consensus.cc:740] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Initialized, Role: FOLLOWER
I20260709 12:24:11.690621 11045 consensus_queue.cc:260] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:11.695245 11045 ts_tablet_manager.cc:1434] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08: Time spent starting tablet: real 0.029s	user 0.002s	sys 0.005s
I20260709 12:24:11.698843 10852 raft_consensus.cc:2468] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 1.
I20260709 12:24:11.686721 11242 leader_election.cc:290] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:11.699991 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fd8fdac2fa449e9e184f3d668ea1a7" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:11.700593 11045 tablet_bootstrap.cc:492] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08: Bootstrap starting.
I20260709 12:24:11.702528 10894 leader_election.cc:304] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:11.703612 11242 raft_consensus.cc:2804] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:11.703886 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:11.704748 10926 raft_consensus.cc:2393] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 1: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:24:11.706722 10819 leader_election.cc:304] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:11.707098 11242 raft_consensus.cc:697] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:11.707521 11304 raft_consensus.cc:3060] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:11.708966 11242 consensus_queue.cc:237] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:11.712056 11305 raft_consensus.cc:493] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:11.713286 11143 leader_election.cc:290] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:11.713045 11305 raft_consensus.cc:515] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:11.716123 11045 tablet_bootstrap.cc:654] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:11.716372 11047 tablet_bootstrap.cc:492] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040: No bootstrap required, opened a new log
I20260709 12:24:11.720518 11047 ts_tablet_manager.cc:1403] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040: Time spent bootstrapping tablet: real 0.059s	user 0.009s	sys 0.004s
I20260709 12:24:11.722640 11305 leader_election.cc:290] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:11.724403 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
W20260709 12:24:11.725961 10894 leader_election.cc:343] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:11.726238 11304 raft_consensus.cc:2749] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:11.731560 11211 consensus_queue.cc:1048] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:11.733456 11047 raft_consensus.cc:359] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:11.734508 11047 raft_consensus.cc:385] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:11.735069 11047 raft_consensus.cc:740] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Initialized, Role: FOLLOWER
I20260709 12:24:11.737339 11047 consensus_queue.cc:260] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:11.700604 11001 raft_consensus.cc:3060] T 69fd8fdac2fa449e9e184f3d668ea1a7 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:11.742734 11047 ts_tablet_manager.cc:1434] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.001s
I20260709 12:24:11.743731 11047 tablet_bootstrap.cc:492] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040: Bootstrap starting.
I20260709 12:24:11.744398 10751 catalog_manager.cc:5697] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 0 to 1, leader changed from <none> to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 1 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:11.749728 11047 tablet_bootstrap.cc:654] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:11.756428 11305 raft_consensus.cc:493] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:11.757718 11324 consensus_queue.cc:1048] T ab816bcc6183447994a2cc013e46c5f8 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:11.757089 11305 raft_consensus.cc:515] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:11.772123 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
W20260709 12:24:11.774204 10894 leader_election.cc:343] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:11.775341 11216 raft_consensus.cc:493] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:11.776039 11216 raft_consensus.cc:515] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:11.783335 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18294423a68a4671bf6c5a0f98645e4c" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
W20260709 12:24:11.784871 10968 leader_election.cc:343] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:11.785652 10751 catalog_manager.cc:5697] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 0 to 1, leader changed from <none> to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 1 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:11.780925 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:11.787226 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18294423a68a4671bf6c5a0f98645e4c" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:11.788511 11216 leader_election.cc:290] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:24:11.789161 10968 leader_election.cc:343] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:11.789674 11045 tablet_bootstrap.cc:492] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08: No bootstrap required, opened a new log
I20260709 12:24:11.789772 10968 leader_election.cc:304] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:11.790452 11045 ts_tablet_manager.cc:1403] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08: Time spent bootstrapping tablet: real 0.090s	user 0.009s	sys 0.006s
W20260709 12:24:11.788652 10895 leader_election.cc:343] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:11.791059 10895 leader_election.cc:304] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:11.792922 11324 raft_consensus.cc:2749] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:11.794404 11216 raft_consensus.cc:2749] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:11.803340 11047 tablet_bootstrap.cc:492] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040: No bootstrap required, opened a new log
I20260709 12:24:11.803890 11047 ts_tablet_manager.cc:1403] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040: Time spent bootstrapping tablet: real 0.060s	user 0.010s	sys 0.023s
I20260709 12:24:11.812702 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:11.815502 11305 leader_election.cc:290] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:11.819077 11001 raft_consensus.cc:2468] T 69fd8fdac2fa449e9e184f3d668ea1a7 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 1.
W20260709 12:24:11.821489 10895 leader_election.cc:343] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:11.843315 10895 leader_election.cc:304] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:11.845170 11242 raft_consensus.cc:2749] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:11.827800 11324 consensus_queue.cc:1048] T ab816bcc6183447994a2cc013e46c5f8 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:11.831609 11047 raft_consensus.cc:359] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:11.850901 11047 raft_consensus.cc:385] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:11.795382 11045 raft_consensus.cc:359] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:11.851770 11045 raft_consensus.cc:385] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:11.852048 11045 raft_consensus.cc:740] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Initialized, Role: FOLLOWER
I20260709 12:24:11.853003 11045 consensus_queue.cc:260] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:11.851379 11047 raft_consensus.cc:740] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Initialized, Role: FOLLOWER
I20260709 12:24:11.857735 10852 raft_consensus.cc:3060] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:11.858124 11047 consensus_queue.cc:260] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:11.865370 11047 ts_tablet_manager.cc:1434] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040: Time spent starting tablet: real 0.061s	user 0.008s	sys 0.000s
I20260709 12:24:11.867180 11047 tablet_bootstrap.cc:492] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040: Bootstrap starting.
I20260709 12:24:11.868768 11140 raft_consensus.cc:493] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:11.869448 11045 ts_tablet_manager.cc:1434] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08: Time spent starting tablet: real 0.079s	user 0.012s	sys 0.001s
I20260709 12:24:11.869292 11140 raft_consensus.cc:515] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:11.872772 11140 leader_election.cc:290] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:11.874145 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:11.876772 11304 raft_consensus.cc:493] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:11.879420 11304 raft_consensus.cc:515] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:11.879844 10968 leader_election.cc:343] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:11.881665 11304 leader_election.cc:290] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:11.882829 11045 tablet_bootstrap.cc:492] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08: Bootstrap starting.
I20260709 12:24:11.877761 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:11.883862 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac83709373b4efd9c3aa1472a9f9022" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:24:11.885063 10968 leader_election.cc:343] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:11.885519 10968 leader_election.cc:304] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:11.886931 11216 raft_consensus.cc:2749] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:11.888101 11000 raft_consensus.cc:2468] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 0.
I20260709 12:24:11.889760 10820 leader_election.cc:304] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:11.893903 11358 raft_consensus.cc:2804] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:11.894330 11358 raft_consensus.cc:493] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:11.894676 11358 raft_consensus.cc:3060] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:11.909184 11358 raft_consensus.cc:515] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:11.911484 11358 leader_election.cc:290] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:11.915349 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac83709373b4efd9c3aa1472a9f9022" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:11.922974 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac83709373b4efd9c3aa1472a9f9022" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:11.923503 10999 raft_consensus.cc:3060] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:11.913903 11305 consensus_queue.cc:1048] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:11.917279 11047 tablet_bootstrap.cc:654] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:11.928669 11324 consensus_queue.cc:1048] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:11.919912 11045 tablet_bootstrap.cc:654] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:11.922432 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac83709373b4efd9c3aa1472a9f9022" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:11.922816 11043 tablet_bootstrap.cc:492] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea: No bootstrap required, opened a new log
I20260709 12:24:11.940076 11043 ts_tablet_manager.cc:1403] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent bootstrapping tablet: real 0.312s	user 0.063s	sys 0.053s
I20260709 12:24:11.946063 11043 raft_consensus.cc:359] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:11.947019 11043 raft_consensus.cc:385] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:11.947651 11043 raft_consensus.cc:740] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Initialized, Role: FOLLOWER
I20260709 12:24:11.954282 10999 raft_consensus.cc:2468] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 1.
I20260709 12:24:11.956161 10820 leader_election.cc:304] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:11.956708 11047 tablet_bootstrap.cc:492] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040: No bootstrap required, opened a new log
I20260709 12:24:11.957160 11304 raft_consensus.cc:2804] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:11.957397 11047 ts_tablet_manager.cc:1403] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040: Time spent bootstrapping tablet: real 0.091s	user 0.015s	sys 0.006s
I20260709 12:24:11.957780 11304 raft_consensus.cc:697] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [term 1 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:11.958827 11304 consensus_queue.cc:237] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:11.960927 11047 raft_consensus.cc:359] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:11.961054 11140 consensus_queue.cc:1048] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:11.961822 11047 raft_consensus.cc:385] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:11.962152 11047 raft_consensus.cc:740] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Initialized, Role: FOLLOWER
I20260709 12:24:11.962869 11047 consensus_queue.cc:260] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:11.963603 11043 consensus_queue.cc:260] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:11.967846 11045 tablet_bootstrap.cc:492] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08: No bootstrap required, opened a new log
I20260709 12:24:11.969396 11045 ts_tablet_manager.cc:1403] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08: Time spent bootstrapping tablet: real 0.087s	user 0.019s	sys 0.008s
I20260709 12:24:11.974846 11045 raft_consensus.cc:359] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:11.975881 11045 raft_consensus.cc:385] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:11.976254 11045 raft_consensus.cc:740] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Initialized, Role: FOLLOWER
W20260709 12:24:11.975382 10819 leader_election.cc:343] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:11.977222 11045 consensus_queue.cc:260] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:11.979029 10819 leader_election.cc:343] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:11.981078 11047 ts_tablet_manager.cc:1434] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.000s
I20260709 12:24:11.982335 11047 tablet_bootstrap.cc:492] T 18294423a68a4671bf6c5a0f98645e4c P 80cd7d227db44f34a6108591dad9c040: Bootstrap starting.
I20260709 12:24:11.992887 11043 ts_tablet_manager.cc:1434] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent starting tablet: real 0.052s	user 0.013s	sys 0.002s
I20260709 12:24:11.993707 11047 tablet_bootstrap.cc:654] T 18294423a68a4671bf6c5a0f98645e4c P 80cd7d227db44f34a6108591dad9c040: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:11.993988 11043 tablet_bootstrap.cc:492] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea: Bootstrap starting.
I20260709 12:24:11.994189 11143 raft_consensus.cc:493] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:11.994722 11143 raft_consensus.cc:515] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:11.997514 11143 leader_election.cc:290] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:11.999068 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:11.999467 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:12.000147 10924 raft_consensus.cc:2468] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 0.
W20260709 12:24:12.000952 10820 leader_election.cc:343] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:12.004469 10819 leader_election.cc:304] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:12.007712 11143 raft_consensus.cc:2804] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:12.008381 11143 raft_consensus.cc:493] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:12.008863 11143 raft_consensus.cc:3060] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:12.020107 11047 tablet_bootstrap.cc:492] T 18294423a68a4671bf6c5a0f98645e4c P 80cd7d227db44f34a6108591dad9c040: No bootstrap required, opened a new log
I20260709 12:24:12.020785 11047 ts_tablet_manager.cc:1403] T 18294423a68a4671bf6c5a0f98645e4c P 80cd7d227db44f34a6108591dad9c040: Time spent bootstrapping tablet: real 0.039s	user 0.023s	sys 0.010s
I20260709 12:24:12.023785 11047 raft_consensus.cc:359] T 18294423a68a4671bf6c5a0f98645e4c P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:12.024494 11047 raft_consensus.cc:385] T 18294423a68a4671bf6c5a0f98645e4c P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:12.024806 11047 raft_consensus.cc:740] T 18294423a68a4671bf6c5a0f98645e4c P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Initialized, Role: FOLLOWER
I20260709 12:24:12.025533 11047 consensus_queue.cc:260] T 18294423a68a4671bf6c5a0f98645e4c P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:12.026651 11045 ts_tablet_manager.cc:1434] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08: Time spent starting tablet: real 0.057s	user 0.009s	sys 0.000s
I20260709 12:24:12.028204 11045 tablet_bootstrap.cc:492] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08: Bootstrap starting.
I20260709 12:24:12.028636 11047 ts_tablet_manager.cc:1434] T 18294423a68a4671bf6c5a0f98645e4c P 80cd7d227db44f34a6108591dad9c040: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:24:12.030277 11047 tablet_bootstrap.cc:492] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040: Bootstrap starting.
I20260709 12:24:12.036856 11216 consensus_queue.cc:1048] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:12.038797 11047 tablet_bootstrap.cc:654] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:12.040426 11369 raft_consensus.cc:493] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:12.041093 11369 raft_consensus.cc:515] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:12.044361 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac83709373b4efd9c3aa1472a9f9022" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:12.044004 11143 raft_consensus.cc:515] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:12.050168 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:12.051316 10924 raft_consensus.cc:3060] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:12.053679 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:12.055776 11216 raft_consensus.cc:493] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:12.056033 10820 leader_election.cc:343] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:12.056493 11216 raft_consensus.cc:515] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:12.059090 11216 leader_election.cc:290] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:12.061949 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:12.062781 10925 raft_consensus.cc:2468] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 0.
I20260709 12:24:12.064838 10968 leader_election.cc:304] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:12.065793 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:12.078169 11216 raft_consensus.cc:2804] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:12.078625 11216 raft_consensus.cc:493] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:12.078971 11216 raft_consensus.cc:3060] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:24:12.081087 10968 leader_election.cc:343] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:12.063663 11143 leader_election.cc:290] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:12.085752 10924 raft_consensus.cc:2468] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 1.
I20260709 12:24:12.090221 11358 consensus_queue.cc:1048] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:12.097631 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac83709373b4efd9c3aa1472a9f9022" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:12.098100 10819 leader_election.cc:304] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:12.098562 11001 raft_consensus.cc:2393] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 1: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:24:12.098966 11358 raft_consensus.cc:2804] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:12.099555 11358 raft_consensus.cc:697] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [term 1 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:12.100857 11358 consensus_queue.cc:237] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:12.102620 11216 raft_consensus.cc:515] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:12.105681 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:12.112772 10895 leader_election.cc:304] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:12.091526 11369 leader_election.cc:290] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:24:12.118726 10968 leader_election.cc:343] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:12.118784 11242 raft_consensus.cc:3060] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:12.122794 10751 catalog_manager.cc:5697] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 0 to 1, leader changed from <none> to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 1 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:12.148157 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:12.148995 10925 raft_consensus.cc:3060] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:12.146215 11216 leader_election.cc:290] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:12.204921 11045 tablet_bootstrap.cc:654] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08: Neither blocks nor log segments found. Creating new log.
W20260709 12:24:12.213413 11374 log.cc:927] Time spent T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:24:12.234742 11043 tablet_bootstrap.cc:654] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:12.235828 11047 tablet_bootstrap.cc:492] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040: No bootstrap required, opened a new log
I20260709 12:24:12.236625 11047 ts_tablet_manager.cc:1403] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040: Time spent bootstrapping tablet: real 0.207s	user 0.017s	sys 0.045s
I20260709 12:24:12.227002 11242 raft_consensus.cc:2749] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:12.254313 11047 raft_consensus.cc:359] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:12.255393 11047 raft_consensus.cc:385] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:12.255693 11047 raft_consensus.cc:740] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Initialized, Role: FOLLOWER
I20260709 12:24:12.258553 10925 raft_consensus.cc:2468] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 1.
I20260709 12:24:12.258745 11242 consensus_queue.cc:1048] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:12.259011 11047 consensus_queue.cc:260] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:12.261561 11304 raft_consensus.cc:493] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:12.261804 11047 ts_tablet_manager.cc:1434] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 12:24:12.262030 11304 raft_consensus.cc:515] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:12.263157 11047 tablet_bootstrap.cc:492] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040: Bootstrap starting.
I20260709 12:24:12.268632 10968 leader_election.cc:304] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:24:12.273855 11143 consensus_queue.cc:1048] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:12.281623 11216 raft_consensus.cc:2804] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:12.286187 11304 leader_election.cc:290] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:12.271621 11306 consensus_queue.cc:1048] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 12:24:12.287942 11216 raft_consensus.cc:697] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 1 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:12.289216 11216 consensus_queue.cc:237] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:12.296303 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:12.297048 10924 raft_consensus.cc:2468] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 0.
I20260709 12:24:12.299763 10751 catalog_manager.cc:5697] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 0 to 1, leader changed from <none> to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 1 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:12.300936 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:12.304360 10819 leader_election.cc:304] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:12.313817 11212 raft_consensus.cc:2804] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:12.314438 11212 raft_consensus.cc:493] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:12.317766 10820 leader_election.cc:343] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:12.314931 11212 raft_consensus.cc:3060] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:12.322988 11045 tablet_bootstrap.cc:492] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08: No bootstrap required, opened a new log
I20260709 12:24:12.324362 11045 ts_tablet_manager.cc:1403] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08: Time spent bootstrapping tablet: real 0.296s	user 0.022s	sys 0.010s
I20260709 12:24:12.338217 11047 tablet_bootstrap.cc:654] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:12.342724 11045 raft_consensus.cc:359] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:12.343609 11045 raft_consensus.cc:385] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:12.343974 11045 raft_consensus.cc:740] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Initialized, Role: FOLLOWER
I20260709 12:24:12.344967 11045 consensus_queue.cc:260] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:12.378718 11045 ts_tablet_manager.cc:1434] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08: Time spent starting tablet: real 0.054s	user 0.008s	sys 0.000s
I20260709 12:24:12.378901 11043 tablet_bootstrap.cc:492] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea: No bootstrap required, opened a new log
I20260709 12:24:12.379609 11043 ts_tablet_manager.cc:1403] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent bootstrapping tablet: real 0.386s	user 0.013s	sys 0.012s
I20260709 12:24:12.379894 11045 tablet_bootstrap.cc:492] T 3f8a389131ef4c77a3e08488aa4759eb P edcc56ddd3264984b4da6c1db59e7f08: Bootstrap starting.
I20260709 12:24:12.381615 11143 raft_consensus.cc:493] T 18294423a68a4671bf6c5a0f98645e4c P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:12.382102 11143 raft_consensus.cc:515] T 18294423a68a4671bf6c5a0f98645e4c P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:12.384099 11143 leader_election.cc:290] T 18294423a68a4671bf6c5a0f98645e4c P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:12.398067 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18294423a68a4671bf6c5a0f98645e4c" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:24:12.399276 10819 leader_election.cc:343] T 18294423a68a4671bf6c5a0f98645e4c P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:12.406060 11212 raft_consensus.cc:515] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:12.412837 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:12.413686 10926 raft_consensus.cc:3060] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:12.437067 10926 raft_consensus.cc:2468] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 1.
I20260709 12:24:12.410907 11212 leader_election.cc:290] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:12.439054 10819 leader_election.cc:304] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:12.440886 11143 raft_consensus.cc:2804] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:12.449875 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18294423a68a4671bf6c5a0f98645e4c" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:12.450584 10999 raft_consensus.cc:2468] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 0.
I20260709 12:24:12.452533 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:12.442260 11143 raft_consensus.cc:697] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 1 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:12.461176 11143 consensus_queue.cc:237] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:12.470438 11043 raft_consensus.cc:359] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:12.472601 11043 raft_consensus.cc:385] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:12.472898 11043 raft_consensus.cc:740] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Initialized, Role: FOLLOWER
I20260709 12:24:12.479915 11043 consensus_queue.cc:260] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:12.482818 11216 raft_consensus.cc:493] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:12.482789 11385 raft_consensus.cc:493] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:12.493192 11043 ts_tablet_manager.cc:1434] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent starting tablet: real 0.113s	user 0.005s	sys 0.005s
I20260709 12:24:12.495415 11043 tablet_bootstrap.cc:492] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea: Bootstrap starting.
I20260709 12:24:12.494225 11212 consensus_queue.cc:1048] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:24:12.499902 10820 leader_election.cc:304] T 18294423a68a4671bf6c5a0f98645e4c P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:12.501264 11314 raft_consensus.cc:2804] T 18294423a68a4671bf6c5a0f98645e4c P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:12.501713 11314 raft_consensus.cc:493] T 18294423a68a4671bf6c5a0f98645e4c P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:12.502096 11314 raft_consensus.cc:3060] T 18294423a68a4671bf6c5a0f98645e4c P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:12.512480 10752 catalog_manager.cc:5697] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 0 to 1, leader changed from <none> to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 1 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
W20260709 12:24:12.522889 10820 leader_election.cc:343] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:12.493073 11216 raft_consensus.cc:515] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:12.520613 11358 consensus_queue.cc:1048] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 12:24:12.534591 11047 tablet_bootstrap.cc:492] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040: No bootstrap required, opened a new log
I20260709 12:24:12.535668 11047 ts_tablet_manager.cc:1403] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040: Time spent bootstrapping tablet: real 0.273s	user 0.016s	sys 0.020s
I20260709 12:24:12.495416 11385 raft_consensus.cc:515] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:12.542409 11385 leader_election.cc:290] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:12.543336 11043 tablet_bootstrap.cc:654] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:12.543639 11216 leader_election.cc:290] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:12.547904 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63ecfc9bd3945818cfe15c03f001315" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:12.550625 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:24:12.551504 10968 leader_election.cc:343] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:24:12.552790 10968 leader_election.cc:343] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:12.552899 11045 tablet_bootstrap.cc:654] T 3f8a389131ef4c77a3e08488aa4759eb P edcc56ddd3264984b4da6c1db59e7f08: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:12.553297 11047 raft_consensus.cc:359] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:12.554816 11047 raft_consensus.cc:385] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:12.555158 11047 raft_consensus.cc:740] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Initialized, Role: FOLLOWER
I20260709 12:24:12.564065 11047 consensus_queue.cc:260] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:12.566704 11043 tablet_bootstrap.cc:492] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea: No bootstrap required, opened a new log
I20260709 12:24:12.567385 11043 ts_tablet_manager.cc:1403] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent bootstrapping tablet: real 0.072s	user 0.013s	sys 0.004s
I20260709 12:24:12.573722 11314 raft_consensus.cc:515] T 18294423a68a4671bf6c5a0f98645e4c P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:12.576275 11314 leader_election.cc:290] T 18294423a68a4671bf6c5a0f98645e4c P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:12.576650 11045 tablet_bootstrap.cc:492] T 3f8a389131ef4c77a3e08488aa4759eb P edcc56ddd3264984b4da6c1db59e7f08: No bootstrap required, opened a new log
I20260709 12:24:12.577217 11045 ts_tablet_manager.cc:1403] T 3f8a389131ef4c77a3e08488aa4759eb P edcc56ddd3264984b4da6c1db59e7f08: Time spent bootstrapping tablet: real 0.198s	user 0.015s	sys 0.002s
W20260709 12:24:12.625805 10820 consensus_peers.cc:597] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 -> Peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): Couldn't send request to peer edcc56ddd3264984b4da6c1db59e7f08. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:12.692965 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 67940.5us
I20260709 12:24:12.644492 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18294423a68a4671bf6c5a0f98645e4c" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:12.696080 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:12.697607 10854 raft_consensus.cc:2468] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 0.
I20260709 12:24:12.698052 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63ecfc9bd3945818cfe15c03f001315" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:12.577230 11047 ts_tablet_manager.cc:1434] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.000s
I20260709 12:24:12.660863 11043 raft_consensus.cc:359] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:12.699513 11043 raft_consensus.cc:385] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:12.700044 11043 raft_consensus.cc:740] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Initialized, Role: FOLLOWER
I20260709 12:24:12.700018 11045 raft_consensus.cc:359] T 3f8a389131ef4c77a3e08488aa4759eb P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:12.662747 11314 raft_consensus.cc:493] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:12.701406 11047 tablet_bootstrap.cc:492] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040: Bootstrap starting.
I20260709 12:24:12.701893 11314 raft_consensus.cc:515] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:12.705346 11314 leader_election.cc:290] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:12.676301 11358 consensus_queue.cc:1048] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:12.701239 11045 raft_consensus.cc:385] T 3f8a389131ef4c77a3e08488aa4759eb P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:12.701386 11043 consensus_queue.cc:260] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:12.742059 10968 leader_election.cc:304] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:12.760118 11140 raft_consensus.cc:2804] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:24:12.760320 10968 leader_election.cc:343] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:12.760650 11140 raft_consensus.cc:493] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:12.760954 10968 leader_election.cc:304] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:12.706288 11045 raft_consensus.cc:740] T 3f8a389131ef4c77a3e08488aa4759eb P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Initialized, Role: FOLLOWER
I20260709 12:24:12.756229 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:12.769757 11242 raft_consensus.cc:493] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:12.777089 11242 raft_consensus.cc:515] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:12.773043 11045 consensus_queue.cc:260] T 3f8a389131ef4c77a3e08488aa4759eb P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:12.782811 11045 ts_tablet_manager.cc:1434] T 3f8a389131ef4c77a3e08488aa4759eb P edcc56ddd3264984b4da6c1db59e7f08: Time spent starting tablet: real 0.092s	user 0.008s	sys 0.002s
I20260709 12:24:12.784680 11045 tablet_bootstrap.cc:492] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08: Bootstrap starting.
I20260709 12:24:12.788869 11242 leader_election.cc:290] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:12.790196 11385 raft_consensus.cc:2749] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:12.791852 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:12.793072 10927 raft_consensus.cc:2393] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 1: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:24:12.762079 11140 raft_consensus.cc:3060] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:12.831223 11043 ts_tablet_manager.cc:1434] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent starting tablet: real 0.263s	user 0.029s	sys 0.007s
I20260709 12:24:12.833564 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:12.715844 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18294423a68a4671bf6c5a0f98645e4c" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
W20260709 12:24:12.842888 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 59982us
I20260709 12:24:12.861025 10998 raft_consensus.cc:3060] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:12.867075 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:12.867975 11047 tablet_bootstrap.cc:654] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040: Neither blocks nor log segments found. Creating new log.
W20260709 12:24:12.878166 10819 leader_election.cc:343] T 18294423a68a4671bf6c5a0f98645e4c P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:12.879417 10819 leader_election.cc:304] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:12.880759 11314 raft_consensus.cc:3060] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:12.897004 11043 tablet_bootstrap.cc:492] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea: Bootstrap starting.
W20260709 12:24:12.916899 10895 leader_election.cc:343] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:24:12.917891 10894 leader_election.cc:343] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:12.909504 11242 raft_consensus.cc:493] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:12.927327 11242 raft_consensus.cc:515] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:12.929912 11242 leader_election.cc:290] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:12.930889 11380 consensus_queue.cc:1048] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:12.938625 11140 raft_consensus.cc:515] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:12.941594 11140 leader_election.cc:290] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:12.908156 10998 raft_consensus.cc:2468] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 1.
I20260709 12:24:12.946863 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:12.947393 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:12.953224 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:12.954458 10894 leader_election.cc:304] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:24:12.956900 10895 leader_election.cc:343] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:24:12.958461 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 49527us
W20260709 12:24:12.959534 10968 leader_election.cc:343] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:12.969525 11314 raft_consensus.cc:2749] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:12.979612 10820 leader_election.cc:304] T 18294423a68a4671bf6c5a0f98645e4c P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:12.981186 11382 raft_consensus.cc:2804] T 18294423a68a4671bf6c5a0f98645e4c P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:12.981881 11382 raft_consensus.cc:697] T 18294423a68a4671bf6c5a0f98645e4c P 80cd7d227db44f34a6108591dad9c040 [term 1 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:12.983186 11382 consensus_queue.cc:237] T 18294423a68a4671bf6c5a0f98645e4c P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:12.984731 11394 raft_consensus.cc:2749] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:12.964509 10852 raft_consensus.cc:3060] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:24:12.992751 10800 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:24:12.997200 11140 consensus_queue.cc:1048] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:13.000180 11045 tablet_bootstrap.cc:654] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:13.003037 10752 catalog_manager.cc:5697] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 0 to 1, leader changed from <none> to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 1 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:13.005344 11047 tablet_bootstrap.cc:492] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040: No bootstrap required, opened a new log
I20260709 12:24:13.005859 11047 ts_tablet_manager.cc:1403] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040: Time spent bootstrapping tablet: real 0.305s	user 0.020s	sys 0.028s
I20260709 12:24:13.013557 11216 raft_consensus.cc:493] T 3f8a389131ef4c77a3e08488aa4759eb P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:13.014087 11047 raft_consensus.cc:359] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:13.014374 11216 raft_consensus.cc:515] T 3f8a389131ef4c77a3e08488aa4759eb P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:13.014894 11047 raft_consensus.cc:385] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:13.015209 11047 raft_consensus.cc:740] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Initialized, Role: FOLLOWER
I20260709 12:24:13.016376 11047 consensus_queue.cc:260] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:13.020236 11216 leader_election.cc:290] T 3f8a389131ef4c77a3e08488aa4759eb P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:13.022816 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:13.023391 11047 ts_tablet_manager.cc:1434] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040: Time spent starting tablet: real 0.017s	user 0.010s	sys 0.001s
I20260709 12:24:13.024816 11047 tablet_bootstrap.cc:492] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040: Bootstrap starting.
I20260709 12:24:13.028534 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:24:13.038232 10894 leader_election.cc:343] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:13.038745 10894 leader_election.cc:304] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:13.044704 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:13.051019 11369 raft_consensus.cc:2749] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:13.053085 10926 raft_consensus.cc:2393] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 1: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:24:13.067505 10968 leader_election.cc:304] T 3f8a389131ef4c77a3e08488aa4759eb P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:13.074263 11216 raft_consensus.cc:3060] T 3f8a389131ef4c77a3e08488aa4759eb P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:13.090628 11043 tablet_bootstrap.cc:654] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:13.097162 10852 raft_consensus.cc:2468] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 1.
I20260709 12:24:13.100210 10968 leader_election.cc:304] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:13.101641 11380 raft_consensus.cc:2804] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:13.104090 11216 raft_consensus.cc:2749] T 3f8a389131ef4c77a3e08488aa4759eb P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:13.117986 11382 consensus_queue.cc:1048] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:24:13.121021 11143 raft_consensus.cc:493] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:13.121529 11143 raft_consensus.cc:515] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:13.123481 11358 consensus_queue.cc:1048] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:13.123705 11143 leader_election.cc:290] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:13.134845 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:13.138032 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:24:13.140056 10819 leader_election.cc:343] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:24:13.149194 10820 leader_election.cc:343] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:13.149717 11047 tablet_bootstrap.cc:654] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:13.149713 10820 leader_election.cc:304] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:13.152071 11314 raft_consensus.cc:2749] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:13.162542 11045 tablet_bootstrap.cc:492] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08: No bootstrap required, opened a new log
I20260709 12:24:13.162922 11380 raft_consensus.cc:697] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:13.163477 11045 ts_tablet_manager.cc:1403] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08: Time spent bootstrapping tablet: real 0.379s	user 0.013s	sys 0.020s
I20260709 12:24:13.164127 11380 consensus_queue.cc:237] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:13.167286 11045 raft_consensus.cc:359] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:13.182193 11045 raft_consensus.cc:385] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:13.182622 11045 raft_consensus.cc:740] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Initialized, Role: FOLLOWER
I20260709 12:24:13.190284 11043 tablet_bootstrap.cc:492] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea: No bootstrap required, opened a new log
I20260709 12:24:13.190860 11043 ts_tablet_manager.cc:1403] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea: Time spent bootstrapping tablet: real 0.294s	user 0.018s	sys 0.012s
I20260709 12:24:13.191959 11045 consensus_queue.cc:260] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:13.228228 11045 ts_tablet_manager.cc:1434] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08: Time spent starting tablet: real 0.064s	user 0.010s	sys 0.000s
I20260709 12:24:13.237298 11043 raft_consensus.cc:359] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:13.239101 11043 raft_consensus.cc:385] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:13.239507 11043 raft_consensus.cc:740] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Initialized, Role: FOLLOWER
I20260709 12:24:13.240296 11043 consensus_queue.cc:260] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:13.242363 11043 ts_tablet_manager.cc:1434] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.001s
I20260709 12:24:13.243666 11043 tablet_bootstrap.cc:492] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea: Bootstrap starting.
I20260709 12:24:13.259174 11043 tablet_bootstrap.cc:654] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:13.271428 11045 tablet_bootstrap.cc:492] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08: Bootstrap starting.
I20260709 12:24:13.272307 11047 tablet_bootstrap.cc:492] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040: No bootstrap required, opened a new log
I20260709 12:24:13.272769 11047 ts_tablet_manager.cc:1403] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040: Time spent bootstrapping tablet: real 0.248s	user 0.017s	sys 0.014s
I20260709 12:24:13.276088 11047 raft_consensus.cc:359] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:13.276793 11047 raft_consensus.cc:385] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:13.277083 11047 raft_consensus.cc:740] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Initialized, Role: FOLLOWER
I20260709 12:24:13.278100 11047 consensus_queue.cc:260] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:13.281947 11047 ts_tablet_manager.cc:1434] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.005s
I20260709 12:24:13.283223 11047 tablet_bootstrap.cc:492] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040: Bootstrap starting.
I20260709 12:24:13.291618 11045 tablet_bootstrap.cc:654] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:13.295553 11047 tablet_bootstrap.cc:654] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:13.306214 11043 tablet_bootstrap.cc:492] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea: No bootstrap required, opened a new log
I20260709 12:24:13.306826 11043 ts_tablet_manager.cc:1403] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent bootstrapping tablet: real 0.063s	user 0.031s	sys 0.014s
I20260709 12:24:13.307509 11047 tablet_bootstrap.cc:492] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040: No bootstrap required, opened a new log
I20260709 12:24:13.310668 11043 raft_consensus.cc:359] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:13.312822 11043 raft_consensus.cc:385] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:13.313181 11043 raft_consensus.cc:740] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Initialized, Role: FOLLOWER
I20260709 12:24:13.313963 11043 consensus_queue.cc:260] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:13.318542 11047 ts_tablet_manager.cc:1403] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040: Time spent bootstrapping tablet: real 0.036s	user 0.012s	sys 0.002s
I20260709 12:24:13.321457 11047 raft_consensus.cc:359] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:13.322177 11047 raft_consensus.cc:385] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:13.322492 11047 raft_consensus.cc:740] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Initialized, Role: FOLLOWER
I20260709 12:24:13.323189 11047 consensus_queue.cc:260] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:13.325441 11047 ts_tablet_manager.cc:1434] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:24:13.326419 11047 tablet_bootstrap.cc:492] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040: Bootstrap starting.
I20260709 12:24:13.329630 11043 ts_tablet_manager.cc:1434] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent starting tablet: real 0.022s	user 0.002s	sys 0.005s
I20260709 12:24:13.331738 11045 tablet_bootstrap.cc:492] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08: No bootstrap required, opened a new log
I20260709 12:24:13.332056 11047 tablet_bootstrap.cc:654] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:13.332261 11045 ts_tablet_manager.cc:1403] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08: Time spent bootstrapping tablet: real 0.061s	user 0.021s	sys 0.000s
I20260709 12:24:13.332692 11043 tablet_bootstrap.cc:492] T c63ecfc9bd3945818cfe15c03f001315 P e2d5c637307a407ab688f5ccd6f0fcea: Bootstrap starting.
I20260709 12:24:13.335120 11045 raft_consensus.cc:359] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:13.335834 11045 raft_consensus.cc:385] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:13.336084 11045 raft_consensus.cc:740] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Initialized, Role: FOLLOWER
I20260709 12:24:13.336947 11045 consensus_queue.cc:260] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:13.339208 11045 ts_tablet_manager.cc:1434] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:24:13.340461 11045 tablet_bootstrap.cc:492] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08: Bootstrap starting.
I20260709 12:24:13.342410 11043 tablet_bootstrap.cc:654] T c63ecfc9bd3945818cfe15c03f001315 P e2d5c637307a407ab688f5ccd6f0fcea: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:13.348623 11045 tablet_bootstrap.cc:654] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:13.350414 10749 catalog_manager.cc:5697] T 18294423a68a4671bf6c5a0f98645e4c P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 0 to 1, leader changed from <none> to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 1 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:13.358733 11043 tablet_bootstrap.cc:492] T c63ecfc9bd3945818cfe15c03f001315 P e2d5c637307a407ab688f5ccd6f0fcea: No bootstrap required, opened a new log
I20260709 12:24:13.359799 11045 tablet_bootstrap.cc:492] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08: No bootstrap required, opened a new log
I20260709 12:24:13.360352 11045 ts_tablet_manager.cc:1403] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.000s
I20260709 12:24:13.359275 11043 ts_tablet_manager.cc:1403] T c63ecfc9bd3945818cfe15c03f001315 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.007s
I20260709 12:24:13.371238 11043 raft_consensus.cc:359] T c63ecfc9bd3945818cfe15c03f001315 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:13.371531 10752 catalog_manager.cc:5697] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 0 to 1, leader changed from <none> to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 1 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:13.372287 11043 raft_consensus.cc:385] T c63ecfc9bd3945818cfe15c03f001315 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:13.372769 11043 raft_consensus.cc:740] T c63ecfc9bd3945818cfe15c03f001315 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Initialized, Role: FOLLOWER
I20260709 12:24:13.373785 11043 consensus_queue.cc:260] T c63ecfc9bd3945818cfe15c03f001315 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:13.376649 11043 ts_tablet_manager.cc:1434] T c63ecfc9bd3945818cfe15c03f001315 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 12:24:13.377941 11043 tablet_bootstrap.cc:492] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea: Bootstrap starting.
I20260709 12:24:13.377897 11045 raft_consensus.cc:359] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:13.378752 11045 raft_consensus.cc:385] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:13.379060 11045 raft_consensus.cc:740] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Initialized, Role: FOLLOWER
I20260709 12:24:13.379730 11045 consensus_queue.cc:260] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:13.381788 11045 ts_tablet_manager.cc:1434] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
I20260709 12:24:13.382715 11045 tablet_bootstrap.cc:492] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08: Bootstrap starting.
I20260709 12:24:13.387497 11047 tablet_bootstrap.cc:492] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040: No bootstrap required, opened a new log
I20260709 12:24:13.388134 11047 ts_tablet_manager.cc:1403] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040: Time spent bootstrapping tablet: real 0.062s	user 0.021s	sys 0.030s
I20260709 12:24:13.391171 11047 raft_consensus.cc:359] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:13.391939 11047 raft_consensus.cc:385] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:13.392249 11047 raft_consensus.cc:740] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Initialized, Role: FOLLOWER
I20260709 12:24:13.393276 11045 tablet_bootstrap.cc:654] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:13.393076 11047 consensus_queue.cc:260] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:13.397075 11047 ts_tablet_manager.cc:1434] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:24:13.399044 11047 tablet_bootstrap.cc:492] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040: Bootstrap starting.
I20260709 12:24:13.399336 11043 tablet_bootstrap.cc:654] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:13.400004 11045 tablet_bootstrap.cc:492] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08: No bootstrap required, opened a new log
I20260709 12:24:13.400583 11045 ts_tablet_manager.cc:1403] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.000s
I20260709 12:24:13.458266 11385 raft_consensus.cc:493] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:13.458843 11385 raft_consensus.cc:515] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:13.460987 11385 leader_election.cc:290] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:13.462721 11045 raft_consensus.cc:359] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:13.463528 11045 raft_consensus.cc:385] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:13.463888 11045 raft_consensus.cc:740] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Initialized, Role: FOLLOWER
I20260709 12:24:13.464414 11047 tablet_bootstrap.cc:654] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:13.464850 11045 consensus_queue.cc:260] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:13.467303 11045 ts_tablet_manager.cc:1434] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08: Time spent starting tablet: real 0.066s	user 0.004s	sys 0.002s
I20260709 12:24:13.476163 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:13.478971 11047 tablet_bootstrap.cc:492] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040: No bootstrap required, opened a new log
I20260709 12:24:13.483232 11143 raft_consensus.cc:493] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:13.483840 11143 raft_consensus.cc:515] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:13.485991 11143 leader_election.cc:290] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:13.488633 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63ecfc9bd3945818cfe15c03f001315" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:13.489264 10924 raft_consensus.cc:3060] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:13.489419 10999 raft_consensus.cc:2468] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 0.
I20260709 12:24:13.492833 10820 leader_election.cc:304] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:13.493712 11143 raft_consensus.cc:2804] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:13.494112 11143 raft_consensus.cc:493] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:13.494490 11143 raft_consensus.cc:3060] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:13.502116 11143 raft_consensus.cc:515] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:13.502359 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63ecfc9bd3945818cfe15c03f001315" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:13.504333 10927 raft_consensus.cc:2468] T c63ecfc9bd3945818cfe15c03f001315 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 0.
I20260709 12:24:13.503816 11045 tablet_bootstrap.cc:492] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08: Bootstrap starting.
I20260709 12:24:13.511937 11045 tablet_bootstrap.cc:654] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:13.519429 11143 leader_election.cc:290] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:13.520602 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63ecfc9bd3945818cfe15c03f001315" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:13.521256 11001 raft_consensus.cc:3060] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:13.521838 11405 raft_consensus.cc:493] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:13.522571 11405 raft_consensus.cc:515] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:13.525554 11405 leader_election.cc:290] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:13.533159 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:13.540114 11047 ts_tablet_manager.cc:1403] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040: Time spent bootstrapping tablet: real 0.141s	user 0.034s	sys 0.045s
W20260709 12:24:13.541855 10968 leader_election.cc:343] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:13.543190 11047 raft_consensus.cc:359] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:13.543955 11047 raft_consensus.cc:385] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:13.544214 11047 raft_consensus.cc:740] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Initialized, Role: FOLLOWER
I20260709 12:24:13.544804 11047 consensus_queue.cc:260] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:13.547680 11047 ts_tablet_manager.cc:1434] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:24:13.550191 11047 tablet_bootstrap.cc:492] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040: Bootstrap starting.
I20260709 12:24:13.551630 11143 consensus_queue.cc:1048] T 18294423a68a4671bf6c5a0f98645e4c P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:13.557783 11047 tablet_bootstrap.cc:654] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:13.566208 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:13.568351 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63ecfc9bd3945818cfe15c03f001315" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:13.568810 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:13.568953 10927 raft_consensus.cc:3060] T c63ecfc9bd3945818cfe15c03f001315 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:13.577553 11045 tablet_bootstrap.cc:492] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08: No bootstrap required, opened a new log
I20260709 12:24:13.565250 11001 raft_consensus.cc:2468] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 1.
I20260709 12:24:13.578271 11045 ts_tablet_manager.cc:1403] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08: Time spent bootstrapping tablet: real 0.075s	user 0.018s	sys 0.000s
I20260709 12:24:13.579486 10820 leader_election.cc:304] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:13.580268 11143 raft_consensus.cc:2804] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:13.580686 11143 raft_consensus.cc:697] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 1 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:13.581423 11143 consensus_queue.cc:237] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:13.584813 11212 consensus_queue.cc:1048] T 18294423a68a4671bf6c5a0f98645e4c P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:13.588197 11047 tablet_bootstrap.cc:492] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040: No bootstrap required, opened a new log
I20260709 12:24:13.588714 11047 ts_tablet_manager.cc:1403] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040: Time spent bootstrapping tablet: real 0.039s	user 0.021s	sys 0.000s
W20260709 12:24:13.591725 10968 leader_election.cc:343] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:13.592324 10968 leader_election.cc:304] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:13.593925 10968 leader_election.cc:304] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:13.595480 11385 raft_consensus.cc:2749] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:13.598080 11405 raft_consensus.cc:2749] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:13.595942 11047 raft_consensus.cc:359] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:13.598866 11043 tablet_bootstrap.cc:492] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea: No bootstrap required, opened a new log
I20260709 12:24:13.598903 11047 raft_consensus.cc:385] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:13.599418 11047 raft_consensus.cc:740] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Initialized, Role: FOLLOWER
I20260709 12:24:13.599484 11043 ts_tablet_manager.cc:1403] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea: Time spent bootstrapping tablet: real 0.222s	user 0.039s	sys 0.018s
I20260709 12:24:13.601408 11047 consensus_queue.cc:260] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:13.603356 11047 ts_tablet_manager.cc:1434] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:24:13.606078 11045 raft_consensus.cc:359] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:13.618407 11043 raft_consensus.cc:359] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:13.621953 11405 consensus_queue.cc:1048] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:13.619441 11043 raft_consensus.cc:385] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:13.624400 11043 raft_consensus.cc:740] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Initialized, Role: FOLLOWER
I20260709 12:24:13.607455 11045 raft_consensus.cc:385] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:13.627884 11045 raft_consensus.cc:740] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Initialized, Role: FOLLOWER
I20260709 12:24:13.625296 11043 consensus_queue.cc:260] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:13.630656 11045 consensus_queue.cc:260] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:13.633605 11043 ts_tablet_manager.cc:1434] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.001s
I20260709 12:24:13.634654 11043 tablet_bootstrap.cc:492] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea: Bootstrap starting.
I20260709 12:24:13.656147 11047 tablet_bootstrap.cc:492] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040: Bootstrap starting.
I20260709 12:24:13.674161 11368 raft_consensus.cc:493] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:13.676151 11045 ts_tablet_manager.cc:1434] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08: Time spent starting tablet: real 0.097s	user 0.009s	sys 0.000s
I20260709 12:24:13.674706 11368 raft_consensus.cc:515] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:13.671527 11385 raft_consensus.cc:493] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:13.679831 11385 raft_consensus.cc:515] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:13.682250 11385 leader_election.cc:290] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:13.684513 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:13.668467 10927 raft_consensus.cc:2468] T c63ecfc9bd3945818cfe15c03f001315 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 1.
I20260709 12:24:13.689548 11368 leader_election.cc:290] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:13.694995 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:13.696229 10854 raft_consensus.cc:2468] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 0.
I20260709 12:24:13.696326 11212 raft_consensus.cc:493] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:13.697041 11212 raft_consensus.cc:515] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:13.698724 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:13.699153 11212 leader_election.cc:290] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:13.699682 10929 raft_consensus.cc:2468] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 0.
I20260709 12:24:13.700034 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:13.702888 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef3220c51df47db8859f07ab745fad5" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:13.703776 11216 raft_consensus.cc:493] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:13.704335 11216 raft_consensus.cc:515] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:13.704880 10820 leader_election.cc:343] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:13.706449 11216 leader_election.cc:290] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:13.708972 10968 leader_election.cc:304] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:13.723436 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:13.724323 10854 raft_consensus.cc:2468] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 0.
I20260709 12:24:13.724870 11045 tablet_bootstrap.cc:492] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08: Bootstrap starting.
I20260709 12:24:13.724517 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:13.725726 10923 raft_consensus.cc:2468] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 0.
I20260709 12:24:13.731519 10968 leader_election.cc:304] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:13.717002 11405 raft_consensus.cc:2804] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:13.733114 11405 raft_consensus.cc:493] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:13.733603 11216 raft_consensus.cc:2804] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:13.733681 11405 raft_consensus.cc:3060] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:13.734134 11216 raft_consensus.cc:493] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:13.734524 11216 raft_consensus.cc:3060] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:13.736522 11047 tablet_bootstrap.cc:654] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:13.737223 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef3220c51df47db8859f07ab745fad5" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:24:13.745947 10819 leader_election.cc:343] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:13.746812 10819 leader_election.cc:304] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:13.747704 11212 raft_consensus.cc:2749] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:13.756053 10998 raft_consensus.cc:3060] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:13.762220 11216 raft_consensus.cc:515] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:13.764269 11216 leader_election.cc:290] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:13.771392 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:13.772364 10847 raft_consensus.cc:3060] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:13.782735 11405 raft_consensus.cc:515] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:13.786599 11405 leader_election.cc:290] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:13.789315 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:13.790153 10852 raft_consensus.cc:3060] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:24:13.800279 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 82074us
I20260709 12:24:13.814953 10895 leader_election.cc:304] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:13.828198 11324 raft_consensus.cc:2749] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:13.846477 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:13.847280 10929 raft_consensus.cc:3060] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:13.852985 10924 raft_consensus.cc:3060] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:13.858590 10852 raft_consensus.cc:2468] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 1.
I20260709 12:24:13.859964 10929 raft_consensus.cc:2468] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 1.
I20260709 12:24:13.861675 11043 tablet_bootstrap.cc:654] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:13.866914 10968 leader_election.cc:304] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:13.868104 11216 raft_consensus.cc:2804] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:13.868685 11216 raft_consensus.cc:697] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:13.869628 11216 consensus_queue.cc:237] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:13.869725 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:13.872888 10926 raft_consensus.cc:3060] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:13.880014 10968 leader_election.cc:304] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:13.883133 11405 raft_consensus.cc:2804] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:13.903457 10847 raft_consensus.cc:2468] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 1.
I20260709 12:24:13.895648 10749 catalog_manager.cc:5697] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 0 to 1, leader changed from <none> to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 1 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:13.911183 11047 tablet_bootstrap.cc:492] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040: No bootstrap required, opened a new log
I20260709 12:24:13.911783 11047 ts_tablet_manager.cc:1403] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040: Time spent bootstrapping tablet: real 0.256s	user 0.008s	sys 0.025s
I20260709 12:24:13.918540 11408 raft_consensus.cc:493] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:13.937040 11047 raft_consensus.cc:359] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:13.937835 11047 raft_consensus.cc:385] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:13.938126 11047 raft_consensus.cc:740] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Initialized, Role: FOLLOWER
I20260709 12:24:13.938776 11047 consensus_queue.cc:260] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:13.947265 11045 tablet_bootstrap.cc:654] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:13.950724 11047 ts_tablet_manager.cc:1434] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.000s
I20260709 12:24:13.952114 11438 consensus_queue.cc:1048] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:13.953414 11047 tablet_bootstrap.cc:492] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040: Bootstrap starting.
I20260709 12:24:13.941125 11408 raft_consensus.cc:515] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:13.956662 11408 leader_election.cc:290] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:13.964540 10926 raft_consensus.cc:2468] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 1.
I20260709 12:24:13.968447 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:13.969383 10929 raft_consensus.cc:2468] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 0.
I20260709 12:24:13.974637 10968 leader_election.cc:304] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:13.976343 11408 raft_consensus.cc:2804] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:13.976843 11408 raft_consensus.cc:493] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:13.977286 11408 raft_consensus.cc:3060] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:24:13.990371 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 68370.2us
I20260709 12:24:13.993465 11405 raft_consensus.cc:697] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:14.002715 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:14.003803 10849 raft_consensus.cc:2468] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 0.
I20260709 12:24:14.036782 11440 raft_consensus.cc:493] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.048401 11440 raft_consensus.cc:515] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:14.050976 11440 leader_election.cc:290] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:14.078497 11408 raft_consensus.cc:515] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:14.092489 11043 tablet_bootstrap.cc:492] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea: No bootstrap required, opened a new log
I20260709 12:24:14.093043 11043 ts_tablet_manager.cc:1403] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent bootstrapping tablet: real 0.459s	user 0.011s	sys 0.010s
I20260709 12:24:14.096684 11143 raft_consensus.cc:493] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.097218 11143 raft_consensus.cc:515] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:14.107473 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:14.108147 11143 leader_election.cc:290] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:14.116935 11045 tablet_bootstrap.cc:492] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08: No bootstrap required, opened a new log
I20260709 12:24:14.117462 11045 ts_tablet_manager.cc:1403] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08: Time spent bootstrapping tablet: real 0.404s	user 0.013s	sys 0.010s
I20260709 12:24:14.085451 11405 consensus_queue.cc:237] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:14.127807 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:14.127439 11043 raft_consensus.cc:359] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:14.132066 11043 raft_consensus.cc:385] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:14.132686 11043 raft_consensus.cc:740] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Initialized, Role: FOLLOWER
I20260709 12:24:14.133522 11043 consensus_queue.cc:260] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:14.113078 11212 consensus_queue.cc:1048] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 12:24:14.152396 11043 ts_tablet_manager.cc:1434] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent starting tablet: real 0.059s	user 0.014s	sys 0.000s
I20260709 12:24:14.159257 11047 tablet_bootstrap.cc:654] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:14.161056 11408 leader_election.cc:290] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:14.163508 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:14.164214 10925 raft_consensus.cc:3060] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:14.178568 11045 raft_consensus.cc:359] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:14.180101 11045 raft_consensus.cc:385] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:14.180470 11045 raft_consensus.cc:740] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Initialized, Role: FOLLOWER
I20260709 12:24:14.181339 11045 consensus_queue.cc:260] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:14.189999 11045 ts_tablet_manager.cc:1434] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08: Time spent starting tablet: real 0.072s	user 0.005s	sys 0.003s
I20260709 12:24:14.191664 11045 tablet_bootstrap.cc:492] T 2ac8522e549a46e09593fa4c2e175557 P edcc56ddd3264984b4da6c1db59e7f08: Bootstrap starting.
I20260709 12:24:14.208293 11314 raft_consensus.cc:493] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.208850 11314 raft_consensus.cc:515] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:14.209468 10926 raft_consensus.cc:2468] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 0.
I20260709 12:24:14.210842 11314 leader_election.cc:290] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:24:14.215762 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 110935us
I20260709 12:24:14.214578 10968 leader_election.cc:304] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:14.217693 11408 raft_consensus.cc:2804] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:14.217820 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:14.218084 11408 raft_consensus.cc:493] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:14.218446 11408 raft_consensus.cc:3060] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:14.218502 10999 raft_consensus.cc:2468] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 0.
I20260709 12:24:14.222256 11216 raft_consensus.cc:493] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.223073 11047 tablet_bootstrap.cc:492] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040: No bootstrap required, opened a new log
I20260709 12:24:14.223747 11047 ts_tablet_manager.cc:1403] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040: Time spent bootstrapping tablet: real 0.272s	user 0.016s	sys 0.025s
W20260709 12:24:14.223830 10819 leader_election.cc:343] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:14.227468 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:14.228152 10852 raft_consensus.cc:2468] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 0.
I20260709 12:24:14.222683 11216 raft_consensus.cc:515] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:14.231096 11216 leader_election.cc:290] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:14.232738 11043 tablet_bootstrap.cc:492] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea: Bootstrap starting.
I20260709 12:24:14.242800 11382 consensus_queue.cc:1048] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:14.244488 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:14.244581 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c913e527ff46578e084c41eab7bb9d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:14.246183 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:14.246413 10925 raft_consensus.cc:2468] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 1.
I20260709 12:24:14.246883 10923 raft_consensus.cc:2468] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 0.
W20260709 12:24:14.249806 10968 leader_election.cc:343] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:14.250504 10968 leader_election.cc:304] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:14.251410 11385 raft_consensus.cc:2804] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:14.252185 11385 raft_consensus.cc:697] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 1 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:14.253187 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c913e527ff46578e084c41eab7bb9d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:14.253280 11385 consensus_queue.cc:237] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:14.259663 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:14.260757 10853 raft_consensus.cc:3060] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:14.271723 10820 leader_election.cc:304] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:14.305387 10819 leader_election.cc:304] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:14.306828 11441 raft_consensus.cc:2804] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:14.307343 11441 raft_consensus.cc:493] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:14.307787 11441 raft_consensus.cc:3060] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:24:14.333110 10800 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 12:24:14.336485 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 64941us
I20260709 12:24:14.337177 11143 raft_consensus.cc:2804] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:14.337613 11143 raft_consensus.cc:493] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:14.338023 11143 raft_consensus.cc:3060] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:14.341758 11045 tablet_bootstrap.cc:654] T 2ac8522e549a46e09593fa4c2e175557 P edcc56ddd3264984b4da6c1db59e7f08: Neither blocks nor log segments found. Creating new log.
W20260709 12:24:14.348346 10968 leader_election.cc:343] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:14.348871 10968 leader_election.cc:304] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:14.351152 11405 raft_consensus.cc:2749] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:14.351799 11047 raft_consensus.cc:359] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:14.351998 11441 raft_consensus.cc:515] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:14.351332 11408 raft_consensus.cc:515] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:14.355039 10996 raft_consensus.cc:2393] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 1: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:24:14.355993 11441 leader_election.cc:290] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:14.354158 11047 raft_consensus.cc:385] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:14.357729 11047 raft_consensus.cc:740] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Initialized, Role: FOLLOWER
I20260709 12:24:14.359601 11047 consensus_queue.cc:260] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:14.363425 10752 catalog_manager.cc:5697] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 0 to 1, leader changed from <none> to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 1 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:14.370972 11143 raft_consensus.cc:515] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:14.376549 11047 ts_tablet_manager.cc:1434] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040: Time spent starting tablet: real 0.152s	user 0.011s	sys 0.002s
I20260709 12:24:14.374122 10752 catalog_manager.cc:5697] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 0 to 1, leader changed from <none> to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 1 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:14.381003 11043 tablet_bootstrap.cc:654] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:14.382035 10853 raft_consensus.cc:2468] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 1.
I20260709 12:24:14.385452 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:14.386314 10996 raft_consensus.cc:2393] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 1: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:24:14.389792 11408 leader_election.cc:290] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:14.397945 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:14.399804 11143 leader_election.cc:290] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:14.404345 10927 raft_consensus.cc:3060] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:14.395896 11408 consensus_queue.cc:1048] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 12:24:14.422469 11047 tablet_bootstrap.cc:492] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040: Bootstrap starting.
I20260709 12:24:14.427165 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:14.437911 10927 raft_consensus.cc:2468] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 1.
I20260709 12:24:14.440608 10968 leader_election.cc:304] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:14.445767 11408 raft_consensus.cc:2804] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:14.449123 11408 raft_consensus.cc:697] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:14.450894 11043 tablet_bootstrap.cc:492] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea: No bootstrap required, opened a new log
I20260709 12:24:14.451719 11043 ts_tablet_manager.cc:1403] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent bootstrapping tablet: real 0.219s	user 0.022s	sys 0.015s
I20260709 12:24:14.450170 11408 consensus_queue.cc:237] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:14.461700 10820 leader_election.cc:304] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:14.478801 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:14.482517 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:14.483215 10994 raft_consensus.cc:3060] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:14.484055 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
W20260709 12:24:14.489689 10819 leader_election.cc:343] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:14.507053 11385 consensus_queue.cc:1048] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:14.508824 11043 raft_consensus.cc:359] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:14.509662 11043 raft_consensus.cc:385] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:14.509945 11043 raft_consensus.cc:740] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Initialized, Role: FOLLOWER
I20260709 12:24:14.510591 11043 consensus_queue.cc:260] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:14.512611 11043 ts_tablet_manager.cc:1434] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent starting tablet: real 0.060s	user 0.006s	sys 0.000s
I20260709 12:24:14.512956 11460 raft_consensus.cc:2749] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:24:14.513831 10849 raft_consensus.cc:2393] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 1: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:24:14.518782 11043 tablet_bootstrap.cc:492] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea: Bootstrap starting.
I20260709 12:24:14.521198 11047 tablet_bootstrap.cc:654] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:14.518826 10994 raft_consensus.cc:2468] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 1.
I20260709 12:24:14.534798 10820 leader_election.cc:304] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:14.535732 11460 raft_consensus.cc:2804] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:14.536818 11460 raft_consensus.cc:697] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 1 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:14.537889 11460 consensus_queue.cc:237] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:14.540800 11043 tablet_bootstrap.cc:654] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:14.590631 11047 tablet_bootstrap.cc:492] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040: No bootstrap required, opened a new log
I20260709 12:24:14.591619 11047 ts_tablet_manager.cc:1403] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040: Time spent bootstrapping tablet: real 0.170s	user 0.014s	sys 0.017s
I20260709 12:24:14.595898 11047 raft_consensus.cc:359] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:14.597040 11047 raft_consensus.cc:385] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:14.597800 11047 raft_consensus.cc:740] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Initialized, Role: FOLLOWER
I20260709 12:24:14.598062 11045 tablet_bootstrap.cc:492] T 2ac8522e549a46e09593fa4c2e175557 P edcc56ddd3264984b4da6c1db59e7f08: No bootstrap required, opened a new log
I20260709 12:24:14.611052 11211 raft_consensus.cc:493] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.624119 11045 ts_tablet_manager.cc:1403] T 2ac8522e549a46e09593fa4c2e175557 P edcc56ddd3264984b4da6c1db59e7f08: Time spent bootstrapping tablet: real 0.433s	user 0.013s	sys 0.019s
I20260709 12:24:14.624379 11211 raft_consensus.cc:515] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:14.618852 11408 consensus_queue.cc:1048] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:14.619520 11043 tablet_bootstrap.cc:492] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea: No bootstrap required, opened a new log
I20260709 12:24:14.626607 11211 leader_election.cc:290] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:14.627131 11043 ts_tablet_manager.cc:1403] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent bootstrapping tablet: real 0.109s	user 0.017s	sys 0.020s
I20260709 12:24:14.621428 10752 catalog_manager.cc:5697] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 0 to 1, leader changed from <none> to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 1 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:14.626750 11045 raft_consensus.cc:359] T 2ac8522e549a46e09593fa4c2e175557 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:14.627939 11045 raft_consensus.cc:385] T 2ac8522e549a46e09593fa4c2e175557 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:14.628404 11045 raft_consensus.cc:740] T 2ac8522e549a46e09593fa4c2e175557 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Initialized, Role: FOLLOWER
I20260709 12:24:14.628393 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef3220c51df47db8859f07ab745fad5" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:14.628588 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef3220c51df47db8859f07ab745fad5" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:14.629328 10849 raft_consensus.cc:2468] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 0.
I20260709 12:24:14.629432 11045 consensus_queue.cc:260] T 2ac8522e549a46e09593fa4c2e175557 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:14.630102 10895 leader_election.cc:343] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:14.623504 11047 consensus_queue.cc:260] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:14.630702 10894 leader_election.cc:304] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:14.631875 11211 raft_consensus.cc:2804] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:14.632273 11211 raft_consensus.cc:493] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:14.632625 11211 raft_consensus.cc:3060] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:14.633054 11045 ts_tablet_manager.cc:1434] T 2ac8522e549a46e09593fa4c2e175557 P edcc56ddd3264984b4da6c1db59e7f08: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:24:14.633356 11047 ts_tablet_manager.cc:1434] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040: Time spent starting tablet: real 0.041s	user 0.008s	sys 0.000s
I20260709 12:24:14.634323 11045 tablet_bootstrap.cc:492] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08: Bootstrap starting.
I20260709 12:24:14.635360 11047 tablet_bootstrap.cc:492] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040: Bootstrap starting.
I20260709 12:24:14.640080 11460 raft_consensus.cc:493] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.630180 11043 raft_consensus.cc:359] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:14.640504 11211 raft_consensus.cc:515] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:14.641266 11043 raft_consensus.cc:385] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:14.642896 11043 raft_consensus.cc:740] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Initialized, Role: FOLLOWER
I20260709 12:24:14.644124 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef3220c51df47db8859f07ab745fad5" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:14.643378 11460 raft_consensus.cc:515] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:14.644944 10849 raft_consensus.cc:3060] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:14.635620 10752 catalog_manager.cc:5697] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 0 to 1, leader changed from <none> to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 1 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:14.645602 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef3220c51df47db8859f07ab745fad5" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:14.644484 11043 consensus_queue.cc:260] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:14.647481 10895 leader_election.cc:343] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:14.652561 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:14.658833 11043 ts_tablet_manager.cc:1434] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.003s
I20260709 12:24:14.646485 11211 leader_election.cc:290] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:24:14.658829 10820 leader_election.cc:343] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:14.661886 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:24:14.664945 10819 leader_election.cc:343] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:14.669204 10819 leader_election.cc:304] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:14.651289 11460 leader_election.cc:290] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:14.671286 11143 raft_consensus.cc:2749] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:14.673602 10849 raft_consensus.cc:2468] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 1.
I20260709 12:24:14.674701 10894 leader_election.cc:304] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:14.676401 11324 raft_consensus.cc:2804] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:14.677619 11324 raft_consensus.cc:697] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:14.678926 11047 tablet_bootstrap.cc:654] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:14.680055 11043 tablet_bootstrap.cc:492] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea: Bootstrap starting.
I20260709 12:24:14.678633 11324 consensus_queue.cc:237] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:14.684653 11438 consensus_queue.cc:1048] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:14.701818 11043 tablet_bootstrap.cc:654] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:14.707862 11438 consensus_queue.cc:1048] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:14.712001 10751 catalog_manager.cc:5697] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 0 to 1, leader changed from <none> to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 1 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:14.719025 11047 tablet_bootstrap.cc:492] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040: No bootstrap required, opened a new log
I20260709 12:24:14.719601 11047 ts_tablet_manager.cc:1403] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040: Time spent bootstrapping tablet: real 0.085s	user 0.018s	sys 0.011s
I20260709 12:24:14.722430 11047 raft_consensus.cc:359] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:14.723130 11047 raft_consensus.cc:385] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:14.723385 11047 raft_consensus.cc:740] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Initialized, Role: FOLLOWER
I20260709 12:24:14.724051 11047 consensus_queue.cc:260] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:14.732439 11045 tablet_bootstrap.cc:654] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:14.742264 11043 tablet_bootstrap.cc:492] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea: No bootstrap required, opened a new log
I20260709 12:24:14.742893 11043 ts_tablet_manager.cc:1403] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea: Time spent bootstrapping tablet: real 0.069s	user 0.006s	sys 0.005s
I20260709 12:24:14.747097 11438 consensus_queue.cc:1048] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:14.750018 11324 raft_consensus.cc:493] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.750677 11324 raft_consensus.cc:515] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:14.758296 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:14.758628 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:14.759169 11001 raft_consensus.cc:2393] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 1: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:24:14.760679 10894 leader_election.cc:304] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:14.761945 11450 raft_consensus.cc:3060] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:14.765769 11047 ts_tablet_manager.cc:1434] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040: Time spent starting tablet: real 0.046s	user 0.005s	sys 0.000s
I20260709 12:24:14.766839 11047 tablet_bootstrap.cc:492] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040: Bootstrap starting.
I20260709 12:24:14.770668 11043 raft_consensus.cc:359] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:14.771404 11043 raft_consensus.cc:385] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:14.772462 11043 raft_consensus.cc:740] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Initialized, Role: FOLLOWER
I20260709 12:24:14.757122 11324 leader_election.cc:290] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:14.774425 11043 consensus_queue.cc:260] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:14.777010 11043 ts_tablet_manager.cc:1434] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea: Time spent starting tablet: real 0.034s	user 0.009s	sys 0.000s
I20260709 12:24:14.779403 11045 tablet_bootstrap.cc:492] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08: No bootstrap required, opened a new log
I20260709 12:24:14.780078 11045 ts_tablet_manager.cc:1403] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08: Time spent bootstrapping tablet: real 0.146s	user 0.016s	sys 0.000s
I20260709 12:24:14.784716 11043 tablet_bootstrap.cc:492] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea: Bootstrap starting.
I20260709 12:24:14.782657 11045 raft_consensus.cc:359] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:14.791915 11045 raft_consensus.cc:385] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:14.792289 11045 raft_consensus.cc:740] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Initialized, Role: FOLLOWER
I20260709 12:24:14.793025 11045 consensus_queue.cc:260] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:14.794292 11043 tablet_bootstrap.cc:654] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:14.796000 11045 ts_tablet_manager.cc:1434] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 12:24:14.783780 10749 catalog_manager.cc:5697] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 0 to 1, leader changed from <none> to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 1 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:14.786408 11450 raft_consensus.cc:2749] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:14.802090 11045 tablet_bootstrap.cc:492] T dad6a1da21304fcfacab384a6afc4101 P edcc56ddd3264984b4da6c1db59e7f08: Bootstrap starting.
I20260709 12:24:14.788396 11047 tablet_bootstrap.cc:654] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:14.808310 11456 raft_consensus.cc:493] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.809182 11456 raft_consensus.cc:515] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:14.816510 11047 tablet_bootstrap.cc:492] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040: No bootstrap required, opened a new log
I20260709 12:24:14.817041 11047 ts_tablet_manager.cc:1403] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040: Time spent bootstrapping tablet: real 0.050s	user 0.012s	sys 0.000s
I20260709 12:24:14.823174 11456 leader_election.cc:290] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:14.825084 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6a1da21304fcfacab384a6afc4101" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:14.825562 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6a1da21304fcfacab384a6afc4101" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:24:14.826761 10819 leader_election.cc:343] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:14.827224 11045 tablet_bootstrap.cc:654] T dad6a1da21304fcfacab384a6afc4101 P edcc56ddd3264984b4da6c1db59e7f08: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:14.827396 11043 tablet_bootstrap.cc:492] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea: No bootstrap required, opened a new log
I20260709 12:24:14.824540 11047 raft_consensus.cc:359] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:14.827852 11047 raft_consensus.cc:385] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:14.827945 11043 ts_tablet_manager.cc:1403] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent bootstrapping tablet: real 0.043s	user 0.008s	sys 0.005s
I20260709 12:24:14.828178 11047 raft_consensus.cc:740] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Initialized, Role: FOLLOWER
I20260709 12:24:14.829008 11047 consensus_queue.cc:260] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:14.828207 10820 leader_election.cc:343] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:14.830175 10820 leader_election.cc:304] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:14.831897 11143 raft_consensus.cc:2749] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:14.840251 11047 ts_tablet_manager.cc:1434] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 12:24:14.840188 11043 raft_consensus.cc:359] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:14.841148 11043 raft_consensus.cc:385] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:14.841524 11043 raft_consensus.cc:740] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Initialized, Role: FOLLOWER
I20260709 12:24:14.841691 11047 tablet_bootstrap.cc:492] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040: Bootstrap starting.
I20260709 12:24:14.842299 11043 consensus_queue.cc:260] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:14.844640 11043 ts_tablet_manager.cc:1434] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.002s
I20260709 12:24:14.845731 11043 tablet_bootstrap.cc:492] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea: Bootstrap starting.
I20260709 12:24:14.858201 11043 tablet_bootstrap.cc:654] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:14.862037 11047 tablet_bootstrap.cc:654] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:14.871631 11045 tablet_bootstrap.cc:492] T dad6a1da21304fcfacab384a6afc4101 P edcc56ddd3264984b4da6c1db59e7f08: No bootstrap required, opened a new log
I20260709 12:24:14.872145 11045 ts_tablet_manager.cc:1403] T dad6a1da21304fcfacab384a6afc4101 P edcc56ddd3264984b4da6c1db59e7f08: Time spent bootstrapping tablet: real 0.070s	user 0.013s	sys 0.000s
I20260709 12:24:14.873965 11043 tablet_bootstrap.cc:492] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea: No bootstrap required, opened a new log
I20260709 12:24:14.874481 11043 ts_tablet_manager.cc:1403] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.003s
I20260709 12:24:14.879902 11045 raft_consensus.cc:359] T dad6a1da21304fcfacab384a6afc4101 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:14.880141 11043 raft_consensus.cc:359] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:14.880674 11045 raft_consensus.cc:385] T dad6a1da21304fcfacab384a6afc4101 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:14.881071 11045 raft_consensus.cc:740] T dad6a1da21304fcfacab384a6afc4101 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Initialized, Role: FOLLOWER
I20260709 12:24:14.881052 11043 raft_consensus.cc:385] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:14.881604 11043 raft_consensus.cc:740] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Initialized, Role: FOLLOWER
I20260709 12:24:14.881922 11045 consensus_queue.cc:260] T dad6a1da21304fcfacab384a6afc4101 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:14.882225 11043 consensus_queue.cc:260] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:14.883728 11043 ts_tablet_manager.cc:1434] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:24:14.884423 11045 ts_tablet_manager.cc:1434] T dad6a1da21304fcfacab384a6afc4101 P edcc56ddd3264984b4da6c1db59e7f08: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:24:14.885628 11043 tablet_bootstrap.cc:492] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea: Bootstrap starting.
I20260709 12:24:14.886377 11045 tablet_bootstrap.cc:492] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08: Bootstrap starting.
I20260709 12:24:14.893815 11043 tablet_bootstrap.cc:654] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:14.894152 11047 tablet_bootstrap.cc:492] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040: No bootstrap required, opened a new log
I20260709 12:24:14.894625 11047 ts_tablet_manager.cc:1403] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040: Time spent bootstrapping tablet: real 0.053s	user 0.010s	sys 0.000s
I20260709 12:24:14.897698 11047 raft_consensus.cc:359] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:14.898192 11461 raft_consensus.cc:493] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.898694 11047 raft_consensus.cc:385] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:14.899107 11047 raft_consensus.cc:740] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Initialized, Role: FOLLOWER
I20260709 12:24:14.898828 11461 raft_consensus.cc:515] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:14.900127 11047 consensus_queue.cc:260] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:14.905911 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac8522e549a46e09593fa4c2e175557" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:14.906236 11045 tablet_bootstrap.cc:654] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:14.907069 10923 raft_consensus.cc:2468] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 0.
I20260709 12:24:14.909215 10819 leader_election.cc:304] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:14.910418 11143 raft_consensus.cc:2804] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:14.910779 11143 raft_consensus.cc:493] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:14.911108 11143 raft_consensus.cc:3060] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:14.911975 11047 ts_tablet_manager.cc:1434] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040: Time spent starting tablet: real 0.017s	user 0.010s	sys 0.000s
I20260709 12:24:14.912158 11461 leader_election.cc:290] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:14.914597 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac8522e549a46e09593fa4c2e175557" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:14.915313 11002 raft_consensus.cc:2468] T 2ac8522e549a46e09593fa4c2e175557 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 0.
I20260709 12:24:14.919384 11143 raft_consensus.cc:515] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:14.921837 11143 leader_election.cc:290] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:14.916878 11047 tablet_bootstrap.cc:492] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040: Bootstrap starting.
I20260709 12:24:14.922750 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac8522e549a46e09593fa4c2e175557" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:14.923380 10927 raft_consensus.cc:3060] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:14.928977 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac8522e549a46e09593fa4c2e175557" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:14.930617 11002 raft_consensus.cc:3060] T 2ac8522e549a46e09593fa4c2e175557 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:14.938779 11408 consensus_queue.cc:1048] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:14.940899 10927 raft_consensus.cc:2468] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 1.
I20260709 12:24:14.943791 10819 leader_election.cc:304] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:14.941656 11143 consensus_queue.cc:1048] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:14.945127 11460 raft_consensus.cc:2804] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:14.945773 11460 raft_consensus.cc:697] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [term 1 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:14.931495 11047 tablet_bootstrap.cc:654] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:14.946718 11460 consensus_queue.cc:237] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:14.944535 11002 raft_consensus.cc:2468] T 2ac8522e549a46e09593fa4c2e175557 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 1.
I20260709 12:24:14.963410 11385 consensus_queue.cc:1048] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:14.965687 11047 tablet_bootstrap.cc:492] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040: No bootstrap required, opened a new log
I20260709 12:24:14.966183 11047 ts_tablet_manager.cc:1403] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040: Time spent bootstrapping tablet: real 0.050s	user 0.021s	sys 0.002s
I20260709 12:24:14.969445 11047 raft_consensus.cc:359] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:14.970510 11047 raft_consensus.cc:385] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:14.970878 11047 raft_consensus.cc:740] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Initialized, Role: FOLLOWER
I20260709 12:24:14.971669 11047 consensus_queue.cc:260] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:14.974308 11047 ts_tablet_manager.cc:1434] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 12:24:14.975505 11047 tablet_bootstrap.cc:492] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040: Bootstrap starting.
I20260709 12:24:14.981745 11047 tablet_bootstrap.cc:654] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:14.986739 11043 tablet_bootstrap.cc:492] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea: No bootstrap required, opened a new log
I20260709 12:24:14.987274 11043 ts_tablet_manager.cc:1403] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent bootstrapping tablet: real 0.102s	user 0.018s	sys 0.008s
I20260709 12:24:14.991813 11043 raft_consensus.cc:359] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:14.992388 11043 raft_consensus.cc:385] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:14.992653 11043 raft_consensus.cc:740] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Initialized, Role: FOLLOWER
I20260709 12:24:14.993690 11043 consensus_queue.cc:260] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:14.987234 11045 tablet_bootstrap.cc:492] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08: No bootstrap required, opened a new log
I20260709 12:24:14.996407 11045 ts_tablet_manager.cc:1403] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08: Time spent bootstrapping tablet: real 0.110s	user 0.005s	sys 0.010s
I20260709 12:24:14.996912 10751 catalog_manager.cc:5697] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 0 to 1, leader changed from <none> to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 1 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:15.001889 11450 raft_consensus.cc:493] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:15.002440 11450 raft_consensus.cc:515] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:15.006914 11450 leader_election.cc:290] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:15.007016 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:15.008450 10853 raft_consensus.cc:2468] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 0.
I20260709 12:24:15.009850 10894 leader_election.cc:304] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:15.010654 11211 raft_consensus.cc:2804] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:15.011014 11211 raft_consensus.cc:493] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:15.011049 11047 tablet_bootstrap.cc:492] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040: No bootstrap required, opened a new log
I20260709 12:24:15.011175 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:15.011446 11211 raft_consensus.cc:3060] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:15.011854 11047 ts_tablet_manager.cc:1403] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.004s
I20260709 12:24:15.014705 11047 raft_consensus.cc:359] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:15.015419 11047 raft_consensus.cc:385] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:15.015758 11047 raft_consensus.cc:740] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Initialized, Role: FOLLOWER
I20260709 12:24:15.015880 11043 ts_tablet_manager.cc:1434] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
W20260709 12:24:15.014684 10895 leader_election.cc:343] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:15.016942 11043 tablet_bootstrap.cc:492] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea: Bootstrap starting.
I20260709 12:24:14.999053 11045 raft_consensus.cc:359] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:15.018222 11045 raft_consensus.cc:385] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:15.018623 11045 raft_consensus.cc:740] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Initialized, Role: FOLLOWER
I20260709 12:24:15.018267 11047 consensus_queue.cc:260] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:15.020748 11047 ts_tablet_manager.cc:1434] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:24:15.019364 11045 consensus_queue.cc:260] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:15.021126 11211 raft_consensus.cc:515] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:15.021899 11047 tablet_bootstrap.cc:492] T d0aed74af73a488f8b691578ca370226 P 80cd7d227db44f34a6108591dad9c040: Bootstrap starting.
I20260709 12:24:15.024420 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:15.025198 10853 raft_consensus.cc:3060] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:15.033085 11047 tablet_bootstrap.cc:654] T d0aed74af73a488f8b691578ca370226 P 80cd7d227db44f34a6108591dad9c040: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:15.047863 11045 ts_tablet_manager.cc:1434] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.001s
I20260709 12:24:15.048983 11211 leader_election.cc:290] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:15.054805 10853 raft_consensus.cc:2468] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 1.
I20260709 12:24:15.082315 11460 consensus_queue.cc:1048] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:15.063242 11385 raft_consensus.cc:493] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:15.098551 11045 tablet_bootstrap.cc:492] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08: Bootstrap starting.
I20260709 12:24:15.098670 11216 raft_consensus.cc:493] T dad6a1da21304fcfacab384a6afc4101 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:15.099436 11216 raft_consensus.cc:515] T dad6a1da21304fcfacab384a6afc4101 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:15.101395 11216 leader_election.cc:290] T dad6a1da21304fcfacab384a6afc4101 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:15.103386 11408 raft_consensus.cc:493] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:15.104084 11408 raft_consensus.cc:515] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:15.114758 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 84390us
I20260709 12:24:15.085408 11385 raft_consensus.cc:515] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:15.120576 10894 leader_election.cc:304] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:15.121565 11385 leader_election.cc:290] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:15.122014 11211 raft_consensus.cc:2804] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:15.122920 11211 raft_consensus.cc:697] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
W20260709 12:24:15.137840 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 96642.6us
I20260709 12:24:15.107178 11408 leader_election.cc:290] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:15.139349 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:15.139901 11043 tablet_bootstrap.cc:654] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:15.148268 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6a1da21304fcfacab384a6afc4101" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:15.154685 10851 raft_consensus.cc:2468] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 0.
I20260709 12:24:15.168536 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef3220c51df47db8859f07ab745fad5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:15.165175 11211 consensus_queue.cc:237] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:15.167037 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:15.171011 10849 raft_consensus.cc:2468] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 0.
I20260709 12:24:15.169768 10853 raft_consensus.cc:2393] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 1: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:24:15.175150 11047 tablet_bootstrap.cc:492] T d0aed74af73a488f8b691578ca370226 P 80cd7d227db44f34a6108591dad9c040: No bootstrap required, opened a new log
I20260709 12:24:15.176297 11047 ts_tablet_manager.cc:1403] T d0aed74af73a488f8b691578ca370226 P 80cd7d227db44f34a6108591dad9c040: Time spent bootstrapping tablet: real 0.155s	user 0.035s	sys 0.032s
I20260709 12:24:15.184911 11047 raft_consensus.cc:359] T d0aed74af73a488f8b691578ca370226 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:15.185889 11047 raft_consensus.cc:385] T d0aed74af73a488f8b691578ca370226 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:15.186231 11047 raft_consensus.cc:740] T d0aed74af73a488f8b691578ca370226 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Initialized, Role: FOLLOWER
I20260709 12:24:15.187130 11047 consensus_queue.cc:260] T d0aed74af73a488f8b691578ca370226 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:15.196908 10968 leader_election.cc:304] T dad6a1da21304fcfacab384a6afc4101 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:15.198220 10968 leader_election.cc:304] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:15.204730 11216 raft_consensus.cc:2804] T dad6a1da21304fcfacab384a6afc4101 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:15.205458 11216 raft_consensus.cc:493] T dad6a1da21304fcfacab384a6afc4101 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:15.205878 11216 raft_consensus.cc:3060] T dad6a1da21304fcfacab384a6afc4101 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:15.210893 11047 ts_tablet_manager.cc:1434] T d0aed74af73a488f8b691578ca370226 P 80cd7d227db44f34a6108591dad9c040: Time spent starting tablet: real 0.034s	user 0.004s	sys 0.004s
I20260709 12:24:15.223768 11143 raft_consensus.cc:493] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:15.224452 11143 raft_consensus.cc:515] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:15.238030 11143 leader_election.cc:290] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:15.239323 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:15.242513 11047 tablet_bootstrap.cc:492] T e8b17195a94142039c40f598ed006c94 P 80cd7d227db44f34a6108591dad9c040: Bootstrap starting.
I20260709 12:24:15.222016 11460 raft_consensus.cc:493] T d0aed74af73a488f8b691578ca370226 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:15.243253 10820 leader_election.cc:343] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:15.257396 11456 raft_consensus.cc:493] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:15.258311 11456 raft_consensus.cc:515] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:15.260762 11143 raft_consensus.cc:493] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:15.241559 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6a1da21304fcfacab384a6afc4101" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:15.266806 11143 raft_consensus.cc:515] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:15.272912 10925 raft_consensus.cc:2468] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 0.
W20260709 12:24:15.309816 10895 leader_election.cc:343] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:24:15.310499 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 112390us
I20260709 12:24:15.259721 11501 raft_consensus.cc:2804] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:15.265802 11460 raft_consensus.cc:515] T d0aed74af73a488f8b691578ca370226 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:15.326601 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:15.313846 11501 raft_consensus.cc:493] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:15.336495 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c6d38c4d8a90a81975a6a0cb13" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:24:15.338609 10819 leader_election.cc:343] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:15.339074 10819 leader_election.cc:304] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:15.321566 11496 raft_consensus.cc:493] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:15.340860 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c6d38c4d8a90a81975a6a0cb13" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:24:15.340353 11494 log.cc:927] Time spent T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 12:24:15.325675 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef3220c51df47db8859f07ab745fad5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:15.335989 11501 raft_consensus.cc:3060] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:15.366127 11001 raft_consensus.cc:3060] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:15.391075 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:15.402531 11216 raft_consensus.cc:515] T dad6a1da21304fcfacab384a6afc4101 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:15.380486 11456 leader_election.cc:290] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:15.411844 11216 leader_election.cc:290] T dad6a1da21304fcfacab384a6afc4101 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:15.418725 11505 raft_consensus.cc:2749] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:15.354758 11496 raft_consensus.cc:515] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:15.447974 10926 raft_consensus.cc:2468] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 0.
I20260709 12:24:15.463665 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c913e527ff46578e084c41eab7bb9d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:15.470463 11045 tablet_bootstrap.cc:654] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:15.464522 11460 leader_election.cc:290] T d0aed74af73a488f8b691578ca370226 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:15.473587 11002 raft_consensus.cc:2468] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 0.
W20260709 12:24:15.477728 10820 leader_election.cc:343] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:15.482628 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aed74af73a488f8b691578ca370226" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:15.501492 11143 leader_election.cc:290] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:24:15.509785 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 198054us
W20260709 12:24:15.536685 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 198085us
I20260709 12:24:15.521883 11514 consensus_queue.cc:1048] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 12:24:15.572280 10968 leader_election.cc:304] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:15.575341 11047 tablet_bootstrap.cc:654] T e8b17195a94142039c40f598ed006c94 P 80cd7d227db44f34a6108591dad9c040: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:15.561910 11496 leader_election.cc:290] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:24:15.597306 10800 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:24:15.584722 11502 raft_consensus.cc:2749] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:15.606691 11043 tablet_bootstrap.cc:492] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea: No bootstrap required, opened a new log
I20260709 12:24:15.607424 11043 ts_tablet_manager.cc:1403] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea: Time spent bootstrapping tablet: real 0.591s	user 0.016s	sys 0.011s
I20260709 12:24:15.626869 11501 raft_consensus.cc:515] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:15.630857 11501 leader_election.cc:290] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:15.634497 11045 tablet_bootstrap.cc:492] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08: No bootstrap required, opened a new log
I20260709 12:24:15.635071 11045 ts_tablet_manager.cc:1403] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08: Time spent bootstrapping tablet: real 0.537s	user 0.016s	sys 0.012s
I20260709 12:24:15.634553 11043 raft_consensus.cc:359] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:15.636155 11043 raft_consensus.cc:385] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:15.636420 11043 raft_consensus.cc:740] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Initialized, Role: FOLLOWER
I20260709 12:24:15.637045 11043 consensus_queue.cc:260] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:15.638280 11043 ts_tablet_manager.cc:1434] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea: Time spent starting tablet: real 0.031s	user 0.003s	sys 0.000s
I20260709 12:24:15.639213 11043 tablet_bootstrap.cc:492] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea: Bootstrap starting.
I20260709 12:24:15.639464 11045 raft_consensus.cc:359] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:15.645560 11047 tablet_bootstrap.cc:492] T e8b17195a94142039c40f598ed006c94 P 80cd7d227db44f34a6108591dad9c040: No bootstrap required, opened a new log
I20260709 12:24:15.644735 11043 tablet_bootstrap.cc:654] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:15.646437 11047 ts_tablet_manager.cc:1403] T e8b17195a94142039c40f598ed006c94 P 80cd7d227db44f34a6108591dad9c040: Time spent bootstrapping tablet: real 0.426s	user 0.009s	sys 0.008s
I20260709 12:24:15.651934 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:15.653002 10997 raft_consensus.cc:2393] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 1: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:24:15.655499 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6a1da21304fcfacab384a6afc4101" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:15.656119 10927 raft_consensus.cc:3060] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:15.646095 11045 raft_consensus.cc:385] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:15.663054 11045 raft_consensus.cc:740] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Initialized, Role: FOLLOWER
I20260709 12:24:15.664750 11045 consensus_queue.cc:260] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:15.662463 11047 raft_consensus.cc:359] T e8b17195a94142039c40f598ed006c94 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:15.667697 11047 raft_consensus.cc:385] T e8b17195a94142039c40f598ed006c94 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:15.667995 11047 raft_consensus.cc:740] T e8b17195a94142039c40f598ed006c94 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Initialized, Role: FOLLOWER
W20260709 12:24:15.674615 10895 consensus_peers.cc:597] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea -> Peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): Couldn't send request to peer edcc56ddd3264984b4da6c1db59e7f08. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:15.668892 11047 consensus_queue.cc:260] T e8b17195a94142039c40f598ed006c94 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:15.678608 11047 ts_tablet_manager.cc:1434] T e8b17195a94142039c40f598ed006c94 P 80cd7d227db44f34a6108591dad9c040: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 12:24:15.682780 10927 raft_consensus.cc:2468] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 1.
I20260709 12:24:15.684827 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:15.685659 10848 raft_consensus.cc:3060] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:15.686722 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6a1da21304fcfacab384a6afc4101" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:15.687410 10847 raft_consensus.cc:3060] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:15.692013 11045 ts_tablet_manager.cc:1434] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08: Time spent starting tablet: real 0.056s	user 0.006s	sys 0.001s
I20260709 12:24:15.695842 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:15.697294 10968 leader_election.cc:304] T dad6a1da21304fcfacab384a6afc4101 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:15.698012 10820 leader_election.cc:304] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:15.741940 11509 raft_consensus.cc:2804] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:15.742400 11509 raft_consensus.cc:493] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:15.742751 11509 raft_consensus.cc:3060] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:15.743597 11045 tablet_bootstrap.cc:492] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08: Bootstrap starting.
I20260709 12:24:15.746614 11499 raft_consensus.cc:2804] T dad6a1da21304fcfacab384a6afc4101 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:15.747152 11499 raft_consensus.cc:697] T dad6a1da21304fcfacab384a6afc4101 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
W20260709 12:24:15.748679 10820 leader_election.cc:343] T d0aed74af73a488f8b691578ca370226 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:15.748944 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:15.696580 10922 raft_consensus.cc:3060] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:15.774498 10751 catalog_manager.cc:5697] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 0 to 1, leader changed from <none> to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 1 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:15.787035 11496 raft_consensus.cc:493] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:15.762562 11499 consensus_queue.cc:237] T dad6a1da21304fcfacab384a6afc4101 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:15.799707 10848 raft_consensus.cc:2468] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 1.
I20260709 12:24:15.808113 10968 leader_election.cc:304] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:15.807323 11518 consensus_queue.cc:1048] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.054s
I20260709 12:24:15.809644 11501 raft_consensus.cc:2804] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:24:15.810827 10819 leader_election.cc:343] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:15.811344 10819 leader_election.cc:304] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:15.816380 11045 tablet_bootstrap.cc:654] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:15.819715 11501 raft_consensus.cc:697] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 1 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:15.805449 11496 raft_consensus.cc:515] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:15.835747 11496 leader_election.cc:290] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:15.826570 11501 consensus_queue.cc:237] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:15.817639 11461 raft_consensus.cc:2749] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:15.858978 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c913e527ff46578e084c41eab7bb9d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:15.862172 10999 raft_consensus.cc:2468] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 0.
I20260709 12:24:15.836175 11509 raft_consensus.cc:515] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:15.878044 11509 leader_election.cc:290] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:15.879335 10847 raft_consensus.cc:2468] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 1.
I20260709 12:24:15.884370 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c913e527ff46578e084c41eab7bb9d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:15.885040 10999 raft_consensus.cc:3060] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:15.907980 10999 raft_consensus.cc:2468] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 1.
I20260709 12:24:15.911561 10820 leader_election.cc:304] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:15.917235 10895 leader_election.cc:304] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:15.920137 11509 raft_consensus.cc:2804] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:15.896030 10922 raft_consensus.cc:2468] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 1.
I20260709 12:24:15.927381 11324 raft_consensus.cc:2804] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:15.936311 11324 raft_consensus.cc:493] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:15.942194 11324 raft_consensus.cc:3060] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:15.944182 11043 tablet_bootstrap.cc:492] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea: No bootstrap required, opened a new log
I20260709 12:24:15.946064 11043 ts_tablet_manager.cc:1403] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent bootstrapping tablet: real 0.307s	user 0.028s	sys 0.030s
I20260709 12:24:15.945550 11045 tablet_bootstrap.cc:492] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08: No bootstrap required, opened a new log
I20260709 12:24:15.947187 11045 ts_tablet_manager.cc:1403] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08: Time spent bootstrapping tablet: real 0.204s	user 0.018s	sys 0.011s
I20260709 12:24:15.949308 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c913e527ff46578e084c41eab7bb9d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:15.952255 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aed74af73a488f8b691578ca370226" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:15.932796 11509 raft_consensus.cc:697] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [term 1 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:15.968537 10894 leader_election.cc:304] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:15.974372 11497 raft_consensus.cc:2749] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:15.972447 11520 consensus_queue.cc:1048] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:24:15.977018 11509 consensus_queue.cc:237] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:15.979118 11045 raft_consensus.cc:359] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:15.980016 11045 raft_consensus.cc:385] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:15.980563 11045 raft_consensus.cc:740] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Initialized, Role: FOLLOWER
I20260709 12:24:15.980310 11043 raft_consensus.cc:359] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:15.981144 11043 raft_consensus.cc:385] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:15.981433 11043 raft_consensus.cc:740] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Initialized, Role: FOLLOWER
I20260709 12:24:15.981513 11045 consensus_queue.cc:260] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:15.982167 11043 consensus_queue.cc:260] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:15.997591 11045 ts_tablet_manager.cc:1434] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08: Time spent starting tablet: real 0.050s	user 0.008s	sys 0.000s
I20260709 12:24:16.003549 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c913e527ff46578e084c41eab7bb9d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:15.989027 11324 raft_consensus.cc:515] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:16.006119 10926 raft_consensus.cc:2393] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 1: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:24:16.007222 11043 ts_tablet_manager.cc:1434] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent starting tablet: real 0.061s	user 0.007s	sys 0.000s
I20260709 12:24:16.012828 11324 leader_election.cc:290] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:16.013659 11045 tablet_bootstrap.cc:492] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08: Bootstrap starting.
I20260709 12:24:16.023430 11045 tablet_bootstrap.cc:654] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:16.024371 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c913e527ff46578e084c41eab7bb9d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
W20260709 12:24:16.037716 10819 leader_election.cc:343] T d0aed74af73a488f8b691578ca370226 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:16.038275 10819 leader_election.cc:304] T d0aed74af73a488f8b691578ca370226 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:16.040241 11043 tablet_bootstrap.cc:492] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea: Bootstrap starting.
I20260709 12:24:16.042575 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c913e527ff46578e084c41eab7bb9d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:16.045509 10995 raft_consensus.cc:2393] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 1: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:24:16.047735 10994 raft_consensus.cc:3060] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:16.059832 11043 tablet_bootstrap.cc:654] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea: Neither blocks nor log segments found. Creating new log.
W20260709 12:24:16.060207 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 90560.1us
I20260709 12:24:16.064884 11520 consensus_queue.cc:1048] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:16.076200 11043 tablet_bootstrap.cc:492] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea: No bootstrap required, opened a new log
I20260709 12:24:16.076892 11043 ts_tablet_manager.cc:1403] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea: Time spent bootstrapping tablet: real 0.040s	user 0.009s	sys 0.006s
I20260709 12:24:16.077258 11460 raft_consensus.cc:2749] T d0aed74af73a488f8b691578ca370226 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:16.080307 11043 raft_consensus.cc:359] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:16.088049 11460 raft_consensus.cc:493] T e8b17195a94142039c40f598ed006c94 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:16.088634 11460 raft_consensus.cc:515] T e8b17195a94142039c40f598ed006c94 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:16.081179 11043 raft_consensus.cc:385] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:16.090595 11043 raft_consensus.cc:740] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Initialized, Role: FOLLOWER
I20260709 12:24:16.091562 11043 consensus_queue.cc:260] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:16.093446 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b17195a94142039c40f598ed006c94" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:16.090516 11460 leader_election.cc:290] T e8b17195a94142039c40f598ed006c94 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:16.095559 11043 ts_tablet_manager.cc:1434] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.004s
I20260709 12:24:16.096997 11043 tablet_bootstrap.cc:492] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea: Bootstrap starting.
W20260709 12:24:16.098227 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 60554us
I20260709 12:24:16.103394 11043 tablet_bootstrap.cc:654] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea: Neither blocks nor log segments found. Creating new log.
W20260709 12:24:16.095445 10820 leader_election.cc:343] T e8b17195a94142039c40f598ed006c94 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:16.117202 11509 consensus_queue.cc:1048] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:16.122828 10750 catalog_manager.cc:5697] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 0 to 1, leader changed from <none> to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 1 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:16.138921 11043 tablet_bootstrap.cc:492] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea: No bootstrap required, opened a new log
I20260709 12:24:16.141829 11043 ts_tablet_manager.cc:1403] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent bootstrapping tablet: real 0.045s	user 0.019s	sys 0.013s
I20260709 12:24:16.147418 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c913e527ff46578e084c41eab7bb9d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:16.149492 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b17195a94142039c40f598ed006c94" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:16.154424 11045 tablet_bootstrap.cc:492] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08: No bootstrap required, opened a new log
I20260709 12:24:16.155216 11045 ts_tablet_manager.cc:1403] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08: Time spent bootstrapping tablet: real 0.149s	user 0.037s	sys 0.024s
I20260709 12:24:16.160190 11043 raft_consensus.cc:359] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:16.160614 10894 leader_election.cc:304] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:16.160949 11043 raft_consensus.cc:385] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:16.161218 11043 raft_consensus.cc:740] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Initialized, Role: FOLLOWER
I20260709 12:24:16.162159 11043 consensus_queue.cc:260] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:16.168982 11045 raft_consensus.cc:359] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:16.169873 11045 raft_consensus.cc:385] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:16.170920 11045 raft_consensus.cc:740] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Initialized, Role: FOLLOWER
I20260709 12:24:16.171741 11045 consensus_queue.cc:260] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:16.173997 11045 ts_tablet_manager.cc:1434] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:24:16.174692 11519 raft_consensus.cc:493] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:16.175308 11519 raft_consensus.cc:515] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:16.177103 11043 ts_tablet_manager.cc:1434] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.001s
W20260709 12:24:16.177851 10819 leader_election.cc:343] T e8b17195a94142039c40f598ed006c94 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:16.178066 11519 leader_election.cc:290] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:16.178416 10819 leader_election.cc:304] T e8b17195a94142039c40f598ed006c94 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:16.179492 11460 raft_consensus.cc:2749] T e8b17195a94142039c40f598ed006c94 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:16.180900 11539 raft_consensus.cc:2749] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:24:16.182315 11043 tablet_bootstrap.cc:492] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea: Bootstrap starting.
I20260709 12:24:16.188316 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:16.189055 10849 raft_consensus.cc:2468] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 0.
I20260709 12:24:16.191143 10968 leader_election.cc:304] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:16.192080 11519 raft_consensus.cc:2804] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:16.192749 11519 raft_consensus.cc:493] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:16.193205 11519 raft_consensus.cc:3060] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:16.193992 11043 tablet_bootstrap.cc:654] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:16.194425 10750 catalog_manager.cc:5697] T dad6a1da21304fcfacab384a6afc4101 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 0 to 1, leader changed from <none> to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 1 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:16.195240 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:16.195966 10926 raft_consensus.cc:2468] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 0.
I20260709 12:24:16.206801 11043 tablet_bootstrap.cc:492] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea: No bootstrap required, opened a new log
I20260709 12:24:16.207554 11043 ts_tablet_manager.cc:1403] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.003s
I20260709 12:24:16.175321 11045 tablet_bootstrap.cc:492] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08: Bootstrap starting.
I20260709 12:24:16.213729 11043 raft_consensus.cc:359] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:16.214682 11043 raft_consensus.cc:385] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:16.215030 11043 raft_consensus.cc:740] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Initialized, Role: FOLLOWER
I20260709 12:24:16.215692 11501 raft_consensus.cc:493] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:16.215898 11043 consensus_queue.cc:260] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:16.216538 11501 raft_consensus.cc:515] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:16.218904 11501 leader_election.cc:290] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:16.219759 10750 catalog_manager.cc:5697] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 0 to 1, leader changed from <none> to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 1 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:16.222054 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c6d38c4d8a90a81975a6a0cb13" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:16.222683 10846 raft_consensus.cc:2468] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 0.
I20260709 12:24:16.224225 10968 leader_election.cc:304] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:16.225337 11501 raft_consensus.cc:2804] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:16.225761 11501 raft_consensus.cc:493] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:16.226164 11501 raft_consensus.cc:3060] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:16.242707 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c6d38c4d8a90a81975a6a0cb13" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:16.243389 10926 raft_consensus.cc:2468] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 0.
I20260709 12:24:16.251044 11043 ts_tablet_manager.cc:1434] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.000s
I20260709 12:24:16.271584 11045 tablet_bootstrap.cc:654] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:16.239010 11519 raft_consensus.cc:515] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:16.277714 11519 leader_election.cc:290] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:16.281265 11501 raft_consensus.cc:515] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:16.283807 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:16.285243 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:16.285874 10925 raft_consensus.cc:3060] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:16.284624 10848 raft_consensus.cc:3060] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:16.295629 11501 leader_election.cc:290] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:16.296478 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c6d38c4d8a90a81975a6a0cb13" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:16.297228 10846 raft_consensus.cc:3060] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:16.300911 10848 raft_consensus.cc:2468] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 1.
I20260709 12:24:16.302392 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c6d38c4d8a90a81975a6a0cb13" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:16.303143 10926 raft_consensus.cc:3060] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:16.307899 10925 raft_consensus.cc:2468] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 1.
I20260709 12:24:16.309792 10968 leader_election.cc:304] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:16.312023 10926 raft_consensus.cc:2468] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 1.
I20260709 12:24:16.317505 10846 raft_consensus.cc:2468] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 1.
I20260709 12:24:16.318656 10968 leader_election.cc:304] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:16.318959 11525 raft_consensus.cc:2804] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:16.319478 11519 raft_consensus.cc:2804] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:16.319494 11525 raft_consensus.cc:697] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 1 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:16.320067 11519 raft_consensus.cc:697] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:16.320990 11519 consensus_queue.cc:237] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:16.320990 11525 consensus_queue.cc:237] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:16.334649 11045 tablet_bootstrap.cc:492] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08: No bootstrap required, opened a new log
I20260709 12:24:16.335170 11045 ts_tablet_manager.cc:1403] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08: Time spent bootstrapping tablet: real 0.160s	user 0.011s	sys 0.004s
I20260709 12:24:16.337409 11045 raft_consensus.cc:359] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:16.337960 11045 raft_consensus.cc:385] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:16.338269 11045 raft_consensus.cc:740] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Initialized, Role: FOLLOWER
I20260709 12:24:16.338984 11045 consensus_queue.cc:260] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:16.341014 11045 ts_tablet_manager.cc:1434] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 12:24:16.342099 11045 tablet_bootstrap.cc:492] T d0aed74af73a488f8b691578ca370226 P edcc56ddd3264984b4da6c1db59e7f08: Bootstrap starting.
I20260709 12:24:16.343170 10750 catalog_manager.cc:5697] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 0 to 1, leader changed from <none> to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 1 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:16.349871 11045 tablet_bootstrap.cc:654] T d0aed74af73a488f8b691578ca370226 P edcc56ddd3264984b4da6c1db59e7f08: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:16.356134 11045 tablet_bootstrap.cc:492] T d0aed74af73a488f8b691578ca370226 P edcc56ddd3264984b4da6c1db59e7f08: No bootstrap required, opened a new log
I20260709 12:24:16.356686 11045 ts_tablet_manager.cc:1403] T d0aed74af73a488f8b691578ca370226 P edcc56ddd3264984b4da6c1db59e7f08: Time spent bootstrapping tablet: real 0.015s	user 0.014s	sys 0.000s
I20260709 12:24:16.364781 11045 raft_consensus.cc:359] T d0aed74af73a488f8b691578ca370226 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:16.365322 11525 consensus_queue.cc:1048] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:16.365597 11045 raft_consensus.cc:385] T d0aed74af73a488f8b691578ca370226 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:16.367228 11045 raft_consensus.cc:740] T d0aed74af73a488f8b691578ca370226 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Initialized, Role: FOLLOWER
I20260709 12:24:16.368043 11045 consensus_queue.cc:260] T d0aed74af73a488f8b691578ca370226 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:16.371202 11045 ts_tablet_manager.cc:1434] T d0aed74af73a488f8b691578ca370226 P edcc56ddd3264984b4da6c1db59e7f08: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:24:16.378070 10750 catalog_manager.cc:5697] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 0 to 1, leader changed from <none> to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 1 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:16.390280 11541 raft_consensus.cc:493] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:16.390800 11541 raft_consensus.cc:515] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:16.399102 11501 consensus_queue.cc:1048] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:16.400849 11541 leader_election.cc:290] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:16.401690 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b17195a94142039c40f598ed006c94" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:16.402405 10846 raft_consensus.cc:2468] T e8b17195a94142039c40f598ed006c94 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 0.
I20260709 12:24:16.403329 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b17195a94142039c40f598ed006c94" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:16.403637 10894 leader_election.cc:304] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:16.404026 11000 raft_consensus.cc:2468] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 0.
I20260709 12:24:16.404450 11541 raft_consensus.cc:2804] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:16.404807 11541 raft_consensus.cc:493] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:16.405113 11541 raft_consensus.cc:3060] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:16.420780 11541 raft_consensus.cc:515] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:16.423465 11541 leader_election.cc:290] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:16.424554 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b17195a94142039c40f598ed006c94" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:16.425200 10846 raft_consensus.cc:3060] T e8b17195a94142039c40f598ed006c94 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:16.434088 10846 raft_consensus.cc:2468] T e8b17195a94142039c40f598ed006c94 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 1.
I20260709 12:24:16.435667 10894 leader_election.cc:304] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:16.436594 11541 raft_consensus.cc:2804] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:16.437600 11541 raft_consensus.cc:697] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:16.438737 11541 consensus_queue.cc:237] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:16.445960 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b17195a94142039c40f598ed006c94" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:16.446758 11000 raft_consensus.cc:3060] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:16.452857 11519 consensus_queue.cc:1048] T dad6a1da21304fcfacab384a6afc4101 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:16.473536 11501 consensus_queue.cc:1048] T dad6a1da21304fcfacab384a6afc4101 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:16.475819 11000 raft_consensus.cc:2468] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 1.
I20260709 12:24:16.480763 10751 catalog_manager.cc:5697] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 0 to 1, leader changed from <none> to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 1 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:16.489537 11509 consensus_queue.cc:1048] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:16.515205 11509 consensus_queue.cc:1048] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:24:16.568580 11541 raft_consensus.cc:493] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:16.569104 11541 raft_consensus.cc:515] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:16.571368 11541 leader_election.cc:290] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:16.572235 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aed74af73a488f8b691578ca370226" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:16.572736 10848 raft_consensus.cc:2468] T d0aed74af73a488f8b691578ca370226 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 0.
I20260709 12:24:16.573648 10894 leader_election.cc:304] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:16.574250 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aed74af73a488f8b691578ca370226" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:16.574576 11541 raft_consensus.cc:2804] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:16.575466 11541 raft_consensus.cc:493] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:16.575927 11541 raft_consensus.cc:3060] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:16.574895 10995 raft_consensus.cc:2468] T d0aed74af73a488f8b691578ca370226 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 0.
I20260709 12:24:16.584311 11541 raft_consensus.cc:515] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:16.586447 11541 leader_election.cc:290] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:16.587205 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aed74af73a488f8b691578ca370226" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:16.587885 10848 raft_consensus.cc:3060] T d0aed74af73a488f8b691578ca370226 P 80cd7d227db44f34a6108591dad9c040 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:16.587963 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aed74af73a488f8b691578ca370226" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:16.588672 10995 raft_consensus.cc:3060] T d0aed74af73a488f8b691578ca370226 P edcc56ddd3264984b4da6c1db59e7f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:16.596506 10848 raft_consensus.cc:2468] T d0aed74af73a488f8b691578ca370226 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 1.
I20260709 12:24:16.598031 10894 leader_election.cc:304] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:16.598755 11541 raft_consensus.cc:2804] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:16.599212 11541 raft_consensus.cc:697] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:16.600040 11541 consensus_queue.cc:237] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:16.604138 10995 raft_consensus.cc:2468] T d0aed74af73a488f8b691578ca370226 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 1.
I20260709 12:24:16.613601 10750 catalog_manager.cc:5697] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 0 to 1, leader changed from <none> to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 1 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:16.811048 11525 consensus_queue.cc:1048] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:16.825083 11519 consensus_queue.cc:1048] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:16.828904 11539 consensus_queue.cc:1048] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:16.860077 11539 consensus_queue.cc:1048] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:16.862140 11499 consensus_queue.cc:1048] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:16.882707 11525 consensus_queue.cc:1048] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:17.111112 11496 consensus_queue.cc:1048] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:17.123803 11496 consensus_queue.cc:1048] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:18.529593  9681 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:24:18.567723 11578 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:18.567691 11580 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:18.570582 11577 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:18.572991  9681 server_base.cc:1061] running on GCE node
I20260709 12:24:18.574716  9681 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:24:18.575138  9681 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:24:18.575469  9681 hybrid_clock.cc:648] HybridClock initialized: now 1783599858575447 us; error 0 us; skew 500 ppm
I20260709 12:24:18.576267  9681 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:24:18.581678  9681 webserver.cc:533] Webserver started at http://127.9.116.68:40707/ using document root <none> and password file <none>
I20260709 12:24:18.583072  9681 fs_manager.cc:362] Metadata directory not provided
I20260709 12:24:18.583395  9681 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:24:18.584231  9681 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:24:18.586585  9681 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599781984018-9681-0/minicluster-data/ts-3-root/instance:
uuid: "3c52e0825c02476e89d84da9bb849f5d"
format_stamp: "Formatted at 2026-07-09 12:24:18 on dist-test-slave-zk51"
I20260709 12:24:18.594517  9681 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:24:18.599627 11585 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:18.601500  9681 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.000s	sys 0.003s
I20260709 12:24:18.601887  9681 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599781984018-9681-0/minicluster-data/ts-3-root
uuid: "3c52e0825c02476e89d84da9bb849f5d"
format_stamp: "Formatted at 2026-07-09 12:24:18 on dist-test-slave-zk51"
I20260709 12:24:18.602224  9681 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599781984018-9681-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599781984018-9681-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599781984018-9681-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:24:18.620782  9681 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:24:18.623001  9681 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:24:18.625259  9681 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:24:18.629454  9681 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:24:18.629769  9681 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:18.630338  9681 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:24:18.630638  9681 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:18.724423  9681 rpc_server.cc:307] RPC server started. Bound to: 127.9.116.68:37613
I20260709 12:24:18.724516 11648 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.116.68:37613 every 8 connection(s)
I20260709 12:24:18.730906  9681 auto_leader_rebalancer-test.cc:439] add a tserver: 3c52e0825c02476e89d84da9bb849f5d
I20260709 12:24:18.749903 11649 heartbeater.cc:344] Connected to a master server at 127.9.116.126:44563
I20260709 12:24:18.750491 11649 heartbeater.cc:461] Registering TS with master...
I20260709 12:24:18.751417 11649 heartbeater.cc:507] Master 127.9.116.126:44563 requested a full tablet report, sending...
I20260709 12:24:18.753612 10750 ts_manager.cc:194] Registered new tserver with Master: 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:24:18.755347 10750 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36188
I20260709 12:24:19.758107 11649 heartbeater.cc:499] Master 127.9.116.126:44563 was elected leader, sending a full tablet report...
I20260709 12:24:19.898228 10847 consensus_queue.cc:237] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:24:19.916695 10924 raft_consensus.cc:1275] T 5794ba618e514e28a7542ab6af39d8c9 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:24:19.919169 10995 raft_consensus.cc:1275] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:24:19.918941 11654 consensus_queue.cc:1048] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:19.923993 11460 consensus_queue.cc:1048] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:24:19.933890 10820 consensus_peers.cc:597] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 -> Peer 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613): Couldn't send request to peer 3c52e0825c02476e89d84da9bb849f5d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5794ba618e514e28a7542ab6af39d8c9. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:19.935273 11576 raft_consensus.cc:2955] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:24:19.937305 10924 raft_consensus.cc:2955] T 5794ba618e514e28a7542ab6af39d8c9 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:24:19.951475 10994 raft_consensus.cc:2955] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:24:19.959945 10750 catalog_manager.cc:5697] T 5794ba618e514e28a7542ab6af39d8c9 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: config changed from index -1 to 2, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New cstate: current_term: 1 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:24:20.001776 10924 consensus_queue.cc:237] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:24:20.015347 10847 raft_consensus.cc:1275] T d0aed74af73a488f8b691578ca370226 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:24:20.015834 10995 raft_consensus.cc:1275] T d0aed74af73a488f8b691578ca370226 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:24:20.020773 11496 consensus_queue.cc:1048] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:20.028559 11496 consensus_queue.cc:1048] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:20.044519 11597 raft_consensus.cc:2955] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:24:20.046881 10847 raft_consensus.cc:2955] T d0aed74af73a488f8b691578ca370226 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:24:20.076839 10847 consensus_queue.cc:237] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:24:20.077759 10752 catalog_manager.cc:5697] T d0aed74af73a488f8b691578ca370226 P 80cd7d227db44f34a6108591dad9c040 reported cstate change: config changed from index -1 to 2, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New cstate: current_term: 1 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
W20260709 12:24:20.090936 10895 consensus_peers.cc:597] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613): Couldn't send request to peer 3c52e0825c02476e89d84da9bb849f5d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d0aed74af73a488f8b691578ca370226. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:20.095821 10995 raft_consensus.cc:2955] T d0aed74af73a488f8b691578ca370226 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:24:20.117054 11000 raft_consensus.cc:1275] T 2ac8522e549a46e09593fa4c2e175557 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:24:20.119928 10820 consensus_peers.cc:597] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 -> Peer 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613): Couldn't send request to peer 3c52e0825c02476e89d84da9bb849f5d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2ac8522e549a46e09593fa4c2e175557. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:20.121131 11654 consensus_queue.cc:1048] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:20.125893 10924 raft_consensus.cc:1275] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:24:20.132222 11654 consensus_queue.cc:1048] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:20.147097 11460 raft_consensus.cc:2955] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:24:20.154191 10926 raft_consensus.cc:2955] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:24:20.154191 11000 raft_consensus.cc:2955] T 2ac8522e549a46e09593fa4c2e175557 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:24:20.166844 10847 consensus_queue.cc:237] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:24:20.169008 10751 catalog_manager.cc:5697] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 reported cstate change: config changed from index -1 to 2, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New cstate: current_term: 1 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:20.204754 10926 raft_consensus.cc:1275] T 352aa49c65194abbb863d7553a091f11 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:24:20.205551 11000 raft_consensus.cc:1275] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:24:20.206342 10820 consensus_peers.cc:597] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 -> Peer 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613): Couldn't send request to peer 3c52e0825c02476e89d84da9bb849f5d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 352aa49c65194abbb863d7553a091f11. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:20.206835 11654 consensus_queue.cc:1048] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:20.207782 11460 consensus_queue.cc:1048] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:20.218592 11676 raft_consensus.cc:2955] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:24:20.220817 10926 raft_consensus.cc:2955] T 352aa49c65194abbb863d7553a091f11 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:24:20.221364 11000 raft_consensus.cc:2955] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:24:20.238821 10751 catalog_manager.cc:5697] T 352aa49c65194abbb863d7553a091f11 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: config changed from index -1 to 2, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New cstate: current_term: 1 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:24:20.517174 11680 ts_tablet_manager.cc:933] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d: Initiating tablet copy from peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265)
I20260709 12:24:20.520867 11680 tablet_copy_client.cc:323] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Beginning tablet copy session from remote peer at address 127.9.116.65:46265
I20260709 12:24:20.535661 10864 tablet_copy_service.cc:140] P 80cd7d227db44f34a6108591dad9c040: Received BeginTabletCopySession request for tablet 5794ba618e514e28a7542ab6af39d8c9 from peer 3c52e0825c02476e89d84da9bb849f5d ({username='slave'} at 127.0.0.1:46480)
I20260709 12:24:20.536553 10864 tablet_copy_service.cc:161] P 80cd7d227db44f34a6108591dad9c040: Beginning new tablet copy session on tablet 5794ba618e514e28a7542ab6af39d8c9 from peer 3c52e0825c02476e89d84da9bb849f5d at {username='slave'} at 127.0.0.1:46480: session id = 3c52e0825c02476e89d84da9bb849f5d-5794ba618e514e28a7542ab6af39d8c9
I20260709 12:24:20.547128 10864 tablet_copy_source_session.cc:215] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:20.553601 11680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5794ba618e514e28a7542ab6af39d8c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:20.572098 11680 tablet_copy_client.cc:806] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:20.573511 11680 tablet_copy_client.cc:670] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:20.575291 11684 ts_tablet_manager.cc:933] T d0aed74af73a488f8b691578ca370226 P 3c52e0825c02476e89d84da9bb849f5d: Initiating tablet copy from peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:20.579032 11680 tablet_copy_client.cc:538] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:20.590507 11680 tablet_bootstrap.cc:492] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap starting.
I20260709 12:24:20.592495 11684 tablet_copy_client.cc:323] T d0aed74af73a488f8b691578ca370226 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Beginning tablet copy session from remote peer at address 127.9.116.66:39339
I20260709 12:24:20.618232 11687 ts_tablet_manager.cc:933] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d: Initiating tablet copy from peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265)
I20260709 12:24:20.627426 10939 tablet_copy_service.cc:140] P e2d5c637307a407ab688f5ccd6f0fcea: Received BeginTabletCopySession request for tablet d0aed74af73a488f8b691578ca370226 from peer 3c52e0825c02476e89d84da9bb849f5d ({username='slave'} at 127.0.0.1:50036)
I20260709 12:24:20.628166 10939 tablet_copy_service.cc:161] P e2d5c637307a407ab688f5ccd6f0fcea: Beginning new tablet copy session on tablet d0aed74af73a488f8b691578ca370226 from peer 3c52e0825c02476e89d84da9bb849f5d at {username='slave'} at 127.0.0.1:50036: session id = 3c52e0825c02476e89d84da9bb849f5d-d0aed74af73a488f8b691578ca370226
I20260709 12:24:20.630960 11680 tablet_bootstrap.cc:492] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:20.632023 11680 tablet_bootstrap.cc:492] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap complete.
I20260709 12:24:20.632728 11680 ts_tablet_manager.cc:1403] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d: Time spent bootstrapping tablet: real 0.043s	user 0.018s	sys 0.024s
I20260709 12:24:20.636592 10939 tablet_copy_source_session.cc:215] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:20.636723 11680 raft_consensus.cc:359] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:24:20.637691 11680 raft_consensus.cc:740] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Initialized, Role: LEARNER
I20260709 12:24:20.639012 11687 tablet_copy_client.cc:323] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Beginning tablet copy session from remote peer at address 127.9.116.65:46265
I20260709 12:24:20.638556 11680 consensus_queue.cc:260] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:24:20.641012 11684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0aed74af73a488f8b691578ca370226. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:20.640885 10864 tablet_copy_service.cc:140] P 80cd7d227db44f34a6108591dad9c040: Received BeginTabletCopySession request for tablet 2ac8522e549a46e09593fa4c2e175557 from peer 3c52e0825c02476e89d84da9bb849f5d ({username='slave'} at 127.0.0.1:46480)
I20260709 12:24:20.641579 10864 tablet_copy_service.cc:161] P 80cd7d227db44f34a6108591dad9c040: Beginning new tablet copy session on tablet 2ac8522e549a46e09593fa4c2e175557 from peer 3c52e0825c02476e89d84da9bb849f5d at {username='slave'} at 127.0.0.1:46480: session id = 3c52e0825c02476e89d84da9bb849f5d-2ac8522e549a46e09593fa4c2e175557
I20260709 12:24:20.649219 10864 tablet_copy_source_session.cc:215] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:20.652809 11680 ts_tablet_manager.cc:1434] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.002s
I20260709 12:24:20.653492 11687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ac8522e549a46e09593fa4c2e175557. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:20.667219 11684 tablet_copy_client.cc:806] T d0aed74af73a488f8b691578ca370226 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:20.667960 11684 tablet_copy_client.cc:670] T d0aed74af73a488f8b691578ca370226 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:20.676540 11684 tablet_copy_client.cc:538] T d0aed74af73a488f8b691578ca370226 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:20.678045 11687 tablet_copy_client.cc:806] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:20.679214 11687 tablet_copy_client.cc:670] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:20.695218 10864 tablet_copy_service.cc:342] P 80cd7d227db44f34a6108591dad9c040: Request end of tablet copy session 3c52e0825c02476e89d84da9bb849f5d-5794ba618e514e28a7542ab6af39d8c9 received from {username='slave'} at 127.0.0.1:46480
I20260709 12:24:20.695990 10864 tablet_copy_service.cc:434] P 80cd7d227db44f34a6108591dad9c040: ending tablet copy session 3c52e0825c02476e89d84da9bb849f5d-5794ba618e514e28a7542ab6af39d8c9 on tablet 5794ba618e514e28a7542ab6af39d8c9 with peer 3c52e0825c02476e89d84da9bb849f5d
I20260709 12:24:20.696969 11687 tablet_copy_client.cc:538] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:20.697036 11684 tablet_bootstrap.cc:492] T d0aed74af73a488f8b691578ca370226 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap starting.
I20260709 12:24:20.709138 11680 ts_tablet_manager.cc:933] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d: Initiating tablet copy from peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265)
I20260709 12:24:20.714761 11687 tablet_bootstrap.cc:492] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap starting.
I20260709 12:24:20.733007 11680 tablet_copy_client.cc:323] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Beginning tablet copy session from remote peer at address 127.9.116.65:46265
I20260709 12:24:20.735821 10864 tablet_copy_service.cc:140] P 80cd7d227db44f34a6108591dad9c040: Received BeginTabletCopySession request for tablet 352aa49c65194abbb863d7553a091f11 from peer 3c52e0825c02476e89d84da9bb849f5d ({username='slave'} at 127.0.0.1:46480)
I20260709 12:24:20.736403 10864 tablet_copy_service.cc:161] P 80cd7d227db44f34a6108591dad9c040: Beginning new tablet copy session on tablet 352aa49c65194abbb863d7553a091f11 from peer 3c52e0825c02476e89d84da9bb849f5d at {username='slave'} at 127.0.0.1:46480: session id = 3c52e0825c02476e89d84da9bb849f5d-352aa49c65194abbb863d7553a091f11
I20260709 12:24:20.773864 11684 tablet_bootstrap.cc:492] T d0aed74af73a488f8b691578ca370226 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:20.774789 10864 tablet_copy_source_session.cc:215] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:20.775337 11684 tablet_bootstrap.cc:492] T d0aed74af73a488f8b691578ca370226 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap complete.
I20260709 12:24:20.801499 11684 ts_tablet_manager.cc:1403] T d0aed74af73a488f8b691578ca370226 P 3c52e0825c02476e89d84da9bb849f5d: Time spent bootstrapping tablet: real 0.109s	user 0.045s	sys 0.011s
I20260709 12:24:20.809387 11684 raft_consensus.cc:359] T d0aed74af73a488f8b691578ca370226 P 3c52e0825c02476e89d84da9bb849f5d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:24:20.815099 11680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 352aa49c65194abbb863d7553a091f11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:20.821821 11684 raft_consensus.cc:740] T d0aed74af73a488f8b691578ca370226 P 3c52e0825c02476e89d84da9bb849f5d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Initialized, Role: LEARNER
I20260709 12:24:20.824357 11687 tablet_bootstrap.cc:492] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:20.828079 11687 tablet_bootstrap.cc:492] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap complete.
I20260709 12:24:20.829047 11687 ts_tablet_manager.cc:1403] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d: Time spent bootstrapping tablet: real 0.115s	user 0.048s	sys 0.028s
I20260709 12:24:20.822686 11684 consensus_queue.cc:260] T d0aed74af73a488f8b691578ca370226 P 3c52e0825c02476e89d84da9bb849f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:24:20.833235 11680 tablet_copy_client.cc:806] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:20.836145 11680 tablet_copy_client.cc:670] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:20.837653 11684 ts_tablet_manager.cc:1434] T d0aed74af73a488f8b691578ca370226 P 3c52e0825c02476e89d84da9bb849f5d: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260709 12:24:20.832971 11687 raft_consensus.cc:359] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:24:20.839407 11687 raft_consensus.cc:740] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Initialized, Role: LEARNER
I20260709 12:24:20.840386 10939 tablet_copy_service.cc:342] P e2d5c637307a407ab688f5ccd6f0fcea: Request end of tablet copy session 3c52e0825c02476e89d84da9bb849f5d-d0aed74af73a488f8b691578ca370226 received from {username='slave'} at 127.0.0.1:50036
I20260709 12:24:20.840312 11687 consensus_queue.cc:260] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:24:20.840906 10939 tablet_copy_service.cc:434] P e2d5c637307a407ab688f5ccd6f0fcea: ending tablet copy session 3c52e0825c02476e89d84da9bb849f5d-d0aed74af73a488f8b691578ca370226 on tablet d0aed74af73a488f8b691578ca370226 with peer 3c52e0825c02476e89d84da9bb849f5d
I20260709 12:24:20.843061 11687 ts_tablet_manager.cc:1434] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 12:24:20.846611 11680 tablet_copy_client.cc:538] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:20.850584 10864 tablet_copy_service.cc:342] P 80cd7d227db44f34a6108591dad9c040: Request end of tablet copy session 3c52e0825c02476e89d84da9bb849f5d-2ac8522e549a46e09593fa4c2e175557 received from {username='slave'} at 127.0.0.1:46480
I20260709 12:24:20.851137 10864 tablet_copy_service.cc:434] P 80cd7d227db44f34a6108591dad9c040: ending tablet copy session 3c52e0825c02476e89d84da9bb849f5d-2ac8522e549a46e09593fa4c2e175557 on tablet 2ac8522e549a46e09593fa4c2e175557 with peer 3c52e0825c02476e89d84da9bb849f5d
I20260709 12:24:20.872910 11680 tablet_bootstrap.cc:492] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap starting.
I20260709 12:24:20.909839 11680 tablet_bootstrap.cc:492] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:20.910792 11680 tablet_bootstrap.cc:492] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap complete.
I20260709 12:24:20.911456 11680 ts_tablet_manager.cc:1403] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d: Time spent bootstrapping tablet: real 0.039s	user 0.020s	sys 0.005s
I20260709 12:24:20.913969 11680 raft_consensus.cc:359] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:24:20.914669 11680 raft_consensus.cc:740] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Initialized, Role: LEARNER
I20260709 12:24:20.915316 11680 consensus_queue.cc:260] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:24:20.917557 11680 ts_tablet_manager.cc:1434] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 12:24:20.922783 10864 tablet_copy_service.cc:342] P 80cd7d227db44f34a6108591dad9c040: Request end of tablet copy session 3c52e0825c02476e89d84da9bb849f5d-352aa49c65194abbb863d7553a091f11 received from {username='slave'} at 127.0.0.1:46480
I20260709 12:24:20.923514 10864 tablet_copy_service.cc:434] P 80cd7d227db44f34a6108591dad9c040: ending tablet copy session 3c52e0825c02476e89d84da9bb849f5d-352aa49c65194abbb863d7553a091f11 on tablet 352aa49c65194abbb863d7553a091f11 with peer 3c52e0825c02476e89d84da9bb849f5d
I20260709 12:24:21.066845 11624 raft_consensus.cc:1217] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:24:21.133069 11624 raft_consensus.cc:1217] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:24:21.191670 11624 raft_consensus.cc:1217] T d0aed74af73a488f8b691578ca370226 P 3c52e0825c02476e89d84da9bb849f5d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:24:21.227950 11624 raft_consensus.cc:1217] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:24:21.514883 11576 raft_consensus.cc:1064] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040: attempting to promote NON_VOTER 3c52e0825c02476e89d84da9bb849f5d to VOTER
I20260709 12:24:21.517963 11576 consensus_queue.cc:237] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:21.526294 10924 raft_consensus.cc:1275] T 5794ba618e514e28a7542ab6af39d8c9 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:21.526391 10994 raft_consensus.cc:1275] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:21.526564 11624 raft_consensus.cc:1275] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d [term 1 LEARNER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:21.528719 11654 consensus_queue.cc:1048] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:21.530004 11576 consensus_queue.cc:1048] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:21.530974 11676 consensus_queue.cc:1048] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:21.585950 11672 raft_consensus.cc:1064] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea: attempting to promote NON_VOTER 3c52e0825c02476e89d84da9bb849f5d to VOTER
I20260709 12:24:21.589246 11672 consensus_queue.cc:237] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:21.597472 11576 raft_consensus.cc:2955] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:24:21.605139 10994 raft_consensus.cc:2955] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:24:21.616627 10926 raft_consensus.cc:2955] T 5794ba618e514e28a7542ab6af39d8c9 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:24:21.634459 11624 raft_consensus.cc:2955] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:24:21.654599 11623 raft_consensus.cc:1275] T d0aed74af73a488f8b691578ca370226 P 3c52e0825c02476e89d84da9bb849f5d [term 1 LEARNER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:21.657372 11654 raft_consensus.cc:1064] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040: attempting to promote NON_VOTER 3c52e0825c02476e89d84da9bb849f5d to VOTER
I20260709 12:24:21.658496 11691 consensus_queue.cc:1048] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:21.659920 11654 consensus_queue.cc:237] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:21.659116 10752 catalog_manager.cc:5697] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 reported cstate change: config changed from index 2 to 3, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:21.701406 10847 raft_consensus.cc:1275] T d0aed74af73a488f8b691578ca370226 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 12:24:21.706290 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 50068.1us
I20260709 12:24:21.713085 10994 raft_consensus.cc:1275] T d0aed74af73a488f8b691578ca370226 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:21.706101 11702 consensus_queue.cc:1048] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 12:24:21.730247 10924 raft_consensus.cc:1275] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:21.738183 11496 consensus_queue.cc:1048] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:21.740701 11654 consensus_queue.cc:1048] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:21.751253 11691 raft_consensus.cc:2955] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:24:21.753135 11624 raft_consensus.cc:2955] T d0aed74af73a488f8b691578ca370226 P 3c52e0825c02476e89d84da9bb849f5d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
W20260709 12:24:21.762980 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 53599.3us
I20260709 12:24:21.777173 10995 raft_consensus.cc:1275] T 2ac8522e549a46e09593fa4c2e175557 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:21.780099 11624 raft_consensus.cc:1275] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d [term 1 LEARNER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:21.786291 11576 consensus_queue.cc:1048] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:21.801076 11654 consensus_queue.cc:1048] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:21.806947 11576 raft_consensus.cc:1064] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040: attempting to promote NON_VOTER 3c52e0825c02476e89d84da9bb849f5d to VOTER
I20260709 12:24:21.810025 11576 consensus_queue.cc:237] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:21.810472 10995 raft_consensus.cc:2955] T d0aed74af73a488f8b691578ca370226 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:24:21.819619 10847 consensus_queue.cc:237] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:21.820925 10749 catalog_manager.cc:5697] T d0aed74af73a488f8b691578ca370226 P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: config changed from index 2 to 3, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:24:21.821256 10849 raft_consensus.cc:2955] T d0aed74af73a488f8b691578ca370226 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:24:21.828205 11623 raft_consensus.cc:1275] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d [term 1 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:24:21.829855 11000 raft_consensus.cc:1275] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:24:21.836125 11676 consensus_queue.cc:1048] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:21.838480 11676 consensus_queue.cc:1048] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:21.853351 11654 raft_consensus.cc:2955] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:24:21.870260 10925 consensus_queue.cc:237] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:21.877539 11623 raft_consensus.cc:1275] T d0aed74af73a488f8b691578ca370226 P 3c52e0825c02476e89d84da9bb849f5d [term 1 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:24:21.879328 11000 raft_consensus.cc:1275] T d0aed74af73a488f8b691578ca370226 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:24:21.881641 11623 raft_consensus.cc:2955] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:24:21.891434 10925 raft_consensus.cc:1275] T 352aa49c65194abbb863d7553a091f11 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:21.903128 11576 consensus_queue.cc:1048] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:21.909044 10750 catalog_manager.cc:5697] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: config changed from index 3 to 4, VOTER e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) evicted. New cstate: current_term: 1 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:24:21.912207 11705 consensus_queue.cc:1048] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:21.916930 11705 consensus_queue.cc:1048] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:21.901412 11676 raft_consensus.cc:2955] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:24:21.927929 10912 tablet_service.cc:1558] Processing DeleteTablet for tablet 5794ba618e514e28a7542ab6af39d8c9 with delete_type TABLET_DATA_TOMBSTONED (TS e2d5c637307a407ab688f5ccd6f0fcea not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59610
I20260709 12:24:21.948199 11706 raft_consensus.cc:2955] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:24:21.951046 11722 tablet_replica.cc:333] T 5794ba618e514e28a7542ab6af39d8c9 P e2d5c637307a407ab688f5ccd6f0fcea: stopping tablet replica
I20260709 12:24:21.957736 11623 raft_consensus.cc:2955] T d0aed74af73a488f8b691578ca370226 P 3c52e0825c02476e89d84da9bb849f5d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:24:21.964458 10738 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d0aed74af73a488f8b691578ca370226 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:21.959923 10994 raft_consensus.cc:2955] T d0aed74af73a488f8b691578ca370226 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:24:21.974398 11722 raft_consensus.cc:2243] T 5794ba618e514e28a7542ab6af39d8c9 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:21.976244 11722 raft_consensus.cc:2272] T 5794ba618e514e28a7542ab6af39d8c9 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:21.956635 10925 raft_consensus.cc:2955] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:24:21.989290 10751 catalog_manager.cc:5697] T d0aed74af73a488f8b691578ca370226 P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: config changed from index 3 to 4, VOTER 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) evicted. New cstate: current_term: 1 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
W20260709 12:24:21.998978 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 104499us
I20260709 12:24:22.002712 11623 raft_consensus.cc:1275] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [term 1 LEARNER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:22.005244 11000 raft_consensus.cc:2955] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:24:22.016471 11722 ts_tablet_manager.cc:1916] T 5794ba618e514e28a7542ab6af39d8c9 P e2d5c637307a407ab688f5ccd6f0fcea: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:22.007793 10994 raft_consensus.cc:1275] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:22.023980 10738 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5794ba618e514e28a7542ab6af39d8c9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:22.025835 10999 raft_consensus.cc:2955] T 2ac8522e549a46e09593fa4c2e175557 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:24:22.028018 10750 catalog_manager.cc:5697] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: config changed from index 2 to 3, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:24:22.051774 11722 ts_tablet_manager.cc:1929] T 5794ba618e514e28a7542ab6af39d8c9 P e2d5c637307a407ab688f5ccd6f0fcea: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:24:22.052454 11722 log.cc:1199] T 5794ba618e514e28a7542ab6af39d8c9 P e2d5c637307a407ab688f5ccd6f0fcea: Deleting WAL directory at /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599781984018-9681-0/minicluster-data/ts-1-root/wals/5794ba618e514e28a7542ab6af39d8c9
I20260709 12:24:22.054495 10738 catalog_manager.cc:5028] TS e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): tablet 5794ba618e514e28a7542ab6af39d8c9 (table test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]) successfully deleted
I20260709 12:24:22.059073 11676 consensus_queue.cc:1048] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:22.075179 11720 consensus_queue.cc:1048] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:24:22.113198 10835 tablet_service.cc:1558] Processing DeleteTablet for tablet d0aed74af73a488f8b691578ca370226 with delete_type TABLET_DATA_TOMBSTONED (TS 80cd7d227db44f34a6108591dad9c040 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56372
I20260709 12:24:22.118173 11727 tablet_replica.cc:333] T d0aed74af73a488f8b691578ca370226 P 80cd7d227db44f34a6108591dad9c040: stopping tablet replica
I20260709 12:24:22.119939 11623 raft_consensus.cc:2955] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:24:22.134033 11727 raft_consensus.cc:2243] T d0aed74af73a488f8b691578ca370226 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:22.138792 11725 raft_consensus.cc:2955] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:24:22.145386 10999 raft_consensus.cc:2955] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:24:22.148995 10849 consensus_queue.cc:237] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:22.162192 10924 raft_consensus.cc:1275] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:24:22.166289 11654 consensus_queue.cc:1048] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:22.168474 11727 raft_consensus.cc:2272] T d0aed74af73a488f8b691578ca370226 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:22.176640 11720 raft_consensus.cc:2955] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:24:22.185416 10926 raft_consensus.cc:2955] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:24:22.187950 11622 raft_consensus.cc:1275] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d [term 1 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:24:22.192301 11725 consensus_queue.cc:1048] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:22.195433 11624 raft_consensus.cc:2955] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:24:22.197897 10924 raft_consensus.cc:2955] T 352aa49c65194abbb863d7553a091f11 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:24:22.198091 11623 raft_consensus.cc:2955] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:24:22.185910 10750 catalog_manager.cc:5697] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: config changed from index 2 to 3, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:24:22.213783 10751 catalog_manager.cc:5697] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: config changed from index 3 to 4, VOTER edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) evicted. New cstate: current_term: 1 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:24:22.217794 11727 ts_tablet_manager.cc:1916] T d0aed74af73a488f8b691578ca370226 P 80cd7d227db44f34a6108591dad9c040: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:22.244556 10992 tablet_service.cc:1558] Processing DeleteTablet for tablet 2ac8522e549a46e09593fa4c2e175557 with delete_type TABLET_DATA_TOMBSTONED (TS edcc56ddd3264984b4da6c1db59e7f08 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37496
I20260709 12:24:22.260020 10738 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2ac8522e549a46e09593fa4c2e175557 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:22.304376 11730 tablet_replica.cc:333] T 2ac8522e549a46e09593fa4c2e175557 P edcc56ddd3264984b4da6c1db59e7f08: stopping tablet replica
I20260709 12:24:22.308579 11727 ts_tablet_manager.cc:1929] T d0aed74af73a488f8b691578ca370226 P 80cd7d227db44f34a6108591dad9c040: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:24:22.309177 11727 log.cc:1199] T d0aed74af73a488f8b691578ca370226 P 80cd7d227db44f34a6108591dad9c040: Deleting WAL directory at /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599781984018-9681-0/minicluster-data/ts-0-root/wals/d0aed74af73a488f8b691578ca370226
I20260709 12:24:22.311847 10738 catalog_manager.cc:5028] TS 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): tablet d0aed74af73a488f8b691578ca370226 (table test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]) successfully deleted
I20260709 12:24:22.318813 11730 raft_consensus.cc:2243] T 2ac8522e549a46e09593fa4c2e175557 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:22.319789 11730 raft_consensus.cc:2272] T 2ac8522e549a46e09593fa4c2e175557 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:22.323679 11730 ts_tablet_manager.cc:1916] T 2ac8522e549a46e09593fa4c2e175557 P edcc56ddd3264984b4da6c1db59e7f08: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:22.346115 11730 ts_tablet_manager.cc:1929] T 2ac8522e549a46e09593fa4c2e175557 P edcc56ddd3264984b4da6c1db59e7f08: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:24:22.346809 11730 log.cc:1199] T 2ac8522e549a46e09593fa4c2e175557 P edcc56ddd3264984b4da6c1db59e7f08: Deleting WAL directory at /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599781984018-9681-0/minicluster-data/ts-2-root/wals/2ac8522e549a46e09593fa4c2e175557
I20260709 12:24:22.349036 10739 catalog_manager.cc:5028] TS edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): tablet 2ac8522e549a46e09593fa4c2e175557 (table test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]) successfully deleted
I20260709 12:24:23.383018 11576 raft_consensus.cc:493] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:23.383756 11576 raft_consensus.cc:515] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:23.385809 11733 raft_consensus.cc:493] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:23.386178 11576 leader_election.cc:290] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:23.386454 11733 raft_consensus.cc:515] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } }
I20260709 12:24:23.387333 11734 raft_consensus.cc:493] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:23.389118 11734 raft_consensus.cc:515] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:23.390898 11733 leader_election.cc:290] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:23.393648 11734 leader_election.cc:290] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:23.394939 11737 raft_consensus.cc:493] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:23.395488 11737 raft_consensus.cc:515] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:23.399931 11737 leader_election.cc:290] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:23.402667 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5794ba618e514e28a7542ab6af39d8c9" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
W20260709 12:24:23.481611 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 65405.6us
I20260709 12:24:23.484838 11708 raft_consensus.cc:493] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:23.486433 11708 raft_consensus.cc:515] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:23.491194 11708 leader_election.cc:290] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:23.493026 11726 raft_consensus.cc:493] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:23.494468 11723 raft_consensus.cc:493] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:23.495157 11726 raft_consensus.cc:515] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:23.498628 11723 raft_consensus.cc:515] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } }
I20260709 12:24:23.505555 11723 leader_election.cc:290] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265)
I20260709 12:24:23.509491 11726 leader_election.cc:290] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:23.542932 11735 raft_consensus.cc:493] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:23.544011 11735 raft_consensus.cc:515] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:23.549177 11653 raft_consensus.cc:493] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:23.559952 11653 raft_consensus.cc:515] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:23.562670 11653 leader_election.cc:290] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:23.552513 11732 raft_consensus.cc:493] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:23.555768 11708 raft_consensus.cc:493] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:23.564229 11732 raft_consensus.cc:515] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:23.555150 11501 raft_consensus.cc:493] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:23.572412 11739 raft_consensus.cc:493] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:23.572772 11708 raft_consensus.cc:515] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:23.577123 11708 leader_election.cc:290] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:23.579010 11501 raft_consensus.cc:515] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:23.581807 11501 leader_election.cc:290] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:23.573674 11739 raft_consensus.cc:515] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:23.578190 11708 raft_consensus.cc:493] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:23.547562 11735 leader_election.cc:290] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:24:23.590147 11702 raft_consensus.cc:493] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:23.601843 11708 raft_consensus.cc:515] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:23.602152 11702 raft_consensus.cc:515] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:23.604669 11708 leader_election.cc:290] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:23.604782 11702 leader_election.cc:290] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:23.590967 11496 raft_consensus.cc:493] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:23.605702 11496 raft_consensus.cc:515] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:23.610358 10783 debug-util.cc:398] Leaking SignalData structure 0x7b0800035040 after lost signal to thread 9684
W20260709 12:24:23.613188 10783 debug-util.cc:398] Leaking SignalData structure 0x7b0800035720 after lost signal to thread 10786
I20260709 12:24:23.618577 11734 raft_consensus.cc:493] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:23.633522 11733 raft_consensus.cc:493] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:23.634567 11733 raft_consensus.cc:515] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:23.635720 11496 leader_election.cc:290] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:23.637146 11733 leader_election.cc:290] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:23.623415 11734 raft_consensus.cc:515] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:23.638615 11732 leader_election.cc:290] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:23.640889 11734 leader_election.cc:290] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:23.642083 11740 raft_consensus.cc:493] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:23.643885 11740 raft_consensus.cc:515] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:23.669658 11736 raft_consensus.cc:493] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:23.669659 11654 raft_consensus.cc:493] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:23.676352 11653 raft_consensus.cc:493] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:23.663720 11741 raft_consensus.cc:493] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:23.656337 11708 raft_consensus.cc:493] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:23.661871 11732 raft_consensus.cc:493] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
W20260709 12:24:23.684842 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 85351.4us
I20260709 12:24:23.670710 11736 raft_consensus.cc:515] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:23.683884 11653 raft_consensus.cc:515] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:23.664048 11726 raft_consensus.cc:493] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:23.677428 11723 raft_consensus.cc:493] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:23.676035 11702 raft_consensus.cc:493] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
W20260709 12:24:23.685637 10783 debug-util.cc:398] Leaking SignalData structure 0x7b08002e6a60 after lost signal to thread 10878
I20260709 12:24:23.690354 11742 raft_consensus.cc:493] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
W20260709 12:24:23.681313 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 106522us
I20260709 12:24:23.682730 11691 raft_consensus.cc:493] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:23.677273 11735 raft_consensus.cc:493] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
W20260709 12:24:23.695843 10783 debug-util.cc:398] Leaking SignalData structure 0x7b0800252420 after lost signal to thread 10879
I20260709 12:24:23.702167 11653 leader_election.cc:290] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:23.678767 11654 raft_consensus.cc:515] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:23.702617 11653 raft_consensus.cc:493] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:23.710552 11708 raft_consensus.cc:515] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:23.705340 11726 raft_consensus.cc:515] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:23.714459 11708 leader_election.cc:290] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:23.714831 11726 leader_election.cc:290] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:23.714987 11734 raft_consensus.cc:493] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:23.715852 11743 raft_consensus.cc:493] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:23.718286 11740 leader_election.cc:290] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:23.720829 11732 raft_consensus.cc:515] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:23.722223 11733 raft_consensus.cc:493] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:23.723097 11733 raft_consensus.cc:515] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:23.725622 10892 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.994s	user 0.004s	sys 0.008s
W20260709 12:24:23.726138 10892 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.018s	user 0.004s	sys 0.008s
I20260709 12:24:23.726653 11733 leader_election.cc:290] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:23.691179 11741 raft_consensus.cc:515] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:23.701372 11737 raft_consensus.cc:493] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:23.717813 11743 raft_consensus.cc:515] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:23.715711 11735 raft_consensus.cc:515] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:23.710085 11723 raft_consensus.cc:515] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:23.701488 11691 raft_consensus.cc:515] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:23.715453 11726 raft_consensus.cc:493] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:23.710289 11702 raft_consensus.cc:515] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:23.715929 11734 raft_consensus.cc:515] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:23.740211 11737 raft_consensus.cc:515] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:23.735263 11740 raft_consensus.cc:493] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:23.764810 11653 raft_consensus.cc:515] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:23.754305 11496 raft_consensus.cc:493] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:23.770814 10752 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60730 (request call id 124) took 1509 ms. Trace:
I20260709 12:24:23.772424 11743 leader_election.cc:290] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:23.773919 11726 raft_consensus.cc:515] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:23.775559 11691 leader_election.cc:290] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:23.766486 11733 raft_consensus.cc:493] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:23.777624 11726 leader_election.cc:290] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:23.777989 11733 raft_consensus.cc:515] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:23.767448 11501 raft_consensus.cc:493] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:23.781107 11501 raft_consensus.cc:515] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:23.783900 11740 raft_consensus.cc:515] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:23.786347 11740 leader_election.cc:290] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:23.787875 11576 raft_consensus.cc:493] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:23.787132 11496 raft_consensus.cc:515] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:23.788661 11576 raft_consensus.cc:515] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:23.796550 11653 leader_election.cc:290] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:23.791232 11496 leader_election.cc:290] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:24:23.791484 11576 leader_election.cc:290] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:23.763015 11737 leader_election.cc:290] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:23.820173 11501 leader_election.cc:290] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:23.822218 11748 raft_consensus.cc:493] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:23.802374 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352aa49c65194abbb863d7553a091f11" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:23.827888 11702 leader_election.cc:290] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:23.828851 11706 raft_consensus.cc:493] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:23.803670 11720 raft_consensus.cc:493] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:23.829089 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c913e527ff46578e084c41eab7bb9d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:23.829535 11706 raft_consensus.cc:515] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:23.830344 11733 leader_election.cc:290] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:23.830050 11720 raft_consensus.cc:515] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:23.824049 11737 raft_consensus.cc:493] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
W20260709 12:24:23.813563 10783 debug-util.cc:398] Leaking SignalData structure 0x7b08002e6b60 after lost signal to thread 10953
I20260709 12:24:23.831377 11737 raft_consensus.cc:515] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:24:23.831907 10783 debug-util.cc:398] Leaking SignalData structure 0x7b0800143a20 after lost signal to thread 10954
I20260709 12:24:23.832969 11735 leader_election.cc:290] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:23.831931 10751 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36188 (request call id 19) took 1557 ms. Trace:
I20260709 12:24:23.833819 10751 rpcz_store.cc:276] 0709 12:24:22.255670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.293908 (+ 38238us) service_pool.cc:224] Handling call
0709 12:24:23.677161 (+1383253us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b540007b554. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df2090 00007f7594e90f3a 00007f759ac46e9c 00007f759ad4504e 00007f75992062a4 00007f7599206232 00007f7599206161 00007f75992060dc 00007f7599205392 00007f75931c348c 00007f75931c28c6
0709 12:24:23.813267 (+136106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47062,"reported_tablets":1,"spinlock_wait_cycles":2381420800}
W20260709 12:24:23.834967 10783 debug-util.cc:398] Leaking SignalData structure 0x7b0800305900 after lost signal to thread 11648
W20260709 12:24:23.835328 10783 debug-util.cc:398] Leaking SignalData structure 0x7b08003058c0 after lost signal to thread 11649
I20260709 12:24:23.802299 11725 raft_consensus.cc:493] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:23.836369 11706 leader_election.cc:290] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:23.796618 11732 leader_election.cc:290] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:23.772095 10752 rpcz_store.cc:276] 0709 12:24:22.261280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.261883 (+   603us) service_pool.cc:224] Handling call
0709 12:24:23.770485 (+1508602us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2330,"reported_tablets":1}
I20260709 12:24:23.814394 11740 raft_consensus.cc:493] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:23.739820 11742 raft_consensus.cc:515] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:23.850207 11501 raft_consensus.cc:493] T 3f8a389131ef4c77a3e08488aa4759eb P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:23.855026 10750 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60734 (request call id 127) took 1565 ms. Trace:
I20260709 12:24:23.854717 11725 raft_consensus.cc:515] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:23.855471 10750 rpcz_store.cc:276] 0709 12:24:22.280750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.289045 (+  8295us) service_pool.cc:224] Handling call
0709 12:24:23.676200 (+1387155us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b540007b554. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df2090 00007f7594e90f3a 00007f759ac46e9c 00007f759ad4504e 00007f75992062a4 00007f7599206232 00007f7599206161 00007f75992060dc 00007f7599205392 00007f75931c348c 00007f75931c28c6
0709 12:24:23.845850 (+169650us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47692,"reported_tablets":1,"spinlock_wait_cycles":2380630400}
I20260709 12:24:23.857267 11725 leader_election.cc:290] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:23.857432 11501 raft_consensus.cc:515] T 3f8a389131ef4c77a3e08488aa4759eb P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:23.858114 11737 leader_election.cc:290] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:23.859457 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:23.844463 11739 leader_election.cc:290] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:23.861395 11739 raft_consensus.cc:493] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:23.861531 11743 raft_consensus.cc:493] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:23.862025 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:23.862149 11743 raft_consensus.cc:515] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:23.857810 11654 leader_election.cc:290] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:23.864185 11720 leader_election.cc:290] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:23.878492 11743 leader_election.cc:290] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:23.879186 11501 leader_election.cc:290] T 3f8a389131ef4c77a3e08488aa4759eb P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:23.878553 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:23.881735 11653 raft_consensus.cc:493] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:23.881768 11732 raft_consensus.cc:493] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:23.884325 11706 raft_consensus.cc:493] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:23.884720 11732 raft_consensus.cc:515] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:23.885088 11706 raft_consensus.cc:515] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:23.885752 11653 raft_consensus.cc:515] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:23.887382 11706 leader_election.cc:290] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:23.887526 11653 leader_election.cc:290] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:23.892184 11734 leader_election.cc:290] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:23.868007 11726 raft_consensus.cc:493] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:23.896968 11743 raft_consensus.cc:493] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:23.901703 11726 raft_consensus.cc:515] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:23.902094 11743 raft_consensus.cc:515] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:23.862150 11739 raft_consensus.cc:515] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:23.904124 11740 raft_consensus.cc:515] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:23.905747 11739 leader_election.cc:290] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:23.823251 11748 raft_consensus.cc:515] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:23.887465 11732 leader_election.cc:290] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:23.912420 11747 raft_consensus.cc:493] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:23.921983 11748 leader_election.cc:290] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:23.897691 11741 leader_election.cc:290] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:23.921051 11723 leader_election.cc:290] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:23.929364 11751 raft_consensus.cc:493] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:23.930390 11743 leader_election.cc:290] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:23.916473 11739 raft_consensus.cc:493] T 69fd8fdac2fa449e9e184f3d668ea1a7 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:23.940280 11750 raft_consensus.cc:493] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:23.940943 11749 raft_consensus.cc:493] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:23.922350 11747 raft_consensus.cc:515] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:23.962884 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:23.947465 11742 leader_election.cc:290] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:23.953701 11653 raft_consensus.cc:493] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:23.959805 11736 leader_election.cc:290] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:23.954999 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac8522e549a46e09593fa4c2e175557" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:23.962538 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5794ba618e514e28a7542ab6af39d8c9" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:23.954260 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:23.948212 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352aa49c65194abbb863d7553a091f11" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:23.952078 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:23.930924 11751 raft_consensus.cc:515] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:23.961651 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:23.961841 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:23.959899 11737 raft_consensus.cc:493] T d0aed74af73a488f8b691578ca370226 P 3c52e0825c02476e89d84da9bb849f5d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:24.137599 11496 raft_consensus.cc:493] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
W20260709 12:24:24.096175 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 51963.4us
I20260709 12:24:24.090431 11501 raft_consensus.cc:493] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:23.993659 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:24.147202 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:24.146262 11496 raft_consensus.cc:515] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:24.148373 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac8522e549a46e09593fa4c2e175557" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:24.150496 11496 leader_election.cc:290] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:23.957185 11740 leader_election.cc:290] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:24.123896 11726 leader_election.cc:290] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:24.164976 11653 raft_consensus.cc:515] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:23.956461 11753 raft_consensus.cc:493] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:23.992628 11702 raft_consensus.cc:493] T 352aa49c65194abbb863d7553a091f11 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:23.953505 11723 raft_consensus.cc:493] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:24.178557 11702 raft_consensus.cc:515] T 352aa49c65194abbb863d7553a091f11 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:24.179067 11723 raft_consensus.cc:515] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:24.180240 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:24.181185 11723 leader_election.cc:290] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:24.181524 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:24.158370 11737 raft_consensus.cc:515] T d0aed74af73a488f8b691578ca370226 P 3c52e0825c02476e89d84da9bb849f5d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:24.163914 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:24.164649 11496 raft_consensus.cc:493] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:24.168634 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:24.095750 11706 raft_consensus.cc:493] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:24.082993 11739 raft_consensus.cc:515] T 69fd8fdac2fa449e9e184f3d668ea1a7 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:23.993786 11741 raft_consensus.cc:493] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:24.038911 11732 raft_consensus.cc:493] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:24.037632 11735 raft_consensus.cc:493] T a6a28416571247df878823d464c05f1e P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:23.993031 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac8522e549a46e09593fa4c2e175557" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:24.186394 11501 raft_consensus.cc:515] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:24.183319 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:24.186023 10995 raft_consensus.cc:2468] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 1.
I20260709 12:24:24.191908 11741 raft_consensus.cc:515] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:24.188412 11726 raft_consensus.cc:493] T d0aed74af73a488f8b691578ca370226 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:24.185055 10925 raft_consensus.cc:2468] T 352aa49c65194abbb863d7553a091f11 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 1.
I20260709 12:24:24.039727 11754 raft_consensus.cc:493] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:24.097213 11743 raft_consensus.cc:493] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:24.170179 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:24.039979 11749 raft_consensus.cc:515] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:24.183818 11753 raft_consensus.cc:515] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:24.190164 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:24.188921 11706 raft_consensus.cc:515] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:24.191761 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:24.164390 11740 raft_consensus.cc:493] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:24.192384 11496 raft_consensus.cc:515] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:24.193442 11653 leader_election.cc:290] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:24.181555 11702 leader_election.cc:290] T 352aa49c65194abbb863d7553a091f11 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:24:24.187552 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:24.195941 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:24.040166 11750 raft_consensus.cc:515] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:24.345709 11691 raft_consensus.cc:493] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:24.348165 11691 raft_consensus.cc:515] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:24.348464 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad766f48812a4ddeb383179b1d84907b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
W20260709 12:24:24.330442 10895 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.014s	sys 0.034s
I20260709 12:24:24.205248 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:24.193007 10922 raft_consensus.cc:2468] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 1.
I20260709 12:24:24.214756 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:24.353897 11691 leader_election.cc:290] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:24:24.356792 10895 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.015s	sys 0.035s
W20260709 12:24:24.361284 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 652455us
I20260709 12:24:24.226640 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:24.363185 10923 raft_consensus.cc:2468] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 1.
I20260709 12:24:24.245566 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:24.352663 10927 raft_consensus.cc:2468] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 1.
I20260709 12:24:24.241734 11748 raft_consensus.cc:493] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:24.274160 11737 leader_election.cc:290] T d0aed74af73a488f8b691578ca370226 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:24.369319 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:24.232538 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:24.268815 11739 leader_election.cc:290] T 69fd8fdac2fa449e9e184f3d668ea1a7 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:24.241531 11747 leader_election.cc:290] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:24.374099 11501 leader_election.cc:290] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:24.372648 10924 raft_consensus.cc:2468] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 1.
I20260709 12:24:24.265869 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:24.242157 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:24.225240 11735 raft_consensus.cc:515] T a6a28416571247df878823d464c05f1e P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:24.360658 10929 raft_consensus.cc:2468] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 1.
I20260709 12:24:24.379509 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fd8fdac2fa449e9e184f3d668ea1a7" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:24.379297 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c913e527ff46578e084c41eab7bb9d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:24.345288 11732 raft_consensus.cc:515] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:24.383906 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:24.362763 10852 consensus_queue.cc:237] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:24.386862 10924 raft_consensus.cc:2468] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 1.
I20260709 12:24:24.388422 11496 leader_election.cc:290] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:24.389986 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c6d38c4d8a90a81975a6a0cb13" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:24.370378 10920 raft_consensus.cc:2468] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 1.
I20260709 12:24:24.394577 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:24.364897 11726 raft_consensus.cc:515] T d0aed74af73a488f8b691578ca370226 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:24.355427 11754 raft_consensus.cc:515] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:24.368204 11743 raft_consensus.cc:515] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:24.395714 11706 leader_election.cc:290] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:24.399070 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c913e527ff46578e084c41eab7bb9d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:24.395881 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aed74af73a488f8b691578ca370226" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:24.405891 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:24.406885 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:24.376168 11740 raft_consensus.cc:515] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:24.409770 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac8522e549a46e09593fa4c2e175557" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:24:24.396052 11588 leader_election.cc:304] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:24.411427 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:24.412393 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:24.412674 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
W20260709 12:24:24.394170 10817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:24.413623 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9331e5342644ca2bae19187b083a7d5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:24.416704 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:24.419338 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:24.417686 10924 raft_consensus.cc:2468] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 1.
I20260709 12:24:24.427210 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:24.431715 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:24.397243 11748 raft_consensus.cc:515] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:24.440831 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:24.441874 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352aa49c65194abbb863d7553a091f11" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:24.448108 11496 raft_consensus.cc:493] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:24.489169 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:24.490062 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:24.495314 11496 raft_consensus.cc:515] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:24.427951 10998 raft_consensus.cc:2468] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 1.
I20260709 12:24:24.439307 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6a1da21304fcfacab384a6afc4101" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:24.504261 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:24.504539 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:24.441393 11747 raft_consensus.cc:493] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:24.442202 11753 leader_election.cc:290] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:24.491312 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:24.440143 11761 raft_consensus.cc:493] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:24.514472 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c6d38c4d8a90a81975a6a0cb13" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:24.514643 11761 raft_consensus.cc:515] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:24.515201 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:24:24.515736 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 222272us
I20260709 12:24:24.516010 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:24.516426 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6a1da21304fcfacab384a6afc4101" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:24.517068 11761 leader_election.cc:290] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:24.445556 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:24.520924 11496 leader_election.cc:290] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:24.521497 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:24.522154 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:24.522853 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:24.522982 10999 raft_consensus.cc:2468] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 1.
I20260709 12:24:24.525658 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef3220c51df47db8859f07ab745fad5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:24.441495 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
W20260709 12:24:24.492129 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 104041us
I20260709 12:24:24.528224 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fd8fdac2fa449e9e184f3d668ea1a7" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:24.529981 11743 leader_election.cc:290] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:24.441125 11749 leader_election.cc:290] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:24.452203 11741 leader_election.cc:290] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:24.532146 11748 leader_election.cc:290] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:24.443346 11750 leader_election.cc:290] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:24.536072 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:24:24.498975 10817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:24.513029 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:24.513161 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:24.513790 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:24.492484 11737 raft_consensus.cc:2749] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:24.528443 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352aa49c65194abbb863d7553a091f11" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:24:24.547451 10922 raft_consensus.cc:2468] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 1.
I20260709 12:24:24.550179 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:24.551524 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:24.552428 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:24.552697 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:24.553776 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352aa49c65194abbb863d7553a091f11" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:24.517865 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:24.569227 11726 leader_election.cc:290] T d0aed74af73a488f8b691578ca370226 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:24:24.440203 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:24.528975 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:24.442229 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:24.530316 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:24.578413 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:24.579335 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:24.545547 11751 leader_election.cc:290] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:24.545791 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:24.545924 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18294423a68a4671bf6c5a0f98645e4c" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:24.528172 11747 raft_consensus.cc:515] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:24.536738 10926 raft_consensus.cc:2468] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 1.
I20260709 12:24:24.579485 10920 raft_consensus.cc:2468] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 1.
I20260709 12:24:24.601432 11754 leader_election.cc:290] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:24.616642 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:24.617427 10928 raft_consensus.cc:2468] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 1.
I20260709 12:24:24.615412 11740 leader_election.cc:290] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:24.618566 11732 leader_election.cc:290] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:24.620065 11624 raft_consensus.cc:1275] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [term 1 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:24:24.623519 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:24.624964 11735 leader_election.cc:290] T a6a28416571247df878823d464c05f1e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:24.630820 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad766f48812a4ddeb383179b1d84907b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:24.632423 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63ecfc9bd3945818cfe15c03f001315" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:24.632802 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:24.633143 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:24.633826 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:24.633906 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fd8fdac2fa449e9e184f3d668ea1a7" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:24.634872 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:24.635936 10995 raft_consensus.cc:1275] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:24:24.631265 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:24.636917 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:24.637202 11747 leader_election.cc:290] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:24.637718 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:24.639323 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:24.640276 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:24.663038 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aed74af73a488f8b691578ca370226" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:24.650251 10847 raft_consensus.cc:2468] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 1.
I20260709 12:24:24.642417 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b17195a94142039c40f598ed006c94" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:24.663026 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352aa49c65194abbb863d7553a091f11" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:24.672765 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:24.673393 11589 leader_election.cc:304] T d0aed74af73a488f8b691578ca370226 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:24.675100 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5794ba618e514e28a7542ab6af39d8c9" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:24.655944 11732 raft_consensus.cc:493] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:24.676419 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:24.676523 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:24.676688 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9331e5342644ca2bae19187b083a7d5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:24.657557 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:24.678803 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aed74af73a488f8b691578ca370226" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:24:24.679288 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:24.679677 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5794ba618e514e28a7542ab6af39d8c9" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:24:24.679221 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:24.679437 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:24.680485 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad766f48812a4ddeb383179b1d84907b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:24.680787 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac83709373b4efd9c3aa1472a9f9022" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:24.681010 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:24.681911 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:24.658782 11002 raft_consensus.cc:2468] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 1.
I20260709 12:24:24.692802 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c913e527ff46578e084c41eab7bb9d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:24.718878 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:24.720212 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:24.721372 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac83709373b4efd9c3aa1472a9f9022" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:24.693773 11737 raft_consensus.cc:2749] T d0aed74af73a488f8b691578ca370226 P 3c52e0825c02476e89d84da9bb849f5d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:24.722523 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:24.695262 11732 raft_consensus.cc:515] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:24.723989 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18294423a68a4671bf6c5a0f98645e4c" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:24.725296 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef3220c51df47db8859f07ab745fad5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:24.725884 11732 leader_election.cc:290] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:24.726504 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fd8fdac2fa449e9e184f3d668ea1a7" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:24.726598 11623 raft_consensus.cc:2468] T d0aed74af73a488f8b691578ca370226 P 3c52e0825c02476e89d84da9bb849f5d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 1.
I20260709 12:24:24.727910 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:24.729084 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:24.730279 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:24.695703 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aed74af73a488f8b691578ca370226" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:24.730724 10969 leader_election.cc:304] T d0aed74af73a488f8b691578ca370226 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:24.731483 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63ecfc9bd3945818cfe15c03f001315" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:24.732219 11740 raft_consensus.cc:2804] T d0aed74af73a488f8b691578ca370226 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:24.732545 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:24.732605 11740 raft_consensus.cc:493] T d0aed74af73a488f8b691578ca370226 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:24.733141 11740 raft_consensus.cc:3060] T d0aed74af73a488f8b691578ca370226 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:24.733670 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:24.696332 11589 leader_election.cc:304] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:24.697479 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:24.736599 11589 leader_election.cc:304] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:24.697569 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:24.698523 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b17195a94142039c40f598ed006c94" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:24.699429 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:24.706453 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:24.731374 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:24.689549 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:24.705153 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:24.697047 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:24.699376 10920 raft_consensus.cc:2468] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 1.
I20260709 12:24:24.737799 11737 raft_consensus.cc:2749] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:24.716681 10820 leader_election.cc:304] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:24.746117 11737 raft_consensus.cc:2749] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:24.711810 10819 leader_election.cc:304] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:24.748430 11736 raft_consensus.cc:2749] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:24.748910 10819 leader_election.cc:304] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:24.749362 11736 raft_consensus.cc:2804] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:24.750144 11736 raft_consensus.cc:493] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:24.750334 10819 leader_election.cc:304] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:24.750677 11736 raft_consensus.cc:3060] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:24.699851 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:24.701273 10895 leader_election.cc:304] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:24.752784 11732 raft_consensus.cc:2749] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:24.753487 11720 raft_consensus.cc:2804] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:24:24.753851 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 52671.7us
I20260709 12:24:24.754185 11720 raft_consensus.cc:493] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:24.754804 11720 raft_consensus.cc:3060] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:24.754848 10895 leader_election.cc:304] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:24.755957 11732 raft_consensus.cc:2749] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:24.757385 10895 leader_election.cc:304] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:24.758317 11732 raft_consensus.cc:2749] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:24.759953 11748 raft_consensus.cc:2804] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:24.760625 11748 raft_consensus.cc:493] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:24.761132 11748 raft_consensus.cc:3060] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:24.763880 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 47397.6us
I20260709 12:24:24.760039 10895 leader_election.cc:304] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:24.775144 11732 raft_consensus.cc:2749] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:24.776582 10895 leader_election.cc:304] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:24.782049 10968 leader_election.cc:304] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040
I20260709 12:24:24.778914 10819 leader_election.cc:304] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:24.783931 11732 raft_consensus.cc:2749] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:24.784837 10895 leader_election.cc:304] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:24.785359 11735 raft_consensus.cc:2749] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:24.789166 11734 raft_consensus.cc:2804] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:24.786906 10820 leader_election.cc:304] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:24.789774 11734 raft_consensus.cc:493] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:24.790314 11766 raft_consensus.cc:2804] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:24.790760 11734 raft_consensus.cc:3060] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:24.791160 11766 raft_consensus.cc:493] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:24.791582 11766 raft_consensus.cc:3060] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:24.791923 11732 raft_consensus.cc:2749] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:24.793465 10819 leader_election.cc:304] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:24.793964 10895 leader_election.cc:304] T 352aa49c65194abbb863d7553a091f11 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:24.801651 11736 raft_consensus.cc:515] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:24.808961 11732 raft_consensus.cc:2749] T 352aa49c65194abbb863d7553a091f11 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:24.810669 11736 leader_election.cc:290] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:24.816354 10895 leader_election.cc:304] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:24.822072 10895 leader_election.cc:304] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:24:24.820551 10819 leader_election.cc:304] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:24.822793 11732 raft_consensus.cc:2749] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:24.823508 10819 leader_election.cc:304] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:24.823961 11736 raft_consensus.cc:2804] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:24.825016 11747 raft_consensus.cc:2804] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:24.825464 11747 raft_consensus.cc:493] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:24.825551 10895 leader_election.cc:304] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:24.826828 10895 leader_election.cc:304] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:24:24.825309 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 88825us
I20260709 12:24:24.824550 11736 raft_consensus.cc:493] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:24.831887 10895 leader_election.cc:304] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:24.832554 11768 raft_consensus.cc:2749] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:24.842854 11734 raft_consensus.cc:515] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:24.843739 11736 raft_consensus.cc:3060] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:24.845101 11734 leader_election.cc:290] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:24.845798 11734 raft_consensus.cc:2804] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:24.846199 11734 raft_consensus.cc:493] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:24.846660 11734 raft_consensus.cc:3060] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:24.847834 11705 raft_consensus.cc:2749] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:24.833377 11754 raft_consensus.cc:2749] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:24.848773 11720 raft_consensus.cc:515] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:24.851187 11720 leader_election.cc:290] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:24.853679 11740 raft_consensus.cc:515] T d0aed74af73a488f8b691578ca370226 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:24.830104 11732 raft_consensus.cc:2749] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:24.827637 11747 raft_consensus.cc:3060] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:24.853861 11748 raft_consensus.cc:515] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:24.866449 11748 leader_election.cc:290] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:24.864820 10895 leader_election.cc:304] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
W20260709 12:24:24.868299 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 43714.6us
I20260709 12:24:24.870322 10819 leader_election.cc:304] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:24.871115 11748 raft_consensus.cc:2804] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:24.870946 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aed74af73a488f8b691578ca370226" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:24:24.871531 11748 raft_consensus.cc:493] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:24.872011 11748 raft_consensus.cc:3060] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:24.872166 11732 raft_consensus.cc:2804] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:24.872614 11732 raft_consensus.cc:493] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:24.873106 11732 raft_consensus.cc:3060] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:24.872040 11623 raft_consensus.cc:3060] T d0aed74af73a488f8b691578ca370226 P 3c52e0825c02476e89d84da9bb849f5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:24.864563 11766 raft_consensus.cc:515] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:24.881516 11736 raft_consensus.cc:515] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:24.882225 11766 leader_election.cc:290] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:24.882632 10820 leader_election.cc:304] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:24.873992 11740 leader_election.cc:290] T d0aed74af73a488f8b691578ca370226 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:24:24.884011 11736 leader_election.cc:290] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:24.889520 11734 raft_consensus.cc:515] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:24.890676 11747 raft_consensus.cc:515] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:24.900144 11747 leader_election.cc:290] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:24.903208 10895 leader_election.cc:304] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:24.904105 11754 raft_consensus.cc:2749] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:24.906602 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:24.913941 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac83709373b4efd9c3aa1472a9f9022" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:24.916148 11734 leader_election.cc:290] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:24.916410 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:24.918040 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:24.918831 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:24.919749 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:24.921826 10968 leader_election.cc:304] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:24.922761 11726 raft_consensus.cc:2749] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:24.925890 10968 leader_election.cc:304] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:24.926690 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:24.928290 11749 raft_consensus.cc:2749] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:24:24.929989 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 55525.7us
I20260709 12:24:24.930902 10819 leader_election.cc:304] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:24.927429 10968 leader_election.cc:304] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
W20260709 12:24:24.938438 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 55954.1us
I20260709 12:24:24.930902 10895 leader_election.cc:304] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040
I20260709 12:24:24.941744 10968 leader_election.cc:304] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:24.942852 10968 leader_election.cc:304] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:24.936502 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:24.943732 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:24.918131 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad766f48812a4ddeb383179b1d84907b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:24.936465 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:24.912038 11623 raft_consensus.cc:2468] T d0aed74af73a488f8b691578ca370226 P 3c52e0825c02476e89d84da9bb849f5d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 2.
I20260709 12:24:24.907296 11732 raft_consensus.cc:515] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:25.008701 10969 leader_election.cc:304] T d0aed74af73a488f8b691578ca370226 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:25.008229 11748 raft_consensus.cc:515] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:25.009303 11732 leader_election.cc:290] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:24.999877 11740 raft_consensus.cc:2749] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:25.009614 11735 raft_consensus.cc:2804] T d0aed74af73a488f8b691578ca370226 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:25.010229 11735 raft_consensus.cc:697] T d0aed74af73a488f8b691578ca370226 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:25.000269 11747 raft_consensus.cc:2749] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:25.011322 11735 consensus_queue.cc:237] T d0aed74af73a488f8b691578ca370226 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:25.012359 11748 leader_election.cc:290] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:25.016754 11624 raft_consensus.cc:1240] T d0aed74af73a488f8b691578ca370226 P 3c52e0825c02476e89d84da9bb849f5d [term 2 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:25.020061 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aed74af73a488f8b691578ca370226" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:25.000823 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:25.001308 11749 raft_consensus.cc:2749] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:24.999886 11726 raft_consensus.cc:2749] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:24.944286 10968 leader_election.cc:304] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
W20260709 12:24:25.027805 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 83583.5us
I20260709 12:24:25.028905 11753 raft_consensus.cc:2749] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:25.029069 10968 leader_election.cc:304] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:25.029850 11760 raft_consensus.cc:2749] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:25.033667 10968 leader_election.cc:304] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:25.034478 11740 raft_consensus.cc:2749] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:24:25.035109 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 93271.4us
I20260709 12:24:25.036515 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:25.005524 11771 raft_consensus.cc:2749] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:24.938323 11736 raft_consensus.cc:2749] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:25.036859 10820 leader_election.cc:304] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:25.036540 11770 consensus_queue.cc:1048] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:24:25.003737 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:25.040174 10819 leader_election.cc:304] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:25.044649 10819 leader_election.cc:304] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:25.036427 10895 leader_election.cc:304] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:25.045652 11747 raft_consensus.cc:2749] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:25.046590 11766 raft_consensus.cc:2804] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:25.047029 11766 raft_consensus.cc:493] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:25.047413 11766 raft_consensus.cc:3060] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:25.050993 10895 leader_election.cc:304] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:25.051774 11770 raft_consensus.cc:2804] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:25.051994 11747 raft_consensus.cc:2749] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:25.052315 11770 raft_consensus.cc:493] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:25.052822 11770 raft_consensus.cc:3060] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:25.053395 10895 leader_election.cc:304] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:25.054198 11747 raft_consensus.cc:2749] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:25.056808 11736 raft_consensus.cc:2804] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:25.057107 11748 consensus_queue.cc:1048] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:25.062450 10819 leader_election.cc:304] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:25.044675 10968 leader_election.cc:304] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:25.064395 10750 catalog_manager.cc:5697] T d0aed74af73a488f8b691578ca370226 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 1 to 2, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 2 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:25.067144 11740 raft_consensus.cc:2749] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:25.068215 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:25.063674 10819 leader_election.cc:304] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:25.064224 11771 raft_consensus.cc:2804] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:25.064376 11702 consensus_queue.cc:1059] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:25.071153 11747 raft_consensus.cc:3055] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:25.071739 11747 raft_consensus.cc:740] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:25.072830 11747 consensus_queue.cc:260] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:25.074563 11747 raft_consensus.cc:3060] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:25.075703 11771 raft_consensus.cc:493] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:25.076169 11771 raft_consensus.cc:3060] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:25.083600 11748 raft_consensus.cc:2804] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:25.084086 11748 raft_consensus.cc:493] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:25.084476 11748 raft_consensus.cc:3060] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:25.057241 11736 raft_consensus.cc:493] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:25.091943 11736 raft_consensus.cc:3060] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:25.096130 11770 raft_consensus.cc:515] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:25.098294 11770 leader_election.cc:290] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:25.106259 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:25.106727 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:25.107492 10819 leader_election.cc:304] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:25.071197 10968 leader_election.cc:304] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:25.109326 10968 leader_election.cc:304] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:25.065174 11766 raft_consensus.cc:515] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:25.114030 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:25.114718 10968 leader_election.cc:304] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:25.110116 11740 raft_consensus.cc:2749] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:25.117771 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:25.120214 10968 leader_election.cc:304] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:25.124460 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c6d38c4d8a90a81975a6a0cb13" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:25.116014 11735 raft_consensus.cc:2749] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:25.126820 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:25.129438 11766 leader_election.cc:290] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:25.130617 11726 raft_consensus.cc:2749] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:25.136152 10968 leader_election.cc:304] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:25.140342 10968 leader_election.cc:304] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:25.142078 11749 raft_consensus.cc:2749] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:25.103394 11748 raft_consensus.cc:515] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:25.142721 11767 raft_consensus.cc:2804] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:25.143133 11767 raft_consensus.cc:493] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:25.143474 11767 raft_consensus.cc:3060] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:25.147733 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:25.150337 10968 leader_election.cc:304] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:25.151819 11726 raft_consensus.cc:2749] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:25.154522 10819 leader_election.cc:304] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:25.152787 11749 raft_consensus.cc:2749] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:25.156255 11735 raft_consensus.cc:2749] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:25.159116 11748 leader_election.cc:290] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:25.170184 11766 raft_consensus.cc:493] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:25.159807 10968 leader_election.cc:304] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:25.154073 11736 raft_consensus.cc:515] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:25.174072 10968 leader_election.cc:304] T 3f8a389131ef4c77a3e08488aa4759eb P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:25.174901 11749 raft_consensus.cc:2749] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:25.167479 11768 raft_consensus.cc:493] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:25.178268 10968 leader_election.cc:304] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:25.176343 11736 leader_election.cc:290] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:25.171011 11766 raft_consensus.cc:515] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:25.182235 10968 leader_election.cc:304] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:25.182691 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:25.183997 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:25.184461 10851 raft_consensus.cc:1240] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:25.181178 11735 raft_consensus.cc:2749] T 3f8a389131ef4c77a3e08488aa4759eb P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:25.185781 11740 raft_consensus.cc:2749] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:25.187036 10968 leader_election.cc:304] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:25.187705 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:25.193791 11740 raft_consensus.cc:2749] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:25.194547 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:25.184505 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:25.196111 10847 raft_consensus.cc:1240] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:25.196313 11736 raft_consensus.cc:2804] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:25.196861 11736 raft_consensus.cc:493] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:25.181447 11749 raft_consensus.cc:2749] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:25.198005 10851 raft_consensus.cc:1240] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:25.193882 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:25.191361 11771 raft_consensus.cc:515] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:25.199815 11736 raft_consensus.cc:3060] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:25.202026 11771 leader_election.cc:290] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:25.202906 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:25.203146 11767 raft_consensus.cc:515] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:25.179790 11768 raft_consensus.cc:515] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:25.210196 10848 raft_consensus.cc:2468] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 1.
I20260709 12:24:25.210484 11767 leader_election.cc:290] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:25.211293 11766 leader_election.cc:290] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:25.213788 10847 raft_consensus.cc:1240] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:25.180570 11748 raft_consensus.cc:493] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:25.214776 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:25.214675 11748 raft_consensus.cc:515] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:25.213737 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:25.216035 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:25.216849 11748 leader_election.cc:290] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:25.218032 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac83709373b4efd9c3aa1472a9f9022" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:25.219455 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:25.223404 11768 leader_election.cc:290] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:25.225687 10894 leader_election.cc:304] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:25.227519 11702 raft_consensus.cc:2749] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:25.233568 10894 leader_election.cc:304] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:25.235353 11702 raft_consensus.cc:2749] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:25.254168 11775 raft_consensus.cc:2955] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:24:25.254127 10894 leader_election.cc:304] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:25.256809 10968 leader_election.cc:304] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:25.257757 11747 raft_consensus.cc:2749] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:25.257901 10968 leader_election.cc:304] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:25.259196 10894 leader_election.cc:304] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:25.259945 11747 raft_consensus.cc:2749] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:25.262984 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:25.263535 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:25.263722 11749 raft_consensus.cc:2749] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:25.262998 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:25.264464 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:25.264745 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:25.263026 11736 raft_consensus.cc:515] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:25.265655 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9331e5342644ca2bae19187b083a7d5" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:25.265972 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:25.266924 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:25.267078 11736 leader_election.cc:290] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:25.267261 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:25.268193 10968 leader_election.cc:304] T 69fd8fdac2fa449e9e184f3d668ea1a7 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:25.268512 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:25.269752 10847 raft_consensus.cc:1240] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:25.270412 10998 raft_consensus.cc:2955] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:24:25.271720 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:25.272779 11751 consensus_queue.cc:1059] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:25.273590 11749 raft_consensus.cc:2804] T 69fd8fdac2fa449e9e184f3d668ea1a7 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:25.273979 11749 raft_consensus.cc:493] T 69fd8fdac2fa449e9e184f3d668ea1a7 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:25.274375 11749 raft_consensus.cc:3060] T 69fd8fdac2fa449e9e184f3d668ea1a7 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:25.275861 10847 raft_consensus.cc:1240] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:25.277460 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:25.278486 10968 leader_election.cc:304] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:25.278771 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c6d38c4d8a90a81975a6a0cb13" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:25.279343 11735 raft_consensus.cc:2749] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:25.279711 10968 leader_election.cc:304] T a6a28416571247df878823d464c05f1e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:25.282197 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:25.283815 10847 raft_consensus.cc:1240] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:25.283913 10968 leader_election.cc:304] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:25.268635 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:25.286023 10925 raft_consensus.cc:1240] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:25.286125 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:25.287254 10928 raft_consensus.cc:1240] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:25.288757 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:25.289819 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:25.290961 11740 raft_consensus.cc:2749] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:25.288913 11732 raft_consensus.cc:3055] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:25.292203 10968 leader_election.cc:304] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:25.292625 11732 raft_consensus.cc:740] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:25.292971 11740 raft_consensus.cc:2749] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:25.293530 11732 consensus_queue.cc:260] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:25.294117 10968 leader_election.cc:304] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:25.280459 11735 raft_consensus.cc:2749] T a6a28416571247df878823d464c05f1e P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:25.295151 11740 raft_consensus.cc:2749] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:25.294888 11732 raft_consensus.cc:3060] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:25.297287 11749 raft_consensus.cc:515] T 69fd8fdac2fa449e9e184f3d668ea1a7 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:25.304131 11749 leader_election.cc:290] T 69fd8fdac2fa449e9e184f3d668ea1a7 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:25.280730 11750 raft_consensus.cc:2749] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:25.299077 10968 leader_election.cc:304] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:25.306809 10847 raft_consensus.cc:1240] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:25.323377 10968 leader_election.cc:304] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:25.324504 11740 raft_consensus.cc:2749] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:25.325645 10848 raft_consensus.cc:1240] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:25.326082 11735 raft_consensus.cc:2749] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:25.324512 10846 raft_consensus.cc:1240] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:25.322834 10851 raft_consensus.cc:1240] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:25.328198 11749 consensus_queue.cc:1059] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:25.328326 11624 raft_consensus.cc:2955] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:24:25.329430 11750 raft_consensus.cc:3055] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:25.330372 11750 raft_consensus.cc:740] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:25.335215 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:25.337167 11775 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:56372 (request call id 62) took 1140 ms. Trace:
I20260709 12:24:25.339184 10894 leader_election.cc:304] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:25.340238 11781 consensus_queue.cc:1059] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:25.331645 11750 consensus_queue.cc:260] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:25.341645 11781 raft_consensus.cc:3055] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:25.341722 11750 raft_consensus.cc:3060] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:25.342170 11781 raft_consensus.cc:740] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:25.339963 10968 leader_election.cc:304] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:25.343396 11749 raft_consensus.cc:2749] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:25.345166 11749 consensus_queue.cc:1059] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:25.346472 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:25.346624 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9331e5342644ca2bae19187b083a7d5" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:25.343727 11781 consensus_queue.cc:260] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:25.346787 11740 raft_consensus.cc:3055] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:25.347887 11740 raft_consensus.cc:740] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:25.348335 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:25.348752 11740 consensus_queue.cc:260] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:25.349959 11740 raft_consensus.cc:3060] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:25.350284 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:25.354553 11732 raft_consensus.cc:2749] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:25.345455 10968 leader_election.cc:304] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:25.356091 10819 leader_election.cc:304] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:25.358480 10894 leader_election.cc:304] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:25.352775 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:25.359350 11735 consensus_queue.cc:1059] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:25.360103 11749 raft_consensus.cc:2804] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:25.394202 11749 raft_consensus.cc:493] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:25.394645 11749 raft_consensus.cc:3060] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:25.397924 11003 raft_consensus.cc:1240] T 69fd8fdac2fa449e9e184f3d668ea1a7 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:25.360550 10894 leader_election.cc:304] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:25.400113 11747 consensus_queue.cc:1059] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:25.359697 11705 raft_consensus.cc:2749] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:25.361526 11781 raft_consensus.cc:3060] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:25.362236 11768 raft_consensus.cc:2749] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:25.403856 10894 leader_election.cc:304] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:25.407691 11702 raft_consensus.cc:3055] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:25.408257 11702 raft_consensus.cc:740] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:25.408012 10894 leader_election.cc:304] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:25.409242 11705 raft_consensus.cc:2749] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:25.409368 11702 consensus_queue.cc:260] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:25.410140 11754 raft_consensus.cc:2749] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:25.401240 11747 raft_consensus.cc:2749] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:25.412339 11749 raft_consensus.cc:515] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:25.382464 10819 leader_election.cc:304] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:25.382573 11726 consensus_queue.cc:1059] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:25.390918 11760 consensus_queue.cc:1059] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:25.418619 11768 raft_consensus.cc:2749] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:24:25.416939 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 52542.2us
I20260709 12:24:25.421663 10819 leader_election.cc:304] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:25.422415 11768 raft_consensus.cc:2749] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:25.422942 10851 raft_consensus.cc:1240] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:25.423635 10819 leader_election.cc:304] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:25.424398 11768 raft_consensus.cc:2749] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:25.424613 11743 raft_consensus.cc:3055] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:25.424978 11743 raft_consensus.cc:740] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:25.411265 11702 raft_consensus.cc:3060] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:25.425532 10819 leader_election.cc:304] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:25.426859 11768 raft_consensus.cc:2749] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:24:25.427716 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:25.427950 11726 consensus_queue.cc:1059] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:25.428987 11726 raft_consensus.cc:3055] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:25.429482 11726 raft_consensus.cc:740] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:25.430882 10819 leader_election.cc:304] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:25.425848 11743 consensus_queue.cc:260] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:25.432400 11735 raft_consensus.cc:3055] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:25.430442 11726 consensus_queue.cc:260] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:25.432788 11735 raft_consensus.cc:740] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:25.433352 11726 raft_consensus.cc:3060] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:25.434435 11768 raft_consensus.cc:493] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:25.431797 11760 raft_consensus.cc:3055] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:25.433755 11735 consensus_queue.cc:260] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:25.435398 11743 raft_consensus.cc:3060] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:25.438082 11753 consensus_queue.cc:1059] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:24:25.438237 10819 leader_election.cc:304] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:25.337625 11775 rpcz_store.cc:276] 0709 12:24:24.199073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:24.207223 (+  8150us) service_pool.cc:224] Handling call
0709 12:24:24.405718 (+198495us) log.cc:844] Serialized 494 byte log entry
0709 12:24:24.571690 (+165972us) spinlock_profiling.cc:243] Waited 7.64 ms on lock 0x7b54000f94a0. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e01142 00007f7594de1eaa 00007f7594de8d53 00007f7594de8cd9 00007f7594de8c69 00007f7594de8c31 00007f7594de7dfd 0000000000388634 0000000000388479 00007f7591d9b475
0709 12:24:25.337073 (+765383us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":370,"raft.run_cpu_time_us":3486,"raft.run_wall_time_us":86249,"spinlock_wait_cycles":18499072,"thread_start_us":87327,"threads_started":1,"wal-append.queue_time_us":107879}
I20260709 12:24:25.439265 11735 raft_consensus.cc:3060] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:25.440003 11736 raft_consensus.cc:2749] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:25.449059 10738 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 352aa49c65194abbb863d7553a091f11 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:25.437206 11760 raft_consensus.cc:740] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:25.441629 11771 raft_consensus.cc:2749] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:25.457711 10819 leader_election.cc:304] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:25.458880 10819 leader_election.cc:304] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:25.460350 11766 raft_consensus.cc:2749] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:25.461102 11770 raft_consensus.cc:2749] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:25.460374 11749 leader_election.cc:290] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:25.444120 11740 consensus_queue.cc:1059] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:24:25.451889 11768 raft_consensus.cc:515] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:25.467617 11740 consensus_queue.cc:1059] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:24:25.484130 10819 leader_election.cc:304] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:25.486627 10819 leader_election.cc:304] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:25.491173 10819 leader_election.cc:304] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:25.497735 11785 raft_consensus.cc:3055] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:25.500646 11753 raft_consensus.cc:3055] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:25.500911 11785 raft_consensus.cc:740] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:25.487249 11736 raft_consensus.cc:2749] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:25.502017 11749 raft_consensus.cc:3055] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:25.502435 11749 raft_consensus.cc:740] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:25.499356 10750 catalog_manager.cc:5697] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: config changed from index 3 to 4, VOTER e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) evicted. New cstate: current_term: 1 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:24:25.502949 11785 consensus_queue.cc:260] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:25.503304 11749 consensus_queue.cc:260] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:25.482010 11760 consensus_queue.cc:260] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:25.501093 11753 raft_consensus.cc:740] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:25.505752 11736 raft_consensus.cc:2749] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:25.521981 11753 consensus_queue.cc:260] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:25.506824 11785 raft_consensus.cc:3060] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:25.488606 11767 consensus_queue.cc:1059] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:24:25.489943 11770 raft_consensus.cc:2749] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:25.483922 11748 consensus_queue.cc:1059] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:24:25.526093 11736 raft_consensus.cc:3055] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:25.526450 11771 raft_consensus.cc:3055] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:25.526608 11736 raft_consensus.cc:740] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:25.526981 11771 raft_consensus.cc:740] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:25.527943 11771 consensus_queue.cc:260] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:25.528301 11736 consensus_queue.cc:260] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:25.529390 11771 raft_consensus.cc:3060] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:25.530002 11760 raft_consensus.cc:3060] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:25.530332 11736 raft_consensus.cc:3060] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:25.519032 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 76467.8us
I20260709 12:24:25.520139 10819 leader_election.cc:304] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:25.523303 11753 raft_consensus.cc:3060] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:25.534432 10847 raft_consensus.cc:1240] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:25.538261 10851 raft_consensus.cc:1240] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:25.539655 10912 tablet_service.cc:1558] Processing DeleteTablet for tablet 352aa49c65194abbb863d7553a091f11 with delete_type TABLET_DATA_TOMBSTONED (TS e2d5c637307a407ab688f5ccd6f0fcea not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59610
I20260709 12:24:25.539960 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:25.540441 11768 leader_election.cc:290] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:24:25.534823 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:25.538261 10848 raft_consensus.cc:1240] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:25.544196 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6a1da21304fcfacab384a6afc4101" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:25.545039 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fd8fdac2fa449e9e184f3d668ea1a7" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:25.546464 10853 raft_consensus.cc:1240] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:25.562484 11749 raft_consensus.cc:3060] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:25.563402 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:25.562541 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fd8fdac2fa449e9e184f3d668ea1a7" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:25.543146 11775 raft_consensus.cc:2749] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:25.570353 10819 leader_election.cc:304] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:25.576015 11775 raft_consensus.cc:2749] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:24:25.578313 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:25.585135 10819 leader_election.cc:304] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:25.587813 11770 raft_consensus.cc:2749] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:25.592958 10819 leader_election.cc:304] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:25.594601 10819 leader_election.cc:304] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:25.595654 11770 raft_consensus.cc:2749] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:25.596452 11770 raft_consensus.cc:2749] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:25.599833 10819 leader_election.cc:304] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:25.600989 11770 raft_consensus.cc:2749] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:25.601248 11786 tablet_replica.cc:333] T 352aa49c65194abbb863d7553a091f11 P e2d5c637307a407ab688f5ccd6f0fcea: stopping tablet replica
I20260709 12:24:25.603964 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6a1da21304fcfacab384a6afc4101" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:25.604674 10928 raft_consensus.cc:2468] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 2.
I20260709 12:24:25.606650 11786 raft_consensus.cc:2243] T 352aa49c65194abbb863d7553a091f11 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:25.607532 11786 raft_consensus.cc:2272] T 352aa49c65194abbb863d7553a091f11 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:25.613382 11786 ts_tablet_manager.cc:1916] T 352aa49c65194abbb863d7553a091f11 P e2d5c637307a407ab688f5ccd6f0fcea: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:25.618875 10968 leader_election.cc:304] T 69fd8fdac2fa449e9e184f3d668ea1a7 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:25.621881 11783 raft_consensus.cc:2804] T 69fd8fdac2fa449e9e184f3d668ea1a7 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:25.622466 11783 raft_consensus.cc:697] T 69fd8fdac2fa449e9e184f3d668ea1a7 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:25.623522 11783 consensus_queue.cc:237] T 69fd8fdac2fa449e9e184f3d668ea1a7 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:25.636044 11624 raft_consensus.cc:1275] T d0aed74af73a488f8b691578ca370226 P 3c52e0825c02476e89d84da9bb849f5d [term 2 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:25.638975 11786 ts_tablet_manager.cc:1929] T 352aa49c65194abbb863d7553a091f11 P e2d5c637307a407ab688f5ccd6f0fcea: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:24:25.639794 11786 log.cc:1199] T 352aa49c65194abbb863d7553a091f11 P e2d5c637307a407ab688f5ccd6f0fcea: Deleting WAL directory at /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599781984018-9681-0/minicluster-data/ts-1-root/wals/352aa49c65194abbb863d7553a091f11
I20260709 12:24:25.642971 10819 leader_election.cc:304] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:25.643807 10738 catalog_manager.cc:5028] TS e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): tablet 352aa49c65194abbb863d7553a091f11 (table test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]) successfully deleted
I20260709 12:24:25.654665 10750 catalog_manager.cc:5697] T 69fd8fdac2fa449e9e184f3d668ea1a7 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 1 to 2, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 2 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:25.643761 11736 raft_consensus.cc:2749] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:25.639111 11753 consensus_queue.cc:1048] T d0aed74af73a488f8b691578ca370226 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 12:24:25.665934 10968 leader_election.cc:304] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:25.677822 11726 consensus_queue.cc:1059] T 442726a7f1e441248ec80a98b31eb341 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:25.672672 11750 consensus_queue.cc:1059] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:24:25.689575 11760 raft_consensus.cc:3055] T 442726a7f1e441248ec80a98b31eb341 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:25.690016 11760 raft_consensus.cc:740] T 442726a7f1e441248ec80a98b31eb341 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:25.691614 11760 consensus_queue.cc:260] T 442726a7f1e441248ec80a98b31eb341 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:25.665398 11749 consensus_queue.cc:1059] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:24:25.693102 11760 raft_consensus.cc:3060] T 442726a7f1e441248ec80a98b31eb341 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:25.693255 11749 raft_consensus.cc:3055] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:25.693686 11749 raft_consensus.cc:740] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:25.694635 11749 consensus_queue.cc:260] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:25.669526 11743 raft_consensus.cc:2749] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:25.696485 11783 raft_consensus.cc:3055] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:25.696831 11783 raft_consensus.cc:740] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:25.662668 11735 consensus_queue.cc:1059] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 12:24:25.706507 10920 raft_consensus.cc:1275] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:25.707896 11000 raft_consensus.cc:1240] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:25.711479 11749 raft_consensus.cc:3060] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:25.713562 11753 raft_consensus.cc:3055] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:25.722277 11753 raft_consensus.cc:740] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:25.726640 11754 consensus_queue.cc:1059] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:25.727824 11754 raft_consensus.cc:3055] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:25.728477 11754 raft_consensus.cc:740] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:25.730334 11754 consensus_queue.cc:260] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:25.697750 11783 consensus_queue.cc:260] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:25.733335 11754 raft_consensus.cc:3060] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:25.734021 11783 raft_consensus.cc:3060] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:25.736153 11753 consensus_queue.cc:260] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:25.737632 11753 raft_consensus.cc:3060] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:25.755066 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 54023.1us
I20260709 12:24:25.759932 11749 consensus_queue.cc:1048] T d0aed74af73a488f8b691578ca370226 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:26.028010 10928 raft_consensus.cc:1275] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:26.029345 11753 consensus_queue.cc:1048] T 69fd8fdac2fa449e9e184f3d668ea1a7 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:26.039117 10848 raft_consensus.cc:3060] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:26.047866 10848 raft_consensus.cc:1275] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:26.050168 11753 consensus_queue.cc:1048] T 69fd8fdac2fa449e9e184f3d668ea1a7 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:26.532245 11783 raft_consensus.cc:493] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:26.532914 11783 raft_consensus.cc:515] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:26.535434 11783 leader_election.cc:290] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:26.540483 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:26.541363 10920 raft_consensus.cc:2468] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 2.
I20260709 12:24:26.543054 10968 leader_election.cc:304] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:26.543998 11783 raft_consensus.cc:2804] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:26.544600 11783 raft_consensus.cc:493] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:26.545084 11783 raft_consensus.cc:3060] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:26.546820 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:26.554605 11783 raft_consensus.cc:515] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:26.555819 10848 raft_consensus.cc:2393] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 2: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:24:26.559514 11783 leader_election.cc:290] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:26.561426 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:26.570719 11783 raft_consensus.cc:493] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:26.571771 11783 raft_consensus.cc:515] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:26.574061 11783 leader_election.cc:290] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:26.575845 10920 raft_consensus.cc:2468] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 2.
I20260709 12:24:26.577129 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:26.582958 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:26.583132 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:26.583894 10846 raft_consensus.cc:2468] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 2.
I20260709 12:24:26.585937 10848 raft_consensus.cc:2393] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 2: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
W20260709 12:24:26.588284 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 47243us
I20260709 12:24:26.588702 10968 leader_election.cc:304] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:26.590054 10968 leader_election.cc:304] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:24:26.595633 11760 raft_consensus.cc:2804] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:26.596064 11760 raft_consensus.cc:493] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:26.596401 11760 raft_consensus.cc:3060] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:26.600059 11783 raft_consensus.cc:2804] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:26.601079 11783 raft_consensus.cc:697] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 2 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:26.602042 11783 consensus_queue.cc:237] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:26.604839 11760 raft_consensus.cc:515] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:26.606981 11760 leader_election.cc:290] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:26.614749 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:26.615088 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:26.615658 10846 raft_consensus.cc:3060] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:26.628979 11753 raft_consensus.cc:493] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:26.629621 11753 raft_consensus.cc:515] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:26.633615 10846 raft_consensus.cc:2468] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 3.
I20260709 12:24:26.630118 11798 raft_consensus.cc:493] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:26.639613 11798 raft_consensus.cc:515] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:26.641419 10968 leader_election.cc:304] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:26.638223 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c6d38c4d8a90a81975a6a0cb13" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:26.643688 11798 leader_election.cc:290] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:26.643748 11800 raft_consensus.cc:2804] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:26.644541 11798 raft_consensus.cc:493] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:26.650056 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:26.640981 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c6d38c4d8a90a81975a6a0cb13" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:26.636628 11753 leader_election.cc:290] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:26.646024 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:26.650310 11798 raft_consensus.cc:515] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:26.650861 10848 raft_consensus.cc:2468] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 2.
I20260709 12:24:26.656903 10846 raft_consensus.cc:2468] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 2.
I20260709 12:24:26.644577 11800 raft_consensus.cc:697] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:26.659399 11798 leader_election.cc:290] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:26.662010 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:26.662693 10920 raft_consensus.cc:2468] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 1.
I20260709 12:24:26.660310 11800 consensus_queue.cc:237] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:26.660943 10968 leader_election.cc:304] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:26.663903 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:26.664181 10968 leader_election.cc:304] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:26.664618 10848 raft_consensus.cc:2468] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 2.
I20260709 12:24:26.665176 11798 raft_consensus.cc:2804] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:26.665544 11798 raft_consensus.cc:493] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:26.665524 10968 leader_election.cc:304] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:26.666183 11798 raft_consensus.cc:3060] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:26.666975 11753 raft_consensus.cc:2804] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:26.667377 11753 raft_consensus.cc:493] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:26.667773 11753 raft_consensus.cc:3060] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:26.669706 11783 raft_consensus.cc:2804] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:26.670164 11783 raft_consensus.cc:493] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:26.670526 11783 raft_consensus.cc:3060] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:26.680889 11783 raft_consensus.cc:515] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:26.679032 10752 catalog_manager.cc:5697] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 1 to 2, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 2 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:26.682493 11797 raft_consensus.cc:493] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:26.683293 11797 raft_consensus.cc:515] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:26.686381 11797 leader_election.cc:290] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:26.687414 11783 leader_election.cc:290] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:26.688174 11783 raft_consensus.cc:493] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:26.688663 11783 raft_consensus.cc:515] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:26.690019 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:26.690991 10848 raft_consensus.cc:2468] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 2.
I20260709 12:24:26.691184 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:26.692083 11783 leader_election.cc:290] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:26.692449 10894 leader_election.cc:304] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:26.693451 11754 raft_consensus.cc:2804] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:26.693853 11754 raft_consensus.cc:493] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:26.694216 11754 raft_consensus.cc:3060] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:26.697116 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:26.697780 10928 raft_consensus.cc:3060] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:24:26.676327 11798 raft_consensus.cc:515] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:26.700335 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:26.701004 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:26.709522 10846 raft_consensus.cc:2468] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 2.
I20260709 12:24:26.711135 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:26.711820 10848 raft_consensus.cc:3060] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:26.711844 11798 leader_election.cc:290] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:26.718230 10968 leader_election.cc:304] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:26.718571 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c6d38c4d8a90a81975a6a0cb13" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:26.719117 11798 raft_consensus.cc:2804] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:26.719321 10846 raft_consensus.cc:3060] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:26.719556 11798 raft_consensus.cc:493] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:26.720045 11798 raft_consensus.cc:3060] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:26.720400 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c6d38c4d8a90a81975a6a0cb13" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:26.723955 11796 raft_consensus.cc:493] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:26.724601 11796 raft_consensus.cc:515] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:26.732555 11796 leader_election.cc:290] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:26.732987 11747 raft_consensus.cc:493] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:26.733516 11747 raft_consensus.cc:515] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:26.733742 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:26.735083 10850 raft_consensus.cc:2393] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 2: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:24:26.735554 11747 leader_election.cc:290] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:26.738353 11747 raft_consensus.cc:493] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:26.739028 11747 raft_consensus.cc:515] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:26.746084 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:26.747133 10994 raft_consensus.cc:2468] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 2.
I20260709 12:24:26.747998 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:26.749151 10850 raft_consensus.cc:2393] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 2: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:24:26.749385 10895 leader_election.cc:304] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:24:26.750929 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:26.751675 11796 raft_consensus.cc:493] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:26.752153 11747 leader_election.cc:290] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:26.752197 11796 raft_consensus.cc:515] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:26.753150 11747 raft_consensus.cc:2804] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:26.753530 11747 raft_consensus.cc:493] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:26.753911 11747 raft_consensus.cc:3060] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:26.755131 11796 leader_election.cc:290] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:26.759267 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:26.761729 10850 raft_consensus.cc:2393] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 2: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:24:26.760680 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:26.762534 10853 raft_consensus.cc:2368] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for earlier term 2. Current term is 3.
I20260709 12:24:26.765244 10894 leader_election.cc:400] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Vote denied by peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265) with higher term. Message: Invalid argument: T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for earlier term 2. Current term is 3.
I20260709 12:24:26.765671 10894 leader_election.cc:403] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:26.766552 11796 raft_consensus.cc:3060] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:24:26.767241 11753 raft_consensus.cc:515] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:26.769042 10846 raft_consensus.cc:2468] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 3.
I20260709 12:24:26.772028 10968 leader_election.cc:304] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:26.768488 11798 raft_consensus.cc:515] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:26.770586 11783 raft_consensus.cc:493] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:26.770678 10848 raft_consensus.cc:2468] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 3.
I20260709 12:24:26.781064 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:26.782099 11783 raft_consensus.cc:515] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:26.775909 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:26.784758 10994 raft_consensus.cc:2468] T 442726a7f1e441248ec80a98b31eb341 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 2.
I20260709 12:24:26.786813 10895 leader_election.cc:304] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:24:26.774374 10928 raft_consensus.cc:2468] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 3.
I20260709 12:24:26.773118 11760 raft_consensus.cc:493] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:26.774264 11800 raft_consensus.cc:2804] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:26.792294 11000 raft_consensus.cc:2368] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for earlier term 2. Current term is 3.
I20260709 12:24:26.794548 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:26.794899 10968 leader_election.cc:304] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:26.796092 10848 raft_consensus.cc:3060] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:26.771039 11754 raft_consensus.cc:515] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:26.798750 10895 leader_election.cc:400] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Vote denied by peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945) with higher term. Message: Invalid argument: T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for earlier term 2. Current term is 3.
I20260709 12:24:26.799026 10895 leader_election.cc:403] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:26.800920 11804 raft_consensus.cc:2804] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:26.801623 11804 raft_consensus.cc:697] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 3 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:26.802557 11804 consensus_queue.cc:237] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:26.804919 10848 raft_consensus.cc:2468] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 3.
I20260709 12:24:26.793049 11760 raft_consensus.cc:515] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:26.805040 11753 leader_election.cc:290] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:26.812583 11783 leader_election.cc:290] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:26.815969 11798 leader_election.cc:290] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:26.822798 11754 leader_election.cc:290] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:26.811455 11797 raft_consensus.cc:2804] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:26.823854 11797 raft_consensus.cc:493] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:26.824445 11797 raft_consensus.cc:3060] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:26.816813 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:26.826000 10848 raft_consensus.cc:3060] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:26.817535 11802 raft_consensus.cc:3060] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:24:26.834286 11796 raft_consensus.cc:2749] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265) with higher term. Message: Invalid argument: T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for earlier term 2. Current term is 3.
I20260709 12:24:26.818732 11760 leader_election.cc:290] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:26.839208 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:26.840144 10994 raft_consensus.cc:3060] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:24:26.841229 11797 raft_consensus.cc:515] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:26.842916 11747 raft_consensus.cc:515] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:26.845594 11747 leader_election.cc:290] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:26.842866 10848 raft_consensus.cc:2468] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 3.
I20260709 12:24:26.851819 10894 leader_election.cc:304] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
W20260709 12:24:26.855484 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 60698.8us
I20260709 12:24:26.855633 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:26.857375 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:26.858194 10846 raft_consensus.cc:2393] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 2: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:24:26.859892 11747 raft_consensus.cc:2804] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:26.860755 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:26.861357 10928 raft_consensus.cc:3060] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:24:26.861610 11747 raft_consensus.cc:697] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:26.862164 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:26.863010 10848 raft_consensus.cc:2468] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 2.
I20260709 12:24:26.862639 11747 consensus_queue.cc:237] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:26.878399 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:26.878705 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:26.879062 10853 raft_consensus.cc:2468] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 2.
I20260709 12:24:26.865782 11797 leader_election.cc:290] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:26.870941 10994 raft_consensus.cc:2468] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 3.
I20260709 12:24:26.875392 11003 raft_consensus.cc:2468] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 2.
I20260709 12:24:26.877470 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:26.865617 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:26.881948 10850 raft_consensus.cc:3060] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:26.882234 10846 raft_consensus.cc:2393] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 2: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:24:26.882337 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:26.852749 11800 raft_consensus.cc:697] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:26.883025 10920 raft_consensus.cc:2468] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 1.
I20260709 12:24:26.884245 11800 consensus_queue.cc:237] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:26.885082 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:26.892994 10850 raft_consensus.cc:2468] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 3.
I20260709 12:24:26.894810 10895 leader_election.cc:304] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:24:26.895946 10968 leader_election.cc:304] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:26.893829 11802 raft_consensus.cc:2749] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945) with higher term. Message: Invalid argument: T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for earlier term 2. Current term is 3.
I20260709 12:24:26.902043 11797 raft_consensus.cc:2804] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:26.902158 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:26.903163 10921 raft_consensus.cc:2393] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 2: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:24:26.904340 11000 raft_consensus.cc:2468] T 442726a7f1e441248ec80a98b31eb341 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 2.
I20260709 12:24:26.904381 10968 leader_election.cc:304] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:26.908006 11806 raft_consensus.cc:2804] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:26.908583 11806 raft_consensus.cc:493] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:26.909924 10895 leader_election.cc:304] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:24:26.903672 11797 raft_consensus.cc:697] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:26.877447 10928 raft_consensus.cc:2468] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 3.
I20260709 12:24:26.911928 11797 consensus_queue.cc:237] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:26.912424 11811 raft_consensus.cc:2804] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:26.913039 11811 raft_consensus.cc:697] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 3 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:26.913972 11811 consensus_queue.cc:237] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:26.908958 11806 raft_consensus.cc:3060] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:26.915992 11802 raft_consensus.cc:2804] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:26.916519 10968 leader_election.cc:304] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:26.920821 11804 raft_consensus.cc:2804] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:26.921792 11804 raft_consensus.cc:493] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:26.922241 11804 raft_consensus.cc:3060] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:26.923139 11802 raft_consensus.cc:697] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:26.927107 10968 leader_election.cc:304] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:26.924582 11802 consensus_queue.cc:237] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:26.931113 11806 raft_consensus.cc:515] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:26.934139 11806 leader_election.cc:290] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:26.948693 10920 raft_consensus.cc:2468] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 3.
I20260709 12:24:26.946909 10750 catalog_manager.cc:5697] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:26.938347 11760 raft_consensus.cc:2804] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:26.955657 11760 raft_consensus.cc:697] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:26.956879 11760 consensus_queue.cc:237] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:26.960240 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:26.961401 10850 raft_consensus.cc:3060] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:26.972455 11771 raft_consensus.cc:493] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:26.973093 11771 raft_consensus.cc:515] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:26.975236 11771 leader_election.cc:290] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:26.983192 11804 raft_consensus.cc:515] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:26.976022 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:26.984099 10921 raft_consensus.cc:3060] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:24:26.979882 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:26.987493 10850 raft_consensus.cc:2468] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 3.
I20260709 12:24:26.982344 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:26.989691 10922 raft_consensus.cc:2468] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 2.
I20260709 12:24:26.991231 10819 leader_election.cc:304] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:26.993676 11748 raft_consensus.cc:2804] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:26.994227 11748 raft_consensus.cc:493] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:26.994663 11748 raft_consensus.cc:3060] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:26.995437 11804 leader_election.cc:290] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:26.995481 11800 raft_consensus.cc:493] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:26.996284 11800 raft_consensus.cc:515] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:27.000746 11800 leader_election.cc:290] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:27.018196 10968 leader_election.cc:304] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:27.019865 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:27.020287 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:27.020345 11811 raft_consensus.cc:2804] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:27.021111 10920 raft_consensus.cc:2393] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 2: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:24:27.021226 11811 raft_consensus.cc:697] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:27.022516 11811 consensus_queue.cc:237] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:27.025496 11748 raft_consensus.cc:515] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:27.029316 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:27.030081 10848 raft_consensus.cc:2468] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 2.
I20260709 12:24:27.033181 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:27.040127 11796 raft_consensus.cc:493] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:27.040704 11796 raft_consensus.cc:515] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:27.048981 10968 leader_election.cc:304] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:27.054245 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:27.055050 10848 raft_consensus.cc:2393] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 2: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:24:27.062310 11800 raft_consensus.cc:2804] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:27.062796 11800 raft_consensus.cc:493] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:27.063153 11800 raft_consensus.cc:3060] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:27.064311 11748 leader_election.cc:290] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:27.052719 11747 raft_consensus.cc:493] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:27.068081 11747 raft_consensus.cc:515] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:27.069245 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:27.070601 11747 leader_election.cc:290] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:27.073534 11807 raft_consensus.cc:493] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:27.059968 11797 raft_consensus.cc:493] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:27.074098 11807 raft_consensus.cc:515] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:27.074780 11797 raft_consensus.cc:515] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:27.075047 11805 raft_consensus.cc:493] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:27.076538 11807 leader_election.cc:290] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:27.075793 11805 raft_consensus.cc:515] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:27.076875 11797 leader_election.cc:290] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:27.052316 11796 leader_election.cc:290] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:27.081197 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:27.081784 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:27.082302 11000 raft_consensus.cc:2468] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 2.
I20260709 12:24:27.082825 10994 raft_consensus.cc:2468] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 2.
W20260709 12:24:27.083693 10800 auto_rebalancer.cc:629] Failed to schedule move for tablet 02a088f690eb45beb958d74519a39b7f: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:24:27.084093 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:27.084740 10920 raft_consensus.cc:1275] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:27.087392 10895 leader_election.cc:304] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:27.081197 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c6d38c4d8a90a81975a6a0cb13" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:27.088320 11806 consensus_queue.cc:1048] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:27.089797 11771 raft_consensus.cc:493] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:27.090586 10895 leader_election.cc:304] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:27.091337 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:27.091890 11810 raft_consensus.cc:2804] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:27.092187 10853 raft_consensus.cc:2393] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 2: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:24:27.092295 11810 raft_consensus.cc:493] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:27.092568 11802 raft_consensus.cc:2804] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:27.092739 11810 raft_consensus.cc:3060] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:27.093010 11802 raft_consensus.cc:493] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:27.093205 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c6d38c4d8a90a81975a6a0cb13" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:27.093773 11802 raft_consensus.cc:3060] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:27.094125 10845 raft_consensus.cc:2368] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for earlier term 2. Current term is 3.
I20260709 12:24:27.095095 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:27.095734 11804 raft_consensus.cc:493] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:27.095918 10851 raft_consensus.cc:2393] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 2: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:24:27.090404 11771 raft_consensus.cc:515] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:27.096239 11804 raft_consensus.cc:515] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:27.088383 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:27.098281 11804 leader_election.cc:290] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:27.098979 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:27.100056 10848 raft_consensus.cc:2393] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 2: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:24:27.099289 11771 leader_election.cc:290] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:27.104924 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:27.105779 10994 raft_consensus.cc:2468] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 2.
I20260709 12:24:27.106629 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:27.054322 10921 raft_consensus.cc:2468] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 3.
I20260709 12:24:27.092196 11805 leader_election.cc:290] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:27.115183 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:27.115972 10850 raft_consensus.cc:2468] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 2.
I20260709 12:24:27.116400 10994 raft_consensus.cc:2468] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 2.
I20260709 12:24:27.117358 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:27.120222 10894 leader_election.cc:400] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Vote denied by peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265) with higher term. Message: Invalid argument: T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for earlier term 2. Current term is 3.
I20260709 12:24:27.132826 10894 leader_election.cc:403] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:27.107290 10848 raft_consensus.cc:2468] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 2.
I20260709 12:24:27.122342 10819 leader_election.cc:304] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:27.124317 10820 leader_election.cc:304] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:27.123082 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:27.136767 11771 raft_consensus.cc:2749] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:27.141347 10895 leader_election.cc:304] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:24:27.158671 10968 leader_election.cc:304] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:27.159498 11804 raft_consensus.cc:2804] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:27.144507 10750 catalog_manager.cc:5697] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 1 to 2, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 2 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:27.159919 11804 raft_consensus.cc:493] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:27.160488 11804 raft_consensus.cc:3060] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:27.161087 10750 catalog_manager.cc:5697] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 1 to 2, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 2 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
W20260709 12:24:27.168620 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 46393.2us
I20260709 12:24:27.158278 11736 raft_consensus.cc:2804] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:27.147073 11797 raft_consensus.cc:3060] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:24:27.142621 10921 raft_consensus.cc:2468] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 1.
I20260709 12:24:27.183511 11736 raft_consensus.cc:493] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:27.186550 11736 raft_consensus.cc:3060] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:27.188776 11747 raft_consensus.cc:2804] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:27.190274 11747 raft_consensus.cc:493] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:27.190838 11747 raft_consensus.cc:3060] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:27.192234 11810 raft_consensus.cc:515] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:27.138955 11800 raft_consensus.cc:515] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:27.203444 11800 leader_election.cc:290] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:27.205130 11003 raft_consensus.cc:2368] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for earlier term 2. Current term is 3.
I20260709 12:24:27.205380 11810 leader_election.cc:290] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:27.185194 10968 leader_election.cc:304] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:27.207167 11800 raft_consensus.cc:2804] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:27.213480 11800 raft_consensus.cc:697] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:27.214555 11800 consensus_queue.cc:237] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:27.215874 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 74730.2us
I20260709 12:24:27.220498 11802 raft_consensus.cc:515] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:27.220182 10920 consensus_queue.cc:237] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:24:27.222935 11802 leader_election.cc:290] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:27.225667 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:27.220803 10752 catalog_manager.cc:5697] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:27.231204 10926 raft_consensus.cc:1275] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:27.183043 11804 raft_consensus.cc:515] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:27.215823 11797 raft_consensus.cc:2749] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265) with higher term. Message: Invalid argument: T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for earlier term 2. Current term is 3.
I20260709 12:24:27.233017 10752 catalog_manager.cc:5697] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:27.235509 10895 leader_election.cc:400] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Vote denied by peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945) with higher term. Message: Invalid argument: T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for earlier term 2. Current term is 3.
I20260709 12:24:27.235661 10926 raft_consensus.cc:1275] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:27.236052 10752 catalog_manager.cc:5697] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:27.236269 10895 leader_election.cc:403] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:27.233371 11827 raft_consensus.cc:493] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:27.239410 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:27.240509 10923 raft_consensus.cc:3060] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:24:27.240340 11827 raft_consensus.cc:515] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:27.242714 11827 leader_election.cc:290] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:27.244243 11003 raft_consensus.cc:2468] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 2.
I20260709 12:24:27.245294 11736 raft_consensus.cc:515] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:27.247949 11747 raft_consensus.cc:515] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:27.252507 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:27.253566 10848 raft_consensus.cc:2393] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 2: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:24:27.253844 10752 catalog_manager.cc:5697] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:27.256603 10752 catalog_manager.cc:5697] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:27.239379 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:27.259995 10845 raft_consensus.cc:2393] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 2: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:24:27.260298 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:27.261758 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:27.262599 10850 raft_consensus.cc:2393] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 2: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:24:27.254348 11825 raft_consensus.cc:493] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:27.263170 11825 raft_consensus.cc:515] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:27.266839 11747 leader_election.cc:290] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:27.247452 11736 leader_election.cc:290] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:27.269536 11825 leader_election.cc:290] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:27.263427 10923 raft_consensus.cc:2468] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 3.
I20260709 12:24:27.272043 11804 leader_election.cc:290] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:24:27.272760 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 91937.5us
I20260709 12:24:27.275076 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:27.275970 10923 raft_consensus.cc:2468] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 2.
I20260709 12:24:27.278215 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:27.278414 11796 raft_consensus.cc:2749] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945) with higher term. Message: Invalid argument: T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for earlier term 2. Current term is 3.
I20260709 12:24:27.278762 10895 leader_election.cc:304] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:27.278956 11003 raft_consensus.cc:3060] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:27.279805 11805 raft_consensus.cc:2804] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:27.280292 11805 raft_consensus.cc:697] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 2 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:27.281155 11805 consensus_queue.cc:237] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:27.287565 10819 leader_election.cc:304] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:27.288147 11771 raft_consensus.cc:493] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:27.288611 11771 raft_consensus.cc:515] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:27.290352 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:27.290676 11771 leader_election.cc:290] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:27.290827 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:27.291611 10999 raft_consensus.cc:2368] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for earlier term 2. Current term is 3.
I20260709 12:24:27.292742 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:27.292894 11003 raft_consensus.cc:2468] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 3.
I20260709 12:24:27.291332 11771 raft_consensus.cc:2804] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:27.287741 10920 raft_consensus.cc:1275] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:27.293434 10999 raft_consensus.cc:2393] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 2: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:24:27.293532 11771 raft_consensus.cc:493] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:27.293979 11771 raft_consensus.cc:3060] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:27.295915 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:27.296921 10850 raft_consensus.cc:1240] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:27.296908 11000 raft_consensus.cc:2468] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 2.
I20260709 12:24:27.298110 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:27.298810 10851 raft_consensus.cc:3060] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:27.300403 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:27.301072 11000 raft_consensus.cc:2468] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 2.
I20260709 12:24:27.303316 10848 raft_consensus.cc:1275] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:24:27.297886 10997 raft_consensus.cc:1275] T a6a28416571247df878823d464c05f1e P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:24:27.305181 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:27.306094 10845 raft_consensus.cc:2393] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 2: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:24:27.306685 10968 leader_election.cc:304] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:27.265450 10752 catalog_manager.cc:5697] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:27.308883 10994 raft_consensus.cc:2468] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 2.
I20260709 12:24:27.310834 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:27.314363 10920 raft_consensus.cc:2468] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 1.
I20260709 12:24:27.314224 11806 consensus_queue.cc:1048] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:27.316992 10819 leader_election.cc:304] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:27.311513 11804 consensus_queue.cc:1048] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:24:27.325198 11826 raft_consensus.cc:2804] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:27.311161 11825 raft_consensus.cc:493] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:27.326437 10820 leader_election.cc:304] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:27.334916 10895 leader_election.cc:400] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 election: Vote denied by peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945) with higher term. Message: Invalid argument: T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for earlier term 2. Current term is 3.
I20260709 12:24:27.335255 10895 leader_election.cc:403] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:24:27.327060 11826 raft_consensus.cc:493] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:27.336331 11826 raft_consensus.cc:3060] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:27.328454 10851 raft_consensus.cc:2468] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 3.
I20260709 12:24:27.337318 11797 raft_consensus.cc:3060] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:27.328986 11825 raft_consensus.cc:515] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:27.342103 11825 leader_election.cc:290] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:27.346580 11797 raft_consensus.cc:2749] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945) with higher term. Message: Invalid argument: T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for earlier term 2. Current term is 3.
I20260709 12:24:27.346940 10895 leader_election.cc:304] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
W20260709 12:24:27.358481 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 51870.3us
I20260709 12:24:27.366972 11805 raft_consensus.cc:2804] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:27.367467 11805 raft_consensus.cc:493] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:27.367501 11806 consensus_queue.cc:1048] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:27.367982 11805 raft_consensus.cc:3060] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:27.369127 11800 consensus_queue.cc:1059] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:27.370041 11753 raft_consensus.cc:3055] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:27.370389 11753 raft_consensus.cc:740] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:27.367059 10895 leader_election.cc:304] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:24:27.348670 11747 consensus_queue.cc:1048] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:24:27.377596 11805 raft_consensus.cc:515] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:27.359766 11811 raft_consensus.cc:2804] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:27.358312 11771 raft_consensus.cc:515] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:27.381248 11811 raft_consensus.cc:697] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:27.382153 11811 consensus_queue.cc:237] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:27.382679 11771 leader_election.cc:290] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:27.356381 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:27.383436 10994 raft_consensus.cc:2468] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 1.
I20260709 12:24:27.357264 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:27.351817 11748 raft_consensus.cc:2804] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:27.384553 10851 raft_consensus.cc:3060] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:27.395701 11835 raft_consensus.cc:493] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:27.396741 11835 raft_consensus.cc:515] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:27.399984 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 47339.4us
I20260709 12:24:27.376854 11826 raft_consensus.cc:515] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:27.384008 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:27.403827 11003 raft_consensus.cc:2393] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 2: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:24:27.384654 11748 raft_consensus.cc:697] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 3 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:27.371265 11753 consensus_queue.cc:260] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:27.386101 10820 leader_election.cc:304] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:27.387529 11802 raft_consensus.cc:2804] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:27.389395 10750 catalog_manager.cc:5697] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 1 to 2, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 2 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:27.392143 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:27.399181 11835 leader_election.cc:290] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:27.404330 10926 raft_consensus.cc:1275] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:27.420073 10851 raft_consensus.cc:2468] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 3.
I20260709 12:24:27.380224 11797 consensus_queue.cc:1048] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:27.405417 10924 raft_consensus.cc:1275] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:27.397461 10752 catalog_manager.cc:5697] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 1 to 2, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 2 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:27.410399 10848 raft_consensus.cc:1275] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:27.411160 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:27.440775 10994 raft_consensus.cc:2468] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 2.
I20260709 12:24:27.414440 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:27.413744 10845 raft_consensus.cc:1275] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:27.416383 11748 consensus_queue.cc:237] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:27.446157 10820 leader_election.cc:304] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:27.447749 10968 leader_election.cc:304] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:27.416908 10846 raft_consensus.cc:1275] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:27.417320 10850 raft_consensus.cc:1275] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:27.417585 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:27.417917 11829 raft_consensus.cc:2804] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:27.418406 11753 raft_consensus.cc:3060] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:27.419740 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:27.454599 10927 raft_consensus.cc:2468] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 2.
W20260709 12:24:27.458540 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 43709.4us
I20260709 12:24:27.437804 11802 raft_consensus.cc:697] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:27.454047 11771 raft_consensus.cc:2804] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:27.458052 11836 consensus_queue.cc:1048] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:24:27.466751 11802 consensus_queue.cc:237] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:27.455246 11806 raft_consensus.cc:2804] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:27.458175 11829 raft_consensus.cc:493] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:27.470549 11771 raft_consensus.cc:493] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:27.483354 11836 consensus_queue.cc:1048] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:27.481087 11810 consensus_queue.cc:1048] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:24:27.492676 10854 raft_consensus.cc:1275] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:27.478634 11829 raft_consensus.cc:3060] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:27.463828 11828 consensus_queue.cc:1048] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 12:24:27.481726 10845 raft_consensus.cc:1275] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:27.498728 11800 consensus_queue.cc:1048] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:27.482605 11771 raft_consensus.cc:3060] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:27.503249 11736 raft_consensus.cc:493] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:27.515029 11736 raft_consensus.cc:515] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:27.497503 11826 leader_election.cc:290] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:27.543120 11736 leader_election.cc:290] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:27.547389 10849 raft_consensus.cc:1275] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:27.545416 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:27.551213 10923 raft_consensus.cc:3060] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:27.536791 11805 leader_election.cc:290] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:27.544950 11811 consensus_queue.cc:1048] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:24:27.553268 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:27.541476 11806 raft_consensus.cc:697] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:27.561709 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:27.562880 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:27.563930 11003 raft_consensus.cc:3060] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:27.570408 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:27.571213 10994 raft_consensus.cc:2468] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 2.
I20260709 12:24:27.576970 10820 leader_election.cc:304] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:27.584913 11736 raft_consensus.cc:2804] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:27.585883 11736 raft_consensus.cc:493] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:27.586333 11736 raft_consensus.cc:3060] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:27.578069 10845 raft_consensus.cc:2368] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for earlier term 2. Current term is 3.
I20260709 12:24:27.563371 11844 consensus_queue.cc:1048] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
W20260709 12:24:27.646198 10895 consensus_peers.cc:597] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613): Couldn't send request to peer 3c52e0825c02476e89d84da9bb849f5d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a6a28416571247df878823d464c05f1e. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:27.646765 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 241848us
I20260709 12:24:27.654722 11771 raft_consensus.cc:515] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:27.657202 11003 raft_consensus.cc:2468] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 3.
I20260709 12:24:27.657874 10925 raft_consensus.cc:2468] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 2.
W20260709 12:24:27.659363 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 74715.1us
I20260709 12:24:27.595293 11797 raft_consensus.cc:493] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:27.664319 11736 raft_consensus.cc:515] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:27.662112 10969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:27.678169 11736 leader_election.cc:290] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:27.684173 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:27.685230 10994 raft_consensus.cc:2368] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for earlier term 2. Current term is 3.
I20260709 12:24:27.663977 11829 raft_consensus.cc:515] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:27.678369 11797 raft_consensus.cc:515] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:27.686916 10846 raft_consensus.cc:1240] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 3 LEADER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:27.687302 11829 leader_election.cc:290] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:27.687969 11800 consensus_queue.cc:1048] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:27.688483 11797 leader_election.cc:290] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:27.704556 10994 raft_consensus.cc:1275] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:27.705046 11000 raft_consensus.cc:1240] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:27.707383 10925 raft_consensus.cc:1275] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:27.709460 10846 raft_consensus.cc:1275] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:27.600155 11806 consensus_queue.cc:237] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:27.710618 11771 leader_election.cc:290] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:27.711117 10997 raft_consensus.cc:1275] T 442726a7f1e441248ec80a98b31eb341 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:27.721218 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:27.706748 10820 leader_election.cc:304] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:27.739727 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:27.740602 11000 raft_consensus.cc:3060] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:24:27.742913 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:27.743701 10994 raft_consensus.cc:3060] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:27.729910 11825 raft_consensus.cc:2804] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:27.763787 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:27.764750 10997 raft_consensus.cc:3060] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:27.736599 10845 raft_consensus.cc:1275] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:27.774802 10994 raft_consensus.cc:2468] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 3.
I20260709 12:24:27.777575 11825 raft_consensus.cc:697] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 3 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:27.833199 10997 raft_consensus.cc:2468] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 3.
I20260709 12:24:27.836365 11825 consensus_queue.cc:237] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:27.836710 10750 catalog_manager.cc:5697] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 2 to 3, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 3 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:27.838891 10895 leader_election.cc:400] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 election: Vote denied by peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945) with higher term. Message: Invalid argument: T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for earlier term 2. Current term is 3.
I20260709 12:24:27.840325 10895 leader_election.cc:403] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:24:27.844199 10920 raft_consensus.cc:2468] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 3.
I20260709 12:24:27.848047 11796 consensus_queue.cc:1048] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:27.855865 11828 consensus_queue.cc:1059] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:24:27.792824 10820 leader_election.cc:304] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
W20260709 12:24:27.866323 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 73672.3us
I20260709 12:24:27.863286 11828 raft_consensus.cc:3055] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:27.863871 10923 raft_consensus.cc:2468] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 3.
I20260709 12:24:27.870712 11827 raft_consensus.cc:2749] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945) with higher term. Message: Invalid argument: T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for earlier term 2. Current term is 3.
W20260709 12:24:27.878544 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 289594us
I20260709 12:24:27.883154 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:27.884084 10925 raft_consensus.cc:3060] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:27.871989 11829 raft_consensus.cc:2804] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:27.872628 11828 raft_consensus.cc:740] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:27.872906 11796 consensus_queue.cc:1048] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:24:27.914872 11000 raft_consensus.cc:2468] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 3.
I20260709 12:24:27.910951 11829 raft_consensus.cc:697] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 3 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:27.927376 10925 raft_consensus.cc:2468] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 3.
I20260709 12:24:27.905283 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:27.938107 10820 leader_election.cc:304] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:27.939958 10820 leader_election.cc:304] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:27.948140 10819 leader_election.cc:304] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:27.922859 11829 consensus_queue.cc:237] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:27.968226 11843 raft_consensus.cc:2804] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:27.949052 11828 consensus_queue.cc:260] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:27.986474 11835 raft_consensus.cc:2804] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:28.017050 11835 raft_consensus.cc:697] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 3 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:28.018141 11835 consensus_queue.cc:237] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:28.021687 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:27.986727 11826 raft_consensus.cc:2804] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:28.032002 11826 raft_consensus.cc:697] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 2 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:28.033696 11826 consensus_queue.cc:237] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:27.988682 11843 raft_consensus.cc:697] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 3 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:28.006915 11828 raft_consensus.cc:3060] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:28.012706 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:28.040141 11811 raft_consensus.cc:493] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:28.060588 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 386855us
I20260709 12:24:28.060853 10846 raft_consensus.cc:2468] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 2.
I20260709 12:24:28.064208 11811 raft_consensus.cc:515] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:28.063129 11836 consensus_queue.cc:1048] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 12:24:28.131296 10997 raft_consensus.cc:1240] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:28.079847 11844 consensus_queue.cc:1048] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 12:24:28.165851 10894 leader_election.cc:400] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 election: Vote denied by peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265) with higher term. Message: Invalid argument: T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for earlier term 2. Current term is 3.
I20260709 12:24:28.171437 10999 raft_consensus.cc:1240] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:28.081626 11843 consensus_queue.cc:237] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:28.201172 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 261431us
W20260709 12:24:28.258472 11852 log.cc:927] Time spent T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:24:28.355238 11861 consensus_queue.cc:1059] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:28.355381 11811 leader_election.cc:290] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:24:28.369158 11845 log.cc:927] Time spent T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.311s	user 0.000s	sys 0.001s
W20260709 12:24:28.370639 11855 log.cc:927] Time spent T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 12:24:28.215288 11797 consensus_queue.cc:1059] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.136s
W20260709 12:24:28.447551 11850 log.cc:927] Time spent T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.245s	user 0.000s	sys 0.001s
W20260709 12:24:28.449048 11856 log.cc:927] Time spent T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
W20260709 12:24:28.450824 11858 log.cc:927] Time spent T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.171s	user 0.000s	sys 0.005s
W20260709 12:24:28.455673 10819 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.000s	sys 0.058s
W20260709 12:24:28.456036 10819 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.000s	sys 0.058s
W20260709 12:24:28.457572 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 509515us
W20260709 12:24:28.459319 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 379581us
I20260709 12:24:28.439056 11754 raft_consensus.cc:3055] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:28.480711 10853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56394 (request call id 722) took 1070 ms. Trace:
I20260709 12:24:28.481374 10853 rpcz_store.cc:276] 0709 12:24:27.409906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:27.415360 (+  5454us) service_pool.cc:224] Handling call
0709 12:24:27.466534 (+ 51174us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:27.466941 (+   407us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:27.466971 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:27.469262 (+  2291us) log.cc:844] Serialized 499 byte log entry
0709 12:24:27.879041 (+409779us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:27.895161 (+ 16120us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:27.899920 (+  4759us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:28.480329 (+580409us) raft_consensus.cc:1685] finished
0709 12:24:28.480379 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:28.480590 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":393962,"threads_started":1,"wal-append.queue_time_us":572175}
I20260709 12:24:28.483180 10894 leader_election.cc:304] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:28.463593 10750 catalog_manager.cc:5697] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:28.493856 10750 catalog_manager.cc:5697] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:28.520537 11747 raft_consensus.cc:493] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:28.521270 11747 raft_consensus.cc:515] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:28.527266 11842 consensus_queue.cc:1048] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:24:28.486734 11754 raft_consensus.cc:740] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
W20260709 12:24:28.530859 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 313473us
I20260709 12:24:28.492317 11810 raft_consensus.cc:2804] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:28.553247 11747 leader_election.cc:290] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:24:28.565614 10925 raft_consensus.cc:1275] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:28.549045 11810 raft_consensus.cc:493] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:28.508328 11811 consensus_queue.cc:1048] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 12:24:28.550491 11754 consensus_queue.cc:260] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:28.569263 11810 raft_consensus.cc:3060] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:28.595652 10853 raft_consensus.cc:1240] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 3 LEADER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:28.620581 11827 raft_consensus.cc:493] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.621755 11754 raft_consensus.cc:3060] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:28.661432 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 110240us
I20260709 12:24:28.665540 11000 raft_consensus.cc:1275] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:28.646781 11796 raft_consensus.cc:3055] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:28.790839 11864 ts_tablet_manager.cc:933] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d: Initiating tablet copy from peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:28.793435 11736 raft_consensus.cc:493] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:28.794135 11736 raft_consensus.cc:515] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:28.781910 11796 raft_consensus.cc:740] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:28.658450 11827 raft_consensus.cc:515] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:28.814891 11736 leader_election.cc:290] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:28.827677 11848 raft_consensus.cc:493] T e3d9a61ecaf84695b70f8519ee57706f P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:28.828464 11848 raft_consensus.cc:515] T e3d9a61ecaf84695b70f8519ee57706f P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:28.829200 11002 raft_consensus.cc:1275] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:28.792528 11805 raft_consensus.cc:493] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.796208 11836 raft_consensus.cc:493] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.860323 10924 raft_consensus.cc:1275] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:28.862651 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:28.863308 10925 raft_consensus.cc:2468] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 2.
W20260709 12:24:28.873512 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 210040us
I20260709 12:24:28.877897 10854 raft_consensus.cc:1240] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 3 LEADER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 2. Current term is 3. Ops: []
W20260709 12:24:28.857012 11826 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.013s	sys 0.052s
I20260709 12:24:28.895288 11736 consensus_queue.cc:1048] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:28.841411 11805 raft_consensus.cc:515] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:28.909032 11865 log.cc:927] Time spent T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.237s	user 0.000s	sys 0.001s
I20260709 12:24:28.910766 10995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37500 (request call id 752) took 1027 ms. Trace:
I20260709 12:24:28.896031 11825 raft_consensus.cc:493] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:28.913168 11825 raft_consensus.cc:515] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:28.912739 10995 rpcz_store.cc:276] 0709 12:24:27.883773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:27.885302 (+  1529us) service_pool.cc:224] Handling call
0709 12:24:27.885703 (+   401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:27.886107 (+   404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:27.886146 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:27.899687 (+ 13541us) log.cc:844] Serialized 26 byte log entry
0709 12:24:28.209764 (+310077us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:28.209802 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:28.209866 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:28.910256 (+700390us) raft_consensus.cc:1685] finished
0709 12:24:28.910287 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:28.910515 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":425,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":2092,"spinlock_wait_cycles":5376,"thread_start_us":306639,"threads_started":1,"wal-append.queue_time_us":648589}
I20260709 12:24:28.929809 11879 raft_consensus.cc:493] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:28.931253 11879 raft_consensus.cc:515] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:28.865088 11796 consensus_queue.cc:260] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:28.966243 11825 leader_election.cc:290] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:28.967126 10921 raft_consensus.cc:1275] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:28.967761 11848 leader_election.cc:290] T e3d9a61ecaf84695b70f8519ee57706f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:28.844179 11836 raft_consensus.cc:515] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:28.954490 11796 raft_consensus.cc:3060] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:28.980976 11864 tablet_copy_client.cc:323] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Beginning tablet copy session from remote peer at address 127.9.116.66:39339
I20260709 12:24:28.981688 11811 raft_consensus.cc:493] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
W20260709 12:24:28.994410 11857 log.cc:927] Time spent T a6a28416571247df878823d464c05f1e P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.676s	user 0.013s	sys 0.000s
I20260709 12:24:28.996127 11879 leader_election.cc:290] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:28.996623 11003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37500 (request call id 736) took 1317 ms. Trace:
I20260709 12:24:28.996990 11003 rpcz_store.cc:276] 0709 12:24:27.679325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:27.680311 (+   986us) service_pool.cc:224] Handling call
0709 12:24:27.680812 (+   501us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:27.681267 (+   455us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:27.681308 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:27.731717 (+ 50409us) log.cc:844] Serialized 499 byte log entry
0709 12:24:28.074483 (+342766us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:28.074529 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:28.074616 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:28.983534 (+908918us) spinlock_profiling.cc:243] Waited 24.3 ms on lock 0x7b4400022b4c. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7591c23db1 00007f7591cc1c85 00007f7591cc26a2 00007f7594a341db 00007f7594a2faaf 00007f7594a2386e 00007f7594a22bb6 00007f7594a227d8 00007f7594a2c221 00007f7594a2c1d9 00007f7594a2c169
0709 12:24:28.996259 (+ 12725us) raft_consensus.cc:1685] finished
0709 12:24:28.996281 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:28.996517 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":55881984,"thread_start_us":338045,"threads_started":1,"wal-append.queue_time_us":415093}
I20260709 12:24:28.998726 11872 raft_consensus.cc:493] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
W20260709 12:24:29.002058 10893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:29.001974 11872 raft_consensus.cc:515] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:28.999320 11811 raft_consensus.cc:515] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:29.025786 11827 leader_election.cc:290] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:29.030579 11836 leader_election.cc:290] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:29.037281 10852 raft_consensus.cc:1275] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:29.042184 10845 raft_consensus.cc:1275] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:29.044039 11872 leader_election.cc:290] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:29.043476 11870 raft_consensus.cc:2955] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:24:29.045696 11805 leader_election.cc:290] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:29.019446 11811 leader_election.cc:290] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:24:29.063118 11853 log.cc:927] Time spent T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.936s	user 0.011s	sys 0.044s
I20260709 12:24:29.064878 10848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56394 (request call id 727) took 1574 ms. Trace:
I20260709 12:24:29.065251 10848 rpcz_store.cc:276] 0709 12:24:27.490253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:27.490400 (+   147us) service_pool.cc:224] Handling call
0709 12:24:27.490721 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:27.491048 (+   327us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:27.491073 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:27.495208 (+  4135us) log.cc:844] Serialized 26 byte log entry
0709 12:24:27.949592 (+454384us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:27.949630 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:27.949703 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:29.049596 (+1099893us) spinlock_profiling.cc:243] Waited 5.02 ms on lock 0x7b4400022b4c. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7591c23db1 00007f7591cc1c85 00007f7591cc26a2 00007f7594a341db 00007f7594a2faaf 00007f7594a2386e 00007f7594a22bb6 00007f7594a227d8 00007f7594a2c221 00007f7594a2c1d9 00007f7594a2c169
0709 12:24:29.064591 (+ 14995us) raft_consensus.cc:1685] finished
0709 12:24:29.064611 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:29.064821 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":442,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":3730,"spinlock_wait_cycles":11555072,"thread_start_us":427199,"threads_started":1,"wal-append.queue_time_us":555746}
I20260709 12:24:29.067503 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
W20260709 12:24:29.069830 11804 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.005s	sys 0.020s
I20260709 12:24:29.070318 11811 raft_consensus.cc:493] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
W20260709 12:24:29.126767 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 65546.7us
W20260709 12:24:29.106388 11804 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.006s	sys 0.020s
I20260709 12:24:29.109779 10939 tablet_copy_service.cc:140] P e2d5c637307a407ab688f5ccd6f0fcea: Received BeginTabletCopySession request for tablet a6a28416571247df878823d464c05f1e from peer 3c52e0825c02476e89d84da9bb849f5d ({username='slave'} at 127.0.0.1:50036)
W20260709 12:24:29.202054 11754 consensus_meta.cc:287] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea: Time spent flushing consensus metadata: real 0.531s	user 0.013s	sys 0.000s
W20260709 12:24:29.196121 11810 consensus_meta.cc:287] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent flushing consensus metadata: real 0.571s	user 0.013s	sys 0.000s
I20260709 12:24:29.207474 11810 raft_consensus.cc:515] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:29.207778 10939 tablet_copy_service.cc:161] P e2d5c637307a407ab688f5ccd6f0fcea: Beginning new tablet copy session on tablet a6a28416571247df878823d464c05f1e from peer 3c52e0825c02476e89d84da9bb849f5d at {username='slave'} at 127.0.0.1:50036: session id = 3c52e0825c02476e89d84da9bb849f5d-a6a28416571247df878823d464c05f1e
I20260709 12:24:29.210225 11810 leader_election.cc:290] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:29.211031 10922 raft_consensus.cc:1240] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:29.198319 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d9a61ecaf84695b70f8519ee57706f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:29.215468 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:24:29.225639 10892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:29.193152 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6a1da21304fcfacab384a6afc4101" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:29.219336 10921 raft_consensus.cc:1275] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:24:29.232817 10921 pending_rounds.cc:85] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea: Aborting all ops after (but not including) 1
I20260709 12:24:29.156414 11748 raft_consensus.cc:493] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:29.239908 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 62688.7us
I20260709 12:24:29.237879 10921 pending_rounds.cc:107] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:24:29.234126 11811 raft_consensus.cc:515] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:29.259680 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 356948us
I20260709 12:24:29.292959 11882 raft_consensus.cc:493] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:29.293778 11882 raft_consensus.cc:515] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:29.263214 10929 raft_consensus.cc:1275] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:24:29.243191 11748 raft_consensus.cc:515] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:29.261013 10921 raft_consensus.cc:2889] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:29.308876 10929 pending_rounds.cc:85] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea: Aborting all ops after (but not including) 1
I20260709 12:24:29.337808 10929 pending_rounds.cc:107] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:24:29.307103 11843 consensus_queue.cc:1048] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 12:24:29.353740 10929 raft_consensus.cc:2889] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:29.355504 11748 leader_election.cc:290] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:29.360677 11753 consensus_queue.cc:1048] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:24:29.373021 11869 consensus_queue.cc:1048] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:24:29.373948 11885 consensus_queue.cc:1048] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 12:24:29.365907 11846 raft_consensus.cc:493] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:29.354511 11804 consensus_queue.cc:1048] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:24:29.387624 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac8522e549a46e09593fa4c2e175557" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:24:29.378078 11829 raft_consensus.cc:493] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
W20260709 12:24:29.384330 11892 log.cc:927] Time spent T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.063s	user 0.000s	sys 0.007s
I20260709 12:24:29.387655 11893 raft_consensus.cc:493] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
W20260709 12:24:29.393926 10894 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.007s	sys 0.020s
W20260709 12:24:29.410231 10894 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.007s	sys 0.020s
W20260709 12:24:29.410641 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 626809us
I20260709 12:24:29.411713 10995 raft_consensus.cc:1240] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:24:29.406296 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:29.417392 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:29.418386 10968 leader_election.cc:304] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:24:29.427034 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:29.439724 11868 consensus_queue.cc:1048] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:24:29.409521 11811 leader_election.cc:290] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:29.399919 11771 consensus_queue.cc:1048] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:24:29.454360 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:29.454118 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:29.389467 11846 raft_consensus.cc:515] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:29.455191 11890 log.cc:927] Time spent T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.059s	user 0.000s	sys 0.003s
I20260709 12:24:29.410761 11800 raft_consensus.cc:493] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:29.437268 11842 raft_consensus.cc:493] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:29.446748 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:29.441926 11760 raft_consensus.cc:2804] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:29.408675 11829 raft_consensus.cc:515] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:29.463714 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:29.468964 11747 raft_consensus.cc:493] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:29.469621 11747 raft_consensus.cc:515] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:29.470770 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 47711.6us
I20260709 12:24:29.482493 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac8522e549a46e09593fa4c2e175557" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:29.484441 11747 leader_election.cc:290] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:29.497668 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:29.463500 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:29.499466 11882 leader_election.cc:290] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:29.500062 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:29.467139 11760 raft_consensus.cc:493] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:29.482916 10854 raft_consensus.cc:2955] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:24:29.496904 11869 raft_consensus.cc:493] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:29.464910 11806 consensus_queue.cc:1048] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 12:24:29.509011 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:29.475601 11800 raft_consensus.cc:515] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:29.481917 11842 raft_consensus.cc:515] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:29.519451 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:29.486564 10851 raft_consensus.cc:2468] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 3.
I20260709 12:24:29.459762 11893 raft_consensus.cc:515] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:29.511348 11869 raft_consensus.cc:515] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:29.583678 11842 leader_election.cc:290] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:24:29.613773 10966 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.031s	sys 0.043s
W20260709 12:24:29.616916 10966 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.031s	sys 0.043s
I20260709 12:24:29.510459 11760 raft_consensus.cc:3060] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:29.587561 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:29.620137 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:29.620949 11884 raft_consensus.cc:493] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:29.621444 10853 raft_consensus.cc:2393] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 3: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:24:29.591331 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:29.595090 11881 raft_consensus.cc:493] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:29.646498 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:29.648435 11001 raft_consensus.cc:2468] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 3.
I20260709 12:24:29.640640 11771 raft_consensus.cc:493] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:29.523828 11872 raft_consensus.cc:493] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:29.559705 11843 raft_consensus.cc:493] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:29.652664 10895 leader_election.cc:304] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040
W20260709 12:24:29.663048 10892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:29.670151 11870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:50034 (request call id 1) took 2475 ms. Trace:
I20260709 12:24:29.621615 11884 raft_consensus.cc:515] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:29.639026 10999 raft_consensus.cc:2955] T a6a28416571247df878823d464c05f1e P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:24:29.645102 11811 raft_consensus.cc:493] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:29.676724 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:29.678067 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:29.669550 11771 raft_consensus.cc:515] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:29.681608 11001 raft_consensus.cc:1275] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:29.682119 11811 raft_consensus.cc:515] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:29.672736 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:29.694145 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:29.682192 11800 leader_election.cc:290] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:29.700639 11800 raft_consensus.cc:493] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:29.674846 11881 raft_consensus.cc:515] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:29.692755 10920 raft_consensus.cc:2468] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 2.
I20260709 12:24:29.699011 11771 leader_election.cc:290] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:29.673396 11872 raft_consensus.cc:515] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:29.680199 11754 raft_consensus.cc:2749] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:29.701297 11800 raft_consensus.cc:515] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } }
I20260709 12:24:29.703706 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d9a61ecaf84695b70f8519ee57706f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:29.675900 11843 raft_consensus.cc:515] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:29.687175 11884 leader_election.cc:290] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:29.721742 11000 raft_consensus.cc:1275] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:29.724234 10895 leader_election.cc:304] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:29.715024 11844 raft_consensus.cc:493] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:29.736136 10817 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.016s	sys 0.082s
W20260709 12:24:29.747830 10817 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.016s	sys 0.082s
I20260709 12:24:29.764741 11754 raft_consensus.cc:2749] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:29.764695 10895 leader_election.cc:304] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:29.736878 11844 raft_consensus.cc:515] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:29.785802 11000 raft_consensus.cc:1275] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:24:29.812980 11857 log.cc:927] Time spent T a6a28416571247df878823d464c05f1e P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:24:29.773996 11771 raft_consensus.cc:493] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:29.773002 11869 leader_election.cc:290] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:29.815284 11881 leader_election.cc:290] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:24:29.830901 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 66329.7us
W20260709 12:24:29.833353 10846 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.020s	sys 0.005s
I20260709 12:24:29.832993 10895 leader_election.cc:304] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:29.825596 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:29.836225 11881 raft_consensus.cc:2749] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:24:29.879513 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 46815.1us
I20260709 12:24:29.887056 10895 leader_election.cc:304] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:29.841336 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:29.901023 10894 leader_election.cc:304] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:24:29.876720 10922 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.002s	sys 0.022s
W20260709 12:24:29.876365 10846 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.675s	user 0.021s	sys 0.005s
I20260709 12:24:29.888921 10895 leader_election.cc:304] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:29.825865 11771 raft_consensus.cc:515] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:29.893502 11754 raft_consensus.cc:2749] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:29.886073 11843 leader_election.cc:290] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:29.939229 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
W20260709 12:24:29.895991 10929 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.006s	sys 0.029s
W20260709 12:24:29.918484 11883 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.023s	sys 0.026s
I20260709 12:24:29.925822 11802 raft_consensus.cc:2749] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:29.947348 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:29.953948 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c6d38c4d8a90a81975a6a0cb13" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
W20260709 12:24:29.946318 10926 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.032s	sys 0.020s
I20260709 12:24:29.674582 11870 rpcz_store.cc:276] 0709 12:24:27.170299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:27.171295 (+   996us) service_pool.cc:224] Handling call
0709 12:24:27.219077 (+ 47782us) spinlock_profiling.cc:243] Waited 7.68 ms on lock 0x7b58001a1bd0. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594de40aa 00007f7594e66447 00007f7594e8370a 00007f7594e8476a 00007f7594e8391b 00007f7594e8f03c 00007f7594e8e6b3 00007f7599e4ed29 00007f75933cd1d4 00007f75933cd162
0709 12:24:27.225181 (+  6104us) log.cc:844] Serialized 499 byte log entry
0709 12:24:29.645152 (+2419971us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20922,"raft.queue_time_us":22157,"raft.run_cpu_time_us":1661,"raft.run_wall_time_us":2360,"spinlock_wait_cycles":19484416,"thread_start_us":26690,"threads_started":1,"wal-append.queue_time_us":42023,"wal-append.run_cpu_time_us":2707,"wal-append.run_wall_time_us":1032219}
I20260709 12:24:29.934017 11800 leader_election.cc:290] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265)
W20260709 12:24:29.953579 11883 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.023s	sys 0.026s
W20260709 12:24:29.945276 10929 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.007s	sys 0.030s
W20260709 12:24:29.959785 10926 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.032s	sys 0.020s
I20260709 12:24:29.968770 11846 leader_election.cc:290] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:29.941972 11829 leader_election.cc:290] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:29.946611 11899 raft_consensus.cc:2749] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:29.972483 10928 raft_consensus.cc:2410] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:24:29.972477 10997 raft_consensus.cc:2410] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:24:29.997678 10926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59622 (request call id 599) took 1125 ms. Trace:
W20260709 12:24:30.006734 10849 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.017s	sys 0.033s
W20260709 12:24:30.064652 10849 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.017s	sys 0.033s
I20260709 12:24:30.063629 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:30.064340 10926 rpcz_store.cc:276] 0709 12:24:28.860191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:28.890237 (+ 30046us) service_pool.cc:224] Handling call
0709 12:24:28.890678 (+   441us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:28.890964 (+   286us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:24:29.300383 (+409419us) log.cc:844] Serialized 14 byte log entry
0709 12:24:29.984721 (+684338us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:29.984798 (+    77us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:29.984878 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:29.984991 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:29.985176 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11480,"prepare.queue_time_us":77138,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":13289,"thread_start_us":1073559,"threads_started":2}
I20260709 12:24:30.105700 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:24:30.103736 10968 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.012s	sys 0.006s
W20260709 12:24:30.111682 10968 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.013s	sys 0.007s
I20260709 12:24:29.981099 11844 leader_election.cc:290] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:24:30.115207 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 676532us
W20260709 12:24:29.983981 11891 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.005s	sys 0.022s
I20260709 12:24:30.107348 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:30.104300 11805 raft_consensus.cc:2804] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:30.064090 11854 raft_consensus.cc:493] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:30.100880 11800 raft_consensus.cc:493] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
W20260709 12:24:30.175699 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 50144us
I20260709 12:24:30.119463 11883 raft_consensus.cc:493] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:30.125486 11828 raft_consensus.cc:493] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
W20260709 12:24:30.230365 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 57429.6us
I20260709 12:24:30.228873 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:30.146588 11844 raft_consensus.cc:493] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
W20260709 12:24:30.226145 11853 log.cc:927] Time spent T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:24:30.239586 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:30.283653 11736 raft_consensus.cc:493] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:30.281894 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:30.240684 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:30.240969 11828 raft_consensus.cc:515] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:30.298619 11907 consensus_queue.cc:1059] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.154s
I20260709 12:24:30.229514 11869 raft_consensus.cc:493] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:30.230209 11885 raft_consensus.cc:493] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:30.219301 11846 raft_consensus.cc:493] T e8b17195a94142039c40f598ed006c94 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:30.347172 11736 raft_consensus.cc:515] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:30.348822 11002 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.727s	user 0.050s	sys 0.089s
W20260709 12:24:30.377303 11002 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.050s	sys 0.089s
I20260709 12:24:30.284451 11842 raft_consensus.cc:493] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
W20260709 12:24:30.367029 11913 log.cc:927] Time spent T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.189s	user 0.001s	sys 0.002s
I20260709 12:24:30.229456 11854 raft_consensus.cc:515] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:30.380226 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:30.442132 11736 leader_election.cc:290] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:30.234328 11883 raft_consensus.cc:515] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:30.228175 11800 raft_consensus.cc:515] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:30.368558 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:30.343662 11868 raft_consensus.cc:493] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
W20260709 12:24:30.373006 10923 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.017s	sys 0.031s
I20260709 12:24:30.366912 11899 raft_consensus.cc:493] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
W20260709 12:24:30.428174 10998 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.042s	sys 0.069s
W20260709 12:24:30.398561 11911 log.cc:927] Time spent T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.168s	user 0.005s	sys 0.002s
I20260709 12:24:30.436560 11902 raft_consensus.cc:493] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.381928 11771 leader_election.cc:290] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:30.370380 11836 raft_consensus.cc:493] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:30.442315 11000 raft_consensus.cc:2468] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 1.
I20260709 12:24:30.375775 11754 raft_consensus.cc:493] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
W20260709 12:24:30.446666 10998 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.043s	sys 0.069s
I20260709 12:24:30.368162 11844 raft_consensus.cc:515] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:30.378620 11869 raft_consensus.cc:515] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:30.438503 11842 raft_consensus.cc:515] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:30.381232 11885 raft_consensus.cc:515] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:30.467320 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c6d38c4d8a90a81975a6a0cb13" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:24:30.821573 10968 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.001s	sys 0.040s
I20260709 12:24:30.901911 11903 raft_consensus.cc:493] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:31.011546 11754 raft_consensus.cc:515] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:31.011634 11760 consensus_meta.cc:287] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08: Time spent flushing consensus metadata: real 1.370s	user 0.013s	sys 0.008s
W20260709 12:24:30.543807 10994 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.046s	sys 0.064s
I20260709 12:24:31.012533 11800 leader_election.cc:290] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:24:30.740538 11925 log.cc:927] Time spent T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 12:24:31.016517 11861 raft_consensus.cc:493] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:31.016794 11836 raft_consensus.cc:515] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:30.823496 11906 log.cc:927] Time spent T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.813s	user 0.000s	sys 0.004s
I20260709 12:24:30.850278 11797 raft_consensus.cc:493] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:31.038757 11003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37500 (request call id 794) took 1024 ms. Trace:
W20260709 12:24:30.445570 10923 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.017s	sys 0.031s
I20260709 12:24:30.902774 10846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56388 (request call id 584) took 1838 ms. Trace:
I20260709 12:24:30.718684 11907 raft_consensus.cc:3055] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:24:30.555056 11916 log.cc:927] Time spent T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 12:24:30.446458 11872 leader_election.cc:290] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:30.552965 11811 leader_election.cc:290] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:30.541702 11771 raft_consensus.cc:493] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:30.755508 11854 leader_election.cc:290] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:24:30.795753 11915 log.cc:927] Time spent T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.369s	user 0.000s	sys 0.000s
I20260709 12:24:30.551285 11879 raft_consensus.cc:493] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:30.503401 10995 raft_consensus.cc:2468] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 1.
W20260709 12:24:31.024451 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 1.10296e+06us
I20260709 12:24:30.459280 11747 raft_consensus.cc:493] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
W20260709 12:24:31.046257 10968 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.826s	user 0.009s	sys 0.052s
W20260709 12:24:31.055809 10994 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.102s	user 0.064s	sys 0.088s
W20260709 12:24:30.987794 11924 log.cc:927] Time spent T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.483s	user 0.000s	sys 0.001s
I20260709 12:24:30.439862 11802 raft_consensus.cc:493] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:31.019265 11893 leader_election.cc:290] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:24:31.071911 11927 log.cc:927] Time spent T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.518s	user 0.004s	sys 0.007s
I20260709 12:24:30.930945 11895 raft_consensus.cc:493] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
W20260709 12:24:30.543768 10852 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.006s	sys 0.007s
I20260709 12:24:30.437786 11846 raft_consensus.cc:515] T e8b17195a94142039c40f598ed006c94 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:31.070367 11003 rpcz_store.cc:276] 0709 12:24:29.996141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.466853 (+470712us) service_pool.cc:224] Handling call
0709 12:24:31.020822 (+553969us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:31.075700 11847 raft_consensus.cc:493] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:30.881073 11933 raft_consensus.cc:493] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:31.075838 11797 raft_consensus.cc:515] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:30.884014 11883 leader_election.cc:290] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:31.078126 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:30.931259 11932 raft_consensus.cc:493] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:30.547641 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:24:31.108826 10820 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.825s	user 0.042s	sys 0.049s
I20260709 12:24:31.051620 11826 raft_consensus.cc:493] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:31.111511 10847 consensus_queue.cc:237] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:24:31.066942 11760 raft_consensus.cc:515] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:30.455427 11868 raft_consensus.cc:515] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:30.451505 11899 raft_consensus.cc:515] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:30.482318 11902 raft_consensus.cc:515] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:31.156653 11002 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.779s	user 0.022s	sys 0.019s
W20260709 12:24:31.843117 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 1.62258e+06us
W20260709 12:24:31.843935 10820 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.560s	user 0.053s	sys 0.093s
W20260709 12:24:31.178876 10966 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.009s	sys 0.033s
W20260709 12:24:31.845207 10966 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.281s	user 0.028s	sys 0.067s
W20260709 12:24:31.753400 10895 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.742s	user 0.009s	sys 0.027s
W20260709 12:24:31.846680 10895 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.836s	user 0.012s	sys 0.028s
I20260709 12:24:31.166662 11882 raft_consensus.cc:493] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:31.847834 11934 raft_consensus.cc:493] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:31.849212 11934 raft_consensus.cc:515] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:31.843178 11002 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.465s	user 0.039s	sys 0.056s
I20260709 12:24:31.851500 11934 leader_election.cc:290] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:24:31.749187 10926 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.369s	user 0.002s	sys 0.014s
W20260709 12:24:31.763459 10894 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.008s	sys 0.025s
I20260709 12:24:31.773427 10845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56388 (request call id 585) took 2704 ms. Trace:
W20260709 12:24:31.844450 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 1.61042e+06us
I20260709 12:24:31.847443 11747 raft_consensus.cc:515] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:31.509694 11842 leader_election.cc:290] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:31.851821 11002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37500 (request call id 782) took 2231 ms. Trace:
I20260709 12:24:31.859800 11932 raft_consensus.cc:515] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:31.853776 10845 rpcz_store.cc:276] 0709 12:24:29.051644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.060051 (+  8407us) service_pool.cc:224] Handling call
0709 12:24:29.063303 (+  3252us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:29.417512 (+354209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:29.437160 (+ 19648us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:29.455461 (+ 18301us) log.cc:844] Serialized 26 byte log entry
0709 12:24:29.929842 (+474381us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:29.938029 (+  8187us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:29.951702 (+ 13673us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:31.524007 (+1572305us) raft_consensus.cc:1685] finished
0709 12:24:31.564691 (+ 40684us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:31.753422 (+188731us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":121974,"raft.queue_time_us":92567,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":13667,"thread_start_us":704429,"threads_started":2,"wal-append.queue_time_us":668786}
I20260709 12:24:31.855914 11826 raft_consensus.cc:515] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:31.860291 11002 rpcz_store.cc:276] 0709 12:24:29.620525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.620675 (+   150us) service_pool.cc:224] Handling call
0709 12:24:29.621094 (+   419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:29.621336 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:24:30.377802 (+756466us) log.cc:844] Serialized 14 byte log entry
0709 12:24:31.850919 (+1473117us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:31.850998 (+    79us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:31.851055 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.851285 (+   230us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:31.851639 (+   354us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":641412,"prepare.run_cpu_time_us":1912,"prepare.run_wall_time_us":50379,"raft.queue_time_us":6356,"raft.run_cpu_time_us":68,"raft.run_wall_time_us":67,"thread_start_us":2228722,"threads_started":2}
W20260709 12:24:31.853395 10894 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.735s	user 0.008s	sys 0.029s
I20260709 12:24:31.852116 11934 raft_consensus.cc:493] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:31.865604 11934 raft_consensus.cc:515] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:31.853107 11882 raft_consensus.cc:515] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:31.866106 11899 leader_election.cc:290] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:31.868031 11882 leader_election.cc:290] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:31.857028 11933 raft_consensus.cc:515] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:31.873831 10967 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.005s	sys 0.007s
W20260709 12:24:31.874359 10967 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.005s	sys 0.007s
I20260709 12:24:31.875873 11003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37500 (request call id 787) took 1949 ms. Trace:
I20260709 12:24:31.876410 11003 rpcz_store.cc:276] 0709 12:24:29.926793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.875011 (+1948218us) service_pool.cc:224] Handling call
0709 12:24:31.875321 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:31.875486 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:31.875509 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:31.875548 (+    39us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:31.875634 (+    86us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.875687 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:31.875807 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:31.878317 11935 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.801s	user 0.001s	sys 0.014s
W20260709 12:24:31.878832 11935 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.802s	user 0.001s	sys 0.014s
I20260709 12:24:31.250581 11940 raft_consensus.cc:493] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:31.880259 11942 raft_consensus.cc:493] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:31.880231 11940 raft_consensus.cc:515] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:31.880879 11942 raft_consensus.cc:515] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:31.882772 11940 leader_election.cc:290] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:31.883117 11942 leader_election.cc:290] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:31.174844 11885 leader_election.cc:290] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:31.888193 10999 raft_consensus.cc:1240] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:24:31.888680 11000 raft_consensus.cc:2468] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 3.
I20260709 12:24:31.890604 11760 leader_election.cc:290] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:31.892019 11902 leader_election.cc:290] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:31.463451 10925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59622 (request call id 603) took 2399 ms. Trace:
I20260709 12:24:31.079746 10846 rpcz_store.cc:276] 0709 12:24:29.046299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.047047 (+   748us) service_pool.cc:224] Handling call
0709 12:24:29.049527 (+  2480us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:29.099126 (+ 49599us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:29.099166 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:29.201261 (+102095us) log.cc:844] Serialized 26 byte log entry
0709 12:24:29.939230 (+737969us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:29.945428 (+  6198us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:29.955120 (+  9692us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:30.822645 (+867525us) raft_consensus.cc:1685] finished
0709 12:24:30.822680 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:30.881818 (+ 59138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47164,"raft.queue_time_us":96968,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":113,"thread_start_us":721167,"threads_started":1,"wal-append.queue_time_us":780178,"wal-append.run_cpu_time_us":35953,"wal-append.run_wall_time_us":1867832}
I20260709 12:24:31.869465 10997 raft_consensus.cc:2468] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 1.
I20260709 12:24:31.577299 11851 raft_consensus.cc:493] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:31.869920 11934 leader_election.cc:290] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:24:31.870404 10852 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.030s	user 0.031s	sys 0.025s
I20260709 12:24:31.865985 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:31.096553 11828 leader_election.cc:290] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:24:31.854429 10926 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.476s	user 0.003s	sys 0.015s
I20260709 12:24:31.073912 11861 raft_consensus.cc:515] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:31.872291 11826 leader_election.cc:290] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:31.149497 10928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59626 (request call id 739) took 1533 ms. Trace:
I20260709 12:24:31.069808 11843 raft_consensus.cc:493] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:31.893637 10994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37500 (request call id 784) took 2201 ms. Trace:
W20260709 12:24:31.896397 11589 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.732s	user 0.012s	sys 0.008s
I20260709 12:24:31.897142 11951 raft_consensus.cc:493] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:31.857805 11847 raft_consensus.cc:515] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:31.894321 10925 rpcz_store.cc:276] 0709 12:24:28.861637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:28.865032 (+  3395us) service_pool.cc:224] Handling call
0709 12:24:28.865363 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:29.398113 (+532750us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:29.398173 (+    60us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:29.416455 (+ 18282us) log.cc:844] Serialized 26 byte log entry
0709 12:24:29.945180 (+528725us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:29.945221 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:29.945306 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:31.261197 (+1315891us) raft_consensus.cc:1685] finished
0709 12:24:31.261232 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:31.261449 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37013,"raft.queue_time_us":131829,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":99,"thread_start_us":983913,"threads_started":2,"wal-append.queue_time_us":869444}
I20260709 12:24:31.856827 11842 raft_consensus.cc:493] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:31.858882 11836 leader_election.cc:290] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:31.900978 11846 leader_election.cc:290] T e8b17195a94142039c40f598ed006c94 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:31.862725 11932 leader_election.cc:290] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:31.902225 11000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37500 (request call id 789) took 1954 ms. Trace:
I20260709 12:24:31.116135 11872 raft_consensus.cc:493] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:31.073256 11849 raft_consensus.cc:493] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:31.844570 10968 leader_election.cc:304] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:31.095047 11907 raft_consensus.cc:740] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
W20260709 12:24:31.920843 11928 log.cc:927] Time spent T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.868s	user 0.001s	sys 0.001s
W20260709 12:24:31.920989 11586 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.746s	user 0.008s	sys 0.026s
I20260709 12:24:31.922816 11002 raft_consensus.cc:2468] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 1.
I20260709 12:24:31.871224 11943 raft_consensus.cc:493] T d0aed74af73a488f8b691578ca370226 P 3c52e0825c02476e89d84da9bb849f5d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:31.134863 11879 raft_consensus.cc:515] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:31.883318 11940 raft_consensus.cc:493] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
W20260709 12:24:31.840492 11920 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.275s	user 0.013s	sys 0.058s
I20260709 12:24:31.928143 10852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56388 (request call id 588) took 2525 ms. Trace:
I20260709 12:24:31.508373 11800 raft_consensus.cc:493] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:31.583061 11939 raft_consensus.cc:493] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:31.857350 11747 leader_election.cc:290] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:31.115592 11811 raft_consensus.cc:493] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:31.079432 11903 raft_consensus.cc:515] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:31.133140 11771 raft_consensus.cc:515] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:31.576067 11936 raft_consensus.cc:493] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:31.904763 11802 raft_consensus.cc:515] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:31.904006 11895 raft_consensus.cc:515] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:31.906812 10921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59626 (request call id 737) took 2401 ms. Trace:
I20260709 12:24:31.976570 10927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59626 (request call id 740) took 2352 ms. Trace:
W20260709 12:24:31.943749 10969 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.924s	user 0.021s	sys 0.049s
W20260709 12:24:32.019950 10969 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.001s	user 0.026s	sys 0.049s
I20260709 12:24:31.915436 11885 raft_consensus.cc:493] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
W20260709 12:24:32.016609 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 172114us
W20260709 12:24:32.018723 11589 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.854s	user 0.012s	sys 0.019s
I20260709 12:24:32.032109 11932 raft_consensus.cc:493] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:32.032809 10926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59622 (request call id 610) took 2513 ms. Trace:
I20260709 12:24:32.033434 11796 raft_consensus.cc:493] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:32.033356 10926 rpcz_store.cc:276] 0709 12:24:29.519760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.364882 (+845122us) service_pool.cc:224] Handling call
0709 12:24:30.365387 (+   505us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:30.369251 (+  3864us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:24:31.932834 (+1563583us) log.cc:844] Serialized 14 byte log entry
0709 12:24:32.032412 (+ 99578us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:32.032470 (+    58us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:32.032517 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.032606 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:32.032746 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1485034,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":786,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":120,"thread_start_us":1649313,"threads_started":2}
I20260709 12:24:32.015861 10927 rpcz_store.cc:276] 0709 12:24:29.623925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.975554 (+2351629us) service_pool.cc:224] Handling call
0709 12:24:31.975922 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:31.976146 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:31.976183 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:31.976241 (+    58us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:31.976282 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.976351 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:31.976500 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:32.036355 11747 raft_consensus.cc:493] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:32.036875 11747 raft_consensus.cc:515] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:32.042977 11747 leader_election.cc:290] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:32.032806 11932 raft_consensus.cc:515] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:32.045835 11932 leader_election.cc:290] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:32.026249 11771 leader_election.cc:290] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:32.026497 11002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37500 (request call id 790) took 2073 ms. Trace:
I20260709 12:24:32.014808 10994 rpcz_store.cc:276] 0709 12:24:29.642644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.642787 (+   143us) service_pool.cc:224] Handling call
0709 12:24:29.643145 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:29.643390 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:24:29.954022 (+310632us) log.cc:844] Serialized 14 byte log entry
0709 12:24:31.843720 (+1889698us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:31.843776 (+    56us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:31.843814 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.843875 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:31.843978 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":729658,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":12920,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"thread_start_us":2163589,"threads_started":2,"wal-append.queue_time_us":1213723}
I20260709 12:24:32.034276 11796 raft_consensus.cc:515] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:32.048161 11002 rpcz_store.cc:276] 0709 12:24:29.953396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.022562 (+2069166us) service_pool.cc:224] Handling call
0709 12:24:32.022954 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:32.023187 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:32.023225 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:32.023283 (+    58us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:32.023326 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.023399 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:32.023555 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:32.049573 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:32.050374 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:32.051493 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac83709373b4efd9c3aa1472a9f9022" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:32.051359 11796 leader_election.cc:290] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:32.052672 10994 raft_consensus.cc:2468] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 1.
I20260709 12:24:32.017230 11000 rpcz_store.cc:276] 0709 12:24:29.948247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.900961 (+1952714us) service_pool.cc:224] Handling call
0709 12:24:31.901582 (+   621us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:31.901818 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:31.901851 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:31.901930 (+    79us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:31.901959 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.902016 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:31.902155 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:32.053128 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 198251us
I20260709 12:24:32.054031 10820 leader_election.cc:304] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:32.054266 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fd8fdac2fa449e9e184f3d668ea1a7" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:32.052467 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:32.055596 11002 raft_consensus.cc:2468] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 1.
I20260709 12:24:32.055971 11846 raft_consensus.cc:2749] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:32.057297 11002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37500 (request call id 791) took 2098 ms. Trace:
I20260709 12:24:32.054025 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:32.058148 10994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37512 (request call id 757) took 2097 ms. Trace:
I20260709 12:24:32.057734 11002 rpcz_store.cc:276] 0709 12:24:29.958917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.056406 (+2097489us) service_pool.cc:224] Handling call
0709 12:24:32.056733 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:32.056923 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:32.056950 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:32.056997 (+    47us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:32.057031 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.057087 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:32.057215 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:32.061113 11000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37500 (request call id 792) took 2083 ms. Trace:
I20260709 12:24:32.061450 11002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37512 (request call id 758) took 2080 ms. Trace:
I20260709 12:24:32.047307 11932 raft_consensus.cc:493] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:32.053185 11796 raft_consensus.cc:493] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:32.058789 10994 rpcz_store.cc:276] 0709 12:24:29.960426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.056896 (+2096470us) service_pool.cc:224] Handling call
0709 12:24:32.057309 (+   413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:32.057619 (+   310us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:32.057742 (+   123us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:32.057804 (+    62us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:32.057848 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.057924 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:32.058077 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:32.004458 11931 log.cc:927] Time spent T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.504s	user 0.001s	sys 0.000s
W20260709 12:24:31.967093 11938 log.cc:927] Time spent T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.673s	user 0.000s	sys 0.001s
I20260709 12:24:31.926229 11851 raft_consensus.cc:515] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:32.060814 10820 leader_election.cc:304] T e3d9a61ecaf84695b70f8519ee57706f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:24:32.005759 11914 log.cc:927] Time spent T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 1.680s	user 0.020s	sys 0.028s
I20260709 12:24:31.968410 11828 raft_consensus.cc:493] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:31.937636 11754 leader_election.cc:290] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:31.956314 11944 raft_consensus.cc:493] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:31.937762 11844 leader_election.cc:290] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:31.946848 11902 raft_consensus.cc:493] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:31.980284 11868 leader_election.cc:290] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:32.065119 11806 raft_consensus.cc:2804] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:32.588109 11806 raft_consensus.cc:493] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:32.029438 11872 raft_consensus.cc:515] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:32.577620 10752 catalog_manager.cc:5697] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 1 to 3, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 3 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:32.588770 11806 raft_consensus.cc:3060] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:32.591080 10925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59626 (request call id 742) took 2963 ms. Trace:
I20260709 12:24:32.063374 10926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59626 (request call id 746) took 2146 ms. Trace:
I20260709 12:24:32.248796 10848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56388 (request call id 590) took 2843 ms. Trace:
W20260709 12:24:31.934123 10997 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37512 (request call id 761) took 1828 ms (client timeout 2050 ms). Trace:
I20260709 12:24:31.990526 10851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56394 (request call id 758) took 2511 ms. Trace:
I20260709 12:24:32.062340 11000 rpcz_store.cc:276] 0709 12:24:29.978181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.059232 (+2081051us) service_pool.cc:224] Handling call
0709 12:24:32.059594 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:32.059766 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:32.059792 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:32.059830 (+    38us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:32.059857 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.059909 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:32.059999 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:32.327404 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:32.120661 11747 raft_consensus.cc:493] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:32.592680 10926 rpcz_store.cc:276] 0709 12:24:29.916561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.061825 (+2145264us) service_pool.cc:224] Handling call
0709 12:24:32.062358 (+   533us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:32.062669 (+   311us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:32.062694 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:32.062763 (+    69us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:32.062941 (+   178us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.063051 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:32.063259 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:32.574975 11930 log.cc:927] Time spent T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 1.693s	user 0.008s	sys 0.013s
I20260709 12:24:32.062389 11002 rpcz_store.cc:276] 0709 12:24:29.987212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.060408 (+2073196us) service_pool.cc:224] Handling call
0709 12:24:32.060793 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:32.061017 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:32.061049 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:32.061106 (+    57us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:32.061153 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.061229 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:32.061366 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:32.594728 10925 rpcz_store.cc:276] 0709 12:24:29.627932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.028710 (+2400778us) service_pool.cc:224] Handling call
0709 12:24:32.029119 (+   409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:32.589229 (+560110us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:32.589262 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:32.589309 (+    47us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:32.589341 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.590676 (+  1335us) spinlock_profiling.cc:243] Waited 560 ms on lock 0x7b54000f0ad4. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e88e01 00007f7594e8783e 00007f7599e4c419 00007f75933c3bd4 00007f75933c3b62 00007f75933c3a91 00007f75933c3a0c 00007f75933c2cc2 00007f75931c348c 00007f75931c28c6
0709 12:24:32.590739 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:32.590991 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1287638912}
I20260709 12:24:32.013914 10852 rpcz_store.cc:276] 0709 12:24:29.402981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.404132 (+  1151us) service_pool.cc:224] Handling call
0709 12:24:29.404488 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:29.404723 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:24:29.840611 (+435888us) log.cc:844] Serialized 14 byte log entry
0709 12:24:31.927629 (+2087018us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:31.927717 (+    88us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:31.927781 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.927879 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:31.928058 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51901,"prepare.queue_time_us":555267,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":6578,"raft.queue_time_us":14630,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":13142,"thread_start_us":2514305,"threads_started":2,"wal-append.queue_time_us":1310259}
I20260709 12:24:32.638037 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:32.005477 11933 leader_election.cc:290] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:31.975418 11948 raft_consensus.cc:493] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:32.638351 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:24:32.015291 11920 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.534s	user 0.017s	sys 0.058s
I20260709 12:24:32.593016 10848 rpcz_store.cc:276] 0709 12:24:29.405739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.406942 (+  1203us) service_pool.cc:224] Handling call
0709 12:24:29.407243 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:29.486724 (+ 79481us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:24:29.906032 (+419308us) log.cc:844] Serialized 14 byte log entry
0709 12:24:30.345367 (+439335us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:30.345420 (+    53us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:30.345503 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.248465 (+1902962us) spinlock_profiling.cc:243] Waited 79.2 ms on lock 0x7b540026aa54. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e88e01 00007f7594e8783e 00007f7599e4c419 00007f75933c3bd4 00007f75933c3b62 00007f75933c3a91 00007f75933c3a0c 00007f75933c2cc2 00007f75931c348c 00007f75931c28c6
0709 12:24:32.248523 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:32.248711 (+   188us) inbound_call.cc:177] Queueing success response
0709 12:24:32.578410 (+329699us) spinlock_profiling.cc:243] Waited 31.8 ms on lock 0x7b4400022b4c. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7591c23db1 00007f7591cc1c85 00007f7591cc26a2 00007f7594a341db 00007f7594a2faaf 00007f7594a2386e 00007f7594a22bb6 00007f7594a227d8 00007f7594a2c221 00007f7594a2c1d9 00007f7594a2c169
Metrics: {"mutex_wait_us":50583,"prepare.queue_time_us":624616,"prepare.run_cpu_time_us":110,"prepare.run_wall_time_us":14539,"raft.queue_time_us":88,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":4802,"spinlock_wait_cycles":255390976,"thread_start_us":762257,"threads_started":2,"wal-append.queue_time_us":543233}
I20260709 12:24:32.637326 11747 raft_consensus.cc:515] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:32.388221 10995 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37512 (request call id 756) took 2457 ms (client timeout 1927 ms). Trace:
I20260709 12:24:32.001120 11861 leader_election.cc:290] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:24:32.579351 11929 log.cc:927] Time spent T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 1.728s	user 0.004s	sys 0.014s
I20260709 12:24:32.589931 10752 catalog_manager.cc:5697] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:32.592721 10998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37512 (request call id 752) took 2752 ms. Trace:
W20260709 12:24:32.251627 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 191400us
I20260709 12:24:32.211478 11771 raft_consensus.cc:493] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:32.329497 10999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37512 (request call id 749) took 2569 ms. Trace:
W20260709 12:24:32.018607 11588 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.854s	user 0.021s	sys 0.015s
I20260709 12:24:32.523377 11003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37500 (request call id 788) took 2587 ms. Trace:
W20260709 12:24:32.574625 11912 log.cc:927] Time spent T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 2.393s	user 0.014s	sys 0.037s
I20260709 12:24:31.956254 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6a1da21304fcfacab384a6afc4101" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:31.991665 11937 raft_consensus.cc:493] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:31.936854 11884 consensus_queue.cc:1048] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.706s
I20260709 12:24:32.012751 11869 leader_election.cc:290] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:31.937026 11899 raft_consensus.cc:493] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:31.967538 11797 leader_election.cc:290] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:24:32.140856 11586 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.428s	user 0.012s	sys 0.026s
I20260709 12:24:32.644485 11922 raft_consensus.cc:493] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:32.028357 11843 raft_consensus.cc:515] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:32.020849 11940 raft_consensus.cc:515] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:24:32.575361 11917 log.cc:927] Time spent T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 1.711s	user 0.012s	sys 0.030s
I20260709 12:24:32.003355 11805 raft_consensus.cc:493] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:32.645922 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:32.020942 11800 raft_consensus.cc:515] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:32.227299 11935 raft_consensus.cc:493] T 3f8a389131ef4c77a3e08488aa4759eb P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:32.880209 11958 raft_consensus.cc:493] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
W20260709 12:24:32.909687 10995 rpcz_store.cc:269] 0709 12:24:29.931096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.974895 (+ 43799us) service_pool.cc:224] Handling call
0709 12:24:32.387930 (+2413035us) spinlock_profiling.cc:243] Waited 400 ms on lock 0x7b54001815d4. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e8c2fa 00007f7599e4db17 00007f75933c86d4 00007f75933c8662 00007f75933c8591 00007f75933c850c 00007f75933c77c2 00007f75931c348c 00007f75931c28c6 00007f75931c226f
0709 12:24:32.388108 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":919806848}
I20260709 12:24:32.910427 11958 raft_consensus.cc:515] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:32.911350 10922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59626 (request call id 722) took 3722 ms. Trace:
I20260709 12:24:32.642023 11844 raft_consensus.cc:493] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:32.914870 11747 leader_election.cc:290] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:32.911866 10922 rpcz_store.cc:276] 0709 12:24:29.188850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.226044 (+ 37194us) service_pool.cc:224] Handling call
0709 12:24:29.226663 (+   619us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:29.242840 (+ 16177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:29.243441 (+   601us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:29.315627 (+ 72186us) log.cc:844] Serialized 26 byte log entry
0709 12:24:29.937141 (+621514us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:29.943910 (+  6769us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:29.952796 (+  8886us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:32.564226 (+2611430us) spinlock_profiling.cc:243] Waited 2.17 ms on lock 0x7b240015b228. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7591c23db1 00007f7591c219c4 00007f7591c1facb 00007f7591ddadc9 00007f7591ddaa55 00007f7591dda09d 00007f7594a0c10e 00007f7594a2388c 00007f7594a22bb6 00007f7594a227d8 00007f7594a2c221
0709 12:24:32.910722 (+346496us) raft_consensus.cc:1685] finished
0709 12:24:32.910761 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:32.911257 (+   496us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11657,"raft.queue_time_us":13612,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":1998,"spinlock_wait_cycles":4979584,"thread_start_us":559728,"threads_started":1,"wal-append.queue_time_us":646023}
I20260709 12:24:32.186857 11854 raft_consensus.cc:493] T a6a28416571247df878823d464c05f1e P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:32.915174 10750 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60736 (request call id 146) took 4551 ms. Trace:
I20260709 12:24:32.638998 11932 raft_consensus.cc:515] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:32.839761 10923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59626 (request call id 736) took 3363 ms. Trace:
W20260709 12:24:32.445969 11910 log.cc:927] Time spent T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 2.320s	user 0.007s	sys 0.007s
I20260709 12:24:32.918023 10924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59622 (request call id 601) took 4057 ms. Trace:
I20260709 12:24:32.260905 11952 raft_consensus.cc:493] T 442726a7f1e441248ec80a98b31eb341 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:32.651171 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:32.881415 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63ecfc9bd3945818cfe15c03f001315" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:24:32.736732 10968 connection.cc:256] RPC call timeout handler was delayed by -1.2571154139995997s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1867s for a response
I20260709 12:24:32.122399 11936 raft_consensus.cc:515] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:32.916487 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:32.122503 11951 raft_consensus.cc:515] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:32.921958 11936 leader_election.cc:290] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:24:32.742794 11868 raft_consensus.cc:493] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:32.918450 10924 rpcz_store.cc:276] 0709 12:24:28.860962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:28.861139 (+   177us) service_pool.cc:224] Handling call
0709 12:24:28.861409 (+   270us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:29.301315 (+439906us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:29.301361 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:29.307805 (+  6444us) log.cc:844] Serialized 26 byte log entry
0709 12:24:29.778906 (+471101us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:29.778976 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.442632 (+663656us) spinlock_profiling.cc:243] Waited 91.7 ms on lock 0x7b54002085d4. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e88e01 00007f7594e8783e 00007f7599e4c419 00007f75933c3bd4 00007f75933c3b62 00007f75933c3a91 00007f75933c3a0c 00007f75933c2cc2 00007f75931c348c 00007f75931c28c6
0709 12:24:30.442711 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:32.420402 (+1977691us) spinlock_profiling.cc:243] Waited 50.7 ms on lock 0x7b4400022b4c. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7591c23db1 00007f7591cc1c85 00007f7591cc26a2 00007f7594a341db 00007f7594a2faaf 00007f7594a2386e 00007f7594a22bb6 00007f7594a227d8 00007f7594a2c221 00007f7594a2c1d9 00007f7594a2c169
0709 12:24:32.917803 (+497401us) raft_consensus.cc:1685] finished
0709 12:24:32.917826 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:32.917952 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":58958,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"spinlock_wait_cycles":327462016,"thread_start_us":803176,"threads_started":2,"wal-append.queue_time_us":655861}
I20260709 12:24:32.020849 11939 raft_consensus.cc:515] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:32.923403 11002 raft_consensus.cc:2468] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 1.
I20260709 12:24:32.923960 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5794ba618e514e28a7542ab6af39d8c9" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:24:32.924649 11624 raft_consensus.cc:2468] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 1.
I20260709 12:24:32.924736 11843 leader_election.cc:290] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:32.925204 11002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37512 (request call id 759) took 2833 ms. Trace:
I20260709 12:24:32.923152 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:32.925379 11939 leader_election.cc:290] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:32.926106 10969 leader_election.cc:304] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
W20260709 12:24:32.919849 10968 connection.cc:256] RPC call timeout handler was delayed by -1.2422846429999481s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15610000000000002s for a response
I20260709 12:24:32.122591 11885 raft_consensus.cc:515] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:32.736011 11948 raft_consensus.cc:515] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:32.927430 10849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56388 (request call id 593) took 3517 ms. Trace:
I20260709 12:24:32.928088 11934 raft_consensus.cc:2804] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:32.928951 11934 raft_consensus.cc:493] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
W20260709 12:24:32.259760 11908 log.cc:927] Time spent T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 1.970s	user 0.008s	sys 0.007s
I20260709 12:24:32.186659 11836 raft_consensus.cc:493] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:32.352875 11847 leader_election.cc:290] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:32.928145 10922 raft_consensus.cc:2468] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 3.
I20260709 12:24:32.918330 10752 catalog_manager.cc:5697] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 1 to 3, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 3 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
W20260709 12:24:32.266674 11909 log.cc:927] Time spent T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 1.817s	user 0.008s	sys 0.004s
I20260709 12:24:32.920838 11771 raft_consensus.cc:515] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:32.942288 10752 catalog_manager.cc:5697] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 2 to 3, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 3 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
W20260709 12:24:32.942821 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 202740us
W20260709 12:24:32.775489 10966 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.928s	user 0.027s	sys 0.058s
W20260709 12:24:32.943490 10966 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.096s	user 0.031s	sys 0.068s
I20260709 12:24:32.930418 10968 leader_election.cc:304] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:32.919360 10926 raft_consensus.cc:2468] T c63ecfc9bd3945818cfe15c03f001315 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 1.
I20260709 12:24:32.827852 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad766f48812a4ddeb383179b1d84907b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:32.428212 11907 consensus_queue.cc:260] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:32.936276 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:32.925657 11002 rpcz_store.cc:276] 0709 12:24:30.092366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.924383 (+2832017us) service_pool.cc:224] Handling call
0709 12:24:32.924694 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:32.924864 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:32.924890 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:32.924935 (+    45us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:32.924985 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.925045 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:32.925146 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:32.901036 10895 leader_election.cc:304] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:32.826750 11001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37512 (request call id 754) took 2951 ms. Trace:
I20260709 12:24:32.930322 11003 rpcz_store.cc:276] 0709 12:24:29.936409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.877686 (+1941277us) service_pool.cc:224] Handling call
0709 12:24:32.388983 (+511297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:32.389219 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:32.389252 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:32.389308 (+    56us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:32.389352 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.389438 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:32.523157 (+133719us) spinlock_profiling.cc:243] Waited 511 ms on lock 0x7b54001815d0. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e878ad 00007f7599e4c419 00007f75933c3bd4 00007f75933c3b62 00007f75933c3a91 00007f75933c3a0c 00007f75933c2cc2 00007f75931c348c 00007f75931c28c6 00007f75931c226f
0709 12:24:32.523301 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1175133440}
I20260709 12:24:32.005111 10853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56394 (request call id 755) took 2526 ms. Trace:
I20260709 12:24:32.027627 11811 raft_consensus.cc:515] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:32.020416 11943 raft_consensus.cc:515] T d0aed74af73a488f8b691578ca370226 P 3c52e0825c02476e89d84da9bb849f5d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:24:32.881198 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 820779us
I20260709 12:24:32.342741 11953 raft_consensus.cc:493] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:32.261519 11903 leader_election.cc:290] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:32.449115 11879 leader_election.cc:290] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:32.063529 11796 raft_consensus.cc:515] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:32.027843 11842 raft_consensus.cc:515] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:32.943828 10752 catalog_manager.cc:5697] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 1 to 2, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 2 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:32.073988 11849 raft_consensus.cc:515] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:24:32.929524 11934 raft_consensus.cc:3060] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:32.947028 11771 leader_election.cc:290] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:33.171103 11961 raft_consensus.cc:2749] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:32.638115 11895 leader_election.cc:290] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:32.329264 11881 raft_consensus.cc:493] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:32.419835 10939 tablet_copy_source_session.cc:215] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:33.007537 11942 raft_consensus.cc:2749] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:32.913605 11958 leader_election.cc:290] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:31.937443 10928 rpcz_store.cc:276] 0709 12:24:29.616373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.483312 (+866939us) service_pool.cc:224] Handling call
0709 12:24:31.066699 (+583387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:31.085060 (+ 18361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:31.095905 (+ 10845us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:31.104310 (+  8405us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:31.114677 (+ 10367us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.149213 (+ 34536us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:31.149406 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:33.163056 11957 consensus_queue.cc:1048] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:24:33.166283 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 265356us
I20260709 12:24:32.983197 11885 leader_election.cc:290] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:33.189694 10895 leader_election.cc:304] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:24:33.190354 11000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37500 (request call id 810) took 1070 ms. Trace:
I20260709 12:24:33.058107 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:33.168120 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:33.048046 10929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59626 (request call id 733) took 3684 ms. Trace:
W20260709 12:24:33.046130 10996 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37512 (request call id 736) took 3411 ms (client timeout 1880 ms). Trace:
I20260709 12:24:33.060496 11948 leader_election.cc:290] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:33.168747 10820 leader_election.cc:304] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:32.757679 11829 raft_consensus.cc:493] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:32.015359 10921 rpcz_store.cc:276] 0709 12:24:29.505388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.691921 (+186533us) service_pool.cc:224] Handling call
0709 12:24:29.692285 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:29.692673 (+   388us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:29.693981 (+  1308us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:29.732195 (+ 38214us) log.cc:844] Serialized 26 byte log entry
0709 12:24:30.099541 (+367346us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:30.113236 (+ 13695us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.124592 (+ 11356us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:31.079248 (+954656us) raft_consensus.cc:1685] finished
0709 12:24:31.093705 (+ 14457us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:31.905054 (+811349us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1239,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":5119,"thread_start_us":252223,"threads_started":1,"wal-append.queue_time_us":500669,"wal-append.run_cpu_time_us":103807,"wal-append.run_wall_time_us":2658735}
I20260709 12:24:32.926499 11868 raft_consensus.cc:515] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:32.918413 10998 rpcz_store.cc:276] 0709 12:24:29.840183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.840341 (+   158us) service_pool.cc:224] Handling call
0709 12:24:29.840692 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:29.841118 (+   426us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:29.841160 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:29.841690 (+   530us) log.cc:844] Serialized 26 byte log entry
0709 12:24:31.021419 (+1179729us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:31.041348 (+ 19929us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.041522 (+   174us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:32.592272 (+1550750us) raft_consensus.cc:1685] finished
0709 12:24:32.592447 (+   175us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:32.592647 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1324,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":37646,"thread_start_us":1106571,"threads_started":1,"wal-append.queue_time_us":683335}
I20260709 12:24:32.930656 10999 rpcz_store.cc:276] 0709 12:24:29.760309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.760525 (+   216us) service_pool.cc:224] Handling call
0709 12:24:29.762136 (+  1611us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:31.888631 (+2126495us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.329171 (+440540us) spinlock_profiling.cc:243] Waited 2.13 s on lock 0x7b54003ebcd4. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e88e01 00007f7594e8783e 00007f7599e4c419 00007f75933c3bd4 00007f75933c3b62 00007f75933c3a91 00007f75933c3a0c 00007f75933c2cc2 00007f75931c348c 00007f75931c28c6
0709 12:24:32.329411 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4888995200}
W20260709 12:24:32.875752 11954 log.cc:927] Time spent T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.327s	user 0.000s	sys 0.001s
I20260709 12:24:32.927951 10849 rpcz_store.cc:276] 0709 12:24:29.409740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.409877 (+   137us) service_pool.cc:224] Handling call
0709 12:24:29.423646 (+ 13769us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:29.426127 (+  2481us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:29.426173 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:29.443986 (+ 17813us) log.cc:844] Serialized 26 byte log entry
0709 12:24:30.065317 (+621331us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:30.065375 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.065473 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:32.450875 (+2385402us) spinlock_profiling.cc:243] Waited 4.29 ms on lock 0x7b4400022b4c. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7591c23db1 00007f7591cc1c85 00007f7591cc26a2 00007f7594a341db 00007f7594a2faaf 00007f7594a2386e 00007f7594a22bb6 00007f7594a227d8 00007f7594a2c221 00007f7594a2c1d9 00007f7594a2c169
0709 12:24:32.927056 (+476181us) raft_consensus.cc:1685] finished
0709 12:24:32.927080 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:32.927366 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2043,"raft.queue_time_us":2696,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":11277,"spinlock_wait_cycles":9864960,"thread_start_us":597602,"threads_started":1,"wal-append.queue_time_us":996509}
I20260709 12:24:32.757229 11933 raft_consensus.cc:493] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:32.937839 11899 raft_consensus.cc:515] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:32.263159 11893 raft_consensus.cc:493] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:32.725999 11828 raft_consensus.cc:515] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:33.215662 10819 connection.cc:256] RPC call timeout handler was delayed by -1.3230127940000784s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1506s for a response
I20260709 12:24:33.186112 11771 raft_consensus.cc:493] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:32.931248 11805 raft_consensus.cc:3060] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:32.975251 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 44916.4us
I20260709 12:24:33.200124 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:24:32.967782 11926 log.cc:927] Time spent T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 2.417s	user 0.011s	sys 0.021s
I20260709 12:24:33.110436 11872 leader_election.cc:290] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:33.048527 11959 raft_consensus.cc:493] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
W20260709 12:24:32.974211 11588 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.809s	user 0.027s	sys 0.057s
I20260709 12:24:33.194692 10895 leader_election.cc:304] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:32.749624 11956 raft_consensus.cc:2749] T e3d9a61ecaf84695b70f8519ee57706f P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:33.169386 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5794ba618e514e28a7542ab6af39d8c9" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:33.190790 11000 rpcz_store.cc:276] 0709 12:24:32.119905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.743461 (+623556us) service_pool.cc:224] Handling call
0709 12:24:33.190271 (+446810us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:33.204566 11849 leader_election.cc:290] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:24:32.638885 10997 rpcz_store.cc:269] 0709 12:24:30.093897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.481936 (+388039us) service_pool.cc:224] Handling call
0709 12:24:31.921850 (+1439914us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:33.204872 11943 leader_election.cc:290] T d0aed74af73a488f8b691578ca370226 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:32.916292 10750 rpcz_store.cc:276] 0709 12:24:28.364201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:28.364339 (+   138us) service_pool.cc:224] Handling call
0709 12:24:32.915019 (+4550680us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:28.868853 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:28.869885 (+  1032us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:28.869935 (+    50us) write_op.cc:435] Acquired schema lock
0709 12:24:28.870155 (+   220us) tablet.cc:662] Decoding operations
0709 12:24:28.871325 (+  1170us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:28.871931 (+   606us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:28.872125 (+   194us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:24:28.872961 (+   836us) tablet.cc:701] Row locks acquired
0709 12:24:28.872984 (+    23us) write_op.cc:260] PREPARE: finished
0709 12:24:28.873202 (+   218us) write_op.cc:270] Start()
0709 12:24:28.873364 (+   162us) write_op.cc:276] Timestamp: P: 1783599868873138 usec, L: 0
0709 12:24:28.873398 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 12:24:28.874277 (+   879us) log.cc:844] Serialized 922 byte log entry
0709 12:24:29.409789 (+535512us) op_driver.cc:464] REPLICATION: finished
0709 12:24:30.341425 (+931636us) write_op.cc:301] APPLY: starting
0709 12:24:30.344137 (+  2712us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:30.373634 (+ 29497us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:30.450374 (+ 76740us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:30.479995 (+ 29621us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:30.480243 (+   248us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:24:30.480317 (+    74us) write_op.cc:312] APPLY: finished
0709 12:24:30.480612 (+   295us) log.cc:844] Serialized 28 byte log entry
0709 12:24:32.911198 (+2430586us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:32.911329 (+   131us) write_op.cc:454] Released schema lock
0709 12:24:32.911388 (+    59us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":816706,"apply.run_cpu_time_us":125145,"apply.run_wall_time_us":2673157,"num_ops":2,"prepare.queue_time_us":338177,"prepare.run_cpu_time_us":5242,"prepare.run_wall_time_us":24712,"replication_time_us":523582,"thread_start_us":3460952,"threads_started":3,"wal-append.queue_time_us":1371192,"wal-append.run_cpu_time_us":1252,"wal-append.run_wall_time_us":1018326}]]}
I20260709 12:24:32.918298 11932 leader_election.cc:290] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:33.007421 11949 raft_consensus.cc:493] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:32.946744 11882 raft_consensus.cc:493] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:33.208364 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352aa49c65194abbb863d7553a091f11" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:33.208367 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aed74af73a488f8b691578ca370226" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:33.209614 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab816bcc6183447994a2cc013e46c5f8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:32.915015 11844 raft_consensus.cc:515] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:33.145824 11951 leader_election.cc:290] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:32.651098 11902 raft_consensus.cc:515] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:33.171278 11953 raft_consensus.cc:515] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:33.185649 11940 leader_election.cc:290] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:33.172657 11001 rpcz_store.cc:276] 0709 12:24:29.875829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.876194 (+   365us) service_pool.cc:224] Handling call
0709 12:24:29.876656 (+   462us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:29.877702 (+  1046us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:29.877747 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:29.883803 (+  6056us) log.cc:844] Serialized 26 byte log entry
0709 12:24:30.302369 (+418566us) spinlock_profiling.cc:243] Waited 32.6 ms on lock 0x7b48001b0258. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7599db1aa1 00007f7599da8b37 00007f7599da89ca 00007f7599ea026f 00007f7599e9ff37 00007f7599eb455c 00007f7599eb4508 00007f7599eb4488 00007f7599eb4443 00007f7599eb36ec 00007f7598ddda96
0709 12:24:32.445556 (+2143187us) spinlock_profiling.cc:243] Waited 22.8 ms on lock 0x7b18001266a0. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f759ac63ab1 00007f759ac70281 00007f7594a304bc 00007f7591d7e48b 00007f759abd89a9 00007f7591d9a69b 00007f7591d9893f 00007f7591d9ac02 00007f7594a2220b 00007f7594a27d23 00007f7594a280d1
0709 12:24:32.574325 (+128769us) spinlock_profiling.cc:243] Waited 28.1 ms on lock 0x7b4400022b4c. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7591c23db1 00007f7591cc1c85 00007f7591cc26a2 00007f7594a341db 00007f7594a2faaf 00007f7594a2386e 00007f7594a22bb6 00007f7594a227d8 00007f7594a2c221 00007f7594a2c1d9 00007f7594a2c169
0709 12:24:32.594831 (+ 20506us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:32.594878 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.594947 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:32.826407 (+231460us) raft_consensus.cc:1685] finished
0709 12:24:32.826433 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:32.826663 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":344,"raft.run_cpu_time_us":19923,"raft.run_wall_time_us":465335,"spinlock_wait_cycles":192078208,"thread_start_us":406833,"threads_started":1,"wal-append.queue_time_us":741107}
I20260709 12:24:33.178258 11842 leader_election.cc:290] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:32.987092 11937 raft_consensus.cc:515] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:33.284924 10939 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.0.0.1:50036 (request call id 6) took 4186 ms. Trace:
I20260709 12:24:32.916328 11854 raft_consensus.cc:515] T a6a28416571247df878823d464c05f1e P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
W20260709 12:24:33.214913 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 46271.3us
W20260709 12:24:33.216090 10819 connection.cc:256] RPC call timeout handler was delayed by -1.2645127939999838s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15710000000000002s for a response
I20260709 12:24:33.218019 10968 leader_election.cc:304] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:32.974741 11802 leader_election.cc:290] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:33.216533 11771 raft_consensus.cc:515] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:33.205806 11901 raft_consensus.cc:2804] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:33.048913 11806 raft_consensus.cc:515] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:32.942059 11836 raft_consensus.cc:515] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:32.910513 11935 raft_consensus.cc:515] T 3f8a389131ef4c77a3e08488aa4759eb P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:33.233230 11893 raft_consensus.cc:515] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:32.637194 10851 rpcz_store.cc:276] 0709 12:24:29.479300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.648625 (+169325us) service_pool.cc:224] Handling call
0709 12:24:31.989131 (+2340506us) spinlock_profiling.cc:243] Waited 3.13 ms on lock 0x7b5800004e98. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7591c23db1 00007f7591d63b71 00007f7591d63a22 00007f759ac7c8d9 00007f7599dd6ee0 00007f7599ea00ab 00007f7599ea0131 00007f7599e61fc0 00007f7599e4c929 00007f7599e4c3d2 00007f75933c3bd4
0709 12:24:31.989429 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:31.989699 (+   270us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:31.989743 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:31.989804 (+    61us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:31.989857 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.989941 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:31.990359 (+   418us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7191808}
W20260709 12:24:33.200031 10996 rpcz_store.cc:269] 0709 12:24:29.634856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.644938 (+ 10082us) service_pool.cc:224] Handling call
0709 12:24:31.950500 (+2305562us) spinlock_profiling.cc:243] Waited 3.73 ms on lock 0x7b5800133598. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7591c23db1 00007f7591d63b71 00007f7591d63a22 00007f759ac7c8d9 00007f7599dd6ee0 00007f7599ea00ab 00007f7599ea0131 00007f7599e4e0a0 00007f7599e4d984 00007f75933c86d4 00007f75933c8662
0709 12:24:33.023564 (+1073064us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8579328}
I20260709 12:24:33.170675 10853 rpcz_store.cc:276] 0709 12:24:29.478484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.642330 (+163846us) service_pool.cc:224] Handling call
0709 12:24:29.675720 (+ 33390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:29.705760 (+ 30040us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:29.714788 (+  9028us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:29.718291 (+  3503us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:29.722899 (+  4608us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.004736 (+2281837us) spinlock_profiling.cc:243] Waited 16.9 ms on lock 0x7b5400190d54. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e88e01 00007f7594e8783e 00007f7599e4c419 00007f75933c3bd4 00007f75933c3b62 00007f75933c3a91 00007f75933c3a0c 00007f75933c2cc2 00007f75931c348c 00007f75931c28c6
0709 12:24:32.004813 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:32.005017 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":38906240}
I20260709 12:24:33.211184 11829 raft_consensus.cc:515] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } }
I20260709 12:24:33.187932 11881 raft_consensus.cc:515] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:33.215507 11884 raft_consensus.cc:2749] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:33.254513 11747 raft_consensus.cc:493] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:33.256174 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 61579.6us
I20260709 12:24:32.941440 11922 raft_consensus.cc:515] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:33.217024 11847 raft_consensus.cc:493] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:33.217437 11843 raft_consensus.cc:493] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:33.189168 11907 raft_consensus.cc:3060] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:33.237345 11958 raft_consensus.cc:493] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:32.919315 11952 raft_consensus.cc:515] T 442726a7f1e441248ec80a98b31eb341 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:33.281999 11902 leader_election.cc:290] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:33.282886 10999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37500 (request call id 795) took 2282 ms. Trace:
I20260709 12:24:33.400107 10995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37500 (request call id 793) took 3415 ms. Trace:
I20260709 12:24:33.291922 11901 raft_consensus.cc:493] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:33.283880 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:33.239674 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:24:33.287096 10819 connection.cc:256] RPC call timeout handler was delayed by -1.260912793999978s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1575s for a response
W20260709 12:24:33.287636 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 69710.6us
W20260709 12:24:33.412395 10819 connection.cc:256] RPC call timeout handler was delayed by -1.2303127939999285s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16090000000000002s for a response
I20260709 12:24:33.292057 11842 raft_consensus.cc:2749] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:24:33.412878 10819 connection.cc:256] RPC call timeout handler was delayed by -1.2249127939999198s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1615s for a response
W20260709 12:24:33.413316 10819 connection.cc:256] RPC call timeout handler was delayed by -1.0746127940001315s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17820000000000003s for a response
W20260709 12:24:33.413602 10819 connection.cc:256] RPC call timeout handler was delayed by -1.0476127940000879s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18120000000000003s for a response
W20260709 12:24:33.413873 10819 connection.cc:256] RPC call timeout handler was delayed by -1.0467127940000864s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18130000000000002s for a response
I20260709 12:24:33.220624 11933 raft_consensus.cc:515] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:33.278976 11796 leader_election.cc:290] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:24:33.288736 10820 leader_election.cc:304] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:33.261174 11895 raft_consensus.cc:2804] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:32.824023 11944 raft_consensus.cc:515] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:33.420061 11843 raft_consensus.cc:515] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:33.254177 10922 raft_consensus.cc:2468] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 1.
I20260709 12:24:33.292399 10998 raft_consensus.cc:2468] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 1.
I20260709 12:24:33.260563 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9331e5342644ca2bae19187b083a7d5" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:33.285394 11800 leader_election.cc:290] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:33.285629 11882 raft_consensus.cc:515] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:33.260805 11959 raft_consensus.cc:515] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:33.286609 11949 raft_consensus.cc:515] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:33.400588 11000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37500 (request call id 796) took 2385 ms. Trace:
W20260709 12:24:33.363499 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:33.409198 10999 rpcz_store.cc:276] 0709 12:24:31.014367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.279430 (+2265063us) service_pool.cc:224] Handling call
0709 12:24:33.279750 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:33.279917 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:33.279941 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:33.279996 (+    55us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:33.280031 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.280090 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:33.282831 (+  2741us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:33.259166 10894 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.116.65:46265 timed out after 1.752s (SENT) [suppressed 1 similar messages]
I20260709 12:24:33.406783 11771 leader_election.cc:290] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:33.407401 11747 raft_consensus.cc:515] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:33.322145 11836 leader_election.cc:290] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:33.416424 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:33.420368 11901 raft_consensus.cc:3060] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:33.419265 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
W20260709 12:24:33.421072 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 132425us
I20260709 12:24:33.441941 10854 raft_consensus.cc:2468] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 3.
I20260709 12:24:33.442637 10820 leader_election.cc:304] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:33.424036 11966 raft_consensus.cc:2749] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:33.421226 10895 leader_election.cc:304] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:33.444609 11771 raft_consensus.cc:2749] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:33.445377 10895 leader_election.cc:304] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:33.422097 11895 raft_consensus.cc:493] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:33.426685 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:33.449357 10926 raft_consensus.cc:2410] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:24:33.294951 10920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59626 (request call id 738) took 3789 ms. Trace:
I20260709 12:24:33.453846 10927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59626 (request call id 743) took 3823 ms. Trace:
I20260709 12:24:33.465198 10927 rpcz_store.cc:276] 0709 12:24:29.630354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.035470 (+2405116us) service_pool.cc:224] Handling call
0709 12:24:32.035787 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:33.423261 (+1387474us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:33.423290 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:33.423332 (+    42us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:33.423362 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.453482 (+ 30120us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b5400286ed4. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e88e01 00007f7594e8783e 00007f7599e4c419 00007f75933c3bd4 00007f75933c3b62 00007f75933c3a91 00007f75933c3a0c 00007f75933c2cc2 00007f75931c348c 00007f75931c28c6
0709 12:24:33.453551 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:33.453759 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3190538496}
I20260709 12:24:33.467713 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:33.303833 11851 leader_election.cc:290] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:33.393345 11953 leader_election.cc:290] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:33.433519 11000 rpcz_store.cc:276] 0709 12:24:31.015011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.282780 (+2267769us) service_pool.cc:224] Handling call
0709 12:24:33.399901 (+117121us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:33.400158 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:33.400195 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:33.400240 (+    45us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:33.400285 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.400362 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:33.400505 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:33.408849 11811 leader_election.cc:290] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:33.394731 11899 leader_election.cc:290] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:24:33.464805 10920 rpcz_store.cc:276] 0709 12:24:29.506033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.727448 (+221415us) service_pool.cc:224] Handling call
0709 12:24:29.730435 (+  2987us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:29.730712 (+   277us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:29.730752 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:29.731458 (+   706us) log.cc:844] Serialized 26 byte log entry
0709 12:24:30.125164 (+393706us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:30.178504 (+ 53340us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.226978 (+ 48474us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:32.522071 (+2295093us) spinlock_profiling.cc:243] Waited 6.57 ms on lock 0x7b4400022b4c. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7591c23db1 00007f7591cc1c85 00007f7591cc26a2 00007f7594a341db 00007f7594a2faaf 00007f7594a2386e 00007f7594a22bb6 00007f7594a227d8 00007f7594a2c221 00007f7594a2c1d9 00007f7594a2c169
0709 12:24:33.278664 (+756593us) raft_consensus.cc:1685] finished
0709 12:24:33.278692 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:33.294854 (+ 16162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15100672,"thread_start_us":378362,"threads_started":1,"wal-append.queue_time_us":818511}
I20260709 12:24:33.472447 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:33.320720 11806 leader_election.cc:290] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:33.409614 10995 rpcz_store.cc:276] 0709 12:24:29.985218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.911447 (+2926229us) service_pool.cc:224] Handling call
0709 12:24:32.911936 (+   489us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:33.364278 (+452342us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:33.364326 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:33.364386 (+    60us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:33.364431 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.376022 (+ 11591us) spinlock_profiling.cc:243] Waited 452 ms on lock 0x7b54002d3f54. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e88e01 00007f7594e8783e 00007f7599e4c419 00007f75933c3bd4 00007f75933c3b62 00007f75933c3a91 00007f75933c3a0c 00007f75933c2cc2 00007f75931c348c 00007f75931c28c6
0709 12:24:33.399829 (+ 23807us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:33.400025 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1039641344}
I20260709 12:24:33.312692 11868 leader_election.cc:290] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:33.323695 11854 leader_election.cc:290] T a6a28416571247df878823d464c05f1e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:33.416982 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:33.439363 10999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37500 (request call id 799) took 2423 ms. Trace:
I20260709 12:24:33.410125 11847 raft_consensus.cc:515] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:33.300361 10994 raft_consensus.cc:2468] T 3f8a389131ef4c77a3e08488aa4759eb P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 1.
I20260709 12:24:33.443738 10820 leader_election.cc:304] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:33.449086 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:33.482534 11893 leader_election.cc:290] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:33.449019 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18294423a68a4671bf6c5a0f98645e4c" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:33.446992 10895 leader_election.cc:304] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:33.449777 10924 raft_consensus.cc:2410] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:24:33.428450 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fd8fdac2fa449e9e184f3d668ea1a7" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:33.451009 11747 leader_election.cc:290] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:33.429947 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:33.484201 10850 raft_consensus.cc:2468] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 2.
I20260709 12:24:33.484490 10852 raft_consensus.cc:2468] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 1.
I20260709 12:24:33.285382 10939 rpcz_store.cc:276] 0709 12:24:29.099306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.109339 (+ 10033us) service_pool.cc:224] Handling call
0709 12:24:31.576931 (+2467592us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b540024c0a0. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594dffdc0 00007f7594e924a5 00007f7594e923ee 00007f7599e28036 00007f7599e31a3e 00007f75916f527b 00007f7599e319ba 00007f7599e2cacc 00007f7599e27c7b 00007f7599e1c8d1
0709 12:24:32.419241 (+842310us) spinlock_profiling.cc:243] Waited 736 ms on lock 0x7b54001e8cd4. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e923f7 00007f7599e28036 00007f7599e31a3e 00007f75916f527b 00007f7599e319ba 00007f7599e2cacc 00007f7599e27c7b 00007f7599e1c8d1 00007f7598ed04b4 00007f7598ed0442
0709 12:24:33.261608 (+842367us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1725394560}
I20260709 12:24:33.471719 11935 leader_election.cc:290] T 3f8a389131ef4c77a3e08488aa4759eb P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:33.472494 11882 leader_election.cc:290] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:33.486299 11747 raft_consensus.cc:2804] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:33.486719 11747 raft_consensus.cc:493] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:33.472820 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9331e5342644ca2bae19187b083a7d5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:33.487051 11747 raft_consensus.cc:3060] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:33.199931 10929 rpcz_store.cc:276] 0709 12:24:29.363389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.387592 (+ 24203us) service_pool.cc:224] Handling call
0709 12:24:29.387888 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:29.388092 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:29.388118 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:29.388625 (+   507us) log.cc:844] Serialized 26 byte log entry
0709 12:24:29.998340 (+609715us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:30.102569 (+104229us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.112161 (+  9592us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:31.991338 (+1879177us) spinlock_profiling.cc:243] Waited 31.4 ms on lock 0x7b240015b228. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7591c23db1 00007f7591c219c4 00007f7591c1facb 00007f7591ddadc9 00007f7591ddaa55 00007f7591dda09d 00007f7594a0c10e 00007f7594a2388c 00007f7594a22bb6 00007f7594a227d8 00007f7594a2c221
0709 12:24:32.973851 (+982513us) raft_consensus.cc:1685] finished
0709 12:24:32.973882 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:33.047961 (+ 74079us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":72201472,"thread_start_us":592657,"threads_started":1,"wal-append.queue_time_us":750726}
I20260709 12:24:33.472962 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:33.473531 11933 leader_election.cc:290] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:33.473786 11944 leader_election.cc:290] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:33.448406 11829 leader_election.cc:290] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:33.475361 11828 leader_election.cc:290] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:33.378785 11623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45920 (request call id 12) took 1192 ms. Trace:
I20260709 12:24:33.504031 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aed74af73a488f8b691578ca370226" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:24:33.504498 11937 leader_election.cc:290] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:33.504619 11002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37512 (request call id 760) took 3411 ms. Trace:
I20260709 12:24:33.432801 11805 raft_consensus.cc:515] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:33.477972 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:33.420027 11958 raft_consensus.cc:515] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:33.509846 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:33.511132 10849 raft_consensus.cc:2468] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 3.
I20260709 12:24:33.439730 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:33.512365 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:33.476219 10922 raft_consensus.cc:2468] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 1.
I20260709 12:24:33.464257 11895 raft_consensus.cc:3060] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:33.489558 10995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37500 (request call id 802) took 2472 ms. Trace:
I20260709 12:24:33.479621 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:33.464026 11870 raft_consensus.cc:2804] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:33.442797 11934 raft_consensus.cc:515] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:32.916739 10923 rpcz_store.cc:276] 0709 12:24:29.468551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.686856 (+218305us) service_pool.cc:224] Handling call
0709 12:24:29.687247 (+   391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:29.764124 (+ 76877us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:29.769360 (+  5236us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:29.831648 (+ 62288us) log.cc:844] Serialized 26 byte log entry
0709 12:24:31.113734 (+1282086us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:31.114986 (+  1252us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.561685 (+1446699us) spinlock_profiling.cc:243] Waited 42.9 ms on lock 0x7b540012acd4. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e88e01 00007f7594e8783e 00007f7599e4c419 00007f75933c3bd4 00007f75933c3b62 00007f75933c3a91 00007f75933c3a0c 00007f75933c2cc2 00007f75931c348c 00007f75931c28c6
0709 12:24:32.637260 (+ 75575us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:32.642877 (+  5617us) raft_consensus.cc:1685] finished
0709 12:24:32.646641 (+  3764us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:32.831689 (+185048us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28977,"raft.queue_time_us":30126,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":151,"spinlock_wait_cycles":98833152,"thread_start_us":1226730,"threads_started":1,"wal-append.queue_time_us":712992,"wal-append.run_cpu_time_us":26934,"wal-append.run_wall_time_us":2320934}
I20260709 12:24:33.504073 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad766f48812a4ddeb383179b1d84907b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:33.505148 11002 rpcz_store.cc:276] 0709 12:24:30.092894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.162404 (+3069510us) service_pool.cc:224] Handling call
0709 12:24:33.162747 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:33.446670 (+283923us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:33.446699 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:33.446745 (+    46us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:33.446775 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.504388 (+ 57613us) spinlock_profiling.cc:243] Waited 284 ms on lock 0x7b5400050ad4. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e88e01 00007f7594e8783e 00007f7599e4c419 00007f75933c3bd4 00007f75933c3b62 00007f75933c3a91 00007f75933c3a0c 00007f75933c2cc2 00007f75931c348c 00007f75931c28c6
0709 12:24:33.504429 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:33.504564 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":652499200}
I20260709 12:24:33.474953 11000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37500 (request call id 801) took 2458 ms. Trace:
I20260709 12:24:33.463855 11861 raft_consensus.cc:2804] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:33.493887 11864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6a28416571247df878823d464c05f1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:33.504391 11623 rpcz_store.cc:276] 0709 12:24:32.250975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.266417 (+ 15442us) service_pool.cc:224] Handling call
0709 12:24:32.266889 (+   472us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:33.199209 (+932320us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:33.199244 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:33.199289 (+    45us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:33.199330 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.362021 (+162691us) spinlock_profiling.cc:243] Waited 922 ms on lock 0x7b54004c1154. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e88e01 00007f7594e8783e 00007f7599e4c419 00007f75933c3bd4 00007f75933c3b62 00007f75933c3a91 00007f75933c3a0c 00007f75933c2cc2 00007f75931c348c 00007f75931c28c6
0709 12:24:33.362072 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:33.378688 (+ 16616us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2120039680}
I20260709 12:24:33.528446 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac8522e549a46e09593fa4c2e175557" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:24:33.528959 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352aa49c65194abbb863d7553a091f11" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:24:33.529157 11624 raft_consensus.cc:2468] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 1.
I20260709 12:24:33.509330 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b17195a94142039c40f598ed006c94" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:33.508677 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:33.530550 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:33.531121 10997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37512 (request call id 763) took 3436 ms. Trace:
I20260709 12:24:33.531648 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:33.480564 10999 rpcz_store.cc:276] 0709 12:24:31.015963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.437951 (+2421988us) service_pool.cc:224] Handling call
0709 12:24:33.438453 (+   502us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:33.438691 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:33.438724 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:33.438771 (+    47us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:33.439084 (+   313us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.439157 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:33.439304 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:33.531495 10997 rpcz_store.cc:276] 0709 12:24:30.094755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.258555 (+3163800us) service_pool.cc:224] Handling call
0709 12:24:33.530397 (+271842us) spinlock_profiling.cc:243] Waited 2.09 ms on lock 0x7b5800133598. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7591c23db1 00007f7591d63b71 00007f7591d63a22 00007f759ac7c8d9 00007f7599dd6ee0 00007f7599ea00ab 00007f7599ea0131 00007f7599e61fc0 00007f7599e4c929 00007f7599e4c3d2 00007f75933c3bd4
0709 12:24:33.530597 (+   200us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:33.530796 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:33.530825 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:33.530872 (+    47us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:33.530903 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.530964 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:33.531066 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4812032}
I20260709 12:24:33.532730 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:33.533519 11001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37500 (request call id 797) took 2518 ms. Trace:
I20260709 12:24:33.533779 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:33.534409 10999 raft_consensus.cc:2468] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 1.
I20260709 12:24:33.533885 11001 rpcz_store.cc:276] 0709 12:24:31.015360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.283721 (+2268361us) service_pool.cc:224] Handling call
0709 12:24:33.283983 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:33.452265 (+168282us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:33.452320 (+    55us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:33.452389 (+    69us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:33.452438 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.533326 (+ 80888us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b54002d2654. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e88e01 00007f7594e8783e 00007f7599e4c419 00007f75933c3bd4 00007f75933c3b62 00007f75933c3a91 00007f75933c3a0c 00007f75933c2cc2 00007f75931c348c 00007f75931c28c6
0709 12:24:33.533365 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:33.533470 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":386288000}
I20260709 12:24:33.517448 11958 leader_election.cc:290] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:24:33.496439 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 52686.6us
I20260709 12:24:33.536325 10820 leader_election.cc:304] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:33.536537 11843 leader_election.cc:290] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:33.537561 11843 raft_consensus.cc:2804] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:33.537685 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6a1da21304fcfacab384a6afc4101" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:33.538012 10820 leader_election.cc:304] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:33.538097 11843 raft_consensus.cc:493] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:33.538415 10847 raft_consensus.cc:2468] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 1.
I20260709 12:24:33.538666 11843 raft_consensus.cc:3060] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:33.520321 11870 raft_consensus.cc:493] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:33.540129 11870 raft_consensus.cc:3060] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:33.541245 11885 raft_consensus.cc:2804] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:33.541621 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c913e527ff46578e084c41eab7bb9d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:33.542318 10998 raft_consensus.cc:2468] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 1.
I20260709 12:24:33.492835 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:24:33.500641 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 241499us
I20260709 12:24:33.515796 11747 raft_consensus.cc:515] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:33.488162 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:33.557380 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:33.557886 10820 leader_election.cc:304] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:33.558133 10849 raft_consensus.cc:2468] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 1.
I20260709 12:24:33.501787 10968 leader_election.cc:304] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:33.488371 10996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37500 (request call id 798) took 2472 ms. Trace:
I20260709 12:24:33.501492 11966 raft_consensus.cc:2749] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:33.524684 11000 rpcz_store.cc:276] 0709 12:24:31.016544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.474115 (+2457571us) service_pool.cc:224] Handling call
0709 12:24:33.474441 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:33.474633 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:33.474665 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:33.474711 (+    46us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:33.474743 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.474798 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:33.474897 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:33.526023 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:33.525470 11861 raft_consensus.cc:493] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:33.527964 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:33.507138 10921 raft_consensus.cc:2468] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 1.
I20260709 12:24:33.517478 11805 leader_election.cc:290] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:33.541714 11885 raft_consensus.cc:493] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:33.535300 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:33.448815 11884 consensus_queue.cc:1048] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.059s
I20260709 12:24:33.514818 10995 rpcz_store.cc:276] 0709 12:24:31.016845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.480411 (+2463566us) service_pool.cc:224] Handling call
0709 12:24:33.488740 (+  8329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:33.489063 (+   323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:33.489118 (+    55us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:33.489190 (+    72us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:33.489235 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.489320 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:33.489485 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:33.535248 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18294423a68a4671bf6c5a0f98645e4c" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:33.573180 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:33.573370 11001 raft_consensus.cc:2468] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 1.
I20260709 12:24:33.573834 11002 raft_consensus.cc:2468] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 1.
I20260709 12:24:33.574115 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:33.574586 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6a1da21304fcfacab384a6afc4101" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:33.574801 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:33.575428 11002 raft_consensus.cc:2468] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 1.
I20260709 12:24:33.474912 11922 leader_election.cc:290] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:33.549373 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c913e527ff46578e084c41eab7bb9d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:33.559199 11003 raft_consensus.cc:2393] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3c52e0825c02476e89d84da9bb849f5d in current term 2: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:24:33.515365 11844 leader_election.cc:290] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:24:33.562270 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:33.562906 10927 raft_consensus.cc:2393] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 2: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:24:33.559911 11622 raft_consensus.cc:2468] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 1.
I20260709 12:24:33.582772 10969 leader_election.cc:304] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:33.572494 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:33.565362 11747 leader_election.cc:290] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:33.565702 11589 leader_election.cc:304] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:33.566033 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aed74af73a488f8b691578ca370226" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:33.566989 11771 consensus_queue.cc:1059] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:33.586228 11771 raft_consensus.cc:3055] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:33.586691 11771 raft_consensus.cc:740] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:33.569100 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:33.605913 10853 raft_consensus.cc:2468] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 3.
I20260709 12:24:33.569221 11806 raft_consensus.cc:493] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
W20260709 12:24:33.608537 10994 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37500 (request call id 811) took 1487 ms (client timeout 1514 ms). Trace:
W20260709 12:24:33.609093 10994 rpcz_store.cc:269] 0709 12:24:32.120946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.327003 (+206057us) service_pool.cc:224] Handling call
0709 12:24:33.608377 (+1281374us) spinlock_profiling.cc:243] Waited 661 ms on lock 0x7b54003eb2d4. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e8c2fa 00007f7599e4db17 00007f75933c86d4 00007f75933c8662 00007f75933c8591 00007f75933c850c 00007f75933c77c2 00007f75931c348c 00007f75931c28c6 00007f75931c226f
0709 12:24:33.608476 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1520504064}
W20260709 12:24:33.570998 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 69275us
I20260709 12:24:33.544173 11881 leader_election.cc:290] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:33.582767 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:33.579097 11893 raft_consensus.cc:2804] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:33.628119 10924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59622 (request call id 615) took 1158 ms. Trace:
I20260709 12:24:33.564373 10929 raft_consensus.cc:2468] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 3.
I20260709 12:24:33.587808 11771 consensus_queue.cc:260] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:33.561595 10996 rpcz_store.cc:276] 0709 12:24:31.015658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.319171 (+2303513us) service_pool.cc:224] Handling call
0709 12:24:33.424299 (+105128us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:33.435390 (+ 11091us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:33.440574 (+  5184us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:33.442562 (+  1988us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:33.452275 (+  9713us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.476695 (+ 24420us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:33.488300 (+ 11605us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2304}
I20260709 12:24:33.569854 11861 raft_consensus.cc:3060] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:33.614490 10969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:33.630961 11771 raft_consensus.cc:3060] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:33.623724 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d9a61ecaf84695b70f8519ee57706f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:33.626396 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d9a61ecaf84695b70f8519ee57706f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:33.572292 11851 raft_consensus.cc:2804] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:33.564977 10820 leader_election.cc:304] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:33.576717 11885 raft_consensus.cc:3060] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:33.628540 10924 rpcz_store.cc:276] 0709 12:24:32.469619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.922874 (+453255us) service_pool.cc:224] Handling call
0709 12:24:33.615356 (+692482us) spinlock_profiling.cc:243] Waited 524 ms on lock 0x7b54002887d4. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e8c2fa 00007f7599e4db17 00007f75933c86d4 00007f75933c8662 00007f75933c8591 00007f75933c850c 00007f75933c77c2 00007f75931c348c 00007f75931c28c6 00007f75931c226f
0709 12:24:33.628038 (+ 12682us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1204351744}
I20260709 12:24:33.617617 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aed74af73a488f8b691578ca370226" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:33.636615 10926 raft_consensus.cc:2468] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 2.
I20260709 12:24:33.638702 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:33.613881 11955 raft_consensus.cc:493] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:33.632488 10895 leader_election.cc:304] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:33.632401 10854 raft_consensus.cc:2468] T e3d9a61ecaf84695b70f8519ee57706f P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 1.
I20260709 12:24:33.625382 11882 raft_consensus.cc:2804] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:33.614041 11806 raft_consensus.cc:515] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:33.629907 11940 raft_consensus.cc:2804] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:33.614519 10923 raft_consensus.cc:2468] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 3.
I20260709 12:24:33.648165 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac83709373b4efd9c3aa1472a9f9022" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:33.632685 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:33.635799 11851 raft_consensus.cc:493] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:33.652274 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:24:33.627836 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 67725.1us
I20260709 12:24:33.628487 11893 raft_consensus.cc:493] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:33.669284 11893 raft_consensus.cc:3060] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:33.681469 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:33.646950 11881 raft_consensus.cc:2804] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:33.659667 11952 leader_election.cc:290] T 442726a7f1e441248ec80a98b31eb341 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:33.661602 11003 raft_consensus.cc:2410] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:24:33.656939 11588 leader_election.cc:304] T d0aed74af73a488f8b691578ca370226 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:33.646706 11882 raft_consensus.cc:493] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:33.666438 11949 leader_election.cc:290] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:33.654415 11940 raft_consensus.cc:493] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:33.671428 11851 raft_consensus.cc:3060] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:33.689857 11959 leader_election.cc:290] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:33.690940 11951 raft_consensus.cc:2804] T d0aed74af73a488f8b691578ca370226 P 3c52e0825c02476e89d84da9bb849f5d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:33.685712 11881 raft_consensus.cc:493] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:33.666060 11806 leader_election.cc:290] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:33.813388 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac83709373b4efd9c3aa1472a9f9022" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:33.639894 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:33.715883 11881 raft_consensus.cc:3060] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:33.647553 11955 raft_consensus.cc:515] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:33.821367 10920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59622 (request call id 631) took 1058 ms. Trace:
I20260709 12:24:33.822202 10920 rpcz_store.cc:276] 0709 12:24:32.763135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.582471 (+819336us) service_pool.cc:224] Handling call
0709 12:24:33.821071 (+238600us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:33.691712 11882 raft_consensus.cc:3060] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:33.807080 10923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59626 (request call id 759) took 1210 ms. Trace:
I20260709 12:24:33.808508 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
W20260709 12:24:33.691085 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 48101.6us
W20260709 12:24:33.662004 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 50284.1us
I20260709 12:24:33.828055 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:33.828315 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:33.830091 10845 raft_consensus.cc:2468] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 3.
I20260709 12:24:33.659667 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac8522e549a46e09593fa4c2e175557" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:33.667806 10927 raft_consensus.cc:2468] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 3.
I20260709 12:24:33.737502 11901 raft_consensus.cc:515] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:33.664196 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:33.682936 10997 raft_consensus.cc:2468] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 3.
I20260709 12:24:33.688637 11847 leader_election.cc:290] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:33.702291 11870 raft_consensus.cc:515] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:33.849182 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:33.850782 11002 raft_consensus.cc:2368] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for earlier term 3. Current term is 4.
I20260709 12:24:33.684314 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:33.851802 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c913e527ff46578e084c41eab7bb9d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:33.851915 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:33.689788 11940 raft_consensus.cc:3060] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:33.854211 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:24:33.802999 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 237863us
I20260709 12:24:33.760434 11895 raft_consensus.cc:515] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:33.805698 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac8522e549a46e09593fa4c2e175557" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:33.718111 11934 leader_election.cc:290] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:24:33.824327 11849 raft_consensus.cc:2749] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:33.829249 10920 raft_consensus.cc:2468] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 1.
I20260709 12:24:33.825531 10923 rpcz_store.cc:276] 0709 12:24:32.596322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.561953 (+965631us) service_pool.cc:224] Handling call
0709 12:24:33.806574 (+244621us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:33.845132 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:33.852263 10926 raft_consensus.cc:2393] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 2: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:24:33.709692 11951 raft_consensus.cc:493] T d0aed74af73a488f8b691578ca370226 P 3c52e0825c02476e89d84da9bb849f5d [term 2 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:33.816680 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:33.815156 11843 raft_consensus.cc:515] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:33.850966 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:33.856374 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5794ba618e514e28a7542ab6af39d8c9" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:24:33.859671 10929 raft_consensus.cc:2468] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 1.
I20260709 12:24:33.863334 10925 raft_consensus.cc:2393] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 4: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:24:33.863325 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:33.866549 11864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:45904 (request call id 15) took 5967 ms. Trace:
I20260709 12:24:33.882215 10968 leader_election.cc:304] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:33.871956 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:33.877799 11955 leader_election.cc:290] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:33.878749 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:33.880057 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:33.868247 11885 raft_consensus.cc:515] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:33.884862 11901 leader_election.cc:290] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:33.885761 11870 leader_election.cc:290] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:34.021669 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:33.886072 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18294423a68a4671bf6c5a0f98645e4c" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:33.755216 11893 raft_consensus.cc:515] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:34.026587 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab816bcc6183447994a2cc013e46c5f8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:33.897261 10928 raft_consensus.cc:2468] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 1.
I20260709 12:24:34.028314 11893 leader_election.cc:290] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:24:34.029364 10969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:34.030457 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:34.034039 11843 leader_election.cc:290] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:33.886193 11851 raft_consensus.cc:515] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:34.035347 11002 raft_consensus.cc:2468] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 1.
I20260709 12:24:34.036945 10853 raft_consensus.cc:1240] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:34.037061 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:34.038424 11002 raft_consensus.cc:2468] T 3f8a389131ef4c77a3e08488aa4759eb P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 1.
I20260709 12:24:34.040361 11851 leader_election.cc:290] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:34.040536 11885 leader_election.cc:290] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:34.041621 11895 leader_election.cc:290] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:34.042088 10995 raft_consensus.cc:2468] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 1.
I20260709 12:24:34.042528 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef3220c51df47db8859f07ab745fad5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:34.060874 10920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59626 (request call id 749) took 4120 ms. Trace:
I20260709 12:24:34.061343 10920 rpcz_store.cc:276] 0709 12:24:29.940562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.059628 (+4119066us) service_pool.cc:224] Handling call
0709 12:24:34.060172 (+   544us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:34.060499 (+   327us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:34.060530 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:34.060589 (+    59us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:34.060625 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.060688 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:34.060812 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:34.043473 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:34.044442 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b17195a94142039c40f598ed006c94" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:34.064170 10997 raft_consensus.cc:3060] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:34.018836 11864 rpcz_store.cc:276] 0709 12:24:27.903141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:27.910045 (+  6904us) service_pool.cc:224] Handling call
0709 12:24:28.791254 (+881209us) ts_tablet_manager.cc:934] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d: Initiating tablet copy from peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
0709 12:24:33.491740 (+4700486us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:24:33.542772 (+ 51032us) tablet_metadata.cc:665] Metadata flushed
0709 12:24:33.542925 (+   153us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:24:33.727090 (+184165us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:24:33.837421 (+110331us) tablet_replica.cc:206] Creating consensus instance
0709 12:24:33.866118 (+ 28697us) ts_tablet_manager.cc:989] Replica registered.
0709 12:24:33.866275 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":9897,"tablet-copy.queue_time_us":663292,"thread_start_us":518706,"threads_started":2}
I20260709 12:24:34.066089 10923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59626 (request call id 752) took 4096 ms. Trace:
I20260709 12:24:34.045861 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:34.046310 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac83709373b4efd9c3aa1472a9f9022" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:33.939667 11882 raft_consensus.cc:515] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:34.046834 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:34.047750 11955 raft_consensus.cc:2804] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:24:34.048530 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 166547us
I20260709 12:24:34.049821 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:34.055374 10929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59626 (request call id 747) took 4133 ms. Trace:
I20260709 12:24:34.034150 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:33.889052 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:34.066614 11864 tablet_copy_client.cc:806] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:34.072806 10847 raft_consensus.cc:2468] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 1.
I20260709 12:24:34.067168 10920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59626 (request call id 751) took 4112 ms. Trace:
I20260709 12:24:34.082930 11000 raft_consensus.cc:2468] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 3.
I20260709 12:24:34.068454 11940 raft_consensus.cc:515] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:34.069741 11955 raft_consensus.cc:493] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:34.090013 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:34.087162 11003 raft_consensus.cc:3060] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:34.086325 10922 raft_consensus.cc:3060] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:34.071188 10929 rpcz_store.cc:276] 0709 12:24:29.921888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.053922 (+4132034us) service_pool.cc:224] Handling call
0709 12:24:34.054455 (+   533us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:34.054855 (+   400us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:34.054887 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:34.054955 (+    68us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:34.055000 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.055090 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:34.055267 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:34.093658 11955 raft_consensus.cc:3060] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:34.066597 10923 rpcz_store.cc:276] 0709 12:24:29.969693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.064662 (+4094969us) service_pool.cc:224] Handling call
0709 12:24:34.065221 (+   559us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:34.065640 (+   419us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:34.065676 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:34.065753 (+    77us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:34.065834 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.065902 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:34.066029 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:34.109879 11623 raft_consensus.cc:1240] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [term 2 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:34.108831 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b17195a94142039c40f598ed006c94" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:34.116789 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
W20260709 12:24:34.110948 10925 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59622 (request call id 614) took 1638 ms (client timeout 1927 ms). Trace:
W20260709 12:24:34.119692 10925 rpcz_store.cc:269] 0709 12:24:32.468940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.167841 (+698901us) service_pool.cc:224] Handling call
0709 12:24:34.093760 (+925919us) spinlock_profiling.cc:243] Waited 662 ms on lock 0x7b540012acd4. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e8c2fa 00007f7599e4db17 00007f75933c86d4 00007f75933c8662 00007f75933c8591 00007f75933c850c 00007f75933c77c2 00007f75931c348c 00007f75931c28c6 00007f75931c226f
0709 12:24:34.107556 (+ 13796us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1521684736}
I20260709 12:24:34.111235 11864 tablet_copy_client.cc:670] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:34.124239 11747 raft_consensus.cc:493] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:34.128007 11747 raft_consensus.cc:515] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:34.114713 11951 raft_consensus.cc:3060] T d0aed74af73a488f8b691578ca370226 P 3c52e0825c02476e89d84da9bb849f5d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:34.129230 10846 raft_consensus.cc:2410] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:24:34.120862 11870 raft_consensus.cc:493] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:34.088882 10920 rpcz_store.cc:276] 0709 12:24:29.951405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.062557 (+4111152us) service_pool.cc:224] Handling call
0709 12:24:34.062994 (+   437us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:34.063248 (+   254us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:34.063276 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:34.063319 (+    43us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:34.063354 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.063417 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:34.063547 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:34.144423 10927 raft_consensus.cc:1275] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:24:34.144937 10927 pending_rounds.cc:85] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea: Aborting all ops after (but not including) 1
I20260709 12:24:34.145219 10927 pending_rounds.cc:107] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:24:34.145826 10927 raft_consensus.cc:2889] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:34.152150 11870 raft_consensus.cc:515] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:34.146776 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:34.125844 11881 raft_consensus.cc:515] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:34.160029 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9331e5342644ca2bae19187b083a7d5" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:34.162051 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:34.167363 10927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59626 (request call id 753) took 4186 ms. Trace:
I20260709 12:24:34.167883 10927 rpcz_store.cc:276] 0709 12:24:29.978631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.092995 (+4114364us) service_pool.cc:224] Handling call
0709 12:24:34.124960 (+ 31965us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:34.163163 (+ 38203us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.164947 (+  1784us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:34.170719 10925 raft_consensus.cc:1240] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:34.169530 10968 leader_election.cc:304] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:34.168185 10926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59622 (request call id 632) took 1380 ms. Trace:
I20260709 12:24:34.175837 10925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59626 (request call id 758) took 4051 ms. Trace:
I20260709 12:24:34.176620 10852 raft_consensus.cc:2393] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 3: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:24:34.176147 10925 rpcz_store.cc:276] 0709 12:24:30.120061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.127049 (+4006988us) service_pool.cc:224] Handling call
0709 12:24:34.155271 (+ 28222us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:34.171023 (+ 15752us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.171661 (+   638us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":798592}
I20260709 12:24:34.168597 10847 raft_consensus.cc:2468] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 3.
I20260709 12:24:34.177955 11747 leader_election.cc:290] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:34.183832 10924 raft_consensus.cc:2393] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3c52e0825c02476e89d84da9bb849f5d in current term 2: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:24:34.184046 11621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352aa49c65194abbb863d7553a091f11" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:24:34.172138 11882 leader_election.cc:290] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:24:34.176985 10928 raft_consensus.cc:1240] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:34.177979 11864 tablet_copy_client.cc:538] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:34.155650 11861 raft_consensus.cc:515] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:34.190012 11934 raft_consensus.cc:2804] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:34.190533 11934 raft_consensus.cc:493] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:34.190923 11934 raft_consensus.cc:3060] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:34.191373 11861 leader_election.cc:290] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:34.192389 10923 raft_consensus.cc:1240] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:34.175493 10926 rpcz_store.cc:276] 0709 12:24:32.787512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.637278 (+849766us) service_pool.cc:224] Handling call
0709 12:24:33.647984 (+ 10706us) spinlock_profiling.cc:243] Waited 2.77 ms on lock 0x7b5800002d98. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7591c23db1 00007f7591d63b71 00007f7591d63a22 00007f759ac7c8d9 00007f7599dd6ee0 00007f7599ea00ab 00007f7599ea0131 00007f7599e4e0a0 00007f7599e4d984 00007f75933c86d4 00007f75933c8662
0709 12:24:34.159844 (+511860us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x7b540012bbd4. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e8c2fa 00007f7599e4db17 00007f75933c86d4 00007f75933c8662 00007f75933c8591 00007f75933c850c 00007f75933c77c2 00007f75931c348c 00007f75931c28c6 00007f75931c226f
0709 12:24:34.168128 (+  8284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":456091904}
I20260709 12:24:34.187244 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:34.201385 10921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59626 (request call id 760) took 1604 ms. Trace:
I20260709 12:24:34.201947 10921 rpcz_store.cc:276] 0709 12:24:32.596618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.199872 (+1603254us) service_pool.cc:224] Handling call
0709 12:24:34.200433 (+   561us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:34.200916 (+   483us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:34.200948 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:34.201007 (+    59us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:34.201089 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.201173 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:34.201308 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:34.209438 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:34.195732 10923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59626 (request call id 757) took 4082 ms. Trace:
I20260709 12:24:34.212949 11000 raft_consensus.cc:2468] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 1.
I20260709 12:24:34.206301 10928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59626 (request call id 755) took 4209 ms. Trace:
I20260709 12:24:34.211833 10929 raft_consensus.cc:1240] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:34.217913 10924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59626 (request call id 764) took 1620 ms. Trace:
I20260709 12:24:34.218593 10968 leader_election.cc:304] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:34.220093 10924 rpcz_store.cc:276] 0709 12:24:32.597659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.205708 (+1608049us) service_pool.cc:224] Handling call
0709 12:24:34.209395 (+  3687us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:34.217495 (+  8100us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:34.217537 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:34.217611 (+    74us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:34.217650 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.217721 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:34.217829 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:34.222335 10925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59622 (request call id 618) took 1751 ms. Trace:
I20260709 12:24:34.224941 10925 rpcz_store.cc:276] 0709 12:24:32.470957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.187815 (+1716858us) service_pool.cc:224] Handling call
0709 12:24:34.208936 (+ 21121us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:34.218789 (+  9853us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:34.218816 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:34.218861 (+    45us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:34.222154 (+  3293us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.222208 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:34.222291 (+    83us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:34.226826 10895 leader_election.cc:304] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:34.228545 10895 leader_election.cc:304] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:34.229333 11861 raft_consensus.cc:2804] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:34.230399 11861 raft_consensus.cc:493] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:34.230911 11861 raft_consensus.cc:3060] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:34.234117 11882 raft_consensus.cc:2804] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:34.234222 11747 raft_consensus.cc:2804] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:34.235432 11747 raft_consensus.cc:493] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:34.235994 11747 raft_consensus.cc:3060] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:34.237317 10921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59626 (request call id 761) took 1640 ms. Trace:
I20260709 12:24:34.237804 10921 rpcz_store.cc:276] 0709 12:24:32.596881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.203495 (+1606614us) service_pool.cc:224] Handling call
0709 12:24:34.225942 (+ 22447us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:34.236857 (+ 10915us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:34.236898 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:34.236989 (+    91us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:34.237032 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.237101 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:34.237250 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:34.239243 10924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59622 (request call id 621) took 1609 ms. Trace:
I20260709 12:24:34.235332 11882 raft_consensus.cc:493] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:34.239980 11882 raft_consensus.cc:3060] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:34.239663 10924 rpcz_store.cc:276] 0709 12:24:32.630114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.238221 (+1608107us) service_pool.cc:224] Handling call
0709 12:24:34.238608 (+   387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:34.238931 (+   323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:34.238955 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:34.238997 (+    42us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:34.239024 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.239075 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:34.239188 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:34.235121 10968 leader_election.cc:304] T 3f8a389131ef4c77a3e08488aa4759eb P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:34.224434 11870 leader_election.cc:290] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:34.247473 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:34.248487 10998 raft_consensus.cc:2468] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 1.
I20260709 12:24:34.245916 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:34.255704 10846 raft_consensus.cc:2410] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:24:34.255927 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352aa49c65194abbb863d7553a091f11" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:34.257187 11000 raft_consensus.cc:2393] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3c52e0825c02476e89d84da9bb849f5d in current term 2: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:24:34.257709 11003 raft_consensus.cc:2468] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 2.
I20260709 12:24:34.257828 11893 raft_consensus.cc:2804] T 3f8a389131ef4c77a3e08488aa4759eb P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:34.247521 10927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59622 (request call id 617) took 1777 ms. Trace:
I20260709 12:24:34.258366 11893 raft_consensus.cc:493] T 3f8a389131ef4c77a3e08488aa4759eb P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:34.258571 10995 raft_consensus.cc:1240] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:34.258929 11893 raft_consensus.cc:3060] T 3f8a389131ef4c77a3e08488aa4759eb P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:34.258733 10927 rpcz_store.cc:276] 0709 12:24:32.470496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.182768 (+1712272us) service_pool.cc:224] Handling call
0709 12:24:34.209722 (+ 26954us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:34.247144 (+ 37422us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:34.247175 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:34.247236 (+    61us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:34.247265 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.247324 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:34.247445 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:34.213600 10923 rpcz_store.cc:276] 0709 12:24:30.113149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.121396 (+4008247us) service_pool.cc:224] Handling call
0709 12:24:34.169887 (+ 48491us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:34.192861 (+ 22974us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.193639 (+   778us) spinlock_profiling.cc:243] Waited 22.2 ms on lock 0x7b54002062d4. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e88e01 00007f7594e8783e 00007f7599e4c419 00007f75933c3bd4 00007f75933c3b62 00007f75933c3a91 00007f75933c3a0c 00007f75933c2cc2 00007f75931c348c 00007f75931c28c6
0709 12:24:34.193843 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":51142528}
I20260709 12:24:34.218680 10928 rpcz_store.cc:276] 0709 12:24:29.995700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.118667 (+4122967us) service_pool.cc:224] Handling call
0709 12:24:34.156865 (+ 38198us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:34.188871 (+ 32006us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.204900 (+ 16029us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:34.269490 10751 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60734 (request call id 137) took 3722 ms. Trace:
I20260709 12:24:34.272200 10929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59626 (request call id 754) took 4289 ms. Trace:
I20260709 12:24:34.269585 10895 leader_election.cc:304] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:34.273448 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:34.275741 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:34.276382 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac83709373b4efd9c3aa1472a9f9022" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:34.285979 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:34.276799 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:34.285074 10929 rpcz_store.cc:276] 0709 12:24:29.982463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.101085 (+4118622us) service_pool.cc:224] Handling call
0709 12:24:34.198377 (+ 97292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:34.221363 (+ 22986us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.271785 (+ 50422us) spinlock_profiling.cc:243] Waited 95.9 ms on lock 0x7b54002882d0. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e878ad 00007f7599e4c419 00007f75933c3bd4 00007f75933c3b62 00007f75933c3a91 00007f75933c3a0c 00007f75933c2cc2 00007f75931c348c 00007f75931c28c6 00007f75931c226f
0709 12:24:34.272101 (+   316us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":220565248}
I20260709 12:24:34.279330 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:34.289371 11861 raft_consensus.cc:515] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:34.279086 10923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59626 (request call id 771) took 1263 ms. Trace:
I20260709 12:24:34.280149 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:34.280537 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:34.302361 10851 raft_consensus.cc:2468] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 3.
I20260709 12:24:34.281656 10852 raft_consensus.cc:1240] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:34.283874 10751 rpcz_store.cc:276] 0709 12:24:30.547290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.711793 (+164503us) service_pool.cc:224] Handling call
0709 12:24:34.269126 (+3557333us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11661,"reported_tablets":5}
I20260709 12:24:34.288606 10926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59622 (request call id 619) took 1817 ms. Trace:
I20260709 12:24:34.279560 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:34.290992 10922 raft_consensus.cc:2468] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 4.
I20260709 12:24:34.291024 10895 leader_election.cc:304] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:34.304694 10925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59622 (request call id 628) took 1657 ms. Trace:
I20260709 12:24:34.305876 10925 rpcz_store.cc:276] 0709 12:24:32.646924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.246307 (+1599383us) service_pool.cc:224] Handling call
0709 12:24:34.304081 (+ 57774us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:34.304383 (+   302us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:34.304411 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:34.304455 (+    44us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:34.304482 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.304530 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:34.304629 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:34.306778 10895 leader_election.cc:304] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:34.277318 11934 raft_consensus.cc:515] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:34.287813 10924 raft_consensus.cc:1240] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:24:34.308387 11893 raft_consensus.cc:515] T 3f8a389131ef4c77a3e08488aa4759eb P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:34.291517 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:34.310263 11881 leader_election.cc:290] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:24:34.310729 11934 leader_election.cc:290] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:34.237995 10997 raft_consensus.cc:2468] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 4.
I20260709 12:24:34.304772 10926 rpcz_store.cc:276] 0709 12:24:32.629082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.197249 (+1568167us) service_pool.cc:224] Handling call
0709 12:24:34.241724 (+ 44475us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:34.288222 (+ 46498us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:34.288259 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:34.288324 (+    65us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:34.288356 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.288415 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:34.288553 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:34.312207 11944 raft_consensus.cc:2804] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:34.307260 11901 raft_consensus.cc:2804] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:34.313167 11901 raft_consensus.cc:493] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:34.313653 11901 raft_consensus.cc:3060] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:34.306797 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:34.308811 10924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59622 (request call id 630) took 1601 ms. Trace:
I20260709 12:24:34.315722 11934 raft_consensus.cc:493] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:34.315783 10924 rpcz_store.cc:276] 0709 12:24:32.708033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.264344 (+1556311us) service_pool.cc:224] Handling call
0709 12:24:34.287429 (+ 23085us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:34.308543 (+ 21114us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.308759 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:34.302810 11882 raft_consensus.cc:515] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:34.313524 10895 leader_election.cc:304] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:34.316373 11934 raft_consensus.cc:515] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:34.307875 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:34.312695 11944 raft_consensus.cc:493] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:34.314152 10752 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60730 (request call id 132) took 4967 ms. Trace:
I20260709 12:24:34.317344 10924 raft_consensus.cc:1240] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:34.322167 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:34.328501 11934 leader_election.cc:290] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:34.328722 11944 raft_consensus.cc:3060] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:34.329406 10994 raft_consensus.cc:1240] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:34.320084 11747 raft_consensus.cc:515] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:34.332690 11747 leader_election.cc:290] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:34.328987 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:34.226357 11940 leader_election.cc:290] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 2 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:34.291227 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:34.291222 11870 raft_consensus.cc:2804] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:34.353418 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:34.357488 10927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59622 (request call id 635) took 1526 ms. Trace:
I20260709 12:24:34.360001 11882 leader_election.cc:290] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:34.329525 10752 rpcz_store.cc:276] 0709 12:24:29.346356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.349747 (+  3391us) service_pool.cc:224] Handling call
0709 12:24:34.313933 (+4964186us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:33.204123 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:33.288989 (+ 84866us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:33.289026 (+    37us) write_op.cc:435] Acquired schema lock
0709 12:24:33.289045 (+    19us) tablet.cc:662] Decoding operations
0709 12:24:33.388455 (+ 99410us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:33.388548 (+    93us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:33.388575 (+    27us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:24:33.389418 (+   843us) tablet.cc:701] Row locks acquired
0709 12:24:33.389442 (+    24us) write_op.cc:260] PREPARE: finished
0709 12:24:33.389656 (+   214us) write_op.cc:270] Start()
0709 12:24:33.389816 (+   160us) write_op.cc:276] Timestamp: P: 1783599873389597 usec, L: 0
0709 12:24:33.389839 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:24:33.411650 (+ 21811us) log.cc:844] Serialized 2078 byte log entry
0709 12:24:33.973688 (+562038us) spinlock_profiling.cc:243] Waited 3.13 ms on lock 0x7b180002b540. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f759ac63ab1 00007f759ac70281 00007f7591d9b3f3 00007f7591d9d7c1 00007f7591d9d779 00007f7591d9d709 00007f7591d9d6d1 00007f7591d9c9cd 0000000000388634 0000000000388479 00007f7591d7e83a
0709 12:24:33.981752 (+  8064us) op_driver.cc:464] REPLICATION: finished
0709 12:24:34.101112 (+119360us) write_op.cc:301] APPLY: starting
0709 12:24:34.101299 (+   187us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:34.101532 (+   233us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:34.101565 (+    33us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:34.146968 (+ 45403us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:34.149205 (+  2237us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:24:34.149265 (+    60us) write_op.cc:312] APPLY: finished
0709 12:24:34.149894 (+   629us) log.cc:844] Serialized 46 byte log entry
0709 12:24:34.153544 (+  3650us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:34.158257 (+  4713us) write_op.cc:454] Released schema lock
0709 12:24:34.164265 (+  6008us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:34.192087 (+ 27822us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:34.192125 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":15963,"reported_tablets":11,"child_traces":[["op",{"apply.queue_time_us":118891,"apply.run_cpu_time_us":6380,"apply.run_wall_time_us":90995,"num_ops":5,"prepare.queue_time_us":3219,"prepare.run_cpu_time_us":60241,"prepare.run_wall_time_us":357339,"raft.queue_time_us":197893,"raft.run_cpu_time_us":40830,"raft.run_wall_time_us":103492,"replication_time_us":590085,"spinlock_wait_cycles":7192832,"thread_start_us":381552,"threads_started":4,"wal-append.queue_time_us":227786}]]}
I20260709 12:24:34.363967 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:34.362864 11861 leader_election.cc:290] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:24:34.366772 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 53410.6us
I20260709 12:24:34.359058 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:34.357991 10927 rpcz_store.cc:276] 0709 12:24:32.830702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.260460 (+1429758us) service_pool.cc:224] Handling call
0709 12:24:34.260997 (+   537us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:34.261960 (+   963us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:24:34.292242 (+ 30282us) log.cc:844] Serialized 14 byte log entry
0709 12:24:34.357119 (+ 64877us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:34.357183 (+    64us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:34.357226 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.357302 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:34.357424 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5475,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":115,"thread_start_us":87524,"threads_started":2,"wal-append.queue_time_us":56068}
I20260709 12:24:34.372155 10997 raft_consensus.cc:1240] T 3f8a389131ef4c77a3e08488aa4759eb P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:34.368525 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:34.379341 10994 raft_consensus.cc:3060] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:34.353087 11881 raft_consensus.cc:2749] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:34.358012 11870 raft_consensus.cc:493] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:34.329138 10923 rpcz_store.cc:276] 0709 12:24:33.015885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.278290 (+1262405us) service_pool.cc:224] Handling call
0709 12:24:34.278602 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:34.278724 (+   122us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:34.278742 (+    18us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:34.278772 (+    30us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:34.278791 (+    19us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.278894 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:34.279007 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:34.388484 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:34.390793 11003 raft_consensus.cc:1240] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:24:34.386013 11870 raft_consensus.cc:3060] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:34.399663 10894 leader_election.cc:304] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:34.400775 11861 raft_consensus.cc:2804] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:34.401293 11861 raft_consensus.cc:493] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:34.401788 11861 raft_consensus.cc:3060] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:34.402734 10894 leader_election.cc:304] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:34.403807 11747 raft_consensus.cc:2804] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:34.404208 11747 raft_consensus.cc:493] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:34.404609 11747 raft_consensus.cc:3060] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:34.413111 11000 raft_consensus.cc:1240] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:34.414983 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:34.416239 11893 leader_election.cc:290] T 3f8a389131ef4c77a3e08488aa4759eb P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:34.416671 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:34.417520 10998 raft_consensus.cc:2468] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 3.
I20260709 12:24:34.417834 10999 raft_consensus.cc:1240] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:34.419605 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:34.423105 11951 raft_consensus.cc:515] T d0aed74af73a488f8b691578ca370226 P 3c52e0825c02476e89d84da9bb849f5d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:34.423348 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef3220c51df47db8859f07ab745fad5" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:34.425578 11951 leader_election.cc:290] T d0aed74af73a488f8b691578ca370226 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 3 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:34.426620 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aed74af73a488f8b691578ca370226" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:34.435899 10994 raft_consensus.cc:2468] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 2.
I20260709 12:24:34.437865 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef3220c51df47db8859f07ab745fad5" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:34.439074 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:34.426524 11624 raft_consensus.cc:1240] T d0aed74af73a488f8b691578ca370226 P 3c52e0825c02476e89d84da9bb849f5d [term 3 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:34.440058 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:34.443310 10995 raft_consensus.cc:2468] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 3.
I20260709 12:24:34.433609 11944 raft_consensus.cc:515] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:34.441713 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:34.445088 10925 raft_consensus.cc:2393] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 3: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:24:34.446308 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:34.446751 10751 catalog_manager.cc:5697] T a6a28416571247df878823d464c05f1e P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: config changed from index -1 to 2, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New cstate: current_term: 1 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
W20260709 12:24:34.449785 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 52930.7us
I20260709 12:24:34.420331 11955 raft_consensus.cc:515] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:34.453600 11934 consensus_queue.cc:1059] T d0aed74af73a488f8b691578ca370226 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:34.454173 11955 leader_election.cc:290] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:34.455224 11934 raft_consensus.cc:3055] T d0aed74af73a488f8b691578ca370226 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:34.455709 11934 raft_consensus.cc:740] T d0aed74af73a488f8b691578ca370226 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:34.457167 11934 consensus_queue.cc:260] T d0aed74af73a488f8b691578ca370226 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:34.458863 11934 raft_consensus.cc:3060] T d0aed74af73a488f8b691578ca370226 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:34.460593 11861 raft_consensus.cc:515] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:34.462812 11944 leader_election.cc:290] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:34.461615 11901 raft_consensus.cc:515] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:34.464926 11901 leader_election.cc:290] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:34.470024 11747 raft_consensus.cc:515] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:34.479460 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:34.480419 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:34.483848 11747 leader_election.cc:290] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:34.482416 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
W20260709 12:24:34.489077 11979 log.cc:927] Time spent T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:24:34.488745 11843 raft_consensus.cc:493] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
W20260709 12:24:34.489471 10820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:34.493466 11864 tablet_bootstrap.cc:492] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap starting.
I20260709 12:24:34.485513 10894 leader_election.cc:304] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:34.495090 11843 raft_consensus.cc:515] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:34.503476 10969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:34.504930 10895 leader_election.cc:304] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:34.512558 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:34.516178 10999 raft_consensus.cc:1240] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:34.515955 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:34.516376 11861 leader_election.cc:290] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:34.507807 11944 raft_consensus.cc:2804] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:34.502638 11849 raft_consensus.cc:493] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:34.521536 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63ecfc9bd3945818cfe15c03f001315" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:34.528672 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aed74af73a488f8b691578ca370226" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:34.510412 10921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59622 (request call id 624) took 1859 ms. Trace:
I20260709 12:24:34.522403 11843 leader_election.cc:290] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:34.521744 11955 raft_consensus.cc:493] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:34.548096 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
W20260709 12:24:34.535905 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 66775.6us
I20260709 12:24:34.549036 10851 raft_consensus.cc:2393] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 2: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:24:34.542109 10920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59622 (request call id 613) took 2073 ms. Trace:
I20260709 12:24:34.544991 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:34.550072 10894 leader_election.cc:304] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:34.551431 11881 raft_consensus.cc:2804] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:34.531633 10921 rpcz_store.cc:276] 0709 12:24:32.645542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.239114 (+1593572us) service_pool.cc:224] Handling call
0709 12:24:34.239517 (+   403us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:34.240193 (+   676us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:34.240242 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:34.240938 (+   696us) log.cc:844] Serialized 26 byte log entry
0709 12:24:34.455746 (+214808us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:34.455821 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.455911 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:34.496918 (+ 41007us) raft_consensus.cc:1685] finished
0709 12:24:34.496942 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:34.504431 (+  7489us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":160,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":222,"thread_start_us":163404,"threads_started":1,"wal-append.queue_time_us":233448}
I20260709 12:24:34.551911 11881 raft_consensus.cc:493] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:34.526145 11944 raft_consensus.cc:493] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:34.552343 11881 raft_consensus.cc:3060] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:34.552779 11944 raft_consensus.cc:3060] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:34.549849 10920 rpcz_store.cc:276] 0709 12:24:32.468583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.163965 (+1695382us) service_pool.cc:224] Handling call
0709 12:24:34.186789 (+ 22824us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:34.252032 (+ 65243us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:34.252067 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:34.252641 (+   574us) log.cc:844] Serialized 26 byte log entry
0709 12:24:34.356217 (+103576us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:34.358089 (+  1872us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.371343 (+ 13254us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:34.541860 (+170517us) raft_consensus.cc:1685] finished
0709 12:24:34.541896 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:34.542043 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7411,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":139,"thread_start_us":102957,"threads_started":1,"wal-append.queue_time_us":130432}
I20260709 12:24:34.548723 11955 raft_consensus.cc:515] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:34.519096 11895 raft_consensus.cc:2804] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:34.555827 11895 raft_consensus.cc:493] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:34.556191 11895 raft_consensus.cc:3060] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:34.558113 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac8522e549a46e09593fa4c2e175557" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:34.541262 11849 raft_consensus.cc:515] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:34.560237 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5794ba618e514e28a7542ab6af39d8c9" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:34.561057 11881 raft_consensus.cc:515] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:34.561861 11849 leader_election.cc:290] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:34.562289 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352aa49c65194abbb863d7553a091f11" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:34.540524 10895 leader_election.cc:400] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 election: Vote denied by peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945) with higher term. Message: Invalid argument: T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for earlier term 3. Current term is 4.
I20260709 12:24:34.563830 10895 leader_election.cc:403] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:24:34.566123 11861 raft_consensus.cc:2749] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945) with higher term. Message: Invalid argument: T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for earlier term 3. Current term is 4.
I20260709 12:24:34.563277 11881 leader_election.cc:290] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:34.568847 11955 leader_election.cc:290] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:34.572824 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:34.573277 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:34.572089 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:34.575161 10847 raft_consensus.cc:2393] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 2: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
W20260709 12:24:34.576097 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 45244.5us
I20260709 12:24:34.576893 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:34.575161 11870 raft_consensus.cc:515] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:34.579949 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:34.582916 10998 raft_consensus.cc:2468] T d0aed74af73a488f8b691578ca370226 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 3.
I20260709 12:24:34.586553 11870 leader_election.cc:290] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:34.586699 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac83709373b4efd9c3aa1472a9f9022" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:34.587592 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:34.588686 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:34.589069 10894 leader_election.cc:304] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:34.587644 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352aa49c65194abbb863d7553a091f11" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:34.611325 11901 raft_consensus.cc:2749] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:34.612598 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:34.618780 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:34.620078 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:34.621539 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:34.622558 10850 raft_consensus.cc:2410] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:24:34.622907 10895 leader_election.cc:304] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:24:34.624281 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9331e5342644ca2bae19187b083a7d5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:34.624737 10895 leader_election.cc:304] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:34.625590 11881 raft_consensus.cc:2804] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:34.625988 11881 raft_consensus.cc:493] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:34.626060 11861 raft_consensus.cc:2804] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:34.626596 11881 raft_consensus.cc:3060] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:34.626631 11861 raft_consensus.cc:493] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:34.627135 11861 raft_consensus.cc:3060] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:34.628023 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:34.629513 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c913e527ff46578e084c41eab7bb9d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:34.625989 10895 leader_election.cc:304] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:34.631875 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
W20260709 12:24:34.632753 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 43828us
I20260709 12:24:34.632848 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5794ba618e514e28a7542ab6af39d8c9" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:34.635071 10894 leader_election.cc:304] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:34.638302 11895 raft_consensus.cc:515] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:34.639544 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b17195a94142039c40f598ed006c94" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:34.637652 11881 raft_consensus.cc:515] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:34.637054 11944 raft_consensus.cc:515] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:34.642810 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef3220c51df47db8859f07ab745fad5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:34.645233 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:34.648968 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18294423a68a4671bf6c5a0f98645e4c" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:34.650182 11747 raft_consensus.cc:2804] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:34.650216 10895 leader_election.cc:304] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:34.657191 10894 leader_election.cc:304] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:34.657585 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:34.659389 10849 raft_consensus.cc:3060] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:34.660432 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
W20260709 12:24:34.671435 11987 log.cc:927] Time spent T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.193s	user 0.005s	sys 0.000s
I20260709 12:24:34.672338 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:34.672380 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:34.673434 10850 raft_consensus.cc:2393] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 2: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:24:34.676498 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:34.679390 10819 leader_election.cc:304] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:34.657234 11901 raft_consensus.cc:2804] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:34.682765 10895 leader_election.cc:304] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:34.662329 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:34.673385 11944 leader_election.cc:290] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:34.688028 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352aa49c65194abbb863d7553a091f11" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:34.686199 11747 raft_consensus.cc:697] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:34.683969 11901 raft_consensus.cc:493] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:34.690637 11901 raft_consensus.cc:3060] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:34.691723 11870 raft_consensus.cc:2804] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:34.691133 11589 leader_election.cc:304] T d0aed74af73a488f8b691578ca370226 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:34.692359 11895 leader_election.cc:290] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:34.693045 11895 raft_consensus.cc:2804] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:34.692291 11870 raft_consensus.cc:697] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:34.701440 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:34.693427 11895 raft_consensus.cc:493] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:34.712730 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:34.715322 11895 raft_consensus.cc:3060] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:34.695686 11951 raft_consensus.cc:2804] T d0aed74af73a488f8b691578ca370226 P 3c52e0825c02476e89d84da9bb849f5d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:34.720898 11951 raft_consensus.cc:697] T d0aed74af73a488f8b691578ca370226 P 3c52e0825c02476e89d84da9bb849f5d [term 3 LEADER]: Becoming Leader. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
I20260709 12:24:34.722102 11951 consensus_queue.cc:237] T d0aed74af73a488f8b691578ca370226 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:34.724982 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:34.725349 11870 consensus_queue.cc:237] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:34.729858 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5794ba618e514e28a7542ab6af39d8c9" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:34.732694 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:34.688791 11885 raft_consensus.cc:2804] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:34.734069 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:34.700482 10819 leader_election.cc:304] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:34.740579 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:34.743484 11000 raft_consensus.cc:3060] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:34.704131 11944 raft_consensus.cc:2804] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:34.747054 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
W20260709 12:24:34.753917 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 65427.8us
I20260709 12:24:34.758073 10849 raft_consensus.cc:2468] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 4.
I20260709 12:24:34.701382 11861 raft_consensus.cc:515] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:34.738878 11885 raft_consensus.cc:493] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:34.770117 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:34.772024 11998 raft_consensus.cc:493] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:34.772893 11861 leader_election.cc:290] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:34.772039 11944 raft_consensus.cc:697] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 2 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:34.782590 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:34.776870 11747 consensus_queue.cc:237] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:34.788722 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63ecfc9bd3945818cfe15c03f001315" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:34.791369 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352aa49c65194abbb863d7553a091f11" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:34.793844 11998 raft_consensus.cc:515] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:34.779361 11885 raft_consensus.cc:3060] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:34.795783 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 146650us
W20260709 12:24:34.795554 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 50971.6us
I20260709 12:24:34.806665 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:34.807361 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c913e527ff46578e084c41eab7bb9d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:34.807565 11003 raft_consensus.cc:2393] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 2: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:24:34.813256 10894 leader_election.cc:304] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:34.789284 11851 raft_consensus.cc:2804] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:34.818214 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:34.830567 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:34.832559 11000 raft_consensus.cc:2468] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 2.
I20260709 12:24:34.839079 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:34.842397 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fd8fdac2fa449e9e184f3d668ea1a7" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:34.842718 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18294423a68a4671bf6c5a0f98645e4c" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:34.843483 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:34.847707 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:34.823397 11881 leader_election.cc:290] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:34.849673 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:34.827787 11851 raft_consensus.cc:493] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:34.852757 11000 raft_consensus.cc:3060] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:34.854297 10849 raft_consensus.cc:2468] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 2.
I20260709 12:24:34.855091 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
W20260709 12:24:34.861266 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 48130.1us
I20260709 12:24:34.862958 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:34.864538 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:34.853637 11851 raft_consensus.cc:3060] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:34.861799 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:34.871672 12000 raft_consensus.cc:2749] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:34.862526 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:34.882655 10968 leader_election.cc:304] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:34.883504 10894 leader_election.cc:304] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:34.872517 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac8522e549a46e09593fa4c2e175557" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
W20260709 12:24:34.884470 11993 log.cc:927] Time spent T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 12:24:34.886900 11895 raft_consensus.cc:515] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:34.894095 11893 raft_consensus.cc:2804] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:24:34.902163 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 48293.9us
W20260709 12:24:34.903719 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 89526.7us
I20260709 12:24:34.896941 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:34.851475 11944 consensus_queue.cc:237] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:34.905328 12000 raft_consensus.cc:2804] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:34.924152 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
W20260709 12:24:34.927894 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 44469.8us
I20260709 12:24:34.928735 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9331e5342644ca2bae19187b083a7d5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:34.930755 12005 raft_consensus.cc:493] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:34.931337 12005 raft_consensus.cc:515] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:34.931833 11895 leader_election.cc:290] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:34.932467 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:34.927795 11893 raft_consensus.cc:697] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 4 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:34.936167 11893 consensus_queue.cc:237] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:34.929517 11901 raft_consensus.cc:515] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:34.941200 10894 leader_election.cc:304] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:34.928189 11998 leader_election.cc:290] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:34.928025 12000 raft_consensus.cc:493] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:34.933694 12005 leader_election.cc:290] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:35.046512 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
W20260709 12:24:34.965953 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 46037.5us
I20260709 12:24:35.002485 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
W20260709 12:24:35.006512 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 81367.5us
I20260709 12:24:35.112159 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:34.991184 11000 raft_consensus.cc:2468] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 2.
I20260709 12:24:35.123301 10850 raft_consensus.cc:2393] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 2: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:24:35.044018 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:35.125257 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63ecfc9bd3945818cfe15c03f001315" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:35.126523 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:35.128082 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:35.129448 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:35.130244 10849 raft_consensus.cc:2410] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:24:35.130653 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:35.132272 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac83709373b4efd9c3aa1472a9f9022" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:35.106791 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad766f48812a4ddeb383179b1d84907b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:35.131515 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:34.955142 11747 raft_consensus.cc:2804] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:35.137415 11747 raft_consensus.cc:493] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:35.138178 11747 raft_consensus.cc:3060] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:35.027096 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:35.140206 10845 raft_consensus.cc:2468] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 1.
I20260709 12:24:35.074102 11885 raft_consensus.cc:515] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:35.143002 10852 raft_consensus.cc:1240] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:35.144706 12017 raft_consensus.cc:493] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:35.145424 12017 raft_consensus.cc:515] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:35.146616 11885 leader_election.cc:290] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:35.075368 11851 raft_consensus.cc:515] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:35.147989 12017 leader_election.cc:290] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:35.148631 10851 raft_consensus.cc:1240] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:34.955026 12000 raft_consensus.cc:3060] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:35.052883 11864 tablet_bootstrap.cc:492] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:35.031991 11901 leader_election.cc:290] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:24:35.168855 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 44275us
I20260709 12:24:35.174537 11000 raft_consensus.cc:1275] T d0aed74af73a488f8b691578ca370226 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:24:35.188030 11747 raft_consensus.cc:515] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:35.174747 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:35.186699 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:35.199911 11951 consensus_queue.cc:1048] T d0aed74af73a488f8b691578ca370226 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:35.200991 12017 consensus_queue.cc:1059] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:24:35.194384 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:35.194350 11843 consensus_queue.cc:1048] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:24:35.206661 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:35.203784 11747 leader_election.cc:290] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:35.228461 10854 raft_consensus.cc:2393] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 2: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:24:35.225564 10752 catalog_manager.cc:5697] T d0aed74af73a488f8b691578ca370226 P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: term changed from 2 to 3, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68). New cstate: current_term: 3 leader_uuid: "3c52e0825c02476e89d84da9bb849f5d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:35.241272 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:35.242956 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:35.246330 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:35.246608 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c6d38c4d8a90a81975a6a0cb13" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:24:35.244087 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 302983us
I20260709 12:24:35.252712 11000 raft_consensus.cc:3060] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:35.254282 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:35.254959 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:35.256738 10997 raft_consensus.cc:1240] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:35.257174 10996 raft_consensus.cc:1240] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:35.258913 11001 raft_consensus.cc:1240] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:35.259476 10922 raft_consensus.cc:3060] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:35.240434 11864 tablet_bootstrap.cc:492] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap complete.
I20260709 12:24:35.260545 11864 ts_tablet_manager.cc:1403] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d: Time spent bootstrapping tablet: real 0.767s	user 0.037s	sys 0.014s
I20260709 12:24:35.254613 10994 raft_consensus.cc:1240] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 1. Current term is 2. Ops: []
W20260709 12:24:35.263993 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 70210.6us
I20260709 12:24:35.265978 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:35.271610 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:35.274523 10894 leader_election.cc:304] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:35.273838 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:35.276576 11999 raft_consensus.cc:2804] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:35.277168 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:35.277455 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:35.278964 10928 raft_consensus.cc:3060] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:35.279095 10925 raft_consensus.cc:2468] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 3.
I20260709 12:24:35.279337 11864 raft_consensus.cc:359] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:24:35.279886 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:35.280277 11864 raft_consensus.cc:740] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Initialized, Role: LEARNER
I20260709 12:24:35.280922 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:35.281256 11864 consensus_queue.cc:260] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:24:35.277065 11999 raft_consensus.cc:493] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:35.282665 11999 raft_consensus.cc:3060] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:35.282693 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:35.283921 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:35.285506 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad766f48812a4ddeb383179b1d84907b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:35.286636 11864 ts_tablet_manager.cc:1434] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.000s
I20260709 12:24:35.287173 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:35.296324 11000 raft_consensus.cc:2468] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 2.
I20260709 12:24:35.296952 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac83709373b4efd9c3aa1472a9f9022" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:35.278139 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63ecfc9bd3945818cfe15c03f001315" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:35.312693 10939 tablet_copy_service.cc:342] P e2d5c637307a407ab688f5ccd6f0fcea: Request end of tablet copy session 3c52e0825c02476e89d84da9bb849f5d-a6a28416571247df878823d464c05f1e received from {username='slave'} at 127.0.0.1:50036
I20260709 12:24:35.313339 10939 tablet_copy_service.cc:434] P e2d5c637307a407ab688f5ccd6f0fcea: ending tablet copy session 3c52e0825c02476e89d84da9bb849f5d-a6a28416571247df878823d464c05f1e on tablet a6a28416571247df878823d464c05f1e with peer 3c52e0825c02476e89d84da9bb849f5d
I20260709 12:24:35.313959 12015 raft_consensus.cc:3055] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:35.314541 12015 raft_consensus.cc:740] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:35.316174 10820 leader_election.cc:304] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:35.317370 11937 raft_consensus.cc:2804] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:35.317982 11937 raft_consensus.cc:493] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:35.318676 11937 raft_consensus.cc:3060] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:35.318770 11851 leader_election.cc:290] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:35.320194 10923 raft_consensus.cc:3060] T c63ecfc9bd3945818cfe15c03f001315 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:35.327823 11937 raft_consensus.cc:515] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:35.330835 10820 leader_election.cc:304] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:35.333076 11851 raft_consensus.cc:2804] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:35.341166 10925 raft_consensus.cc:1240] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:35.343686 10820 leader_election.cc:304] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:35.336028 11851 raft_consensus.cc:493] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:35.346820 11851 raft_consensus.cc:3060] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:35.356067 10820 leader_election.cc:304] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
W20260709 12:24:35.358789 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 90930.8us
I20260709 12:24:35.360428 10925 raft_consensus.cc:1240] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:35.361816 11937 leader_election.cc:290] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:35.308250 12017 consensus_queue.cc:1059] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 12:24:35.370275 10920 raft_consensus.cc:1240] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:35.359333 11885 raft_consensus.cc:2804] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:35.371541 10894 leader_election.cc:304] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:35.315860 12015 consensus_queue.cc:260] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:35.353037 11944 consensus_queue.cc:1059] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:24:35.368213 11849 raft_consensus.cc:2804] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:35.374374 11885 raft_consensus.cc:493] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:35.404258 11885 raft_consensus.cc:3060] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:35.404899 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:35.406493 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:35.407507 11001 raft_consensus.cc:2393] T 3f8a389131ef4c77a3e08488aa4759eb P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 2: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:24:35.404157 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:35.413086 10922 raft_consensus.cc:1275] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:24:35.384943 11747 raft_consensus.cc:2804] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:35.425845 11747 raft_consensus.cc:493] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:35.426499 11747 raft_consensus.cc:3060] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:35.425758 12000 raft_consensus.cc:515] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:35.385766 10894 leader_election.cc:304] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:24:35.434916 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 49280.3us
I20260709 12:24:35.437331 11944 raft_consensus.cc:2749] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:35.438104 10894 leader_election.cc:304] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:35.439620 11944 raft_consensus.cc:2749] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:35.389108 12015 raft_consensus.cc:3060] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:35.390136 11861 raft_consensus.cc:3055] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:35.440440 11861 raft_consensus.cc:740] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:35.441596 11861 consensus_queue.cc:260] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:35.391304 11849 raft_consensus.cc:493] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:35.445161 11849 raft_consensus.cc:3060] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:35.396834 10820 leader_election.cc:304] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:35.397003 12011 consensus_queue.cc:1059] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:24:35.397022 11843 consensus_queue.cc:1059] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:24:35.398972 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:35.402720 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:35.395504 12017 raft_consensus.cc:3055] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:35.378983 10928 raft_consensus.cc:2468] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 2.
I20260709 12:24:35.424968 10968 leader_election.cc:304] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:35.453972 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6a1da21304fcfacab384a6afc4101" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:35.458230 10920 raft_consensus.cc:1240] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:35.443348 11861 raft_consensus.cc:3060] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:35.462138 10996 raft_consensus.cc:2393] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 3: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
W20260709 12:24:35.461826 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 86714.7us
I20260709 12:24:35.462888 12016 raft_consensus.cc:2749] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:35.502434 10895 leader_election.cc:304] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:35.520582 11747 raft_consensus.cc:515] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:35.531020 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d9a61ecaf84695b70f8519ee57706f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:35.534842 11747 leader_election.cc:290] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:35.457834 12017 raft_consensus.cc:740] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:35.539660 10751 catalog_manager.cc:5697] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
W20260709 12:24:35.542438 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 141812us
W20260709 12:24:35.550715 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 89651.1us
I20260709 12:24:35.537496 11881 raft_consensus.cc:2804] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:35.512815 11937 consensus_queue.cc:1059] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 12:24:35.555958 10894 leader_election.cc:304] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:24:35.564327 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 167549us
I20260709 12:24:35.565420 10820 leader_election.cc:304] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:35.567108 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:35.567421 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:35.584618 10894 leader_election.cc:304] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:24:35.588059 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 61050.2us
I20260709 12:24:35.563604 11944 raft_consensus.cc:2804] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:35.595824 12024 consensus_queue.cc:1048] T d0aed74af73a488f8b691578ca370226 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 12:24:35.597185 10820 leader_election.cc:304] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:35.597265 12000 leader_election.cc:290] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:24:35.608326 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 69262.5us
I20260709 12:24:35.597990 12031 raft_consensus.cc:2749] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:35.609643 10968 leader_election.cc:304] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:35.602065 11999 raft_consensus.cc:515] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:35.569010 12011 raft_consensus.cc:2749] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:35.563138 11881 raft_consensus.cc:697] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 2 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:35.595106 12030 raft_consensus.cc:3055] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:35.605926 10894 leader_election.cc:304] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:35.576207 10996 raft_consensus.cc:1240] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:35.597714 12026 consensus_queue.cc:1059] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 12:24:35.610164 10895 leader_election.cc:304] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:35.620280 12000 raft_consensus.cc:2749] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:35.613257 11882 raft_consensus.cc:2749] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:35.608228 11944 raft_consensus.cc:493] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:35.612147 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:35.629768 11870 raft_consensus.cc:2804] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:35.629861 10968 leader_election.cc:304] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:35.572962 12032 consensus_queue.cc:1059] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 12:24:35.640517 11851 raft_consensus.cc:515] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:35.643711 12034 raft_consensus.cc:3055] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:35.644347 12034 raft_consensus.cc:740] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:35.645545 12034 consensus_queue.cc:260] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:35.638403 12015 consensus_queue.cc:1059] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:24:35.648765 11588 leader_election.cc:304] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:35.638137 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:35.650357 11870 raft_consensus.cc:697] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 2 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:35.650480 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b17195a94142039c40f598ed006c94" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:35.650559 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab816bcc6183447994a2cc013e46c5f8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:35.651674 11870 consensus_queue.cc:237] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:35.652436 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9331e5342644ca2bae19187b083a7d5" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:35.643111 11885 raft_consensus.cc:515] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:35.654518 12019 raft_consensus.cc:2749] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:35.654618 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:35.624514 12031 consensus_queue.cc:1059] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:24:35.657006 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c6d38c4d8a90a81975a6a0cb13" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:35.616701 12030 raft_consensus.cc:740] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:35.624599 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:35.647403 12034 raft_consensus.cc:3060] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:35.621498 12036 raft_consensus.cc:2749] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:35.613240 12017 consensus_queue.cc:260] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:35.672972 12017 raft_consensus.cc:3060] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:35.648013 11881 consensus_queue.cc:237] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:35.664531 11882 raft_consensus.cc:2749] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:35.678417 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:35.667253 10923 raft_consensus.cc:2468] T c63ecfc9bd3945818cfe15c03f001315 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 2.
I20260709 12:24:35.665940 11843 consensus_queue.cc:1059] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:35.684032 10925 raft_consensus.cc:1240] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:35.667001 12032 raft_consensus.cc:3055] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:35.684700 12032 raft_consensus.cc:740] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:35.685382 10968 leader_election.cc:304] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:35.685580 12032 consensus_queue.cc:260] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:35.686966 12032 raft_consensus.cc:3060] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:35.687309 11955 raft_consensus.cc:2749] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:35.687803 12036 raft_consensus.cc:3055] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:35.688241 12036 raft_consensus.cc:740] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:35.636215 11944 raft_consensus.cc:3060] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:35.665932 11851 leader_election.cc:290] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:35.689399 12036 consensus_queue.cc:260] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:24:35.695894 10817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:35.698298 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 77176.8us
I20260709 12:24:35.689335 12030 consensus_queue.cc:260] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:35.707213 12030 raft_consensus.cc:3060] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:35.708426 10820 leader_election.cc:304] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:24:35.705489 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 79326us
I20260709 12:24:35.712446 10968 leader_election.cc:304] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
W20260709 12:24:35.728626 10818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:35.728926 12026 raft_consensus.cc:2749] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:35.737959 10820 leader_election.cc:304] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:35.746707 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:35.749892 10968 leader_election.cc:304] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:35.731787 11882 raft_consensus.cc:2749] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:24:35.732501 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 83854.1us
I20260709 12:24:35.767694 10994 raft_consensus.cc:1275] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:24:35.760958 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 124255us
I20260709 12:24:35.783365 10820 leader_election.cc:304] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:35.785326 10968 leader_election.cc:304] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:35.764367 11955 raft_consensus.cc:3060] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:35.790673 12016 raft_consensus.cc:2749] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:35.787140 11885 leader_election.cc:290] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:35.781841 10922 raft_consensus.cc:1240] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:35.746897 12026 consensus_queue.cc:1059] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:24:35.795285 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:35.797317 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:24:35.801436 10819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:35.801733 10820 leader_election.cc:304] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:35.787919 11851 raft_consensus.cc:2749] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:35.812170 10929 raft_consensus.cc:1240] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:35.789408 10921 raft_consensus.cc:1240] T c63ecfc9bd3945818cfe15c03f001315 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:35.804198 12040 raft_consensus.cc:2749] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:35.801196 10923 raft_consensus.cc:1240] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 LEADER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:35.807978 12026 raft_consensus.cc:3055] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:35.820397 12026 raft_consensus.cc:740] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:35.791404 11999 leader_election.cc:290] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:35.828207 10923 raft_consensus.cc:1240] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:24:35.829996 12036 raft_consensus.cc:3060] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:35.830267 11851 raft_consensus.cc:2804] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:35.830672 11851 raft_consensus.cc:493] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:35.831053 11851 raft_consensus.cc:3060] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:35.831408 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:35.832440 10820 leader_election.cc:304] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:35.834895 10926 raft_consensus.cc:1240] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:35.835072 11624 raft_consensus.cc:1217] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 12:24:35.836163 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 43625.2us
I20260709 12:24:35.837842 10894 leader_election.cc:304] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:24:35.810873 10819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:35.822960 12033 raft_consensus.cc:3055] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:35.825239 12041 raft_consensus.cc:2804] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:35.826313 10968 leader_election.cc:304] T a6a28416571247df878823d464c05f1e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:35.846937 12033 raft_consensus.cc:740] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:35.847110 12041 raft_consensus.cc:493] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:35.847811 12041 raft_consensus.cc:3060] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:35.848431 12033 consensus_queue.cc:260] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:35.849846 11882 raft_consensus.cc:2749] T a6a28416571247df878823d464c05f1e P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:35.850453 12033 raft_consensus.cc:3060] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:35.849118 10968 leader_election.cc:304] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040
I20260709 12:24:35.853999 10968 leader_election.cc:304] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040
I20260709 12:24:35.855018 11882 raft_consensus.cc:2749] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:35.855166 12016 raft_consensus.cc:2749] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:35.856144 12041 raft_consensus.cc:515] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:35.857584 10968 leader_election.cc:304] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:35.858930 12041 leader_election.cc:290] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:35.858705 12016 raft_consensus.cc:2804] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:35.859715 12016 raft_consensus.cc:493] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:35.859998 10819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:35.860345 12016 raft_consensus.cc:3060] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:35.861656 11885 raft_consensus.cc:3055] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:35.864166 11885 raft_consensus.cc:740] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:35.867134 10820 leader_election.cc:304] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:35.863289 10968 leader_election.cc:304] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:35.873132 11882 raft_consensus.cc:2749] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:35.874467 11955 raft_consensus.cc:2749] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:35.865222 11885 consensus_queue.cc:260] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:24:35.875114 10968 leader_election.cc:304] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:35.876315 11747 raft_consensus.cc:2804] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:35.876864 11747 raft_consensus.cc:493] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:35.876796 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab816bcc6183447994a2cc013e46c5f8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:35.877336 11747 raft_consensus.cc:3060] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:35.822858 11849 raft_consensus.cc:515] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:35.883625 10894 leader_election.cc:304] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:35.901965 10968 leader_election.cc:304] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:35.906270 10820 leader_election.cc:304] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:35.908365 11747 raft_consensus.cc:515] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:35.913638 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:35.914037 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:35.887315 12015 raft_consensus.cc:2749] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:35.885332 11955 raft_consensus.cc:2749] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:35.885051 12011 raft_consensus.cc:2749] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:35.916373 11747 leader_election.cc:290] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:35.919369 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18294423a68a4671bf6c5a0f98645e4c" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:35.919449 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:35.900560 11870 raft_consensus.cc:2749] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:35.901576 11885 raft_consensus.cc:3060] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:35.920799 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:35.922408 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:35.934237 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:35.922549 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c913e527ff46578e084c41eab7bb9d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:35.923041 11937 raft_consensus.cc:3055] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:35.923738 11988 raft_consensus.cc:2749] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:35.923843 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:35.941098 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d9a61ecaf84695b70f8519ee57706f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:35.875871 12026 consensus_queue.cc:260] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:35.927698 10927 raft_consensus.cc:1240] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 2 LEADER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:35.923979 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac8522e549a46e09593fa4c2e175557" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:35.945930 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:35.928239 12034 raft_consensus.cc:493] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:35.930123 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:35.886617 12014 consensus_queue.cc:1059] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 12:24:35.883808 11851 raft_consensus.cc:515] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:35.928069 10968 leader_election.cc:304] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:35.929358 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:35.903729 12041 raft_consensus.cc:493] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:35.942889 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6a1da21304fcfacab384a6afc4101" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:35.928093 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fd8fdac2fa449e9e184f3d668ea1a7" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:35.950604 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:35.938886 11937 raft_consensus.cc:740] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:35.940321 12011 raft_consensus.cc:2749] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:35.959810 10820 leader_election.cc:304] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:35.964952 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:35.966077 10849 raft_consensus.cc:1240] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:35.967748 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:35.977425 12041 raft_consensus.cc:515] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:35.965894 12034 raft_consensus.cc:515] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:35.927347 11944 raft_consensus.cc:515] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:35.984230 12049 log.cc:927] Time spent T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 12:24:35.984753 10924 raft_consensus.cc:2393] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 4: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:24:35.987694 11988 raft_consensus.cc:2749] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:35.989740 10968 leader_election.cc:304] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:35.990618 10854 raft_consensus.cc:2468] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 3.
I20260709 12:24:36.003826 10848 raft_consensus.cc:1275] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:36.004575 12017 raft_consensus.cc:2749] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:35.999070 11988 raft_consensus.cc:2749] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:35.965306 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:36.016839 10845 raft_consensus.cc:2393] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 4: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:24:36.018112 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:36.019168 10920 raft_consensus.cc:2393] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 4: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:24:36.018584 11937 consensus_queue.cc:260] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:36.020576 11937 raft_consensus.cc:3060] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:36.026994 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:36.004798 10851 raft_consensus.cc:2468] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 2.
I20260709 12:24:36.029906 11861 consensus_queue.cc:1048] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:36.035414 12016 raft_consensus.cc:515] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:36.041594 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:36.043475 10852 raft_consensus.cc:1240] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:36.043732 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:36.046250 12016 leader_election.cc:290] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:36.046765 10852 raft_consensus.cc:1240] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:36.048992 11870 raft_consensus.cc:3055] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:36.049788 11870 raft_consensus.cc:740] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:36.050721 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac8522e549a46e09593fa4c2e175557" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:36.050838 11870 consensus_queue.cc:260] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:36.053961 11870 raft_consensus.cc:3060] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:36.051834 12026 raft_consensus.cc:3060] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:36.052556 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352aa49c65194abbb863d7553a091f11" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:36.052764 11849 leader_election.cc:290] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:36.059314 10848 raft_consensus.cc:2468] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 2.
I20260709 12:24:36.057979 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:36.060818 10851 raft_consensus.cc:3060] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:36.063836 11851 leader_election.cc:290] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:35.950671 12015 consensus_queue.cc:1059] T 18294423a68a4671bf6c5a0f98645e4c P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.078s
I20260709 12:24:36.075476 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5794ba618e514e28a7542ab6af39d8c9" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:36.080088 10849 raft_consensus.cc:1275] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:36.080747 10820 leader_election.cc:304] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:36.081100 12033 consensus_queue.cc:1059] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:36.081966 12017 raft_consensus.cc:2804] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:36.082499 12017 raft_consensus.cc:697] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 2 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:36.083402 12017 consensus_queue.cc:237] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:36.085224 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
W20260709 12:24:36.087121 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 95751us
I20260709 12:24:36.089775 10968 leader_election.cc:304] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:36.097708 10968 leader_election.cc:304] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:36.099800 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab816bcc6183447994a2cc013e46c5f8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:36.104197 11000 raft_consensus.cc:3060] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:36.105862 10928 raft_consensus.cc:1240] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 1. Current term is 2. Ops: [1.2-1.2]
I20260709 12:24:36.106555 10925 raft_consensus.cc:1240] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 LEADER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:36.107614 10996 raft_consensus.cc:1240] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:36.107905 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:36.108611 11001 raft_consensus.cc:1240] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:36.109548 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:36.111413 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:36.111498 10819 leader_election.cc:304] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:36.093497 12016 raft_consensus.cc:2749] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:36.112515 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:36.108155 10925 raft_consensus.cc:1240] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:36.108853 12051 raft_consensus.cc:493] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.114691 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:36.115437 12051 raft_consensus.cc:515] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:36.119079 12051 leader_election.cc:290] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:36.128885 11000 raft_consensus.cc:2468] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 2.
I20260709 12:24:36.138183 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:36.139191 11000 raft_consensus.cc:2368] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 3. Current term is 4.
I20260709 12:24:36.143060 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
W20260709 12:24:36.146354 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 48706.9us
I20260709 12:24:36.147189 10968 leader_election.cc:304] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:36.148376 12016 raft_consensus.cc:2749] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:36.148949 10968 leader_election.cc:304] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:36.151502 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:36.094527 10921 raft_consensus.cc:1240] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 1. Current term is 2. Ops: []
W20260709 12:24:36.156594 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 45182.2us
I20260709 12:24:36.147078 11988 raft_consensus.cc:2749] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:36.157718 10819 leader_election.cc:304] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:24:36.137097 12047 log.cc:927] Time spent T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260709 12:24:36.164322 10968 leader_election.cc:304] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:36.092519 11851 consensus_queue.cc:1059] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.066s
I20260709 12:24:36.173659 10847 raft_consensus.cc:1240] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:36.182152 10968 leader_election.cc:304] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:36.163100 11882 raft_consensus.cc:3060] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:36.158679 11849 raft_consensus.cc:493] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:36.163291 12041 leader_election.cc:290] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:36.164507 12033 raft_consensus.cc:2749] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:36.189640 10819 leader_election.cc:304] T e8b17195a94142039c40f598ed006c94 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:36.193626 10968 leader_election.cc:304] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:36.184777 11955 raft_consensus.cc:2749] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:36.186556 12016 raft_consensus.cc:2749] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:36.215859 12017 raft_consensus.cc:2749] T e8b17195a94142039c40f598ed006c94 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:36.195751 12052 raft_consensus.cc:2749] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:36.221314 10846 raft_consensus.cc:2410] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for term 2 because replica has last-logged OpId of term: 1 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:24:36.223093 10820 leader_election.cc:304] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
W20260709 12:24:36.223909 10818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:36.224538 12016 raft_consensus.cc:2804] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:36.224987 12016 raft_consensus.cc:493] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:36.225344 12016 raft_consensus.cc:3060] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:36.194073 11849 raft_consensus.cc:515] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:36.194747 12041 consensus_queue.cc:1059] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 12:24:36.227766 10820 leader_election.cc:400] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 election: Vote denied by peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945) with higher term. Message: Invalid argument: T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 3. Current term is 4.
I20260709 12:24:36.238250 10820 leader_election.cc:403] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:24:36.197229 12034 leader_election.cc:290] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:36.228379 12011 raft_consensus.cc:2804] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:36.227864 10845 raft_consensus.cc:2468] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 2.
I20260709 12:24:36.240044 11885 raft_consensus.cc:3060] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:36.240361 12011 raft_consensus.cc:697] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [term 2 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:36.241539 12011 consensus_queue.cc:237] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:36.242380 11849 leader_election.cc:290] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:36.232969 10819 leader_election.cc:304] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:36.253768 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fd8fdac2fa449e9e184f3d668ea1a7" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:36.255093 10819 leader_election.cc:304] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:36.255808 11937 raft_consensus.cc:2749] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:36.256541 11937 raft_consensus.cc:2749] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:36.256484 10819 leader_election.cc:304] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:36.258188 10819 leader_election.cc:304] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:36.258217 12052 raft_consensus.cc:2749] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:36.259362 12052 raft_consensus.cc:2749] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:36.259223 12030 consensus_queue.cc:1059] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:36.235888 10853 raft_consensus.cc:2468] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 2.
I20260709 12:24:36.244743 12041 raft_consensus.cc:3055] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:36.260289 12052 raft_consensus.cc:3055] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:36.260636 12041 raft_consensus.cc:740] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:36.260800 12052 raft_consensus.cc:740] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:36.261570 12041 consensus_queue.cc:260] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:36.262356 12016 raft_consensus.cc:515] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:36.261955 12052 consensus_queue.cc:260] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:36.244966 10851 raft_consensus.cc:2468] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 4.
I20260709 12:24:36.246611 11870 raft_consensus.cc:1064] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea: attempting to promote NON_VOTER 3c52e0825c02476e89d84da9bb849f5d to VOTER
I20260709 12:24:36.251186 10850 raft_consensus.cc:1275] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:36.252060 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:36.266885 11001 raft_consensus.cc:2468] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 3.
I20260709 12:24:36.253000 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:36.273181 10848 raft_consensus.cc:1240] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:36.278918 12052 raft_consensus.cc:3060] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:36.272779 12041 raft_consensus.cc:3060] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:36.282663 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 89122.5us
I20260709 12:24:36.285804 11885 raft_consensus.cc:2749] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945) with higher term. Message: Invalid argument: T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 3. Current term is 4.
I20260709 12:24:36.292212 11870 consensus_queue.cc:237] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:36.293761 11882 raft_consensus.cc:2749] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:36.294005 12016 leader_election.cc:290] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:36.295889 12059 consensus_queue.cc:1059] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:36.292409 12011 consensus_queue.cc:1059] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:36.298159 10968 leader_election.cc:304] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:36.301964 12026 consensus_queue.cc:1059] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:36.299455 11882 consensus_queue.cc:1059] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:24:36.303877 11882 raft_consensus.cc:3055] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:36.304385 11882 raft_consensus.cc:740] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:36.305285 11882 consensus_queue.cc:260] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:36.306110 10820 leader_election.cc:304] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:36.306629 11882 raft_consensus.cc:3060] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:36.308099 11849 raft_consensus.cc:2804] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:36.308635 11849 raft_consensus.cc:493] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:36.309062 11849 raft_consensus.cc:3060] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:36.312763 10969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:36.310328 11944 leader_election.cc:290] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:36.310458 10819 leader_election.cc:304] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:36.324158 12041 raft_consensus.cc:2749] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:36.326701 12026 raft_consensus.cc:493] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:36.324606 12059 raft_consensus.cc:3060] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:36.329818 12035 raft_consensus.cc:3055] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:36.351794 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:36.358141 11002 raft_consensus.cc:1240] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:36.364239 11001 raft_consensus.cc:1275] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:36.366582 12026 raft_consensus.cc:515] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:36.343955 12011 consensus_queue.cc:1059] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:24:36.376545 12011 raft_consensus.cc:3055] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:24:36.379438 10895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:36.347065 12035 raft_consensus.cc:740] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:36.380971 12005 consensus_queue.cc:1059] T ab816bcc6183447994a2cc013e46c5f8 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:36.387245 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:36.386885 12035 consensus_queue.cc:260] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:36.388113 10853 raft_consensus.cc:2393] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 2: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:24:36.389168 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:36.392474 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6a1da21304fcfacab384a6afc4101" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:36.386806 12036 raft_consensus.cc:3055] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:36.380110 11885 raft_consensus.cc:3055] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:36.380045 11955 consensus_queue.cc:1059] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:36.395181 11885 raft_consensus.cc:740] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:36.395803 11955 raft_consensus.cc:3055] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:36.396239 11955 raft_consensus.cc:740] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:36.396431 11885 consensus_queue.cc:260] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:36.397069 11955 consensus_queue.cc:260] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:36.398411 11885 raft_consensus.cc:3060] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:36.394968 12036 raft_consensus.cc:740] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:36.401839 12036 consensus_queue.cc:260] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:36.404409 12062 log.cc:927] Time spent T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:24:36.405186 12005 raft_consensus.cc:3055] T ab816bcc6183447994a2cc013e46c5f8 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:36.405737 12005 raft_consensus.cc:740] T ab816bcc6183447994a2cc013e46c5f8 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:36.407219 12005 consensus_queue.cc:260] T ab816bcc6183447994a2cc013e46c5f8 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:36.398427 11955 raft_consensus.cc:3060] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:36.409466 10854 raft_consensus.cc:1275] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:36.411082 12011 raft_consensus.cc:740] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:36.412048 12011 consensus_queue.cc:260] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:36.413276 12011 raft_consensus.cc:3060] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:36.380544 12031 raft_consensus.cc:3055] T 18294423a68a4671bf6c5a0f98645e4c P 80cd7d227db44f34a6108591dad9c040 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:36.375223 12026 leader_election.cc:290] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:36.389138 12035 raft_consensus.cc:3060] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:36.427258 10927 raft_consensus.cc:1240] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:36.418885 10921 raft_consensus.cc:1240] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:36.419797 10924 raft_consensus.cc:1240] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:36.419900 10925 raft_consensus.cc:1240] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:36.431041 10819 leader_election.cc:304] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:36.418578 12036 raft_consensus.cc:3060] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:36.425506 12031 raft_consensus.cc:740] T 18294423a68a4671bf6c5a0f98645e4c P 80cd7d227db44f34a6108591dad9c040 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:36.431859 12026 consensus_queue.cc:1059] T 18294423a68a4671bf6c5a0f98645e4c P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:36.432031 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:36.394906 10752 catalog_manager.cc:5697] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 3 to 4, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 4 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:36.432580 12005 raft_consensus.cc:3060] T ab816bcc6183447994a2cc013e46c5f8 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:36.432703 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
W20260709 12:24:36.435966 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 101451us
I20260709 12:24:36.436942 10927 raft_consensus.cc:1240] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:36.445446 10752 catalog_manager.cc:5697] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 1 to 2, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 2 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:36.447151 10894 leader_election.cc:304] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:36.433305 11944 consensus_queue.cc:1048] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:24:36.449848 10894 leader_election.cc:304] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:36.455497 10894 leader_election.cc:304] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:36.435148 12041 raft_consensus.cc:2749] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:36.439905 10928 raft_consensus.cc:3060] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:36.463109 11747 raft_consensus.cc:2749] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:36.458721 10968 leader_election.cc:304] T 442726a7f1e441248ec80a98b31eb341 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:36.459671 10752 catalog_manager.cc:5697] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 1 to 2, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 2 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:36.485127 10894 leader_election.cc:304] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:24:36.486302 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 55359.9us
I20260709 12:24:36.449821 12026 consensus_queue.cc:1243] T 18294423a68a4671bf6c5a0f98645e4c P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer e2d5c637307a407ab688f5ccd6f0fcea log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:24:36.457751 12060 raft_consensus.cc:2749] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:36.510536 10819 leader_election.cc:304] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:36.511001 10920 raft_consensus.cc:1240] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:36.512488 10819 leader_election.cc:304] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:36.514446 10894 leader_election.cc:304] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:36.515801 11747 raft_consensus.cc:2749] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:36.516010 10894 leader_election.cc:304] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:36.517601 10894 leader_election.cc:304] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:36.519394 10894 leader_election.cc:304] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:36.526176 11747 raft_consensus.cc:2749] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:36.526924 11747 raft_consensus.cc:2749] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:36.527688 11747 raft_consensus.cc:2749] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:36.528487 11747 raft_consensus.cc:2749] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:24:36.532742 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:36.523867 12026 raft_consensus.cc:2749] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:36.524168 11937 raft_consensus.cc:2749] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:24:36.556255 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 43865.4us
I20260709 12:24:36.570999 10819 leader_election.cc:304] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:36.572659 10819 leader_election.cc:304] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:36.557796 12061 raft_consensus.cc:2749] T 442726a7f1e441248ec80a98b31eb341 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:24:36.524365 11588 leader_election.cc:336] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Timed out: RequestConsensusVote RPC to 127.9.116.65:46265 timed out after 1.579s (SENT)
I20260709 12:24:36.556941 12037 raft_consensus.cc:2749] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:36.579653 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:36.582983 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fd8fdac2fa449e9e184f3d668ea1a7" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:36.584213 10928 raft_consensus.cc:2468] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 4.
I20260709 12:24:36.589423 10925 raft_consensus.cc:2393] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 3: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:24:36.591699 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:36.592078 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:36.592657 10926 raft_consensus.cc:2468] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 2.
I20260709 12:24:36.596349 10927 raft_consensus.cc:2393] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 4: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:24:36.575795 11937 raft_consensus.cc:2749] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:36.598206 11849 raft_consensus.cc:515] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:36.606735 11849 leader_election.cc:290] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:24:36.607530 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 91717.2us
I20260709 12:24:36.607836 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
W20260709 12:24:36.608299 11588 leader_election.cc:336] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Timed out: RequestConsensusVote RPC to 127.9.116.65:46265 timed out after 1.602s (SENT)
I20260709 12:24:36.608487 10995 raft_consensus.cc:3060] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:36.608932 11588 leader_election.cc:304] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:36.609499 10998 raft_consensus.cc:1275] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:36.610661 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:36.611207 12059 raft_consensus.cc:2749] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:36.611488 11001 raft_consensus.cc:1275] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:36.546664 12031 consensus_queue.cc:260] T 18294423a68a4671bf6c5a0f98645e4c P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:36.585207 11843 raft_consensus.cc:2749] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:36.608350 11624 raft_consensus.cc:1275] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [term 1 LEARNER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:36.611999 10921 raft_consensus.cc:2368] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 3. Current term is 4.
W20260709 12:24:36.619334 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 165069us
I20260709 12:24:36.623378 10925 raft_consensus.cc:1240] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:24:36.623699 10994 raft_consensus.cc:1275] T a6a28416571247df878823d464c05f1e P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:36.638490 10995 raft_consensus.cc:2468] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 4.
I20260709 12:24:36.625347 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:36.586995 12041 consensus_queue.cc:1059] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:24:36.658775 10849 raft_consensus.cc:1240] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:36.629902 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:36.660348 10854 raft_consensus.cc:2393] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 4: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:24:36.630771 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:36.615033 11003 raft_consensus.cc:1275] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:24:36.658041 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 138739us
I20260709 12:24:36.587893 12052 consensus_queue.cc:1059] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:24:36.668164 10850 raft_consensus.cc:1240] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:36.641412 10820 leader_election.cc:304] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:36.636974 10968 leader_election.cc:304] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:36.643563 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:36.670004 10920 raft_consensus.cc:3060] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:24:36.646576 10819 leader_election.cc:304] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:36.649313 12005 consensus_queue.cc:1048] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:36.658025 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6a1da21304fcfacab384a6afc4101" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:36.614872 10851 raft_consensus.cc:2468] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 4.
I20260709 12:24:36.666106 10894 leader_election.cc:304] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:24:36.696707 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 50264.5us
I20260709 12:24:36.697132 12011 raft_consensus.cc:2749] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:36.698103 10819 leader_election.cc:304] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:36.700124 10819 leader_election.cc:304] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:36.700791 12036 raft_consensus.cc:3060] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:36.701999 12052 raft_consensus.cc:2749] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:36.702901 11849 raft_consensus.cc:3055] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:36.703325 11849 raft_consensus.cc:740] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:36.703672 12031 raft_consensus.cc:3060] T 18294423a68a4671bf6c5a0f98645e4c P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:36.638589 11861 consensus_queue.cc:1048] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.041s
W20260709 12:24:36.679455 10893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:36.687197 10926 raft_consensus.cc:2393] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 2: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:24:36.675063 10853 raft_consensus.cc:2468] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 4.
W20260709 12:24:36.711957 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 70660.5us
I20260709 12:24:36.667939 12016 raft_consensus.cc:3055] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:24:36.739362 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 102518us
W20260709 12:24:36.740715 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 62723.3us
I20260709 12:24:36.744192 10997 raft_consensus.cc:1275] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:36.745157 10968 leader_election.cc:304] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
W20260709 12:24:36.747462 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 81512us
I20260709 12:24:36.748317 10894 leader_election.cc:304] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:36.749487 10819 leader_election.cc:400] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 election: Vote denied by peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339) with higher term. Message: Invalid argument: T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 3. Current term is 4.
I20260709 12:24:36.751251 10819 leader_election.cc:304] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:36.738504 11843 raft_consensus.cc:2804] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:36.736678 12061 raft_consensus.cc:2749] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:36.754648 12059 raft_consensus.cc:2749] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:36.739364 12016 raft_consensus.cc:740] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
W20260709 12:24:36.739825 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 131559us
I20260709 12:24:36.760267 10968 leader_election.cc:304] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:36.750504 12069 raft_consensus.cc:2749] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:36.750965 12005 consensus_queue.cc:1048] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 12:24:36.754648 12026 raft_consensus.cc:3060] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:36.770836 12076 raft_consensus.cc:3060] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:36.778070 10968 leader_election.cc:304] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:36.782713 10920 raft_consensus.cc:2468] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 4.
I20260709 12:24:36.747665 12011 raft_consensus.cc:493] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:36.786907 10894 leader_election.cc:304] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:36.794435 10894 leader_election.cc:304] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:36.798069 10894 leader_election.cc:304] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:36.777395 11881 raft_consensus.cc:2749] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:36.781845 12065 raft_consensus.cc:2749] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:36.804824 10968 leader_election.cc:304] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:36.823173 10926 raft_consensus.cc:1275] T ab816bcc6183447994a2cc013e46c5f8 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:36.806888 10894 leader_election.cc:304] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:24:36.823733 10969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:36.802214 12060 raft_consensus.cc:2749] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:36.783972 11843 raft_consensus.cc:697] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:36.823223 12042 raft_consensus.cc:2804] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:24:36.848579 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 43908.8us
W20260709 12:24:36.848695 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 86949.9us
I20260709 12:24:36.801395 12067 raft_consensus.cc:2749] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:36.850518 10968 leader_election.cc:304] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:36.792616 12017 consensus_queue.cc:1048] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 12:24:36.854897 10968 leader_election.cc:304] T 3f8a389131ef4c77a3e08488aa4759eb P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:36.786566 11588 leader_election.cc:304] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:36.792862 11861 consensus_queue.cc:1059] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 12:24:36.857056 10968 leader_election.cc:304] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
W20260709 12:24:36.852721 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 45962.4us
I20260709 12:24:36.846405 11955 raft_consensus.cc:2749] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:36.822921 12072 consensus_queue.cc:1048] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 12:24:36.847972 11988 raft_consensus.cc:2749] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:36.862700 10968 leader_election.cc:304] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:36.858337 12019 raft_consensus.cc:2749] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:36.847451 12074 raft_consensus.cc:493] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:36.878945 12074 raft_consensus.cc:515] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:36.867111 12068 raft_consensus.cc:2749] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:36.881459 12074 leader_election.cc:290] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:36.881114 11843 consensus_queue.cc:237] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:36.809729 12011 raft_consensus.cc:515] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:36.831487 12016 consensus_queue.cc:260] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:36.886333 12016 raft_consensus.cc:3060] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:36.887737 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:36.888981 12011 leader_election.cc:290] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:36.892373 11937 raft_consensus.cc:3055] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:36.892936 11937 raft_consensus.cc:740] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:36.894199 11937 consensus_queue.cc:260] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:36.907626 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 44952.1us
I20260709 12:24:36.855150 12065 raft_consensus.cc:2749] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:36.858357 12035 raft_consensus.cc:493] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:36.915549 10894 leader_election.cc:304] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:36.858772 12042 raft_consensus.cc:697] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 2 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:36.913519 10968 leader_election.cc:304] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:36.859272 12061 raft_consensus.cc:2749] T 3f8a389131ef4c77a3e08488aa4759eb P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:24:36.918829 10895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:36.920444 12035 raft_consensus.cc:515] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:36.913657 11988 raft_consensus.cc:2749] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:24:36.939709 10969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:36.944540 10894 leader_election.cc:304] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d
I20260709 12:24:36.936028 11937 raft_consensus.cc:3060] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:36.934366 12037 raft_consensus.cc:2749] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:36.916887 12052 consensus_queue.cc:1048] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:24:36.933401 12036 raft_consensus.cc:2749] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:36.952216 11988 raft_consensus.cc:2749] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:36.955040 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:36.961858 10921 raft_consensus.cc:2468] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 3.
I20260709 12:24:36.956990 10920 raft_consensus.cc:1240] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:36.949532 11895 consensus_queue.cc:1059] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 12:24:36.964470 12026 raft_consensus.cc:2749] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:36.965102 12051 raft_consensus.cc:2804] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:36.966990 12051 raft_consensus.cc:697] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:36.967386 10819 leader_election.cc:304] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:36.967851 12041 raft_consensus.cc:493] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.968010 12051 consensus_queue.cc:237] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:36.968600 12080 raft_consensus.cc:2804] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:36.966192 11895 raft_consensus.cc:3055] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:36.968441 12041 raft_consensus.cc:515] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:36.960019 10968 leader_election.cc:304] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:36.969702 10894 leader_election.cc:304] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:36.945389 11951 raft_consensus.cc:3060] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:36.936180 11870 consensus_queue.cc:1059] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 12:24:36.975358 10894 leader_election.cc:304] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:36.978528 10926 raft_consensus.cc:1275] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:36.982748 12037 consensus_queue.cc:1048] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:36.976647 11999 raft_consensus.cc:2804] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:36.985523 10845 raft_consensus.cc:1275] T 18294423a68a4671bf6c5a0f98645e4c P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:36.986438 11988 raft_consensus.cc:2749] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:36.983237 12041 leader_election.cc:290] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:36.938839 12019 consensus_queue.cc:1048] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 12:24:36.993057 12035 leader_election.cc:290] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:36.994287 11870 raft_consensus.cc:3055] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:36.994763 11870 raft_consensus.cc:740] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:36.995236 12035 consensus_queue.cc:1048] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:36.995644 11870 consensus_queue.cc:260] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:36.996970 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:36.997400 11870 raft_consensus.cc:3060] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:36.998698 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:36.999081 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:37.000376 10921 raft_consensus.cc:2393] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 2: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:24:37.001742 12067 raft_consensus.cc:3055] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:37.002142 12067 raft_consensus.cc:740] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:36.969043 12080 raft_consensus.cc:493] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:37.003978 12080 raft_consensus.cc:3060] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:37.005040 11999 raft_consensus.cc:697] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 4 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:37.006502 11999 consensus_queue.cc:237] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:37.008179 11861 consensus_queue.cc:1048] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:37.009316 12037 consensus_queue.cc:1048] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:24:37.013402 12073 log.cc:927] Time spent T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.165s	user 0.003s	sys 0.000s
I20260709 12:24:37.015672 12042 consensus_queue.cc:237] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:37.005297 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:37.003053 12067 consensus_queue.cc:260] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:37.018541 12067 raft_consensus.cc:3060] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:37.023330 10820 leader_election.cc:304] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:37.036233 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:24:37.040505 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 80566.2us
I20260709 12:24:36.971517 11895 raft_consensus.cc:740] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:37.014905 11849 consensus_queue.cc:260] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:37.043315 11003 raft_consensus.cc:1275] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:24:37.054232 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 78941.3us
I20260709 12:24:37.055068 10894 leader_election.cc:304] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:37.056458 10819 leader_election.cc:304] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:37.057868 10894 leader_election.cc:304] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:37.060850 10894 leader_election.cc:304] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:37.065310 11747 consensus_queue.cc:1059] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:37.065743 10894 leader_election.cc:304] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:37.071738 12081 raft_consensus.cc:3060] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:37.051486 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 287239us
I20260709 12:24:37.057094 12074 raft_consensus.cc:2749] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:37.058763 11861 raft_consensus.cc:2764] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:24:37.063395 12069 raft_consensus.cc:2749] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:37.069475 11944 raft_consensus.cc:2749] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:37.068521 12076 raft_consensus.cc:2749] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:37.060191 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c6d38c4d8a90a81975a6a0cb13" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:37.059885 11882 consensus_queue.cc:1059] T 69fd8fdac2fa449e9e184f3d668ea1a7 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 12:24:37.104970 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c913e527ff46578e084c41eab7bb9d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:37.094859 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c6d38c4d8a90a81975a6a0cb13" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:37.110433 10846 raft_consensus.cc:2468] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 3.
I20260709 12:24:37.056802 12041 consensus_queue.cc:1048] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 12:24:37.061223 11843 raft_consensus.cc:2749] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:37.082536 11999 raft_consensus.cc:3055] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:37.056866 12061 consensus_queue.cc:1059] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 12:24:37.069847 12060 consensus_queue.cc:1059] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
W20260709 12:24:37.135708 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:37.079739 12065 consensus_queue.cc:1059] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 12:24:37.072957 12068 consensus_queue.cc:1059] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 12:24:37.116199 11999 raft_consensus.cc:740] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
W20260709 12:24:37.145915 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 75247.2us
I20260709 12:24:37.091351 11895 consensus_queue.cc:260] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:37.185299 10997 raft_consensus.cc:1240] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:37.190708 11861 raft_consensus.cc:3055] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:37.189044 10853 raft_consensus.cc:1275] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:37.194357 11861 raft_consensus.cc:740] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:37.190783 11882 raft_consensus.cc:3055] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:24:37.225333 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 150982us
I20260709 12:24:37.226039 10968 leader_election.cc:304] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:24:37.211545 12041 raft_consensus.cc:493] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.227294 10968 leader_election.cc:304] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:24:37.216802 11882 raft_consensus.cc:740] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:37.214473 12038 raft_consensus.cc:2804] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:37.221334 11895 raft_consensus.cc:3060] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:37.242182 10969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:37.233868 12068 raft_consensus.cc:2804] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:24:37.249177 12086 log.cc:927] Time spent T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
W20260709 12:24:37.250242 12091 log.cc:927] Time spent T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 12:24:37.250118 12080 raft_consensus.cc:515] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:37.251041 12090 log.cc:927] Time spent T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 12:24:37.252053 11882 consensus_queue.cc:260] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:37.256644 11951 raft_consensus.cc:2749] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:37.236523 12038 raft_consensus.cc:493] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:37.281726 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 70068.2us
I20260709 12:24:37.246320 11988 raft_consensus.cc:2804] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:37.219769 11999 consensus_queue.cc:260] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:37.232897 12041 raft_consensus.cc:515] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:37.284467 12038 raft_consensus.cc:3060] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:37.263515 11861 consensus_queue.cc:260] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:37.337636 10968 leader_election.cc:304] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:37.323858 11882 raft_consensus.cc:3060] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:37.323850 12037 raft_consensus.cc:493] T c63ecfc9bd3945818cfe15c03f001315 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.347325 10894 leader_election.cc:304] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:37.352460 10852 raft_consensus.cc:1240] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:37.353997 10854 raft_consensus.cc:2468] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 2.
I20260709 12:24:37.358204 12106 raft_consensus.cc:2804] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:37.359627 10846 raft_consensus.cc:1240] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 1. Current term is 2. Ops: []
W20260709 12:24:37.359535 12084 log.cc:927] Time spent T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.197s	user 0.001s	sys 0.001s
I20260709 12:24:37.358711 12106 raft_consensus.cc:493] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:37.330600 12065 consensus_queue.cc:1059] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
W20260709 12:24:37.415197 10969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:37.377421 10853 raft_consensus.cc:1240] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:37.377705 12102 consensus_queue.cc:1059] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 12:24:37.376459 12108 consensus_queue.cc:1059] T dad6a1da21304fcfacab384a6afc4101 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:37.449913 12076 raft_consensus.cc:493] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.363008 12068 raft_consensus.cc:697] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:37.455209 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:37.462560 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:37.448194 11944 raft_consensus.cc:493] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.463492 10925 raft_consensus.cc:2468] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 2.
I20260709 12:24:37.447389 12106 raft_consensus.cc:3060] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:37.465785 10819 leader_election.cc:304] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
W20260709 12:24:37.466547 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 108065us
I20260709 12:24:37.362500 12037 raft_consensus.cc:515] T c63ecfc9bd3945818cfe15c03f001315 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:37.459499 12076 raft_consensus.cc:515] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:37.465680 12042 raft_consensus.cc:493] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:37.512413 10893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:37.478154 12080 leader_election.cc:290] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:37.467355 11944 raft_consensus.cc:515] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:37.528518 12118 raft_consensus.cc:493] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:37.515129 12041 leader_election.cc:290] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:37.512880 12042 raft_consensus.cc:515] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:37.547168 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 81491.6us
I20260709 12:24:37.529198 12118 raft_consensus.cc:515] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } }
I20260709 12:24:37.542677 12112 consensus_queue.cc:1048] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 12:24:37.574579 12079 raft_consensus.cc:2804] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:37.598711 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352aa49c65194abbb863d7553a091f11" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:24:37.599413 12103 log.cc:927] Time spent T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
I20260709 12:24:37.599509 10995 raft_consensus.cc:2468] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 2.
W20260709 12:24:37.604295 12107 log.cc:927] Time spent T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.263s	user 0.001s	sys 0.000s
W20260709 12:24:37.607128 12081 consensus_meta.cc:287] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040: Time spent flushing consensus metadata: real 0.535s	user 0.000s	sys 0.013s
W20260709 12:24:37.607504 12099 log.cc:927] Time spent T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.285s	user 0.000s	sys 0.001s
I20260709 12:24:37.608134 12119 raft_consensus.cc:493] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:37.617683 12096 log.cc:927] Time spent T a6a28416571247df878823d464c05f1e P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.368s	user 0.001s	sys 0.001s
I20260709 12:24:37.617916 12108 raft_consensus.cc:493] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:37.618232 12123 raft_consensus.cc:493] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:37.618716 12108 raft_consensus.cc:515] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:37.621922 12108 leader_election.cc:290] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:37.582738 12079 raft_consensus.cc:493] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:37.619083 12123 raft_consensus.cc:515] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:37.637746 11589 leader_election.cc:304] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:37.634605 11885 raft_consensus.cc:493] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:37.641705 12104 log.cc:927] Time spent T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.185s	user 0.002s	sys 0.000s
I20260709 12:24:37.641785 11885 raft_consensus.cc:515] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:37.638876 12121 raft_consensus.cc:493] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:37.596606 12118 leader_election.cc:290] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:37.594033 12076 leader_election.cc:290] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:37.623725 12065 raft_consensus.cc:3055] T dad6a1da21304fcfacab384a6afc4101 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:37.633853 12079 raft_consensus.cc:3060] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:37.643996 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 166032us
I20260709 12:24:37.608692 11944 leader_election.cc:290] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:24:37.643471 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:37.651409 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 302631us
I20260709 12:24:37.615661 12081 raft_consensus.cc:2749] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:37.593034 12109 raft_consensus.cc:2804] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:37.663338 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:37.667004 10995 raft_consensus.cc:2468] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 2.
I20260709 12:24:37.667984 11003 raft_consensus.cc:1240] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:37.664851 11988 raft_consensus.cc:697] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:37.544389 12068 consensus_queue.cc:237] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:37.671870 12128 raft_consensus.cc:493] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.672497 12128 raft_consensus.cc:515] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:37.673710 10894 leader_election.cc:304] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:37.676360 12123 leader_election.cc:290] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:37.678025 12115 raft_consensus.cc:493] T 18294423a68a4671bf6c5a0f98645e4c P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.678228 11944 raft_consensus.cc:2804] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:37.678727 11944 raft_consensus.cc:697] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [term 2 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:37.678589 12115 raft_consensus.cc:515] T 18294423a68a4671bf6c5a0f98645e4c P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:37.678949 12037 leader_election.cc:290] T c63ecfc9bd3945818cfe15c03f001315 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:24:37.681536 10894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:37.681552 10968 leader_election.cc:304] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
W20260709 12:24:37.682228 10894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:37.648487 12065 raft_consensus.cc:740] T dad6a1da21304fcfacab384a6afc4101 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:37.653379 11895 raft_consensus.cc:493] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.694504 10847 raft_consensus.cc:1240] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:37.608691 12119 raft_consensus.cc:515] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:24:37.675293 12128 leader_election.cc:290] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:24:37.705566 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 73819us
I20260709 12:24:37.714990 12128 consensus_queue.cc:1048] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:37.688597 12109 raft_consensus.cc:697] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:37.700290 12123 raft_consensus.cc:2749] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:37.759953 12038 raft_consensus.cc:515] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:37.713660 12067 consensus_meta.cc:287] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent flushing consensus metadata: real 0.677s	user 0.010s	sys 0.006s
W20260709 12:24:37.760969 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 52676.9us
I20260709 12:24:37.679770 11944 consensus_queue.cc:237] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:37.758776 12115 leader_election.cc:290] T 18294423a68a4671bf6c5a0f98645e4c P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:37.673835 12069 consensus_queue.cc:1048] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.083s
I20260709 12:24:37.781174 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:37.781731 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:37.781962 10853 raft_consensus.cc:2468] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 4.
I20260709 12:24:37.782413 10850 raft_consensus.cc:2393] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 2: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:24:37.783208 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c913e527ff46578e084c41eab7bb9d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:37.784518 10846 raft_consensus.cc:2393] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 2: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:24:37.701784 11895 raft_consensus.cc:515] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:37.647584 12121 raft_consensus.cc:515] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:24:37.809556 12133 raft_consensus.cc:2804] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:37.773819 12128 consensus_queue.cc:1059] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 12:24:37.810073 12133 raft_consensus.cc:493] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:37.810532 12133 raft_consensus.cc:3060] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:37.810756 12128 raft_consensus.cc:493] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:37.773918 11885 leader_election.cc:290] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:37.808816 12123 raft_consensus.cc:493] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.815269 12123 raft_consensus.cc:515] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:37.805776 10921 raft_consensus.cc:1240] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:37.804006 12119 leader_election.cc:290] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:37.813871 12128 raft_consensus.cc:515] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:37.837759 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:37.838498 10925 raft_consensus.cc:1275] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:37.841084 12123 leader_election.cc:290] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:24:37.833508 11895 leader_election.cc:290] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:37.824187 12068 raft_consensus.cc:3055] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:37.845613 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18294423a68a4671bf6c5a0f98645e4c" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:37.809103 12065 consensus_queue.cc:260] T dad6a1da21304fcfacab384a6afc4101 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:37.824101 11988 consensus_queue.cc:237] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:37.848694 12065 raft_consensus.cc:3060] T dad6a1da21304fcfacab384a6afc4101 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:37.855149 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 150899us
I20260709 12:24:37.856226 10895 leader_election.cc:304] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:37.844729 12068 raft_consensus.cc:740] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:37.854626 12119 raft_consensus.cc:493] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.876461 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:37.873590 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63ecfc9bd3945818cfe15c03f001315" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:37.894886 12105 raft_consensus.cc:2804] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:37.895464 12105 raft_consensus.cc:493] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:37.896096 12105 raft_consensus.cc:3060] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:37.899554 10997 raft_consensus.cc:1275] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:37.904920 11000 raft_consensus.cc:1275] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:37.904210 11849 raft_consensus.cc:3060] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:37.913142 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:37.914289 10852 raft_consensus.cc:2468] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 2.
I20260709 12:24:37.915426 10850 raft_consensus.cc:1275] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:37.916199 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63ecfc9bd3945818cfe15c03f001315" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:37.913156 11621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5794ba618e514e28a7542ab6af39d8c9" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:24:37.918748 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352aa49c65194abbb863d7553a091f11" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:37.920044 10852 raft_consensus.cc:2468] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 2.
I20260709 12:24:37.926090 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:37.921819 11621 raft_consensus.cc:2468] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 2.
I20260709 12:24:37.927922 10926 raft_consensus.cc:1240] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:37.928406 10969 leader_election.cc:304] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:37.929190 12123 raft_consensus.cc:2804] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:37.929591 12123 raft_consensus.cc:493] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:37.930183 12123 raft_consensus.cc:3060] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:37.930406 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c913e527ff46578e084c41eab7bb9d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:37.934787 10929 raft_consensus.cc:1240] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:37.908680 12081 raft_consensus.cc:493] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:37.908864 12080 raft_consensus.cc:493] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:37.844372 12109 consensus_queue.cc:237] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:37.878187 12119 raft_consensus.cc:515] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:37.939970 12081 raft_consensus.cc:515] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:37.944691 10923 raft_consensus.cc:1240] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:37.947068 11861 raft_consensus.cc:3060] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:37.948167 12118 raft_consensus.cc:493] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:37.950546 12100 log.cc:927] Time spent T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.511s	user 0.000s	sys 0.005s
I20260709 12:24:37.950881 11955 raft_consensus.cc:3055] T 69fd8fdac2fa449e9e184f3d668ea1a7 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:37.951061 12042 leader_election.cc:290] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:37.951552 12080 raft_consensus.cc:515] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:37.959714 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:37.922313 12038 leader_election.cc:290] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:37.971405 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:37.936057 12115 raft_consensus.cc:493] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:37.925407 12128 leader_election.cc:290] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:37.950570 11882 raft_consensus.cc:3055] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:37.975011 10848 raft_consensus.cc:2468] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 2.
W20260709 12:24:37.984653 10969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:37.973399 11955 raft_consensus.cc:740] T 69fd8fdac2fa449e9e184f3d668ea1a7 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:37.988894 11747 consensus_queue.cc:1048] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 12:24:38.014555 10926 raft_consensus.cc:2468] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 4.
I20260709 12:24:37.919031 12079 raft_consensus.cc:515] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:37.990603 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:38.020957 12011 raft_consensus.cc:493] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.022972 11003 raft_consensus.cc:2468] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 2.
W20260709 12:24:38.033248 12097 log.cc:927] Time spent T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d: Append to log took a long time: real 0.762s	user 0.007s	sys 0.000s
I20260709 12:24:37.925823 12121 leader_election.cc:290] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:38.015101 11882 raft_consensus.cc:740] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:38.030431 12011 raft_consensus.cc:515] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:38.037846 12133 raft_consensus.cc:515] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:24:38.043064 12142 log.cc:927] Time spent T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 12:24:38.042577 11955 consensus_queue.cc:260] T 69fd8fdac2fa449e9e184f3d668ea1a7 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:38.043923 11955 raft_consensus.cc:3060] T 69fd8fdac2fa449e9e184f3d668ea1a7 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:38.035363 12081 leader_election.cc:290] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:38.048319 11624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45904 (request call id 23) took 1003 ms. Trace:
I20260709 12:24:38.050402 11624 rpcz_store.cc:276] 0709 12:24:37.053506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:37.062284 (+  8778us) service_pool.cc:224] Handling call
0709 12:24:37.072145 (+  9861us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:37.072510 (+   365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:37.072542 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:37.152133 (+ 79591us) log.cc:844] Serialized 556 byte log entry
0709 12:24:37.208840 (+ 56707us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:37.212026 (+  3186us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:37.220036 (+  8010us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:37.882035 (+661999us) spinlock_profiling.cc:243] Waited 1.53 ms on lock 0x7b4400022b4c. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7591c23db1 00007f7591cc1c85 00007f7591cc26a2 00007f7594a341db 00007f7594a2faaf 00007f7594a2386e 00007f7594a22bb6 00007f7594a227d8 00007f7594a2c221 00007f7594a2c1d9 00007f7594a2c169
0709 12:24:38.036414 (+154379us) raft_consensus.cc:1685] finished
0709 12:24:38.039597 (+  3183us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:38.048220 (+  8623us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3510016,"thread_start_us":44803,"threads_started":1,"wal-append.queue_time_us":87096}
I20260709 12:24:38.059926 12119 leader_election.cc:290] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:37.956132 12068 consensus_queue.cc:260] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:38.061606 12068 raft_consensus.cc:3060] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:38.061893 12079 leader_election.cc:290] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:38.039170 12080 leader_election.cc:290] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:38.029744 12115 raft_consensus.cc:515] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:38.071458 12123 raft_consensus.cc:515] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:38.082577 12105 raft_consensus.cc:515] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:38.083516 10928 raft_consensus.cc:2468] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 2.
I20260709 12:24:38.084767 10849 raft_consensus.cc:1275] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:24:38.092173 10968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:38.100116 12128 consensus_queue.cc:1059] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:24:38.106622 10969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:37.973323 12118 raft_consensus.cc:515] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:38.114270 10968 leader_election.cc:304] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:38.103263 12016 raft_consensus.cc:3055] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:38.125409 12016 raft_consensus.cc:740] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:38.126084 10923 raft_consensus.cc:1240] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:38.126585 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5794ba618e514e28a7542ab6af39d8c9" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:38.127347 10851 raft_consensus.cc:2468] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 2.
I20260709 12:24:38.127822 12140 raft_consensus.cc:2804] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:38.128571 12140 raft_consensus.cc:493] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:38.130927 10851 raft_consensus.cc:1240] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:38.095815 12080 raft_consensus.cc:493] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.141016 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:38.141836 10926 raft_consensus.cc:2393] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 4: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:24:38.142365 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:38.129331 12140 raft_consensus.cc:3060] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:38.094507 11882 consensus_queue.cc:260] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:38.159616 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5794ba618e514e28a7542ab6af39d8c9" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:38.160218 10851 raft_consensus.cc:3060] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:38.149801 12036 raft_consensus.cc:493] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:38.166842 12123 leader_election.cc:290] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:24:38.166618 12036 raft_consensus.cc:515] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:38.138844 12079 consensus_queue.cc:1048] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:24:38.129175 12138 raft_consensus.cc:493] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:38.170773 10926 raft_consensus.cc:1240] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:38.156375 10929 raft_consensus.cc:1240] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:38.141363 12080 raft_consensus.cc:515] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:38.198038 12011 leader_election.cc:290] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:38.151986 11861 consensus_queue.cc:1048] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 12:24:38.156260 12130 consensus_queue.cc:1059] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.088s
I20260709 12:24:38.210489 10850 raft_consensus.cc:2468] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 4.
I20260709 12:24:38.215548 12147 raft_consensus.cc:493] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:38.203594 12106 consensus_meta.cc:287] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent flushing consensus metadata: real 0.728s	user 0.004s	sys 0.012s
I20260709 12:24:38.217576 10851 raft_consensus.cc:2468] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 3.
W20260709 12:24:38.226097 10894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:38.197904 12118 leader_election.cc:290] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:38.198262 12132 consensus_queue.cc:1059] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 12:24:38.231679 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:38.171020 11988 consensus_queue.cc:1059] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 12:24:38.218890 12133 leader_election.cc:290] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 3 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:38.243045 10968 leader_election.cc:304] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:38.230293 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5794ba618e514e28a7542ab6af39d8c9" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:24:38.249133 12144 raft_consensus.cc:493] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.189704 12138 raft_consensus.cc:515] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:38.225538 12065 consensus_queue.cc:1059] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:24:38.253412 12111 raft_consensus.cc:493] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.253582 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:38.245013 12109 raft_consensus.cc:3060] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:38.253438 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352aa49c65194abbb863d7553a091f11" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:38.253990 12111 raft_consensus.cc:515] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:38.261503 10845 raft_consensus.cc:3060] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:38.251690 11624 raft_consensus.cc:3060] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:38.265995 10894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:38.247130 12079 raft_consensus.cc:493] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.247035 12115 leader_election.cc:290] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:38.229709 12106 raft_consensus.cc:515] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:38.198107 12136 consensus_queue.cc:1059] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.138s
I20260709 12:24:38.279239 12079 raft_consensus.cc:515] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:38.282500 12136 raft_consensus.cc:3055] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:38.282882 12036 leader_election.cc:290] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:38.282996 12136 raft_consensus.cc:740] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:38.277071 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:38.265515 10996 raft_consensus.cc:3060] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:38.255378 12105 leader_election.cc:290] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:38.285585 10848 raft_consensus.cc:2393] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 3: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:24:38.296934 12079 leader_election.cc:290] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:38.245829 12147 raft_consensus.cc:515] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:38.298272 12151 log.cc:927] Time spent T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:24:38.301945 10925 raft_consensus.cc:1240] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:38.303179 12061 raft_consensus.cc:3055] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:38.303411 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:38.303632 12061 raft_consensus.cc:740] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:38.305055 12061 consensus_queue.cc:260] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:38.306620 10846 raft_consensus.cc:1275] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:38.307899 12138 leader_election.cc:290] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:38.303668 10849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56394 (request call id 875) took 1218 ms. Trace:
I20260709 12:24:38.308786 12080 leader_election.cc:290] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:38.309026 10849 rpcz_store.cc:276] 0709 12:24:37.085149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:37.085271 (+   122us) service_pool.cc:224] Handling call
0709 12:24:37.085661 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:38.086334 (+1000673us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:38.303391 (+217057us) spinlock_profiling.cc:243] Waited 999 ms on lock 0x7b54001a4354. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e88e01 00007f7594e8783e 00007f7599e4c419 00007f75933c3bd4 00007f75933c3b62 00007f75933c3a91 00007f75933c3a0c 00007f75933c2cc2 00007f75931c348c 00007f75931c28c6
0709 12:24:38.303563 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2296723200}
I20260709 12:24:38.249709 12144 raft_consensus.cc:515] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:38.306702 12061 raft_consensus.cc:3060] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:38.313611 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 65012.3us
I20260709 12:24:38.317305 10929 raft_consensus.cc:1275] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:38.319168 11624 raft_consensus.cc:2468] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 3.
I20260709 12:24:38.321301 10968 leader_election.cc:304] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:38.323911 10848 raft_consensus.cc:1240] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:38.324935 10851 raft_consensus.cc:2468] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 2.
I20260709 12:24:38.312326 12080 raft_consensus.cc:493] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.347281 11955 consensus_queue.cc:1048] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:24:38.347230 12123 raft_consensus.cc:2804] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:38.348686 12105 raft_consensus.cc:493] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:38.355366 12123 raft_consensus.cc:697] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:38.358850 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:38.359766 10848 raft_consensus.cc:2468] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 4.
W20260709 12:24:38.361402 12087 log.cc:927] Time spent T ab816bcc6183447994a2cc013e46c5f8 P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 1.165s	user 0.004s	sys 0.000s
I20260709 12:24:38.361482 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:38.362233 10997 raft_consensus.cc:2468] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 1.
I20260709 12:24:38.362797 12060 raft_consensus.cc:493] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.362815 10920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59626 (request call id 838) took 1395 ms. Trace:
I20260709 12:24:38.363435 12060 raft_consensus.cc:515] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:38.364221 10920 rpcz_store.cc:276] 0709 12:24:36.967067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.973493 (+  6426us) service_pool.cc:224] Handling call
0709 12:24:36.981074 (+  7581us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:37.003339 (+ 22265us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:37.003387 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:37.004058 (+   671us) log.cc:844] Serialized 26 byte log entry
0709 12:24:37.078146 (+ 74088us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:37.078215 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:37.078363 (+   148us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:38.360804 (+1282441us) spinlock_profiling.cc:243] Waited 2.29 ms on lock 0x7b4400022b4c. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7591c23db1 00007f7591cc1c85 00007f7591cc26a2 00007f7594a341db 00007f7594a2faaf 00007f7594a2386e 00007f7594a22bb6 00007f7594a227d8 00007f7594a2c221 00007f7594a2c1d9 00007f7594a2c169
0709 12:24:38.362545 (+  1741us) raft_consensus.cc:1685] finished
0709 12:24:38.362564 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:38.362739 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21784,"raft.queue_time_us":23284,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":114,"spinlock_wait_cycles":5274496,"thread_start_us":73632,"threads_started":1,"wal-append.queue_time_us":126528}
I20260709 12:24:38.371798 12060 leader_election.cc:290] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:38.371922 12147 leader_election.cc:290] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:38.323668 12136 consensus_queue.cc:260] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:38.385094 12136 raft_consensus.cc:3060] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:38.388339 12016 consensus_queue.cc:260] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:37.850095 12102 consensus_queue.cc:1175] T dad6a1da21304fcfacab384a6afc4101 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "80cd7d227db44f34a6108591dad9c040" responder_term: 2 status { last_received { term: 1 index: 1 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:24:38.389914 12016 raft_consensus.cc:3060] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:38.366263 12144 leader_election.cc:290] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:38.393636 12140 raft_consensus.cc:515] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:38.394618 12068 raft_consensus.cc:493] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:38.395958 12109 raft_consensus.cc:2749] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:38.395645 12068 raft_consensus.cc:515] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:38.356443 12123 consensus_queue.cc:237] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:38.398856 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:38.398064 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6a1da21304fcfacab384a6afc4101" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:38.399803 10920 raft_consensus.cc:3060] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:38.400004 10997 raft_consensus.cc:2468] T dad6a1da21304fcfacab384a6afc4101 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 2.
I20260709 12:24:38.356844 12080 raft_consensus.cc:515] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:24:38.407707 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:38.377717 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:38.358006 12105 raft_consensus.cc:515] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:38.411270 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:38.411916 12156 raft_consensus.cc:493] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.412670 10847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56388 (request call id 683) took 1068 ms. Trace:
I20260709 12:24:38.412976 10920 raft_consensus.cc:2468] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 5.
I20260709 12:24:38.413586 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:38.444157 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:38.396796 12140 leader_election.cc:290] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:38.473024 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:38.470476 11002 raft_consensus.cc:2468] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 2.
I20260709 12:24:38.475195 10847 rpcz_store.cc:276] 0709 12:24:37.344510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:37.344640 (+   130us) service_pool.cc:224] Handling call
0709 12:24:37.346234 (+  1594us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:37.695534 (+349300us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:38.406736 (+711202us) spinlock_profiling.cc:243] Waited 344 ms on lock 0x7b54002981d4. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e88e01 00007f7594e8783e 00007f7599e4c419 00007f75933c3bd4 00007f75933c3b62 00007f75933c3a91 00007f75933c3a0c 00007f75933c2cc2 00007f75931c348c 00007f75931c28c6
0709 12:24:38.412579 (+  5843us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":790431488}
I20260709 12:24:38.479038 12112 raft_consensus.cc:493] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.481678 11002 raft_consensus.cc:1275] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:38.481841 12112 raft_consensus.cc:515] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:38.479938 10846 raft_consensus.cc:3060] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:38.484207 12112 leader_election.cc:290] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:38.485530 10849 raft_consensus.cc:1275] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:38.486835 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18294423a68a4671bf6c5a0f98645e4c" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:38.488484 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:38.490097 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:38.469455 12138 raft_consensus.cc:493] T d0aed74af73a488f8b691578ca370226 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:24:38.493775 10929 raft_consensus.cc:2393] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 4: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
W20260709 12:24:38.491943 12099 log.cc:927] Time spent T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 12:24:38.495000 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:38.495745 11001 raft_consensus.cc:2468] T 3f8a389131ef4c77a3e08488aa4759eb P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 2.
I20260709 12:24:38.495208 12138 raft_consensus.cc:515] T d0aed74af73a488f8b691578ca370226 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:38.491281 11002 raft_consensus.cc:2468] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 2.
I20260709 12:24:38.502352 10895 leader_election.cc:304] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:38.504374 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:38.491612 10921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59622 (request call id 690) took 1144 ms. Trace:
I20260709 12:24:38.509570 12068 leader_election.cc:290] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:38.509776 12106 leader_election.cc:290] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:38.510138 10921 rpcz_store.cc:276] 0709 12:24:37.343150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:37.360105 (+ 16955us) service_pool.cc:224] Handling call
0709 12:24:37.440328 (+ 80223us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:37.825520 (+385192us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:38.475202 (+649682us) spinlock_profiling.cc:243] Waited 342 ms on lock 0x7b540039ec54. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e88e01 00007f7594e8783e 00007f7599e4c419 00007f75933c3bd4 00007f75933c3b62 00007f75933c3a91 00007f75933c3a0c 00007f75933c2cc2 00007f75931c348c 00007f75931c28c6
0709 12:24:38.487236 (+ 12034us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":787473792}
I20260709 12:24:38.507632 12113 consensus_queue.cc:1048] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:24:38.511160 12105 leader_election.cc:290] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:38.511935 12120 raft_consensus.cc:3055] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:38.512360 12120 raft_consensus.cc:740] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:38.480017 12156 raft_consensus.cc:515] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:38.514842 11849 consensus_meta.cc:287] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040: Time spent flushing consensus metadata: real 0.593s	user 0.014s	sys 0.000s
I20260709 12:24:38.517450 11999 raft_consensus.cc:3060] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:38.519898 12080 leader_election.cc:290] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:24:38.520298 11843 raft_consensus.cc:493] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.526026 10895 leader_election.cc:304] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:38.528997 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac8522e549a46e09593fa4c2e175557" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:24:38.529237 11003 raft_consensus.cc:2468] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 2.
I20260709 12:24:38.529798 11624 raft_consensus.cc:2468] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 2.
I20260709 12:24:38.530632 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:38.527257 10895 leader_election.cc:304] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:38.535638 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:38.537113 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c6d38c4d8a90a81975a6a0cb13" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:38.536991 11002 raft_consensus.cc:2468] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 2.
I20260709 12:24:38.522119 12112 raft_consensus.cc:2804] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:38.539538 12105 raft_consensus.cc:493] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.541961 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63ecfc9bd3945818cfe15c03f001315" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:38.542006 12105 raft_consensus.cc:515] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:38.526317 11843 raft_consensus.cc:515] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:38.544132 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:38.544680 11001 raft_consensus.cc:3060] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:38.545018 12154 log.cc:927] Time spent T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.181s	user 0.000s	sys 0.001s
I20260709 12:24:38.547870 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:38.548673 10999 raft_consensus.cc:2393] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 2: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:24:38.550542 10845 raft_consensus.cc:2468] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 3.
I20260709 12:24:38.532614 12051 raft_consensus.cc:2804] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:38.541043 12005 raft_consensus.cc:2804] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:38.552731 12105 leader_election.cc:290] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:38.555959 10820 leader_election.cc:304] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040; no voters: 
I20260709 12:24:38.558931 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:38.571794 10998 raft_consensus.cc:2468] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 2.
I20260709 12:24:38.576906 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:38.541224 12112 raft_consensus.cc:493] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:38.578474 10997 raft_consensus.cc:2468] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 4.
I20260709 12:24:38.583099 10895 leader_election.cc:304] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:38.564246 12113 raft_consensus.cc:493] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:38.589360 10969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:38.565065 12140 raft_consensus.cc:493] T a6a28416571247df878823d464c05f1e P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:38.565701 12051 raft_consensus.cc:493] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:38.567480 12005 raft_consensus.cc:493] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:38.595937 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:38.585299 12112 raft_consensus.cc:3060] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:38.581647 11849 raft_consensus.cc:2804] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:38.579645 10996 raft_consensus.cc:2468] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 3.
I20260709 12:24:38.600508 12051 raft_consensus.cc:3060] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:38.609390 12156 leader_election.cc:290] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:24:38.610059 12141 log.cc:927] Time spent T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.339s	user 0.001s	sys 0.002s
I20260709 12:24:38.589603 12138 leader_election.cc:290] T d0aed74af73a488f8b691578ca370226 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:24:38.593796 12113 raft_consensus.cc:515] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:38.603366 12005 raft_consensus.cc:3060] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:38.647899 12153 log.cc:927] Time spent T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.371s	user 0.003s	sys 0.000s
I20260709 12:24:38.675248 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:38.655622 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aed74af73a488f8b691578ca370226" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:24:38.607123 12162 raft_consensus.cc:2804] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:24:38.657337 10819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:38.657907 11001 raft_consensus.cc:2468] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 3.
I20260709 12:24:38.646564 12111 leader_election.cc:290] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:38.673692 10846 raft_consensus.cc:2468] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 5.
I20260709 12:24:38.675326 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fd8fdac2fa449e9e184f3d668ea1a7" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:38.641157 12080 raft_consensus.cc:493] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.688512 11861 raft_consensus.cc:493] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.689050 11861 raft_consensus.cc:515] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:38.689918 12026 raft_consensus.cc:493] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.690404 12026 raft_consensus.cc:515] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:38.687740 11000 raft_consensus.cc:2468] T 69fd8fdac2fa449e9e184f3d668ea1a7 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 3.
I20260709 12:24:38.677724 12037 raft_consensus.cc:493] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.692772 12026 leader_election.cc:290] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:38.679446 10995 raft_consensus.cc:2468] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 4.
I20260709 12:24:38.693282 12037 raft_consensus.cc:515] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:38.697386 12037 leader_election.cc:290] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:38.694646 11937 raft_consensus.cc:493] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.697888 10895 leader_election.cc:304] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:38.698459 11937 raft_consensus.cc:515] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:38.700516 12127 raft_consensus.cc:2804] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:38.700892 11937 leader_election.cc:290] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:38.701066 12127 raft_consensus.cc:697] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:38.701474 11588 leader_election.cc:304] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040; no voters: 
I20260709 12:24:38.655678 11955 raft_consensus.cc:493] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:38.702061 12113 leader_election.cc:290] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:38.703011 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:38.611441 11849 raft_consensus.cc:493] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:38.705679 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef3220c51df47db8859f07ab745fad5" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:38.703743 10850 raft_consensus.cc:3060] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:38.704576 10895 leader_election.cc:304] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:38.584537 12120 consensus_queue.cc:260] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:38.718266 10894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:38.676012 12052 raft_consensus.cc:493] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.675227 12041 raft_consensus.cc:493] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.713709 11624 raft_consensus.cc:2955] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:24:38.725701 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c6d38c4d8a90a81975a6a0cb13" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:38.727558 10849 raft_consensus.cc:1275] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:38.727749 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:38.728626 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:38.736275 11001 raft_consensus.cc:2410] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:24:38.728863 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d9a61ecaf84695b70f8519ee57706f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:38.736102 10999 raft_consensus.cc:2468] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 3.
I20260709 12:24:38.602905 12140 raft_consensus.cc:515] T a6a28416571247df878823d464c05f1e P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:38.734092 12000 raft_consensus.cc:2804] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:38.739552 12000 raft_consensus.cc:493] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:38.740057 12000 raft_consensus.cc:3060] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:38.706620 11951 raft_consensus.cc:2804] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:38.688028 12162 raft_consensus.cc:493] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:38.736847 11000 raft_consensus.cc:2468] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 2.
I20260709 12:24:38.705027 12079 raft_consensus.cc:493] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:38.722335 11861 leader_election.cc:290] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:38.706157 12156 raft_consensus.cc:493] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:38.749657 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6a1da21304fcfacab384a6afc4101" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:38.707930 11849 raft_consensus.cc:3060] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:38.748409 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:38.742537 10998 raft_consensus.cc:2955] T a6a28416571247df878823d464c05f1e P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:24:38.702512 11955 raft_consensus.cc:515] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:38.760829 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:38.747816 12074 raft_consensus.cc:493] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.764269 10846 raft_consensus.cc:2468] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 2.
I20260709 12:24:38.737190 12026 raft_consensus.cc:493] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:38.767060 11001 raft_consensus.cc:2468] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 3.
I20260709 12:24:38.705356 12080 raft_consensus.cc:515] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:38.750466 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fd8fdac2fa449e9e184f3d668ea1a7" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:38.789650 10894 leader_election.cc:304] T c63ecfc9bd3945818cfe15c03f001315 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:38.790361 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:38.749787 12162 raft_consensus.cc:3060] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:38.756441 12093 raft_consensus.cc:493] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.796669 12164 raft_consensus.cc:2804] T c63ecfc9bd3945818cfe15c03f001315 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:38.797379 11951 raft_consensus.cc:697] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [term 3 LEADER]: Becoming Leader. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
I20260709 12:24:38.742214 12041 raft_consensus.cc:515] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:38.736965 12052 raft_consensus.cc:515] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:38.801120 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:38.808351 11002 raft_consensus.cc:2468] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 3.
I20260709 12:24:38.702008 12127 consensus_queue.cc:237] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:38.809507 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352aa49c65194abbb863d7553a091f11" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:38.810120 11002 raft_consensus.cc:3060] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:38.810385 10854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56388 (request call id 692) took 1029 ms. Trace:
I20260709 12:24:38.754329 12105 raft_consensus.cc:493] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:38.811962 12105 raft_consensus.cc:515] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:38.811064 10854 rpcz_store.cc:276] 0709 12:24:37.781303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:37.782834 (+  1531us) service_pool.cc:224] Handling call
0709 12:24:37.783164 (+   330us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:37.783561 (+   397us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:37.783610 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:37.784210 (+   600us) log.cc:844] Serialized 52 byte log entry
0709 12:24:38.085357 (+301147us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:38.087598 (+  2241us) log.cc:844] Serialized 14 byte log entry
0709 12:24:38.088161 (+   563us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:38.088259 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:38.554544 (+466285us) spinlock_profiling.cc:243] Waited 2.62 ms on lock 0x7b4400022b4c. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7591c23db1 00007f7591cc1c85 00007f7591cc26a2 00007f7594a341db 00007f7594a2faaf 00007f7594a2386e 00007f7594a22bb6 00007f7594a227d8 00007f7594a2c221 00007f7594a2c1d9 00007f7594a2c169
0709 12:24:38.810084 (+255540us) raft_consensus.cc:1685] finished
0709 12:24:38.810192 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:38.810328 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1186,"prepare.queue_time_us":1954,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":1651,"raft.run_cpu_time_us":365,"raft.run_wall_time_us":6747,"spinlock_wait_cycles":6023424,"thread_start_us":300753,"threads_started":1,"wal-append.queue_time_us":362284}
I20260709 12:24:38.813892 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:38.814464 10854 raft_consensus.cc:2468] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 2.
I20260709 12:24:38.801153 12026 raft_consensus.cc:515] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:38.779866 11861 raft_consensus.cc:493] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.816131 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:38.815989 11861 raft_consensus.cc:515] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:38.816865 10846 raft_consensus.cc:2468] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 4.
I20260709 12:24:38.817271 12026 leader_election.cc:290] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:38.817796 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:38.818240 11861 leader_election.cc:290] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:38.818629 10846 raft_consensus.cc:2410] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:24:38.819149 12140 leader_election.cc:290] T a6a28416571247df878823d464c05f1e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:24:38.819799 12093 raft_consensus.cc:515] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:38.822235 12093 leader_election.cc:290] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:38.756067 12079 raft_consensus.cc:515] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:38.823689 11002 raft_consensus.cc:2468] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 3.
I20260709 12:24:38.824710 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:38.825348 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:38.825531 12079 leader_election.cc:290] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:38.814486 12105 leader_election.cc:290] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:38.762463 12156 raft_consensus.cc:515] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:38.828742 12156 leader_election.cc:290] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:38.828889 12164 raft_consensus.cc:493] T c63ecfc9bd3945818cfe15c03f001315 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:38.829638 12164 raft_consensus.cc:3060] T c63ecfc9bd3945818cfe15c03f001315 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:38.811647 10845 raft_consensus.cc:2468] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 3.
I20260709 12:24:38.834738 10848 raft_consensus.cc:2468] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 2.
I20260709 12:24:38.840847 10820 leader_election.cc:304] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:38.826174 11843 leader_election.cc:290] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:38.841986 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d9a61ecaf84695b70f8519ee57706f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:38.789475 12074 raft_consensus.cc:515] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:38.789029 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:38.850210 10820 leader_election.cc:304] T 18294423a68a4671bf6c5a0f98645e4c P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:38.853242 10820 leader_election.cc:304] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:38.834955 12036 raft_consensus.cc:493] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.829650 11621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:24:38.849299 12026 raft_consensus.cc:2749] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:24:38.860011 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 68533.9us
I20260709 12:24:38.871263 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
W20260709 12:24:38.875809 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:38.855528 11885 raft_consensus.cc:2749] T 18294423a68a4671bf6c5a0f98645e4c P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:38.854440 12105 raft_consensus.cc:493] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.902061 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:38.902158 12105 raft_consensus.cc:515] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:38.882527 11955 leader_election.cc:290] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:38.886826 12070 raft_consensus.cc:493] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.889122 12074 leader_election.cc:290] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:38.855129 11843 raft_consensus.cc:493] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:38.859373 12060 raft_consensus.cc:493] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.859678 12079 consensus_queue.cc:1048] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 12:24:38.862212 10853 raft_consensus.cc:2468] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 2.
I20260709 12:24:38.865270 11937 raft_consensus.cc:2804] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:38.912954 11937 raft_consensus.cc:493] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:38.913614 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:38.913766 11937 raft_consensus.cc:3060] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:38.873137 12036 raft_consensus.cc:515] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:38.893573 12000 raft_consensus.cc:515] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:38.876155 10894 leader_election.cc:304] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:38.917696 12000 leader_election.cc:290] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:38.918339 12000 raft_consensus.cc:2749] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:38.918834 11882 raft_consensus.cc:3060] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:38.918947 12000 consensus_queue.cc:1048] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:38.903203 12052 leader_election.cc:290] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:24:38.898159 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:38.859390 10820 leader_election.cc:304] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:38.819836 11951 consensus_queue.cc:237] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:38.925930 12081 raft_consensus.cc:2804] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:38.926403 12081 raft_consensus.cc:493] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:38.926748 12081 raft_consensus.cc:3060] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:38.937495 12156 raft_consensus.cc:493] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:38.938336 12156 raft_consensus.cc:515] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:38.910221 10850 raft_consensus.cc:2468] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 3.
I20260709 12:24:38.919265 10894 leader_election.cc:304] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:38.942238 11849 raft_consensus.cc:515] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:38.898084 10846 raft_consensus.cc:2468] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 1.
I20260709 12:24:38.944211 12167 raft_consensus.cc:2804] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:38.944638 12167 raft_consensus.cc:493] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:38.945000 12167 raft_consensus.cc:3060] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:38.920174 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:24:38.923286 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 63969.1us
I20260709 12:24:38.903236 12041 leader_election.cc:290] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:38.949116 12005 raft_consensus.cc:515] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:38.949116 10820 leader_election.cc:304] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:38.960724 10820 leader_election.cc:304] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:38.943431 10894 leader_election.cc:304] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:38.920665 11843 raft_consensus.cc:515] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:38.969362 12156 leader_election.cc:290] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:38.908246 12070 raft_consensus.cc:515] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:38.955030 12113 raft_consensus.cc:493] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:38.919735 11861 consensus_queue.cc:1048] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:24:38.909020 12060 raft_consensus.cc:515] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:38.983563 10820 leader_election.cc:304] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:38.939682 12081 raft_consensus.cc:515] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:39.004498 10820 leader_election.cc:304] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:38.974534 12052 raft_consensus.cc:2804] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:39.022116 10820 leader_election.cc:304] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:38.944636 12074 consensus_queue.cc:1048] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:24:38.978971 11843 leader_election.cc:290] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:39.027189 12026 raft_consensus.cc:2804] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:38.970817 12112 raft_consensus.cc:515] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:38.985200 11999 raft_consensus.cc:2749] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:39.025300 10820 leader_election.cc:304] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:39.032817 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:39.034591 10927 raft_consensus.cc:2468] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 1.
I20260709 12:24:39.034781 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:38.987942 12041 raft_consensus.cc:2804] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:39.033888 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:39.035990 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:39.037365 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:39.037561 11849 leader_election.cc:290] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:24:39.037698 12005 leader_election.cc:290] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:39.038064 10921 raft_consensus.cc:2468] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 2.
I20260709 12:24:39.039254 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:39.039906 10921 raft_consensus.cc:2468] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 4.
I20260709 12:24:39.039978 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63ecfc9bd3945818cfe15c03f001315" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:39.021577 11885 raft_consensus.cc:2804] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:39.041047 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:39.018653 12113 raft_consensus.cc:515] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:39.025694 12147 raft_consensus.cc:2804] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:39.040953 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef3220c51df47db8859f07ab745fad5" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:39.022763 12052 raft_consensus.cc:493] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
W20260709 12:24:39.037683 12168 log.cc:927] Time spent T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:24:39.043872 10924 raft_consensus.cc:2468] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 2.
I20260709 12:24:39.020537 12000 consensus_queue.cc:1048] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:24:39.030237 12080 leader_election.cc:290] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:39.033905 12038 raft_consensus.cc:493] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.052135 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:39.030447 12026 raft_consensus.cc:493] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:39.046644 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:39.043431 12035 raft_consensus.cc:2804] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:39.050380 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6a1da21304fcfacab384a6afc4101" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:39.065922 12035 raft_consensus.cc:493] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:39.066180 10995 raft_consensus.cc:2468] T dad6a1da21304fcfacab384a6afc4101 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 2.
I20260709 12:24:39.066390 12035 raft_consensus.cc:3060] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:39.054771 11001 raft_consensus.cc:2468] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 3.
I20260709 12:24:39.044456 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:39.068027 10923 raft_consensus.cc:2393] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 3: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:24:39.068969 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac8522e549a46e09593fa4c2e175557" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:39.048781 12052 raft_consensus.cc:3060] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:39.070353 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:39.055629 12026 raft_consensus.cc:3060] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:39.049156 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:39.055845 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:39.060242 12080 raft_consensus.cc:493] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.082458 11621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac8522e549a46e09593fa4c2e175557" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:24:39.083256 11621 raft_consensus.cc:3060] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:39.061184 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:39.061502 12105 leader_election.cc:290] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:39.092630 12060 leader_election.cc:290] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:39.051884 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:39.082552 12080 raft_consensus.cc:515] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:39.095772 12080 leader_election.cc:290] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:39.064026 12167 raft_consensus.cc:515] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:39.097667 12113 leader_election.cc:290] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:39.099354 10921 raft_consensus.cc:2393] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 3: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:24:39.101012 12035 raft_consensus.cc:515] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:39.064267 12051 raft_consensus.cc:515] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:39.065065 12038 raft_consensus.cc:515] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:39.045778 12147 raft_consensus.cc:493] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:39.053031 10994 raft_consensus.cc:2468] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 4.
I20260709 12:24:39.077319 12041 raft_consensus.cc:697] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:39.080435 10924 raft_consensus.cc:2468] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 4.
I20260709 12:24:39.097754 12164 raft_consensus.cc:515] T c63ecfc9bd3945818cfe15c03f001315 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:39.034994 12127 raft_consensus.cc:493] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.080310 10923 raft_consensus.cc:2468] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 2.
I20260709 12:24:39.104439 11885 raft_consensus.cc:697] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 3 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:39.048723 11937 raft_consensus.cc:515] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:24:39.084718 12081 leader_election.cc:290] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:39.121317 11937 leader_election.cc:290] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:38.819725  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:39.122730 12038 leader_election.cc:290] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:39.118093 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:39.123662 10927 raft_consensus.cc:2393] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 2: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:24:39.123884 11001 raft_consensus.cc:3060] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:39.113946 12147 raft_consensus.cc:3060] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:39.125519 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:39.126174 10994 raft_consensus.cc:2468] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 2.
I20260709 12:24:39.128080 12051 leader_election.cc:290] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:39.116480 12113 raft_consensus.cc:493] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:39.138059 12113 raft_consensus.cc:515] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:39.139164 12147 raft_consensus.cc:515] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:39.140162 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:39.141284 12130 raft_consensus.cc:3055] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:39.141743 12130 raft_consensus.cc:740] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:39.141822 12147 leader_election.cc:290] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:39.131712 10820 leader_election.cc:304] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:39.144315 10926 raft_consensus.cc:2393] T c63ecfc9bd3945818cfe15c03f001315 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 3: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:24:39.144668 12000 raft_consensus.cc:493] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.159801 10999 raft_consensus.cc:1275] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:39.146106 12162 raft_consensus.cc:515] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:39.147114 12113 leader_election.cc:290] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:39.147867 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:39.166592 10995 raft_consensus.cc:2468] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 4.
I20260709 12:24:39.168015 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:39.148934 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:39.152251 10894 leader_election.cc:304] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:39.155555 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6a1da21304fcfacab384a6afc4101" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:39.169397 11003 raft_consensus.cc:2468] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 3.
I20260709 12:24:39.169693 11002 raft_consensus.cc:3060] T dad6a1da21304fcfacab384a6afc4101 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:39.155550 11001 raft_consensus.cc:2468] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 3.
I20260709 12:24:39.160029 12060 raft_consensus.cc:493] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.118358 12127 raft_consensus.cc:515] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:39.163206 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:39.164662 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:39.170782 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fd8fdac2fa449e9e184f3d668ea1a7" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:39.173875 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac8522e549a46e09593fa4c2e175557" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:39.174015 10894 leader_election.cc:304] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
W20260709 12:24:39.183154 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:39.143421 12051 raft_consensus.cc:493] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.186749 10819 leader_election.cc:304] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:39.188539 10819 leader_election.cc:304] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:39.174499 10820 leader_election.cc:304] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:39.175990 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:39.184556 11003 raft_consensus.cc:3060] T 69fd8fdac2fa449e9e184f3d668ea1a7 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:39.190495 10894 leader_election.cc:304] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:39.190672 11002 raft_consensus.cc:2468] T dad6a1da21304fcfacab384a6afc4101 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 3.
I20260709 12:24:39.191869 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:39.172230 12060 raft_consensus.cc:515] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:39.191808 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:39.165624 10968 leader_election.cc:304] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:39.182698 11937 raft_consensus.cc:493] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:39.198632 10819 leader_election.cc:304] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:39.198441 10820 leader_election.cc:304] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:39.195829 10968 leader_election.cc:304] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:39.202266 10920 raft_consensus.cc:2393] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 4: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:24:39.202105 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:39.142731 12130 consensus_queue.cc:260] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:39.204363 12176 raft_consensus.cc:2804] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:39.208531 12176 raft_consensus.cc:493] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:39.208684 11849 raft_consensus.cc:2804] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:39.208954 12176 raft_consensus.cc:3060] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:39.209124 11849 raft_consensus.cc:493] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:39.209556 11849 raft_consensus.cc:3060] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:39.188963 12147 raft_consensus.cc:2804] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:39.211578 12147 raft_consensus.cc:493] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:39.212006 12147 raft_consensus.cc:3060] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:39.176484 10996 raft_consensus.cc:2468] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 4.
I20260709 12:24:39.213346 12127 leader_election.cc:290] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:39.185467 12178 raft_consensus.cc:493] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.214506 12060 leader_election.cc:290] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:39.176545 12140 raft_consensus.cc:493] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:39.205895 10820 leader_election.cc:304] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:39.185956 12038 raft_consensus.cc:2804] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:39.195300 12113 raft_consensus.cc:2804] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:39.218492 10968 leader_election.cc:304] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:39.221683 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:39.222098 11621 raft_consensus.cc:2468] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 3.
I20260709 12:24:39.199767 12172 raft_consensus.cc:2804] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:39.250643 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:39.222431 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fd8fdac2fa449e9e184f3d668ea1a7" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:39.222584 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:39.223109 12035 leader_election.cc:290] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:39.223284 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:39.254539 11002 raft_consensus.cc:3060] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:24:39.217942 12038 raft_consensus.cc:493] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:39.214764 12026 raft_consensus.cc:515] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:39.257028 12038 raft_consensus.cc:3060] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:39.257491 12081 raft_consensus.cc:2804] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:39.257906 12081 raft_consensus.cc:493] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:39.258224 12081 raft_consensus.cc:3060] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:39.258731 12026 leader_election.cc:290] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:39.205320 10929 raft_consensus.cc:2368] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 2. Current term is 3.
I20260709 12:24:39.193692 11885 consensus_queue.cc:237] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:39.254109 12172 raft_consensus.cc:493] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:39.260181 12172 raft_consensus.cc:3060] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:39.261485 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6a1da21304fcfacab384a6afc4101" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:39.250787 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:39.251870 10852 raft_consensus.cc:3060] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:39.205174 11937 raft_consensus.cc:515] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:39.264372 12164 leader_election.cc:290] T c63ecfc9bd3945818cfe15c03f001315 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:39.207269 12177 raft_consensus.cc:2749] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:39.201486 11882 raft_consensus.cc:2804] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:39.265616 11882 raft_consensus.cc:493] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:39.265789 11937 leader_election.cc:290] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:39.266077 11882 raft_consensus.cc:3060] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:39.166497 12000 raft_consensus.cc:515] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:39.274153 12000 leader_election.cc:290] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:39.215178 12178 raft_consensus.cc:515] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:39.276558 10852 raft_consensus.cc:2468] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 4.
I20260709 12:24:39.277139 11002 raft_consensus.cc:2468] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 3.
I20260709 12:24:39.278447 12178 leader_election.cc:290] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:39.217404 12080 raft_consensus.cc:2749] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:39.220397 12079 raft_consensus.cc:2804] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:39.256687 12052 raft_consensus.cc:515] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:39.280236 10850 raft_consensus.cc:2468] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 4.
I20260709 12:24:39.224640 12140 raft_consensus.cc:515] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:39.281327 10894 leader_election.cc:304] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:39.282006 12052 leader_election.cc:290] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:39.282424 12140 leader_election.cc:290] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:39.224896 12113 raft_consensus.cc:493] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:39.283140 12000 raft_consensus.cc:2804] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:39.281545 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:39.283762 12000 raft_consensus.cc:697] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:39.220255 12041 consensus_queue.cc:237] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:39.285193 12042 raft_consensus.cc:2955] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:24:39.220561 12108 raft_consensus.cc:2804] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:39.196806 12051 raft_consensus.cc:515] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:39.283157 12140 raft_consensus.cc:2804] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:39.287689 10852 raft_consensus.cc:2468] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 3.
I20260709 12:24:39.295295 10852 raft_consensus.cc:2955] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:24:39.336905 11003 raft_consensus.cc:2468] T 69fd8fdac2fa449e9e184f3d668ea1a7 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 4.
I20260709 12:24:39.255723 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:39.293372 12108 raft_consensus.cc:493] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:39.295477 10894 leader_election.cc:304] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:39.293962 12079 raft_consensus.cc:493] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:39.341729 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 46350.4us
I20260709 12:24:39.347985 11861 raft_consensus.cc:2804] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:39.348551 11861 raft_consensus.cc:493] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:39.348902 11861 raft_consensus.cc:3060] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:39.352097 12124 raft_consensus.cc:493] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:39.352773 12124 raft_consensus.cc:515] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:39.357815 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6a1da21304fcfacab384a6afc4101" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:39.359535 10929 raft_consensus.cc:2393] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 3: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:24:39.360570 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:39.361176 10929 raft_consensus.cc:3060] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:39.351145 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:39.370651 10819 leader_election.cc:304] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:39.388633 10819 leader_election.cc:304] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:39.283505 12113 raft_consensus.cc:3060] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:39.386543 10752 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60734 (request call id 138) took 3368 ms. Trace:
I20260709 12:24:39.221657 12167 leader_election.cc:290] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:39.355353 12124 leader_election.cc:290] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:39.421278 10819 leader_election.cc:400] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Vote denied by peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339) with higher term. Message: Invalid argument: T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 2. Current term is 3.
I20260709 12:24:39.425055 11747 raft_consensus.cc:493] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:39.363236 10923 raft_consensus.cc:2468] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 4.
I20260709 12:24:39.341414 12079 raft_consensus.cc:3060] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:39.340894 12108 raft_consensus.cc:3060] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:39.425833 11747 raft_consensus.cc:515] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:39.417605 10752 rpcz_store.cc:276] 0709 12:24:36.018130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.018487 (+   357us) service_pool.cc:224] Handling call
0709 12:24:39.386438 (+3367951us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:36.533826 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:36.562354 (+ 28528us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:36.562388 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:24:36.562404 (+    16us) tablet.cc:662] Decoding operations
0709 12:24:36.562977 (+   573us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:36.563071 (+    94us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:36.563098 (+    27us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:24:36.563462 (+   364us) tablet.cc:701] Row locks acquired
0709 12:24:36.563480 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:24:36.563725 (+   245us) write_op.cc:270] Start()
0709 12:24:36.563860 (+   135us) write_op.cc:276] Timestamp: P: 1783599876563676 usec, L: 0
0709 12:24:36.563888 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 12:24:36.564579 (+   691us) log.cc:844] Serialized 1307 byte log entry
0709 12:24:36.810224 (+245645us) op_driver.cc:464] REPLICATION: finished
0709 12:24:36.963059 (+152835us) write_op.cc:301] APPLY: starting
0709 12:24:36.963207 (+   148us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:36.963390 (+   183us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:36.963611 (+   221us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:36.964204 (+   593us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:36.964436 (+   232us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:24:36.964506 (+    70us) write_op.cc:312] APPLY: finished
0709 12:24:36.964776 (+   270us) log.cc:844] Serialized 34 byte log entry
0709 12:24:36.965010 (+   234us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:36.965303 (+   293us) write_op.cc:454] Released schema lock
0709 12:24:36.965383 (+    80us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:36.965957 (+   574us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:36.965987 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":96935,"reported_tablets":18,"child_traces":[["op",{"apply.queue_time_us":118821,"apply.run_cpu_time_us":2906,"apply.run_wall_time_us":7349,"num_ops":3,"prepare.queue_time_us":7829,"prepare.run_cpu_time_us":3662,"prepare.run_wall_time_us":49794,"replication_time_us":224469,"thread_start_us":98261,"threads_started":2}]]}
I20260709 12:24:39.340811 12140 raft_consensus.cc:697] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:39.430151 12016 raft_consensus.cc:493] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.447379 12016 raft_consensus.cc:515] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:39.450182 12016 leader_election.cc:290] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:39.456512 12000 consensus_queue.cc:237] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:39.457751 12051 leader_election.cc:290] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:39.466084 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:39.467036 10925 raft_consensus.cc:3060] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:39.468699 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:39.460237 10751 catalog_manager.cc:5697] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 1 to 2, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 2 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } }
I20260709 12:24:39.472036 10751 catalog_manager.cc:5697] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 1 to 2, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 2 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } }
I20260709 12:24:39.462086 12038 raft_consensus.cc:515] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:39.477761 11747 leader_election.cc:290] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:39.416083 12035 raft_consensus.cc:2804] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:39.474589 10751 catalog_manager.cc:5697] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 1 to 2, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 2 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } }
I20260709 12:24:39.416539 12177 raft_consensus.cc:2749] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:39.447224 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:39.432539 12162 leader_election.cc:290] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:39.499684 10928 raft_consensus.cc:3060] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:39.488550 12035 raft_consensus.cc:493] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:39.511518 10929 raft_consensus.cc:2468] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 3.
I20260709 12:24:39.466946 11849 raft_consensus.cc:515] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:39.516855 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:39.517593 10921 raft_consensus.cc:2468] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 2.
I20260709 12:24:39.518579 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:39.520450 10925 raft_consensus.cc:2468] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 5.
I20260709 12:24:39.521317 10928 raft_consensus.cc:2468] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 3.
I20260709 12:24:39.522933 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:39.512682 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:39.521445 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:39.523770 10929 raft_consensus.cc:2468] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 2.
I20260709 12:24:39.489092 12172 raft_consensus.cc:515] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:39.528368 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 311565us
I20260709 12:24:39.529918 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:39.466946 11882 raft_consensus.cc:515] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:39.525331 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:39.531216 10968 leader_election.cc:304] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:24:39.524441 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:39.532174 10928 raft_consensus.cc:2368] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 2. Current term is 3.
I20260709 12:24:39.545410 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c913e527ff46578e084c41eab7bb9d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:39.536553 10929 raft_consensus.cc:2468] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 4.
I20260709 12:24:39.509102 12035 raft_consensus.cc:3060] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:39.531535 12175 log.cc:927] Time spent T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d: Append to log took a long time: real 0.466s	user 0.005s	sys 0.002s
I20260709 12:24:39.534662 10923 raft_consensus.cc:2393] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 4: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:24:39.564133 12136 consensus_queue.cc:1059] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:39.550105 12147 raft_consensus.cc:515] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:39.572968 12180 log.cc:927] Time spent T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 12:24:39.530035 12140 consensus_queue.cc:237] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:39.609748 12070 leader_election.cc:290] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:39.610240 10853 raft_consensus.cc:2393] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 3: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:24:39.609803 12147 leader_election.cc:290] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:39.553328 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:39.618057 10921 raft_consensus.cc:2393] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 4: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:24:39.577232 12172 leader_election.cc:290] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:39.528530 12176 raft_consensus.cc:515] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:39.579888 12038 leader_election.cc:290] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:39.551960 12016 raft_consensus.cc:2804] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:39.624658 12016 raft_consensus.cc:493] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:39.625123 12016 raft_consensus.cc:3060] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:39.628693 12130 raft_consensus.cc:3060] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:39.590054 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 412137us
I20260709 12:24:39.592079 11000 raft_consensus.cc:1275] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:24:39.599504 10847 raft_consensus.cc:1275] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:24:39.606922 12120 raft_consensus.cc:3060] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:39.630582 10819 leader_election.cc:304] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:39.631970 10895 leader_election.cc:304] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:39.618042 12036 leader_election.cc:290] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:39.637530 10846 raft_consensus.cc:2393] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 5: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:24:39.637526 10819 leader_election.cc:304] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:39.639775 10819 leader_election.cc:304] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:39.633097 12113 raft_consensus.cc:515] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:39.652916 10895 leader_election.cc:304] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:24:39.618202 12079 raft_consensus.cc:515] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:39.669914 10895 leader_election.cc:304] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:39.675316 10895 leader_election.cc:304] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:39.676192 10895 leader_election.cc:304] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:39.677198 10895 leader_election.cc:304] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:39.678035 10852 raft_consensus.cc:1240] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:24:39.679153 10895 leader_election.cc:304] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:39.679534 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:39.680856 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:39.681475 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:39.682225 10852 raft_consensus.cc:3060] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:39.682391 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
W20260709 12:24:39.684361 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 478503us
I20260709 12:24:39.685323 10820 leader_election.cc:304] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:39.686110 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:39.686959 10854 raft_consensus.cc:2468] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 3.
I20260709 12:24:39.690847 10924 raft_consensus.cc:2393] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 5: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:24:39.639032 12041 raft_consensus.cc:2804] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:39.683321 10851 raft_consensus.cc:2468] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 1.
I20260709 12:24:39.652649 12036 raft_consensus.cc:3060] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:39.672691 12164 raft_consensus.cc:2804] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:39.656463 11999 raft_consensus.cc:2749] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:39.702698 10852 raft_consensus.cc:2468] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 3.
I20260709 12:24:39.704933 10820 leader_election.cc:304] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:39.706610 11747 raft_consensus.cc:2804] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:39.708596 11747 raft_consensus.cc:493] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:39.709102 11747 raft_consensus.cc:3060] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:39.634500 12185 consensus_queue.cc:1059] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.077s
I20260709 12:24:39.720021 10895 leader_election.cc:304] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:39.721256 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:39.698488 12186 raft_consensus.cc:2804] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:39.654521 12163 consensus_queue.cc:1048] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 12:24:39.725251 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:39.727566 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:39.727861 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c913e527ff46578e084c41eab7bb9d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:39.728196 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:39.733470 11001 raft_consensus.cc:2468] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 2.
I20260709 12:24:39.733843 11000 raft_consensus.cc:3060] T 3f8a389131ef4c77a3e08488aa4759eb P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:39.731989 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:39.743415 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6a1da21304fcfacab384a6afc4101" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:39.744401 11001 raft_consensus.cc:2393] T dad6a1da21304fcfacab384a6afc4101 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 3: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:24:39.746621 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fd8fdac2fa449e9e184f3d668ea1a7" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:39.750785 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:39.700646 12147 raft_consensus.cc:493] T e3d9a61ecaf84695b70f8519ee57706f P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:39.757918 10999 raft_consensus.cc:2393] T 69fd8fdac2fa449e9e184f3d668ea1a7 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 4: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:24:39.753849 11002 raft_consensus.cc:2468] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 2.
I20260709 12:24:39.706215 12189 raft_consensus.cc:2804] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:39.701433 11882 leader_election.cc:290] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:39.701911 12164 raft_consensus.cc:493] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:39.708034 12041 raft_consensus.cc:697] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 3 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:39.722007 12144 raft_consensus.cc:2749] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:39.720418 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fd8fdac2fa449e9e184f3d668ea1a7" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:39.742005 12026 raft_consensus.cc:2804] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:39.770676 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:39.724198 12177 raft_consensus.cc:493] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.702373 12105 consensus_queue.cc:1048] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 12:24:39.770232 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:39.755306 12070 raft_consensus.cc:2804] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:39.777082 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:39.803766 11002 raft_consensus.cc:2393] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 4: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:24:39.804986 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:39.806473 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aed74af73a488f8b691578ca370226" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:39.808146 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:39.808614 10927 raft_consensus.cc:1240] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:24:39.779512 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:39.733557 12060 raft_consensus.cc:2804] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:39.721573 12183 raft_consensus.cc:2804] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:39.785480 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:39.789105 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63ecfc9bd3945818cfe15c03f001315" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:39.792613 11001 raft_consensus.cc:2468] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 1.
I20260709 12:24:39.763088 12189 raft_consensus.cc:493] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:39.775952 11003 raft_consensus.cc:2468] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 4.
I20260709 12:24:39.762698 12164 raft_consensus.cc:3060] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:39.747385 12186 raft_consensus.cc:493] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:39.768723 12080 raft_consensus.cc:493] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:39.773499 12081 consensus_meta.cc:287] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040: Time spent flushing consensus metadata: real 0.515s	user 0.014s	sys 0.000s
I20260709 12:24:39.809988 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:39.819967 10846 raft_consensus.cc:2468] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 4.
I20260709 12:24:39.761166 12185 raft_consensus.cc:3055] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:39.808914 10929 raft_consensus.cc:2468] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 2.
I20260709 12:24:39.838047 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:39.839275 10929 raft_consensus.cc:2468] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 2.
I20260709 12:24:39.830204 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad766f48812a4ddeb383179b1d84907b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:39.826273 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:39.833905 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:39.780328 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:39.755069 12134 consensus_queue.cc:1048] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 12:24:39.783615 12026 raft_consensus.cc:493] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:39.897688 10925 raft_consensus.cc:2393] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 3: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:24:39.840349 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b17195a94142039c40f598ed006c94" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:39.845036 10968 leader_election.cc:304] T d0aed74af73a488f8b691578ca370226 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:39.900054 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:39.767123 12147 raft_consensus.cc:515] T e3d9a61ecaf84695b70f8519ee57706f P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:39.903923 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 59026.2us
I20260709 12:24:39.792096 12093 raft_consensus.cc:493] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:39.904821 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:39.906857 10968 leader_election.cc:304] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:39.909106 10968 leader_election.cc:304] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:39.833293 12186 raft_consensus.cc:3060] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:39.854154 11747 raft_consensus.cc:515] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:39.854750 11000 raft_consensus.cc:2468] T 3f8a389131ef4c77a3e08488aa4759eb P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 3.
I20260709 12:24:39.832571 12070 raft_consensus.cc:697] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:39.828228 12189 raft_consensus.cc:3060] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:39.902707 12026 raft_consensus.cc:3060] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:39.832306 11849 leader_election.cc:290] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:39.915763 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:39.895970 12185 raft_consensus.cc:740] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:39.901202 10996 raft_consensus.cc:3060] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:39.863034 12060 raft_consensus.cc:697] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:39.963066 10999 raft_consensus.cc:3060] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:39.969059 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:39.908396 11882 raft_consensus.cc:2749] T d0aed74af73a488f8b691578ca370226 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:39.914157 11955 raft_consensus.cc:2804] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:39.962082 12195 raft_consensus.cc:2804] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:39.977613 11747 leader_election.cc:290] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:39.922138 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad766f48812a4ddeb383179b1d84907b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:39.848518 12081 raft_consensus.cc:515] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:39.855108 12080 raft_consensus.cc:515] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:39.800025 12177 raft_consensus.cc:515] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:39.963238 12176 leader_election.cc:290] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:39.993044 10925 raft_consensus.cc:1275] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:24:39.972498 11861 consensus_meta.cc:287] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea: Time spent flushing consensus metadata: real 0.623s	user 0.012s	sys 0.002s
I20260709 12:24:39.910898 12140 consensus_queue.cc:1059] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.066s
I20260709 12:24:39.994263 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:40.007099 12140 raft_consensus.cc:3055] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:39.978519 12195 raft_consensus.cc:493] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:39.978457 11955 raft_consensus.cc:493] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:39.997466 10925 raft_consensus.cc:1240] T c63ecfc9bd3945818cfe15c03f001315 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:39.912576 12093 raft_consensus.cc:515] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:40.003350 12185 consensus_queue.cc:260] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:40.005214 12194 log.cc:927] Time spent T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 12:24:39.976688 12199 raft_consensus.cc:493] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:39.982612 11621 raft_consensus.cc:1240] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d [term 3 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:39.863749 12041 consensus_queue.cc:237] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:24:40.048173 10846 raft_consensus.cc:2468] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 2.
I20260709 12:24:39.987841 12113 leader_election.cc:290] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:39.984746 12178 raft_consensus.cc:493] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:39.978652 12183 raft_consensus.cc:697] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [term 3 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:40.060668 11003 raft_consensus.cc:1275] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:40.060815 10928 raft_consensus.cc:2468] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 3.
I20260709 12:24:40.045132 11955 raft_consensus.cc:3060] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:39.998974 11882 raft_consensus.cc:493] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:40.017071 11861 raft_consensus.cc:515] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:40.054673 12179 log.cc:927] Time spent T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:24:40.044148 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:40.042846 12016 raft_consensus.cc:515] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:40.076941 12093 leader_election.cc:290] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:40.077865 11861 leader_election.cc:290] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:40.078436 10926 raft_consensus.cc:2368] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 4. Current term is 5.
I20260709 12:24:40.079212 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63ecfc9bd3945818cfe15c03f001315" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
W20260709 12:24:40.080695 12197 log.cc:927] Time spent T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 12:24:40.085747 12189 raft_consensus.cc:515] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:40.084298 12183 consensus_queue.cc:237] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:40.009061 12147 leader_election.cc:290] T e3d9a61ecaf84695b70f8519ee57706f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:40.087785 12185 raft_consensus.cc:3060] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:40.093297 10999 raft_consensus.cc:2468] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 3.
I20260709 12:24:40.106199 10925 raft_consensus.cc:1240] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:24:40.007539 12140 raft_consensus.cc:740] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:40.008167 12195 raft_consensus.cc:3060] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:40.083241 12177 leader_election.cc:290] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:40.099817 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:40.100627 10922 raft_consensus.cc:2368] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for earlier term 4. Current term is 5.
I20260709 12:24:40.058326 12199 raft_consensus.cc:515] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:40.115721 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:40.067723 12178 raft_consensus.cc:515] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:40.117730 10999 raft_consensus.cc:3060] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:40.103158 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:40.126245 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:40.137370 10853 raft_consensus.cc:3060] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:40.122516 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:40.146720 11002 raft_consensus.cc:2468] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 2.
I20260709 12:24:40.123590 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6a1da21304fcfacab384a6afc4101" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:40.127622 12080 leader_election.cc:290] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:40.131930 12026 raft_consensus.cc:515] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:40.136621 12108 consensus_meta.cc:287] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08: Time spent flushing consensus metadata: real 0.652s	user 0.004s	sys 0.008s
I20260709 12:24:40.088677 12070 consensus_queue.cc:237] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:40.091641 12060 consensus_queue.cc:237] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:40.151942 12140 consensus_queue.cc:260] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:40.104511 10845 raft_consensus.cc:3060] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:40.143095 12130 consensus_meta.cc:287] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08: Time spent flushing consensus metadata: real 0.514s	user 0.011s	sys 0.000s
I20260709 12:24:40.143822 12105 consensus_queue.cc:1059] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:40.182449 12192 raft_consensus.cc:493] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:40.145330 10922 raft_consensus.cc:1275] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:24:40.184057 12019 raft_consensus.cc:3055] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:24:40.143095 12035 consensus_meta.cc:287] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040: Time spent flushing consensus metadata: real 0.563s	user 0.014s	sys 0.000s
I20260709 12:24:40.186087 12035 raft_consensus.cc:515] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:40.120561 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:40.187114 10995 raft_consensus.cc:2468] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 4.
I20260709 12:24:40.141074 12079 leader_election.cc:290] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:40.187417 11003 raft_consensus.cc:2368] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for earlier term 2. Current term is 3.
I20260709 12:24:40.154971 12081 leader_election.cc:290] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:40.190049 12199 leader_election.cc:290] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:40.182937 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:40.191761 11002 raft_consensus.cc:2393] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 3: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:24:40.184587 12019 raft_consensus.cc:740] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:40.191577 12189 leader_election.cc:290] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:40.196753 10820 leader_election.cc:304] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:40.094496 11882 raft_consensus.cc:515] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:40.184721 12026 leader_election.cc:290] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:40.202463 12035 leader_election.cc:290] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:40.199846 10895 leader_election.cc:304] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
W20260709 12:24:40.206205 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:40.208156 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:40.214720 10895 leader_election.cc:304] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:40.157856 12108 raft_consensus.cc:515] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:40.225921 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:40.229743 10999 raft_consensus.cc:2468] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 3.
I20260709 12:24:40.232208 11747 raft_consensus.cc:2804] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:40.232738 11747 raft_consensus.cc:697] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:40.237390 10895 leader_election.cc:304] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:40.211668 12140 raft_consensus.cc:3060] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:40.184141 12192 raft_consensus.cc:515] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:40.224789 12110 raft_consensus.cc:2804] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:40.211800 12068 raft_consensus.cc:493] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:40.246690 12127 raft_consensus.cc:2804] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:40.252065 11747 consensus_queue.cc:237] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:40.254791 10895 leader_election.cc:400] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 election: Vote denied by peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945) with higher term. Message: Invalid argument: T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for earlier term 2. Current term is 3.
W20260709 12:24:40.245846 12120 consensus_meta.cc:287] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08: Time spent flushing consensus metadata: real 0.612s	user 0.006s	sys 0.006s
I20260709 12:24:40.265209 10895 leader_election.cc:403] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:24:40.268191 10895 leader_election.cc:304] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:40.272239 10997 raft_consensus.cc:2468] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 2.
I20260709 12:24:40.193202 12019 consensus_queue.cc:260] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:40.234341 12113 consensus_queue.cc:1048] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:24:40.254137 12110 raft_consensus.cc:493] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:40.256507 12127 raft_consensus.cc:493] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:40.288743 12127 raft_consensus.cc:3060] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:40.277220 12070 raft_consensus.cc:2749] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945) with higher term. Message: Invalid argument: T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for earlier term 2. Current term is 3.
I20260709 12:24:40.288093 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:40.283825 12016 leader_election.cc:290] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:40.287222 11882 leader_election.cc:290] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:40.275769 11870 raft_consensus.cc:2804] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:40.297081 11870 raft_consensus.cc:697] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:40.298436 11870 consensus_queue.cc:237] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:40.259331 12068 raft_consensus.cc:515] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:40.289547 12110 raft_consensus.cc:3060] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:40.303725 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:40.312973 10920 raft_consensus.cc:2393] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 2: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
W20260709 12:24:40.291874 12036 consensus_meta.cc:287] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040: Time spent flushing consensus metadata: real 0.590s	user 0.013s	sys 0.000s
I20260709 12:24:40.300616 12186 raft_consensus.cc:515] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:40.305313 12108 leader_election.cc:290] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:40.305344 12192 leader_election.cc:290] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:40.309386 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:40.292147 12136 raft_consensus.cc:3055] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:40.301162 12019 raft_consensus.cc:3060] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:40.317940 10925 raft_consensus.cc:2368] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for earlier term 4. Current term is 5.
I20260709 12:24:40.321956 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:40.322439 10854 raft_consensus.cc:2393] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 3: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:24:40.331228 12068 leader_election.cc:290] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:24:40.331836 12214 log.cc:927] Time spent T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 12:24:40.333804 12133 raft_consensus.cc:493] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:40.334537 12133 raft_consensus.cc:515] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:40.315594 12036 raft_consensus.cc:2749] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:40.304335 12164 raft_consensus.cc:515] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:40.316731 10922 raft_consensus.cc:2468] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 2.
I20260709 12:24:40.341202 12164 leader_election.cc:290] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:40.334957 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef3220c51df47db8859f07ab745fad5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:40.319039 12136 raft_consensus.cc:740] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:40.338970 10996 raft_consensus.cc:2468] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 5.
W20260709 12:24:40.338055 12182 log.cc:927] Time spent T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.829s	user 0.002s	sys 0.004s
I20260709 12:24:40.361389 10853 raft_consensus.cc:2468] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 3.
I20260709 12:24:40.361726 10995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37500 (request call id 993) took 1196 ms. Trace:
I20260709 12:24:40.363008 10852 raft_consensus.cc:2468] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 3.
I20260709 12:24:40.362186 10995 rpcz_store.cc:276] 0709 12:24:39.160548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:39.167643 (+  7095us) service_pool.cc:224] Handling call
0709 12:24:40.351555 (+1183912us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54003052d4. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e8c2fa 00007f7599e4db17 00007f75933c86d4 00007f75933c8662 00007f75933c8591 00007f75933c850c 00007f75933c77c2 00007f75931c348c 00007f75931c28c6 00007f75931c226f
0709 12:24:40.357348 (+  5793us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2341847936}
I20260709 12:24:40.367095 12136 consensus_queue.cc:260] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:40.368614 12136 raft_consensus.cc:3060] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:40.369362 10848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56394 (request call id 931) took 1143 ms. Trace:
I20260709 12:24:40.369742 10848 rpcz_store.cc:276] 0709 12:24:39.225881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:39.226023 (+   142us) service_pool.cc:224] Handling call
0709 12:24:39.252332 (+ 26309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:39.526452 (+274120us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:39.526503 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:39.527145 (+   642us) log.cc:844] Serialized 26 byte log entry
0709 12:24:39.773411 (+246266us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:39.832176 (+ 58765us) log.cc:844] Serialized 14 byte log entry
0709 12:24:39.984618 (+152442us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:39.985125 (+   507us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:40.352849 (+367724us) spinlock_profiling.cc:243] Waited 6.66 ms on lock 0x7b1800362860. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f759ac63ab1 00007f759ac70281 00007f7591d9b3f3 00007f7591d9d7c1 00007f7591d9d779 00007f7591d9d709 00007f7591d9d6d1 00007f7591d9c9cd 0000000000388634 0000000000388479 00007f7591d7e83a
0709 12:24:40.369054 (+ 16205us) raft_consensus.cc:1685] finished
0709 12:24:40.369164 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:40.369304 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2330,"prepare.queue_time_us":60349,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":4006,"raft.queue_time_us":5885,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":118,"spinlock_wait_cycles":15315200,"thread_start_us":600636,"threads_started":3,"wal-append.queue_time_us":359374}
I20260709 12:24:40.372133 12186 leader_election.cc:290] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:40.372318 12133 leader_election.cc:290] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:40.372925 10845 raft_consensus.cc:2468] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 3.
I20260709 12:24:40.328298 11955 raft_consensus.cc:515] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:40.376780 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5794ba618e514e28a7542ab6af39d8c9" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:40.380007 11955 leader_election.cc:290] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:40.380831 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:40.382171 11621 raft_consensus.cc:1275] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d [term 3 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:24:40.382699 12178 leader_election.cc:290] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:40.386346 11955 consensus_queue.cc:1048] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:40.375504 12127 raft_consensus.cc:515] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:40.358537 12195 raft_consensus.cc:515] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:40.391618 11000 raft_consensus.cc:2393] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 3: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:24:40.398797 12195 leader_election.cc:290] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:40.399755 12112 leader_election.cc:290] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:40.399966 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:40.400548 10927 raft_consensus.cc:3060] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:40.400884 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:40.401705 10994 raft_consensus.cc:3060] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:40.403123 12127 leader_election.cc:290] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:40.415344 12145 raft_consensus.cc:493] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:40.417191 10927 raft_consensus.cc:2468] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 3.
I20260709 12:24:40.415973 12145 raft_consensus.cc:515] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:40.422611 10994 raft_consensus.cc:2468] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 5.
W20260709 12:24:40.423902 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 54618us
I20260709 12:24:40.428136 12145 leader_election.cc:290] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:24:40.431336 10968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:40.437480 12110 raft_consensus.cc:515] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:40.438778 10920 raft_consensus.cc:2368] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for earlier term 2. Current term is 3.
I20260709 12:24:40.439922 12162 raft_consensus.cc:2749] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:40.448750 12110 leader_election.cc:290] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:40.454109 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:40.454396 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:40.454902 10854 raft_consensus.cc:2468] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 2.
I20260709 12:24:40.455734 10852 raft_consensus.cc:2393] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 3: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:24:40.470198 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:40.473189 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:40.474499 10852 raft_consensus.cc:2393] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 3: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:24:40.476630 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:40.477445 10852 raft_consensus.cc:2393] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 5: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:24:40.483853 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:40.484820 10845 raft_consensus.cc:2393] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 5: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:24:40.488763 10854 raft_consensus.cc:1275] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:40.492341 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:40.493458 10852 raft_consensus.cc:2393] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 5: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:24:40.494539 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:40.495363 10854 raft_consensus.cc:3060] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Advancing to term 5
W20260709 12:24:40.492722 10997 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37512 (request call id 870) took 1833 ms (client timeout 2089 ms). Trace:
I20260709 12:24:40.496362 11849 raft_consensus.cc:493] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:40.491294 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:40.498025 10968 leader_election.cc:304] T a6a28416571247df878823d464c05f1e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:40.502017 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:40.502439 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:40.503012 10999 raft_consensus.cc:3060] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:40.504678 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:40.505244 11001 raft_consensus.cc:3060] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:40.507392 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d9a61ecaf84695b70f8519ee57706f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:40.507994 11003 raft_consensus.cc:3060] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:40.511169 10999 raft_consensus.cc:2468] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 5.
I20260709 12:24:40.511444 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:40.512100 10998 raft_consensus.cc:3060] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:40.527745 10893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:40.512219 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:40.530557 10999 raft_consensus.cc:3060] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:40.497116 12191 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.830s	user 0.013s	sys 0.015s
W20260709 12:24:40.498407 10997 rpcz_store.cc:269] 0709 12:24:38.659151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:38.661203 (+  2052us) service_pool.cc:224] Handling call
0709 12:24:40.492551 (+1831348us) spinlock_profiling.cc:243] Waited 1.6 s on lock 0x7b54001833d4. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e8c2fa 00007f7599e4db17 00007f75933c86d4 00007f75933c8662 00007f75933c8591 00007f75933c850c 00007f75933c77c2 00007f75931c348c 00007f75931c28c6 00007f75931c226f
0709 12:24:40.492649 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3669244672}
I20260709 12:24:40.520521 10968 leader_election.cc:400] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Vote denied by peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339) with higher term. Message: Invalid argument: T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for earlier term 4. Current term is 5.
I20260709 12:24:40.533460 10968 leader_election.cc:403] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:40.534497 10895 leader_election.cc:304] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:40.536687 10854 raft_consensus.cc:2468] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 5.
I20260709 12:24:40.537432 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:40.538064 10994 raft_consensus.cc:3060] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Advancing to term 5
W20260709 12:24:40.531193 12191 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.865s	user 0.013s	sys 0.015s
I20260709 12:24:40.496500 12203 raft_consensus.cc:493] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:40.542582 10968 leader_election.cc:400] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 election: Vote denied by peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339) with higher term. Message: Invalid argument: T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for earlier term 4. Current term is 5.
I20260709 12:24:40.545706 10999 raft_consensus.cc:2468] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 3.
I20260709 12:24:40.513008 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:40.550144 10996 raft_consensus.cc:2393] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 5: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:24:40.550276 12000 raft_consensus.cc:2804] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:40.550880 12000 raft_consensus.cc:697] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 5 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:40.513175 12136 raft_consensus.cc:2749] T a6a28416571247df878823d464c05f1e P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:40.532348 11955 consensus_queue.cc:1059] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 12:24:40.535082 12185 raft_consensus.cc:493] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:40.553831 10895 leader_election.cc:304] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:40.567076 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:40.570955 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:40.566248 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d9a61ecaf84695b70f8519ee57706f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:40.580664 10852 raft_consensus.cc:2393] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 3: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:24:40.580835 10854 raft_consensus.cc:3060] T e3d9a61ecaf84695b70f8519ee57706f P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:24:40.548672 10968 leader_election.cc:403] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:24:40.568221 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:40.582342 10849 raft_consensus.cc:3060] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:40.567433 10819 leader_election.cc:304] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:40.520298 12195 consensus_queue.cc:1048] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 12:24:40.587062 10994 raft_consensus.cc:2468] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 5.
W20260709 12:24:40.568832 10894 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.116.65:46265 timed out after 1.577s (SENT) [suppressed 38 similar messages]
I20260709 12:24:40.568766 11001 raft_consensus.cc:2468] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 5.
I20260709 12:24:40.589283 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:40.591063 10847 raft_consensus.cc:2468] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 5.
I20260709 12:24:40.584214 10968 leader_election.cc:304] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:40.597538 10998 raft_consensus.cc:2468] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 3.
I20260709 12:24:40.598802 11003 raft_consensus.cc:2468] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 3.
I20260709 12:24:40.604786 10854 raft_consensus.cc:2468] T e3d9a61ecaf84695b70f8519ee57706f P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 3.
I20260709 12:24:40.535712 11849 raft_consensus.cc:515] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:40.561916 12184 raft_consensus.cc:493] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:40.615746 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 46954.4us
I20260709 12:24:40.567739 11955 raft_consensus.cc:3055] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:40.595960 10968 leader_election.cc:304] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:40.556002 12140 consensus_queue.cc:1048] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:24:40.551859 12000 consensus_queue.cc:237] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:40.560875 12205 raft_consensus.cc:493] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:40.586755 11944 raft_consensus.cc:2804] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:40.587003 12136 raft_consensus.cc:2749] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339) with higher term. Message: Invalid argument: T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for earlier term 4. Current term is 5.
I20260709 12:24:40.621831 10849 raft_consensus.cc:2468] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 3.
I20260709 12:24:40.618541 10968 leader_election.cc:400] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 election: Vote denied by peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339) with higher term. Message: Invalid argument: T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for earlier term 2. Current term is 3.
I20260709 12:24:40.593053 12156 raft_consensus.cc:2749] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339) with higher term. Message: Invalid argument: T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for earlier term 4. Current term is 5.
I20260709 12:24:40.605226 12005 raft_consensus.cc:493] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:40.623271 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 426553us
I20260709 12:24:40.617252 11882 raft_consensus.cc:2804] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:40.622570 10968 leader_election.cc:403] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:24:40.558477 12203 raft_consensus.cc:515] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:40.628263 10854 raft_consensus.cc:1240] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:40.586514 12185 raft_consensus.cc:515] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:40.620028 11955 raft_consensus.cc:740] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:40.630486 10854 raft_consensus.cc:1240] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:40.631122 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b17195a94142039c40f598ed006c94" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:40.643869 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:40.644686 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:40.647508 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
W20260709 12:24:40.660087 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 92788.3us
I20260709 12:24:40.661042 10847 raft_consensus.cc:2393] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 3: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:24:40.661552 10819 leader_election.cc:304] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
W20260709 12:24:40.661860 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 43496us
I20260709 12:24:40.662030 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:40.662652 10849 raft_consensus.cc:2468] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 2.
I20260709 12:24:40.662583 10968 leader_election.cc:304] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:40.662878 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:40.664007 10853 raft_consensus.cc:2368] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for earlier term 2. Current term is 3.
I20260709 12:24:40.664077 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:40.667659 10854 raft_consensus.cc:2368] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for earlier term 2. Current term is 3.
I20260709 12:24:40.664462 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:40.626686 12026 raft_consensus.cc:2804] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:40.622763 12068 raft_consensus.cc:2804] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:40.630600 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:40.673981 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:40.669245 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:40.674234 10819 leader_election.cc:304] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:40.674865 10852 raft_consensus.cc:2368] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for earlier term 4. Current term is 5.
W20260709 12:24:40.670258 10968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:40.644151 12036 raft_consensus.cc:493] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:40.623945 11944 raft_consensus.cc:697] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:40.674113 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:40.668951 10849 raft_consensus.cc:2368] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for earlier term 2. Current term is 3.
I20260709 12:24:40.681550 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:40.674932 10847 raft_consensus.cc:2368] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for earlier term 4. Current term is 5.
I20260709 12:24:40.682806 10853 raft_consensus.cc:3060] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:40.669732 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef3220c51df47db8859f07ab745fad5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:40.659771 11882 raft_consensus.cc:697] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 2 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:40.679018 10819 leader_election.cc:304] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:40.675930 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:40.667294 12136 raft_consensus.cc:2749] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339) with higher term. Message: Invalid argument: T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for earlier term 2. Current term is 3.
I20260709 12:24:40.664183 12052 raft_consensus.cc:2749] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:40.668696 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:40.619802 12184 raft_consensus.cc:515] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:40.706852 10854 raft_consensus.cc:1275] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:24:40.622298 12205 raft_consensus.cc:515] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:40.681097 12120 raft_consensus.cc:2804] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:40.680836 12176 raft_consensus.cc:2749] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:40.666440 12072 raft_consensus.cc:493] T ab816bcc6183447994a2cc013e46c5f8 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:40.700333 10820 leader_election.cc:304] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
W20260709 12:24:40.701428 12228 log.cc:927] Time spent T 00000000000000000000000000000000 P 9619ad7a9e7f4d9b8039487e3ee77243: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:24:40.702340 12203 leader_election.cc:290] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:40.693257 12036 raft_consensus.cc:515] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:40.628894 12005 raft_consensus.cc:515] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:40.681048 12178 raft_consensus.cc:2804] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:40.693447 10849 raft_consensus.cc:1275] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:24:40.695274 10852 raft_consensus.cc:2368] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for earlier term 2. Current term is 3.
I20260709 12:24:40.682825 12026 raft_consensus.cc:697] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [term 3 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:40.678560 12206 raft_consensus.cc:493] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
W20260709 12:24:40.722456 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 43516.9us
I20260709 12:24:40.746018 10819 leader_election.cc:400] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 election: Vote denied by peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339) with higher term. Message: Invalid argument: T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 2. Current term is 3.
I20260709 12:24:40.746558 10819 leader_election.cc:403] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:24:40.747640 12204 raft_consensus.cc:2804] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:40.748116 12204 raft_consensus.cc:493] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:40.748469 12204 raft_consensus.cc:3060] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:40.724663 10850 raft_consensus.cc:1275] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:40.700389 11944 consensus_queue.cc:237] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:40.726778 11882 consensus_queue.cc:237] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:40.724880 11937 raft_consensus.cc:2749] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:40.733454 10845 raft_consensus.cc:2368] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for earlier term 4. Current term is 5.
I20260709 12:24:40.711030 12120 raft_consensus.cc:493] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:40.729511 12072 raft_consensus.cc:515] T ab816bcc6183447994a2cc013e46c5f8 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:40.722651 10853 raft_consensus.cc:2468] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 3.
I20260709 12:24:40.756910 12120 raft_consensus.cc:3060] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:40.769948 10820 leader_election.cc:304] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:40.725201 12068 raft_consensus.cc:697] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:40.773289 10820 leader_election.cc:304] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:40.732837 12016 raft_consensus.cc:493] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:40.695736 11955 consensus_queue.cc:260] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:40.778220 10819 leader_election.cc:304] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:40.779390 12081 raft_consensus.cc:2749] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:40.780148 12038 raft_consensus.cc:493] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:40.780714 12038 raft_consensus.cc:515] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:40.782498 10820 leader_election.cc:304] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:40.784422 12035 raft_consensus.cc:2804] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:40.784644 12081 raft_consensus.cc:2804] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:40.783402 12016 raft_consensus.cc:515] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:40.785218 12035 raft_consensus.cc:697] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 5 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:40.786382 12035 consensus_queue.cc:237] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:40.771380 12052 raft_consensus.cc:2749] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339) with higher term. Message: Invalid argument: T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 2. Current term is 3.
I20260709 12:24:40.789713 10819 leader_election.cc:304] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:40.785374 12081 raft_consensus.cc:493] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:40.794385 10819 leader_election.cc:304] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:40.776847 12186 raft_consensus.cc:2804] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:40.795826 10819 leader_election.cc:400] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Vote denied by peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339) with higher term. Message: Invalid argument: T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 4. Current term is 5.
I20260709 12:24:40.798624 10819 leader_election.cc:403] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:40.798738 12186 raft_consensus.cc:697] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:40.799445 12212 raft_consensus.cc:2749] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339) with higher term. Message: Invalid argument: T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 4. Current term is 5.
I20260709 12:24:40.794054 12130 consensus_queue.cc:1059] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:24:40.775915 12178 raft_consensus.cc:697] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 5 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:40.811419 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d9a61ecaf84695b70f8519ee57706f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:40.812477 10927 raft_consensus.cc:2368] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 2. Current term is 3.
I20260709 12:24:40.818171 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:40.818616 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:40.800568 12183 raft_consensus.cc:2749] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:40.819363 10924 raft_consensus.cc:2393] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 3: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:24:40.819687 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:40.820282 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:40.792141 11849 leader_election.cc:290] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:40.814400 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:40.827442 10927 raft_consensus.cc:2393] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 5: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:24:40.802211 12081 raft_consensus.cc:3060] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:40.825109 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:40.825795 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:40.827544 10819 leader_election.cc:400] T e3d9a61ecaf84695b70f8519ee57706f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Vote denied by peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339) with higher term. Message: Invalid argument: T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 2. Current term is 3.
I20260709 12:24:40.769757 12026 consensus_queue.cc:237] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:40.836804 10819 leader_election.cc:403] T e3d9a61ecaf84695b70f8519ee57706f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:40.777307 12206 raft_consensus.cc:515] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:40.818802 12184 leader_election.cc:290] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:40.804948 12201 raft_consensus.cc:2749] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:40.836424 10920 raft_consensus.cc:2393] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 5: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:24:40.820295 10922 raft_consensus.cc:3060] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:40.841660 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5794ba618e514e28a7542ab6af39d8c9" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:40.843853 10846 raft_consensus.cc:2468] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 3.
I20260709 12:24:40.820381 12036 leader_election.cc:290] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:24:40.841485 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:40.848912 11588 leader_election.cc:304] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:40.862175 10894 leader_election.cc:304] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:40.863448 10894 leader_election.cc:304] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:40.865044 12042 raft_consensus.cc:2749] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:40.865692 11944 raft_consensus.cc:2749] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:40.864306 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac83709373b4efd9c3aa1472a9f9022" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:40.838548 12212 raft_consensus.cc:2749] T e3d9a61ecaf84695b70f8519ee57706f P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339) with higher term. Message: Invalid argument: T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 2. Current term is 3.
I20260709 12:24:40.864562 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:40.867249 10845 raft_consensus.cc:2393] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 5: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:24:40.800153 12186 consensus_queue.cc:237] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:40.848603 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:40.867487 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c6d38c4d8a90a81975a6a0cb13" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:40.867931 12076 raft_consensus.cc:2804] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:40.868396 12076 raft_consensus.cc:493] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d [term 3 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:40.853600 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab816bcc6183447994a2cc013e46c5f8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:40.854444 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c6d38c4d8a90a81975a6a0cb13" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:40.839510 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:40.870939 10923 raft_consensus.cc:2393] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 3: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:24:40.870535 10752 catalog_manager.cc:5697] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: config changed from index 2 to 3, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:24:40.838323 12068 consensus_queue.cc:237] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:40.872058 12206 leader_election.cc:290] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:40.849874 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:40.866027 10894 leader_election.cc:304] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:40.874202 10925 raft_consensus.cc:2393] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 4: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:24:40.874714 10894 leader_election.cc:304] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:40.875067 11944 raft_consensus.cc:2804] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:40.875486 11944 raft_consensus.cc:493] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:40.875857 11944 raft_consensus.cc:3060] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:40.876698 10894 leader_election.cc:304] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:40.876956 10925 raft_consensus.cc:1275] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:40.877817 10894 leader_election.cc:304] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:40.878957 12110 raft_consensus.cc:2804] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:40.879307 12110 raft_consensus.cc:493] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:40.879667 12110 raft_consensus.cc:3060] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:40.872074 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:40.880471 10923 raft_consensus.cc:3060] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:40.841295 12178 consensus_queue.cc:237] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:40.868778 10924 raft_consensus.cc:2393] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 4: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:24:40.872519 10752 catalog_manager.cc:5697] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: term changed from 1 to 3, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68). New cstate: current_term: 3 leader_uuid: "3c52e0825c02476e89d84da9bb849f5d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:40.877938 10925 raft_consensus.cc:3060] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:40.885051 10894 leader_election.cc:304] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:40.868918 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:40.887766 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:40.888777 10924 raft_consensus.cc:2393] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 5: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:24:40.832284 12016 leader_election.cc:290] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:40.879617 12205 leader_election.cc:290] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:40.909968 10894 leader_election.cc:304] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:40.915011 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:40.917613 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:40.932744 10925 raft_consensus.cc:1275] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:40.938730 12183 consensus_queue.cc:1048] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:40.868794 12076 raft_consensus.cc:3060] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:40.900261 12042 raft_consensus.cc:2804] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:24:40.910653 12236 log.cc:927] Time spent T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
W20260709 12:24:40.960995 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 51204us
I20260709 12:24:40.901697 12038 leader_election.cc:290] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:40.969139 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:40.897477 12072 leader_election.cc:290] T ab816bcc6183447994a2cc013e46c5f8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:40.944506 12000 raft_consensus.cc:2749] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:40.909171 12036 consensus_queue.cc:1048] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.061s
I20260709 12:24:40.953001 12042 raft_consensus.cc:493] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:40.965533 12067 raft_consensus.cc:2749] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:40.998829 10894 leader_election.cc:304] T c63ecfc9bd3945818cfe15c03f001315 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:40.988240 12042 raft_consensus.cc:3060] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:40.985338 11621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352aa49c65194abbb863d7553a091f11" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:24:41.004630 10894 leader_election.cc:304] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:40.977170 12204 raft_consensus.cc:515] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:41.008599 10894 leader_election.cc:304] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:41.009696 10894 leader_election.cc:304] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:40.995641 12093 raft_consensus.cc:2749] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:41.008183 12112 raft_consensus.cc:2804] T c63ecfc9bd3945818cfe15c03f001315 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:41.010272 12000 raft_consensus.cc:2804] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:41.022670 12162 raft_consensus.cc:2764] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:24:41.036170 12000 raft_consensus.cc:697] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:41.040527 12000 consensus_queue.cc:237] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:41.042814 10922 raft_consensus.cc:2468] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 3.
I20260709 12:24:41.044631 10819 leader_election.cc:304] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
W20260709 12:24:41.059616 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 178662us
I20260709 12:24:41.061086 10968 leader_election.cc:304] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:41.059819 10894 leader_election.cc:304] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:24:41.039179 12239 log.cc:927] Time spent T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 12:24:41.064333 10922 raft_consensus.cc:1275] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:41.033586 12112 raft_consensus.cc:697] T c63ecfc9bd3945818cfe15c03f001315 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:41.067906 12112 consensus_queue.cc:237] T c63ecfc9bd3945818cfe15c03f001315 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:41.072512 12204 leader_election.cc:290] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:41.073495 12068 raft_consensus.cc:2749] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:41.074766 12201 consensus_queue.cc:1048] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:41.077677 12110 raft_consensus.cc:515] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:41.080000 10968 leader_election.cc:304] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:41.082435 10968 leader_election.cc:304] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:41.038935 12081 raft_consensus.cc:515] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:41.044216 12145 raft_consensus.cc:2749] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:41.043478 12120 raft_consensus.cc:515] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:41.086585 12195 raft_consensus.cc:2749] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:41.086795 12014 raft_consensus.cc:2749] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:24:41.087431 12245 log.cc:927] Time spent T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:24:41.082512 12108 raft_consensus.cc:2749] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:24:41.089610 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:41.132478 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:41.133286 10927 raft_consensus.cc:2368] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 2. Current term is 3.
I20260709 12:24:41.140357 10819 leader_election.cc:400] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 election: Vote denied by peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339) with higher term. Message: Invalid argument: T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 2. Current term is 3.
I20260709 12:24:41.140825 10819 leader_election.cc:403] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:24:41.152047 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab816bcc6183447994a2cc013e46c5f8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:41.139007 10895 leader_election.cc:304] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:41.158214 10895 leader_election.cc:304] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:24:41.061064 12036 raft_consensus.cc:2804] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:41.165094 12036 raft_consensus.cc:697] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 3 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:41.166072 12036 consensus_queue.cc:237] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:41.126077 12076 raft_consensus.cc:515] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:41.168320 12164 raft_consensus.cc:2804] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:41.168833 12164 raft_consensus.cc:697] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:41.169828 12076 leader_election.cc:290] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 4 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:41.169695 12164 consensus_queue.cc:237] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:41.173219 10895 leader_election.cc:304] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:24:41.174865 10895 leader_election.cc:304] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:41.117353 12162 consensus_queue.cc:1048] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:24:41.124027 12081 leader_election.cc:290] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:41.126181 12110 leader_election.cc:290] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:24:41.126767 12246 log.cc:927] Time spent T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 12:24:41.102466 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c913e527ff46578e084c41eab7bb9d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:41.110016 11944 raft_consensus.cc:515] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:41.160701 12250 raft_consensus.cc:2804] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:41.160068 10995 raft_consensus.cc:1275] T dad6a1da21304fcfacab384a6afc4101 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:24:41.194633 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 65273.2us
I20260709 12:24:41.162577 12212 raft_consensus.cc:3060] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:41.093355 10968 leader_election.cc:400] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 election: Vote denied by peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265) with higher term. Message: Invalid argument: T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for earlier term 2. Current term is 3.
W20260709 12:24:41.199272 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 106075us
I20260709 12:24:41.179909 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:41.185956 10999 raft_consensus.cc:1275] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:41.193375 11000 raft_consensus.cc:1275] T 69fd8fdac2fa449e9e184f3d668ea1a7 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:41.180518 12019 raft_consensus.cc:2804] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:41.196918 12067 raft_consensus.cc:2804] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:41.176653 10923 raft_consensus.cc:2468] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 3.
I20260709 12:24:41.199512 12042 raft_consensus.cc:515] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:41.207913 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d9a61ecaf84695b70f8519ee57706f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:41.208673 11002 raft_consensus.cc:2368] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 2. Current term is 3.
I20260709 12:24:41.201172 10968 leader_election.cc:400] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 election: Vote denied by peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265) with higher term. Message: Invalid argument: T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for earlier term 4. Current term is 5.
I20260709 12:24:41.210167 10968 leader_election.cc:400] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 election: Vote denied by peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265) with higher term. Message: Invalid argument: T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for earlier term 2. Current term is 3.
I20260709 12:24:41.210964 10968 leader_election.cc:304] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:41.201973 11001 raft_consensus.cc:2410] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:24:41.213223 11003 raft_consensus.cc:1275] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:41.213423 10968 leader_election.cc:304] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:41.207401 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5794ba618e514e28a7542ab6af39d8c9" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:41.214514 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:41.215505 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:41.215930 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:41.216753 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352aa49c65194abbb863d7553a091f11" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:41.211504 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:41.217778 10995 raft_consensus.cc:2393] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 5: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:24:41.174794 12120 leader_election.cc:290] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:41.224273 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c6d38c4d8a90a81975a6a0cb13" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:41.225399 10968 leader_election.cc:400] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 election: Vote denied by peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265) with higher term. Message: Invalid argument: T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for earlier term 4. Current term is 5.
I20260709 12:24:41.226290 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:41.243009 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c6d38c4d8a90a81975a6a0cb13" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:41.234428 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:41.253822 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:41.255113 10997 raft_consensus.cc:2393] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 3: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:24:41.253707 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:41.255759 11001 raft_consensus.cc:3060] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:24:41.253296 10968 leader_election.cc:403] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:24:41.258414 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:41.259145 10997 raft_consensus.cc:2468] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 5.
I20260709 12:24:41.260316 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:41.261188 10997 raft_consensus.cc:2393] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 3: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:24:41.262494 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c913e527ff46578e084c41eab7bb9d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:41.257303 11003 raft_consensus.cc:3060] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:41.268863 12120 raft_consensus.cc:2749] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265) with higher term. Message: Invalid argument: T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for earlier term 4. Current term is 5.
I20260709 12:24:41.205763 11944 leader_election.cc:290] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:41.206862 12005 leader_election.cc:290] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:41.249948 12195 raft_consensus.cc:2749] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:41.272327 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5794ba618e514e28a7542ab6af39d8c9" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:41.291776 10848 raft_consensus.cc:3060] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:41.234289 12156 raft_consensus.cc:2749] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:41.293751 10995 raft_consensus.cc:2468] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 4.
I20260709 12:24:41.277428 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac83709373b4efd9c3aa1472a9f9022" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:41.279078 11002 raft_consensus.cc:1275] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:41.255177 11955 raft_consensus.cc:3060] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:41.226954 12130 raft_consensus.cc:493] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.272688 10968 leader_election.cc:400] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265) with higher term. Message: Invalid argument: T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for earlier term 2. Current term is 3.
I20260709 12:24:41.358376 10968 leader_election.cc:403] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:24:41.359583 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 87015.7us
I20260709 12:24:41.361153 10968 leader_election.cc:400] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265) with higher term. Message: Invalid argument: T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for earlier term 4. Current term is 5.
I20260709 12:24:41.254487 12108 raft_consensus.cc:493] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:41.248840 12035 raft_consensus.cc:493] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:41.301779 10820 leader_election.cc:400] T e3d9a61ecaf84695b70f8519ee57706f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Vote denied by peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945) with higher term. Message: Invalid argument: T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 2. Current term is 3.
I20260709 12:24:41.257936 12068 raft_consensus.cc:493] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:41.258463 11882 raft_consensus.cc:493] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:41.257745 12019 raft_consensus.cc:697] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:41.307253 11001 raft_consensus.cc:2468] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 3.
I20260709 12:24:41.273442 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:41.264541 12250 raft_consensus.cc:697] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:41.271627 12176 raft_consensus.cc:493] T 18294423a68a4671bf6c5a0f98645e4c P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:41.280391 12016 consensus_queue.cc:1048] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 12:24:41.307848 12042 leader_election.cc:290] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:41.329936 12212 raft_consensus.cc:2749] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339) with higher term. Message: Invalid argument: T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 2. Current term is 3.
I20260709 12:24:41.311702 12140 raft_consensus.cc:493] T dad6a1da21304fcfacab384a6afc4101 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.305435 12120 raft_consensus.cc:493] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:41.331753 12185 leader_election.cc:290] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:41.351293 11003 raft_consensus.cc:2468] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 3.
W20260709 12:24:41.369987 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 71950.1us
I20260709 12:24:41.410499 10848 raft_consensus.cc:2468] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 4.
I20260709 12:24:41.371624 12195 raft_consensus.cc:2749] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265) with higher term. Message: Invalid argument: T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for earlier term 2. Current term is 3.
I20260709 12:24:41.428176 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:41.429257 10994 raft_consensus.cc:2368] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 2. Current term is 3.
I20260709 12:24:41.430837 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:41.431892 11003 raft_consensus.cc:2393] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 3: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:24:41.376468 12156 consensus_queue.cc:1048] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:24:41.371934 12108 raft_consensus.cc:515] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:41.445228 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 192638us
I20260709 12:24:41.377141 12035 raft_consensus.cc:515] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:41.386632 12068 raft_consensus.cc:515] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:41.445947 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:41.457942 11003 raft_consensus.cc:3060] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:41.368494 12130 raft_consensus.cc:515] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:41.387231 11882 raft_consensus.cc:515] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:41.460978 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:41.414263 12176 raft_consensus.cc:515] T 18294423a68a4671bf6c5a0f98645e4c P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:41.465669 10994 raft_consensus.cc:2393] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 5: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:24:41.419901 12140 raft_consensus.cc:515] T dad6a1da21304fcfacab384a6afc4101 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:41.430668 12185 consensus_queue.cc:1048] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:24:41.426477 12120 raft_consensus.cc:515] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:41.473192 10999 raft_consensus.cc:2468] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 4.
W20260709 12:24:41.476027 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 280108us
I20260709 12:24:41.436105 11588 leader_election.cc:304] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:41.483795 10994 raft_consensus.cc:1240] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:41.478371 10894 leader_election.cc:304] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:24:41.499763 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 136495us
I20260709 12:24:41.468737 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:41.477545 12067 raft_consensus.cc:697] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:41.522938 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:24:41.524855 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 46605.5us
I20260709 12:24:41.527347 11003 raft_consensus.cc:2468] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 5.
I20260709 12:24:41.543483 10994 raft_consensus.cc:1275] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:41.542141 10819 leader_election.cc:304] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:41.464608 12019 consensus_queue.cc:237] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:41.540722 12042 raft_consensus.cc:2749] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:41.556046 10998 raft_consensus.cc:1275] T 3f8a389131ef4c77a3e08488aa4759eb P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:41.525465 12133 raft_consensus.cc:2804] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:24:41.526616 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 90692.8us
I20260709 12:24:41.551729 12206 raft_consensus.cc:2804] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:41.566156 12067 consensus_queue.cc:237] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:41.479255 12250 consensus_queue.cc:237] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:41.591379 12258 log.cc:927] Time spent T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
W20260709 12:24:41.591125 12264 log.cc:927] Time spent T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
W20260709 12:24:41.622363 12257 log.cc:927] Time spent T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
W20260709 12:24:41.640918 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 75803.4us
W20260709 12:24:41.673401 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 89283.3us
I20260709 12:24:41.670575 10894 leader_election.cc:304] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:41.620451 12206 raft_consensus.cc:697] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040 [term 3 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:41.670014 12035 leader_election.cc:290] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:24:41.680917 12256 log.cc:927] Time spent T c63ecfc9bd3945818cfe15c03f001315 P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.250s	user 0.001s	sys 0.003s
I20260709 12:24:41.672773 12038 raft_consensus.cc:493] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.682993 12108 leader_election.cc:290] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:41.702333 11882 leader_election.cc:290] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:24:41.726245 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 54769.1us
W20260709 12:24:41.740428 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 43671.9us
I20260709 12:24:41.709034 12042 raft_consensus.cc:2804] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:41.709532 12140 leader_election.cc:290] T dad6a1da21304fcfacab384a6afc4101 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:41.678615 12266 consensus_queue.cc:1048] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.059s
W20260709 12:24:41.729571 12238 log.cc:927] Time spent T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.766s	user 0.004s	sys 0.003s
I20260709 12:24:41.712479 12176 leader_election.cc:290] T 18294423a68a4671bf6c5a0f98645e4c P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:41.750744 10894 leader_election.cc:304] T ab816bcc6183447994a2cc013e46c5f8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:41.729378 12275 raft_consensus.cc:493] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.746170 12042 raft_consensus.cc:493] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:41.730399 12120 leader_election.cc:290] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:41.715180 12038 raft_consensus.cc:515] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:41.736189 12269 consensus_queue.cc:1048] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:24:41.747097 12108 raft_consensus.cc:493] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.748560 11882 raft_consensus.cc:493] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:41.768663 12260 log.cc:927] Time spent T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.226s	user 0.001s	sys 0.001s
I20260709 12:24:41.765151 12206 consensus_queue.cc:237] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:41.769652 11944 consensus_queue.cc:1048] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:24:41.770460 12274 log.cc:927] Time spent T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
W20260709 12:24:41.771116 12259 log.cc:927] Time spent T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
W20260709 12:24:41.771826 12265 log.cc:927] Time spent T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260709 12:24:41.764246 12275 raft_consensus.cc:515] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:41.784224 10895 leader_election.cc:304] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:41.752655 12156 raft_consensus.cc:493] T 69fd8fdac2fa449e9e184f3d668ea1a7 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.805759 12156 raft_consensus.cc:515] T 69fd8fdac2fa449e9e184f3d668ea1a7 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:41.790416 11882 raft_consensus.cc:515] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:41.807997 11882 leader_election.cc:290] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:24:41.786722 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 161752us
I20260709 12:24:41.739724 12000 consensus_queue.cc:1048] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
W20260709 12:24:41.771003 12268 log.cc:927] Time spent T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.178s	user 0.000s	sys 0.000s
I20260709 12:24:41.764716 12042 raft_consensus.cc:3060] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:41.757762 12133 raft_consensus.cc:697] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d [term 4 LEADER]: Becoming Leader. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
I20260709 12:24:41.788277 12269 raft_consensus.cc:2749] T ab816bcc6183447994a2cc013e46c5f8 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:41.787034 12176 raft_consensus.cc:493] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:41.811398 10968 leader_election.cc:304] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:41.788491 12108 raft_consensus.cc:515] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:41.817975 10895 leader_election.cc:304] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:41.826694 11000 raft_consensus.cc:1275] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:41.816377 12000 raft_consensus.cc:2749] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:41.833817 12176 raft_consensus.cc:515] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:41.834915 12275 leader_election.cc:290] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:41.808025 12156 leader_election.cc:290] T 69fd8fdac2fa449e9e184f3d668ea1a7 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:41.840379 10895 leader_election.cc:304] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:41.843374 12277 raft_consensus.cc:2804] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:41.836316 11882 raft_consensus.cc:2749] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:41.847182 12176 leader_election.cc:290] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:41.851712 12277 raft_consensus.cc:697] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:41.851946 12014 raft_consensus.cc:2804] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:41.851723 12038 leader_election.cc:290] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:24:41.852816 12277 consensus_queue.cc:237] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:41.853680 12133 consensus_queue.cc:237] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:41.859020 12108 leader_election.cc:290] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:41.860697 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:41.861402 11001 raft_consensus.cc:3060] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:41.861840 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:41.863610 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:41.865935 10925 raft_consensus.cc:1275] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:41.872000 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:41.872670 10928 raft_consensus.cc:2468] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 3.
I20260709 12:24:41.868506 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:41.874730 10929 raft_consensus.cc:2468] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 1.
I20260709 12:24:41.877974 10968 leader_election.cc:304] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:41.879735 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:41.867864 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:41.871097 11001 raft_consensus.cc:2468] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 5.
I20260709 12:24:41.882121 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6a1da21304fcfacab384a6afc4101" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:41.869210 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:41.883395 10895 leader_election.cc:304] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:41.878716 12271 raft_consensus.cc:493] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:41.867201 12014 raft_consensus.cc:697] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:41.881037 12140 raft_consensus.cc:2749] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:41.923786 10920 raft_consensus.cc:1240] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:41.923840 10928 raft_consensus.cc:1275] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:24:41.928261 10928 raft_consensus.cc:1275] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 12:24:41.928673 10928 pending_rounds.cc:85] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea: Aborting all ops after (but not including) 4
I20260709 12:24:41.928570 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:41.928992 10928 pending_rounds.cc:107] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:24:41.929261 10928 raft_consensus.cc:2889] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:41.930512 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18294423a68a4671bf6c5a0f98645e4c" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:41.931135 11001 raft_consensus.cc:1275] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:41.931463 10925 raft_consensus.cc:1275] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:24:41.933002 12019 raft_consensus.cc:2804] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:41.933952 12019 raft_consensus.cc:697] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:41.916721 12271 raft_consensus.cc:515] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:41.899171 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:41.937012 12271 leader_election.cc:290] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:41.935230 12019 consensus_queue.cc:237] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:41.938760 10924 raft_consensus.cc:2468] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 2.
I20260709 12:24:41.897805 11621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac8522e549a46e09593fa4c2e175557" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:24:41.955149 11621 raft_consensus.cc:2468] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 3.
I20260709 12:24:41.949318 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:41.958784 12130 leader_election.cc:290] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:41.950773 10752 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36188 (request call id 37) took 1942 ms. Trace:
I20260709 12:24:41.961189 10926 raft_consensus.cc:1275] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:41.961624 12068 leader_election.cc:290] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:41.963055 10895 leader_election.cc:304] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:41.953411 12014 consensus_queue.cc:237] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:41.891326 12108 consensus_queue.cc:1048] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.063s
I20260709 12:24:41.959889 10752 rpcz_store.cc:276] 0709 12:24:40.007977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:40.008250 (+   273us) service_pool.cc:224] Handling call
0709 12:24:40.604122 (+595872us) spinlock_profiling.cc:243] Waited 535 ms on lock 0x7b540007b554. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df2090 00007f7594e90f3a 00007f759ac46e9c 00007f759ad4504e 00007f75992062a4 00007f7599206232 00007f7599206161 00007f75992060dc 00007f7599205392 00007f75931c348c 00007f75931c28c6
0709 12:24:41.950660 (+1346538us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:40.951223 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:41.019683 (+ 68460us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:41.022180 (+  2497us) write_op.cc:435] Acquired schema lock
0709 12:24:41.022205 (+    25us) tablet.cc:662] Decoding operations
0709 12:24:41.085392 (+ 63187us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:41.092680 (+  7288us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:41.096663 (+  3983us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:24:41.127637 (+ 30974us) tablet.cc:701] Row locks acquired
0709 12:24:41.127653 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:24:41.127831 (+   178us) write_op.cc:270] Start()
0709 12:24:41.127961 (+   130us) write_op.cc:276] Timestamp: P: 1783599881127786 usec, L: 0
0709 12:24:41.127983 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:24:41.160004 (+ 32021us) log.cc:844] Serialized 974 byte log entry
0709 12:24:41.161758 (+  1754us) op_driver.cc:464] REPLICATION: finished
0709 12:24:41.162612 (+   854us) write_op.cc:301] APPLY: starting
0709 12:24:41.162701 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:41.162838 (+   137us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:41.162948 (+   110us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:41.163270 (+   322us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:41.163424 (+   154us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:24:41.163479 (+    55us) write_op.cc:312] APPLY: finished
0709 12:24:41.182904 (+ 19425us) log.cc:844] Serialized 28 byte log entry
0709 12:24:41.199723 (+ 16819us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:41.199810 (+    87us) write_op.cc:454] Released schema lock
0709 12:24:41.199848 (+    38us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":2,"spinlock_wait_cycles":1229811968,"child_traces":[["op",{"apply.queue_time_us":612,"apply.run_cpu_time_us":2272,"apply.run_wall_time_us":37890,"num_ops":2,"prepare.queue_time_us":715,"prepare.run_cpu_time_us":5292,"prepare.run_wall_time_us":216602,"replication_time_us":33617,"thread_start_us":243433,"threads_started":1}]]}
I20260709 12:24:41.880602 10968 leader_election.cc:304] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
W20260709 12:24:41.977013 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 96472.4us
I20260709 12:24:41.978360 10968 leader_election.cc:304] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:41.984400 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c6d38c4d8a90a81975a6a0cb13" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:41.988899 11624 raft_consensus.cc:1240] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d [term 4 LEADER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:41.991662 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad766f48812a4ddeb383179b1d84907b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:41.989423 10920 raft_consensus.cc:2468] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 4.
I20260709 12:24:42.001995 10968 leader_election.cc:304] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:42.005988 11882 raft_consensus.cc:493] T 3f8a389131ef4c77a3e08488aa4759eb P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.983422 12250 consensus_queue.cc:1048] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:24:42.006768 11882 raft_consensus.cc:515] T 3f8a389131ef4c77a3e08488aa4759eb P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:42.007696 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fd8fdac2fa449e9e184f3d668ea1a7" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:41.982406 12199 raft_consensus.cc:493] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:42.008929 12199 raft_consensus.cc:515] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:42.009382 11882 leader_election.cc:290] T 3f8a389131ef4c77a3e08488aa4759eb P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:42.011446 10996 raft_consensus.cc:1275] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:41.982029 12205 raft_consensus.cc:493] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:42.012679 12205 raft_consensus.cc:515] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:42.014324 10751 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60736 (request call id 152) took 4077 ms. Trace:
I20260709 12:24:41.986128 12195 raft_consensus.cc:2804] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:41.988682 12253 raft_consensus.cc:2804] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:41.996249 12176 raft_consensus.cc:493] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:41.985925 12156 raft_consensus.cc:2804] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:42.016388 12253 raft_consensus.cc:493] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:42.032323 12253 raft_consensus.cc:3060] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:42.016848 12176 raft_consensus.cc:515] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } }
I20260709 12:24:42.017935 12156 raft_consensus.cc:493] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:42.039295 12156 raft_consensus.cc:3060] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:42.039532 12042 raft_consensus.cc:515] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:42.040576 10921 raft_consensus.cc:1240] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:42.016016 12195 raft_consensus.cc:493] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:42.042906 12195 raft_consensus.cc:3060] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:42.046281 10927 raft_consensus.cc:1240] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:42.050261 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:42.037982 12176 leader_election.cc:290] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:42.052557 10994 raft_consensus.cc:1275] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:24:42.054975 10994 pending_rounds.cc:85] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08: Aborting all ops after (but not including) 1
I20260709 12:24:42.055328 10994 pending_rounds.cc:107] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:24:42.055617 10994 raft_consensus.cc:2889] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:42.026729 11882 raft_consensus.cc:2804] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:42.015547 12205 leader_election.cc:290] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:42.014736 10751 rpcz_store.cc:276] 0709 12:24:37.937106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:37.940609 (+  3503us) service_pool.cc:224] Handling call
0709 12:24:42.014245 (+4073636us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:39.661345 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:39.662121 (+   776us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:39.662173 (+    52us) write_op.cc:435] Acquired schema lock
0709 12:24:39.662200 (+    27us) tablet.cc:662] Decoding operations
0709 12:24:39.662967 (+   767us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:39.663103 (+   136us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:39.663147 (+    44us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:24:39.663694 (+   547us) tablet.cc:701] Row locks acquired
0709 12:24:39.663721 (+    27us) write_op.cc:260] PREPARE: finished
0709 12:24:39.663886 (+   165us) write_op.cc:270] Start()
0709 12:24:39.664040 (+   154us) write_op.cc:276] Timestamp: P: 1783599879663839 usec, L: 0
0709 12:24:39.664069 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 12:24:39.666235 (+  2166us) log.cc:844] Serialized 1307 byte log entry
0709 12:24:40.449340 (+783105us) spinlock_profiling.cc:243] Waited 1.2 ms on lock 0x7b4400022b4c. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7591c23db1 00007f7591cc1c85 00007f7591cc26a2 00007f7594a341db 00007f7594a2faaf 00007f7591d7e0ac 00007f759abd89a9 00007f7591d9a69b 00007f7591d9893f 00007f7591d9ac02 00007f7594a2220b
0709 12:24:40.924157 (+474817us) op_driver.cc:464] REPLICATION: finished
0709 12:24:41.021970 (+ 97813us) write_op.cc:301] APPLY: starting
0709 12:24:41.022069 (+    99us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:41.033076 (+ 11007us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:41.035198 (+  2122us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:41.132245 (+ 97047us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:41.161117 (+ 28872us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:24:41.161167 (+    50us) write_op.cc:312] APPLY: finished
0709 12:24:41.161418 (+   251us) log.cc:844] Serialized 34 byte log entry
0709 12:24:41.161595 (+   177us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:41.161681 (+    86us) write_op.cc:454] Released schema lock
0709 12:24:41.161736 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:41.162110 (+   374us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:41.162155 (+    45us) write_op.cc:454] Released schema lock
0709 12:24:41.411205 (+249050us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:41.411257 (+    52us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1568486,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":74907,"apply.run_cpu_time_us":3076,"apply.run_wall_time_us":140155,"num_ops":3,"prepare.queue_time_us":158679,"prepare.run_cpu_time_us":33165,"prepare.run_wall_time_us":878890,"raft.queue_time_us":43359,"raft.run_cpu_time_us":45145,"raft.run_wall_time_us":415342,"replication_time_us":1227151,"spinlock_wait_cycles":4524672,"thread_start_us":1045927,"threads_started":4,"wal-append.queue_time_us":939446}]]}
I20260709 12:24:42.057600 11882 raft_consensus.cc:493] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:42.072309 12199 leader_election.cc:290] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:42.083472 11882 raft_consensus.cc:3060] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:42.074764 12042 leader_election.cc:290] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:42.057772 12185 consensus_queue.cc:1059] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:24:42.078354 12205 raft_consensus.cc:493] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.154757 12185 consensus_queue.cc:1059] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:42.155763 12185 raft_consensus.cc:3055] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:42.156095 12185 raft_consensus.cc:740] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:42.156984 12185 consensus_queue.cc:260] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:42.158669 12185 raft_consensus.cc:3060] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:42.124109 12205 raft_consensus.cc:515] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:42.161986 12205 leader_election.cc:290] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:42.180204 10820 leader_election.cc:304] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:42.182036 10820 leader_election.cc:304] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:42.182319 12206 raft_consensus.cc:2749] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:42.183441 12176 raft_consensus.cc:2749] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:42.185855 10820 leader_election.cc:304] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:42.188498 10820 leader_election.cc:304] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:42.159551 12156 raft_consensus.cc:515] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:42.193555 10820 leader_election.cc:304] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:42.193392 12205 raft_consensus.cc:2749] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:42.194543 12206 raft_consensus.cc:2749] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:42.195955 10820 leader_election.cc:304] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:42.196946 12206 raft_consensus.cc:2749] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:42.198197 10820 leader_election.cc:304] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:42.188328 12176 raft_consensus.cc:2749] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:42.198925 12206 raft_consensus.cc:2804] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:42.199337 12206 raft_consensus.cc:493] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:42.199795 12206 raft_consensus.cc:3060] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:42.174500 11882 raft_consensus.cc:515] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:42.189009 12185 raft_consensus.cc:493] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.208602 12195 raft_consensus.cc:515] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:42.209088 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c6d38c4d8a90a81975a6a0cb13" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:42.209813 10927 raft_consensus.cc:3060] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:42.209124 12185 raft_consensus.cc:515] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:42.212492 12185 leader_election.cc:290] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:42.202956 10820 leader_election.cc:304] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:42.213666 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:42.214744 12176 raft_consensus.cc:2749] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:42.214466 10820 leader_election.cc:304] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:42.221328 10927 raft_consensus.cc:2468] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 5.
I20260709 12:24:42.223851 10968 leader_election.cc:304] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:42.231961 12185 raft_consensus.cc:2804] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:42.238788 12185 raft_consensus.cc:697] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:42.239281 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:42.241003 10920 raft_consensus.cc:3060] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:42.241253 12185 consensus_queue.cc:237] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:42.215612 11882 leader_election.cc:290] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:42.245136 12195 leader_election.cc:290] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:42.238191 12156 leader_election.cc:290] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:24:42.193284 12164 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.838s	user 0.015s	sys 0.011s
I20260709 12:24:42.249506 10820 leader_election.cc:304] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:42.236333 12253 raft_consensus.cc:515] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:42.261548 10997 raft_consensus.cc:1275] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:42.261932 10920 raft_consensus.cc:2468] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 4.
I20260709 12:24:42.263844 10820 leader_election.cc:304] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:42.265007 10820 leader_election.cc:400] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 election: Vote denied by peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945) with higher term. Message: Invalid argument: T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 2. Current term is 3.
I20260709 12:24:42.265769 10820 leader_election.cc:304] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:42.266821 10820 leader_election.cc:304] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:42.267925 10820 leader_election.cc:304] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:42.261548 12026 raft_consensus.cc:2749] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:42.277549 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
W20260709 12:24:42.248673 12164 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.896s	user 0.016s	sys 0.012s
I20260709 12:24:42.275110 12204 raft_consensus.cc:2749] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:42.284377 12253 leader_election.cc:290] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:24:42.280438 12199 raft_consensus.cc:2749] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:42.288033 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:42.280320 12035 raft_consensus.cc:2749] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:42.241509 12206 raft_consensus.cc:515] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:42.289683 11001 raft_consensus.cc:1275] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:24:42.295960 12026 consensus_queue.cc:1059] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:42.280012 12205 raft_consensus.cc:2804] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:42.309098 12280 consensus_queue.cc:1048] T c63ecfc9bd3945818cfe15c03f001315 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:42.313877 12206 leader_election.cc:290] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:42.268172 12305 raft_consensus.cc:2749] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:24:42.308164 10803 thread.cc:641] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.020s	sys 0.032s
I20260709 12:24:42.330865 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:42.279238 12176 consensus_queue.cc:1048] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 12:24:42.333755 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:42.333907 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:42.335320 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:42.339682 10920 raft_consensus.cc:2393] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 5: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:24:42.333178 10847 raft_consensus.cc:1275] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:24:42.334540 10803 thread.cc:608] client-negotiator [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.020s	sys 0.032s
I20260709 12:24:42.317958 12199 raft_consensus.cc:3055] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:24:42.354705 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 85718.5us
I20260709 12:24:42.356074 10820 leader_election.cc:304] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:42.304437 12277 consensus_queue.cc:1048] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 12:24:42.335808 12278 raft_consensus.cc:493] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.331562 12195 raft_consensus.cc:493] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.367332 10752 catalog_manager.cc:5697] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: term changed from 1 to 4, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68). New cstate: current_term: 4 leader_uuid: "3c52e0825c02476e89d84da9bb849f5d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:42.369490 10968 leader_election.cc:304] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:42.334833 12035 raft_consensus.cc:493] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:42.375255 10998 raft_consensus.cc:1275] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:42.383529 10968 leader_election.cc:304] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:42.342724 12016 raft_consensus.cc:493] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.377257 11002 raft_consensus.cc:2468] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 6.
I20260709 12:24:42.350666 12206 raft_consensus.cc:493] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:42.359990 12199 raft_consensus.cc:740] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:42.405822 10927 raft_consensus.cc:1275] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:42.390792 11882 raft_consensus.cc:2804] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:42.390407 12156 raft_consensus.cc:2804] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:42.382180 12035 raft_consensus.cc:515] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:42.420785 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 86461.8us
I20260709 12:24:42.430577 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac8522e549a46e09593fa4c2e175557" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:24:42.431550 11624 raft_consensus.cc:3060] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:42.382947 12278 raft_consensus.cc:515] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:42.385310 12120 consensus_queue.cc:1059] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:24:42.386392 12195 raft_consensus.cc:515] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:42.390698 12110 consensus_queue.cc:1048] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:24:42.399750 12289 consensus_queue.cc:1048] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:24:42.396792 12016 raft_consensus.cc:515] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:42.401225 12206 raft_consensus.cc:515] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:42.424642 12156 raft_consensus.cc:493] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:42.426574 12312 raft_consensus.cc:2749] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:42.457625 11624 raft_consensus.cc:2468] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 4.
I20260709 12:24:42.430855 11882 raft_consensus.cc:697] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:42.469657 12278 leader_election.cc:290] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:42.448167 12120 consensus_queue.cc:1243] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer 3c52e0825c02476e89d84da9bb849f5d log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:24:42.473261 12016 leader_election.cc:290] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:42.476500 11003 raft_consensus.cc:3055] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:42.480016 12195 leader_election.cc:290] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:42.480711 11003 raft_consensus.cc:740] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:42.481583 11882 consensus_queue.cc:237] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:42.482285 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:42.485610 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63ecfc9bd3945818cfe15c03f001315" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:42.486289 12035 leader_election.cc:290] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:42.478952 10929 raft_consensus.cc:1240] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:24:42.461330 12156 raft_consensus.cc:3060] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:42.428083 12204 consensus_queue.cc:1048] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 12:24:42.481567 11003 consensus_queue.cc:260] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:42.446025 12199 consensus_queue.cc:260] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:42.500403 12199 raft_consensus.cc:3060] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:42.501788 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:42.505734 12206 leader_election.cc:290] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:42.518066 11001 raft_consensus.cc:1275] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:24:42.506697 11003 raft_consensus.cc:3060] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:42.506861 12108 raft_consensus.cc:3055] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:42.554106 10895 leader_election.cc:304] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:42.459903 12205 raft_consensus.cc:697] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:42.538285 12108 raft_consensus.cc:740] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:42.557101 10895 leader_election.cc:304] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
W20260709 12:24:42.569782 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 211684us
I20260709 12:24:42.585636 10998 raft_consensus.cc:1275] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:24:42.586190 10998 pending_rounds.cc:85] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08: Aborting all ops after (but not including) 1
I20260709 12:24:42.586481 10998 pending_rounds.cc:107] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:24:42.550777 12289 raft_consensus.cc:493] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:42.562899 12038 raft_consensus.cc:2804] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:42.588052 10994 raft_consensus.cc:1275] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:42.590817 11003 raft_consensus.cc:1275] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:42.586757 10998 raft_consensus.cc:2889] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:24:42.601974 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 49138.8us
I20260709 12:24:42.582320 12270 raft_consensus.cc:2804] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:42.559883 12000 consensus_queue.cc:1048] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 12:24:42.566038 12312 consensus_queue.cc:1048] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:24:42.556156 12305 consensus_queue.cc:1048] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 12:24:42.616566 12133 consensus_queue.cc:1048] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:42.561928 12317 consensus_queue.cc:1059] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.045s
W20260709 12:24:42.620345 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 46852.9us
W20260709 12:24:42.623490 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:42.618031 12205 consensus_queue.cc:237] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:42.632514 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 48637.3us
W20260709 12:24:42.611086 12288 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 12:24:42.511628 12315 raft_consensus.cc:2955] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 3 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:24:42.622841 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:42.621963 12108 consensus_queue.cc:260] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:42.602232 12289 raft_consensus.cc:515] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:42.629884 12035 consensus_queue.cc:1048] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:24:42.650162 10820 leader_election.cc:304] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:42.640354 12016 raft_consensus.cc:493] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.640251 12270 raft_consensus.cc:697] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:42.644990 12093 raft_consensus.cc:493] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:42.657382 12206 raft_consensus.cc:3055] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:42.648511 10922 raft_consensus.cc:2468] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 5.
I20260709 12:24:42.638629 12005 consensus_queue.cc:1048] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 12:24:42.639178 12321 consensus_queue.cc:1048] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:24:42.671905 12156 raft_consensus.cc:515] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:42.676115 12328 raft_consensus.cc:2804] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:42.694224 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18294423a68a4671bf6c5a0f98645e4c" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:42.679872 12067 consensus_queue.cc:1048] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:24:42.680603 12323 log.cc:927] Time spent T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:24:42.672727 12206 raft_consensus.cc:740] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:42.681560 12176 raft_consensus.cc:493] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:42.690819 12042 consensus_queue.cc:1048] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:42.691128 12204 consensus_queue.cc:1048] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:42.692484 12156 leader_election.cc:290] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:42.692834 12289 leader_election.cc:290] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:42.646674 12195 consensus_queue.cc:1059] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:24:42.653790 12038 raft_consensus.cc:697] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:42.667030 12016 raft_consensus.cc:515] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:42.700758 12328 raft_consensus.cc:493] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:42.701085 10998 raft_consensus.cc:1275] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:24:42.698633 10968 leader_election.cc:304] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:42.725899 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:42.726593 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:42.760636 10997 raft_consensus.cc:2468] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 3.
I20260709 12:24:42.736236 11624 raft_consensus.cc:1240] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:42.761772 12305 raft_consensus.cc:493] T e3d9a61ecaf84695b70f8519ee57706f P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.732578 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d9a61ecaf84695b70f8519ee57706f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:42.762338 12305 raft_consensus.cc:515] T e3d9a61ecaf84695b70f8519ee57706f P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:42.765059 12305 leader_election.cc:290] T e3d9a61ecaf84695b70f8519ee57706f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:42.723066 12140 raft_consensus.cc:493] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
W20260709 12:24:42.768723 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 165395us
I20260709 12:24:42.689097 12093 raft_consensus.cc:515] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:24:42.789819 12093 leader_election.cc:290] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:24:42.791256 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 92689.1us
I20260709 12:24:42.776671 12038 consensus_queue.cc:237] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:42.777510 11002 raft_consensus.cc:1275] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:24:42.781886 12330 log.cc:927] Time spent T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.054s	user 0.000s	sys 0.003s
I20260709 12:24:42.724689 12176 raft_consensus.cc:515] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:42.752853 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:42.850667 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:42.881465 10994 raft_consensus.cc:2468] T 3f8a389131ef4c77a3e08488aa4759eb P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 3.
I20260709 12:24:42.767102 12328 raft_consensus.cc:3060] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:42.897132 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 78908.8us
I20260709 12:24:42.899835 10848 raft_consensus.cc:1275] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:42.904441 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:42.905298 10848 raft_consensus.cc:2410] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:24:42.905366 10847 raft_consensus.cc:1275] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:42.906162 10850 raft_consensus.cc:1275] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:24:42.909919 10820 consensus_peers.cc:597] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 -> Peer 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613): Couldn't send request to peer 3c52e0825c02476e89d84da9bb849f5d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3f8a389131ef4c77a3e08488aa4759eb. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:42.911018 10847 raft_consensus.cc:1240] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:42.827082 12120 raft_consensus.cc:2804] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:42.911504 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:42.912576 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:42.917009 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
W20260709 12:24:42.892261 12326 log.cc:927] Time spent T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 12:24:42.772255 12140 raft_consensus.cc:515] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:42.878350 12327 raft_consensus.cc:493] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:42.921233 10852 raft_consensus.cc:1275] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:24:42.822775 12026 raft_consensus.cc:493] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.818388 12205 consensus_queue.cc:1048] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.088s
I20260709 12:24:42.922106 12333 raft_consensus.cc:493] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:42.946151 12026 raft_consensus.cc:515] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:42.946417 12333 raft_consensus.cc:515] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:42.947990 10853 raft_consensus.cc:1275] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:42.948837 12333 leader_election.cc:290] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:42.916132 12120 raft_consensus.cc:493] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:42.949882 12120 raft_consensus.cc:3060] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:42.798545 12305 consensus_queue.cc:1048] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.109s
I20260709 12:24:42.907763 12035 raft_consensus.cc:493] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.952068 12035 raft_consensus.cc:515] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:42.934950 10895 leader_election.cc:304] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:42.955163 10895 leader_election.cc:304] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:42.934377 12206 consensus_queue.cc:260] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:42.935240 12000 consensus_queue.cc:1048] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:42.935353 12317 consensus_queue.cc:1059] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:42.936961 12042 raft_consensus.cc:493] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.937539 10921 raft_consensus.cc:1275] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:24:42.938714 12016 leader_election.cc:290] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:42.939316 12019 raft_consensus.cc:493] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:42.938637 10750 catalog_manager.cc:5697] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } }
I20260709 12:24:42.758667 12270 consensus_queue.cc:237] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:42.957988 10852 raft_consensus.cc:1275] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:42.959983 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac8522e549a46e09593fa4c2e175557" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
W20260709 12:24:43.315868 10968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:43.349915 10968 leader_election.cc:336] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Timed out: RequestConsensusVote RPC to 127.9.116.65:46265 timed out after 1.615s (SENT)
I20260709 12:24:43.350160 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:42.962330 10846 raft_consensus.cc:1275] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:42.995457 10850 raft_consensus.cc:2468] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 3.
I20260709 12:24:42.914667 12321 raft_consensus.cc:493] T e8b17195a94142039c40f598ed006c94 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:42.954269 12269 raft_consensus.cc:2804] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:24:43.315335 12339 log.cc:927] Time spent T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
W20260709 12:24:43.400362 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 489548us
I20260709 12:24:43.030606 12262 raft_consensus.cc:2804] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:43.340278 12325 raft_consensus.cc:493] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.405618 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:43.373317 10750 catalog_manager.cc:5697] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 1 to 2, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 2 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:43.410537 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:43.422108 12016 raft_consensus.cc:493] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:43.426795 12016 raft_consensus.cc:515] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:43.427242 12334 log.cc:927] Time spent T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
I20260709 12:24:43.414700 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:43.428567 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fd8fdac2fa449e9e184f3d668ea1a7" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:43.417526 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:43.417001 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6a1da21304fcfacab384a6afc4101" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:43.429522 12016 leader_election.cc:290] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:43.429883 10849 raft_consensus.cc:2468] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 3.
I20260709 12:24:43.430670 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:43.430966 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:43.432583 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:43.433634 10853 raft_consensus.cc:1240] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:24:43.434394 10849 raft_consensus.cc:1240] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040 [term 3 LEADER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:43.372047 12042 raft_consensus.cc:515] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:43.437354 10853 raft_consensus.cc:1275] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:43.437999 12042 leader_election.cc:290] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:43.023955 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:42.992559 12335 raft_consensus.cc:493] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.354667 12195 raft_consensus.cc:493] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:43.440191 12195 raft_consensus.cc:515] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:43.429540 10847 raft_consensus.cc:2468] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 4.
I20260709 12:24:43.318740 12108 raft_consensus.cc:3060] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:43.443856 12120 raft_consensus.cc:515] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:43.379706 12285 raft_consensus.cc:493] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.448208 12285 raft_consensus.cc:515] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:43.242265 12026 leader_election.cc:290] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:43.427254 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:43.449927 10850 raft_consensus.cc:2368] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for earlier term 2. Current term is 3.
I20260709 12:24:43.450620 12285 leader_election.cc:290] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:43.451006 12335 raft_consensus.cc:515] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:43.450582 10846 raft_consensus.cc:2468] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 4.
I20260709 12:24:43.452612 12262 raft_consensus.cc:493] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:43.453423 12262 raft_consensus.cc:3060] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:43.443126 12195 leader_election.cc:290] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:43.324331 12140 leader_election.cc:290] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:43.314175 12035 leader_election.cc:290] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:43.462342 10750 catalog_manager.cc:5697] T ab816bcc6183447994a2cc013e46c5f8 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 1 to 2, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 2 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } }
W20260709 12:24:43.401154 12280 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.011s	sys 0.042s
I20260709 12:24:43.464140 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:43.464023 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad766f48812a4ddeb383179b1d84907b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:43.466598 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c6d38c4d8a90a81975a6a0cb13" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
W20260709 12:24:43.467249 10818 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.038s	sys 0.047s
I20260709 12:24:43.469430 10750 catalog_manager.cc:5697] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 3 to 4, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 4 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
W20260709 12:24:43.474969 10818 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.038s	sys 0.047s
I20260709 12:24:43.476620 10750 catalog_manager.cc:5697] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 1 to 2, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 2 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:43.036723 12327 raft_consensus.cc:515] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:43.408787 12321 raft_consensus.cc:515] T e8b17195a94142039c40f598ed006c94 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:43.481173 12328 consensus_meta.cc:287] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040: Time spent flushing consensus metadata: real 0.583s	user 0.010s	sys 0.002s
I20260709 12:24:43.484040 12328 raft_consensus.cc:515] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:43.481371 12120 leader_election.cc:290] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:24:43.498821 12331 log.cc:927] Time spent T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.767s	user 0.004s	sys 0.000s
I20260709 12:24:43.377658 12019 raft_consensus.cc:515] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:43.406358 12269 raft_consensus.cc:493] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:43.509145 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c6d38c4d8a90a81975a6a0cb13" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:43.509145 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:43.479336 10750 catalog_manager.cc:5697] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 2 to 4, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 4 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:43.506541 10853 raft_consensus.cc:3060] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:43.468783 12280 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.011s	sys 0.043s
I20260709 12:24:43.516737 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab816bcc6183447994a2cc013e46c5f8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:43.518873 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:43.508847 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:43.534925 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:43.509461 12120 raft_consensus.cc:493] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.543079 10846 raft_consensus.cc:2468] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 5.
I20260709 12:24:43.546851 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d9a61ecaf84695b70f8519ee57706f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:43.547538 10846 raft_consensus.cc:2468] T e3d9a61ecaf84695b70f8519ee57706f P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 3.
W20260709 12:24:43.548285 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:43.548424 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:43.551949 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:43.553665 10853 raft_consensus.cc:2468] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 5.
I20260709 12:24:43.555140 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:43.556416 10846 raft_consensus.cc:2468] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 5.
I20260709 12:24:43.557333 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:43.512173 12269 raft_consensus.cc:3060] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:43.557687 10750 catalog_manager.cc:5697] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
W20260709 12:24:43.560199 10994 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.055s	sys 0.065s
I20260709 12:24:43.510483 12195 raft_consensus.cc:493] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.509086 12176 leader_election.cc:290] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:24:43.563800 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:43.564248 10994 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.055s	sys 0.065s
I20260709 12:24:43.574641 11000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37500 (request call id 1107) took 1034 ms. Trace:
I20260709 12:24:43.572618 12285 raft_consensus.cc:493] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.575261 11000 rpcz_store.cc:276] 0709 12:24:42.540126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.540340 (+   214us) service_pool.cc:224] Handling call
0709 12:24:42.540897 (+   557us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:42.541232 (+   335us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:42.541273 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:42.552809 (+ 11536us) log.cc:844] Serialized 26 byte log entry
0709 12:24:42.637132 (+ 84323us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:42.637169 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:42.637234 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:43.498044 (+860810us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b4400022b4c. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7591c23db1 00007f7591cc1c85 00007f7591cc26a2 00007f7594a341db 00007f7594a2faaf 00007f7594a2386e 00007f7594a22bb6 00007f7594a227d8 00007f7594a2c221 00007f7594a2c1d9 00007f7594a2c169
0709 12:24:43.564436 (+ 66392us) raft_consensus.cc:1685] finished
0709 12:24:43.564464 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:43.574538 (+ 10074us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36268800,"thread_start_us":50677,"threads_started":1,"wal-append.queue_time_us":155248}
I20260709 12:24:43.574049 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:43.464035 12325 raft_consensus.cc:515] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:43.573750 12315 consensus_meta.cc:287] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040: Time spent flushing consensus metadata: real 0.896s	user 0.010s	sys 0.003s
I20260709 12:24:43.570914 12321 leader_election.cc:290] T e8b17195a94142039c40f598ed006c94 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:43.564924 12140 raft_consensus.cc:493] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:43.601131 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:43.556792 12120 raft_consensus.cc:515] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:43.615828 10851 raft_consensus.cc:2468] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 3.
I20260709 12:24:43.597088 12140 raft_consensus.cc:515] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:43.618824 12140 leader_election.cc:290] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:43.590780 12328 leader_election.cc:290] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:43.589408 12019 leader_election.cc:290] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:43.586200 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63ecfc9bd3945818cfe15c03f001315" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:43.577904 12285 raft_consensus.cc:515] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:43.573130 12195 raft_consensus.cc:515] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:43.618856 12340 log.cc:927] Time spent T 00000000000000000000000000000000 P 9619ad7a9e7f4d9b8039487e3ee77243: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:24:43.638877 12019 raft_consensus.cc:493] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.647789 12019 raft_consensus.cc:515] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:43.658401 12019 leader_election.cc:290] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:43.658902 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac8522e549a46e09593fa4c2e175557" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:43.651351 12289 raft_consensus.cc:493] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:43.660995 10847 raft_consensus.cc:3055] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:43.661495 12289 raft_consensus.cc:515] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:43.661525 10847 raft_consensus.cc:740] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:43.672061 10847 consensus_queue.cc:260] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:43.673486 12120 leader_election.cc:290] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:43.680342 12285 leader_election.cc:290] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:43.682457 12195 leader_election.cc:290] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:43.684201 12325 leader_election.cc:290] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:43.669711 12019 raft_consensus.cc:493] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:43.685505 12205 raft_consensus.cc:3055] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:43.696915 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:24:43.744666 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 268263us
I20260709 12:24:43.698901 12251 consensus_queue.cc:1048] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:43.703394 10846 raft_consensus.cc:1275] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:24:43.708206 12289 leader_election.cc:290] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:43.644932 10845 raft_consensus.cc:2468] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 3.
I20260709 12:24:43.710274 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:43.729370 12277 raft_consensus.cc:493] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.715255 11000 raft_consensus.cc:1275] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:24:43.717283 10999 raft_consensus.cc:1240] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:43.718726 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:43.777606 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9331e5342644ca2bae19187b083a7d5" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:43.778044 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d9a61ecaf84695b70f8519ee57706f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:43.778359 10968 leader_election.cc:304] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:43.719724 12000 raft_consensus.cc:493] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:43.719919 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:43.725347 10894 leader_election.cc:304] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:43.734773 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:43.783995 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9331e5342644ca2bae19187b083a7d5" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:43.752611 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d9a61ecaf84695b70f8519ee57706f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:43.775422 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:43.712478 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:43.750146 12120 raft_consensus.cc:493] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.783942 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:43.728871 12110 consensus_queue.cc:1048] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 12:24:43.749675 12276 raft_consensus.cc:493] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:43.772785 12262 raft_consensus.cc:515] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:24:43.780920 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:43.801193 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:43.801621 12262 leader_election.cc:290] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:43.802799 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:43.791513 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:43.804852 10853 raft_consensus.cc:1275] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:43.806146 10929 raft_consensus.cc:1240] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:43.798797 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b17195a94142039c40f598ed006c94" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:43.806967 10853 raft_consensus.cc:1275] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:43.751735 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:43.807929 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:43.808735 10996 raft_consensus.cc:1240] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:43.809032 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:43.809971 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:43.724216 12164 consensus_queue.cc:1048] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 12:24:43.774300 12285 raft_consensus.cc:493] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:43.772740 12019 raft_consensus.cc:515] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:43.811861 12285 raft_consensus.cc:515] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:43.812999 10853 raft_consensus.cc:1275] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:24:43.813550 12019 leader_election.cc:290] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:43.774945 12195 raft_consensus.cc:493] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:43.814637 12195 raft_consensus.cc:515] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:43.776407 12108 raft_consensus.cc:493] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.816571 12108 raft_consensus.cc:515] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:43.816862 12195 leader_election.cc:290] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:43.819989 12206 raft_consensus.cc:3060] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:43.817922 10853 raft_consensus.cc:1275] T e3d9a61ecaf84695b70f8519ee57706f P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:43.820441 12269 raft_consensus.cc:515] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:43.821825 10924 raft_consensus.cc:1240] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:43.822562 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:43.823393 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:43.823637 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:43.793099 12277 raft_consensus.cc:515] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:43.825877 10968 leader_election.cc:304] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:43.744266 12205 raft_consensus.cc:740] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:43.798714 12120 raft_consensus.cc:515] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:43.799072 12276 raft_consensus.cc:515] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:43.800060 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:43.794929 12000 raft_consensus.cc:515] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:43.834530 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 109300us
I20260709 12:24:43.736272 12005 consensus_queue.cc:1048] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.058s
I20260709 12:24:43.815286 12285 leader_election.cc:290] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:43.783107 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef3220c51df47db8859f07ab745fad5" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:43.915422 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:43.865137 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:43.928994 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:43.929327 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b17195a94142039c40f598ed006c94" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:43.929824 10849 raft_consensus.cc:2468] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 3.
I20260709 12:24:43.921842 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c6d38c4d8a90a81975a6a0cb13" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:43.931020 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:43.931270 10928 raft_consensus.cc:2368] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 4. Current term is 5.
W20260709 12:24:43.862346 10820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:43.918030 10850 raft_consensus.cc:1275] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:43.932577 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:43.933504 11000 raft_consensus.cc:2393] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 2: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:24:43.860972 12250 consensus_queue.cc:1048] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.073s
I20260709 12:24:43.934340 10820 leader_election.cc:304] T 18294423a68a4671bf6c5a0f98645e4c P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:24:43.935032 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 109229us
I20260709 12:24:43.935175 12204 raft_consensus.cc:2749] T 18294423a68a4671bf6c5a0f98645e4c P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:43.936313 10820 leader_election.cc:304] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:43.838974 11003 raft_consensus.cc:1275] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:43.937441 12204 raft_consensus.cc:2749] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:43.988301 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:43.795300 12140 raft_consensus.cc:2749] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:43.937716 10820 leader_election.cc:304] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:43.857143 12291 raft_consensus.cc:493] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:43.920212 12277 leader_election.cc:290] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:43.938707 12000 leader_election.cc:290] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:43.897394 10996 raft_consensus.cc:2468] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 5.
I20260709 12:24:43.931941 10998 raft_consensus.cc:2410] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:24:43.939184 12285 consensus_queue.cc:1048] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 12:24:43.942185 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c6d38c4d8a90a81975a6a0cb13" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:43.931087 10849 raft_consensus.cc:3055] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:44.029119 10849 raft_consensus.cc:740] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:44.029611 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:44.008163 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:24:44.003706 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 58963us
I20260709 12:24:44.037276 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:43.939330 10968 leader_election.cc:304] T 3f8a389131ef4c77a3e08488aa4759eb P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:43.856475 12093 raft_consensus.cc:2749] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:24:44.021301 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 50842.6us
W20260709 12:24:44.050020 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 110762us
W20260709 12:24:44.013092 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 75432.9us
I20260709 12:24:44.052268 10820 leader_election.cc:304] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:44.004570 11001 raft_consensus.cc:2468] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 5.
I20260709 12:24:43.991828 12276 leader_election.cc:290] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:44.062999 10968 leader_election.cc:304] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
W20260709 12:24:44.064638 10817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:44.067551 10819 leader_election.cc:400] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 election: Vote denied by peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339) with higher term. Message: Invalid argument: T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 4. Current term is 5.
I20260709 12:24:44.067940 10819 leader_election.cc:403] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:24:44.092077 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef3220c51df47db8859f07ab745fad5" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:44.091176 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:24:44.089258 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 390885us
I20260709 12:24:44.102734 12347 raft_consensus.cc:2749] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339) with higher term. Message: Invalid argument: T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 4. Current term is 5.
I20260709 12:24:44.108178 12315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:46472 (request call id 3) took 13284 ms. Trace:
I20260709 12:24:44.108572 12315 rpcz_store.cc:276] 0709 12:24:31.042504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.064117 (+ 21613us) service_pool.cc:224] Handling call
0709 12:24:32.122911 (+1058794us) log.cc:844] Serialized 499 byte log entry
0709 12:24:44.108070 (+11985159us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":276,"raft.run_cpu_time_us":733,"raft.run_wall_time_us":735,"thread_start_us":307661,"threads_started":1,"wal-append.queue_time_us":646291,"wal-append.run_cpu_time_us":2857,"wal-append.run_wall_time_us":1002798}
I20260709 12:24:44.109833 12108 leader_election.cc:290] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:44.110656 12108 raft_consensus.cc:493] T 442726a7f1e441248ec80a98b31eb341 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:44.024369 12204 raft_consensus.cc:2749] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:44.112169 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:24:44.102669 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 401695us
I20260709 12:24:44.114058 11003 raft_consensus.cc:1240] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:44.024022 12327 leader_election.cc:290] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:24:44.022912 12140 raft_consensus.cc:493] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:43.998716 12164 consensus_queue.cc:1059] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.110s
I20260709 12:24:44.090516 12195 raft_consensus.cc:493] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:44.129848 11003 raft_consensus.cc:1240] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:44.113637 12285 raft_consensus.cc:2804] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:44.024883 12291 raft_consensus.cc:515] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:44.089600 12325 consensus_queue.cc:1059] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 12:24:43.997748 12205 consensus_queue.cc:260] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:44.159011 12195 raft_consensus.cc:515] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:44.168879 12195 leader_election.cc:290] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:44.169690 12195 raft_consensus.cc:493] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:44.170256 12195 raft_consensus.cc:515] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:44.156442 12285 raft_consensus.cc:493] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:44.187601 12285 raft_consensus.cc:3060] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:44.203900 12340 log.cc:927] Time spent T 00000000000000000000000000000000 P 9619ad7a9e7f4d9b8039487e3ee77243: Append to log took a long time: real 0.076s	user 0.002s	sys 0.000s
I20260709 12:24:44.196115 12362 raft_consensus.cc:493] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:44.208227 12362 raft_consensus.cc:515] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:44.219969 12362 leader_election.cc:290] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:24:44.252236 10817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:44.256878 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 204538us
I20260709 12:24:44.257105 10850 raft_consensus.cc:3060] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:44.029956 10849 consensus_queue.cc:260] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:44.261593 10849 raft_consensus.cc:3060] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:44.266492 10847 raft_consensus.cc:3060] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:44.259322 10820 leader_election.cc:304] T e3d9a61ecaf84695b70f8519ee57706f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:44.274967 10852 raft_consensus.cc:1275] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:44.277007 10849 raft_consensus.cc:1275] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:24:44.277756 10849 pending_rounds.cc:85] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040: Aborting all ops after (but not including) 2
I20260709 12:24:44.278491 10849 pending_rounds.cc:107] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:24:44.278947 10849 raft_consensus.cc:2889] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:24:44.296036 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 244904us
I20260709 12:24:44.302572 10920 raft_consensus.cc:1240] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 LEADER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:24:44.303610 10923 raft_consensus.cc:1240] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:24:44.130796 10997 raft_consensus.cc:2955] T 3f8a389131ef4c77a3e08488aa4759eb P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:24:44.307022 10923 raft_consensus.cc:1240] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 LEADER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 4. Current term is 5. Ops: []
W20260709 12:24:44.315418 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:44.111502 12108 raft_consensus.cc:515] T 442726a7f1e441248ec80a98b31eb341 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:44.175354 12269 leader_election.cc:290] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:44.128427 12140 raft_consensus.cc:515] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:44.176555 12205 raft_consensus.cc:3060] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:44.338867 10922 raft_consensus.cc:1275] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:44.342075 12140 leader_election.cc:290] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:24:44.331192 12206 consensus_meta.cc:287] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040: Time spent flushing consensus metadata: real 0.510s	user 0.012s	sys 0.000s
W20260709 12:24:44.326635 12014 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.015s	sys 0.059s
W20260709 12:24:44.344390 12014 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.016s	sys 0.059s
W20260709 12:24:44.331871 10926 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.004s	sys 0.035s
I20260709 12:24:44.330365 12195 leader_election.cc:290] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:44.327201 12108 leader_election.cc:290] T 442726a7f1e441248ec80a98b31eb341 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:44.326174 12291 leader_election.cc:290] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:24:44.481752 10926 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.005s	sys 0.036s
I20260709 12:24:44.324720 12019 raft_consensus.cc:3055] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:44.485694 10850 raft_consensus.cc:1275] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:44.328101 12120 leader_election.cc:290] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:44.316100 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:44.508276 10847 raft_consensus.cc:1275] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:24:44.521347 10847 pending_rounds.cc:85] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040: Aborting all ops after (but not including) 1
I20260709 12:24:44.531790 10847 pending_rounds.cc:107] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:24:44.532240 10847 raft_consensus.cc:2889] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:44.489916 12019 raft_consensus.cc:740] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
W20260709 12:24:44.573917 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 522206us
W20260709 12:24:44.540769 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 460925us
I20260709 12:24:44.589687 12327 raft_consensus.cc:493] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.590343 12352 consensus_queue.cc:1048] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:44.590713 12327 raft_consensus.cc:515] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:44.561899 12333 raft_consensus.cc:2749] T e3d9a61ecaf84695b70f8519ee57706f P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:44.594326 12327 leader_election.cc:290] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:44.598199 12291 raft_consensus.cc:493] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:44.599526 12199 raft_consensus.cc:493] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.600494 12199 raft_consensus.cc:515] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:44.575383 10968 leader_election.cc:304] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
W20260709 12:24:44.606010 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 306913us
I20260709 12:24:44.640451 12164 raft_consensus.cc:493] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.641486 12164 raft_consensus.cc:515] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:44.643770 12312 raft_consensus.cc:2749] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:44.589771 12289 consensus_queue.cc:1048] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 12:24:44.670065 10853 raft_consensus.cc:1275] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:24:44.670773 10853 pending_rounds.cc:85] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040: Aborting all ops after (but not including) 2
I20260709 12:24:44.671089 10853 pending_rounds.cc:107] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:24:44.671490 10853 raft_consensus.cc:2889] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:24:44.705451 12363 log.cc:927] Time spent T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 12:24:44.706439 10845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56394 (request call id 1011) took 1120 ms. Trace:
I20260709 12:24:44.707057 10845 rpcz_store.cc:276] 0709 12:24:43.564949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.808026 (+243077us) service_pool.cc:224] Handling call
0709 12:24:43.808425 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:43.808829 (+   404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:43.808862 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:43.809378 (+   516us) log.cc:844] Serialized 26 byte log entry
0709 12:24:44.252843 (+443465us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:44.485342 (+232499us) log.cc:844] Serialized 14 byte log entry
0709 12:24:44.569163 (+ 83821us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:44.581858 (+ 12695us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:44.585297 (+  3439us) raft_consensus.cc:1685] finished
0709 12:24:44.605324 (+ 20027us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:44.685184 (+ 79860us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39455,"prepare.queue_time_us":330885,"prepare.run_cpu_time_us":96,"prepare.run_wall_time_us":7975,"raft.queue_time_us":147971,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":34054,"thread_start_us":669279,"threads_started":2,"wal-append.queue_time_us":396216}
I20260709 12:24:44.732064 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
W20260709 12:24:44.735067 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 476202us
W20260709 12:24:44.701720 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 61384.3us
I20260709 12:24:44.688216 12199 leader_election.cc:290] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:44.750067 10847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56388 (request call id 756) took 1259 ms. Trace:
I20260709 12:24:44.611536 12291 raft_consensus.cc:515] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:44.760202 10817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:44.757997 10847 rpcz_store.cc:276] 0709 12:24:43.484713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.660441 (+175728us) service_pool.cc:224] Handling call
0709 12:24:43.660825 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:44.265712 (+604887us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b58003f14d0. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594de40aa 00007f7594e66447 00007f7594e7efe7 00007f7594e807de 00007f7594e8ab49 00007f7594e8b416 00007f7594e87d8f 00007f7594e8783e 00007f7599e4c419 00007f75933c3bd4
0709 12:24:44.689833 (+424121us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:44.744289 (+ 54456us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":434540928}
I20260709 12:24:44.765095 12068 raft_consensus.cc:2749] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:24:44.767066 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 191999us
I20260709 12:24:44.768432 10968 leader_election.cc:304] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:44.769742 12120 raft_consensus.cc:2804] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:44.770327 12120 raft_consensus.cc:493] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:44.770823 12120 raft_consensus.cc:3060] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:44.735519 10819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:44.774220 10819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:44.797303 10817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:44.809269 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:44.810684 12380 raft_consensus.cc:493] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.811106 10922 raft_consensus.cc:2410] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:24:44.811465 12380 raft_consensus.cc:515] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:44.814352 12380 leader_election.cc:290] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:24:44.815935 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 47713.1us
W20260709 12:24:44.795074 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 250178us
I20260709 12:24:44.817281 12195 raft_consensus.cc:2749] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:44.821722 12386 consensus_queue.cc:1059] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:44.826360 10968 leader_election.cc:304] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:44.822969 12204 consensus_queue.cc:1048] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:44.831182 12386 raft_consensus.cc:3055] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:44.835354 12386 raft_consensus.cc:740] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:44.835951 10997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37512 (request call id 949) took 1106 ms. Trace:
I20260709 12:24:44.839015 10820 leader_election.cc:304] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:44.836540 10997 rpcz_store.cc:276] 0709 12:24:43.730129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.802634 (+ 72505us) service_pool.cc:224] Handling call
0709 12:24:43.803194 (+   560us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:43.803750 (+   556us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:43.803780 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:43.804994 (+  1214us) log.cc:844] Serialized 525 byte log entry
0709 12:24:44.130634 (+325640us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:44.495283 (+364649us) log.cc:844] Serialized 14 byte log entry
0709 12:24:44.821822 (+326539us) log.cc:844] Serialized 14 byte log entry
0709 12:24:44.835257 (+ 13435us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:44.835409 (+   152us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:44.835485 (+    76us) raft_consensus.cc:1685] finished
0709 12:24:44.835496 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:44.835716 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":206202,"prepare.queue_time_us":502,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":94,"raft.queue_time_us":236021,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":205,"spinlock_wait_cycles":37632,"thread_start_us":325229,"threads_started":1,"wal-append.queue_time_us":393434}
I20260709 12:24:44.845193 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:44.847260 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c913e527ff46578e084c41eab7bb9d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:44.847818 10968 leader_election.cc:304] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:44.850222 12195 raft_consensus.cc:493] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:44.850242 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac8522e549a46e09593fa4c2e175557" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:44.851824 12195 raft_consensus.cc:515] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:44.854234 12305 raft_consensus.cc:493] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.855000 12140 raft_consensus.cc:493] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:44.854117 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac8522e549a46e09593fa4c2e175557" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:44.854934 12305 raft_consensus.cc:515] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:44.856041 12140 raft_consensus.cc:515] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:44.858040 12204 raft_consensus.cc:493] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:44.858745 12204 raft_consensus.cc:515] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:44.859005 12140 leader_election.cc:290] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:44.859215 12305 leader_election.cc:290] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:44.815837 12291 leader_election.cc:290] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:24:44.868407 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 49731.3us
I20260709 12:24:44.850102 12108 raft_consensus.cc:2749] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:44.890925 12164 leader_election.cc:290] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:44.902388 12305 raft_consensus.cc:2749] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:44.939639 11588 leader_election.cc:304] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:44.939224 12386 consensus_queue.cc:260] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:24:44.942606 10995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37500 (request call id 1136) took 1375 ms. Trace:
I20260709 12:24:44.942724 12204 leader_election.cc:290] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:44.927673 10894 leader_election.cc:304] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:44.946242 12195 leader_election.cc:290] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:24:44.966442 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 77540.2us
I20260709 12:24:44.966751 12361 raft_consensus.cc:2749] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:44.969614 12204 raft_consensus.cc:493] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.970609 12204 raft_consensus.cc:515] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:44.971414 12328 raft_consensus.cc:3055] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:44.944648 10995 rpcz_store.cc:276] 0709 12:24:43.567564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.567748 (+   184us) service_pool.cc:224] Handling call
0709 12:24:43.568069 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:43.640356 (+ 72287us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:43.640405 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:43.643304 (+  2899us) log.cc:844] Serialized 26 byte log entry
0709 12:24:44.061686 (+418382us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:44.061750 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:44.941725 (+879975us) spinlock_profiling.cc:243] Waited 71.8 ms on lock 0x7b54001833d4. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e88e01 00007f7594e8783e 00007f7599e4c419 00007f75933c3bd4 00007f75933c3b62 00007f75933c3a91 00007f75933c3a0c 00007f75933c2cc2 00007f75931c348c 00007f75931c28c6
0709 12:24:44.941840 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:44.941900 (+    60us) raft_consensus.cc:1685] finished
0709 12:24:44.941914 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:44.942380 (+   466us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":108,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":156,"spinlock_wait_cycles":165129984,"thread_start_us":413613,"threads_started":1,"wal-append.queue_time_us":473618}
I20260709 12:24:44.972015 12328 raft_consensus.cc:740] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
W20260709 12:24:44.973600 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 95229.4us
I20260709 12:24:44.973806 12328 consensus_queue.cc:260] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:44.974325 12288 raft_consensus.cc:2749] T 3f8a389131ef4c77a3e08488aa4759eb P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:44.975106 12014 raft_consensus.cc:2749] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:44.975724 12385 raft_consensus.cc:493] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.985781 12385 raft_consensus.cc:515] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:44.977749 12391 log.cc:927] Time spent T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 12:24:44.981567 10927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59626 (request call id 960) took 1200 ms. Trace:
I20260709 12:24:44.983613 12386 raft_consensus.cc:3060] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:44.991284 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:44.998643 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 226578us
I20260709 12:24:44.989748 10927 rpcz_store.cc:276] 0709 12:24:43.780886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.824590 (+ 43704us) service_pool.cc:224] Handling call
0709 12:24:43.824901 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:43.936440 (+111539us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:43.936472 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:43.936511 (+    39us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:43.936538 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:44.980962 (+1044424us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b540012b6d4. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e88e01 00007f7594e8783e 00007f7599e4c419 00007f75933c3bd4 00007f75933c3b62 00007f75933c3a91 00007f75933c3a0c 00007f75933c2cc2 00007f75931c348c 00007f75931c28c6
0709 12:24:44.981041 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:44.981360 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":256109312}
W20260709 12:24:45.007115 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 141893us
I20260709 12:24:44.997244 12195 raft_consensus.cc:493] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:45.006107 12204 leader_election.cc:290] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:24:45.023990 10818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:45.034328 12328 raft_consensus.cc:3060] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:45.026866 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:24:45.065929 12355 log.cc:927] Time spent T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.958s	user 0.003s	sys 0.002s
I20260709 12:24:45.036060 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:45.043135 10926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59626 (request call id 955) took 1292 ms. Trace:
I20260709 12:24:45.052853 10994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37512 (request call id 948) took 1323 ms. Trace:
I20260709 12:24:45.068405 12385 leader_election.cc:290] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:45.055665 12067 consensus_queue.cc:1048] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:45.069144 12195 raft_consensus.cc:515] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:45.069823 10820 leader_election.cc:304] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:45.071233 10920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59626 (request call id 956) took 1320 ms. Trace:
I20260709 12:24:45.068574 10994 rpcz_store.cc:276] 0709 12:24:43.729302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.797967 (+ 68665us) service_pool.cc:224] Handling call
0709 12:24:43.798363 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:43.837343 (+ 38980us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:43.837388 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:43.914679 (+ 77291us) log.cc:844] Serialized 26 byte log entry
0709 12:24:44.320898 (+406219us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:44.496395 (+175497us) log.cc:844] Serialized 14 byte log entry
0709 12:24:44.745613 (+249218us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:44.754405 (+  8792us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:45.044198 (+289793us) raft_consensus.cc:1685] finished
0709 12:24:45.044235 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:45.052602 (+  8367us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":246421,"prepare.queue_time_us":444068,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":290055,"raft.run_cpu_time_us":332,"raft.run_wall_time_us":258,"thread_start_us":482888,"threads_started":2,"wal-append.queue_time_us":967711}
I20260709 12:24:45.072593 10854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56388 (request call id 735) took 1654 ms. Trace:
I20260709 12:24:45.067968 10926 rpcz_store.cc:276] 0709 12:24:43.750778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.750921 (+   143us) service_pool.cc:224] Handling call
0709 12:24:43.751229 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:43.792753 (+ 41524us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:24:44.540321 (+747568us) log.cc:844] Serialized 14 byte log entry
0709 12:24:44.647364 (+107043us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:44.806919 (+159555us) log.cc:844] Serialized 26 byte log entry
0709 12:24:44.808355 (+  1436us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:44.808405 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:44.808555 (+   150us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:45.042844 (+234289us) raft_consensus.cc:1685] finished
0709 12:24:45.042868 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:45.043060 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39421,"prepare.queue_time_us":399945,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":49,"raft.queue_time_us":44944,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":140,"spinlock_wait_cycles":84965760,"thread_start_us":763794,"threads_started":2,"wal-append.queue_time_us":456305}
I20260709 12:24:45.073078 10854 rpcz_store.cc:276] 0709 12:24:43.418625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.418864 (+   239us) service_pool.cc:224] Handling call
0709 12:24:43.419401 (+   537us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:43.423109 (+  3708us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 12:24:43.423146 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:43.464639 (+ 41493us) log.cc:844] Serialized 26 byte log entry
0709 12:24:43.705709 (+241070us) spinlock_profiling.cc:243] Waited 5.84 ms on lock 0x7b48002ac0d8. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7599db1aa1 00007f7599da8b37 00007f7599da89ca 00007f7599ea026f 00007f7599e9ff37 00007f7599eb455c 00007f7599eb4508 00007f7599eb4488 00007f7599eb4443 00007f7599eb36ec 00007f7598ddda96
0709 12:24:43.739631 (+ 33922us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:43.740014 (+   383us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:43.740093 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:45.010938 (+1270845us) spinlock_profiling.cc:243] Waited 7.14 ms on lock 0x7b4400022b4c. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7591c23db1 00007f7591cc1c85 00007f7591cc26a2 00007f7594a341db 00007f7594a2faaf 00007f7594a2386e 00007f7594a22bb6 00007f7594a227d8 00007f7594a2c221 00007f7594a2c1d9 00007f7594a2c169
0709 12:24:45.072155 (+ 61217us) raft_consensus.cc:1685] finished
0709 12:24:45.072180 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:45.072428 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3050,"raft.queue_time_us":3704,"raft.run_cpu_time_us":3028,"raft.run_wall_time_us":249535,"spinlock_wait_cycles":29845632,"thread_start_us":194937,"threads_started":1,"wal-append.queue_time_us":598895}
I20260709 12:24:45.071877 10920 rpcz_store.cc:276] 0709 12:24:43.751196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.751611 (+   415us) service_pool.cc:224] Handling call
0709 12:24:43.751912 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:44.303456 (+551544us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:45.070856 (+767400us) spinlock_profiling.cc:243] Waited 548 ms on lock 0x7b54002882d4. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e88e01 00007f7594e8783e 00007f7599e4c419 00007f75933c3bd4 00007f75933c3b62 00007f75933c3a91 00007f75933c3a0c 00007f75933c2cc2 00007f75931c348c 00007f75931c28c6
0709 12:24:45.071134 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1260851968}
I20260709 12:24:45.077080 10996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37500 (request call id 1149) took 1267 ms. Trace:
I20260709 12:24:45.077620 10996 rpcz_store.cc:276] 0709 12:24:43.809298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.809585 (+   287us) service_pool.cc:224] Handling call
0709 12:24:45.076640 (+1267055us) spinlock_profiling.cc:243] Waited 17.9 ms on lock 0x7b540006e854. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e8c2fa 00007f7599e4db17 00007f75933c86d4 00007f75933c8662 00007f75933c8591 00007f75933c850c 00007f75933c77c2 00007f75931c348c 00007f75931c28c6 00007f75931c226f
0709 12:24:45.076875 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":41080064}
I20260709 12:24:45.082599 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:45.090129 12375 raft_consensus.cc:493] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:45.090912 12375 raft_consensus.cc:515] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:45.098186 12285 consensus_meta.cc:287] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08: Time spent flushing consensus metadata: real 0.696s	user 0.014s	sys 0.003s
I20260709 12:24:45.098758 12285 raft_consensus.cc:515] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:45.099534 12288 raft_consensus.cc:493] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:45.100589 12288 raft_consensus.cc:515] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:45.102926 12205 consensus_meta.cc:287] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040: Time spent flushing consensus metadata: real 0.766s	user 0.012s	sys 0.004s
I20260709 12:24:45.103976 10847 raft_consensus.cc:2410] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3c52e0825c02476e89d84da9bb849f5d for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:24:45.092268 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:45.103288 12288 leader_election.cc:290] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:45.118511 10927 raft_consensus.cc:1275] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:24:45.121869 12376 raft_consensus.cc:493] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:45.122324 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:45.122804 12376 raft_consensus.cc:515] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:45.128721 12108 raft_consensus.cc:493] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:45.129429 12108 raft_consensus.cc:515] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:45.130721 10968 connection.cc:256] RPC call timeout handler was delayed by -1.1024497050002537s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18910000000000002s for a response
I20260709 12:24:45.127925 12373 raft_consensus.cc:493] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:45.131788 12288 raft_consensus.cc:493] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:45.132135 12373 raft_consensus.cc:515] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } }
I20260709 12:24:45.133142 12288 raft_consensus.cc:515] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:45.134845 12335 leader_election.cc:290] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:45.137178 12285 leader_election.cc:290] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:45.138021 12285 raft_consensus.cc:493] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.138651 12285 raft_consensus.cc:515] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:45.139155 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:45.178550 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:45.140488 12375 leader_election.cc:290] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:45.180058 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:45.181356 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:45.181550 10853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56394 (request call id 1024) took 1489 ms. Trace:
I20260709 12:24:45.181984 10853 rpcz_store.cc:276] 0709 12:24:43.692499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.822895 (+130396us) service_pool.cc:224] Handling call
0709 12:24:43.823121 (+   226us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:44.672244 (+849123us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:45.181262 (+509018us) spinlock_profiling.cc:243] Waited 522 ms on lock 0x7b54002986d4. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e88e01 00007f7594e8783e 00007f7599e4c419 00007f75933c3bd4 00007f75933c3b62 00007f75933c3a91 00007f75933c3a0c 00007f75933c2cc2 00007f75931c348c 00007f75931c28c6
0709 12:24:45.181494 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1201283968}
I20260709 12:24:45.182507 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:45.141623 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab816bcc6183447994a2cc013e46c5f8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:45.179219 12285 leader_election.cc:290] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:45.143002 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:24:45.143975 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 50661.4us
I20260709 12:24:45.114027 12140 raft_consensus.cc:2804] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:45.144269 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:45.144387 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:45.231776 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:45.233035 10927 raft_consensus.cc:2468] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 5.
I20260709 12:24:45.234579 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:45.146836 10850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56394 (request call id 1033) took 1450 ms. Trace:
I20260709 12:24:45.148487 12288 leader_election.cc:290] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:45.149751 12019 consensus_queue.cc:260] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:45.150390 12376 leader_election.cc:290] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:45.152489 11001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37500 (request call id 1157) took 1271 ms. Trace:
I20260709 12:24:45.155408 12195 leader_election.cc:290] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:45.156314 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:45.156559 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:45.158768 12120 raft_consensus.cc:515] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:45.162568 10994 raft_consensus.cc:1275] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:45.165504 12373 leader_election.cc:290] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265)
I20260709 12:24:45.166446 12108 leader_election.cc:290] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:45.168046 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
W20260709 12:24:45.170733 12397 log.cc:927] Time spent T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.111s	user 0.002s	sys 0.000s
I20260709 12:24:45.170259 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:45.259143 10998 raft_consensus.cc:2468] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 3.
I20260709 12:24:45.259799 12195 raft_consensus.cc:493] T d0aed74af73a488f8b691578ca370226 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:24:45.244182 11001 rpcz_store.cc:276] 0709 12:24:43.840110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.568889 (+728779us) service_pool.cc:224] Handling call
0709 12:24:44.573953 (+  5064us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:44.574753 (+   800us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:24:44.994175 (+419422us) log.cc:844] Serialized 14 byte log entry
0709 12:24:45.110678 (+116503us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:45.110726 (+    48us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:45.110757 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:45.110845 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:45.110969 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":190541,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":27,"raft.queue_time_us":5716,"raft.run_cpu_time_us":307,"raft.run_wall_time_us":14253,"thread_start_us":508347,"threads_started":2}
I20260709 12:24:45.260587 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:45.261879 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:45.175194 10999 raft_consensus.cc:1240] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:24:45.176267 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:45.261121 11000 raft_consensus.cc:1240] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:45.235795 10850 rpcz_store.cc:276] 0709 12:24:43.696223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.932713 (+236490us) service_pool.cc:224] Handling call
0709 12:24:44.256525 (+323812us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:44.486281 (+229756us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:45.146640 (+660359us) spinlock_profiling.cc:243] Waited 323 ms on lock 0x7b54000ea450. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e878ad 00007f7599e4c419 00007f75933c3bd4 00007f75933c3b62 00007f75933c3a91 00007f75933c3a0c 00007f75933c2cc2 00007f75931c348c 00007f75931c28c6 00007f75931c226f
0709 12:24:45.146777 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":743306496}
I20260709 12:24:45.254446 10996 raft_consensus.cc:2468] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 3.
I20260709 12:24:45.255363 12014 consensus_queue.cc:1048] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:45.172673 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad766f48812a4ddeb383179b1d84907b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:45.239131 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:45.239316 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:45.274060 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18294423a68a4671bf6c5a0f98645e4c" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:45.278168 12019 raft_consensus.cc:3060] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:45.260655 12195 raft_consensus.cc:515] T d0aed74af73a488f8b691578ca370226 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:45.260891 12120 leader_election.cc:290] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:24:45.290230 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 138806us
I20260709 12:24:45.291622 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:45.293869 10894 leader_election.cc:304] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:45.294051 10997 raft_consensus.cc:2468] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 1.
I20260709 12:24:45.294755 11003 raft_consensus.cc:2468] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 4.
I20260709 12:24:45.317160 12120 raft_consensus.cc:493] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.325613 12120 raft_consensus.cc:515] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:45.326349 12195 leader_election.cc:290] T d0aed74af73a488f8b691578ca370226 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:24:45.330297 10927 raft_consensus.cc:2410] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:24:45.269984 12108 raft_consensus.cc:493] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:24:45.326746 12014 raft_consensus.cc:2749] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:24:45.352782 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 59475.1us
I20260709 12:24:45.354763 12195 consensus_queue.cc:1048] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:45.339277 12373 raft_consensus.cc:493] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:45.349613 12376 raft_consensus.cc:493] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:45.366513 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:45.361804 10894 leader_election.cc:304] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:45.378886 10895 leader_election.cc:304] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:45.382181 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aed74af73a488f8b691578ca370226" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:24:45.384338 10928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59626 (request call id 961) took 1603 ms. Trace:
I20260709 12:24:45.358227 12288 raft_consensus.cc:493] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:45.390530 12093 raft_consensus.cc:2749] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:45.384812 10928 rpcz_store.cc:276] 0709 12:24:43.781308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:45.082532 (+1301224us) service_pool.cc:224] Handling call
0709 12:24:45.089076 (+  6544us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:45.089679 (+   603us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:45.089707 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:45.090427 (+   720us) log.cc:844] Serialized 26 byte log entry
0709 12:24:45.207769 (+117342us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:45.207824 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:45.207936 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:45.383975 (+176039us) raft_consensus.cc:1685] finished
0709 12:24:45.383992 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:45.384145 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2628,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":152,"thread_start_us":116831,"threads_started":1,"wal-append.queue_time_us":249373}
I20260709 12:24:45.364897 12108 raft_consensus.cc:515] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:45.403323 10968 leader_election.cc:304] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:45.403729 12285 consensus_queue.cc:1048] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:45.404244 12375 raft_consensus.cc:2749] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:45.372361 12373 raft_consensus.cc:515] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:45.397230 12352 raft_consensus.cc:2804] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:45.387773 12288 raft_consensus.cc:515] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:45.411962 10929 consensus_queue.cc:237] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:24:45.396809 12376 raft_consensus.cc:515] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:45.415548 12120 leader_election.cc:290] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:45.422528 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:45.413882 12352 raft_consensus.cc:493] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:45.431250 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:45.432626 11000 raft_consensus.cc:2393] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 4: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:24:45.435211 10925 raft_consensus.cc:2468] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 3.
W20260709 12:24:45.436007 10893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:45.436684 12288 leader_election.cc:290] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:45.438445 12108 leader_election.cc:290] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:24:45.443517 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b17195a94142039c40f598ed006c94" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:45.430408 12352 raft_consensus.cc:3060] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:45.438951 12373 leader_election.cc:290] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:45.447469 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:45.447861 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352aa49c65194abbb863d7553a091f11" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:24:45.443260 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef3220c51df47db8859f07ab745fad5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:45.450819 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:45.450855 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:24:45.451464 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 415658us
I20260709 12:24:45.452605 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:24:45.454870 12400 log.cc:927] Time spent T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.381s	user 0.004s	sys 0.000s
W20260709 12:24:45.455355 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 435553us
I20260709 12:24:45.453935 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:45.456350 10820 leader_election.cc:304] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:45.456681 11002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37500 (request call id 1152) took 1646 ms. Trace:
I20260709 12:24:45.455814 12347 raft_consensus.cc:2749] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:45.457183 12140 raft_consensus.cc:493] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:45.457762 12140 raft_consensus.cc:3060] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:45.458096 12333 consensus_queue.cc:1048] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:45.460000 11588 leader_election.cc:304] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:45.461158 12393 raft_consensus.cc:2749] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:45.458315 10820 leader_election.cc:304] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:45.457031 11002 rpcz_store.cc:276] 0709 12:24:43.810110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.344061 (+533951us) service_pool.cc:224] Handling call
0709 12:24:44.344595 (+   534us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:44.345215 (+   620us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:44.345243 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:44.563391 (+218148us) log.cc:844] Serialized 26 byte log entry
0709 12:24:44.955932 (+392541us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:44.956066 (+   134us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:44.956267 (+   201us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:45.440309 (+484042us) spinlock_profiling.cc:243] Waited 17.1 ms on lock 0x7b4400022b4c. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7591c23db1 00007f7591cc1c85 00007f7591cc26a2 00007f7594a341db 00007f7594a2faaf 00007f7594a2386e 00007f7594a22bb6 00007f7594a227d8 00007f7594a2c221 00007f7594a2c1d9 00007f7594a2c169
0709 12:24:45.456251 (+ 15942us) raft_consensus.cc:1685] finished
0709 12:24:45.456269 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:45.456525 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5528,"raft.queue_time_us":594,"raft.run_cpu_time_us":542,"raft.run_wall_time_us":142483,"spinlock_wait_cycles":39359744,"thread_start_us":328146,"threads_started":1,"wal-append.queue_time_us":476926}
I20260709 12:24:45.470891 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aed74af73a488f8b691578ca370226" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:45.472486 10894 leader_election.cc:304] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:45.457542 12347 raft_consensus.cc:2749] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:45.476876 12376 leader_election.cc:290] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:24:45.477254 10817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:45.477695 12335 raft_consensus.cc:493] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:45.478502 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d9a61ecaf84695b70f8519ee57706f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:45.476891 12176 raft_consensus.cc:2749] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:45.478464 12335 raft_consensus.cc:515] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:45.481276 12038 raft_consensus.cc:3060] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:45.481540 12333 raft_consensus.cc:493] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:45.482450 10819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:45.482177 12333 raft_consensus.cc:515] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:45.482848 10819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:45.482940 12335 leader_election.cc:290] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:45.484200 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:24:45.483623 10819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:45.490784 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:45.495510 10925 raft_consensus.cc:2468] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 4.
I20260709 12:24:45.498270 12386 raft_consensus.cc:493] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:45.498971 12386 raft_consensus.cc:515] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:45.505046 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 46874.9us
I20260709 12:24:45.483757 12206 raft_consensus.cc:493] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.489025 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9331e5342644ca2bae19187b083a7d5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:45.515359 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:45.484403 12333 leader_election.cc:290] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:45.520913 10752 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36188 (request call id 38) took 3488 ms. Trace:
I20260709 12:24:45.521611 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:45.522961 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab816bcc6183447994a2cc013e46c5f8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:24:45.524050 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:45.524704 12206 raft_consensus.cc:515] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:45.483582 12335 raft_consensus.cc:493] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.530439 10820 leader_election.cc:304] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:45.509204 12386 leader_election.cc:290] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:45.533667 10895 leader_election.cc:304] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:45.535902 10750 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60734 (request call id 139) took 4943 ms. Trace:
I20260709 12:24:45.538730 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac83709373b4efd9c3aa1472a9f9022" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:45.539769 12176 raft_consensus.cc:2749] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:45.541234 10820 leader_election.cc:304] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:45.542117 12347 consensus_queue.cc:1059] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:45.542514 12386 raft_consensus.cc:2749] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:45.542778 10820 leader_election.cc:304] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:45.543303 12347 raft_consensus.cc:3055] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:45.536136 12164 consensus_queue.cc:1048] T c63ecfc9bd3945818cfe15c03f001315 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:24:45.543700 12386 raft_consensus.cc:2749] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:45.544526 12335 raft_consensus.cc:515] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:45.545441 12206 leader_election.cc:290] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:45.543795 12347 raft_consensus.cc:740] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:45.546811 12347 consensus_queue.cc:260] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:45.552738 12038 raft_consensus.cc:2749] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:45.549268 12019 raft_consensus.cc:2804] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:45.537619 10750 rpcz_store.cc:276] 0709 12:24:40.616628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:40.620612 (+  3984us) service_pool.cc:224] Handling call
0709 12:24:45.534175 (+4913563us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:43.616254 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:43.617115 (+   861us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:43.617163 (+    48us) write_op.cc:435] Acquired schema lock
0709 12:24:43.617186 (+    23us) tablet.cc:662] Decoding operations
0709 12:24:43.618354 (+  1168us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:43.618434 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:43.618476 (+    42us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:24:43.619384 (+   908us) tablet.cc:701] Row locks acquired
0709 12:24:43.619407 (+    23us) write_op.cc:260] PREPARE: finished
0709 12:24:43.619646 (+   239us) write_op.cc:270] Start()
0709 12:24:43.619798 (+   152us) write_op.cc:276] Timestamp: P: 1783599883619557 usec, L: 0
0709 12:24:43.619824 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:24:43.646940 (+ 27116us) log.cc:844] Serialized 2848 byte log entry
0709 12:24:44.653121 (+1006181us) op_driver.cc:464] REPLICATION: finished
0709 12:24:45.034358 (+381237us) write_op.cc:301] APPLY: starting
0709 12:24:45.034567 (+   209us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:45.034974 (+   407us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:45.035165 (+   191us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:45.144950 (+109785us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:45.145166 (+   216us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 12:24:45.145215 (+    49us) write_op.cc:312] APPLY: finished
0709 12:24:45.145519 (+   304us) log.cc:844] Serialized 58 byte log entry
0709 12:24:45.145707 (+   188us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:45.145925 (+   218us) write_op.cc:454] Released schema lock
0709 12:24:45.145965 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:45.146361 (+   396us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:45.146398 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":46825,"reported_tablets":19,"child_traces":[["op",{"apply.queue_time_us":380590,"apply.run_cpu_time_us":4109,"apply.run_wall_time_us":112002,"num_ops":7,"prepare.queue_time_us":875,"prepare.run_cpu_time_us":5214,"prepare.run_wall_time_us":31021,"replication_time_us":1032932,"thread_start_us":252406,"threads_started":1}]]}
I20260709 12:24:45.521637 10752 rpcz_store.cc:276] 0709 12:24:42.028328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.029766 (+  1438us) service_pool.cc:224] Handling call
0709 12:24:45.516591 (+3486825us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:42.512604 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:42.513254 (+   650us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:42.513296 (+    42us) write_op.cc:435] Acquired schema lock
0709 12:24:42.513319 (+    23us) tablet.cc:662] Decoding operations
0709 12:24:42.520952 (+  7633us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:42.538802 (+ 17850us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:42.543799 (+  4997us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:24:42.560786 (+ 16987us) tablet.cc:701] Row locks acquired
0709 12:24:42.564696 (+  3910us) write_op.cc:260] PREPARE: finished
0709 12:24:42.583515 (+ 18819us) write_op.cc:270] Start()
0709 12:24:42.597822 (+ 14307us) write_op.cc:276] Timestamp: P: 1783599882583433 usec, L: 0
0709 12:24:42.601646 (+  3824us) op_driver.cc:348] REPLICATION: starting
0709 12:24:42.655043 (+ 53397us) log.cc:844] Serialized 532 byte log entry
0709 12:24:44.165903 (+1510860us) op_driver.cc:464] REPLICATION: finished
0709 12:24:44.815523 (+649620us) write_op.cc:301] APPLY: starting
0709 12:24:44.815716 (+   193us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:44.815903 (+   187us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:44.817429 (+  1526us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:44.817897 (+   468us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:44.818279 (+   382us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:24:44.818372 (+    93us) write_op.cc:312] APPLY: finished
0709 12:24:44.957728 (+139356us) log.cc:844] Serialized 22 byte log entry
0709 12:24:45.004412 (+ 46684us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:45.011302 (+  6890us) write_op.cc:454] Released schema lock
0709 12:24:45.020423 (+  9121us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:45.033467 (+ 13044us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:45.033546 (+    79us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":235385,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":639108,"apply.run_cpu_time_us":5404,"apply.run_wall_time_us":217847,"num_ops":1,"prepare.queue_time_us":130994,"prepare.run_cpu_time_us":230288,"prepare.run_wall_time_us":607399,"raft.queue_time_us":911425,"raft.run_cpu_time_us":35075,"raft.run_wall_time_us":836915,"replication_time_us":1555491,"spinlock_wait_cycles":11648,"thread_start_us":1261840,"threads_started":4,"wal-append.queue_time_us":817524}]]}
I20260709 12:24:45.552330 10925 consensus_queue.cc:237] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:45.548810 10819 leader_election.cc:304] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:45.568156 10819 leader_election.cc:304] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:45.566802 10820 leader_election.cc:304] T e8b17195a94142039c40f598ed006c94 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:45.578644 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:45.560961 12019 raft_consensus.cc:493] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:45.551447 10749 catalog_manager.cc:5697] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 3 to 4, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 4 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:45.580060 12312 raft_consensus.cc:2804] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:45.569701 12204 raft_consensus.cc:2804] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:45.588037 12312 raft_consensus.cc:493] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:45.591214 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6a1da21304fcfacab384a6afc4101" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:45.591813 10968 leader_election.cc:304] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:45.588712 12019 raft_consensus.cc:3060] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:45.607724 10968 leader_election.cc:304] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:45.591182 12204 raft_consensus.cc:493] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:45.595067 12312 raft_consensus.cc:3060] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:45.636459 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 69745us
I20260709 12:24:45.658022 12110 consensus_queue.cc:1059] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 12:24:45.658450 12335 leader_election.cc:290] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:24:45.658337 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 50752.6us
I20260709 12:24:45.659029 12042 consensus_queue.cc:1048] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 12:24:45.663056 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:45.595218 12373 raft_consensus.cc:2749] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:45.611495 12305 raft_consensus.cc:2749] T e8b17195a94142039c40f598ed006c94 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:24:45.670028 10818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:45.608047 12386 raft_consensus.cc:493] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.672952 12376 raft_consensus.cc:2804] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:45.612502 12204 raft_consensus.cc:3060] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:45.689072 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:45.669414 10895 leader_election.cc:304] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:45.667820 12385 raft_consensus.cc:493] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:45.607295 12164 consensus_queue.cc:1048] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.094s
I20260709 12:24:45.711858 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:45.697471 12376 raft_consensus.cc:493] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:45.717643 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 110060us
I20260709 12:24:45.723634 10895 leader_election.cc:304] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:45.685285 12352 raft_consensus.cc:515] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:45.737323 10817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:45.708256 12335 consensus_queue.cc:1048] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 12:24:45.738977 10968 leader_election.cc:304] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
W20260709 12:24:45.740658 10893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:45.728147 12014 raft_consensus.cc:2804] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:45.728484 12376 raft_consensus.cc:3060] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:45.711812 12386 raft_consensus.cc:515] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:45.746699 12014 raft_consensus.cc:493] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:45.754779 12014 raft_consensus.cc:3060] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:45.756158 12386 leader_election.cc:290] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:45.757100 10923 raft_consensus.cc:1240] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:45.751931 12332 raft_consensus.cc:493] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.766099 10820 leader_election.cc:304] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:45.754174 12352 leader_election.cc:290] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:24:45.764060 12419 log.cc:927] Time spent T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 12:24:45.777443 10895 leader_election.cc:304] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:45.747479 12351 raft_consensus.cc:2804] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:45.733386 12385 raft_consensus.cc:515] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:45.791412 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 52572.3us
I20260709 12:24:45.770725 12108 raft_consensus.cc:2749] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:45.757735 12067 consensus_queue.cc:1048] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:24:45.785230 12351 raft_consensus.cc:493] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:45.791590 12110 raft_consensus.cc:2804] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:45.780728 12335 raft_consensus.cc:493] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.805732 12328 raft_consensus.cc:493] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:45.806030 12335 raft_consensus.cc:515] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:45.806377 12328 raft_consensus.cc:515] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:45.806882 12385 leader_election.cc:290] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:45.808615 12328 leader_election.cc:290] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:45.808960 12335 leader_election.cc:290] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:45.804136 10968 leader_election.cc:304] T d0aed74af73a488f8b691578ca370226 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:45.768611 12332 raft_consensus.cc:515] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:24:45.804961 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 58469.7us
W20260709 12:24:45.819353 12417 log.cc:927] Time spent T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.129s	user 0.000s	sys 0.002s
I20260709 12:24:45.819844 12332 leader_election.cc:290] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:24:45.812561 12110 raft_consensus.cc:493] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
W20260709 12:24:45.799526 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 64349.2us
I20260709 12:24:45.820569 12110 raft_consensus.cc:3060] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:45.804279 12351 raft_consensus.cc:3060] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:45.830056 10893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:45.832265 10820 leader_election.cc:304] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:24:45.848242 12420 log.cc:927] Time spent T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 12:24:45.850467 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac8522e549a46e09593fa4c2e175557" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:45.850519 10820 leader_election.cc:304] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:45.816823 12373 raft_consensus.cc:2749] T d0aed74af73a488f8b691578ca370226 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:45.842162 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:45.848037 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:45.850991 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:45.886296 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63ecfc9bd3945818cfe15c03f001315" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:24:45.887516 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 69973us
W20260709 12:24:45.893270 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 81381.2us
W20260709 12:24:45.898275 10893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:45.858004 12108 raft_consensus.cc:493] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:45.898679 12432 consensus_queue.cc:1048] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.069s
I20260709 12:24:45.904019 12429 raft_consensus.cc:2749] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:45.906455 12376 raft_consensus.cc:515] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:45.890836 12427 raft_consensus.cc:2749] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:45.894124 12328 raft_consensus.cc:2749] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:24:45.911950 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 61572.6us
I20260709 12:24:45.912366 12042 consensus_queue.cc:1059] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:45.913766 10820 leader_election.cc:304] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:45.914489 12385 consensus_queue.cc:1059] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:24:45.914935 12328 raft_consensus.cc:2749] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:45.915391 12385 raft_consensus.cc:3055] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:45.913838 12335 consensus_queue.cc:1059] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:45.915524 10820 leader_election.cc:304] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:45.898744 12347 raft_consensus.cc:3060] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:45.917869 11944 raft_consensus.cc:3055] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:45.911096 12108 raft_consensus.cc:515] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:45.941828 11944 raft_consensus.cc:740] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:45.942426 12376 leader_election.cc:290] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:45.943849 12108 leader_election.cc:290] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:45.926318 12140 raft_consensus.cc:515] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:45.944644 12312 raft_consensus.cc:515] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:45.944145 11944 consensus_queue.cc:260] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:45.946605 12140 leader_election.cc:290] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:45.946197 11944 raft_consensus.cc:3060] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:45.948060 12394 raft_consensus.cc:3055] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:45.948441 12394 raft_consensus.cc:740] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:45.948664 12019 raft_consensus.cc:515] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:45.949752 10927 raft_consensus.cc:1240] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:45.949378 12394 consensus_queue.cc:260] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:45.933959 12432 consensus_queue.cc:1048] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:24:45.952793 12019 leader_election.cc:290] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:45.954123 12332 raft_consensus.cc:3055] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:45.937299 12429 raft_consensus.cc:2749] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:24:45.957171 10819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:45.951208 12394 raft_consensus.cc:3060] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:45.922189 12110 raft_consensus.cc:515] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:45.915912 12385 raft_consensus.cc:740] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
W20260709 12:24:45.981383 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 65987.4us
I20260709 12:24:45.931521 12204 raft_consensus.cc:515] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:45.946645 12312 leader_election.cc:290] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:45.954563 12332 raft_consensus.cc:740] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:45.990562 12204 leader_election.cc:290] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:45.992647 11944 consensus_queue.cc:1048] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:45.990367 12019 consensus_queue.cc:1048] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:45.994729 10820 leader_election.cc:304] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:45.995136 12204 consensus_queue.cc:1059] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:45.996318 12204 raft_consensus.cc:2804] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:45.996755 12110 leader_election.cc:290] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:45.997081 12335 raft_consensus.cc:3055] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:24:45.997970 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 94410.7us
W20260709 12:24:45.999801 10817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:45.992532 12351 raft_consensus.cc:515] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:45.978375 12352 consensus_queue.cc:1048] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:24:45.944644 12014 raft_consensus.cc:515] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:45.997517 12335 raft_consensus.cc:740] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:46.008553 10927 raft_consensus.cc:1240] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:46.000612 12204 raft_consensus.cc:697] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 5 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:45.983772 12385 consensus_queue.cc:260] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:46.021395 10819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:46.021989 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c913e527ff46578e084c41eab7bb9d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:46.022632 10927 raft_consensus.cc:3060] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:46.004968 12434 consensus_queue.cc:1048] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 12:24:46.017038 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:46.030280 12385 raft_consensus.cc:3060] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:46.032070 12204 consensus_queue.cc:237] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:46.035414 10968 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.116.65:46265 timed out after 2.203s (SENT) [suppressed 13 similar messages]
I20260709 12:24:46.036564 12351 leader_election.cc:290] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:46.036142 12335 consensus_queue.cc:260] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:46.037905 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:46.038957 12014 leader_election.cc:290] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:46.039155 10921 raft_consensus.cc:1240] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:46.045728 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:46.047645 10999 raft_consensus.cc:1240] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 LEADER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:24:46.049196 11624 raft_consensus.cc:1240] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:24:46.015215 12332 consensus_queue.cc:260] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:46.075716 12332 raft_consensus.cc:3060] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:46.076956 12140 raft_consensus.cc:493] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:46.077628 12140 raft_consensus.cc:515] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:46.080160 12140 leader_election.cc:290] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:46.040428 12176 consensus_queue.cc:1059] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:24:46.086989 10849 raft_consensus.cc:2468] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 4.
I20260709 12:24:46.088718 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:46.045709 12347 consensus_queue.cc:1059] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 12:24:46.090919 10999 raft_consensus.cc:1275] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:24:46.106213 12335 raft_consensus.cc:3060] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:46.108911 10892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:46.109511 11003 raft_consensus.cc:1275] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:24:46.114637 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:46.093446 12427 raft_consensus.cc:3055] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:46.109297 11622 raft_consensus.cc:1275] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [term 1 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:24:46.119472 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:46.113088 11003 pending_rounds.cc:85] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08: Aborting all ops after (but not including) 1
I20260709 12:24:46.124022 11003 pending_rounds.cc:107] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:24:46.124398 11003 raft_consensus.cc:2889] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:46.129976 10999 raft_consensus.cc:1240] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 5. Current term is 6. Ops: []
W20260709 12:24:46.133442 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 98088.4us
I20260709 12:24:46.133071 10998 raft_consensus.cc:3060] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:46.135407 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:46.138190 10994 raft_consensus.cc:3060] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:46.142658 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:46.152216 12176 raft_consensus.cc:3055] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:46.152796 12176 raft_consensus.cc:740] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:46.153803 12176 consensus_queue.cc:260] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:46.153823 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:46.155189 11003 raft_consensus.cc:3060] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:46.120765 12427 raft_consensus.cc:740] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:46.157986 10927 raft_consensus.cc:2468] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 4.
I20260709 12:24:46.155181 12176 raft_consensus.cc:3060] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:46.167110 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad766f48812a4ddeb383179b1d84907b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:46.171146 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad766f48812a4ddeb383179b1d84907b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:46.172986 10999 raft_consensus.cc:3060] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:46.182499 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:46.185173 10968 leader_election.cc:304] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:46.176149 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:24:46.203553 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:46.229128 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:46.229905 10853 raft_consensus.cc:2468] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 3.
I20260709 12:24:46.231599 10852 raft_consensus.cc:1240] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 2. Current term is 4. Ops: []
I20260709 12:24:46.233178 10853 raft_consensus.cc:1275] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 12:24:46.233639 10853 pending_rounds.cc:85] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040: Aborting all ops after (but not including) 4
I20260709 12:24:46.233974 10853 pending_rounds.cc:107] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 12:24:46.234280 10853 raft_consensus.cc:2889] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:46.235661 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:46.247118 10999 raft_consensus.cc:2468] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 2.
I20260709 12:24:46.247208 10848 raft_consensus.cc:2393] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 5: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:24:46.248608 11003 raft_consensus.cc:2468] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 4.
I20260709 12:24:46.249697 10998 raft_consensus.cc:2468] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 6.
I20260709 12:24:46.259963 10994 raft_consensus.cc:2468] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 4.
W20260709 12:24:46.265640 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 80540.9us
I20260709 12:24:46.249697 12140 raft_consensus.cc:2749] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:46.272455 10854 raft_consensus.cc:2468] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 4.
I20260709 12:24:46.280465 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:46.280978 12386 raft_consensus.cc:493] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:46.287462 10999 raft_consensus.cc:1240] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:46.295815 11003 raft_consensus.cc:1240] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:46.296882 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:46.299422 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c913e527ff46578e084c41eab7bb9d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:46.300379 10998 raft_consensus.cc:2468] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 2.
I20260709 12:24:46.300444 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:46.302747 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c913e527ff46578e084c41eab7bb9d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:46.303606 10927 raft_consensus.cc:2368] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for earlier term 3. Current term is 4.
W20260709 12:24:46.306532 10893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:46.306866 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:46.308156 11002 raft_consensus.cc:1240] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:24:46.281492 12386 raft_consensus.cc:515] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:46.311432 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:46.313402 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:46.315743 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:46.280517 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:24:46.319605 10893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:46.321661 10850 raft_consensus.cc:2393] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 4: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:24:46.330200 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6a1da21304fcfacab384a6afc4101" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:46.331094 10999 raft_consensus.cc:2410] T dad6a1da21304fcfacab384a6afc4101 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:24:46.233989 12427 consensus_queue.cc:260] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:46.286845 12140 consensus_queue.cc:1048] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 12:24:46.334596 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:46.319042 11621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac8522e549a46e09593fa4c2e175557" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:24:46.342048 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:46.345111 10999 raft_consensus.cc:2393] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 6: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:24:46.347462 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:46.333832 12347 raft_consensus.cc:493] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.334292 12332 raft_consensus.cc:493] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:46.354110 10895 leader_election.cc:304] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:46.351954 12328 raft_consensus.cc:493] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.338094 12067 consensus_queue.cc:1048] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 12:24:46.367904 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:46.364801 10895 leader_election.cc:304] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:46.371694 10895 leader_election.cc:304] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:46.372494 10895 leader_election.cc:304] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:46.359503 12427 raft_consensus.cc:3060] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:46.341483 12108 consensus_queue.cc:1048] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 12:24:46.377293 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:46.378901 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:46.379232 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:46.379788 10854 raft_consensus.cc:2468] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 3.
I20260709 12:24:46.343317 12435 consensus_queue.cc:1059] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 12:24:46.353436 12204 raft_consensus.cc:493] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:46.352788 11621 raft_consensus.cc:2468] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 4.
I20260709 12:24:46.386502 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:46.387334 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:46.375761 12038 raft_consensus.cc:2804] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:46.389338 11000 raft_consensus.cc:1240] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:24:46.374472 12332 raft_consensus.cc:515] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:46.369628 12347 raft_consensus.cc:515] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:46.390703 12454 ts_tablet_manager.cc:933] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d: Initiating tablet copy from peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265)
I20260709 12:24:46.374433 12353 raft_consensus.cc:2804] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:46.392112 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:46.403414 12332 leader_election.cc:290] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:46.370616 12438 raft_consensus.cc:2804] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:46.410800 10968 leader_election.cc:400] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 pre-election: Vote denied by peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339) with higher term. Message: Invalid argument: T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for earlier term 3. Current term is 4.
I20260709 12:24:46.423803 10968 leader_election.cc:403] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:46.426453 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:46.380788 11944 raft_consensus.cc:2804] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:24:46.442711 10893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:46.427623 12353 raft_consensus.cc:697] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:46.457599 12386 leader_election.cc:290] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:46.428947 12038 raft_consensus.cc:697] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 4 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:46.457846 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:46.464282 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:46.376608 12328 raft_consensus.cc:515] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:46.476877 10853 raft_consensus.cc:2468] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 2.
I20260709 12:24:46.432734 12347 leader_election.cc:290] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:46.486285 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:46.432624 12438 raft_consensus.cc:697] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [term 2 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
W20260709 12:24:46.480944 12400 log.cc:927] Time spent T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:24:46.407651 12204 raft_consensus.cc:515] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:46.505146 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:46.458137 12353 consensus_queue.cc:237] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:46.479861 11944 raft_consensus.cc:697] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:46.473767 12456 raft_consensus.cc:493] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:46.508951 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
W20260709 12:24:46.512003 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 134170us
W20260709 12:24:46.521521 10892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:46.503852 12376 raft_consensus.cc:3060] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:24:46.532621 11944 consensus_queue.cc:237] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:46.534296 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:46.535009 10854 raft_consensus.cc:2468] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 3.
I20260709 12:24:46.535974 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c6d38c4d8a90a81975a6a0cb13" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:46.536674 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:46.526595 12454 tablet_copy_client.cc:323] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Beginning tablet copy session from remote peer at address 127.9.116.65:46265
I20260709 12:24:46.540309 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad766f48812a4ddeb383179b1d84907b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:46.540645 12038 consensus_queue.cc:237] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:46.541570 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:46.542744 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:46.543900 10848 raft_consensus.cc:2468] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 1.
I20260709 12:24:46.544834 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:46.545202 12204 leader_election.cc:290] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:46.546010 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad766f48812a4ddeb383179b1d84907b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:46.547058 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6a1da21304fcfacab384a6afc4101" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:46.548122 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:46.551529 10848 raft_consensus.cc:2468] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 2.
I20260709 12:24:46.555006 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:46.555909 10850 raft_consensus.cc:2468] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 2.
I20260709 12:24:46.556880 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:46.557410 10850 raft_consensus.cc:2376] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 4. Re-sending same reply.
I20260709 12:24:46.558243 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18294423a68a4671bf6c5a0f98645e4c" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:46.523540 12456 raft_consensus.cc:515] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:46.559352 10847 raft_consensus.cc:2468] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 5.
I20260709 12:24:46.548493 12328 leader_election.cc:290] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:46.561872 10853 raft_consensus.cc:2468] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 3.
I20260709 12:24:46.553624 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fd8fdac2fa449e9e184f3d668ea1a7" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:46.574596 10894 leader_election.cc:304] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:46.575672 12434 raft_consensus.cc:2804] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:46.576381 12434 raft_consensus.cc:697] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 4 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:46.577657 12434 consensus_queue.cc:237] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:24:46.579836 10854 raft_consensus.cc:2376] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 5. Re-sending same reply.
I20260709 12:24:46.584233 10848 raft_consensus.cc:1275] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:24:46.585466 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:24:46.587167 10819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:46.587769 10819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:46.588184 10819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:46.596902 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:46.598701 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:46.600343 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9331e5342644ca2bae19187b083a7d5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:46.601047 10848 raft_consensus.cc:2468] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 1.
I20260709 12:24:46.601770 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b17195a94142039c40f598ed006c94" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:46.603739 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:46.605080 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:46.608049 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:46.608572 10923 raft_consensus.cc:2468] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 3.
I20260709 12:24:46.610316 10848 raft_consensus.cc:2468] T e8b17195a94142039c40f598ed006c94 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 1.
I20260709 12:24:46.611374 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63ecfc9bd3945818cfe15c03f001315" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:46.617448 12441 raft_consensus.cc:3055] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:46.617893 12441 raft_consensus.cc:740] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
W20260709 12:24:46.618487 12385 consensus_meta.cc:287] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040: Time spent flushing consensus metadata: real 0.573s	user 0.012s	sys 0.001s
I20260709 12:24:46.618747 12441 consensus_queue.cc:260] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:46.622341 12376 raft_consensus.cc:2749] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339) with higher term. Message: Invalid argument: T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for earlier term 3. Current term is 4.
I20260709 12:24:46.629261 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
W20260709 12:24:46.626653 10817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:46.627892 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:46.623770 12456 leader_election.cc:290] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:46.631840 10854 raft_consensus.cc:2468] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 1.
I20260709 12:24:46.633934 10819 leader_election.cc:304] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:46.630533 10894 leader_election.cc:304] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:46.641628 10921 raft_consensus.cc:1240] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 4 LEADER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:46.642835 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:46.644274 10848 raft_consensus.cc:2468] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 3.
I20260709 12:24:46.641914 12176 raft_consensus.cc:2804] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:46.648644 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d9a61ecaf84695b70f8519ee57706f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:46.648825 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:46.649294 10848 raft_consensus.cc:3060] T e3d9a61ecaf84695b70f8519ee57706f P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:46.650326 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:46.650804 10854 raft_consensus.cc:3060] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:46.627584 12438 consensus_queue.cc:237] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:46.652881 11944 consensus_queue.cc:1048] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:46.656497 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c913e527ff46578e084c41eab7bb9d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:46.647795 10864 tablet_copy_service.cc:140] P 80cd7d227db44f34a6108591dad9c040: Received BeginTabletCopySession request for tablet 3f8a389131ef4c77a3e08488aa4759eb from peer 3c52e0825c02476e89d84da9bb849f5d ({username='slave'} at 127.0.0.1:46480)
I20260709 12:24:46.658334 10864 tablet_copy_service.cc:161] P 80cd7d227db44f34a6108591dad9c040: Beginning new tablet copy session on tablet 3f8a389131ef4c77a3e08488aa4759eb from peer 3c52e0825c02476e89d84da9bb849f5d at {username='slave'} at 127.0.0.1:46480: session id = 3c52e0825c02476e89d84da9bb849f5d-3f8a389131ef4c77a3e08488aa4759eb
W20260709 12:24:46.660336 10895 consensus_peers.cc:597] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613): Couldn't send request to peer 3c52e0825c02476e89d84da9bb849f5d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 438b1d5ca177401b94c157e6f4836150. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:46.660851 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 285375us
I20260709 12:24:46.643610 12441 raft_consensus.cc:3060] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:46.655066 10894 leader_election.cc:304] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:24:46.673720 10895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:46.668905 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c913e527ff46578e084c41eab7bb9d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:46.674609 10854 raft_consensus.cc:2468] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 6.
I20260709 12:24:46.648491 12038 raft_consensus.cc:2804] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:46.686820 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:46.686992 10894 leader_election.cc:304] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:46.691742 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:46.694561 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:46.696255 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:46.698764 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:46.688861 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:46.709090 10994 raft_consensus.cc:2468] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 4.
W20260709 12:24:46.708444 10968 leader_election.cc:336] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Timed out: RequestConsensusVote RPC to 127.9.116.65:46265 timed out after 1.524s (SENT)
I20260709 12:24:46.692022 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:46.686235 10852 raft_consensus.cc:2468] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 6.
I20260709 12:24:46.696098 10848 raft_consensus.cc:2468] T e3d9a61ecaf84695b70f8519ee57706f P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 4.
I20260709 12:24:46.640872 12385 consensus_queue.cc:1059] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 12:24:46.722002 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352aa49c65194abbb863d7553a091f11" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:46.723407 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c6d38c4d8a90a81975a6a0cb13" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:46.725905 10846 raft_consensus.cc:2376] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 5. Re-sending same reply.
I20260709 12:24:46.726893 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
W20260709 12:24:46.727087 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 57087.4us
I20260709 12:24:46.727854 10925 raft_consensus.cc:2393] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 4: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:24:46.727972 10894 leader_election.cc:304] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:46.713848 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:46.729216 10849 raft_consensus.cc:2410] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:24:46.729203 10848 raft_consensus.cc:2468] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 2.
I20260709 12:24:46.728077 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef3220c51df47db8859f07ab745fad5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:46.685132 12042 raft_consensus.cc:3060] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:46.696714 11621 raft_consensus.cc:1275] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:24:46.731931 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:46.732862 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:46.686349 12038 raft_consensus.cc:493] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:46.735077 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac83709373b4efd9c3aa1472a9f9022" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:46.731540 10846 raft_consensus.cc:2468] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 1.
I20260709 12:24:46.695688 12353 consensus_queue.cc:1048] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 12:24:46.736485 12019 raft_consensus.cc:2804] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:24:46.737105 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 61634.9us
I20260709 12:24:46.733479 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:46.740327 12014 raft_consensus.cc:3060] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:46.742427 10854 raft_consensus.cc:2468] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 1.
I20260709 12:24:46.747231 10894 leader_election.cc:304] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:46.749557 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63ecfc9bd3945818cfe15c03f001315" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:46.748481 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:46.751000 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:46.751688 10854 raft_consensus.cc:2468] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 3.
I20260709 12:24:46.741925 12038 raft_consensus.cc:3060] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:46.748796 10968 leader_election.cc:336] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Timed out: RequestConsensusVote RPC to 127.9.116.65:46265 timed out after 1.526s (SENT)
I20260709 12:24:46.753278 10995 raft_consensus.cc:2468] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 4.
I20260709 12:24:46.753482 10846 raft_consensus.cc:2410] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:24:46.752856 10968 leader_election.cc:304] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:46.754058 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:46.749202 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
W20260709 12:24:46.759074 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 115336us
I20260709 12:24:46.761118 10819 leader_election.cc:304] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:46.765762 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:46.767848 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:46.748886 12019 raft_consensus.cc:697] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:46.773725 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:46.771205 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:46.755897 10851 raft_consensus.cc:2468] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 6.
I20260709 12:24:46.780818 10994 raft_consensus.cc:2468] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 4.
I20260709 12:24:46.782680 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:46.783075 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:46.796641 10854 raft_consensus.cc:2468] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 5.
W20260709 12:24:46.802057 10820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:46.804256 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:46.804625 10852 raft_consensus.cc:1275] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:24:46.781028 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
W20260709 12:24:46.805835 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 55628.1us
I20260709 12:24:46.806384 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:46.806955 10854 raft_consensus.cc:1240] T e3d9a61ecaf84695b70f8519ee57706f P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:24:46.752966 10922 raft_consensus.cc:3060] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:46.815090 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 54095.4us
I20260709 12:24:46.808584 10848 raft_consensus.cc:2393] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 4: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:24:46.811451 12162 raft_consensus.cc:493] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:46.813557 10864 tablet_copy_source_session.cc:215] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:46.821337 10853 raft_consensus.cc:2468] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 3.
I20260709 12:24:46.774973 12376 raft_consensus.cc:2749] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:46.830248 10849 raft_consensus.cc:1240] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:24:46.773511 12176 raft_consensus.cc:697] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:46.784557 12352 raft_consensus.cc:2749] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:24:46.849759 10893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:46.856122 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 109758us
I20260709 12:24:46.841763 12386 raft_consensus.cc:2804] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:46.876422 12465 raft_consensus.cc:493] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.877136 12176 consensus_queue.cc:237] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:46.877390 12465 raft_consensus.cc:515] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:46.880569 12474 log.cc:927] Time spent T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 12:24:46.876502 12019 consensus_queue.cc:237] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:46.882656 12469 log.cc:927] Time spent T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 12:24:46.883028 12454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f8a389131ef4c77a3e08488aa4759eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:46.886797 10820 leader_election.cc:304] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:46.824287 10853 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
mode: GRACEFUL
new_leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:47358
I20260709 12:24:46.887539 10853 raft_consensus.cc:606] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Received request to transfer leadership to TS edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:46.887926 10853 raft_consensus.cc:614] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:46.864617 12464 raft_consensus.cc:493] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.831812 12162 raft_consensus.cc:515] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:46.885279 12386 raft_consensus.cc:493] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:46.894137 12464 raft_consensus.cc:515] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:46.902371 12456 raft_consensus.cc:493] T 3f8a389131ef4c77a3e08488aa4759eb P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:46.840679 12427 consensus_queue.cc:1059] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 12:24:46.903030 12456 raft_consensus.cc:515] T 3f8a389131ef4c77a3e08488aa4759eb P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:24:46.903786 12427 consensus_queue.cc:1243] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer e2d5c637307a407ab688f5ccd6f0fcea log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:24:46.894647 12386 raft_consensus.cc:3060] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:46.904450 12427 raft_consensus.cc:3055] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:46.904801 12427 raft_consensus.cc:740] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:46.905083 12335 raft_consensus.cc:3055] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:46.905504 12335 raft_consensus.cc:740] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:46.905602 12427 consensus_queue.cc:260] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:46.906402 12335 consensus_queue.cc:260] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:46.858438 12394 consensus_queue.cc:1048] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 12:24:46.910017 12205 raft_consensus.cc:2804] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:46.910506 12205 raft_consensus.cc:493] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:46.910857 12205 raft_consensus.cc:3060] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:46.896595 12162 leader_election.cc:290] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:46.914515 12465 leader_election.cc:290] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:24:46.929148 10819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:46.937511 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 115088us
W20260709 12:24:46.950145 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 63413us
I20260709 12:24:46.951964 10749 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60730 (request call id 133) took 6271 ms. Trace:
W20260709 12:24:46.990188 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 156055us
I20260709 12:24:47.004597 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:24:47.017978 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 59885.1us
I20260709 12:24:46.950162 12427 raft_consensus.cc:3060] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:47.034431 10820 leader_election.cc:304] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:46.964217 12335 raft_consensus.cc:3060] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:46.956529 12038 raft_consensus.cc:515] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:47.040439 12347 raft_consensus.cc:2749] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:47.040769 12465 raft_consensus.cc:493] T a6a28416571247df878823d464c05f1e P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:47.047281 12038 leader_election.cc:290] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:47.047148 12465 raft_consensus.cc:515] T a6a28416571247df878823d464c05f1e P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:47.051513 12465 leader_election.cc:290] T a6a28416571247df878823d464c05f1e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
W20260709 12:24:47.053793 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 196940us
I20260709 12:24:47.018066 12456 leader_election.cc:290] T 3f8a389131ef4c77a3e08488aa4759eb P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:24:47.057133 10968 leader_election.cc:336] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Timed out: RequestConsensusVote RPC to 127.9.116.65:46265 timed out after 1.585s (SENT)
I20260709 12:24:47.068538 12291 consensus_queue.cc:1048] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:47.070441 12438 consensus_queue.cc:1048] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:47.073894 12042 raft_consensus.cc:2749] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:24:47.074661 10968 leader_election.cc:336] T dad6a1da21304fcfacab384a6afc4101 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Timed out: RequestConsensusVote RPC to 127.9.116.65:46265 timed out after 1.713s (SENT)
I20260709 12:24:47.074931 10923 raft_consensus.cc:1240] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:47.075212 10968 leader_election.cc:304] T dad6a1da21304fcfacab384a6afc4101 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:47.061902 10820 leader_election.cc:304] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:47.055955 12464 leader_election.cc:290] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:46.959393 10749 rpcz_store.cc:276] 0709 12:24:40.644475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:40.676733 (+ 32258us) service_pool.cc:224] Handling call
0709 12:24:46.915514 (+6238781us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:46.029322 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:46.065468 (+ 36146us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:46.065526 (+    58us) write_op.cc:435] Acquired schema lock
0709 12:24:46.065544 (+    18us) tablet.cc:662] Decoding operations
0709 12:24:46.065943 (+   399us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:46.066045 (+   102us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:46.066134 (+    89us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:24:46.066445 (+   311us) tablet.cc:701] Row locks acquired
0709 12:24:46.066494 (+    49us) write_op.cc:260] PREPARE: finished
0709 12:24:46.066652 (+   158us) write_op.cc:270] Start()
0709 12:24:46.066805 (+   153us) write_op.cc:276] Timestamp: P: 1783599886066590 usec, L: 0
0709 12:24:46.066826 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:24:46.067540 (+   714us) log.cc:844] Serialized 537 byte log entry
0709 12:24:46.181080 (+113540us) op_driver.cc:464] REPLICATION: finished
0709 12:24:46.357050 (+175970us) write_op.cc:301] APPLY: starting
0709 12:24:46.363729 (+  6679us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:46.371380 (+  7651us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:46.390602 (+ 19222us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:46.390854 (+   252us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:46.391019 (+   165us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:24:46.391076 (+    57us) write_op.cc:312] APPLY: finished
0709 12:24:46.391275 (+   199us) log.cc:844] Serialized 22 byte log entry
0709 12:24:46.392092 (+   817us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:46.392176 (+    84us) write_op.cc:454] Released schema lock
0709 12:24:46.392212 (+    36us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:46.430857 (+ 38645us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:46.458697 (+ 27840us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":78341,"reported_tablets":21,"child_traces":[["op",{"apply.queue_time_us":154292,"apply.run_cpu_time_us":2112,"apply.run_wall_time_us":57018,"num_ops":1,"prepare.queue_time_us":223531,"prepare.run_cpu_time_us":3576,"prepare.run_wall_time_us":73598,"replication_time_us":99594,"thread_start_us":251666,"threads_started":2}]]}
I20260709 12:24:47.053486 12480 consensus_queue.cc:1048] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 12:24:47.110173 10820 leader_election.cc:304] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:47.116209 10820 leader_election.cc:304] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:47.129338 10820 leader_election.cc:304] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:24:47.129952 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 55338.7us
I20260709 12:24:47.102805 12328 raft_consensus.cc:2749] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:47.103754 12456 raft_consensus.cc:2749] T dad6a1da21304fcfacab384a6afc4101 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:47.125114 12347 raft_consensus.cc:2749] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:24:47.147142 10968 leader_election.cc:336] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Timed out: RequestConsensusVote RPC to 127.9.116.65:46265 timed out after 1.803s (SENT)
W20260709 12:24:47.149206 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 94981us
I20260709 12:24:47.130272 12204 raft_consensus.cc:2749] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:24:47.165300 10968 leader_election.cc:336] T 69fd8fdac2fa449e9e184f3d668ea1a7 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Timed out: RequestConsensusVote RPC to 127.9.116.65:46265 timed out after 1.820s (SENT)
I20260709 12:24:47.165807 10968 leader_election.cc:304] T 69fd8fdac2fa449e9e184f3d668ea1a7 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:47.171825 12465 raft_consensus.cc:2749] T 69fd8fdac2fa449e9e184f3d668ea1a7 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:47.174875 11621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:24:47.179983 10922 raft_consensus.cc:2468] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 6.
I20260709 12:24:47.181435 10968 leader_election.cc:304] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:47.195561 10854 raft_consensus.cc:1240] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
W20260709 12:24:47.205672 12476 log.cc:927] Time spent T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.314s	user 0.004s	sys 0.000s
I20260709 12:24:47.206449 12456 raft_consensus.cc:2749] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:47.207605 10968 leader_election.cc:304] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:47.208374 12456 raft_consensus.cc:2804] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:47.208775 12456 raft_consensus.cc:493] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:47.209120 12456 raft_consensus.cc:3060] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:47.213378 12386 raft_consensus.cc:515] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:47.219064 10968 leader_election.cc:304] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:47.220141 12464 raft_consensus.cc:2749] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:47.220943 10968 leader_election.cc:304] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:47.222378 12464 raft_consensus.cc:2804] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:47.223207 12464 raft_consensus.cc:493] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:47.223788 12464 raft_consensus.cc:3060] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:47.233744 12014 raft_consensus.cc:2749] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:47.238339 12434 raft_consensus.cc:493] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:47.239002 12434 raft_consensus.cc:515] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:47.241348 12434 leader_election.cc:290] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:24:47.243564 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 114319us
W20260709 12:24:47.243992 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 88950.9us
I20260709 12:24:47.243484 12328 raft_consensus.cc:2749] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:47.245133 10820 leader_election.cc:304] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:24:47.245759 10819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:47.245918 12480 raft_consensus.cc:2749] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:47.246328 10820 leader_election.cc:304] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:47.248015 12204 raft_consensus.cc:2749] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:47.247458 10820 leader_election.cc:304] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:47.253171 12176 raft_consensus.cc:2749] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:47.222999 12205 raft_consensus.cc:515] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:47.254518 10820 leader_election.cc:304] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:47.255330 12176 raft_consensus.cc:2749] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:47.255949 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:47.256963 10820 leader_election.cc:304] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:47.253315 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:47.257836 12176 raft_consensus.cc:2749] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:47.222430 10968 leader_election.cc:304] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:47.248128 12386 leader_election.cc:290] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:47.261248 12465 raft_consensus.cc:2804] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:47.261665 12465 raft_consensus.cc:493] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:47.262032 12465 raft_consensus.cc:3060] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:47.258119 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:47.262909 10923 raft_consensus.cc:3060] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:47.263094 10847 raft_consensus.cc:1275] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:47.255962 12205 leader_election.cc:290] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:24:47.264732 10853 raft_consensus.cc:1240] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 12:24:47.264909 10846 raft_consensus.cc:1275] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:47.265466 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac8522e549a46e09593fa4c2e175557" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
W20260709 12:24:47.267913 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 45553.3us
I20260709 12:24:47.271925 12465 raft_consensus.cc:515] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:47.274457 12465 leader_election.cc:290] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:47.258698 10820 leader_election.cc:304] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:47.286698 12332 raft_consensus.cc:2749] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:24:47.287998 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 246792us
I20260709 12:24:47.293426 12454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:45890 (request call id 66) took 1013 ms. Trace:
I20260709 12:24:47.293285 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:47.296195 10996 raft_consensus.cc:1275] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:47.268685 10968 leader_election.cc:304] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:47.313079 12454 rpcz_store.cc:276] 0709 12:24:46.280139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.280341 (+   202us) service_pool.cc:224] Handling call
0709 12:24:46.404275 (+123934us) ts_tablet_manager.cc:934] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d: Initiating tablet copy from peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265)
0709 12:24:46.881620 (+477345us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:24:47.259848 (+378228us) tablet_metadata.cc:665] Metadata flushed
0709 12:24:47.259988 (+   140us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:24:47.292336 (+ 32348us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:24:47.292762 (+   426us) tablet_replica.cc:206] Creating consensus instance
0709 12:24:47.293222 (+   460us) ts_tablet_manager.cc:989] Replica registered.
0709 12:24:47.293303 (+    81us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":45214,"tablet-copy.queue_time_us":81139,"thread_start_us":122436,"threads_started":2}
I20260709 12:24:47.312835 11002 raft_consensus.cc:1275] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:47.315483 12454 tablet_copy_client.cc:806] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:47.324776 12454 tablet_copy_client.cc:670] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 1 WAL segments...
W20260709 12:24:47.311789 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 174803us
I20260709 12:24:47.325248 12456 raft_consensus.cc:515] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:47.314569 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 45949.7us
I20260709 12:24:47.344067 10968 leader_election.cc:304] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:47.344432 12456 leader_election.cc:290] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:47.345163 12456 raft_consensus.cc:2749] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:47.345356 10968 leader_election.cc:304] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:47.346045 10923 raft_consensus.cc:2468] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 5.
I20260709 12:24:47.346568 10968 leader_election.cc:304] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:47.288291 10820 leader_election.cc:304] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:47.347689 10819 leader_election.cc:304] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
W20260709 12:24:47.347812 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 59606.6us
I20260709 12:24:47.348506 10820 leader_election.cc:304] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:47.349732 10820 leader_election.cc:304] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:47.319779 12465 raft_consensus.cc:2804] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:47.329077 10853 raft_consensus.cc:1275] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:24:47.329062 11002 raft_consensus.cc:3060] T 3f8a389131ef4c77a3e08488aa4759eb P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:47.330547 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:47.332594 11000 raft_consensus.cc:1275] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:47.353322 10968 leader_election.cc:304] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:47.308350 12464 raft_consensus.cc:515] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:47.334649 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:47.354317 10995 raft_consensus.cc:2393] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 3: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:24:47.354156 10820 leader_election.cc:304] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:47.353540 10848 raft_consensus.cc:2468] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 3.
I20260709 12:24:47.351926 12335 raft_consensus.cc:2749] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:47.355556 10820 leader_election.cc:304] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:47.333564 10750 catalog_manager.cc:5697] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 1 to 3, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 3 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } }
I20260709 12:24:47.359445 12506 ts_tablet_manager.cc:933] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d: Initiating tablet copy from peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:47.361770 10820 leader_election.cc:304] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:47.360394 12176 raft_consensus.cc:2749] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:24:47.363104 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 102584us
I20260709 12:24:47.357398 12456 raft_consensus.cc:2749] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:47.351006 12332 raft_consensus.cc:2749] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:47.352334 12427 raft_consensus.cc:2804] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:47.356830 12376 raft_consensus.cc:2804] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:47.368685 12176 raft_consensus.cc:2749] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:47.368636 10968 leader_election.cc:304] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:47.379146 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:47.379629 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:47.380275 10925 raft_consensus.cc:2468] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 2.
I20260709 12:24:47.380893 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:47.381450 10820 leader_election.cc:304] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:47.366641 12464 leader_election.cc:290] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:47.371407 12205 raft_consensus.cc:2804] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:47.360509 12386 raft_consensus.cc:2749] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:47.360379 10750 catalog_manager.cc:5697] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 1 to 3, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 3 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } }
I20260709 12:24:47.381994 10968 leader_election.cc:304] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:47.385495 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:47.388561 10922 raft_consensus.cc:2468] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 2.
I20260709 12:24:47.366783 12456 raft_consensus.cc:2804] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:47.376354 12376 raft_consensus.cc:493] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:47.378023 12427 raft_consensus.cc:697] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 5 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:47.400565 11000 raft_consensus.cc:1240] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:47.394421 10750 catalog_manager.cc:5697] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } }
I20260709 12:24:47.415102 10750 catalog_manager.cc:5697] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:47.420080 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:47.387471 11944 raft_consensus.cc:493] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.386463 12332 raft_consensus.cc:2749] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:24:47.428414 10819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:47.435958 12435 consensus_queue.cc:1048] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:47.437527 12435 consensus_queue.cc:1059] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:47.414114 12376 raft_consensus.cc:3060] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:47.393445 12456 raft_consensus.cc:493] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:47.445847 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac8522e549a46e09593fa4c2e175557" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:24:47.425133 10750 catalog_manager.cc:5697] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 1 to 4, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 4 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:47.392853 12440 consensus_queue.cc:1048] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 12:24:47.455250 12352 raft_consensus.cc:2955] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 LEADER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:24:47.456333 12427 consensus_queue.cc:237] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:47.460930 10895 leader_election.cc:304] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:47.417140 12464 raft_consensus.cc:2804] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:47.442261 10922 raft_consensus.cc:1275] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:47.428845 12508 raft_consensus.cc:2749] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:47.472887 11002 raft_consensus.cc:1275] T 3f8a389131ef4c77a3e08488aa4759eb P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:24:47.467669 10894 leader_election.cc:304] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:47.475278 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:47.477005 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:47.477478 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:47.477630 10853 raft_consensus.cc:2468] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 2.
I20260709 12:24:47.478058 10848 raft_consensus.cc:2468] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 3.
I20260709 12:24:47.478192 10750 catalog_manager.cc:5697] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } }
I20260709 12:24:47.480274 10850 raft_consensus.cc:2393] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 4: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
W20260709 12:24:47.481643 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 99733.7us
I20260709 12:24:47.472393 12464 raft_consensus.cc:493] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:47.485975 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:47.470809 12456 raft_consensus.cc:3060] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:47.473496 12291 raft_consensus.cc:2749] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:47.488791 10968 leader_election.cc:304] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:47.433616 11944 raft_consensus.cc:515] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:47.465323 12483 consensus_queue.cc:1048] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 12:24:47.491856 10848 raft_consensus.cc:1275] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:47.479676 12494 raft_consensus.cc:2804] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:47.472620 12465 raft_consensus.cc:697] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 4 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:47.485375 12464 raft_consensus.cc:3060] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:47.520490 10927 raft_consensus.cc:1240] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:47.522487 10820 leader_election.cc:304] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:47.517177 12386 consensus_queue.cc:1059] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 12:24:47.525699 12204 raft_consensus.cc:3055] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:47.526095 12204 raft_consensus.cc:740] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:47.478809 12478 consensus_queue.cc:1048] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:24:47.528808 10852 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
mode: GRACEFUL
new_leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:47358
I20260709 12:24:47.529461 10852 raft_consensus.cc:606] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Received request to transfer leadership to TS edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:47.529832 10852 raft_consensus.cc:614] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:47.497864 12205 raft_consensus.cc:493] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:47.502859 10895 leader_election.cc:304] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:47.532430 12205 raft_consensus.cc:3060] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:47.533998 12434 raft_consensus.cc:2749] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:47.534619 12042 consensus_queue.cc:1048] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:47.513155 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d9a61ecaf84695b70f8519ee57706f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:47.535337 12038 consensus_queue.cc:1048] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:47.535907 10848 raft_consensus.cc:2468] T e3d9a61ecaf84695b70f8519ee57706f P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 4.
I20260709 12:24:47.526930 12204 consensus_queue.cc:260] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:47.538429 12510 raft_consensus.cc:2804] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:47.538642 12204 raft_consensus.cc:3060] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:47.513236 10850 raft_consensus.cc:1275] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:47.524106 12493 raft_consensus.cc:2955] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
W20260709 12:24:47.539487 12385 consensus_queue.cc:1175] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" responder_term: 6 status { last_received { term: 2 index: 2 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 5. Current term is 6. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:24:47.497957 11944 leader_election.cc:290] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:47.543035 12291 consensus_queue.cc:1048] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:47.488526 10750 catalog_manager.cc:5697] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } }
W20260709 12:24:47.493299 12501 log.cc:927] Time spent T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:24:47.544390 12438 raft_consensus.cc:3055] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:47.550076 12438 raft_consensus.cc:740] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:47.518213 12494 raft_consensus.cc:493] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:47.551385 12438 consensus_queue.cc:260] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:47.552069 12494 raft_consensus.cc:3060] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:47.552690 12438 raft_consensus.cc:3060] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:47.509666 12454 tablet_copy_client.cc:538] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:47.554412 12386 raft_consensus.cc:2749] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:47.539047 12510 raft_consensus.cc:493] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
W20260709 12:24:47.556756 12512 log.cc:927] Time spent T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:24:47.555272 12510 raft_consensus.cc:3060] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:47.546859 11000 raft_consensus.cc:1275] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:47.560649 11000 raft_consensus.cc:1275] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:47.563966 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d9a61ecaf84695b70f8519ee57706f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:47.564862 10998 raft_consensus.cc:2468] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 4.
I20260709 12:24:47.554924 10752 catalog_manager.cc:5697] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: term changed from 1 to 4, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 4 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:24:47.568384 10848 raft_consensus.cc:1240] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 12:24:47.581430 10750 catalog_manager.cc:5697] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:47.548208 12353 consensus_queue.cc:1048] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
W20260709 12:24:47.589417 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 107105us
I20260709 12:24:47.590606 10968 leader_election.cc:304] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:47.519418 12506 tablet_copy_client.cc:323] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Beginning tablet copy session from remote peer at address 127.9.116.66:39339
I20260709 12:24:47.568148 12386 raft_consensus.cc:493] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.593442 10750 catalog_manager.cc:5697] T dad6a1da21304fcfacab384a6afc4101 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 1 to 3, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 3 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } }
I20260709 12:24:47.606830 10750 catalog_manager.cc:5697] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 1 to 3, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 3 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } }
I20260709 12:24:47.608819 10750 catalog_manager.cc:5697] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 3 to 5, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 5 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } }
I20260709 12:24:47.611176 10750 catalog_manager.cc:5697] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:47.621462 10750 catalog_manager.cc:5697] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } }
W20260709 12:24:47.622763 10895 consensus_peers.cc:597] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613): Couldn't send request to peer 3c52e0825c02476e89d84da9bb849f5d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:47.622910 10750 catalog_manager.cc:5697] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } }
I20260709 12:24:47.613736 10968 leader_election.cc:304] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:47.614259 10845 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
mode: GRACEFUL
new_leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:47358
I20260709 12:24:47.628000 10845 raft_consensus.cc:606] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Received request to transfer leadership to TS edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:47.549057 12465 consensus_queue.cc:237] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:47.610468 12164 raft_consensus.cc:493] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.641191 10968 leader_election.cc:304] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:47.613780 12508 raft_consensus.cc:2804] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:47.637676 10894 leader_election.cc:304] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:47.646385 10750 catalog_manager.cc:5697] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 1 to 3, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 3 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } }
I20260709 12:24:47.647970 10750 catalog_manager.cc:5697] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 3 to 5, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 5 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } }
I20260709 12:24:47.618129 12483 raft_consensus.cc:493] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:47.649214 10750 catalog_manager.cc:5697] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 1 to 3, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 3 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } }
I20260709 12:24:47.656271 10994 raft_consensus.cc:1240] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:47.656337 10968 leader_election.cc:304] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040
I20260709 12:24:47.620296 12332 consensus_queue.cc:1048] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 12:24:47.651547 12164 raft_consensus.cc:515] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:47.665251 12164 leader_election.cc:290] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:47.667769 12511 raft_consensus.cc:2749] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:47.668555 12456 raft_consensus.cc:515] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:47.670066 12205 raft_consensus.cc:515] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:24:47.670907 12456 leader_election.cc:290] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:47.615162 12386 raft_consensus.cc:515] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:47.671725 11003 raft_consensus.cc:1240] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:47.673476 12386 leader_election.cc:290] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:47.674479 12483 raft_consensus.cc:515] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:47.675130 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:47.675765 10922 raft_consensus.cc:2468] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 5.
I20260709 12:24:47.677078 12483 leader_election.cc:290] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:47.641769 10845 raft_consensus.cc:614] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:47.680437 10819 leader_election.cc:304] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:47.684581 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:47.685174 10994 raft_consensus.cc:2468] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 6.
I20260709 12:24:47.688897 10750 catalog_manager.cc:5697] T 3f8a389131ef4c77a3e08488aa4759eb P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: config changed from index -1 to 2, term changed from 1 to 3, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New cstate: current_term: 3 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
W20260709 12:24:47.705770 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 68166.5us
I20260709 12:24:47.643705 12435 consensus_queue.cc:1048] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.057s
I20260709 12:24:47.696017 12386 raft_consensus.cc:2804] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:47.705962 12456 raft_consensus.cc:2804] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:47.714393 12432 raft_consensus.cc:2804] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:47.735239 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:47.717648 12386 raft_consensus.cc:493] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:47.744001 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:47.693838 12093 consensus_queue.cc:1048] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:24:47.752928 11001 raft_consensus.cc:2393] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 6: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:24:47.759640 10939 tablet_copy_service.cc:140] P e2d5c637307a407ab688f5ccd6f0fcea: Received BeginTabletCopySession request for tablet 438b1d5ca177401b94c157e6f4836150 from peer 3c52e0825c02476e89d84da9bb849f5d ({username='slave'} at 127.0.0.1:50036)
I20260709 12:24:47.760372 10939 tablet_copy_service.cc:161] P e2d5c637307a407ab688f5ccd6f0fcea: Beginning new tablet copy session on tablet 438b1d5ca177401b94c157e6f4836150 from peer 3c52e0825c02476e89d84da9bb849f5d at {username='slave'} at 127.0.0.1:50036: session id = 3c52e0825c02476e89d84da9bb849f5d-438b1d5ca177401b94c157e6f4836150
I20260709 12:24:47.719974 12464 raft_consensus.cc:515] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:47.764871 12464 leader_election.cc:290] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:47.716251 12067 consensus_queue.cc:1048] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:24:47.743351 12386 raft_consensus.cc:3060] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:47.738966 12432 raft_consensus.cc:493] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:47.742264 12332 raft_consensus.cc:493] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:47.744566 12521 raft_consensus.cc:2749] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:47.739959 12351 consensus_queue.cc:1059] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
W20260709 12:24:47.791455 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 78089.7us
I20260709 12:24:47.726123 12494 raft_consensus.cc:515] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:47.638571 10996 raft_consensus.cc:2955] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:24:47.843669 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:47.802842 12432 raft_consensus.cc:3060] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:47.811648 12518 raft_consensus.cc:493] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:47.844574 12205 leader_election.cc:290] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:47.797513 12376 raft_consensus.cc:515] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:47.813336 12332 raft_consensus.cc:515] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:47.859222 12478 raft_consensus.cc:493] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
W20260709 12:24:47.876416 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 64198.3us
W20260709 12:24:47.912305 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 256069us
I20260709 12:24:47.874096 12456 raft_consensus.cc:697] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 4 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:47.914767 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:47.913803 10853 raft_consensus.cc:2955] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:24:47.920972 10854 raft_consensus.cc:2468] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 6.
W20260709 12:24:47.904239 12516 log.cc:927] Time spent T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.292s	user 0.001s	sys 0.004s
I20260709 12:24:47.876189 12508 raft_consensus.cc:697] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:47.931881 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:47.942893 10848 raft_consensus.cc:1240] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:47.870450 12518 raft_consensus.cc:515] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:47.937295 12520 log.cc:927] Time spent T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
I20260709 12:24:47.925748 12352 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:50034 (request call id 2) took 2584 ms. Trace:
I20260709 12:24:47.952301 10968 leader_election.cc:304] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:47.970217 10968 leader_election.cc:304] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:47.976195 10968 leader_election.cc:304] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:47.979097 12332 leader_election.cc:290] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:47.979362 12465 raft_consensus.cc:2804] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:47.979940 12465 raft_consensus.cc:493] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:47.980345 12465 raft_consensus.cc:3060] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:47.980657 12518 leader_election.cc:290] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:47.981003 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:47.981309 12456 consensus_queue.cc:237] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:47.984515 12454 tablet_bootstrap.cc:492] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap starting.
I20260709 12:24:47.985420 12494 leader_election.cc:290] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:47.986819 12432 raft_consensus.cc:515] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:47.950749 12510 raft_consensus.cc:515] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:47.988350 12376 leader_election.cc:290] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:47.989240 12531 raft_consensus.cc:2749] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:47.989449 12432 leader_election.cc:290] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:47.991151 12508 consensus_queue.cc:237] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:47.989755 12510 leader_election.cc:290] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:48.006284 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
W20260709 12:24:48.010983 12526 log.cc:927] Time spent T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:24:47.996728 10968 leader_election.cc:304] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:48.023065 10968 leader_election.cc:304] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:47.923143 12478 raft_consensus.cc:515] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:47.998562 12531 raft_consensus.cc:2749] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:48.033432 10968 leader_election.cc:304] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:48.034080 12510 raft_consensus.cc:2749] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:48.044596 10968 leader_election.cc:304] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:48.046244 12376 raft_consensus.cc:2804] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:48.045948 12527 raft_consensus.cc:2804] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:48.053552 12518 raft_consensus.cc:2804] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:48.111361 10968 leader_election.cc:304] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:48.112715 11000 raft_consensus.cc:1240] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:48.067999 12376 raft_consensus.cc:493] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:48.077729 12518 raft_consensus.cc:493] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:48.139075 11003 raft_consensus.cc:1240] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:48.076248 12527 raft_consensus.cc:493] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:48.072373 12493 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:59610 (request call id 62) took 2532 ms. Trace:
I20260709 12:24:48.142601 12527 raft_consensus.cc:3060] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:48.165477 12438 consensus_meta.cc:287] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent flushing consensus metadata: real 0.612s	user 0.015s	sys 0.000s
I20260709 12:24:48.170157 12478 leader_election.cc:290] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:47.963799 12352 rpcz_store.cc:276] 0709 12:24:45.327360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:45.327485 (+   125us) service_pool.cc:224] Handling call
0709 12:24:45.453153 (+125668us) log.cc:844] Serialized 499 byte log entry
0709 12:24:47.911256 (+2458103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16677,"raft.queue_time_us":49595,"raft.run_cpu_time_us":2823,"raft.run_wall_time_us":91676,"spinlock_wait_cycles":134400,"thread_start_us":61947,"threads_started":1,"wal-append.queue_time_us":125107,"wal-append.run_cpu_time_us":3758,"wal-append.run_wall_time_us":1223999}
I20260709 12:24:48.117617 12531 raft_consensus.cc:2749] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:24:48.173236 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 92952.3us
W20260709 12:24:48.181115 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 69868.3us
I20260709 12:24:48.129004 12376 raft_consensus.cc:3060] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:48.111609 12386 raft_consensus.cc:515] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:48.198101 12545 log.cc:927] Time spent T 00000000000000000000000000000000 P 9619ad7a9e7f4d9b8039487e3ee77243: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 12:24:48.180717 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:48.181763 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:48.141758 12518 raft_consensus.cc:3060] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:48.202006 11000 raft_consensus.cc:3055] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:48.202396 11000 raft_consensus.cc:740] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:48.202742 12386 leader_election.cc:290] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:48.203266 11000 consensus_queue.cc:260] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:48.204399 11000 raft_consensus.cc:3060] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:48.182109 10968 leader_election.cc:304] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:48.206014 10968 leader_election.cc:304] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:48.182479 10996 raft_consensus.cc:1240] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:48.207854 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d9a61ecaf84695b70f8519ee57706f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:48.183246 11621 raft_consensus.cc:2955] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:24:48.186321 10894 leader_election.cc:304] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:48.188818 12536 raft_consensus.cc:3055] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:48.175534 12014 consensus_queue.cc:1059] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:24:48.191828 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d9a61ecaf84695b70f8519ee57706f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:48.188813 12527 raft_consensus.cc:515] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:48.199990 11002 raft_consensus.cc:2393] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 6: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:24:48.200107 10852 raft_consensus.cc:2368] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for earlier term 6. Current term is 7.
I20260709 12:24:48.200363 10995 raft_consensus.cc:2393] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 3: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:24:48.208750 10847 raft_consensus.cc:3060] T e3d9a61ecaf84695b70f8519ee57706f P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:48.221840 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:48.222321 10819 leader_election.cc:304] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:48.208804 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:48.234122 10996 raft_consensus.cc:3060] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:48.212208 10846 raft_consensus.cc:1275] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:48.210376 12434 raft_consensus.cc:493] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:48.212682 12456 raft_consensus.cc:2804] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:48.212050 10968 leader_election.cc:304] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:48.236707 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:48.247752 10922 raft_consensus.cc:2468] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 6.
I20260709 12:24:48.248513 10968 leader_election.cc:304] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:48.226392 12385 raft_consensus.cc:2749] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:48.251756 12531 raft_consensus.cc:2749] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:48.251374 10922 raft_consensus.cc:1275] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:24:48.210913 12536 raft_consensus.cc:740] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:48.258538 11003 raft_consensus.cc:1240] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:48.260218 10996 raft_consensus.cc:2468] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 7.
I20260709 12:24:48.261695 10820 leader_election.cc:304] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:48.223837 12291 raft_consensus.cc:2804] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:48.264432 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:48.264068 10968 leader_election.cc:304] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:48.265214 10819 leader_election.cc:304] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:48.269938 10922 raft_consensus.cc:3060] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:24:48.271932 10968 leader_election.cc:304] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:48.231923 12510 raft_consensus.cc:2749] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:48.282281 11002 raft_consensus.cc:3060] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:48.252097 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:48.142729 12493 rpcz_store.cc:276] 0709 12:24:45.532010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:45.532264 (+   254us) service_pool.cc:224] Handling call
0709 12:24:45.595512 (+ 63248us) log.cc:844] Serialized 494 byte log entry
0709 12:24:48.064730 (+2469218us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3497,"raft.queue_time_us":7339,"raft.run_cpu_time_us":1477,"raft.run_wall_time_us":5607,"thread_start_us":120927,"threads_started":2,"wal-append.queue_time_us":191781,"wal-append.run_cpu_time_us":2593,"wal-append.run_wall_time_us":1149661}
I20260709 12:24:48.247128 12456 raft_consensus.cc:493] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
W20260709 12:24:48.335037 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 63280.9us
I20260709 12:24:48.257130 12434 raft_consensus.cc:515] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:48.272095 12176 raft_consensus.cc:2749] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:48.337633 10847 raft_consensus.cc:2468] T e3d9a61ecaf84695b70f8519ee57706f P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 5.
I20260709 12:24:48.272964 12332 raft_consensus.cc:2804] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:24:48.340744 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 80480.2us
I20260709 12:24:48.269730 12291 raft_consensus.cc:493] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:48.366564 12291 raft_consensus.cc:3060] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:48.368530 12332 raft_consensus.cc:697] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 7 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:48.369606 12332 consensus_queue.cc:237] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:48.359633 10968 leader_election.cc:304] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:48.372727 12524 raft_consensus.cc:2804] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:48.373253 12524 raft_consensus.cc:493] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:48.373665 12524 raft_consensus.cc:3060] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:48.374996 12534 consensus_queue.cc:1059] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:48.376022 12534 raft_consensus.cc:3055] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:48.376438 12534 raft_consensus.cc:740] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:48.273685 12531 raft_consensus.cc:2804] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:48.281037 12464 raft_consensus.cc:2749] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:48.382513 12494 raft_consensus.cc:493] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.383119 12494 raft_consensus.cc:515] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:48.385105 12494 leader_election.cc:290] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:48.385736 12014 consensus_queue.cc:1059] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:48.385149 12434 leader_election.cc:290] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:24:48.393783 12525 log.cc:927] Time spent T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.487s	user 0.003s	sys 0.000s
I20260709 12:24:48.396724 10819 leader_election.cc:304] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:48.391360 12376 raft_consensus.cc:515] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } }
I20260709 12:24:48.407642 12527 leader_election.cc:290] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:48.408776 12014 raft_consensus.cc:3055] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:48.408950 12376 leader_election.cc:290] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265)
I20260709 12:24:48.409718 12536 consensus_queue.cc:260] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:48.411199 12536 raft_consensus.cc:3060] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:48.411298 12534 consensus_queue.cc:260] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:48.413009 12534 raft_consensus.cc:3060] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:48.414203 10738 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a6a28416571247df878823d464c05f1e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:48.415827 12176 raft_consensus.cc:2804] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:48.416417 12176 raft_consensus.cc:493] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:48.416811 12176 raft_consensus.cc:3060] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:48.381635 12531 raft_consensus.cc:493] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:48.420585 12531 raft_consensus.cc:3060] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:48.426098 10894 leader_election.cc:304] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:48.427932 10894 leader_election.cc:400] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 pre-election: Vote denied by peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265) with higher term. Message: Invalid argument: T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for earlier term 6. Current term is 7.
I20260709 12:24:48.428218 10894 leader_election.cc:403] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:48.431924 12351 consensus_queue.cc:1048] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:48.433993 12038 raft_consensus.cc:2804] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:48.434648 12038 raft_consensus.cc:697] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 5 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:48.356822 12456 raft_consensus.cc:3060] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:48.440575 12014 raft_consensus.cc:740] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
W20260709 12:24:48.361913 12505 log.cc:927] Time spent T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.079s	user 0.002s	sys 0.000s
I20260709 12:24:48.441650 12014 consensus_queue.cc:260] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:24:48.447016 12014 raft_consensus.cc:3060] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:48.409116 12204 consensus_queue.cc:1048] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 12:24:48.457804 10922 raft_consensus.cc:2468] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 7.
I20260709 12:24:48.462321 11002 raft_consensus.cc:1275] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:48.463708 10997 raft_consensus.cc:1240] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:48.467269 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c6d38c4d8a90a81975a6a0cb13" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:48.461616 12351 raft_consensus.cc:2749] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265) with higher term. Message: Invalid argument: T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for earlier term 6. Current term is 7.
I20260709 12:24:48.463925 12511 raft_consensus.cc:2749] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:48.468808 12038 consensus_queue.cc:237] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:48.469970 12465 raft_consensus.cc:515] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:48.465232 11000 raft_consensus.cc:1275] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:24:48.472550 11000 pending_rounds.cc:85] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08: Aborting all ops after (but not including) 2
I20260709 12:24:48.472901 11000 pending_rounds.cc:107] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:24:48.473245 11000 raft_consensus.cc:2889] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:48.497411 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:48.498616 10848 raft_consensus.cc:2468] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 5.
I20260709 12:24:48.387331 12291 raft_consensus.cc:515] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:48.503638 12539 raft_consensus.cc:3055] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:48.504145 12539 raft_consensus.cc:740] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:48.505139 12539 consensus_queue.cc:260] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:48.505712 12291 leader_election.cc:290] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:24:48.520648 10894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:48.524748 10894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:48.536862 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 163079us
I20260709 12:24:48.537765 10968 leader_election.cc:304] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:48.538808 10968 leader_election.cc:304] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:48.541268 10968 leader_election.cc:304] T a6a28416571247df878823d464c05f1e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040
W20260709 12:24:48.526830 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 127997us
I20260709 12:24:48.525544 12465 leader_election.cc:290] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:48.575112 10927 raft_consensus.cc:1240] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:48.577337 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:48.577517 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:48.579083 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:48.580032 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b17195a94142039c40f598ed006c94" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
W20260709 12:24:48.581823 10968 connection.cc:256] RPC call timeout handler was delayed by -1.2385032689999207s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1535s for a response
I20260709 12:24:48.583986 10850 raft_consensus.cc:3060] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:48.585423 10968 leader_election.cc:304] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:24:48.587306 10998 raft_consensus.cc:1240] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:48.594194 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:48.547323 12527 raft_consensus.cc:2804] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:48.572621 12539 raft_consensus.cc:3060] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:48.572288 12464 raft_consensus.cc:2804] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:48.609862 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab816bcc6183447994a2cc013e46c5f8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:48.527001 12518 raft_consensus.cc:515] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:48.573642 12376 raft_consensus.cc:2749] T a6a28416571247df878823d464c05f1e P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:24:48.596115 12522 log.cc:927] Time spent T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:24:48.621142 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:48.625854 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:48.623304 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:48.632261 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9331e5342644ca2bae19187b083a7d5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:48.635824 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c6d38c4d8a90a81975a6a0cb13" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:24:48.635738 12541 log.cc:927] Time spent T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:24:48.637593 12518 leader_election.cc:290] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:48.637630 11003 raft_consensus.cc:1240] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:48.604683 12527 raft_consensus.cc:493] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:48.612434 12464 raft_consensus.cc:493] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:48.641598 10894 leader_election.cc:304] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:48.644944 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:48.645433 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:48.648038 10925 raft_consensus.cc:2468] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 3.
I20260709 12:24:48.654748 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef3220c51df47db8859f07ab745fad5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:48.658124 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
W20260709 12:24:48.659046 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 73779.3us
I20260709 12:24:48.659885 11000 raft_consensus.cc:1240] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:48.659760 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:48.660779 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:48.660929 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:48.661834 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:48.654500 12464 raft_consensus.cc:3060] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:48.663157 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:48.670578 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:48.664449 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef3220c51df47db8859f07ab745fad5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:48.672668 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9331e5342644ca2bae19187b083a7d5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
W20260709 12:24:48.674741 12556 log.cc:927] Time spent T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 12:24:48.674909 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:48.677042 10920 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
mode: GRACEFUL
new_leader_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:41546
I20260709 12:24:48.677659 10920 raft_consensus.cc:606] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 LEADER]: Received request to transfer leadership to TS 80cd7d227db44f34a6108591dad9c040
I20260709 12:24:48.665444 10850 raft_consensus.cc:2468] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 7.
I20260709 12:24:48.661509 10968 leader_election.cc:304] T 3f8a389131ef4c77a3e08488aa4759eb P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:48.638191 12557 raft_consensus.cc:2804] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:48.640872 12527 raft_consensus.cc:3060] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:48.661890 12545 log.cc:927] Time spent T 00000000000000000000000000000000 P 9619ad7a9e7f4d9b8039487e3ee77243: Append to log took a long time: real 0.155s	user 0.000s	sys 0.002s
I20260709 12:24:48.681854 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b17195a94142039c40f598ed006c94" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:48.681071 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:48.698164 12524 raft_consensus.cc:515] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:48.704432 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab816bcc6183447994a2cc013e46c5f8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:48.694417 12376 consensus_queue.cc:1059] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 12:24:48.718429 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:48.705140 12456 raft_consensus.cc:515] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:48.706300 10847 raft_consensus.cc:1240] T e3d9a61ecaf84695b70f8519ee57706f P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:48.690730 12518 raft_consensus.cc:2749] T 3f8a389131ef4c77a3e08488aa4759eb P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:48.708706 12524 leader_election.cc:290] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:48.709658 10848 raft_consensus.cc:1240] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 5 LEADER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:48.717891 10894 leader_election.cc:304] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:48.689443 12093 raft_consensus.cc:2804] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:48.764276 10854 raft_consensus.cc:1240] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:48.715059 12176 raft_consensus.cc:515] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:48.769896 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:48.766352 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:48.775817 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:48.776139 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:48.762511 12162 raft_consensus.cc:2804] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:48.759220 12093 raft_consensus.cc:493] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:48.779772 11001 raft_consensus.cc:1240] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:48.780668 12093 raft_consensus.cc:3060] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:48.785035 10845 raft_consensus.cc:2468] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 3.
I20260709 12:24:48.789013 12176 leader_election.cc:290] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:48.790961 12456 leader_election.cc:290] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:24:48.774947 12569 log.cc:927] Time spent T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 12:24:48.767156 12557 raft_consensus.cc:697] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 6 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:48.800362 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:48.806295 11944 raft_consensus.cc:993] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea: : Instructing follower 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:24:48.809692 11001 raft_consensus.cc:1240] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:48.811636 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:48.811895 12564 raft_consensus.cc:3055] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:48.812404 12564 raft_consensus.cc:740] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:48.812935 10939 tablet_copy_source_session.cc:215] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:48.798203 12162 raft_consensus.cc:697] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:48.813309 12564 consensus_queue.cc:260] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:48.815615 12564 raft_consensus.cc:3060] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:48.812041 10894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.815467 12162 consensus_queue.cc:237] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:48.814393 10939 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.0.0.1:50036 (request call id 31) took 1106 ms. Trace:
I20260709 12:24:48.822710 10939 rpcz_store.cc:276] 0709 12:24:47.731310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.759247 (+ 27937us) service_pool.cc:224] Handling call
0709 12:24:48.449210 (+689963us) spinlock_profiling.cc:243] Waited 277 ms on lock 0x7b540012acd4. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e923f7 00007f7599e28036 00007f7599e31a3e 00007f75916f527b 00007f7599e319ba 00007f7599e2cacc 00007f7599e27c7b 00007f7599e1c8d1 00007f7598ed04b4 00007f7598ed0442
0709 12:24:48.812799 (+363589us) spinlock_profiling.cc:243] Waited 362 ms on lock 0x7b540012acd4. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df2090 00007f7594e90f3a 00007f7599e281bb 00007f7599e31a3e 00007f75916f527b 00007f7599e319ba 00007f7599e2cacc 00007f7599e27c7b 00007f7599e1c8d1 00007f7598ed04b4 00007f7598ed0442
0709 12:24:48.814237 (+  1438us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1469033600}
I20260709 12:24:48.858623 12540 consensus_queue.cc:1059] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:48.859217 12506 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 438b1d5ca177401b94c157e6f4836150. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:48.847931 12527 raft_consensus.cc:515] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:48.861683 12464 raft_consensus.cc:515] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:48.863934 12464 leader_election.cc:290] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:48.864480 12527 leader_election.cc:290] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:48.854919 12494 consensus_queue.cc:1059] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:24:48.865582 12494 raft_consensus.cc:3055] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:48.865972 12494 raft_consensus.cc:740] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:48.865586 12557 consensus_queue.cc:237] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:48.866824 12494 consensus_queue.cc:260] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:48.845939 12434 consensus_queue.cc:1059] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 12:24:48.868284 12433 raft_consensus.cc:493] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:48.868837 12434 raft_consensus.cc:3055] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:48.869257 12434 raft_consensus.cc:740] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:48.869609 12531 raft_consensus.cc:515] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:48.870544 12434 consensus_queue.cc:260] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:48.870985 10998 raft_consensus.cc:2468] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 5.
I20260709 12:24:48.873162 12494 raft_consensus.cc:3060] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:48.877044 12434 raft_consensus.cc:3060] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:48.880784 12531 leader_election.cc:290] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:48.884302 11944 raft_consensus.cc:1081] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 LEADER]: Signalling peer 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:24:48.868808 12433 raft_consensus.cc:515] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:24:48.889175 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 127666us
I20260709 12:24:48.889699 12093 raft_consensus.cc:515] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:48.897325 12454 tablet_bootstrap.cc:492] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:48.898811 12454 tablet_bootstrap.cc:492] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap complete.
I20260709 12:24:48.899911 12454 ts_tablet_manager.cc:1403] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d: Time spent bootstrapping tablet: real 0.916s	user 0.029s	sys 0.028s
I20260709 12:24:48.905026 10968 leader_election.cc:304] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
W20260709 12:24:48.879324 12561 log.cc:927] Time spent T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.201s	user 0.000s	sys 0.001s
W20260709 12:24:48.910002 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 76739.5us
I20260709 12:24:48.914764 10752 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36188 (request call id 42) took 1402 ms. Trace:
I20260709 12:24:48.918150 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:48.919082 10851 raft_consensus.cc:3060] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:48.920102 10845 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5794ba618e514e28a7542ab6af39d8c9"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
mode: GRACEFUL
new_leader_uuid: "3c52e0825c02476e89d84da9bb849f5d"
 from {username='slave'} at 127.0.0.1:47358
I20260709 12:24:48.920768 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:48.920984 10845 raft_consensus.cc:606] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Received request to transfer leadership to TS 3c52e0825c02476e89d84da9bb849f5d
I20260709 12:24:48.921397 10845 raft_consensus.cc:614] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:48.922647 10845 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:56394
I20260709 12:24:48.923475 12204 raft_consensus.cc:493] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.924082 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:48.924197 12204 raft_consensus.cc:515] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:48.888837 12433 leader_election.cc:290] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:48.922737 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:48.926581 12204 leader_election.cc:290] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:48.923517 10845 raft_consensus.cc:493] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:48.929183 10845 raft_consensus.cc:3060] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:48.928115 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:48.935773 10850 raft_consensus.cc:3060] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:48.935873 10847 raft_consensus.cc:2468] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 5.
I20260709 12:24:48.938880 10926 raft_consensus.cc:2468] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 2.
I20260709 12:24:48.915772 10752 rpcz_store.cc:276] 0709 12:24:47.506851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.507082 (+   231us) service_pool.cc:224] Handling call
0709 12:24:48.908917 (+1401835us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:47.678965 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:47.763863 (+ 84898us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:47.763905 (+    42us) write_op.cc:435] Acquired schema lock
0709 12:24:47.763927 (+    22us) tablet.cc:662] Decoding operations
0709 12:24:47.764317 (+   390us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:47.764401 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:47.764436 (+    35us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:24:47.764633 (+   197us) tablet.cc:701] Row locks acquired
0709 12:24:47.764655 (+    22us) write_op.cc:260] PREPARE: finished
0709 12:24:47.764818 (+   163us) write_op.cc:270] Start()
0709 12:24:47.764989 (+   171us) write_op.cc:276] Timestamp: P: 1783599887764765 usec, L: 0
0709 12:24:47.765012 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:24:47.765771 (+   759us) log.cc:844] Serialized 532 byte log entry
0709 12:24:48.639194 (+873423us) op_driver.cc:464] REPLICATION: finished
0709 12:24:48.792395 (+153201us) write_op.cc:301] APPLY: starting
0709 12:24:48.792500 (+   105us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:48.792609 (+   109us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:48.794229 (+  1620us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:48.794494 (+   265us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:48.794667 (+   173us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:24:48.794713 (+    46us) write_op.cc:312] APPLY: finished
0709 12:24:48.796124 (+  1411us) log.cc:844] Serialized 22 byte log entry
0709 12:24:48.796299 (+   175us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:48.796378 (+    79us) write_op.cc:454] Released schema lock
0709 12:24:48.796413 (+    35us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:48.796789 (+   376us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:48.796816 (+    27us) write_op.cc:454] Released schema lock
0709 12:24:48.839282 (+ 42466us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:48.841615 (+  2333us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":147740,"apply.run_cpu_time_us":2006,"apply.run_wall_time_us":4363,"num_ops":1,"prepare.queue_time_us":97953,"prepare.run_cpu_time_us":12196,"prepare.run_wall_time_us":375388,"raft.queue_time_us":393383,"raft.run_cpu_time_us":53851,"raft.run_wall_time_us":248912,"replication_time_us":849959,"thread_start_us":697128,"threads_started":4,"wal-append.queue_time_us":299282}]]}
I20260709 12:24:48.933146 10851 raft_consensus.cc:2468] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 3.
I20260709 12:24:48.908762 12014 consensus_queue.cc:1059] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 12:24:48.932965 12432 raft_consensus.cc:2955] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 4 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:24:48.949536 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac8522e549a46e09593fa4c2e175557" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:48.950536 10927 raft_consensus.cc:2468] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 5.
I20260709 12:24:48.952335 11588 leader_election.cc:304] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:48.953261 12433 raft_consensus.cc:2804] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:48.954512 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac8522e549a46e09593fa4c2e175557" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:48.955706 10851 raft_consensus.cc:2393] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3c52e0825c02476e89d84da9bb849f5d in current term 5: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
W20260709 12:24:48.962109 10894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.953685 12433 raft_consensus.cc:493] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:48.972411 12433 raft_consensus.cc:3060] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:48.965160 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 45947.5us
I20260709 12:24:48.978144 12162 raft_consensus.cc:3055] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:48.978641 12162 raft_consensus.cc:740] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:48.979481 12162 consensus_queue.cc:260] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:48.979858 12536 consensus_queue.cc:1048] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:48.980705 12162 raft_consensus.cc:3060] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:48.980860 10895 leader_election.cc:304] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:48.942163 12478 raft_consensus.cc:493] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.982520 12498 raft_consensus.cc:2749] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:48.982451 12533 consensus_queue.cc:1059] T e9331e5342644ca2bae19187b083a7d5 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:24:48.989156 12498 raft_consensus.cc:3055] T e9331e5342644ca2bae19187b083a7d5 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:48.989567 12498 raft_consensus.cc:740] T e9331e5342644ca2bae19187b083a7d5 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:49.000265 12498 consensus_queue.cc:260] T e9331e5342644ca2bae19187b083a7d5 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:49.001727 12498 raft_consensus.cc:3060] T e9331e5342644ca2bae19187b083a7d5 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:49.004165 12540 consensus_queue.cc:1059] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:49.005136 12438 consensus_queue.cc:1059] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:49.006038 12533 raft_consensus.cc:3055] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:49.006564 12533 raft_consensus.cc:740] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:49.007401 12533 consensus_queue.cc:260] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:49.008461 12533 raft_consensus.cc:3060] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:49.006186 12438 raft_consensus.cc:3055] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:49.011857 12438 raft_consensus.cc:740] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:49.012980 12438 consensus_queue.cc:260] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } }
I20260709 12:24:49.014240 12438 raft_consensus.cc:3060] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:48.982400 12478 raft_consensus.cc:515] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:49.016182 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:49.016793 10998 raft_consensus.cc:3060] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:49.017179 12478 leader_election.cc:290] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:48.996217 10850 raft_consensus.cc:2468] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 4.
I20260709 12:24:48.960860 12093 leader_election.cc:290] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:24:49.030684 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 125723us
I20260709 12:24:49.031817 10968 leader_election.cc:304] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:49.033105 12564 raft_consensus.cc:2749] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:49.044917 10968 leader_election.cc:304] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:49.046339 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:49.046813 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:49.047390 10925 raft_consensus.cc:3060] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:49.050518 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
W20260709 12:24:49.035344 12572 log.cc:927] Time spent T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:24:49.056663 10920 raft_consensus.cc:2368] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for earlier term 5. Current term is 6.
I20260709 12:24:49.057132 10968 leader_election.cc:304] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:49.058288 10968 leader_election.cc:304] T 442726a7f1e441248ec80a98b31eb341 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:49.066008 10920 raft_consensus.cc:1275] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:24:49.066118 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:49.067106 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:49.067375 10927 raft_consensus.cc:3060] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:49.067886 10926 raft_consensus.cc:2468] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 6.
I20260709 12:24:49.073705 10968 leader_election.cc:304] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:49.059235 12510 raft_consensus.cc:2749] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:49.081046 10894 leader_election.cc:304] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:49.075685 10968 leader_election.cc:304] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:49.087157 10998 raft_consensus.cc:2468] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 6.
I20260709 12:24:49.090348 10922 raft_consensus.cc:2468] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 6.
I20260709 12:24:49.063122 12557 raft_consensus.cc:2749] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:49.063385 12527 raft_consensus.cc:2749] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:49.106577 10925 raft_consensus.cc:2468] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 4.
I20260709 12:24:49.107972 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:49.099156 10968 leader_election.cc:304] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:49.110133 10968 leader_election.cc:304] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:49.118103 10819 leader_election.cc:304] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:49.079938 11944 raft_consensus.cc:493] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.078521 12531 raft_consensus.cc:2749] T 442726a7f1e441248ec80a98b31eb341 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:49.127116 10819 leader_election.cc:304] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:49.128865 10968 leader_election.cc:304] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:49.118942 12508 raft_consensus.cc:2749] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:49.141060 10968 leader_election.cc:304] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:49.100612 12464 raft_consensus.cc:2749] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:49.145906 10927 raft_consensus.cc:2468] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 3.
I20260709 12:24:49.154340 10968 leader_election.cc:304] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:49.084713 12352 consensus_queue.cc:1059] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 12:24:49.124290 12376 raft_consensus.cc:2749] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:49.155726 10968 leader_election.cc:304] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:49.139530 12386 raft_consensus.cc:2804] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:49.167749 10997 raft_consensus.cc:1240] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:49.168183 12563 consensus_queue.cc:1048] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 12:24:49.168905 12571 raft_consensus.cc:2749] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:49.169301 12575 consensus_queue.cc:1048] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.124s
I20260709 12:24:49.136771 12427 raft_consensus.cc:2804] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:49.180449 12427 raft_consensus.cc:493] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:49.180943 12427 raft_consensus.cc:3060] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:49.185240 10845 raft_consensus.cc:515] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:49.187474 12574 log.cc:927] Time spent T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 12:24:49.137429 11944 raft_consensus.cc:515] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:49.189273 12577 log.cc:927] Time spent T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
W20260709 12:24:49.190686 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:49.112586 12433 raft_consensus.cc:515] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:49.104959 12537 consensus_queue.cc:1059] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 12:24:49.194037 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:49.194792 11002 raft_consensus.cc:2393] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 6: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:24:49.194914 12479 raft_consensus.cc:2764] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 12:24:49.197942 10851 raft_consensus.cc:1240] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:49.200016 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:49.200528 10921 raft_consensus.cc:2410] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:24:49.147507 12456 consensus_queue.cc:1059] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.054s
W20260709 12:24:49.202414 12576 log.cc:927] Time spent T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:24:49.143519 12510 consensus_queue.cc:1059] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.063s
I20260709 12:24:49.203442 12510 raft_consensus.cc:3055] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:49.203872 12510 raft_consensus.cc:740] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:49.204756 12510 consensus_queue.cc:260] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:49.206176 12510 raft_consensus.cc:3060] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:49.206547 12537 raft_consensus.cc:3055] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:49.207116 12537 raft_consensus.cc:740] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
W20260709 12:24:49.145850 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 52034.9us
I20260709 12:24:49.165705 12518 raft_consensus.cc:2804] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:49.208240 12537 consensus_queue.cc:260] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:49.208995 12518 raft_consensus.cc:697] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 3 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:49.209998 12537 raft_consensus.cc:3060] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:49.147322 12557 raft_consensus.cc:2749] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:49.202308 12456 raft_consensus.cc:3055] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:49.227691 11001 raft_consensus.cc:1275] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:24:49.253048 12456 raft_consensus.cc:740] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:49.254331 12456 consensus_queue.cc:260] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:49.197502 12579 log.cc:927] Time spent T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 12:24:49.211793 12038 consensus_queue.cc:1175] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "80cd7d227db44f34a6108591dad9c040" responder_term: 3 status { last_received { term: 3 index: 2 } last_committed_idx: 2 last_received_current_leader { term: 3 index: 2 } }
I20260709 12:24:49.227615 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:49.227862 12433 leader_election.cc:290] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 5 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:49.264036 10996 raft_consensus.cc:2410] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:24:49.264307 10845 leader_election.cc:290] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:49.229871 11944 leader_election.cc:290] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:49.231832 12454 raft_consensus.cc:359] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:24:49.272512 12454 raft_consensus.cc:740] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Initialized, Role: LEARNER
I20260709 12:24:49.273648 12454 consensus_queue.cc:260] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:24:49.236244 12386 raft_consensus.cc:697] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 6 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
W20260709 12:24:49.237532 10892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:49.241043 12042 raft_consensus.cc:3055] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:24:49.243216 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 87623.8us
I20260709 12:24:49.283655 10968 leader_election.cc:304] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:49.210397 12518 consensus_queue.cc:237] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:49.245826 12510 raft_consensus.cc:2804] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:49.264880 12332 raft_consensus.cc:493] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:49.161957 12465 raft_consensus.cc:2764] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 12:24:49.276073 10996 raft_consensus.cc:1275] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:24:49.276302 10895 leader_election.cc:304] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
W20260709 12:24:49.280730 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 142401us
I20260709 12:24:49.309796 10996 pending_rounds.cc:85] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08: Aborting all ops after (but not including) 2
I20260709 12:24:49.310704 10996 pending_rounds.cc:107] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:24:49.311116 10996 raft_consensus.cc:2889] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:49.291437 10999 raft_consensus.cc:1240] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:49.289662 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:49.313881 10994 raft_consensus.cc:2468] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 5.
I20260709 12:24:49.311021 10968 leader_election.cc:304] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:49.279304 12454 ts_tablet_manager.cc:1434] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d: Time spent starting tablet: real 0.379s	user 0.005s	sys 0.005s
I20260709 12:24:49.319766 10968 leader_election.cc:304] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:49.297530 12042 raft_consensus.cc:740] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:49.324131 12042 consensus_queue.cc:260] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:49.324710 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:49.325621 11001 raft_consensus.cc:3060] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:49.321635 12376 raft_consensus.cc:2749] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:49.320592 12527 raft_consensus.cc:2749] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:49.328118 12531 raft_consensus.cc:2749] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:24:49.328778 12568 log.cc:927] Time spent T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.204s	user 0.005s	sys 0.000s
W20260709 12:24:49.330992 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 54779.1us
I20260709 12:24:49.331063 11944 raft_consensus.cc:2804] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:49.321659 12332 raft_consensus.cc:515] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:49.336653 12441 consensus_queue.cc:1059] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:49.301640 12464 raft_consensus.cc:493] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:49.337687 12441 raft_consensus.cc:3055] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:49.337551 12464 raft_consensus.cc:515] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:24:49.338064 12441 raft_consensus.cc:740] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:49.340603 12441 consensus_queue.cc:260] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:49.341570 11944 raft_consensus.cc:697] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:49.322013 12204 consensus_queue.cc:1048] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:24:49.347095 12510 raft_consensus.cc:697] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08 [term 4 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:49.348470 12510 consensus_queue.cc:237] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:49.310149 12456 raft_consensus.cc:3060] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:49.357271 10895 leader_election.cc:304] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:49.350208 12483 consensus_queue.cc:1048] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:49.359962 12435 raft_consensus.cc:2804] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:49.360363 12435 raft_consensus.cc:493] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:49.360844 12435 raft_consensus.cc:3060] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:49.278923 12386 consensus_queue.cc:237] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:49.361752 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac8522e549a46e09593fa4c2e175557" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
W20260709 12:24:49.366032 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 46544.1us
W20260709 12:24:49.380581 10892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:49.388965 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 239342us
I20260709 12:24:49.377712 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:49.390292 10968 leader_election.cc:304] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:49.394652 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:49.394820 10819 leader_election.cc:304] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:49.395727 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac8522e549a46e09593fa4c2e175557" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:49.396950 10851 raft_consensus.cc:2393] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3c52e0825c02476e89d84da9bb849f5d in current term 5: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:24:49.396158 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:49.395282 10922 raft_consensus.cc:2468] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 5.
I20260709 12:24:49.395315 10921 raft_consensus.cc:3055] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:49.400152 10968 leader_election.cc:304] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:49.398633 10921 raft_consensus.cc:740] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:49.406376 10968 leader_election.cc:304] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:24:49.375953 12332 leader_election.cc:290] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:49.408321 10968 leader_election.cc:304] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:24:49.370752 12464 leader_election.cc:290] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:49.368332 12042 raft_consensus.cc:3060] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:49.415185 10819 leader_election.cc:304] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:49.366364 12506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:45904 (request call id 38) took 1996 ms. Trace:
I20260709 12:24:49.391436 12427 raft_consensus.cc:515] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:49.412448 12527 raft_consensus.cc:2804] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:49.401602 12508 raft_consensus.cc:2749] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:49.404331 12204 raft_consensus.cc:2749] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:49.438807 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:49.404067 12465 raft_consensus.cc:2749] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:49.366736 12291 consensus_queue.cc:1059] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 12:24:49.437029 12427 leader_election.cc:290] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:49.411231 10921 consensus_queue.cc:260] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:49.452749 10921 raft_consensus.cc:3060] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:49.453125 10968 leader_election.cc:400] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 election: Vote denied by peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339) with higher term. Message: Invalid argument: T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for earlier term 5. Current term is 6.
I20260709 12:24:49.401451 12441 raft_consensus.cc:3060] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:49.454917 12538 raft_consensus.cc:3055] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:49.460258 11001 raft_consensus.cc:2468] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 6.
W20260709 12:24:49.461234 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 60000us
I20260709 12:24:49.387766 11944 consensus_queue.cc:237] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:49.432807 12571 raft_consensus.cc:2804] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:49.465358 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:49.468134 10925 raft_consensus.cc:3060] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:49.472474 10893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:49.474400 10850 raft_consensus.cc:1275] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:24:49.463500 10820 leader_election.cc:304] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:49.476898 10925 raft_consensus.cc:2468] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 7.
I20260709 12:24:49.477082 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:49.477734 10851 raft_consensus.cc:2468] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 5.
I20260709 12:24:49.479632 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:49.480412 10925 raft_consensus.cc:2468] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 5.
I20260709 12:24:49.459488 12527 raft_consensus.cc:697] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 3 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:49.481557 10968 leader_election.cc:304] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:49.481923 10819 leader_election.cc:304] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:49.461859 12538 raft_consensus.cc:740] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:49.462719 12204 raft_consensus.cc:2749] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:24:49.458618 12483 consensus_queue.cc:1175] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "80cd7d227db44f34a6108591dad9c040" responder_term: 6 status { last_received { term: 5 index: 3 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 5. Current term is 6. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:24:49.493109 11003 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c72fddfc26044838a71a798f3371636b"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
mode: GRACEFUL
new_leader_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:32960
I20260709 12:24:49.494359 11003 raft_consensus.cc:606] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 6 LEADER]: Received request to transfer leadership to TS 80cd7d227db44f34a6108591dad9c040
I20260709 12:24:49.475703 12427 raft_consensus.cc:493] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:49.466748 11588 leader_election.cc:304] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:24:49.492468 12508 raft_consensus.cc:2804] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:49.500020 10845 raft_consensus.cc:1275] T e3d9a61ecaf84695b70f8519ee57706f P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:24:49.500394 12508 raft_consensus.cc:493] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:49.500818 12508 raft_consensus.cc:3060] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:49.503284 12538 consensus_queue.cc:260] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:49.504660 12538 raft_consensus.cc:3060] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:49.480862 12571 raft_consensus.cc:697] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:49.482306 12332 raft_consensus.cc:493] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.498730 12586 raft_consensus.cc:2804] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:49.431318 12506 rpcz_store.cc:276] 0709 12:24:47.311798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.312011 (+   213us) service_pool.cc:224] Handling call
0709 12:24:47.367535 (+ 55524us) ts_tablet_manager.cc:934] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d: Initiating tablet copy from peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
0709 12:24:48.857886 (+1490351us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:24:49.236886 (+379000us) tablet_metadata.cc:665] Metadata flushed
0709 12:24:49.237021 (+   135us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:24:49.257420 (+ 20399us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:24:49.257725 (+   305us) tablet_replica.cc:206] Creating consensus instance
0709 12:24:49.258064 (+   339us) ts_tablet_manager.cc:989] Replica registered.
0709 12:24:49.308322 (+ 50258us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":281,"tablet-copy.queue_time_us":46826,"thread_start_us":99865,"threads_started":2}
I20260709 12:24:49.493206 12205 raft_consensus.cc:2804] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:49.505736 12427 raft_consensus.cc:515] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:49.516672 10894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:49.521687 12205 raft_consensus.cc:697] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 7 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:49.522750 12205 consensus_queue.cc:237] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:49.520435 12586 raft_consensus.cc:697] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 6 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:49.527060 12586 consensus_queue.cc:237] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:49.531268 10921 raft_consensus.cc:2468] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 6.
I20260709 12:24:49.533455 12562 raft_consensus.cc:2804] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:49.534065 12562 raft_consensus.cc:697] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d [term 5 LEADER]: Becoming Leader. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
I20260709 12:24:49.534263 12527 consensus_queue.cc:237] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:49.534710 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 77121.5us
I20260709 12:24:49.514679 12332 raft_consensus.cc:515] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:49.511904 12442 consensus_queue.cc:1048] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 12:24:49.535233 12506 tablet_copy_client.cc:806] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:49.575875 10846 raft_consensus.cc:1240] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 7 LEADER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:49.572540 12506 tablet_copy_client.cc:670] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:49.582952 12019 raft_consensus.cc:3055] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:49.568130 10864 tablet_copy_service.cc:342] P 80cd7d227db44f34a6108591dad9c040: Request end of tablet copy session 3c52e0825c02476e89d84da9bb849f5d-3f8a389131ef4c77a3e08488aa4759eb received from {username='slave'} at 127.0.0.1:46480
W20260709 12:24:49.587206 10893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:49.583547 12019 raft_consensus.cc:740] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
W20260709 12:24:49.600461 12591 log.cc:927] Time spent T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 12:24:49.610313 11621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac8522e549a46e09593fa4c2e175557" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:24:49.613548 11000 raft_consensus.cc:1275] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:24:49.589277 10864 tablet_copy_service.cc:434] P 80cd7d227db44f34a6108591dad9c040: ending tablet copy session 3c52e0825c02476e89d84da9bb849f5d-3f8a389131ef4c77a3e08488aa4759eb on tablet 3f8a389131ef4c77a3e08488aa4759eb with peer 3c52e0825c02476e89d84da9bb849f5d
I20260709 12:24:49.604703 12332 leader_election.cc:290] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:24:49.633109 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac8522e549a46e09593fa4c2e175557" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:49.634385 10926 raft_consensus.cc:2410] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:24:49.584177 12571 consensus_queue.cc:237] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:49.617372 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:49.620993 12427 leader_election.cc:290] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:49.630498 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:49.641625 10849 raft_consensus.cc:2393] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 5: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:24:49.648737 10924 raft_consensus.cc:2393] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 3: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:24:49.578733 12562 consensus_queue.cc:237] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:49.660470 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:49.663944 10819 leader_election.cc:304] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:49.607555 12508 raft_consensus.cc:515] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:24:49.665184 12537 consensus_queue.cc:1048] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:24:49.673794 12478 raft_consensus.cc:2749] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:49.681506 12511 consensus_queue.cc:1059] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 12:24:49.675177 12019 consensus_queue.cc:260] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:49.616533 12435 raft_consensus.cc:515] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:49.755895 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 60517.6us
I20260709 12:24:49.764150 12508 leader_election.cc:290] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:49.779138 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:49.790153 10849 raft_consensus.cc:2393] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 5: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:24:49.758194 12478 raft_consensus.cc:493] T e8b17195a94142039c40f598ed006c94 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:49.800514 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:49.810475 12435 leader_election.cc:290] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:49.801203 12478 raft_consensus.cc:515] T e8b17195a94142039c40f598ed006c94 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:49.813627 12478 leader_election.cc:290] T e8b17195a94142039c40f598ed006c94 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:49.814757 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b17195a94142039c40f598ed006c94" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:49.794075 12511 consensus_queue.cc:1243] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer 80cd7d227db44f34a6108591dad9c040 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 12:24:49.821976 10894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:49.822817 10926 raft_consensus.cc:2468] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 5.
I20260709 12:24:49.825955 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:49.827322 10994 raft_consensus.cc:3060] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:49.800984 12093 raft_consensus.cc:493] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.852027 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:49.854101  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:24:49.854842 10845 raft_consensus.cc:3060] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:49.866605 10994 raft_consensus.cc:2468] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 6.
I20260709 12:24:49.841845 12093 raft_consensus.cc:515] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:49.883934 10895 leader_election.cc:304] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:49.893253 12164 raft_consensus.cc:2804] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:49.903738 12093 leader_election.cc:290] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:49.904251 12164 raft_consensus.cc:697] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:49.905265 12164 consensus_queue.cc:237] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:49.888111 12438 consensus_queue.cc:1048] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:24:49.908648 10819 leader_election.cc:304] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:49.909199 10845 raft_consensus.cc:2468] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 6.
I20260709 12:24:49.910782 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:49.918802 10994 raft_consensus.cc:2468] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 4.
W20260709 12:24:49.913357 12606 log.cc:927] Time spent T e3d9a61ecaf84695b70f8519ee57706f P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:24:49.922516 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:49.924361 12586 raft_consensus.cc:3060] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:49.931742 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b17195a94142039c40f598ed006c94" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:49.932670 10926 raft_consensus.cc:2393] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 2: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:24:49.934795 12438 consensus_queue.cc:1243] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer edcc56ddd3264984b4da6c1db59e7f08 log is divergent from this leader: its last log entry 6.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:24:50.004276 10926 raft_consensus.cc:1275] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:24:50.004410 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 94391.1us
I20260709 12:24:50.007289 10819 leader_election.cc:304] T e8b17195a94142039c40f598ed006c94 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:50.011252 12332 raft_consensus.cc:3060] T e8b17195a94142039c40f598ed006c94 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:50.011723 12385 raft_consensus.cc:493] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:50.012949 12385 raft_consensus.cc:515] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:50.016228 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 177029us
I20260709 12:24:50.018078 10968 leader_election.cc:304] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:24:50.018803 12465 raft_consensus.cc:3055] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:50.019497 12465 raft_consensus.cc:740] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:50.020447 12465 consensus_queue.cc:260] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:50.022369 12534 raft_consensus.cc:2804] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:50.022589 12465 raft_consensus.cc:3060] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:50.026084 12332 raft_consensus.cc:2749] T e8b17195a94142039c40f598ed006c94 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:50.015205 12427 consensus_queue.cc:1048] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 12:24:50.046180 10846 raft_consensus.cc:1275] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:50.049331 12204 raft_consensus.cc:493] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:50.049964 12204 raft_consensus.cc:515] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:50.037117 12478 raft_consensus.cc:493] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.061376 12478 raft_consensus.cc:515] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:24:50.064985 10998 raft_consensus.cc:1275] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:24:50.036541 12534 raft_consensus.cc:697] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:50.082196 12478 leader_election.cc:290] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:50.106068 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9331e5342644ca2bae19187b083a7d5" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:50.110280 10921 raft_consensus.cc:1275] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:24:50.112673 10845 raft_consensus.cc:3060] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:50.107055 10920 raft_consensus.cc:2468] T e9331e5342644ca2bae19187b083a7d5 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 2.
I20260709 12:24:50.115494 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:24:50.120810 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 75080.4us
I20260709 12:24:50.121788 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:50.122673 10927 raft_consensus.cc:2468] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 3.
I20260709 12:24:50.118283 10924 raft_consensus.cc:2468] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 5.
I20260709 12:24:50.128093 11000 raft_consensus.cc:1275] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:50.134986 11001 raft_consensus.cc:1275] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:50.138847 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:50.141314 10995 pending_rounds.cc:85] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08: Aborting all ops after (but not including) 2
I20260709 12:24:50.141762 10995 pending_rounds.cc:107] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08: Aborting uncommitted NO_OP operation due to leader change: 6.3
I20260709 12:24:50.146667 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9331e5342644ca2bae19187b083a7d5" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:50.149268 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:50.150282 10994 raft_consensus.cc:2393] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 3: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:24:50.150810 10995 raft_consensus.cc:2889] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:50.155148 11001 raft_consensus.cc:2393] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 2: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:24:50.109777 12531 raft_consensus.cc:493] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:50.157025 12019 raft_consensus.cc:3060] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:50.157183 12531 raft_consensus.cc:515] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:50.155745 12456 consensus_queue.cc:1048] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:50.160382 12518 raft_consensus.cc:493] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.160881 12518 raft_consensus.cc:515] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:50.159379 12531 leader_election.cc:290] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:50.163091 12518 leader_election.cc:290] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:50.166126 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:50.166409 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:50.114991 12385 leader_election.cc:290] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:50.120193 12204 leader_election.cc:290] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:50.184667 10845 raft_consensus.cc:1275] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:50.187713 10852 raft_consensus.cc:1275] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:50.184108 12539 raft_consensus.cc:493] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.187902 12534 consensus_queue.cc:237] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:24:50.230274 10924 raft_consensus.cc:1275] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:24:50.196517 12427 consensus_queue.cc:1048] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 12:24:50.207831 12539 raft_consensus.cc:515] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:50.240020 12539 leader_election.cc:290] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:24:50.243711 12608 log.cc:927] Time spent T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
I20260709 12:24:50.243628 10752 catalog_manager.cc:5697] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: config changed from index 3 to 4, VOTER edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) evicted. New cstate: current_term: 1 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:24:50.242686  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:50.247824  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:50.242404 12562 consensus_queue.cc:1048] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:50.248878 12610 consensus_queue.cc:1048] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:50.208456 12385 raft_consensus.cc:493] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
W20260709 12:24:50.264596 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 51209us
I20260709 12:24:50.273777 12586 raft_consensus.cc:2749] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:50.285254 12506 tablet_copy_client.cc:538] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:50.304059 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:50.305186 10853 raft_consensus.cc:2468] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 3.
I20260709 12:24:50.349928 10894 leader_election.cc:304] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:50.267639 12385 raft_consensus.cc:515] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:50.275990 12610 consensus_queue.cc:1048] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.059s
I20260709 12:24:50.310376 12441 raft_consensus.cc:493] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.309815 12531 consensus_queue.cc:1048] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 12:24:50.369439 10895 leader_election.cc:304] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:24:50.353772 12204 raft_consensus.cc:493] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:50.364368 12610 consensus_queue.cc:1243] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer edcc56ddd3264984b4da6c1db59e7f08 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:24:50.356164 12386 raft_consensus.cc:493] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:50.317150 12442 consensus_queue.cc:1048] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 12:24:50.359336 12465 raft_consensus.cc:493] T a6a28416571247df878823d464c05f1e P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:50.364873 12435 raft_consensus.cc:2804] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:50.377025 12542 raft_consensus.cc:2804] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:50.400758 12542 raft_consensus.cc:493] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:50.401176 12542 raft_consensus.cc:3060] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:50.393960 12386 raft_consensus.cc:515] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:50.405599 12386 leader_election.cc:290] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:50.405584 12385 leader_election.cc:290] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:24:50.407963 12620 log.cc:927] Time spent T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 12:24:50.409948 12538 raft_consensus.cc:493] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.369016 12441 raft_consensus.cc:515] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } }
W20260709 12:24:50.397414 12617 log.cc:927] Time spent T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 12:24:50.418006 10920 raft_consensus.cc:1275] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:50.394831 12435 raft_consensus.cc:493] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:50.410480 12538 raft_consensus.cc:515] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:50.378146 12204 raft_consensus.cc:515] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:50.440752 12204 leader_election.cc:290] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:50.448935 12441 leader_election.cc:290] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265)
I20260709 12:24:50.451614 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:50.423497 12435 raft_consensus.cc:3060] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:50.410979 12465 raft_consensus.cc:515] T a6a28416571247df878823d464c05f1e P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:50.467694 11621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:24:50.468922 12465 leader_election.cc:290] T a6a28416571247df878823d464c05f1e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:24:50.477818 10926 raft_consensus.cc:1275] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:50.478188 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:50.478653 10924 raft_consensus.cc:1275] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:50.477869 10921 raft_consensus.cc:1275] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:50.481338 12538 leader_election.cc:290] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:50.482023 12586 raft_consensus.cc:493] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:50.485687 10845 raft_consensus.cc:1275] T e8b17195a94142039c40f598ed006c94 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:50.486079 12478 raft_consensus.cc:493] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:50.486578 12478 raft_consensus.cc:515] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:50.488571 12478 leader_election.cc:290] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:50.489786 10849 raft_consensus.cc:1275] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:50.490814 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:50.493314 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:50.493505 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:50.494411 10999 raft_consensus.cc:2468] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 4.
I20260709 12:24:50.496596 10922 raft_consensus.cc:1240] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:50.501547 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:50.502449 10997 raft_consensus.cc:2468] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 4.
I20260709 12:24:50.502727 11000 raft_consensus.cc:1275] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:50.494287 11003 raft_consensus.cc:2468] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 2.
I20260709 12:24:50.516978 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:50.517359 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:50.518041 10922 raft_consensus.cc:2468] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 4.
I20260709 12:24:50.518060 11000 raft_consensus.cc:2393] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 7: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:24:50.519374 10968 leader_election.cc:304] T a6a28416571247df878823d464c05f1e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040
I20260709 12:24:50.526463 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:50.528606 11003 pending_rounds.cc:85] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08: Aborting all ops after (but not including) 3
I20260709 12:24:50.529054 11003 pending_rounds.cc:107] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:24:50.529359 11003 raft_consensus.cc:2889] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:50.530920 10968 leader_election.cc:304] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:50.534687 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:50.538512 12438 raft_consensus.cc:493] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.539109 12438 raft_consensus.cc:515] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:50.541224 12438 leader_election.cc:290] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:50.548132 11000 raft_consensus.cc:2393] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 4: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:24:50.548095 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:50.548928 10927 raft_consensus.cc:2468] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 7.
I20260709 12:24:50.549117 10819 leader_election.cc:304] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:50.550887 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:50.551666 10997 raft_consensus.cc:2393] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 4: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:24:50.482568 12586 raft_consensus.cc:515] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:50.617379 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:24:50.618492 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 85669.5us
W20260709 12:24:50.618444 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 75044.6us
I20260709 12:24:50.617087 12386 raft_consensus.cc:493] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:50.635260 10895 leader_election.cc:304] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:50.547608 12571 raft_consensus.cc:2749] T a6a28416571247df878823d464c05f1e P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:24:50.638459 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 89406.1us
I20260709 12:24:50.615350 12332 raft_consensus.cc:493] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.615175 12524 raft_consensus.cc:2749] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:50.629716 12205 consensus_queue.cc:1048] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 12:24:50.650362 10819 leader_election.cc:304] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:50.650621 10750 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60736 (request call id 153) took 4863 ms. Trace:
I20260709 12:24:50.554111 12563 raft_consensus.cc:493] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:50.547853 12527 consensus_queue.cc:1048] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.096s
I20260709 12:24:50.654857 10895 leader_election.cc:304] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:50.553812 12465 consensus_queue.cc:1048] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.092s
I20260709 12:24:50.658020 10819 leader_election.cc:304] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:50.614661 12456 consensus_queue.cc:1048] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 12:24:50.656263 10750 rpcz_store.cc:276] 0709 12:24:45.786864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:45.787107 (+   243us) service_pool.cc:224] Handling call
0709 12:24:50.650500 (+4863393us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:48.079525 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:48.186469 (+106944us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:48.186502 (+    33us) write_op.cc:435] Acquired schema lock
0709 12:24:48.186520 (+    18us) tablet.cc:662] Decoding operations
0709 12:24:48.193296 (+  6776us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:48.193373 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:48.193406 (+    33us) tablet.cc:685] Acquiring locks for 18 operations
0709 12:24:48.194944 (+  1538us) tablet.cc:701] Row locks acquired
0709 12:24:48.194966 (+    22us) write_op.cc:260] PREPARE: finished
0709 12:24:48.195240 (+   274us) write_op.cc:270] Start()
0709 12:24:48.195438 (+   198us) write_op.cc:276] Timestamp: P: 1783599888195188 usec, L: 0
0709 12:24:48.195464 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:24:48.254118 (+ 58654us) log.cc:844] Serialized 7140 byte log entry
0709 12:24:48.802445 (+548327us) op_driver.cc:464] REPLICATION: finished
0709 12:24:48.824633 (+ 22188us) write_op.cc:301] APPLY: starting
0709 12:24:48.824722 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:48.825099 (+   377us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:48.825204 (+   105us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:48.827167 (+  1963us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:48.827452 (+   285us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=18
0709 12:24:48.827500 (+    48us) write_op.cc:312] APPLY: finished
0709 12:24:48.827944 (+   444us) log.cc:844] Serialized 124 byte log entry
0709 12:24:48.832026 (+  4082us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:48.832188 (+   162us) write_op.cc:454] Released schema lock
0709 12:24:48.832246 (+    58us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":64112,"reported_tablets":37,"child_traces":[["op",{"apply.queue_time_us":4219,"apply.run_cpu_time_us":4050,"apply.run_wall_time_us":7937,"num_ops":18,"prepare.queue_time_us":221308,"prepare.run_cpu_time_us":36498,"prepare.run_wall_time_us":198453,"replication_time_us":602916}]]}
I20260709 12:24:50.662132 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:50.638135 12611 raft_consensus.cc:493] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:50.646860 12575 raft_consensus.cc:2804] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:50.672981 11002 raft_consensus.cc:1275] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:24:50.673586 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef3220c51df47db8859f07ab745fad5" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:50.684078 11000 raft_consensus.cc:2468] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 2.
I20260709 12:24:50.630214 12518 consensus_queue.cc:1048] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:24:50.700488 12508 consensus_queue.cc:1048] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:24:50.655876 12332 raft_consensus.cc:515] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:50.737457 12332 leader_election.cc:290] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:50.695030 12478 raft_consensus.cc:2804] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:50.738880 12478 raft_consensus.cc:493] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:50.739352 12478 raft_consensus.cc:3060] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:50.663865 12351 raft_consensus.cc:2804] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:50.740024 12351 raft_consensus.cc:493] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:50.740505 12351 raft_consensus.cc:3060] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:50.740832 12586 leader_election.cc:290] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:50.659632 12537 raft_consensus.cc:2804] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:50.741523 12537 raft_consensus.cc:493] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:50.741928 12537 raft_consensus.cc:3060] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:50.664037 12427 raft_consensus.cc:2804] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:50.745257 12427 raft_consensus.cc:493] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:50.745682 12427 raft_consensus.cc:3060] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:50.695695 12611 raft_consensus.cc:515] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:50.748577 10895 leader_election.cc:304] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:50.749894 12611 leader_election.cc:290] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:50.655154 12386 raft_consensus.cc:515] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:50.752640 12386 leader_election.cc:290] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:50.681334 12575 raft_consensus.cc:493] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:50.753232 12538 raft_consensus.cc:2804] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:50.753479 12575 raft_consensus.cc:3060] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:50.753720 12538 raft_consensus.cc:493] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:50.754189 12538 raft_consensus.cc:3060] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:50.696185 12542 raft_consensus.cc:515] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:50.755789 12438 consensus_queue.cc:1048] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:50.757848 12542 leader_election.cc:290] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:24:50.662125 12616 log.cc:927] Time spent T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.279s	user 0.002s	sys 0.008s
I20260709 12:24:50.666149 12563 raft_consensus.cc:515] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } }
I20260709 12:24:50.762842 12563 leader_election.cc:290] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:50.763232 10921 raft_consensus.cc:2368] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 4. Current term is 5.
I20260709 12:24:50.659394 12533 consensus_queue.cc:1048] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.104s
I20260709 12:24:50.766172 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:50.766812 11003 raft_consensus.cc:3060] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:50.733014 12435 raft_consensus.cc:515] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:50.776288 11003 raft_consensus.cc:2468] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 5.
W20260709 12:24:50.808636 10969 consensus_peers.cc:597] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613): Couldn't send request to peer 3c52e0825c02476e89d84da9bb849f5d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:50.821480 12538 raft_consensus.cc:515] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:50.829881 12435 leader_election.cc:290] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:50.840380 10927 raft_consensus.cc:1240] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:50.847962 12631 raft_consensus.cc:493] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:50.844450 12506 tablet_bootstrap.cc:492] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap starting.
W20260709 12:24:50.873435 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 70091.2us
I20260709 12:24:50.848263 12441 raft_consensus.cc:493] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.876454 12441 raft_consensus.cc:515] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:50.853636 12631 raft_consensus.cc:515] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:50.881412 12536 raft_consensus.cc:493] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.881983 12536 raft_consensus.cc:515] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:50.888828 12537 raft_consensus.cc:515] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:50.874765 10895 leader_election.cc:304] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
W20260709 12:24:50.920674 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 254067us
W20260709 12:24:50.925631 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 305185us
W20260709 12:24:50.925904 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 51245.5us
I20260709 12:24:50.930097 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b17195a94142039c40f598ed006c94" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:50.934979 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
W20260709 12:24:50.946430 10968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:50.944321 10819 leader_election.cc:304] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:50.952610 10819 leader_election.cc:304] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:50.953593 10819 leader_election.cc:400] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Vote denied by peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339) with higher term. Message: Invalid argument: T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 4. Current term is 5.
I20260709 12:24:50.953898 10819 leader_election.cc:403] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:50.955363 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:50.957098 10854 raft_consensus.cc:1275] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:24:50.958014 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:50.958732 11002 raft_consensus.cc:2393] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 4: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:24:50.960902 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:50.962134 11003 raft_consensus.cc:2393] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 4: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:24:50.962317 10849 raft_consensus.cc:1275] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:24:50.966195 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef3220c51df47db8859f07ab745fad5" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:50.967077 10997 raft_consensus.cc:2393] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 2: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:24:50.968957 10968 leader_election.cc:304] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:50.976352 12205 raft_consensus.cc:3060] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:24:50.974080 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef3220c51df47db8859f07ab745fad5" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:50.975276 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:50.977598 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:50.948297 12542 raft_consensus.cc:2804] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:50.899171 12478 raft_consensus.cc:515] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:50.951354 12498 raft_consensus.cc:493] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.944309 12538 leader_election.cc:290] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:50.968845 12586 raft_consensus.cc:2804] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:50.903245 12575 raft_consensus.cc:515] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:24:50.969229 12332 raft_consensus.cc:2804] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:50.879504 12441 leader_election.cc:290] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:50.996531 10922 raft_consensus.cc:1275] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:24:51.000080 10997 raft_consensus.cc:2393] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 2: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:24:50.948185 12563 consensus_queue.cc:1048] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 12:24:50.999290 10854 raft_consensus.cc:2468] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 1.
I20260709 12:24:51.001065 11002 raft_consensus.cc:3060] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:51.002267 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:50.998422 12638 raft_consensus.cc:2749] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:51.006446 12537 leader_election.cc:290] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:51.008391 12478 leader_election.cc:290] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:51.009596 12542 raft_consensus.cc:697] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:51.015925 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:50.949186 12351 raft_consensus.cc:515] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } }
I20260709 12:24:51.027022 11003 raft_consensus.cc:2468] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 4.
I20260709 12:24:51.041052 10895 leader_election.cc:304] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:51.003324 12536 leader_election.cc:290] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:51.052109 10851 raft_consensus.cc:1240] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:51.021737 12586 raft_consensus.cc:493] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:51.061241 11002 raft_consensus.cc:2468] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 3.
I20260709 12:24:51.069056 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:51.073321 10895 leader_election.cc:304] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:51.001996 12518 consensus_queue.cc:1059] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 12:24:51.031764 12332 raft_consensus.cc:493] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
W20260709 12:24:51.122328 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 49149.1us
I20260709 12:24:51.023188 12498 raft_consensus.cc:515] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:51.165659 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:51.166301 11002 raft_consensus.cc:3060] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:51.104816 12586 raft_consensus.cc:3060] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:51.121891 12632 raft_consensus.cc:493] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.058223 12631 leader_election.cc:290] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:51.187932 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:51.120105 12435 raft_consensus.cc:2804] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:51.186767 11002 raft_consensus.cc:2468] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 5.
I20260709 12:24:51.188604 10853 raft_consensus.cc:2468] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 3.
I20260709 12:24:51.119634 12511 raft_consensus.cc:493] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.195648 12511 raft_consensus.cc:515] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:51.153713 12538 raft_consensus.cc:2804] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:51.199306 12538 raft_consensus.cc:697] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:51.200788 12538 consensus_queue.cc:237] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:51.121482 12332 raft_consensus.cc:3060] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:51.209452 12511 leader_election.cc:290] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:51.051949 12427 raft_consensus.cc:515] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:51.219667 12435 raft_consensus.cc:493] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:51.220209 12435 raft_consensus.cc:3060] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:51.221033 12351 leader_election.cc:290] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 election: Requested vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265)
I20260709 12:24:51.221836 12631 raft_consensus.cc:493] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.222551 12631 raft_consensus.cc:515] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:51.164529 12442 raft_consensus.cc:493] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:51.225911 12442 raft_consensus.cc:515] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:51.227458 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:51.163570 12465 raft_consensus.cc:493] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.228749 12465 raft_consensus.cc:515] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:51.225512 12631 leader_election.cc:290] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:24:51.232281 12636 log.cc:927] Time spent T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:24:51.223049 12498 leader_election.cc:290] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:51.228178 12442 leader_election.cc:290] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:51.234875 12465 leader_election.cc:290] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:51.236673 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef3220c51df47db8859f07ab745fad5" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:51.237603 10854 raft_consensus.cc:2468] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 1.
W20260709 12:24:51.239899 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 200836us
W20260709 12:24:51.182413 12615 log.cc:927] Time spent T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 12:24:51.264577 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9331e5342644ca2bae19187b083a7d5" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:51.265744 11002 raft_consensus.cc:2393] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 2: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:24:51.269424 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9331e5342644ca2bae19187b083a7d5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:51.269626 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:51.269928 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:51.270134 10847 raft_consensus.cc:2468] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 2.
I20260709 12:24:51.270555 10846 raft_consensus.cc:2468] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 3.
I20260709 12:24:51.270167 10854 raft_consensus.cc:2468] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 1.
I20260709 12:24:51.276456 10968 leader_election.cc:304] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:51.282236 12649 raft_consensus.cc:493] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:51.282949 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:51.287038 12427 leader_election.cc:290] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:51.236068 12632 raft_consensus.cc:515] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:51.282889 12649 raft_consensus.cc:515] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:51.292275 12632 leader_election.cc:290] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:51.294883 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef3220c51df47db8859f07ab745fad5" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:51.295801 10854 raft_consensus.cc:3060] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:24:51.193133 12518 consensus_queue.cc:1048] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
W20260709 12:24:51.304116 12640 log.cc:927] Time spent T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260709 12:24:51.309823 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b17195a94142039c40f598ed006c94" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:51.320549 12643 raft_consensus.cc:493] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.321480 12643 raft_consensus.cc:515] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:51.326152 12643 leader_election.cc:290] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:51.277865 12351 raft_consensus.cc:493] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.275915 12542 consensus_queue.cc:237] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:51.305681 12632 raft_consensus.cc:493] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.337913 12649 leader_election.cc:290] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:51.340804 12205 raft_consensus.cc:2749] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339) with higher term. Message: Invalid argument: T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 4. Current term is 5.
I20260709 12:24:51.341493 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:51.374439 10853 raft_consensus.cc:3060] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:24:51.343986 12575 leader_election.cc:290] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:51.346377 12435 raft_consensus.cc:515] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:51.346529 12332 raft_consensus.cc:515] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:51.347792 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:51.285751 12527 raft_consensus.cc:2749] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:51.361644 10854 raft_consensus.cc:2468] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 3.
I20260709 12:24:51.384987 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:51.389840 10852 raft_consensus.cc:3060] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:24:51.385667 10845 raft_consensus.cc:2468] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 3.
I20260709 12:24:51.381884 12435 leader_election.cc:290] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:51.390547 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:51.395159 10854 raft_consensus.cc:2468] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 3.
I20260709 12:24:51.396996 10853 raft_consensus.cc:2468] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 5.
I20260709 12:24:51.481141 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:51.482024 10920 raft_consensus.cc:2368] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 4. Current term is 5.
I20260709 12:24:51.481081 12540 consensus_queue.cc:1048] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:51.382064 12531 raft_consensus.cc:3055] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:51.482656 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:51.394534 12534 raft_consensus.cc:493] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.492705 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:51.486867 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:51.499758 10850 raft_consensus.cc:2468] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 5.
I20260709 12:24:51.501531 10923 raft_consensus.cc:2468] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 4.
I20260709 12:24:51.501688 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:51.502276 10854 raft_consensus.cc:3060] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:24:51.366936 12351 raft_consensus.cc:515] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:51.505724 12351 leader_election.cc:290] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:51.509941 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:51.511119 10923 raft_consensus.cc:2368] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 4. Current term is 5.
I20260709 12:24:51.520826 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef3220c51df47db8859f07ab745fad5" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:51.382104 12632 raft_consensus.cc:515] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:51.529809 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:24:51.531021 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 55693.1us
I20260709 12:24:51.531190 10923 raft_consensus.cc:2368] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 2. Current term is 3.
I20260709 12:24:51.494344 12531 raft_consensus.cc:740] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:51.507405 12586 raft_consensus.cc:515] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:51.545984 12586 leader_election.cc:290] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:51.563448 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9331e5342644ca2bae19187b083a7d5" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:51.565629 10854 raft_consensus.cc:2468] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 5.
I20260709 12:24:51.576570 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:51.583222 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:51.584380 10927 raft_consensus.cc:3060] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:51.516976 12534 raft_consensus.cc:515] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:51.587880 12664 consensus_queue.cc:1048] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:51.589169 12531 consensus_queue.cc:260] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:51.590245 12531 raft_consensus.cc:3060] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:51.593326 10894 leader_election.cc:304] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:51.594270 10922 raft_consensus.cc:2468] T e9331e5342644ca2bae19187b083a7d5 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 2.
I20260709 12:24:51.596292 10852 raft_consensus.cc:2468] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 3.
I20260709 12:24:51.600649 10894 leader_election.cc:304] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:51.578091 12434 raft_consensus.cc:493] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.604879 10927 raft_consensus.cc:2468] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 6.
I20260709 12:24:51.605718 10894 leader_election.cc:304] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:51.606966 10894 leader_election.cc:304] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:51.610150 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:51.611261 10852 raft_consensus.cc:2468] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 1.
I20260709 12:24:51.616788 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:51.617619 10927 raft_consensus.cc:2468] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 2.
I20260709 12:24:51.619112 10854 raft_consensus.cc:1275] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:51.601972 12441 raft_consensus.cc:2749] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:51.603869 12646 raft_consensus.cc:2749] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:51.636040 12534 leader_election.cc:290] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:51.654644 10819 leader_election.cc:400] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Vote denied by peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339) with higher term. Message: Invalid argument: T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 4. Current term is 5.
I20260709 12:24:51.655156 10819 leader_election.cc:403] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:51.612354 12435 raft_consensus.cc:2804] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:51.613229 12540 raft_consensus.cc:2804] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:51.662348 10819 leader_election.cc:304] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:51.664144 10819 leader_election.cc:304] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:51.665961 10819 leader_election.cc:400] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Vote denied by peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339) with higher term. Message: Invalid argument: T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 4. Current term is 5.
I20260709 12:24:51.666944 10819 leader_election.cc:403] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:51.668787 10819 leader_election.cc:304] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:51.672605 10819 leader_election.cc:400] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Vote denied by peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339) with higher term. Message: Invalid argument: T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 2. Current term is 3.
I20260709 12:24:51.673076 10819 leader_election.cc:403] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:51.612665 12434 raft_consensus.cc:515] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:51.669576 12435 raft_consensus.cc:493] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:51.674599 12635 raft_consensus.cc:2749] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339) with higher term. Message: Invalid argument: T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 4. Current term is 5.
I20260709 12:24:51.669441 12649 raft_consensus.cc:2749] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339) with higher term. Message: Invalid argument: T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 4. Current term is 5.
I20260709 12:24:51.668073 12527 raft_consensus.cc:493] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:51.695891 10968 leader_election.cc:304] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:51.708685 10968 leader_election.cc:304] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:51.709520 10968 leader_election.cc:304] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:51.702855 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:51.711372 10995 raft_consensus.cc:2393] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 3: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:24:51.703189 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:51.711805 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:51.712499 10850 raft_consensus.cc:2468] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 7.
I20260709 12:24:51.713485 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:51.714267 10850 raft_consensus.cc:2468] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 4.
I20260709 12:24:51.715926 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:51.716554 10849 raft_consensus.cc:2468] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 3.
I20260709 12:24:51.670970 12610 raft_consensus.cc:2804] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:51.683197 12427 raft_consensus.cc:2749] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339) with higher term. Message: Invalid argument: T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 2. Current term is 3.
I20260709 12:24:51.721603 10996 raft_consensus.cc:2393] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 2: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:24:51.721849 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:51.683900 12540 raft_consensus.cc:697] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:51.743713 10968 leader_election.cc:304] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:51.681720 12664 raft_consensus.cc:493] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:51.677533 12654 raft_consensus.cc:2749] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:51.746992 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
W20260709 12:24:51.684410 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 143511us
I20260709 12:24:51.777990 10752 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36188 (request call id 43) took 2435 ms. Trace:
I20260709 12:24:51.778661 10968 leader_election.cc:304] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:51.702919 12435 raft_consensus.cc:3060] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:51.784973 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 110424us
I20260709 12:24:51.721383 12527 raft_consensus.cc:515] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:51.792467 10968 leader_election.cc:304] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:51.778805 10752 rpcz_store.cc:276] 0709 12:24:49.342377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:49.344160 (+  1783us) service_pool.cc:224] Handling call
0709 12:24:51.777890 (+2433730us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:50.381534 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:50.402471 (+ 20937us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:50.402508 (+    37us) write_op.cc:435] Acquired schema lock
0709 12:24:50.402525 (+    17us) tablet.cc:662] Decoding operations
0709 12:24:50.402842 (+   317us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:50.402928 (+    86us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:50.402969 (+    41us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:24:50.403146 (+   177us) tablet.cc:701] Row locks acquired
0709 12:24:50.403164 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:24:50.403295 (+   131us) write_op.cc:270] Start()
0709 12:24:50.403415 (+   120us) write_op.cc:276] Timestamp: P: 1783599890403256 usec, L: 0
0709 12:24:50.403441 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:24:50.430481 (+ 27040us) log.cc:844] Serialized 532 byte log entry
0709 12:24:51.022526 (+592045us) op_driver.cc:464] REPLICATION: finished
0709 12:24:51.486128 (+463602us) write_op.cc:301] APPLY: starting
0709 12:24:51.495613 (+  9485us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:51.525890 (+ 30277us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:51.543422 (+ 17532us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:51.561722 (+ 18300us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:51.587688 (+ 25966us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:24:51.587739 (+    51us) write_op.cc:312] APPLY: finished
0709 12:24:51.587979 (+   240us) log.cc:844] Serialized 22 byte log entry
0709 12:24:51.588183 (+   204us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:51.588274 (+    91us) write_op.cc:454] Released schema lock
0709 12:24:51.588311 (+    37us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:51.588663 (+   352us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:51.588693 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":411987,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":366139,"apply.run_cpu_time_us":2474,"apply.run_wall_time_us":180353,"num_ops":1,"prepare.queue_time_us":122564,"prepare.run_cpu_time_us":17269,"prepare.run_wall_time_us":173229,"raft.queue_time_us":435967,"replication_time_us":594834,"spinlock_wait_cycles":5661696,"thread_start_us":688580,"threads_started":4,"wal-append.queue_time_us":113875}]]}
I20260709 12:24:51.740828 12571 raft_consensus.cc:2804] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:51.739753 12465 raft_consensus.cc:2804] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:51.811276 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:51.812528 10998 raft_consensus.cc:3060] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:51.786123 10819 leader_election.cc:304] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:51.744719 12610 raft_consensus.cc:493] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:51.791690 12631 raft_consensus.cc:2804] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:51.798094 12643 raft_consensus.cc:2804] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:51.798749 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:51.779517 12638 raft_consensus.cc:2804] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:51.757153 12518 consensus_queue.cc:1059] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 12:24:51.738449 12586 raft_consensus.cc:2749] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:24:51.800637 12662 log.cc:927] Time spent T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
I20260709 12:24:51.801608 12511 raft_consensus.cc:2804] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:51.818594 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:51.819680 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:51.824895 10920 raft_consensus.cc:2468] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 3.
W20260709 12:24:51.847666 10969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:51.809149 12571 raft_consensus.cc:493] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:51.815881 12465 raft_consensus.cc:493] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:51.828034 12610 raft_consensus.cc:3060] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:51.822777 12632 leader_election.cc:290] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:51.861841 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:51.862468 11001 raft_consensus.cc:3060] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:51.861156 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:51.829982 12631 raft_consensus.cc:493] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:51.863417 10995 raft_consensus.cc:2468] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 2.
I20260709 12:24:51.830225 12643 raft_consensus.cc:493] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:51.779374 12664 raft_consensus.cc:515] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:51.865605 10998 raft_consensus.cc:2468] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 3.
I20260709 12:24:51.847863 12511 raft_consensus.cc:493] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:51.859943 12571 raft_consensus.cc:3060] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:51.910380 12668 log.cc:927] Time spent T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:24:51.860354 12465 raft_consensus.cc:3060] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:51.867151 12631 raft_consensus.cc:3060] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:51.930569 11001 raft_consensus.cc:2468] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 5.
I20260709 12:24:51.876713 12643 raft_consensus.cc:3060] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:51.898267 12511 raft_consensus.cc:3060] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:51.956465 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 97604.4us
I20260709 12:24:51.957748  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:51.931013 12352 raft_consensus.cc:493] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
W20260709 12:24:51.943917 12671 log.cc:927] Time spent T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 12:24:51.868381 12540 consensus_queue.cc:237] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:51.981349 12664 leader_election.cc:290] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:51.984196 12527 leader_election.cc:290] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:51.961944 12434 leader_election.cc:290] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:51.964380 12352 raft_consensus.cc:515] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:51.993366 12435 raft_consensus.cc:515] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:51.994660 12352 leader_election.cc:290] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:52.001127 12351 raft_consensus.cc:493] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:52.001727 12351 raft_consensus.cc:515] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:52.005322 12643 raft_consensus.cc:515] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:52.006608 10997 raft_consensus.cc:2368] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 4. Current term is 5.
W20260709 12:24:52.021039 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 82123.9us
W20260709 12:24:52.025440 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 128928us
I20260709 12:24:52.038094 10895 leader_election.cc:304] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:52.039871 12643 leader_election.cc:290] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:52.042052 12538 raft_consensus.cc:2749] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:52.042490 12643 raft_consensus.cc:493] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:52.044199 12435 leader_election.cc:290] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:52.044518 12610 raft_consensus.cc:515] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:52.044763 12571 raft_consensus.cc:515] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:52.049126 12571 leader_election.cc:290] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:52.047088 12610 leader_election.cc:290] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:52.051080 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:52.052735 10992 tablet_service.cc:1558] Processing DeleteTablet for tablet a6a28416571247df878823d464c05f1e with delete_type TABLET_DATA_TOMBSTONED (TS edcc56ddd3264984b4da6c1db59e7f08 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37496
I20260709 12:24:52.034258 12531 raft_consensus.cc:493] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:52.085491 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9331e5342644ca2bae19187b083a7d5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:52.086216 10920 raft_consensus.cc:2468] T e9331e5342644ca2bae19187b083a7d5 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 2.
I20260709 12:24:52.069023 12538 raft_consensus.cc:493] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:52.088152 12538 raft_consensus.cc:515] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:52.090358 12538 leader_election.cc:290] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:52.059108 12506 tablet_bootstrap.cc:492] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=1 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:52.091284 12679 raft_consensus.cc:3055] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:52.092005 12679 raft_consensus.cc:740] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:52.092653 12506 tablet_bootstrap.cc:492] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap complete.
I20260709 12:24:52.093597 12506 ts_tablet_manager.cc:1403] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d: Time spent bootstrapping tablet: real 1.354s	user 0.044s	sys 0.064s
I20260709 12:24:52.093130 12679 consensus_queue.cc:260] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:24:52.094689 12679 raft_consensus.cc:3060] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:52.073220 12332 leader_election.cc:290] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:52.073774 12351 leader_election.cc:290] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:52.062919 12631 raft_consensus.cc:515] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:52.097892 12631 leader_election.cc:290] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:52.077392 12511 raft_consensus.cc:515] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:52.043025 12643 raft_consensus.cc:515] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:52.099526 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:52.100867 10921 raft_consensus.cc:2468] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 2.
I20260709 12:24:52.106863 12643 leader_election.cc:290] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:52.109110 10920 raft_consensus.cc:1240] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:24:52.112003 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:52.081377 12435 raft_consensus.cc:493] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:52.113903 12435 raft_consensus.cc:515] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:52.115957 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:52.083309 12536 raft_consensus.cc:1064] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea: attempting to promote NON_VOTER 3c52e0825c02476e89d84da9bb849f5d to VOTER
I20260709 12:24:52.120604 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:52.121533 12435 leader_election.cc:290] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:52.061842 12465 raft_consensus.cc:515] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:52.104570 12511 leader_election.cc:290] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:52.122301 12536 consensus_queue.cc:237] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:52.125313 10921 raft_consensus.cc:2393] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 5: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:24:52.127480 12465 leader_election.cc:290] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:52.080045 12685 tablet_replica.cc:333] T a6a28416571247df878823d464c05f1e P edcc56ddd3264984b4da6c1db59e7f08: stopping tablet replica
I20260709 12:24:52.112424 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:52.154505 10920 raft_consensus.cc:2468] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 7.
I20260709 12:24:52.091348 12531 raft_consensus.cc:515] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:52.079914 12638 raft_consensus.cc:493] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:52.156373 12638 raft_consensus.cc:3060] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:52.118992 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:52.115335 10927 raft_consensus.cc:1240] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 12:24:52.157744 10922 raft_consensus.cc:3060] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:52.119896 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:52.158506 10924 raft_consensus.cc:2468] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 3.
I20260709 12:24:52.121867 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:52.114637 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:52.104420 10749 catalog_manager.cc:5697] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 3 to 6, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 6 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:52.153539 12042 raft_consensus.cc:493] T ab816bcc6183447994a2cc013e46c5f8 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:52.102902 12506 raft_consensus.cc:359] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [term 5 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:24:52.155344 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:52.168633 12506 raft_consensus.cc:740] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [term 5 LEARNER]: Becoming Follower/Learner. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Initialized, Role: LEARNER
I20260709 12:24:52.168877 10920 raft_consensus.cc:3060] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:52.169395 12506 consensus_queue.cc:260] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:24:52.152194 10999 raft_consensus.cc:2393] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 5: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:24:52.156966 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:52.174480 10922 raft_consensus.cc:2468] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 5.
I20260709 12:24:52.179024 10925 raft_consensus.cc:2468] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 3.
I20260709 12:24:52.188516 12506 ts_tablet_manager.cc:1434] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d: Time spent starting tablet: real 0.095s	user 0.010s	sys 0.001s
I20260709 12:24:52.190310 10939 tablet_copy_service.cc:342] P e2d5c637307a407ab688f5ccd6f0fcea: Request end of tablet copy session 3c52e0825c02476e89d84da9bb849f5d-438b1d5ca177401b94c157e6f4836150 received from {username='slave'} at 127.0.0.1:50036
I20260709 12:24:52.190783 10939 tablet_copy_service.cc:434] P e2d5c637307a407ab688f5ccd6f0fcea: ending tablet copy session 3c52e0825c02476e89d84da9bb849f5d-438b1d5ca177401b94c157e6f4836150 on tablet 438b1d5ca177401b94c157e6f4836150 with peer 3c52e0825c02476e89d84da9bb849f5d
I20260709 12:24:52.167934 12042 raft_consensus.cc:515] T ab816bcc6183447994a2cc013e46c5f8 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:52.192898 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:52.193457 12042 leader_election.cc:290] T ab816bcc6183447994a2cc013e46c5f8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:52.193809 10925 raft_consensus.cc:2393] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 5: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:24:52.181057 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:52.193946 10895 leader_election.cc:304] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:52.195080 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d9a61ecaf84695b70f8519ee57706f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:52.195858 12435 raft_consensus.cc:2804] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:52.195080 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c6d38c4d8a90a81975a6a0cb13" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:52.196333 12435 raft_consensus.cc:493] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:52.197697 12435 raft_consensus.cc:3060] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:52.197912 11001 raft_consensus.cc:1275] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:52.200091 10895 leader_election.cc:304] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:52.157996 12531 leader_election.cc:290] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:52.201987 10895 leader_election.cc:304] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:52.206485 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:52.208360 10994 raft_consensus.cc:2468] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 3.
I20260709 12:24:52.210805 10968 leader_election.cc:304] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:52.211802 12531 raft_consensus.cc:2804] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:52.212945 12531 raft_consensus.cc:697] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 5 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
W20260709 12:24:52.213768 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 423681us
I20260709 12:24:52.214118 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:52.185787 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:52.215102 10968 leader_election.cc:304] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:52.155499 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:52.184800 10749 catalog_manager.cc:5697] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 1 to 3, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 3 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } }
I20260709 12:24:52.240089 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab816bcc6183447994a2cc013e46c5f8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:52.239908 10749 catalog_manager.cc:5697] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 3 to 5, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 5 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:52.206670 12435 raft_consensus.cc:515] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:52.207455 12438 raft_consensus.cc:2804] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:52.243860 12438 raft_consensus.cc:697] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 5 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:52.245258 12435 leader_election.cc:290] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:52.147312 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9331e5342644ca2bae19187b083a7d5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:52.245896 10921 raft_consensus.cc:3060] T e9331e5342644ca2bae19187b083a7d5 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:52.249325 12352 consensus_queue.cc:1048] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:52.250972 10895 leader_election.cc:304] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:52.215837 10928 raft_consensus.cc:3060] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:52.201855 12440 raft_consensus.cc:2804] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:52.251989 12042 raft_consensus.cc:2804] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:52.252421 12042 raft_consensus.cc:493] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:52.252496 12440 raft_consensus.cc:697] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:52.252894 12042 raft_consensus.cc:3060] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:52.253631 12440 consensus_queue.cc:237] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } }
I20260709 12:24:52.254679 11621 raft_consensus.cc:1275] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [term 4 LEARNER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 12:24:52.216377 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 430375us
I20260709 12:24:52.256053 10819 leader_election.cc:304] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:52.256904 12675 raft_consensus.cc:2804] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:52.257368 12675 raft_consensus.cc:697] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 6 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:52.257719 12537 consensus_queue.cc:1048] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:52.258342 12675 consensus_queue.cc:237] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:24:52.257207 10819 leader_election.cc:304] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:52.267174 12205 raft_consensus.cc:2804] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:52.267256 10819 leader_election.cc:304] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:52.267685 12205 raft_consensus.cc:493] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:52.268146 12205 raft_consensus.cc:3060] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:52.269198 12654 raft_consensus.cc:2804] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:52.269768 12654 raft_consensus.cc:697] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040 [term 3 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:52.270689 12654 consensus_queue.cc:237] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:52.289139 12204 raft_consensus.cc:493] T e3d9a61ecaf84695b70f8519ee57706f P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:52.215502 10820 leader_election.cc:400] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 election: Vote denied by peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945) with higher term. Message: Invalid argument: T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 4. Current term is 5.
I20260709 12:24:52.299285 10820 leader_election.cc:403] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
W20260709 12:24:52.299883 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 84496.1us
I20260709 12:24:52.300227 10997 raft_consensus.cc:1275] T 3f8a389131ef4c77a3e08488aa4759eb P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:24:52.276785 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:52.217144 12427 raft_consensus.cc:2804] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:52.167320 12638 raft_consensus.cc:515] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:52.280049 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:52.244886 12438 consensus_queue.cc:237] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:52.303880 12385 raft_consensus.cc:3060] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:52.304364 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:52.305084 11001 raft_consensus.cc:2368] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 4. Current term is 5.
I20260709 12:24:52.213937 12531 consensus_queue.cc:237] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:52.216190 12679 raft_consensus.cc:2804] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:52.305939 12638 leader_election.cc:290] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:52.305866 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:52.292549 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:52.306766 10996 raft_consensus.cc:2368] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 7. Current term is 8.
I20260709 12:24:52.306911 10929 raft_consensus.cc:2368] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 4. Current term is 5.
I20260709 12:24:52.183105 10920 raft_consensus.cc:2468] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 4.
I20260709 12:24:52.308112 10925 raft_consensus.cc:2368] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 4. Current term is 5.
I20260709 12:24:52.284034 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:52.308840 10999 raft_consensus.cc:2393] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 3: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:24:52.217295 10994 raft_consensus.cc:1275] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:24:52.305898 12679 raft_consensus.cc:493] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:52.309768 12679 raft_consensus.cc:3060] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:52.303261 12427 raft_consensus.cc:697] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [term 2 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:52.311144 10928 raft_consensus.cc:2468] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 8.
I20260709 12:24:52.311337 12427 consensus_queue.cc:237] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:52.322485 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:52.322749 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:52.284626 12093 consensus_queue.cc:1048] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:52.324525 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9331e5342644ca2bae19187b083a7d5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:52.332535 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d9a61ecaf84695b70f8519ee57706f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:52.324901 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:52.333426 10849 raft_consensus.cc:3060] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:52.334600 12385 raft_consensus.cc:2749] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945) with higher term. Message: Invalid argument: T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 4. Current term is 5.
I20260709 12:24:52.326220 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:52.326606 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:52.327775 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:52.329457 10968 leader_election.cc:304] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:52.330173 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:52.271981 12042 raft_consensus.cc:515] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:52.381687 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 50151.6us
I20260709 12:24:52.398069 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:52.399061 10928 raft_consensus.cc:2393] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 3: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:24:52.399816 12042 leader_election.cc:290] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:52.331005 10749 catalog_manager.cc:5697] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 3 to 6, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 6 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:52.401921 10749 catalog_manager.cc:5697] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 1 to 2, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 2 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:52.276571 12205 raft_consensus.cc:515] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:52.409031 10921 raft_consensus.cc:2468] T e9331e5342644ca2bae19187b083a7d5 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 3.
I20260709 12:24:52.374789 10847 raft_consensus.cc:3060] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:52.410226 12646 consensus_queue.cc:1048] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:52.410547 12533 consensus_queue.cc:1048] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:52.410319 12205 leader_election.cc:290] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:52.384573 10820 leader_election.cc:400] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 election: Vote denied by peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945) with higher term. Message: Invalid argument: T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 4. Current term is 5.
I20260709 12:24:52.415977 10820 leader_election.cc:403] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:24:52.416831 10820 leader_election.cc:400] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 election: Vote denied by peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945) with higher term. Message: Invalid argument: T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 7. Current term is 8.
I20260709 12:24:52.417125 10820 leader_election.cc:403] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:24:52.389953 12679 raft_consensus.cc:515] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:52.391624 12685 raft_consensus.cc:2243] T a6a28416571247df878823d464c05f1e P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:52.392364 12204 raft_consensus.cc:515] T e3d9a61ecaf84695b70f8519ee57706f P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:52.392823 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:52.419806 12685 raft_consensus.cc:2272] T a6a28416571247df878823d464c05f1e P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:52.396054 10845 raft_consensus.cc:2468] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 5.
I20260709 12:24:52.409206 10848 raft_consensus.cc:3060] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:52.420639 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 91274.3us
I20260709 12:24:52.422236 10968 leader_election.cc:304] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:52.381919 10849 raft_consensus.cc:2468] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 8.
I20260709 12:24:52.423156 12675 raft_consensus.cc:2749] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945) with higher term. Message: Invalid argument: T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 7. Current term is 8.
I20260709 12:24:52.423926 12643 raft_consensus.cc:2804] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:52.424556 12643 raft_consensus.cc:697] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 4 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:52.425458 12685 ts_tablet_manager.cc:1916] T a6a28416571247df878823d464c05f1e P edcc56ddd3264984b4da6c1db59e7f08: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:52.425689 12631 raft_consensus.cc:2804] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:52.426283 12631 raft_consensus.cc:697] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:52.427140 12631 consensus_queue.cc:237] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:52.429352 12679 leader_election.cc:290] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:52.425508 12643 consensus_queue.cc:237] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:52.438789 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:52.436239 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:52.439446 10853 raft_consensus.cc:3060] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:24:52.440434 10854 raft_consensus.cc:2468] T e3d9a61ecaf84695b70f8519ee57706f P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 5.
I20260709 12:24:52.440172 10922 raft_consensus.cc:2393] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 4: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:24:52.443112 12204 leader_election.cc:290] T e3d9a61ecaf84695b70f8519ee57706f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:52.447623 10853 raft_consensus.cc:2468] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 4.
I20260709 12:24:52.448619 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:52.449074 10968 leader_election.cc:304] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:52.449417 11000 raft_consensus.cc:2368] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 2. Current term is 3.
I20260709 12:24:52.450208 12571 raft_consensus.cc:2749] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:52.451817 12511 raft_consensus.cc:493] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:52.452538 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:52.452315 12511 raft_consensus.cc:515] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:52.454465 12511 leader_election.cc:290] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:52.455613 11000 raft_consensus.cc:2393] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 4: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:24:52.455964 10848 raft_consensus.cc:2468] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 3.
I20260709 12:24:52.418228 10847 raft_consensus.cc:2468] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 5.
I20260709 12:24:52.457000 12205 raft_consensus.cc:2749] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945) with higher term. Message: Invalid argument: T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 4. Current term is 5.
I20260709 12:24:52.450696 10968 leader_election.cc:304] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:52.460795 12571 raft_consensus.cc:2749] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:52.461726 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:52.468231 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:52.469048 10850 raft_consensus.cc:2393] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 5: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:24:52.469863 10968 leader_election.cc:304] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:52.470935 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c6d38c4d8a90a81975a6a0cb13" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:52.472426 12571 raft_consensus.cc:2804] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:52.473178 12571 raft_consensus.cc:493] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:52.473848 12571 raft_consensus.cc:3060] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:52.474537 10820 leader_election.cc:400] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 election: Vote denied by peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945) with higher term. Message: Invalid argument: T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 2. Current term is 3.
I20260709 12:24:52.475047 10820 leader_election.cc:403] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:24:52.473268 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d9a61ecaf84695b70f8519ee57706f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:52.480818 12205 raft_consensus.cc:2749] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945) with higher term. Message: Invalid argument: T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 2. Current term is 3.
I20260709 12:24:52.482257 12205 raft_consensus.cc:493] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:24:52.482477 10968 leader_election.cc:304] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:52.482836 12205 raft_consensus.cc:515] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:52.483777 10968 leader_election.cc:304] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:52.484591 12632 raft_consensus.cc:2804] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:52.484927 10968 leader_election.cc:304] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:52.485076 12632 raft_consensus.cc:697] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [term 4 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:52.485827 12534 raft_consensus.cc:2804] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:52.486402 12534 raft_consensus.cc:697] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:52.486058 12632 consensus_queue.cc:237] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:52.487002 12531 raft_consensus.cc:2804] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:52.487516 12531 raft_consensus.cc:697] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 5 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:52.487321 12534 consensus_queue.cc:237] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:52.488509 12531 consensus_queue.cc:237] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:52.488734 12571 raft_consensus.cc:515] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:52.491752 12571 leader_election.cc:290] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:52.491863 12205 leader_election.cc:290] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:24:52.493034 12204 raft_consensus.cc:493] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:52.493134 12675 raft_consensus.cc:493] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:52.493086 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:52.493908 12204 raft_consensus.cc:515] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:52.494078 12675 raft_consensus.cc:515] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:52.495868 12204 leader_election.cc:290] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:52.497013 12675 leader_election.cc:290] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:52.492828 12205 raft_consensus.cc:493] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:52.497875 10968 leader_election.cc:304] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:24:52.497968 12205 raft_consensus.cc:515] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:52.499382 12511 raft_consensus.cc:2804] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:52.500264 12205 leader_election.cc:290] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:52.500370 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d9a61ecaf84695b70f8519ee57706f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:52.500315 12511 raft_consensus.cc:697] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:52.502389 11621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352aa49c65194abbb863d7553a091f11" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:24:52.502630 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352aa49c65194abbb863d7553a091f11" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:52.506251 10850 raft_consensus.cc:1275] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:24:52.512213 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:52.514225 12511 consensus_queue.cc:237] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:52.517653 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:52.520406 12205 raft_consensus.cc:493] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:52.521054 12205 raft_consensus.cc:515] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:52.522544 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:52.523144 12205 leader_election.cc:290] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:52.525041 12675 raft_consensus.cc:493] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:24:52.525614 12675 raft_consensus.cc:515] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:52.529942 12675 leader_election.cc:290] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:24:52.532755 11000 raft_consensus.cc:1240] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:52.536899 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:52.537611 10848 raft_consensus.cc:2468] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 5.
I20260709 12:24:52.403520 10749 catalog_manager.cc:5697] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: config changed from index 2 to -1, term changed from 3 to 4, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66), NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) evicted, now has a pending config: VOTER 80cd7d227db44f34a6108591dad9c040 (127.9.116.65), VOTER e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66), VOTER edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67), NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68). New cstate: current_term: 4 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:24:52.541915 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:52.543387 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5794ba618e514e28a7542ab6af39d8c9" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:52.545413 10968 leader_election.cc:304] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:52.546836 10820 leader_election.cc:304] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:52.547564 12675 raft_consensus.cc:493] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:52.539479 12042 consensus_queue.cc:1059] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:52.548149 12675 raft_consensus.cc:515] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:52.548693 11621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5794ba618e514e28a7542ab6af39d8c9" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:24:52.546428 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d9a61ecaf84695b70f8519ee57706f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:52.552306 10850 raft_consensus.cc:3060] T e3d9a61ecaf84695b70f8519ee57706f P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:52.554286 10749 catalog_manager.cc:5697] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } }
I20260709 12:24:52.555369 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63ecfc9bd3945818cfe15c03f001315" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:52.556713 10820 leader_election.cc:304] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:52.563305 10749 catalog_manager.cc:5697] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 3 to 4, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 4 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:52.565464 10749 catalog_manager.cc:5697] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 3 to 4, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 4 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:52.550745 12435 raft_consensus.cc:3055] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:52.550748 12675 leader_election.cc:290] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:52.554360 12205 raft_consensus.cc:2749] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:52.574555 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:52.577451 10847 raft_consensus.cc:2393] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 4: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:24:52.577360 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:52.569940 12204 raft_consensus.cc:2749] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:52.567564 10749 catalog_manager.cc:5697] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 1 to 4, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 4 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:52.573208 12435 raft_consensus.cc:740] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:52.580958 12632 raft_consensus.cc:2804] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:52.606437 10848 raft_consensus.cc:1275] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:24:52.607244 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab816bcc6183447994a2cc013e46c5f8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:52.606801 10850 raft_consensus.cc:2468] T e3d9a61ecaf84695b70f8519ee57706f P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 6.
I20260709 12:24:52.610162 10854 raft_consensus.cc:1240] T e3d9a61ecaf84695b70f8519ee57706f P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:52.605998 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:52.612200 10847 raft_consensus.cc:2393] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 3: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:24:52.614763 10968 leader_election.cc:304] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:52.615965 12632 raft_consensus.cc:493] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:24:52.616436 12534 raft_consensus.cc:2804] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:52.617092 12534 raft_consensus.cc:697] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 6 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:52.618017 12534 consensus_queue.cc:237] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:52.616519 12632 raft_consensus.cc:3060] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:52.624112 10994 raft_consensus.cc:1275] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:24:52.636572 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:52.637980 10854 raft_consensus.cc:2393] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 4: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
W20260709 12:24:52.660363 10894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:52.663650 10854 raft_consensus.cc:1275] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:24:52.687953 10922 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
mode: GRACEFUL
new_leader_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:41546
I20260709 12:24:52.688882 10922 raft_consensus.cc:606] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Received request to transfer leadership to TS 80cd7d227db44f34a6108591dad9c040
I20260709 12:24:52.689347 10922 raft_consensus.cc:614] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:52.703619 10922 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18294423a68a4671bf6c5a0f98645e4c"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
mode: GRACEFUL
new_leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:41546
I20260709 12:24:52.704236 10922 raft_consensus.cc:606] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 2 LEADER]: Received request to transfer leadership to TS edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:52.715201 10922 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
mode: GRACEFUL
new_leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:41546
I20260709 12:24:52.716300 10922 raft_consensus.cc:606] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Received request to transfer leadership to TS edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:52.654929 12434 consensus_queue.cc:1048] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 12:24:52.682225 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:52.744019 10894 leader_election.cc:304] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:52.745194 10894 leader_election.cc:304] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:52.745239 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d9a61ecaf84695b70f8519ee57706f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:52.745455 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:52.644068 12435 consensus_queue.cc:260] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:52.748180 10894 leader_election.cc:304] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:52.750164 10997 raft_consensus.cc:1275] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:52.753916 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:52.755139 10928 raft_consensus.cc:2368] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 2. Current term is 3.
I20260709 12:24:52.756775 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:52.761493 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:52.761886 12042 raft_consensus.cc:2749] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:52.763211 10894 leader_election.cc:304] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:52.762993 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:52.768754 10929 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
mode: GRACEFUL
new_leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:41546
I20260709 12:24:52.769527 10929 raft_consensus.cc:606] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Received request to transfer leadership to TS edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:52.770094 12042 consensus_queue.cc:1048] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:52.780576 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63ecfc9bd3945818cfe15c03f001315" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:52.762303 12093 raft_consensus.cc:2749] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:52.788021 10929 raft_consensus.cc:1240] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:52.762070 12540 raft_consensus.cc:2749] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:52.768389 12351 raft_consensus.cc:2749] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:52.772150 12675 raft_consensus.cc:493] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:52.785375 12435 raft_consensus.cc:3060] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:52.815692 12711 log.cc:927] Time spent T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 12:24:52.816088 12675 raft_consensus.cc:515] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:52.827392 11588 leader_election.cc:304] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:52.857455 12440 raft_consensus.cc:2955] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index 2 to 5, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:24:52.860636 12019 consensus_queue.cc:1048] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:52.873558 10994 raft_consensus.cc:2955] T 3f8a389131ef4c77a3e08488aa4759eb P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 2 to 5, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:24:52.894393 12665 raft_consensus.cc:2749] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:24:52.904786 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 132371us
W20260709 12:24:52.922760 10895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:52.933745 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:52.934077 10994 raft_consensus.cc:1275] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 12:24:52.935973 10994 pending_rounds.cc:85] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08: Aborting all ops after (but not including) 4
I20260709 12:24:52.936925 10994 pending_rounds.cc:107] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08: Aborting uncommitted NO_OP operation due to leader change: 5.5
W20260709 12:24:52.935197 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 135083us
W20260709 12:24:52.905579 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 97331.7us
I20260709 12:24:52.934587 11000 raft_consensus.cc:2468] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 4.
I20260709 12:24:52.940337 10819 leader_election.cc:400] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 election: Vote denied by peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339) with higher term. Message: Invalid argument: T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 4. Current term is 5.
I20260709 12:24:52.941494 10994 raft_consensus.cc:2889] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:52.949302 10819 leader_election.cc:400] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 election: Vote denied by peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339) with higher term. Message: Invalid argument: T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 4. Current term is 5.
I20260709 12:24:52.949402 10921 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8b17195a94142039c40f598ed006c94"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
mode: GRACEFUL
new_leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:41546
I20260709 12:24:52.950693 10921 raft_consensus.cc:606] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Received request to transfer leadership to TS edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:52.951143 10921 raft_consensus.cc:614] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:52.926623 12675 leader_election.cc:290] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:52.961550 12632 raft_consensus.cc:515] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:53.005512 10997 raft_consensus.cc:1240] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 5. Current term is 6. Ops: []
W20260709 12:24:53.020308 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 88119.3us
W20260709 12:24:53.020407 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 66940.1us
I20260709 12:24:53.023940 10819 leader_election.cc:304] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:53.025084 10923 raft_consensus.cc:1275] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:24:53.027046 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 79855.2us
I20260709 12:24:53.036015 10920 raft_consensus.cc:1275] T e9331e5342644ca2bae19187b083a7d5 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:53.038806 10921 raft_consensus.cc:1275] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:24:53.027292 12714 log.cc:927] Time spent T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 12:24:53.060483 10819 leader_election.cc:400] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 election: Vote denied by peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339) with higher term. Message: Invalid argument: T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 2. Current term is 3.
I20260709 12:24:53.061957 10819 leader_election.cc:304] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:53.063465 10819 leader_election.cc:304] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:53.065063 10819 leader_election.cc:304] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:24:53.060624 12715 log.cc:927] Time spent T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 12:24:53.093258 12205 raft_consensus.cc:2749] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:53.094414 12205 raft_consensus.cc:2749] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:24:53.095919 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 52124.3us
I20260709 12:24:53.095165 12205 raft_consensus.cc:2749] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:53.063051 12725 raft_consensus.cc:2749] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:24:53.114696 12724 log.cc:927] Time spent T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
W20260709 12:24:53.116520 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 72902.6us
I20260709 12:24:53.118266 10894 leader_election.cc:304] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:24:53.128430 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 63480.6us
I20260709 12:24:53.139211 10819 leader_election.cc:304] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:53.128199 12019 raft_consensus.cc:2749] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:53.148284  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:24:53.153471  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:53.167168 12720 raft_consensus.cc:2749] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:53.197332 10845 raft_consensus.cc:1275] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:53.204169 10925 raft_consensus.cc:2468] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 6.
I20260709 12:24:53.194240 12632 leader_election.cc:290] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:53.208084 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:53.210799 10922 raft_consensus.cc:2393] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 4: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
W20260709 12:24:53.209276 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 62434.6us
I20260709 12:24:53.209568 10927 raft_consensus.cc:1275] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:24:53.188627 12730 consensus_queue.cc:1059] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 12:24:53.217583 10894 leader_election.cc:304] T ab816bcc6183447994a2cc013e46c5f8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:53.223331 10998 raft_consensus.cc:1240] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 LEADER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:53.224216 10849 raft_consensus.cc:1275] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:24:53.225149 10999 raft_consensus.cc:1240] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 4 LEADER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:53.229089 10894 leader_election.cc:304] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:53.229550 10847 raft_consensus.cc:1275] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:24:53.231099 10820 leader_election.cc:304] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:53.217346 12685 ts_tablet_manager.cc:1929] T a6a28416571247df878823d464c05f1e P edcc56ddd3264984b4da6c1db59e7f08: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:24:53.236202 12685 log.cc:1199] T a6a28416571247df878823d464c05f1e P edcc56ddd3264984b4da6c1db59e7f08: Deleting WAL directory at /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599781984018-9681-0/minicluster-data/ts-2-root/wals/a6a28416571247df878823d464c05f1e
I20260709 12:24:53.237481 12685 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37496 (request call id 60) took 1301 ms. Trace:
I20260709 12:24:53.238161 12726 raft_consensus.cc:2804] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:53.238826 12726 raft_consensus.cc:493] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:24:53.239364 12726 raft_consensus.cc:3060] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:53.240489 12727 raft_consensus.cc:993] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea: : Instructing follower edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:24:53.246835 10894 leader_election.cc:304] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:53.231802 12435 raft_consensus.cc:2749] T ab816bcc6183447994a2cc013e46c5f8 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:53.248116 12435 raft_consensus.cc:2749] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:53.248853 12434 consensus_queue.cc:1048] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:53.250905 12737 raft_consensus.cc:993] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea: : Instructing follower edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:24:53.251515 12737 raft_consensus.cc:1081] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Signalling peer edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:24:53.254022 10923 raft_consensus.cc:1240] T e9331e5342644ca2bae19187b083a7d5 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:53.254549 12537 raft_consensus.cc:2749] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:53.254722 12738 consensus_queue.cc:1048] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:53.226385 12717 consensus_queue.cc:1048] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:24:53.259431 12731 consensus_queue.cc:1048] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:53.237860 12685 rpcz_store.cc:276] 0709 12:24:52.007739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:52.038630 (+ 30891us) service_pool.cc:224] Handling call
0709 12:24:52.079513 (+ 40883us) ts_tablet_manager.cc:1151] Deleting tablet a6a28416571247df878823d464c05f1e
0709 12:24:52.079654 (+   141us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:24:52.478823 (+399169us) tablet_metadata.cc:665] Metadata flushed
0709 12:24:53.208658 (+729835us) tablet_metadata.cc:665] Metadata flushed
0709 12:24:53.237386 (+ 28728us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":106374,"tablet-delete.queue_time_us":26050,"thread_start_us":28454,"threads_started":1}
I20260709 12:24:53.263947 12440 raft_consensus.cc:1081] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Signalling peer edcc56ddd3264984b4da6c1db59e7f08 to start an election
W20260709 12:24:53.224876 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 88080.8us
I20260709 12:24:53.266376 12727 consensus_queue.cc:1059] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:53.267323 10739 catalog_manager.cc:5028] TS edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): tablet a6a28416571247df878823d464c05f1e (table test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]) successfully deleted
I20260709 12:24:53.267529 12537 raft_consensus.cc:3055] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:53.268061 12537 raft_consensus.cc:740] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:53.269546 10850 raft_consensus.cc:3055] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:53.269011 12537 consensus_queue.cc:260] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:53.270710 12537 raft_consensus.cc:3060] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:53.277436 11621 raft_consensus.cc:2955] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 2 to 5, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:24:53.280644 12654 consensus_queue.cc:1048] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:53.282897 12727 raft_consensus.cc:993] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea: : Instructing follower edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:24:53.283486 12727 raft_consensus.cc:1081] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 2 LEADER]: Signalling peer edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:24:53.270020 10850 raft_consensus.cc:740] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:53.288343 10850 consensus_queue.cc:260] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:53.289541 10850 raft_consensus.cc:3060] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:53.292299 12679 consensus_queue.cc:1048] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:53.295312 12679 consensus_queue.cc:1048] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:53.300217 12534 consensus_queue.cc:1048] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:53.309139 11000 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:37500
I20260709 12:24:53.309372 10850 raft_consensus.cc:1275] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:24:53.309916 10850 pending_rounds.cc:85] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040: Aborting all ops after (but not including) 2
I20260709 12:24:53.310071 11002 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:37500
I20260709 12:24:53.310328 10850 pending_rounds.cc:107] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:24:53.310608 11002 raft_consensus.cc:493] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:53.310783 10850 raft_consensus.cc:2889] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:53.311048 11002 raft_consensus.cc:3060] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:53.311685 12730 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
W20260709 12:24:53.312582 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 77267.1us
I20260709 12:24:53.321707 10998 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "18294423a68a4671bf6c5a0f98645e4c"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:37500
I20260709 12:24:53.322438 10998 raft_consensus.cc:493] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:53.322826 10998 raft_consensus.cc:3060] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:53.324402 12679 raft_consensus.cc:493] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:53.325111 12679 raft_consensus.cc:515] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:24:53.328744 12679 leader_election.cc:290] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:24:53.327679 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 81752.3us
I20260709 12:24:53.333374 10925 raft_consensus.cc:1275] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:24:53.333860 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:53.336907 10921 raft_consensus.cc:1275] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:53.338639 12511 consensus_queue.cc:1048] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:53.339744 12643 consensus_queue.cc:1048] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:53.340371 10850 raft_consensus.cc:1275] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:24:53.333195 10927 raft_consensus.cc:1275] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:24:53.342828 12427 raft_consensus.cc:493] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:53.340981 10998 raft_consensus.cc:515] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:53.373229 12427 raft_consensus.cc:515] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } }
I20260709 12:24:53.375047 10998 leader_election.cc:290] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:53.343469 11621 raft_consensus.cc:3060] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [term 5 LEARNER]: Advancing to term 6
I20260709 12:24:53.375428 12427 leader_election.cc:290] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:53.382098 11000 raft_consensus.cc:493] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:53.382643 11000 raft_consensus.cc:3060] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:53.386720 11621 raft_consensus.cc:1275] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [term 6 LEARNER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:24:53.343871 12654 consensus_queue.cc:1059] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 12:24:53.401043 10847 raft_consensus.cc:3055] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:53.401472 10847 raft_consensus.cc:740] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:53.402292 10847 consensus_queue.cc:260] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:53.403743 12730 consensus_queue.cc:1175] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "edcc56ddd3264984b4da6c1db59e7f08" responder_term: 3 status { last_received { term: 3 index: 2 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 2. Current term is 3. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:24:53.404965 10998 raft_consensus.cc:1275] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:24:53.344223 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:53.345291 10921 raft_consensus.cc:1275] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:53.407480 10850 raft_consensus.cc:3060] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:53.403525 10847 raft_consensus.cc:3060] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:53.343644 10819 leader_election.cc:304] T e3d9a61ecaf84695b70f8519ee57706f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:53.348676 10925 raft_consensus.cc:1275] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:53.349635 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:53.352865 10849 raft_consensus.cc:1275] T e3d9a61ecaf84695b70f8519ee57706f P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:53.417377 10924 raft_consensus.cc:2468] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 6.
W20260709 12:24:53.359115 10818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:53.367144 10922 raft_consensus.cc:2468] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 6.
I20260709 12:24:53.367756 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:53.364511 10845 raft_consensus.cc:1275] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:24:53.416996 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 73508.9us
I20260709 12:24:53.419895 12571 consensus_queue.cc:1048] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:53.347709 12726 raft_consensus.cc:515] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:53.425192 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18294423a68a4671bf6c5a0f98645e4c" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:53.425845 10920 raft_consensus.cc:3055] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:53.426214 10920 raft_consensus.cc:740] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:53.425976 12679 consensus_queue.cc:1048] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:53.426802 12732 raft_consensus.cc:2764] T e3d9a61ecaf84695b70f8519ee57706f P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:24:53.392522 11000 raft_consensus.cc:515] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } }
I20260709 12:24:53.397679 11002 raft_consensus.cc:515] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:53.356523 10854 raft_consensus.cc:1275] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:53.418179 12511 consensus_queue.cc:1048] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:53.429055 10994 raft_consensus.cc:1240] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:53.431093 12531 consensus_queue.cc:1048] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:53.432284 11002 leader_election.cc:290] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:53.433674 12737 consensus_queue.cc:1048] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:53.434736 10847 raft_consensus.cc:1275] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:24:53.435112 10847 pending_rounds.cc:85] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040: Aborting all ops after (but not including) 1
I20260709 12:24:53.435329 10847 pending_rounds.cc:107] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:24:53.435588 10847 raft_consensus.cc:2889] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:53.424456 12726 leader_election.cc:290] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:24:53.436471 12654 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 12:24:53.436290 12537 consensus_queue.cc:1059] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:53.437839 12537 raft_consensus.cc:3055] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:53.439954 12537 raft_consensus.cc:740] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:53.440917 12537 consensus_queue.cc:260] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:53.427130 10920 consensus_queue.cc:260] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:53.442833 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:53.443216 10920 raft_consensus.cc:3060] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:53.442907 11000 leader_election.cc:290] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265)
I20260709 12:24:53.445851 12537 raft_consensus.cc:3060] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:53.448429 12571 consensus_queue.cc:1048] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
W20260709 12:24:53.446445 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 48045.9us
I20260709 12:24:53.460556 10850 raft_consensus.cc:2468] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 6.
I20260709 12:24:53.464217 10854 raft_consensus.cc:1240] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:24:53.460860 10968 leader_election.cc:304] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:53.469705 12571 raft_consensus.cc:2804] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:53.470306 12571 raft_consensus.cc:493] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:53.470715 12571 raft_consensus.cc:3060] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:53.472533 10968 leader_election.cc:304] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:53.472800 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:53.473402 12511 raft_consensus.cc:2804] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:53.478904  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:53.485472 12511 raft_consensus.cc:697] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:53.485934 12571 raft_consensus.cc:515] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:24:53.486591 12511 consensus_queue.cc:237] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:53.491350 10893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:53.511133 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:53.511914 10929 raft_consensus.cc:3055] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:53.512531 10929 raft_consensus.cc:740] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:53.513456 10929 consensus_queue.cc:260] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } }
I20260709 12:24:53.514504 10929 raft_consensus.cc:3060] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:53.512091 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 51437.6us
I20260709 12:24:53.529379 12571 leader_election.cc:290] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:53.538442 11000 raft_consensus.cc:1240] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:24:53.544518 10920 raft_consensus.cc:2468] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 3.
I20260709 12:24:53.545601 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:53.549010 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:53.560721 10845 raft_consensus.cc:2955] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 2 to 5, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:24:53.568214 10853 raft_consensus.cc:1275] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:24:53.576164 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:53.577252 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:53.578073 10920 raft_consensus.cc:2393] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 4: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:24:53.582782 12385 consensus_queue.cc:1048] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:53.597914 10929 raft_consensus.cc:2468] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 4.
I20260709 12:24:53.599713 10923 raft_consensus.cc:2468] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 2.
I20260709 12:24:53.602605 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18294423a68a4671bf6c5a0f98645e4c" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:53.603920 10851 raft_consensus.cc:3060] T 18294423a68a4671bf6c5a0f98645e4c P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:53.612139 10752 catalog_manager.cc:5697] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: config changed from index -1 to 2, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added, no longer has a pending config: VOTER 80cd7d227db44f34a6108591dad9c040 (127.9.116.65), VOTER e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66), VOTER edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67), NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68). New cstate: current_term: 4 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:24:53.617771 12019 raft_consensus.cc:493] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:53.618546 10994 raft_consensus.cc:2468] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 4.
I20260709 12:24:53.618341 12019 raft_consensus.cc:515] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:53.619199 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:53.620901 10849 raft_consensus.cc:3060] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:53.619993 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:53.623591 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:53.627321 10752 catalog_manager.cc:5697] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: term changed from 4 to 5, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68). New cstate: current_term: 5 leader_uuid: "3c52e0825c02476e89d84da9bb849f5d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:24:53.632575 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 80643.3us
I20260709 12:24:53.633431 12632 consensus_queue.cc:1048] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:53.636906 10851 raft_consensus.cc:2468] T 18294423a68a4671bf6c5a0f98645e4c P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 3.
I20260709 12:24:53.644052 10849 raft_consensus.cc:2468] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 2.
I20260709 12:24:53.663172 10820 leader_election.cc:304] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:53.667713 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:53.668641 10849 raft_consensus.cc:2410] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:24:53.669962 12019 leader_election.cc:290] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:53.673029 10820 leader_election.cc:304] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
W20260709 12:24:53.728294 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 94023.6us
I20260709 12:24:53.638172 12351 consensus_queue.cc:1048] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
W20260709 12:24:53.729959 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 57021.8us
W20260709 12:24:53.734920 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 71267.9us
I20260709 12:24:53.736027 10968 leader_election.cc:304] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:53.691318 12675 raft_consensus.cc:2749] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:53.653668 12733 consensus_queue.cc:1048] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.082s
I20260709 12:24:53.674585 12511 consensus_queue.cc:1048] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 12:24:53.677177 12427 consensus_queue.cc:1059] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 12:24:53.752764 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:53.733695 12204 raft_consensus.cc:2804] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:53.755761 11002 raft_consensus.cc:2410] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:24:53.770977 12766 raft_consensus.cc:2804] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:24:53.773730 10893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:53.780092 12766 raft_consensus.cc:697] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [term 3 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:53.781279 12766 consensus_queue.cc:237] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:53.744266 12643 consensus_queue.cc:1048] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 12:24:53.733707 12734 consensus_queue.cc:1048] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 12:24:53.749419 12631 consensus_queue.cc:1048] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 12:24:53.784446 12204 raft_consensus.cc:697] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:53.816478 10895 leader_election.cc:304] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:24:53.872260 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 136292us
I20260709 12:24:53.873112 10968 leader_election.cc:304] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:53.833899 12717 raft_consensus.cc:2749] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:53.878369 12773 raft_consensus.cc:2804] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:24:53.888625 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 52615.8us
W20260709 12:24:53.882428 12742 log.cc:927] Time spent T 00000000000000000000000000000000 P 9619ad7a9e7f4d9b8039487e3ee77243: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:24:53.910715 12205 raft_consensus.cc:493] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:53.927026 12773 raft_consensus.cc:697] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
W20260709 12:24:53.940034 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 65014.2us
I20260709 12:24:53.940903 10968 leader_election.cc:304] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:53.942423 12733 raft_consensus.cc:2749] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:53.942696 10968 leader_election.cc:304] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
W20260709 12:24:53.929982 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 176757us
W20260709 12:24:53.942456 12759 log.cc:927] Time spent T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 12:24:53.944427 12734 raft_consensus.cc:2804] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:53.922542 12204 consensus_queue.cc:237] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:53.936414 12205 raft_consensus.cc:515] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:53.958653 12205 leader_election.cc:290] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:53.967257 12773 consensus_queue.cc:237] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:53.984357 12734 raft_consensus.cc:697] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:53.985543 12734 consensus_queue.cc:237] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } }
W20260709 12:24:53.989970 12761 log.cc:927] Time spent T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.259s	user 0.003s	sys 0.000s
I20260709 12:24:53.994766 10925 raft_consensus.cc:1275] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:54.093700 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:24:54.126354 12762 log.cc:927] Time spent T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.400s	user 0.000s	sys 0.001s
I20260709 12:24:54.079838 12632 consensus_queue.cc:1048] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
W20260709 12:24:54.210372 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 47098.3us
W20260709 12:24:54.230032 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 107901us
I20260709 12:24:54.243037 10749 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60734 (request call id 140) took 6551 ms. Trace:
I20260709 12:24:54.243672 10749 rpcz_store.cc:276] 0709 12:24:47.691977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.692153 (+   176us) service_pool.cc:224] Handling call
0709 12:24:48.229336 (+537183us) spinlock_profiling.cc:243] Waited 266 ms on lock 0x7b540007b554. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df2090 00007f7594e90f3a 00007f759ac46e9c 00007f759ad4504e 00007f75992062a4 00007f7599206232 00007f7599206161 00007f75992060dc 00007f7599205392 00007f75931c348c 00007f75931c28c6
0709 12:24:54.242920 (+6013584us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:52.796665 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:52.903072 (+106407us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:52.904874 (+  1802us) write_op.cc:435] Acquired schema lock
0709 12:24:52.904894 (+    20us) tablet.cc:662] Decoding operations
0709 12:24:53.004716 (+ 99822us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:53.004796 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:53.004829 (+    33us) tablet.cc:685] Acquiring locks for 10 operations
0709 12:24:53.149446 (+144617us) tablet.cc:701] Row locks acquired
0709 12:24:53.149474 (+    28us) write_op.cc:260] PREPARE: finished
0709 12:24:53.149690 (+   216us) write_op.cc:270] Start()
0709 12:24:53.149857 (+   167us) write_op.cc:276] Timestamp: P: 1783599893149626 usec, L: 0
0709 12:24:53.149883 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:24:53.150781 (+   898us) log.cc:844] Serialized 4250 byte log entry
0709 12:24:53.367709 (+216928us) op_driver.cc:464] REPLICATION: finished
0709 12:24:53.462767 (+ 95058us) write_op.cc:301] APPLY: starting
0709 12:24:53.462864 (+    97us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:53.463085 (+   221us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:53.463196 (+   111us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:53.490215 (+ 27019us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:53.490515 (+   300us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 12:24:53.490562 (+    47us) write_op.cc:312] APPLY: finished
0709 12:24:53.490847 (+   285us) log.cc:844] Serialized 76 byte log entry
0709 12:24:53.491026 (+   179us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:53.491175 (+   149us) write_op.cc:454] Released schema lock
0709 12:24:53.491228 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:53.503417 (+ 12189us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:53.503453 (+    36us) write_op.cc:454] Released schema lock
0709 12:24:53.511880 (+  8427us) spinlock_profiling.cc:243] Waited 46.5 ms on lock 0x7b540007b554. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e8532a 00007f7594e0af14 00007f7594e0aec3 00007f7594e0ae38 00007f7594e0adf3 00007f7594e0a0dc 00007f7594e33e16 00007f7594e1bcbb 00007f7594e0639d 00007f7594e09d75
Metrics: {"dns_us":4126,"mutex_wait_us":1268,"reported_tablets":38,"spinlock_wait_cycles":612646272,"child_traces":[["op",{"apply.queue_time_us":94749,"apply.run_cpu_time_us":3455,"apply.run_wall_time_us":40623,"num_ops":10,"prepare.queue_time_us":145858,"prepare.run_cpu_time_us":16815,"prepare.run_wall_time_us":567233,"raft.queue_time_us":1797,"raft.run_cpu_time_us":26329,"raft.run_wall_time_us":193443,"replication_time_us":217519,"spinlock_wait_cycles":107072128,"thread_start_us":359961,"threads_started":4,"wal-append.queue_time_us":165014}]]}
I20260709 12:24:54.300676 12675 raft_consensus.cc:3055] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:54.301210 12675 raft_consensus.cc:740] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:54.302117 12675 consensus_queue.cc:260] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:24:54.342222 12654 raft_consensus.cc:493] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:54.344815 12654 raft_consensus.cc:515] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:54.347137 12654 leader_election.cc:290] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:24:54.344869 12763 log.cc:927] Time spent T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.616s	user 0.000s	sys 0.010s
W20260709 12:24:54.354066 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 253191us
W20260709 12:24:54.359928 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 129101us
W20260709 12:24:54.369777 12772 log.cc:927] Time spent T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.518s	user 0.004s	sys 0.007s
I20260709 12:24:54.381071 10752 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36188 (request call id 44) took 2382 ms. Trace:
I20260709 12:24:54.407902 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:54.412364 10994 raft_consensus.cc:1240] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:24:54.413744 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:54.416613 10750 catalog_manager.cc:5697] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 2 to 4, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 4 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } }
I20260709 12:24:54.425225 10853 raft_consensus.cc:1275] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:54.433940 10752 rpcz_store.cc:276] 0709 12:24:51.998934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:51.999121 (+   187us) service_pool.cc:224] Handling call
0709 12:24:54.380975 (+2381854us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:53.646490 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:53.647045 (+   555us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:53.647083 (+    38us) write_op.cc:435] Acquired schema lock
0709 12:24:53.647105 (+    22us) tablet.cc:662] Decoding operations
0709 12:24:53.669791 (+ 22686us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:53.677229 (+  7438us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:53.690589 (+ 13360us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:24:53.762636 (+ 72047us) tablet.cc:701] Row locks acquired
0709 12:24:53.771775 (+  9139us) write_op.cc:260] PREPARE: finished
0709 12:24:53.783457 (+ 11682us) write_op.cc:270] Start()
0709 12:24:53.783621 (+   164us) write_op.cc:276] Timestamp: P: 1783599893783399 usec, L: 0
0709 12:24:53.783644 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:24:53.818740 (+ 35096us) log.cc:844] Serialized 974 byte log entry
0709 12:24:53.944286 (+125546us) op_driver.cc:464] REPLICATION: finished
0709 12:24:53.952407 (+  8121us) write_op.cc:301] APPLY: starting
0709 12:24:53.955180 (+  2773us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:53.960725 (+  5545us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:53.960836 (+   111us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:53.961457 (+   621us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:53.978571 (+ 17114us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:24:53.978646 (+    75us) write_op.cc:312] APPLY: finished
0709 12:24:53.978961 (+   315us) log.cc:844] Serialized 28 byte log entry
0709 12:24:53.979189 (+   228us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:53.979320 (+   131us) write_op.cc:454] Released schema lock
0709 12:24:53.979379 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:53.979825 (+   446us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:53.979854 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":205663,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":241,"apply.run_cpu_time_us":2519,"apply.run_wall_time_us":27393,"num_ops":2,"prepare.queue_time_us":154,"prepare.run_cpu_time_us":4205,"prepare.run_wall_time_us":180484,"replication_time_us":160286}]]}
I20260709 12:24:54.437122 10750 catalog_manager.cc:5697] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } }
I20260709 12:24:54.452158 10750 catalog_manager.cc:5697] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 1 to 5, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 5 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } }
I20260709 12:24:54.453629 10750 catalog_manager.cc:5697] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 3 to 7, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 7 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } }
I20260709 12:24:54.455113 10750 catalog_manager.cc:5697] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 5 to 6, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 6 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } }
I20260709 12:24:54.459525 10750 catalog_manager.cc:5697] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } }
I20260709 12:24:54.430332 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:54.479461 12675 raft_consensus.cc:3060] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:54.488615 10820 leader_election.cc:304] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:54.545874 11614 tablet_service.cc:1558] Processing DeleteTablet for tablet 3f8a389131ef4c77a3e08488aa4759eb with delete_type TABLET_DATA_TOMBSTONED (TS 3c52e0825c02476e89d84da9bb849f5d not found in new config with opid_index -1) from {username='slave'} at 127.0.0.1:58238
W20260709 12:24:54.560981 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 72350.9us
I20260709 12:24:54.564852 10750 catalog_manager.cc:5697] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 1 to 2, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 2 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:54.567122 10750 catalog_manager.cc:5697] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 5 to 6, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 6 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } }
I20260709 12:24:54.568989 10750 catalog_manager.cc:5697] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: config changed from index -1 to 4, term changed from 4 to 6, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to <none>, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New cstate: current_term: 6 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:24:54.599267 10853 raft_consensus.cc:3060] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:54.602914 10820 leader_election.cc:304] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:24:54.603781 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 50341.1us
I20260709 12:24:54.600256 10750 catalog_manager.cc:5697] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 1 to 3, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 3 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:54.605558 10750 catalog_manager.cc:5697] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 4 to 7, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 7 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } }
I20260709 12:24:54.608459 10750 catalog_manager.cc:5697] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 2 to 4, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 4 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:54.639726 10925 raft_consensus.cc:1275] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:24:54.638492 10750 catalog_manager.cc:5697] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 4 to 6, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 6 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } }
I20260709 12:24:54.641141 10750 catalog_manager.cc:5697] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 4 to 6, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 6 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } }
I20260709 12:24:54.612030 12654 raft_consensus.cc:2749] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:54.613233 12204 raft_consensus.cc:2749] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:54.635630 10853 raft_consensus.cc:1275] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:54.622210 12775 consensus_queue.cc:1048] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:24:54.664206 12736 consensus_queue.cc:1048] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:24:54.839752 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 191267us
W20260709 12:24:54.861641 10739 catalog_manager.cc:5002] TS 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613): delete failed for tablet 3f8a389131ef4c77a3e08488aa4759eb because of a CAS failure. No further retry: Illegal state: Request specified cas_config_opid_index_less_or_equal of 2 but the committed config has opid_index of 5
I20260709 12:24:54.872900 12205 consensus_queue.cc:1048] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:54.988893 10849 raft_consensus.cc:1275] T 18294423a68a4671bf6c5a0f98645e4c P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:54.988826 10925 raft_consensus.cc:1275] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:55.018646 10923 raft_consensus.cc:1275] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:55.020401 10997 raft_consensus.cc:1275] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:24:55.020833 10923 raft_consensus.cc:1275] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:55.076570 12534 consensus_queue.cc:1048] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:55.108847 12205 consensus_queue.cc:1048] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:24:55.120258 12536 raft_consensus.cc:493] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.120976 12536 raft_consensus.cc:515] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:55.123744 12536 leader_election.cc:290] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:55.124503 10851 raft_consensus.cc:1275] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:55.200948 12773 consensus_queue.cc:1048] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:55.234997 12631 consensus_queue.cc:1048] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 12:24:55.238628 12631 consensus_queue.cc:1048] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 12:24:55.257193 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18294423a68a4671bf6c5a0f98645e4c" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:55.274266 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18294423a68a4671bf6c5a0f98645e4c" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:55.269454 12534 consensus_queue.cc:1048] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
W20260709 12:24:55.368643 12814 log.cc:927] Time spent T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.122s	user 0.002s	sys 0.003s
I20260709 12:24:55.391469  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:55.404182 12536 raft_consensus.cc:493] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:55.434612 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 73838.4us
I20260709 12:24:55.436146 12536 raft_consensus.cc:515] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } }
I20260709 12:24:55.439116 12536 leader_election.cc:290] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265)
I20260709 12:24:55.529325 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:55.563849 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:55.571774 10895 leader_election.cc:304] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:55.595290 10895 leader_election.cc:304] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:55.596515 12440 raft_consensus.cc:2749] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:55.603514 12828 raft_consensus.cc:2749] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:55.623796 12828 raft_consensus.cc:493] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:55.624490 12828 raft_consensus.cc:515] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:24:55.626960 12828 leader_election.cc:290] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:55.628222 12042 raft_consensus.cc:493] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.628880 12042 raft_consensus.cc:515] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:55.631057 12042 leader_election.cc:290] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:55.645707 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:55.646767 10999 raft_consensus.cc:2393] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 7: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:24:55.648141 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:55.655565 10752 catalog_manager.cc:5697] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: config changed from index 2 to 5, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:24:55.660490 10752 catalog_manager.cc:5697] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: leader changed from <none> to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 6 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:24:55.670017 12385 raft_consensus.cc:493] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.673718 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:55.673614 12385 raft_consensus.cc:515] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:24:55.675285 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:24:55.676878 10849 raft_consensus.cc:2468] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 7.
I20260709 12:24:55.677676 12385 leader_election.cc:290] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:55.678874 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:24:55.679697 10999 raft_consensus.cc:2468] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 7.
I20260709 12:24:55.683022 10820 leader_election.cc:304] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:55.683975 12385 raft_consensus.cc:2804] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:55.684520 12385 raft_consensus.cc:493] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:55.685220 12385 raft_consensus.cc:3060] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:55.689848 10894 leader_election.cc:304] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:55.691041 12536 raft_consensus.cc:2749] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:55.693939 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:24:55.700068 10921 raft_consensus.cc:2468] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 6.
I20260709 12:24:55.693930 10894 leader_election.cc:304] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:55.702642 12536 raft_consensus.cc:2804] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:55.703073 12536 raft_consensus.cc:493] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:24:55.703437 12536 raft_consensus.cc:3060] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:55.723994 12536 raft_consensus.cc:515] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:24:55.729915 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:55.734030 12536 leader_election.cc:290] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:55.740448 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:55.741482 10996 raft_consensus.cc:2393] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 7: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:24:55.755800 10752 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36188 (request call id 45) took 1263 ms. Trace:
I20260709 12:24:55.757251 10752 rpcz_store.cc:276] 0709 12:24:54.492529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.515025 (+ 22496us) service_pool.cc:224] Handling call
0709 12:24:55.755667 (+1240642us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:55.664921 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:55.665564 (+   643us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:55.665611 (+    47us) write_op.cc:435] Acquired schema lock
0709 12:24:55.665636 (+    25us) tablet.cc:662] Decoding operations
0709 12:24:55.666160 (+   524us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:55.666221 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:55.666250 (+    29us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:24:55.666510 (+   260us) tablet.cc:701] Row locks acquired
0709 12:24:55.666530 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:24:55.666687 (+   157us) write_op.cc:270] Start()
0709 12:24:55.666804 (+   117us) write_op.cc:276] Timestamp: P: 1783599895666634 usec, L: 0
0709 12:24:55.666827 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:24:55.667613 (+   786us) log.cc:844] Serialized 1036 byte log entry
0709 12:24:55.670903 (+  3290us) op_driver.cc:464] REPLICATION: finished
0709 12:24:55.679348 (+  8445us) write_op.cc:301] APPLY: starting
0709 12:24:55.679424 (+    76us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:55.679540 (+   116us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:55.679654 (+   114us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:55.689874 (+ 10220us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:55.691005 (+  1131us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:24:55.691056 (+    51us) write_op.cc:312] APPLY: finished
0709 12:24:55.691260 (+   204us) log.cc:844] Serialized 28 byte log entry
0709 12:24:55.692946 (+  1686us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:55.693035 (+    89us) write_op.cc:454] Released schema lock
0709 12:24:55.693074 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:55.693432 (+   358us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:55.693464 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":58645,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":8202,"apply.run_cpu_time_us":1830,"apply.run_wall_time_us":14062,"num_ops":2,"prepare.queue_time_us":105,"prepare.run_cpu_time_us":3035,"prepare.run_wall_time_us":5728,"replication_time_us":3911}]]}
I20260709 12:24:55.803951 10750 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60736 (request call id 154) took 3542 ms. Trace:
I20260709 12:24:55.811818 10750 rpcz_store.cc:276] 0709 12:24:52.261912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:52.262044 (+   132us) service_pool.cc:224] Handling call
0709 12:24:55.803748 (+3541704us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:55.074212 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:55.075116 (+   904us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:55.075177 (+    61us) write_op.cc:435] Acquired schema lock
0709 12:24:55.075216 (+    39us) tablet.cc:662] Decoding operations
0709 12:24:55.086080 (+ 10864us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:55.086255 (+   175us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:55.086290 (+    35us) tablet.cc:685] Acquiring locks for 14 operations
0709 12:24:55.143383 (+ 57093us) tablet.cc:701] Row locks acquired
0709 12:24:55.148641 (+  5258us) write_op.cc:260] PREPARE: finished
0709 12:24:55.159871 (+ 11230us) write_op.cc:270] Start()
0709 12:24:55.164041 (+  4170us) write_op.cc:276] Timestamp: P: 1783599895157090 usec, L: 0
0709 12:24:55.164083 (+    42us) op_driver.cc:348] REPLICATION: starting
0709 12:24:55.164934 (+   851us) log.cc:844] Serialized 5566 byte log entry
0709 12:24:55.548113 (+383179us) op_driver.cc:464] REPLICATION: finished
0709 12:24:55.615928 (+ 67815us) write_op.cc:301] APPLY: starting
0709 12:24:55.616034 (+   106us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:55.616502 (+   468us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:55.616650 (+   148us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:55.623458 (+  6808us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:55.623955 (+   497us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=14
0709 12:24:55.624037 (+    82us) write_op.cc:312] APPLY: finished
0709 12:24:55.625678 (+  1641us) log.cc:844] Serialized 100 byte log entry
0709 12:24:55.626629 (+   951us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:55.626804 (+   175us) write_op.cc:454] Released schema lock
0709 12:24:55.626913 (+   109us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:55.627979 (+  1066us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:55.628013 (+    34us) write_op.cc:454] Released schema lock
0709 12:24:55.676168 (+ 48155us) spinlock_profiling.cc:243] Waited 1 ms on lock 0x7b540007b554. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e8532a 00007f7594e0af14 00007f7594e0aec3 00007f7594e0ae38 00007f7594e0adf3 00007f7594e0a0dc 00007f7594e33e16 00007f7594e1bcbb 00007f7594e0639d 00007f7594e09d75
Metrics: {"mutex_wait_us":51703,"reported_tablets":33,"child_traces":[["op",{"apply.queue_time_us":67448,"apply.run_cpu_time_us":4995,"apply.run_wall_time_us":12048,"num_ops":14,"prepare.queue_time_us":148042,"prepare.run_cpu_time_us":57557,"prepare.run_wall_time_us":164510,"raft.queue_time_us":117474,"raft.run_cpu_time_us":34861,"raft.run_wall_time_us":61753,"replication_time_us":383819,"spinlock_wait_cycles":2307456,"thread_start_us":315049,"threads_started":4,"wal-append.queue_time_us":102372}]]}
I20260709 12:24:55.809052 12385 raft_consensus.cc:515] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:24:55.840631 10847 raft_consensus.cc:2368] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for earlier term 7. Current term is 8.
I20260709 12:24:55.843081 10894 leader_election.cc:400] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 election: Vote denied by peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265) with higher term. Message: Invalid argument: T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for earlier term 7. Current term is 8.
I20260709 12:24:55.843437 10894 leader_election.cc:403] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:24:55.844527 12042 raft_consensus.cc:3060] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:55.853535 12042 raft_consensus.cc:2749] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265) with higher term. Message: Invalid argument: T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for earlier term 7. Current term is 8.
I20260709 12:24:55.857335 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:55.859973 12385 leader_election.cc:290] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:55.860162 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:55.868976 10999 raft_consensus.cc:3060] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:55.880481 10999 raft_consensus.cc:2468] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 8.
I20260709 12:24:55.888149 10921 raft_consensus.cc:2468] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 8.
I20260709 12:24:55.889835 10820 leader_election.cc:304] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:55.891217 12205 raft_consensus.cc:2804] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:55.891958 12205 raft_consensus.cc:697] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 8 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:55.893065 12205 consensus_queue.cc:237] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:24:55.902371 10925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
mode: GRACEFUL
new_leader_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:41546
I20260709 12:24:55.903368 10925 raft_consensus.cc:606] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 4 LEADER]: Received request to transfer leadership to TS 80cd7d227db44f34a6108591dad9c040
I20260709 12:24:55.908344 10925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
mode: GRACEFUL
new_leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:41546
I20260709 12:24:55.909077 10925 raft_consensus.cc:606] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Received request to transfer leadership to TS edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:55.924934 10921 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
mode: GRACEFUL
new_leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:41546
I20260709 12:24:55.925865 10921 raft_consensus.cc:606] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Received request to transfer leadership to TS edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:55.927845 10921 raft_consensus.cc:614] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:55.930943 10921 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
mode: GRACEFUL
new_leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:41546
I20260709 12:24:55.946883 10921 raft_consensus.cc:606] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Received request to transfer leadership to TS edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:55.958549 10921 raft_consensus.cc:614] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:55.971501 10921 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
mode: GRACEFUL
new_leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:41546
I20260709 12:24:55.972256 10921 raft_consensus.cc:606] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 LEADER]: Received request to transfer leadership to TS edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:24:55.978559 10749 catalog_manager.cc:5697] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 2 to 4, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 4 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } }
I20260709 12:24:55.980121  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:24:55.980139 10749 catalog_manager.cc:5697] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:55.990440  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:55.992424 10749 catalog_manager.cc:5697] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 3 to 5, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 5 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } }
I20260709 12:24:56.000499  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:55.995276 10749 catalog_manager.cc:5697] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 6 to 8, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 8 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } }
I20260709 12:24:56.009162 10749 catalog_manager.cc:5697] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:56.011533 10749 catalog_manager.cc:5697] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 5 to 6, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 6 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } }
I20260709 12:24:56.053273 10749 catalog_manager.cc:5697] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 3 to 5, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 5 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } }
I20260709 12:24:56.055814 10749 catalog_manager.cc:5697] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } }
I20260709 12:24:56.058571 10749 catalog_manager.cc:5697] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:56.076186 12828 raft_consensus.cc:993] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea: : Instructing follower edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:24:56.076762 12440 raft_consensus.cc:1081] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Signalling peer edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:24:56.080036 10997 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:37500
I20260709 12:24:56.079293 10749 catalog_manager.cc:5697] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 2 to 4, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 4 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } }
I20260709 12:24:56.080770 10997 raft_consensus.cc:493] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:56.081319 10997 raft_consensus.cc:3060] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:56.084820 10749 catalog_manager.cc:5697] T e9331e5342644ca2bae19187b083a7d5 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 1 to 3, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 3 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } }
I20260709 12:24:56.088348 10751 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60730 (request call id 134) took 6036 ms. Trace:
I20260709 12:24:56.103852 10751 rpcz_store.cc:276] 0709 12:24:50.052097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.052387 (+   290us) service_pool.cc:224] Handling call
0709 12:24:56.088136 (+6035749us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":73273,"reported_tablets":46,"spinlock_wait_cycles":35584}
I20260709 12:24:56.090029 10749 catalog_manager.cc:5697] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 1 to 3, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 3 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } }
I20260709 12:24:56.106787 10997 raft_consensus.cc:515] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:56.109769 10997 leader_election.cc:290] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:56.119787 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:56.120411 10921 raft_consensus.cc:3055] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:56.120707 10921 raft_consensus.cc:740] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:56.121469 10921 consensus_queue.cc:260] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:56.122777 10921 raft_consensus.cc:3060] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:56.125993 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:56.126765 10848 raft_consensus.cc:3060] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:56.142198 10921 raft_consensus.cc:2468] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 2.
I20260709 12:24:56.156716 12819 raft_consensus.cc:993] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea: : Instructing follower 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:24:56.157532 12440 raft_consensus.cc:1081] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 4 LEADER]: Signalling peer 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:24:56.160494 10851 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:56394
I20260709 12:24:56.161105 10851 raft_consensus.cc:493] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:56.161458 10851 raft_consensus.cc:3060] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:56.167845 10968 leader_election.cc:304] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:56.168898 12820 raft_consensus.cc:2804] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:56.171824 10851 raft_consensus.cc:515] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:56.174642 12820 raft_consensus.cc:697] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 2 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:56.175299 10851 leader_election.cc:290] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:56.175765 12820 consensus_queue.cc:237] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:56.177007 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:56.177582 10921 raft_consensus.cc:3055] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:56.177848 10921 raft_consensus.cc:740] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:56.178601 10921 consensus_queue.cc:260] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:56.179697 10921 raft_consensus.cc:3060] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:56.187767 10921 raft_consensus.cc:2468] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 5.
I20260709 12:24:56.193410 10848 raft_consensus.cc:2468] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 2.
I20260709 12:24:56.202137 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:56.214246 10997 raft_consensus.cc:3060] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:56.216372 10819 leader_election.cc:304] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:56.217528 12385 raft_consensus.cc:2804] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:56.218045 12385 raft_consensus.cc:697] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 5 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:56.219131 12385 consensus_queue.cc:237] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:56.222010 10997 raft_consensus.cc:2468] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 5.
I20260709 12:24:56.246913 10750 catalog_manager.cc:5697] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 2 to 4, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 4 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } }
I20260709 12:24:56.249972 10750 catalog_manager.cc:5697] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 2 to 3, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 3 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:56.266341 10750 catalog_manager.cc:5697] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 1 to 2, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 2 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:56.271144 10750 catalog_manager.cc:5697] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 1 to 4, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 4 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:56.335244 10921 consensus_queue.cc:237] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:56.336323 11621 raft_consensus.cc:3060] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [term 6 LEARNER]: Advancing to term 8
I20260709 12:24:56.346948 11621 raft_consensus.cc:1275] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [term 8 LEARNER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:24:56.349040 12385 consensus_queue.cc:1048] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:56.348685 10751 catalog_manager.cc:5697] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 4 to 5, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 5 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:56.352814 10848 raft_consensus.cc:1275] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:56.356139 12819 consensus_queue.cc:1048] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:56.364001 10749 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60734 (request call id 141) took 1104 ms. Trace:
I20260709 12:24:56.364449 10749 rpcz_store.cc:276] 0709 12:24:55.260208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.261107 (+   899us) service_pool.cc:224] Handling call
0709 12:24:56.363931 (+1102824us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:56.114555 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:56.115344 (+   789us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:56.115380 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:24:56.115394 (+    14us) tablet.cc:662] Decoding operations
0709 12:24:56.116590 (+  1196us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:56.116643 (+    53us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:56.116674 (+    31us) tablet.cc:685] Acquiring locks for 12 operations
0709 12:24:56.117409 (+   735us) tablet.cc:701] Row locks acquired
0709 12:24:56.117424 (+    15us) write_op.cc:260] PREPARE: finished
0709 12:24:56.117526 (+   102us) write_op.cc:270] Start()
0709 12:24:56.117629 (+   103us) write_op.cc:276] Timestamp: P: 1783599896117494 usec, L: 0
0709 12:24:56.117643 (+    14us) op_driver.cc:348] REPLICATION: starting
0709 12:24:56.118141 (+   498us) log.cc:844] Serialized 4773 byte log entry
0709 12:24:56.120312 (+  2171us) op_driver.cc:464] REPLICATION: finished
0709 12:24:56.120787 (+   475us) write_op.cc:301] APPLY: starting
0709 12:24:56.120868 (+    81us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:56.121132 (+   264us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:56.121220 (+    88us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:56.122482 (+  1262us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:56.122727 (+   245us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 12:24:56.122774 (+    47us) write_op.cc:312] APPLY: finished
0709 12:24:56.123066 (+   292us) log.cc:844] Serialized 88 byte log entry
0709 12:24:56.123220 (+   154us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:56.123358 (+   138us) write_op.cc:454] Released schema lock
0709 12:24:56.123431 (+    73us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:56.149503 (+ 26072us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:56.149538 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":78531,"reported_tablets":40,"child_traces":[["op",{"apply.queue_time_us":252,"apply.run_cpu_time_us":3130,"apply.run_wall_time_us":28652,"num_ops":12,"prepare.queue_time_us":216,"prepare.run_cpu_time_us":3861,"prepare.run_wall_time_us":3862,"replication_time_us":2552}]]}
I20260709 12:24:56.386276 10751 catalog_manager.cc:5697] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 reported cstate change: config changed from index 4 to -1, term changed from 6 to 8, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) evicted, now has a pending config: VOTER 80cd7d227db44f34a6108591dad9c040 (127.9.116.65), VOTER e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66), VOTER edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67), NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68). New cstate: current_term: 8 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:24:56.398025 11621 raft_consensus.cc:1275] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:56.417109 10752 catalog_manager.cc:5697] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 1 to 2, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 2 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:56.426513 10750 catalog_manager.cc:5697] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: config changed from index -1 to 4, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added, no longer has a pending config: VOTER 80cd7d227db44f34a6108591dad9c040 (127.9.116.65), VOTER e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66), VOTER edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67), NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68). New cstate: current_term: 8 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:24:56.435042 12783 consensus_queue.cc:1048] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:56.436867 10994 raft_consensus.cc:1275] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:24:56.440001 12440 raft_consensus.cc:993] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea: : Instructing follower edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:24:56.442431 12440 raft_consensus.cc:1081] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 LEADER]: Signalling peer edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:24:56.449242 10997 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:37500
I20260709 12:24:56.450030 10997 raft_consensus.cc:493] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:56.450809 10997 raft_consensus.cc:3060] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:56.459929 12385 raft_consensus.cc:1027] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 8 LEADER]: attempt to promote peer 3c52e0825c02476e89d84da9bb849f5d: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 12:24:56.465780 10997 raft_consensus.cc:515] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:56.481660 12819 raft_consensus.cc:2955] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:24:56.489624 10997 leader_election.cc:290] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:24:56.513797 10921 raft_consensus.cc:1275] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:24:56.513847 10854 raft_consensus.cc:2955] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:24:56.517954 12840 consensus_queue.cc:1048] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:56.522207 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:56.522867 10925 raft_consensus.cc:3055] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:56.523177 10925 raft_consensus.cc:740] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:56.523959 10925 consensus_queue.cc:260] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:56.524982 10925 raft_consensus.cc:3060] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:56.542596 11622 raft_consensus.cc:2955] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:24:56.549110 10738 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3f8a389131ef4c77a3e08488aa4759eb with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:56.554982 10925 raft_consensus.cc:2468] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 6.
I20260709 12:24:56.567811 11614 tablet_service.cc:1558] Processing DeleteTablet for tablet 438b1d5ca177401b94c157e6f4836150 with delete_type TABLET_DATA_TOMBSTONED (TS 3c52e0825c02476e89d84da9bb849f5d not found in new config with opid_index -1) from {username='slave'} at 127.0.0.1:58238
I20260709 12:24:56.584349 10968 leader_election.cc:304] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:24:56.585577 12822 raft_consensus.cc:2804] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:56.587020 12822 raft_consensus.cc:697] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:56.588117 12822 consensus_queue.cc:237] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:56.602682 12842 raft_consensus.cc:2955] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 8 LEADER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:24:56.606508 12844 tablet_replica.cc:333] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d: stopping tablet replica
I20260709 12:24:56.607760 12844 raft_consensus.cc:2243] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [term 8 LEARNER]: Raft consensus shutting down.
I20260709 12:24:56.608484 12844 pending_rounds.cc:70] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d: Trying to abort 2 pending ops.
W20260709 12:24:56.616698 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 171570us
I20260709 12:24:56.623796 10749 catalog_manager.cc:5697] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: config changed from index 5 to 6, VOTER edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) evicted. New cstate: current_term: 4 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:24:56.621207 10751 catalog_manager.cc:5697] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 5 to 6, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 6 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:56.626950 12844 pending_rounds.cc:77] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d: Aborting op as it isn't in flight: id { term: 8 index: 6 } timestamp: 7305625173630242816 op_type: NO_OP noop_request { }
I20260709 12:24:56.628334 12844 raft_consensus.cc:2889] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [term 8 LEARNER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:24:56.629572 12844 pending_rounds.cc:77] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d: Aborting op as it isn't in flight: id { term: 6 index: 5 } timestamp: 7305625158706970624 op_type: NO_OP noop_request { }
I20260709 12:24:56.630110 12840 consensus_queue.cc:1048] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:56.632714 12844 raft_consensus.cc:2889] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [term 8 LEARNER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:24:56.641630 10992 tablet_service.cc:1558] Processing DeleteTablet for tablet 3f8a389131ef4c77a3e08488aa4759eb with delete_type TABLET_DATA_TOMBSTONED (TS edcc56ddd3264984b4da6c1db59e7f08 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:37496
I20260709 12:24:56.641937 12844 raft_consensus.cc:2272] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [term 8 LEARNER]: Raft consensus is shut down!
I20260709 12:24:56.654636 12844 ts_tablet_manager.cc:1916] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:56.688486 12847 tablet_replica.cc:333] T 3f8a389131ef4c77a3e08488aa4759eb P edcc56ddd3264984b4da6c1db59e7f08: stopping tablet replica
I20260709 12:24:56.690572 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:56.699863 10854 raft_consensus.cc:3060] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:56.704010 12847 raft_consensus.cc:2243] T 3f8a389131ef4c77a3e08488aa4759eb P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:56.715176 10925 raft_consensus.cc:1275] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:56.717264 12847 raft_consensus.cc:2272] T 3f8a389131ef4c77a3e08488aa4759eb P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:56.726109 12847 ts_tablet_manager.cc:1916] T 3f8a389131ef4c77a3e08488aa4759eb P edcc56ddd3264984b4da6c1db59e7f08: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:56.727433 12844 ts_tablet_manager.cc:1929] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 8.6
I20260709 12:24:56.736060 12820 consensus_queue.cc:1048] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:56.744374 12844 log.cc:1199] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d: Deleting WAL directory at /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599781984018-9681-0/minicluster-data/ts-3-root/wals/438b1d5ca177401b94c157e6f4836150
I20260709 12:24:56.746449 10854 raft_consensus.cc:2468] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 6.
I20260709 12:24:56.747128 10739 catalog_manager.cc:5028] TS 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613): tablet 438b1d5ca177401b94c157e6f4836150 (table test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]) successfully deleted
W20260709 12:24:56.790942 10739 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 43838.9us
I20260709 12:24:56.807768 10854 raft_consensus.cc:1275] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:24:56.812661 10820 consensus_peers.cc:597] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 -> Peer 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613): Couldn't send request to peer 3c52e0825c02476e89d84da9bb849f5d. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:56.821410 10997 raft_consensus.cc:1275] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:56.825511 12852 consensus_queue.cc:1048] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:56.833530 10925 raft_consensus.cc:1275] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:56.836640 12205 consensus_queue.cc:1048] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:56.840979 12842 consensus_queue.cc:1048] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:24:56.876161 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 52152.6us
W20260709 12:24:56.979918 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 91652.9us
I20260709 12:24:57.027596 10848 raft_consensus.cc:1275] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:57.049366 12860 consensus_queue.cc:1048] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:57.073410 12847 ts_tablet_manager.cc:1929] T 3f8a389131ef4c77a3e08488aa4759eb P edcc56ddd3264984b4da6c1db59e7f08: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.5
I20260709 12:24:57.074074 12847 log.cc:1199] T 3f8a389131ef4c77a3e08488aa4759eb P edcc56ddd3264984b4da6c1db59e7f08: Deleting WAL directory at /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599781984018-9681-0/minicluster-data/ts-2-root/wals/3f8a389131ef4c77a3e08488aa4759eb
I20260709 12:24:57.111866 10739 catalog_manager.cc:5028] TS edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): tablet 3f8a389131ef4c77a3e08488aa4759eb (table test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]) successfully deleted
W20260709 12:24:57.126221 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 44821.4us
W20260709 12:24:57.155998 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 60342.8us
I20260709 12:24:57.180806 10925 raft_consensus.cc:1275] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:57.201212 12852 consensus_queue.cc:1048] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:57.254236 12868 ts_tablet_manager.cc:933] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d: Initiating tablet copy from peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265)
I20260709 12:24:57.276086 12868 tablet_copy_client.cc:323] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Beginning tablet copy session from remote peer at address 127.9.116.65:46265
I20260709 12:24:57.277999  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:57.278436 10864 tablet_copy_service.cc:140] P 80cd7d227db44f34a6108591dad9c040: Received BeginTabletCopySession request for tablet 438b1d5ca177401b94c157e6f4836150 from peer 3c52e0825c02476e89d84da9bb849f5d ({username='slave'} at 127.0.0.1:46480)
I20260709 12:24:57.279513 10864 tablet_copy_service.cc:161] P 80cd7d227db44f34a6108591dad9c040: Beginning new tablet copy session on tablet 438b1d5ca177401b94c157e6f4836150 from peer 3c52e0825c02476e89d84da9bb849f5d at {username='slave'} at 127.0.0.1:46480: session id = 3c52e0825c02476e89d84da9bb849f5d-438b1d5ca177401b94c157e6f4836150
I20260709 12:24:57.294615 10864 tablet_copy_source_session.cc:215] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:57.298821 12868 ts_tablet_manager.cc:1916] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260709 12:24:57.328827 12868 ts_tablet_manager.cc:1929] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 8.6
I20260709 12:24:57.329797 12868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 438b1d5ca177401b94c157e6f4836150. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:57.358059 12868 tablet_copy_client.cc:806] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:57.359042 12868 tablet_copy_client.cc:670] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:57.364779 12868 tablet_copy_client.cc:538] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:57.377084 12868 tablet_bootstrap.cc:492] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap starting.
I20260709 12:24:57.491009 10920 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
mode: GRACEFUL
new_leader_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:41546
I20260709 12:24:57.491770 10920 raft_consensus.cc:606] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 LEADER]: Received request to transfer leadership to TS 80cd7d227db44f34a6108591dad9c040
I20260709 12:24:57.500036 10925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
mode: GRACEFUL
new_leader_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:41546
I20260709 12:24:57.500929 10925 raft_consensus.cc:606] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Received request to transfer leadership to TS 80cd7d227db44f34a6108591dad9c040
I20260709 12:24:57.509627 10920 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
mode: GRACEFUL
new_leader_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:41546
I20260709 12:24:57.510440 10920 raft_consensus.cc:606] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 5 LEADER]: Received request to transfer leadership to TS 80cd7d227db44f34a6108591dad9c040
I20260709 12:24:57.514267 10994 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "60dca008c268416c8e63091506d1653e"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
mode: GRACEFUL
new_leader_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:32960
I20260709 12:24:57.514981 10994 raft_consensus.cc:606] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 3 LEADER]: Received request to transfer leadership to TS 80cd7d227db44f34a6108591dad9c040
I20260709 12:24:57.519541 10925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c63ecfc9bd3945818cfe15c03f001315"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
mode: GRACEFUL
new_leader_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:41546
I20260709 12:24:57.520394 10925 raft_consensus.cc:606] T c63ecfc9bd3945818cfe15c03f001315 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Received request to transfer leadership to TS 80cd7d227db44f34a6108591dad9c040
I20260709 12:24:57.527477 10925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
mode: GRACEFUL
new_leader_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:41546
I20260709 12:24:57.528327 10925 raft_consensus.cc:606] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Received request to transfer leadership to TS 80cd7d227db44f34a6108591dad9c040
I20260709 12:24:57.530088  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:24:57.532752  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:57.534056  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:57.536746 12868 tablet_bootstrap.cc:492] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:57.538640 12868 tablet_bootstrap.cc:492] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap complete.
I20260709 12:24:57.543350 12868 ts_tablet_manager.cc:1403] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d: Time spent bootstrapping tablet: real 0.167s	user 0.034s	sys 0.011s
I20260709 12:24:57.548643 12868 raft_consensus.cc:359] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [term 8 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:24:57.550592 12868 raft_consensus.cc:740] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [term 8 LEARNER]: Becoming Follower/Learner. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Initialized, Role: LEARNER
I20260709 12:24:57.551425 12868 consensus_queue.cc:260] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:24:57.555250 12868 ts_tablet_manager.cc:1434] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.002s
I20260709 12:24:57.558949 10864 tablet_copy_service.cc:342] P 80cd7d227db44f34a6108591dad9c040: Request end of tablet copy session 3c52e0825c02476e89d84da9bb849f5d-438b1d5ca177401b94c157e6f4836150 received from {username='slave'} at 127.0.0.1:46480
I20260709 12:24:57.559932 10864 tablet_copy_service.cc:434] P 80cd7d227db44f34a6108591dad9c040: ending tablet copy session 3c52e0825c02476e89d84da9bb849f5d-438b1d5ca177401b94c157e6f4836150 on tablet 438b1d5ca177401b94c157e6f4836150 with peer 3c52e0825c02476e89d84da9bb849f5d
I20260709 12:24:57.600004 12536 raft_consensus.cc:993] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea: : Instructing follower 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:24:57.600762 12536 raft_consensus.cc:1081] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Signalling peer 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:24:57.612792 10848 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:56394
I20260709 12:24:57.613490 10848 raft_consensus.cc:493] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:57.613847 10848 raft_consensus.cc:3060] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:57.713521 10848 raft_consensus.cc:515] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:24:57.772115 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 78969.6us
I20260709 12:24:57.983446 10848 leader_election.cc:290] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:58.052338 12880 raft_consensus.cc:993] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea: : Instructing follower 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:24:58.053210 12880 raft_consensus.cc:1081] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 LEADER]: Signalling peer 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:24:58.076772 10851 raft_consensus.cc:1240] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:58.077556 10850 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:56394
I20260709 12:24:58.078430 10850 raft_consensus.cc:493] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:58.078891 10850 raft_consensus.cc:3060] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:58.083380 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:58.084111 10923 raft_consensus.cc:3055] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:58.084407 10923 raft_consensus.cc:740] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:58.085215 10923 consensus_queue.cc:260] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:58.086179 10923 raft_consensus.cc:3060] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:58.092909 10850 raft_consensus.cc:515] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:58.179364 10850 leader_election.cc:290] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:58.193060 12882 raft_consensus.cc:1064] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040: attempting to promote NON_VOTER 3c52e0825c02476e89d84da9bb849f5d to VOTER
I20260709 12:24:58.199985 12536 raft_consensus.cc:993] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea: : Instructing follower 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:24:58.205910 12878 raft_consensus.cc:1081] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 5 LEADER]: Signalling peer 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:24:58.204432 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:58.211826 10920 raft_consensus.cc:3055] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:58.213793 10920 raft_consensus.cc:740] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:58.215097 10920 consensus_queue.cc:260] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:58.219976 10920 raft_consensus.cc:3060] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:58.226565 10848 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:56394
I20260709 12:24:58.241667 10848 raft_consensus.cc:493] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:58.242269 10848 raft_consensus.cc:3060] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:58.230801 12879 raft_consensus.cc:993] T c63ecfc9bd3945818cfe15c03f001315 P e2d5c637307a407ab688f5ccd6f0fcea: : Instructing follower 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:24:58.248023 12879 raft_consensus.cc:1081] T c63ecfc9bd3945818cfe15c03f001315 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Signalling peer 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:24:58.247820 12882 consensus_queue.cc:237] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 5, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:58.250877 10848 raft_consensus.cc:515] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:58.253037 10848 leader_election.cc:290] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:58.256115 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:58.258909 10999 raft_consensus.cc:3060] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:58.263057 10848 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c63ecfc9bd3945818cfe15c03f001315"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:56394
I20260709 12:24:58.263661 10848 raft_consensus.cc:493] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:58.264640 10848 raft_consensus.cc:3060] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:58.267028 10999 raft_consensus.cc:2468] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 7.
I20260709 12:24:58.258257 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:58.268572 10929 raft_consensus.cc:3055] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:58.268947 10929 raft_consensus.cc:740] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:58.292236 10929 consensus_queue.cc:260] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:58.291122 10848 raft_consensus.cc:515] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:58.299188 10929 raft_consensus.cc:3060] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:58.301409 12536 raft_consensus.cc:993] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea: : Instructing follower 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:24:58.305950 12536 raft_consensus.cc:1081] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Signalling peer 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:24:58.302035 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63ecfc9bd3945818cfe15c03f001315" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:58.302722 10848 leader_election.cc:290] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:58.308036 10922 raft_consensus.cc:3055] T c63ecfc9bd3945818cfe15c03f001315 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:58.308398 10922 raft_consensus.cc:740] T c63ecfc9bd3945818cfe15c03f001315 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:58.308701 10845 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:56394
I20260709 12:24:58.309342 10845 raft_consensus.cc:493] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:58.305083 10920 raft_consensus.cc:2468] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 5.
I20260709 12:24:58.309171 10922 consensus_queue.cc:260] T c63ecfc9bd3945818cfe15c03f001315 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:58.309741 10845 raft_consensus.cc:3060] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:58.310494 10922 raft_consensus.cc:3060] T c63ecfc9bd3945818cfe15c03f001315 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:58.311757 10819 leader_election.cc:304] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:58.312673 12205 raft_consensus.cc:2804] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:58.313189 12205 raft_consensus.cc:697] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 5 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:58.313997 12205 consensus_queue.cc:237] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:58.320394 10929 raft_consensus.cc:2468] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 6.
I20260709 12:24:58.322136 10819 leader_election.cc:304] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:58.323230 12865 raft_consensus.cc:2804] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:58.323813 12865 raft_consensus.cc:697] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 6 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:58.324226 12866 raft_consensus.cc:993] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08: : Instructing follower 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:24:58.324692 12866 raft_consensus.cc:1081] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 3 LEADER]: Signalling peer 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:24:58.324707 12865 consensus_queue.cc:237] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:58.326952 10922 raft_consensus.cc:2468] T c63ecfc9bd3945818cfe15c03f001315 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 4.
I20260709 12:24:58.334869 10819 leader_election.cc:304] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:58.339130 12865 raft_consensus.cc:2804] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:58.339735 12865 raft_consensus.cc:697] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:58.339619 10749 catalog_manager.cc:5697] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 4 to 5, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 5 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:58.340778 12865 consensus_queue.cc:237] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:58.343904 10923 raft_consensus.cc:2468] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 7.
I20260709 12:24:58.345141 10819 leader_election.cc:304] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:58.346252 12205 raft_consensus.cc:2804] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:58.346897 12205 raft_consensus.cc:697] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 7 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:58.347703 12205 consensus_queue.cc:237] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:58.356549 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:58.357364 11001 raft_consensus.cc:3060] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:58.371299 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:58.372074 10997 raft_consensus.cc:3060] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:58.375896 11622 raft_consensus.cc:1275] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [term 8 LEARNER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:24:58.377827 12205 consensus_queue.cc:1048] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:58.380326 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63ecfc9bd3945818cfe15c03f001315" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:58.381102 10999 raft_consensus.cc:3060] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:58.390859 10923 raft_consensus.cc:1275] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:24:58.367025 11001 raft_consensus.cc:2468] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 5.
I20260709 12:24:58.395042 10848 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "60dca008c268416c8e63091506d1653e"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:56388
I20260709 12:24:58.395879 10848 raft_consensus.cc:493] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:58.396272 10848 raft_consensus.cc:3060] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:58.400363 10845 raft_consensus.cc:515] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:58.407677 12882 consensus_queue.cc:1048] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:58.415650 10999 raft_consensus.cc:2468] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 4.
I20260709 12:24:58.418367 10994 raft_consensus.cc:1275] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:24:58.429630 10997 raft_consensus.cc:2468] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 6.
I20260709 12:24:58.437932 10848 raft_consensus.cc:515] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:58.437124 12205 consensus_queue.cc:1048] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:24:58.440862 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:58.443575 10922 raft_consensus.cc:3055] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:58.443972 10922 raft_consensus.cc:740] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:58.444825 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:58.444695 10922 consensus_queue.cc:260] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:58.445359 10920 raft_consensus.cc:3060] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:58.445771 10922 raft_consensus.cc:3060] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:58.446165 10848 leader_election.cc:290] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:58.462980 10920 raft_consensus.cc:2468] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 4.
I20260709 12:24:58.465283 10819 leader_election.cc:304] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:58.466209 12205 raft_consensus.cc:2804] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:58.466864 12205 raft_consensus.cc:697] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:58.467783 10922 raft_consensus.cc:2468] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 4.
I20260709 12:24:58.467739 12205 consensus_queue.cc:237] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:58.468912 10819 leader_election.cc:304] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:58.469656 12881 raft_consensus.cc:2804] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:58.470171 12881 raft_consensus.cc:697] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:58.472976 12881 consensus_queue.cc:237] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:58.483371 10845 leader_election.cc:290] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:24:58.506629 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 69833.3us
I20260709 12:24:58.512482 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:58.513119 10994 raft_consensus.cc:3060] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:58.517035 10749 catalog_manager.cc:5697] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 3 to 4, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 4 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:58.518610 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:58.519498 10997 raft_consensus.cc:3055] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:58.519977 10997 raft_consensus.cc:740] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:58.519614 10749 catalog_manager.cc:5697] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 5 to 6, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 6 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:58.520758 10997 consensus_queue.cc:260] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:58.521654 10749 catalog_manager.cc:5697] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 6 to 7, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 7 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:58.523811 12882 raft_consensus.cc:2955] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 8 LEADER]: Committing config change with OpId 8.7: config changed from index 4 to 7, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:24:58.535768 10848 raft_consensus.cc:1240] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:58.544637 11622 raft_consensus.cc:2955] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 4 to 7, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:24:58.547883 12822 consensus_queue.cc:1059] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:58.548791 12822 consensus_queue.cc:1243] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Peer 80cd7d227db44f34a6108591dad9c040 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:24:58.556238 10922 raft_consensus.cc:2955] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 4 to 7, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:24:58.575915 10997 raft_consensus.cc:3060] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:58.585309 10997 raft_consensus.cc:2468] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 4.
I20260709 12:24:58.598790 10994 raft_consensus.cc:2468] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 4.
I20260709 12:24:58.602286 10751 catalog_manager.cc:5697] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 3 to 4, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 4 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:58.606829 10751 catalog_manager.cc:5697] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 3 to 4, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 4 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:58.609460 10751 catalog_manager.cc:5697] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 reported cstate change: config changed from index 4 to 7, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New cstate: current_term: 8 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:58.641326 10997 raft_consensus.cc:2955] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 4 to 7, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:24:58.648115  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:58.699100 10994 raft_consensus.cc:1275] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:58.701542 12881 consensus_queue.cc:1048] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:58.711377 10922 raft_consensus.cc:1275] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:58.714794 12881 consensus_queue.cc:1048] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:58.709718 10848 consensus_queue.cc:237] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:58.730701 10999 raft_consensus.cc:1275] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:58.737493 12205 consensus_queue.cc:1048] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:24:58.754000 10923 raft_consensus.cc:1275] T c63ecfc9bd3945818cfe15c03f001315 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:58.761459 12205 consensus_queue.cc:1048] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:58.770737 11622 raft_consensus.cc:1275] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:24:58.771521 11001 raft_consensus.cc:1275] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:24:58.775329 12881 consensus_queue.cc:1048] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:58.777774 12882 consensus_queue.cc:1048] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 12:24:58.806387 10920 raft_consensus.cc:1275] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:58.823498 12842 consensus_queue.cc:1048] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:58.821739 11622 raft_consensus.cc:2955] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, VOTER e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:24:58.807991 12896 raft_consensus.cc:2955] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 8 LEADER]: Committing config change with OpId 8.8: config changed from index 7 to 8, VOTER e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:24:58.830668 10920 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a6a28416571247df878823d464c05f1e"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
mode: GRACEFUL
new_leader_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:41546
I20260709 12:24:58.818779 10994 raft_consensus.cc:2955] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, VOTER e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:24:58.831664 10920 raft_consensus.cc:606] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Received request to transfer leadership to TS 80cd7d227db44f34a6108591dad9c040
I20260709 12:24:58.855903 10997 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
mode: GRACEFUL
new_leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:32960
I20260709 12:24:58.856559 10997 raft_consensus.cc:606] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 LEADER]: Received request to transfer leadership to TS e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:24:58.858129  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:24:58.860339  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:58.862406  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:58.878310 10997 raft_consensus.cc:1275] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:58.891001 12842 consensus_queue.cc:1048] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:58.890686 10750 catalog_manager.cc:5697] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: config changed from index 7 to 8, VOTER e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) evicted. New cstate: current_term: 8 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:24:58.905791 10738 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 438b1d5ca177401b94c157e6f4836150 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:58.929497 10997 raft_consensus.cc:1275] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:24:58.933465 12881 consensus_queue.cc:1048] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:58.954646 10923 raft_consensus.cc:1275] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:58.982481 10912 tablet_service.cc:1558] Processing DeleteTablet for tablet 438b1d5ca177401b94c157e6f4836150 with delete_type TABLET_DATA_TOMBSTONED (TS e2d5c637307a407ab688f5ccd6f0fcea not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:59610
I20260709 12:24:58.995903 10999 raft_consensus.cc:1275] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:59.018221 12912 tablet_replica.cc:333] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea: stopping tablet replica
I20260709 12:24:59.019610 12912 raft_consensus.cc:2243] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:59.006034 12881 consensus_queue.cc:1048] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:24:59.025764 12874 raft_consensus.cc:993] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08: : Instructing follower e2d5c637307a407ab688f5ccd6f0fcea to start an election
W20260709 12:24:59.012389 11645 debug-util.cc:398] Leaking SignalData structure 0x7b08002874e0 after lost signal to thread 9684
I20260709 12:24:59.026428 12874 raft_consensus.cc:1081] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 LEADER]: Signalling peer e2d5c637307a407ab688f5ccd6f0fcea to start an election
W20260709 12:24:59.027405 11645 debug-util.cc:398] Leaking SignalData structure 0x7b0800117180 after lost signal to thread 10786
W20260709 12:24:59.029055 11645 debug-util.cc:398] Leaking SignalData structure 0x7b08002f3200 after lost signal to thread 10878
I20260709 12:24:59.030390 10922 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:59622
I20260709 12:24:59.031077 10922 raft_consensus.cc:493] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:59.031669 10922 raft_consensus.cc:3060] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:59.031909 11645 debug-util.cc:398] Leaking SignalData structure 0x7b080035b8c0 after lost signal to thread 10953
W20260709 12:24:59.034480 11645 debug-util.cc:398] Leaking SignalData structure 0x7b08003629c0 after lost signal to thread 11027
I20260709 12:24:59.042842 12912 raft_consensus.cc:2272] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:59.045957 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 88620.6us
I20260709 12:24:59.048111 10922 raft_consensus.cc:515] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:59.051668 12912 ts_tablet_manager.cc:1916] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:24:59.046087 11645 debug-util.cc:398] Leaking SignalData structure 0x7b0800280cc0 after lost signal to thread 11648
I20260709 12:24:59.057328 10922 leader_election.cc:290] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:24:59.072019 10928 raft_consensus.cc:1275] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:59.077013 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:24:59.077958 10996 raft_consensus.cc:3055] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:59.078397 10996 raft_consensus.cc:740] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:24:59.083307 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:24:59.084110 10850 raft_consensus.cc:3060] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:59.079435 10996 consensus_queue.cc:260] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:59.084981 11001 raft_consensus.cc:1275] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:59.085621 10996 raft_consensus.cc:3060] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:59.092991 10850 raft_consensus.cc:2468] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 7.
I20260709 12:24:59.094694 12842 consensus_queue.cc:1048] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:59.107438 12865 consensus_queue.cc:1048] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:59.109444 12865 consensus_queue.cc:1048] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:59.112682 10922 raft_consensus.cc:1275] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:24:59.116199 12881 consensus_queue.cc:1048] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:59.124888 10894 leader_election.cc:304] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:24:59.132220 12536 raft_consensus.cc:2804] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:59.132761 12536 raft_consensus.cc:697] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:59.133534 12536 consensus_queue.cc:237] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:24:59.141516 10996 raft_consensus.cc:2468] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 7.
W20260709 12:24:59.159750 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 45075.6us
I20260709 12:24:59.221624 10751 catalog_manager.cc:5697] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 6 to 7, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 7 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:59.284411 12352 raft_consensus.cc:993] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea: : Instructing follower 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:24:59.302172 12921 raft_consensus.cc:1081] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Signalling peer 80cd7d227db44f34a6108591dad9c040 to start an election
W20260709 12:24:59.366204 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 79871.5us
I20260709 12:24:59.384508 12912 ts_tablet_manager.cc:1929] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 8.7
I20260709 12:24:59.385238 12912 log.cc:1199] T 438b1d5ca177401b94c157e6f4836150 P e2d5c637307a407ab688f5ccd6f0fcea: Deleting WAL directory at /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599781984018-9681-0/minicluster-data/ts-1-root/wals/438b1d5ca177401b94c157e6f4836150
I20260709 12:24:59.387691 10738 catalog_manager.cc:5028] TS e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): tablet 438b1d5ca177401b94c157e6f4836150 (table test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]) successfully deleted
W20260709 12:24:59.392045 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 45862.8us
I20260709 12:24:59.398847 10853 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a6a28416571247df878823d464c05f1e"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:56394
I20260709 12:24:59.399437 10853 raft_consensus.cc:493] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:59.399852 10853 raft_consensus.cc:3060] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:59.422744 10853 raft_consensus.cc:515] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:59.424734 10853 leader_election.cc:290] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:24:59.426195 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:24:59.428188 11622 raft_consensus.cc:3060] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:59.435707 11622 raft_consensus.cc:2468] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 2.
I20260709 12:24:59.437369 10820 leader_election.cc:304] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040; no voters: 
I20260709 12:24:59.438107 12931 raft_consensus.cc:2804] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:59.438620 12931 raft_consensus.cc:697] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [term 2 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:24:59.439504 12931 consensus_queue.cc:237] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:59.452493 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:24:59.453516 10922 raft_consensus.cc:3055] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:59.453912 10922 raft_consensus.cc:740] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:24:59.454901 10922 consensus_queue.cc:260] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:24:59.457931 10922 raft_consensus.cc:3060] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:59.491714 10922 raft_consensus.cc:2468] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 2.
I20260709 12:24:59.503310 10751 catalog_manager.cc:5697] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 1 to 2, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 2 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:59.716611 10994 raft_consensus.cc:1275] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:24:59.757978 12929 consensus_queue.cc:1048] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:59.780090 10848 raft_consensus.cc:1275] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:24:59.795449 12911 consensus_queue.cc:1048] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:59.826815 10922 raft_consensus.cc:1275] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:59.830446 12881 consensus_queue.cc:1048] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:59.906937 11622 raft_consensus.cc:1275] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [term 2 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:59.912436 12881 consensus_queue.cc:1048] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:25:00.043929  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:00.220503 10999 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "435d66c6d38c4d8a90a81975a6a0cb13"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
mode: GRACEFUL
new_leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:32960
I20260709 12:25:00.221172 10999 raft_consensus.cc:606] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 LEADER]: Received request to transfer leadership to TS e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:00.224395 10923 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "834361a055d34950b4edecba39f07657"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
mode: GRACEFUL
new_leader_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:41546
I20260709 12:25:00.225070 10923 raft_consensus.cc:606] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Received request to transfer leadership to TS 80cd7d227db44f34a6108591dad9c040
I20260709 12:25:00.231230 10999 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
mode: GRACEFUL
new_leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:32960
I20260709 12:25:00.231984 10999 raft_consensus.cc:606] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [term 4 LEADER]: Received request to transfer leadership to TS e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:00.242964 10923 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
mode: GRACEFUL
new_leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:41546
I20260709 12:25:00.243757 10923 raft_consensus.cc:606] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 LEADER]: Received request to transfer leadership to TS edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:00.260499 10848 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c72fddfc26044838a71a798f3371636b"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
mode: GRACEFUL
new_leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:47358
I20260709 12:25:00.261211 10848 raft_consensus.cc:606] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 7 LEADER]: Received request to transfer leadership to TS edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:00.264787  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:25:00.266688  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:00.273313 12934 raft_consensus.cc:993] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea: : Instructing follower 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:25:00.273875 12934 raft_consensus.cc:1081] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Signalling peer 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:25:00.278378 10848 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "834361a055d34950b4edecba39f07657"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:56394
I20260709 12:25:00.279104 10848 raft_consensus.cc:493] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:00.279524 10848 raft_consensus.cc:3060] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:00.280193  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:00.301595 10848 raft_consensus.cc:515] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:00.304533 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:00.305192 10923 raft_consensus.cc:3055] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:00.305513 10923 raft_consensus.cc:740] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:00.306346 10923 consensus_queue.cc:260] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:00.316879 12879 raft_consensus.cc:993] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea: : Instructing follower edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:25:00.317513 12879 raft_consensus.cc:1081] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 LEADER]: Signalling peer edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:25:00.323335 10996 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:37500
I20260709 12:25:00.323956 10996 raft_consensus.cc:493] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:00.324295 10996 raft_consensus.cc:3060] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:00.307380 10923 raft_consensus.cc:3060] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:00.333751 10996 raft_consensus.cc:515] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:00.334111 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:00.334892 10999 raft_consensus.cc:3060] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:00.336074 10996 leader_election.cc:290] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:00.337239 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:00.337837 10922 raft_consensus.cc:3055] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:00.338104 10922 raft_consensus.cc:740] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:00.338380 10923 raft_consensus.cc:2468] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 7.
I20260709 12:25:00.338792 10922 consensus_queue.cc:260] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:00.341322 10819 leader_election.cc:304] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:25:00.342478 12881 raft_consensus.cc:2804] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:00.342983 12881 raft_consensus.cc:697] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 7 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:00.341322 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:00.344586 10850 raft_consensus.cc:3060] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:00.345012 10922 raft_consensus.cc:3060] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:00.343981 12881 consensus_queue.cc:237] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:00.355818 10848 leader_election.cc:290] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:00.378340 10850 raft_consensus.cc:2468] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 8.
I20260709 12:25:00.353785 10999 raft_consensus.cc:2468] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 7.
I20260709 12:25:00.382329 10750 catalog_manager.cc:5697] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 6 to 7, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 7 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:00.405896 10968 leader_election.cc:304] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:25:00.406847 12884 raft_consensus.cc:2804] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:00.408275 12884 raft_consensus.cc:697] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:25:00.386176 10922 raft_consensus.cc:2468] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 8.
I20260709 12:25:00.409626 12884 consensus_queue.cc:237] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:00.425482 10922 consensus_queue.cc:237] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:00.443377 10751 catalog_manager.cc:5697] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 7 to 8, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 8 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
W20260709 12:25:00.444559 10895 consensus_peers.cc:597] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613): Couldn't send request to peer 3c52e0825c02476e89d84da9bb849f5d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3ad755c012434396a53498486697a9b4. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:00.448688 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 48314.6us
I20260709 12:25:00.448915 10999 raft_consensus.cc:1275] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:25:00.452028 12921 consensus_queue.cc:1048] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:25:00.545723 10848 raft_consensus.cc:1275] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:25:00.577111 12911 consensus_queue.cc:1048] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:25:00.583716 12881 raft_consensus.cc:993] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040: : Instructing follower edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:25:00.584483 12945 raft_consensus.cc:1081] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 7 LEADER]: Signalling peer edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:25:00.592842 10999 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c72fddfc26044838a71a798f3371636b"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:37512
I20260709 12:25:00.593539 10999 raft_consensus.cc:493] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:00.593923 10999 raft_consensus.cc:3060] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:00.614439 12952 raft_consensus.cc:2955] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Committing config change with OpId 6.4: config changed from index -1 to 4, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:25:00.623787 12932 raft_consensus.cc:993] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08: : Instructing follower e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:25:00.624334 12932 raft_consensus.cc:1081] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 LEADER]: Signalling peer e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:25:00.624162 10994 raft_consensus.cc:2955] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Committing config change with OpId 6.4: config changed from index -1 to 4, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:25:00.627033 10922 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "435d66c6d38c4d8a90a81975a6a0cb13"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:59622
I20260709 12:25:00.627236 12922 raft_consensus.cc:993] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08: : Instructing follower e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:25:00.627643 10922 raft_consensus.cc:493] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:00.627745 12922 raft_consensus.cc:1081] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [term 4 LEADER]: Signalling peer e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:25:00.628057 10922 raft_consensus.cc:3060] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:00.638378 10922 raft_consensus.cc:515] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:00.641428 10922 leader_election.cc:290] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:00.643574 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c6d38c4d8a90a81975a6a0cb13" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:00.644276 10848 raft_consensus.cc:3060] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:00.646114 10996 consensus_queue.cc:237] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:00.646816 10751 catalog_manager.cc:5697] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: config changed from index -1 to 4, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New cstate: current_term: 6 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:00.648195 10922 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:59622
I20260709 12:25:00.648882 10922 raft_consensus.cc:493] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:00.643603 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c6d38c4d8a90a81975a6a0cb13" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:00.649860 10997 raft_consensus.cc:3055] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:00.650419 10997 raft_consensus.cc:740] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:25:00.651459 10997 consensus_queue.cc:260] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:00.620990 10853 raft_consensus.cc:2955] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Committing config change with OpId 6.4: config changed from index -1 to 4, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:25:00.652261 10922 raft_consensus.cc:3060] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:00.652627 10997 raft_consensus.cc:3060] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:00.677965 10997 raft_consensus.cc:2468] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 6.
I20260709 12:25:00.664537 10848 raft_consensus.cc:2468] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 6.
I20260709 12:25:00.679265 10895 leader_election.cc:304] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:25:00.681686 12911 raft_consensus.cc:2804] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:00.682199 12911 raft_consensus.cc:697] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:00.683109 12911 consensus_queue.cc:237] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:00.674624 10999 raft_consensus.cc:515] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:00.675884 10922 raft_consensus.cc:515] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:00.694242 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:00.695004 10997 raft_consensus.cc:3055] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:00.695330 10997 raft_consensus.cc:740] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:25:00.696600 10922 leader_election.cc:290] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:00.698613 10849 raft_consensus.cc:1240] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:00.696621 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:00.702316 10848 raft_consensus.cc:3060] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:00.701056 10997 consensus_queue.cc:260] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:00.712826 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:00.712148 10999 leader_election.cc:290] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:00.713249 10997 raft_consensus.cc:3060] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:00.713677 10922 raft_consensus.cc:3060] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:00.726294 10848 raft_consensus.cc:2468] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 5.
I20260709 12:25:00.729740 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:00.730438 10847 raft_consensus.cc:3055] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:00.730732 10847 raft_consensus.cc:740] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:00.731488 10847 consensus_queue.cc:260] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:00.732559 10847 raft_consensus.cc:3060] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:00.732645 10922 raft_consensus.cc:2468] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 8.
I20260709 12:25:00.735392 10968 leader_election.cc:304] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:25:00.736871 12884 raft_consensus.cc:2804] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:00.737463 12884 raft_consensus.cc:697] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 8 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:25:00.738272 10894 leader_election.cc:304] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:25:00.738355 12884 consensus_queue.cc:237] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:00.739751 12952 raft_consensus.cc:2804] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:25:00.740499 12952 raft_consensus.cc:697] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 5 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:00.742204 12952 consensus_queue.cc:237] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:00.747146 10847 raft_consensus.cc:2468] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 8.
I20260709 12:25:00.755517 10997 raft_consensus.cc:2468] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 5.
W20260709 12:25:00.768826 10969 consensus_peers.cc:597] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613): Couldn't send request to peer 3c52e0825c02476e89d84da9bb849f5d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 114b16c8c992413dab64ab31b16cb06f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:00.814677 10751 catalog_manager.cc:5697] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 5 to 6, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 6 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:00.830108 10749 catalog_manager.cc:5697] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 7 to 8, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 8 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
W20260709 12:25:00.831056 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 54220.6us
W20260709 12:25:00.835624 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 68493.7us
I20260709 12:25:00.840948 10922 raft_consensus.cc:1275] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 12:25:00.834992 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 46915.9us
W20260709 12:25:00.933233 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 84561.7us
W20260709 12:25:00.943864 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 53324.3us
I20260709 12:25:00.947784 10997 raft_consensus.cc:1275] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:25:00.950528 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 103365us
I20260709 12:25:00.983345 10922 raft_consensus.cc:1275] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:25:00.971679 12968 ts_tablet_manager.cc:933] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d: Initiating tablet copy from peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:00.984689 10749 catalog_manager.cc:5697] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 4 to 5, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 5 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:00.984586 10847 raft_consensus.cc:1275] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:00.990023 12920 consensus_queue.cc:1048] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:00.991298 12884 consensus_queue.cc:1048] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:25:01.003942 10920 raft_consensus.cc:1275] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:25:01.006088 12973 consensus_queue.cc:1048] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:01.010718 10853 raft_consensus.cc:1275] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:25:01.010747 12967 consensus_queue.cc:1048] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:25:01.022789 12968 tablet_copy_client.cc:323] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Beginning tablet copy session from remote peer at address 127.9.116.66:39339
I20260709 12:25:01.025146 10939 tablet_copy_service.cc:140] P e2d5c637307a407ab688f5ccd6f0fcea: Received BeginTabletCopySession request for tablet 3ad755c012434396a53498486697a9b4 from peer 3c52e0825c02476e89d84da9bb849f5d ({username='slave'} at 127.0.0.1:50036)
I20260709 12:25:01.025799 10939 tablet_copy_service.cc:161] P e2d5c637307a407ab688f5ccd6f0fcea: Beginning new tablet copy session on tablet 3ad755c012434396a53498486697a9b4 from peer 3c52e0825c02476e89d84da9bb849f5d at {username='slave'} at 127.0.0.1:50036: session id = 3c52e0825c02476e89d84da9bb849f5d-3ad755c012434396a53498486697a9b4
I20260709 12:25:01.026597 12922 consensus_queue.cc:1048] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:01.033638 12931 consensus_queue.cc:1048] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:25:01.058418 12920 raft_consensus.cc:2955] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 4 LEADER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:25:01.062301 10939 tablet_copy_source_session.cc:215] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:25:01.070389 10922 raft_consensus.cc:2955] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:25:01.125689 12968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ad755c012434396a53498486697a9b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:01.198959 10848 raft_consensus.cc:2955] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:25:01.209774 10994 consensus_queue.cc:237] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
W20260709 12:25:01.233279 10969 consensus_peers.cc:597] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613): Couldn't send request to peer 3c52e0825c02476e89d84da9bb849f5d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b289bc89d592435fb63c7fcf580d95a4. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:01.245527 10848 raft_consensus.cc:1275] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:25:01.247630 12922 consensus_queue.cc:1048] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:01.253170 10853 raft_consensus.cc:1275] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:25:01.255640 12911 consensus_queue.cc:1048] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:25:01.256285 10848 raft_consensus.cc:1275] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:25:01.257874 12965 consensus_queue.cc:1048] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:01.259671 12972 raft_consensus.cc:2955] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 LEADER]: Committing config change with OpId 8.7: config changed from index -1 to 7, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:25:01.263020 10923 raft_consensus.cc:1275] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:25:01.275696 12922 consensus_queue.cc:1048] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:01.265054 10853 raft_consensus.cc:2955] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index -1 to 7, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:25:01.309949 10994 raft_consensus.cc:1275] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:25:01.313884 10923 raft_consensus.cc:1275] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:25:01.316919 10922 raft_consensus.cc:2955] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index -1 to 7, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:25:01.317988 10849 raft_consensus.cc:1275] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:25:01.347115 12922 consensus_queue.cc:1048] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:01.339648 12952 consensus_queue.cc:1048] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 12:25:01.337822 12968 tablet_copy_client.cc:806] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 0 data blocks...
I20260709 12:25:01.350183 12968 tablet_copy_client.cc:670] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:25:01.345126 10994 raft_consensus.cc:1275] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:25:01.311546 10751 catalog_manager.cc:5697] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: config changed from index -1 to 4, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New cstate: current_term: 4 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:01.360966 12968 tablet_copy_client.cc:538] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:25:01.363492 12952 consensus_queue.cc:1048] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:25:01.387480 12932 consensus_queue.cc:1048] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:01.393882 12986 ts_tablet_manager.cc:933] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d: Initiating tablet copy from peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:25:01.410235 10800 auto_rebalancer.cc:629] Failed to schedule move for tablet c72fddfc26044838a71a798f3371636b: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:25:01.413511 12968 tablet_bootstrap.cc:492] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap starting.
I20260709 12:25:01.437855 12986 tablet_copy_client.cc:323] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Beginning tablet copy session from remote peer at address 127.9.116.67:39945
I20260709 12:25:01.471941 11013 tablet_copy_service.cc:140] P edcc56ddd3264984b4da6c1db59e7f08: Received BeginTabletCopySession request for tablet 114b16c8c992413dab64ab31b16cb06f from peer 3c52e0825c02476e89d84da9bb849f5d ({username='slave'} at 127.0.0.1:57514)
I20260709 12:25:01.472731 11013 tablet_copy_service.cc:161] P edcc56ddd3264984b4da6c1db59e7f08: Beginning new tablet copy session on tablet 114b16c8c992413dab64ab31b16cb06f from peer 3c52e0825c02476e89d84da9bb849f5d at {username='slave'} at 127.0.0.1:57514: session id = 3c52e0825c02476e89d84da9bb849f5d-114b16c8c992413dab64ab31b16cb06f
I20260709 12:25:01.486235 10749 catalog_manager.cc:5697] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 reported cstate change: config changed from index -1 to 7, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New cstate: current_term: 8 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:25:01.490557 11013 tablet_copy_source_session.cc:215] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:25:01.494843 12986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 114b16c8c992413dab64ab31b16cb06f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:01.516206 12968 tablet_bootstrap.cc:492] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:01.517390 12968 tablet_bootstrap.cc:492] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap complete.
I20260709 12:25:01.520506 12968 ts_tablet_manager.cc:1403] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d: Time spent bootstrapping tablet: real 0.107s	user 0.032s	sys 0.004s
I20260709 12:25:01.537088 12968 raft_consensus.cc:359] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [term 6 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:01.538450 12968 raft_consensus.cc:740] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [term 6 LEARNER]: Becoming Follower/Learner. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Initialized, Role: LEARNER
I20260709 12:25:01.556279 12986 tablet_copy_client.cc:806] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 0 data blocks...
I20260709 12:25:01.557142 12986 tablet_copy_client.cc:670] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:25:01.539332 12968 consensus_queue.cc:260] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:01.563347 12986 tablet_copy_client.cc:538] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:25:01.586093 12968 ts_tablet_manager.cc:1434] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d: Time spent starting tablet: real 0.065s	user 0.009s	sys 0.000s
I20260709 12:25:01.588363 10939 tablet_copy_service.cc:342] P e2d5c637307a407ab688f5ccd6f0fcea: Request end of tablet copy session 3c52e0825c02476e89d84da9bb849f5d-3ad755c012434396a53498486697a9b4 received from {username='slave'} at 127.0.0.1:50036
I20260709 12:25:01.588837 10939 tablet_copy_service.cc:434] P e2d5c637307a407ab688f5ccd6f0fcea: ending tablet copy session 3c52e0825c02476e89d84da9bb849f5d-3ad755c012434396a53498486697a9b4 on tablet 3ad755c012434396a53498486697a9b4 with peer 3c52e0825c02476e89d84da9bb849f5d
I20260709 12:25:01.597927 12986 tablet_bootstrap.cc:492] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap starting.
I20260709 12:25:01.619410 12968 ts_tablet_manager.cc:933] T b289bc89d592435fb63c7fcf580d95a4 P 3c52e0825c02476e89d84da9bb849f5d: Initiating tablet copy from peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:01.645380 12968 tablet_copy_client.cc:323] T b289bc89d592435fb63c7fcf580d95a4 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Beginning tablet copy session from remote peer at address 127.9.116.67:39945
I20260709 12:25:01.647172 11013 tablet_copy_service.cc:140] P edcc56ddd3264984b4da6c1db59e7f08: Received BeginTabletCopySession request for tablet b289bc89d592435fb63c7fcf580d95a4 from peer 3c52e0825c02476e89d84da9bb849f5d ({username='slave'} at 127.0.0.1:57514)
I20260709 12:25:01.647764 11013 tablet_copy_service.cc:161] P edcc56ddd3264984b4da6c1db59e7f08: Beginning new tablet copy session on tablet b289bc89d592435fb63c7fcf580d95a4 from peer 3c52e0825c02476e89d84da9bb849f5d at {username='slave'} at 127.0.0.1:57514: session id = 3c52e0825c02476e89d84da9bb849f5d-b289bc89d592435fb63c7fcf580d95a4
I20260709 12:25:01.656242 11013 tablet_copy_source_session.cc:215] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:25:01.662937 12968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b289bc89d592435fb63c7fcf580d95a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:01.731323 12968 tablet_copy_client.cc:806] T b289bc89d592435fb63c7fcf580d95a4 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 0 data blocks...
I20260709 12:25:01.731997 12968 tablet_copy_client.cc:670] T b289bc89d592435fb63c7fcf580d95a4 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:25:01.732450 12986 tablet_bootstrap.cc:492] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:01.733466 12986 tablet_bootstrap.cc:492] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap complete.
I20260709 12:25:01.738564 12986 ts_tablet_manager.cc:1403] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d: Time spent bootstrapping tablet: real 0.141s	user 0.030s	sys 0.017s
I20260709 12:25:01.741012 12968 tablet_copy_client.cc:538] T b289bc89d592435fb63c7fcf580d95a4 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:25:01.754506 12986 raft_consensus.cc:359] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:01.763867 12986 raft_consensus.cc:740] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Initialized, Role: LEARNER
I20260709 12:25:01.764786 12986 consensus_queue.cc:260] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:01.773284 12986 ts_tablet_manager.cc:1434] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.004s
I20260709 12:25:01.777055 11013 tablet_copy_service.cc:342] P edcc56ddd3264984b4da6c1db59e7f08: Request end of tablet copy session 3c52e0825c02476e89d84da9bb849f5d-114b16c8c992413dab64ab31b16cb06f received from {username='slave'} at 127.0.0.1:57514
I20260709 12:25:01.777659 11013 tablet_copy_service.cc:434] P edcc56ddd3264984b4da6c1db59e7f08: ending tablet copy session 3c52e0825c02476e89d84da9bb849f5d-114b16c8c992413dab64ab31b16cb06f on tablet 114b16c8c992413dab64ab31b16cb06f with peer 3c52e0825c02476e89d84da9bb849f5d
I20260709 12:25:01.789572  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:01.884656 12968 tablet_bootstrap.cc:492] T b289bc89d592435fb63c7fcf580d95a4 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap starting.
I20260709 12:25:01.953284 11621 raft_consensus.cc:1217] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [term 4 LEARNER]: Deduplicated request from leader. Original: 4.3->[4.4-4.4]   Dedup: 4.4->[]
I20260709 12:25:01.979215 10922 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
mode: GRACEFUL
new_leader_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:41546
I20260709 12:25:01.979907 10922 raft_consensus.cc:606] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Received request to transfer leadership to TS 80cd7d227db44f34a6108591dad9c040
I20260709 12:25:01.986320 10997 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
mode: GRACEFUL
new_leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:32960
I20260709 12:25:01.986927 10997 raft_consensus.cc:606] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 2 LEADER]: Received request to transfer leadership to TS e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:01.991039 12968 tablet_bootstrap.cc:492] T b289bc89d592435fb63c7fcf580d95a4 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:01.991405 10849 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
mode: GRACEFUL
new_leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:47358
I20260709 12:25:01.992034 10849 raft_consensus.cc:606] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 6 LEADER]: Received request to transfer leadership to TS edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:01.992522 12968 tablet_bootstrap.cc:492] T b289bc89d592435fb63c7fcf580d95a4 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap complete.
I20260709 12:25:01.993918 12968 ts_tablet_manager.cc:1403] T b289bc89d592435fb63c7fcf580d95a4 P 3c52e0825c02476e89d84da9bb849f5d: Time spent bootstrapping tablet: real 0.111s	user 0.042s	sys 0.004s
I20260709 12:25:01.995164 10922 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
mode: GRACEFUL
new_leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:41546
I20260709 12:25:01.995875 10922 raft_consensus.cc:606] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Received request to transfer leadership to TS edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:02.000895 10997 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e3d9a61ecaf84695b70f8519ee57706f"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
mode: GRACEFUL
new_leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:32960
I20260709 12:25:02.001840 10997 raft_consensus.cc:606] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 6 LEADER]: Received request to transfer leadership to TS e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:02.004760  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:25:02.006666  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:02.007670  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:02.009580 12968 raft_consensus.cc:359] T b289bc89d592435fb63c7fcf580d95a4 P 3c52e0825c02476e89d84da9bb849f5d [term 8 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:02.010888 12968 raft_consensus.cc:740] T b289bc89d592435fb63c7fcf580d95a4 P 3c52e0825c02476e89d84da9bb849f5d [term 8 LEARNER]: Becoming Follower/Learner. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Initialized, Role: LEARNER
I20260709 12:25:02.011832 12968 consensus_queue.cc:260] T b289bc89d592435fb63c7fcf580d95a4 P 3c52e0825c02476e89d84da9bb849f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:02.017964 12968 ts_tablet_manager.cc:1434] T b289bc89d592435fb63c7fcf580d95a4 P 3c52e0825c02476e89d84da9bb849f5d: Time spent starting tablet: real 0.023s	user 0.000s	sys 0.006s
I20260709 12:25:02.020864 11013 tablet_copy_service.cc:342] P edcc56ddd3264984b4da6c1db59e7f08: Request end of tablet copy session 3c52e0825c02476e89d84da9bb849f5d-b289bc89d592435fb63c7fcf580d95a4 received from {username='slave'} at 127.0.0.1:57514
I20260709 12:25:02.021406 11013 tablet_copy_service.cc:434] P edcc56ddd3264984b4da6c1db59e7f08: ending tablet copy session 3c52e0825c02476e89d84da9bb849f5d-b289bc89d592435fb63c7fcf580d95a4 on tablet b289bc89d592435fb63c7fcf580d95a4 with peer 3c52e0825c02476e89d84da9bb849f5d
I20260709 12:25:02.028105 11621 raft_consensus.cc:1217] T b289bc89d592435fb63c7fcf580d95a4 P 3c52e0825c02476e89d84da9bb849f5d [term 8 LEARNER]: Deduplicated request from leader. Original: 8.6->[8.7-8.7]   Dedup: 8.7->[]
I20260709 12:25:02.067137 11621 raft_consensus.cc:1217] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [term 6 LEARNER]: Deduplicated request from leader. Original: 6.3->[6.4-6.4]   Dedup: 6.4->[]
I20260709 12:25:02.108217 12963 raft_consensus.cc:993] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea: : Instructing follower edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:25:02.108718 12963 raft_consensus.cc:1081] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Signalling peer edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:25:02.113390 10994 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:37500
I20260709 12:25:02.114241 10994 raft_consensus.cc:493] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:02.114652 10994 raft_consensus.cc:3060] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:02.120668 12973 raft_consensus.cc:993] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040: : Instructing follower edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:25:02.122516 12973 raft_consensus.cc:1081] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 6 LEADER]: Signalling peer edcc56ddd3264984b4da6c1db59e7f08 to start an election
W20260709 12:25:02.185911 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 69159.8us
I20260709 12:25:02.197293 10994 raft_consensus.cc:515] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:02.198553 10996 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:37512
I20260709 12:25:02.199123 10996 raft_consensus.cc:493] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:02.199550 10996 raft_consensus.cc:3060] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:02.219910 10996 raft_consensus.cc:515] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:02.247146 10996 leader_election.cc:290] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:02.248838 12884 raft_consensus.cc:993] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08: : Instructing follower e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:25:02.250659 12884 raft_consensus.cc:1081] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 2 LEADER]: Signalling peer e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:25:02.251835 10994 leader_election.cc:290] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:02.248656 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:02.253564 10922 raft_consensus.cc:3060] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:02.254415 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:02.255088 10850 raft_consensus.cc:3055] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:02.255347 10850 raft_consensus.cc:740] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:02.256219 10850 consensus_queue.cc:260] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:02.257493 10850 raft_consensus.cc:3060] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:02.280907 10928 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:59622
I20260709 12:25:02.281194 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:02.281677 10928 raft_consensus.cc:493] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:02.282286 10928 raft_consensus.cc:3060] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:02.282622 10923 raft_consensus.cc:3055] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:25:02.283038 10923 raft_consensus.cc:740] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:02.283962 10923 consensus_queue.cc:260] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:02.285537 10923 raft_consensus.cc:3060] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:02.291982 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:02.293115 10853 raft_consensus.cc:3060] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:02.316570 10850 raft_consensus.cc:2468] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 7.
I20260709 12:25:02.291282 10928 raft_consensus.cc:515] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:02.322800 10853 raft_consensus.cc:2468] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 4.
I20260709 12:25:02.324385 10968 leader_election.cc:304] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:25:02.328229 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:02.331147 10994 raft_consensus.cc:3055] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:02.331492 10994 raft_consensus.cc:740] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:25:02.332405 10994 consensus_queue.cc:260] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:02.333442 10994 raft_consensus.cc:3060] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:02.328259 12952 raft_consensus.cc:993] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea: : Instructing follower 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:25:02.336165 12952 raft_consensus.cc:1081] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Signalling peer 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:25:02.329350 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:02.337519 10850 raft_consensus.cc:3060] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:02.344434 10849 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:56394
I20260709 12:25:02.345090 10849 raft_consensus.cc:493] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:02.345428 10849 raft_consensus.cc:3060] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:02.329972 10922 raft_consensus.cc:2468] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 7.
I20260709 12:25:02.327033 10928 leader_election.cc:290] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:02.349560 10994 raft_consensus.cc:2468] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 3.
I20260709 12:25:02.351032 10895 leader_election.cc:304] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:25:02.352259 12963 raft_consensus.cc:2804] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:02.352831 12963 raft_consensus.cc:697] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:02.353938 12963 consensus_queue.cc:237] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:02.355027 10850 raft_consensus.cc:2468] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 3.
I20260709 12:25:02.359112 12972 raft_consensus.cc:2804] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:02.359723 12972 raft_consensus.cc:697] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:25:02.360639 12972 consensus_queue.cc:237] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:02.364946 10968 leader_election.cc:304] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:25:02.367877 12884 raft_consensus.cc:2804] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:25:02.368453 12884 raft_consensus.cc:697] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:25:02.369355 12884 consensus_queue.cc:237] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:02.330327 10923 raft_consensus.cc:2468] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 4.
I20260709 12:25:02.377683 10849 raft_consensus.cc:515] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:02.386181 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:02.386937 10928 raft_consensus.cc:3055] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:25:02.387279 10928 raft_consensus.cc:740] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:02.388406 10928 consensus_queue.cc:260] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:02.391036 10928 raft_consensus.cc:3060] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:02.405756 12922 raft_consensus.cc:993] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08: : Instructing follower e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:25:02.406682 10849 leader_election.cc:290] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:02.408263 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:02.408869 10999 raft_consensus.cc:3060] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:02.412261 10928 raft_consensus.cc:2468] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 4.
I20260709 12:25:02.412770 12972 raft_consensus.cc:1081] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 6 LEADER]: Signalling peer e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:25:02.417448 10752 catalog_manager.cc:5697] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 6 to 7, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 7 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:02.424651 10819 leader_election.cc:304] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:25:02.427016 12998 raft_consensus.cc:2804] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:25:02.428552 12998 raft_consensus.cc:697] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:02.429641 12998 consensus_queue.cc:237] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:02.448779 10751 catalog_manager.cc:5697] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 2 to 3, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 3 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:02.469657 12972 raft_consensus.cc:1064] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08: attempting to promote NON_VOTER 3c52e0825c02476e89d84da9bb849f5d to VOTER
I20260709 12:25:02.474320 10999 raft_consensus.cc:2468] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 4.
I20260709 12:25:02.474116 12972 consensus_queue.cc:237] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 5, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:25:02.495383 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 95413.2us
I20260709 12:25:02.534001 11621 raft_consensus.cc:1275] T b289bc89d592435fb63c7fcf580d95a4 P 3c52e0825c02476e89d84da9bb849f5d [term 8 LEARNER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:25:02.538507 12922 consensus_queue.cc:1048] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:02.543169 10749 catalog_manager.cc:5697] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 3 to 4, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 4 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:02.544767 12972 raft_consensus.cc:1064] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08: attempting to promote NON_VOTER 3c52e0825c02476e89d84da9bb849f5d to VOTER
I20260709 12:25:02.548539 12972 consensus_queue.cc:237] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 2, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:02.563329 10928 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e3d9a61ecaf84695b70f8519ee57706f"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:59622
I20260709 12:25:02.563987 10928 raft_consensus.cc:493] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:02.564092 11621 raft_consensus.cc:1275] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [term 4 LEARNER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:25:02.564397 10928 raft_consensus.cc:3060] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:02.566303 12972 consensus_queue.cc:1048] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:02.571894 10928 raft_consensus.cc:515] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:02.576844 10928 leader_election.cc:290] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:02.580197 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d9a61ecaf84695b70f8519ee57706f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:02.580823 10849 raft_consensus.cc:3060] T e3d9a61ecaf84695b70f8519ee57706f P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:02.587623 10928 raft_consensus.cc:1275] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:25:02.593606 10922 raft_consensus.cc:1275] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:25:02.599263 10850 raft_consensus.cc:1275] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:25:02.603842 10850 raft_consensus.cc:1275] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:25:02.631421 12932 consensus_queue.cc:1048] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:02.631923 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d9a61ecaf84695b70f8519ee57706f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:02.632530 10999 raft_consensus.cc:3055] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:02.632827 10999 raft_consensus.cc:740] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:25:02.634061 12932 consensus_queue.cc:1048] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:25:02.634769 12963 raft_consensus.cc:1064] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea: attempting to promote NON_VOTER 3c52e0825c02476e89d84da9bb849f5d to VOTER
I20260709 12:25:02.634032 10999 consensus_queue.cc:260] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:02.637971 12963 consensus_queue.cc:237] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 2, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:02.642047 13006 consensus_queue.cc:1048] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:02.645035 13006 consensus_queue.cc:1048] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:02.646965 10849 raft_consensus.cc:2468] T e3d9a61ecaf84695b70f8519ee57706f P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 7.
I20260709 12:25:02.637717 10999 raft_consensus.cc:3060] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:02.657346 11621 raft_consensus.cc:1275] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [term 6 LEARNER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:25:02.658557 10997 raft_consensus.cc:1275] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:25:02.677356 10847 raft_consensus.cc:1275] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:25:02.686431 12952 consensus_queue.cc:1048] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:02.689035 12921 consensus_queue.cc:1048] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:25:02.696627 12921 consensus_queue.cc:1048] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:02.702744 10894 leader_election.cc:304] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:25:02.727706 13006 raft_consensus.cc:2955] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 LEADER]: Committing config change with OpId 8.8: config changed from index 7 to 8, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:02.728030 12921 raft_consensus.cc:2804] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:02.753136 12921 raft_consensus.cc:697] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 7 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:02.751504 12884 raft_consensus.cc:2955] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:02.754204 12921 consensus_queue.cc:237] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:02.766022 10853 raft_consensus.cc:1275] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:02.770313 12911 consensus_queue.cc:1048] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:25:02.775298 13020 log.cc:927] Time spent T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.059s	user 0.000s	sys 0.004s
W20260709 12:25:02.784111 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 69181.2us
I20260709 12:25:02.794190 10999 raft_consensus.cc:2468] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 7.
I20260709 12:25:02.810693 11622 raft_consensus.cc:2955] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:02.811352 10752 catalog_manager.cc:5697] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 3 to 4, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 4 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:02.824405 11621 raft_consensus.cc:2955] T b289bc89d592435fb63c7fcf580d95a4 P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:02.824790 10847 raft_consensus.cc:2955] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:02.828011 10849 raft_consensus.cc:1275] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:25:02.833102 10923 raft_consensus.cc:2955] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:02.840348 12963 raft_consensus.cc:2955] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Committing config change with OpId 6.5: config changed from index 4 to 5, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:02.868420 10751 catalog_manager.cc:5697] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: config changed from index 7 to 8, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New cstate: current_term: 8 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:02.875334 10847 raft_consensus.cc:2955] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Committing config change with OpId 6.5: config changed from index 4 to 5, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:02.878806 10751 catalog_manager.cc:5697] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: config changed from index 4 to 5, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:02.881613 11623 raft_consensus.cc:2955] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Committing config change with OpId 6.5: config changed from index 4 to 5, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:02.906100 12884 consensus_queue.cc:1048] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:25:02.906635 10846 raft_consensus.cc:2955] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:02.926108 10928 raft_consensus.cc:2955] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:02.942625 10997 consensus_queue.cc:237] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:02.951159 10999 consensus_queue.cc:237] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:02.956154 10752 catalog_manager.cc:5697] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: config changed from index 4 to 5, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New cstate: current_term: 6 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:02.967213 10920 raft_consensus.cc:1275] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:25:02.963233 11623 raft_consensus.cc:1275] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:25:02.977981 10850 raft_consensus.cc:1275] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:25:02.968427 10923 raft_consensus.cc:1275] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:25:02.997539 13002 consensus_queue.cc:1048] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:03.006386 10922 raft_consensus.cc:1275] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:25:03.012347 11622 raft_consensus.cc:1275] T b289bc89d592435fb63c7fcf580d95a4 P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:25:03.014132 10997 raft_consensus.cc:1275] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:25:03.018247 13006 consensus_queue.cc:1048] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:03.019095 12922 raft_consensus.cc:2955] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:03.022341 10922 raft_consensus.cc:1275] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:25:03.024034 12997 consensus_queue.cc:1048] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:03.026304 13006 consensus_queue.cc:1048] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:03.047245 12962 consensus_queue.cc:1048] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:03.043345 13002 raft_consensus.cc:2955] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 LEADER]: Committing config change with OpId 8.9: config changed from index 8 to 9, VOTER 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:03.049940 11621 raft_consensus.cc:2955] T b289bc89d592435fb63c7fcf580d95a4 P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Committing config change with OpId 8.9: config changed from index 8 to 9, VOTER 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:03.054442 11623 raft_consensus.cc:2955] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:03.091316 10928 raft_consensus.cc:1275] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:25:03.099539 10999 raft_consensus.cc:2955] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Committing config change with OpId 6.5: config changed from index 4 to 5, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:03.156324 11001 raft_consensus.cc:1275] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:03.138975 10752 catalog_manager.cc:5697] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 6 to 7, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 7 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:03.172667 12884 consensus_queue.cc:1048] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
W20260709 12:25:03.180365 10969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:03.192121 10739 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b289bc89d592435fb63c7fcf580d95a4 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:25:03.217075 10923 consensus_queue.cc:237] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:03.226431 12963 consensus_queue.cc:1048] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:03.235323 12932 consensus_queue.cc:1048] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:03.240737 10751 catalog_manager.cc:5697] T b289bc89d592435fb63c7fcf580d95a4 P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: config changed from index 8 to 9, VOTER 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) evicted. New cstate: current_term: 8 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:03.248523 13035 consensus_queue.cc:1048] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:03.252058 10739 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 114b16c8c992413dab64ab31b16cb06f with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:25:03.253662 13034 consensus_queue.cc:1048] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:03.257618  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:03.266806 11623 raft_consensus.cc:1275] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:25:03.268724 10997 raft_consensus.cc:1275] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:25:03.281308 10999 raft_consensus.cc:1275] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:25:03.285043 10835 tablet_service.cc:1558] Processing DeleteTablet for tablet b289bc89d592435fb63c7fcf580d95a4 with delete_type TABLET_DATA_TOMBSTONED (TS 80cd7d227db44f34a6108591dad9c040 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:56372
I20260709 12:25:03.293597 10925 raft_consensus.cc:2955] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Committing config change with OpId 8.9: config changed from index 8 to 9, VOTER 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:03.293704 10926 raft_consensus.cc:2955] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:03.298395 10751 catalog_manager.cc:5697] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: config changed from index 5 to 6, VOTER 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) evicted. New cstate: current_term: 4 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:03.311074 10850 raft_consensus.cc:1275] T e3d9a61ecaf84695b70f8519ee57706f P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:25:03.315435 13037 consensus_queue.cc:1048] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:25:03.320050 12963 consensus_queue.cc:1048] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:03.324900 13039 tablet_replica.cc:333] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040: stopping tablet replica
I20260709 12:25:03.330822 12965 consensus_queue.cc:1048] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:03.334925 13039 raft_consensus.cc:2243] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:03.335613 12965 consensus_queue.cc:1048] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:25:03.342955 13039 raft_consensus.cc:2272] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:03.359426 13039 ts_tablet_manager.cc:1916] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:25:03.367802 10835 tablet_service.cc:1558] Processing DeleteTablet for tablet 114b16c8c992413dab64ab31b16cb06f with delete_type TABLET_DATA_TOMBSTONED (TS 80cd7d227db44f34a6108591dad9c040 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:56372
I20260709 12:25:03.370262 13036 raft_consensus.cc:2955] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Committing config change with OpId 6.6: config changed from index 5 to 6, VOTER 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:03.377753 11001 raft_consensus.cc:2955] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 5 to 6, VOTER 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:03.378144 11623 raft_consensus.cc:2955] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 5 to 6, VOTER 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:03.395936 10738 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3ad755c012434396a53498486697a9b4 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:25:03.399713 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 70564.2us
I20260709 12:25:03.417936 10752 catalog_manager.cc:5697] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: config changed from index 5 to 6, VOTER 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) evicted. New cstate: current_term: 6 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:03.450475 13039 ts_tablet_manager.cc:1929] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 8.8
I20260709 12:25:03.451004 13039 log.cc:1199] T b289bc89d592435fb63c7fcf580d95a4 P 80cd7d227db44f34a6108591dad9c040: Deleting WAL directory at /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599781984018-9681-0/minicluster-data/ts-0-root/wals/b289bc89d592435fb63c7fcf580d95a4
I20260709 12:25:03.503727 10835 tablet_service.cc:1558] Processing DeleteTablet for tablet 3ad755c012434396a53498486697a9b4 with delete_type TABLET_DATA_TOMBSTONED (TS 80cd7d227db44f34a6108591dad9c040 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:56372
I20260709 12:25:03.508628 10994 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
mode: GRACEFUL
new_leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:32960
I20260709 12:25:03.509310 10994 raft_consensus.cc:606] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 LEADER]: Received request to transfer leadership to TS e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:03.510521 13039 tablet_replica.cc:333] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040: stopping tablet replica
I20260709 12:25:03.512209 13039 raft_consensus.cc:2243] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:03.513208 13039 raft_consensus.cc:2272] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:03.517508 10849 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "60dca008c268416c8e63091506d1653e"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
mode: GRACEFUL
new_leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:47358
I20260709 12:25:03.518136 10849 raft_consensus.cc:606] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Received request to transfer leadership to TS edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:25:03.522274 13043 log.cc:927] Time spent T e3d9a61ecaf84695b70f8519ee57706f P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 12:25:03.516353 10738 catalog_manager.cc:5028] TS 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): tablet b289bc89d592435fb63c7fcf580d95a4 (table test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]) successfully deleted
I20260709 12:25:03.536439 10929 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
mode: GRACEFUL
new_leader_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:41546
I20260709 12:25:03.537034 10929 raft_consensus.cc:606] T 9211e3b6d81447798824045b9515c0ee P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Received request to transfer leadership to TS 80cd7d227db44f34a6108591dad9c040
I20260709 12:25:03.544389 10849 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
mode: GRACEFUL
new_leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:47358
I20260709 12:25:03.545042 10849 raft_consensus.cc:606] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 5 LEADER]: Received request to transfer leadership to TS edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:03.559597 10920 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
mode: GRACEFUL
new_leader_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:41546
I20260709 12:25:03.554395 13039 ts_tablet_manager.cc:1916] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:25:03.560415 10920 raft_consensus.cc:606] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 LEADER]: Received request to transfer leadership to TS 80cd7d227db44f34a6108591dad9c040
I20260709 12:25:03.561791  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:25:03.563727  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:03.564551  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:03.637830 13039 ts_tablet_manager.cc:1929] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.5
I20260709 12:25:03.638451 13039 log.cc:1199] T 114b16c8c992413dab64ab31b16cb06f P 80cd7d227db44f34a6108591dad9c040: Deleting WAL directory at /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599781984018-9681-0/minicluster-data/ts-0-root/wals/114b16c8c992413dab64ab31b16cb06f
I20260709 12:25:03.640373 10738 catalog_manager.cc:5028] TS 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): tablet 114b16c8c992413dab64ab31b16cb06f (table test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]) successfully deleted
I20260709 12:25:03.640951 13039 tablet_replica.cc:333] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040: stopping tablet replica
I20260709 12:25:03.642135 13039 raft_consensus.cc:2243] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:03.643081 13039 raft_consensus.cc:2272] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:03.649776 13039 ts_tablet_manager.cc:1916] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:25:03.693629 13039 ts_tablet_manager.cc:1929] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 6.5
I20260709 12:25:03.694120 13039 log.cc:1199] T 3ad755c012434396a53498486697a9b4 P 80cd7d227db44f34a6108591dad9c040: Deleting WAL directory at /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599781984018-9681-0/minicluster-data/ts-0-root/wals/3ad755c012434396a53498486697a9b4
I20260709 12:25:03.696301 10738 catalog_manager.cc:5028] TS 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): tablet 3ad755c012434396a53498486697a9b4 (table test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]) successfully deleted
W20260709 12:25:03.703294 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 161606us
I20260709 12:25:03.719094 12998 raft_consensus.cc:993] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040: : Instructing follower edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:25:03.719753 12998 raft_consensus.cc:1081] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 5 LEADER]: Signalling peer edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:25:03.721746 11001 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:37512
I20260709 12:25:03.722460 11001 raft_consensus.cc:493] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:03.723115 11001 raft_consensus.cc:3060] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:03.732963 11001 raft_consensus.cc:515] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:03.735349 11001 leader_election.cc:290] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:03.736315 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:03.736943 10850 raft_consensus.cc:3055] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:03.737268 10850 raft_consensus.cc:740] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:03.737978 10850 consensus_queue.cc:260] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:03.739180 10850 raft_consensus.cc:3060] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:03.747526 13036 raft_consensus.cc:993] T 9211e3b6d81447798824045b9515c0ee P e2d5c637307a407ab688f5ccd6f0fcea: : Instructing follower 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:25:03.747889 10850 raft_consensus.cc:2468] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 6.
I20260709 12:25:03.748490 13037 raft_consensus.cc:1081] T 9211e3b6d81447798824045b9515c0ee P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Signalling peer 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:25:03.754173 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:03.754932 10920 raft_consensus.cc:3060] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:03.761407 10968 leader_election.cc:304] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:25:03.763867 10850 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:56394
I20260709 12:25:03.764696 10850 raft_consensus.cc:493] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:03.765118 10850 raft_consensus.cc:3060] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:03.765823 13006 raft_consensus.cc:2804] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:03.766661 13006 raft_consensus.cc:697] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 6 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:25:03.769058 13006 consensus_queue.cc:237] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:03.792101 10920 raft_consensus.cc:2468] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 6.
I20260709 12:25:03.793231 10850 raft_consensus.cc:515] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:03.795172 10850 leader_election.cc:290] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:03.796237 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:03.795732 10751 catalog_manager.cc:5697] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 5 to 6, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 6 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:03.796821 10994 raft_consensus.cc:3060] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:03.797374 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:03.798400 10920 raft_consensus.cc:3055] T 9211e3b6d81447798824045b9515c0ee P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:03.798804 10920 raft_consensus.cc:740] T 9211e3b6d81447798824045b9515c0ee P e2d5c637307a407ab688f5ccd6f0fcea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:03.799997 10920 consensus_queue.cc:260] T 9211e3b6d81447798824045b9515c0ee P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:03.805179 10920 raft_consensus.cc:3060] T 9211e3b6d81447798824045b9515c0ee P e2d5c637307a407ab688f5ccd6f0fcea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:03.805369 10994 raft_consensus.cc:2468] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 2.
I20260709 12:25:03.811703 10820 leader_election.cc:304] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:25:03.812680 12973 raft_consensus.cc:2804] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:03.813247 12973 raft_consensus.cc:697] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 2 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:03.813616 10920 raft_consensus.cc:2468] T 9211e3b6d81447798824045b9515c0ee P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 2.
I20260709 12:25:03.814213 12973 consensus_queue.cc:237] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:03.835194 13036 raft_consensus.cc:993] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea: : Instructing follower 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:25:03.835963 13037 raft_consensus.cc:1081] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 LEADER]: Signalling peer 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:25:03.838217 10850 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:56394
I20260709 12:25:03.838972 10850 raft_consensus.cc:493] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:03.839329 10850 raft_consensus.cc:3060] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:03.852720 10850 raft_consensus.cc:515] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:03.854817 10850 leader_election.cc:290] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:03.857060 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:03.858274 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:03.858892 10926 raft_consensus.cc:3055] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:03.859201 10926 raft_consensus.cc:740] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:03.860107 10926 consensus_queue.cc:260] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:03.861550 10926 raft_consensus.cc:3060] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:03.857750 10994 raft_consensus.cc:3060] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:03.871541 10994 raft_consensus.cc:2468] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 8.
I20260709 12:25:03.872393 10997 raft_consensus.cc:1240] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:03.873282 10820 leader_election.cc:304] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:25:03.874704 12973 raft_consensus.cc:2804] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:03.877574 12973 raft_consensus.cc:697] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 8 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:03.878494 12973 consensus_queue.cc:237] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:03.882002 10926 raft_consensus.cc:2468] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 8.
I20260709 12:25:03.882407 10751 catalog_manager.cc:5697] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 1 to 2, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 2 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:03.887441 12998 raft_consensus.cc:993] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040: : Instructing follower edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:25:03.888150 12998 raft_consensus.cc:1081] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Signalling peer edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:25:03.891669 10997 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "60dca008c268416c8e63091506d1653e"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:37512
I20260709 12:25:03.893131 10997 raft_consensus.cc:493] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:03.893494 10997 raft_consensus.cc:3060] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:03.918591 10997 raft_consensus.cc:515] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:03.923003 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:03.923655 10850 raft_consensus.cc:3055] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:03.923957 10850 raft_consensus.cc:740] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:03.924655 10850 consensus_queue.cc:260] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:03.924664 10997 leader_election.cc:290] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:03.925421 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:03.925858 10850 raft_consensus.cc:3060] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:03.926052 10920 raft_consensus.cc:3060] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:03.933676 10850 raft_consensus.cc:2468] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 5.
I20260709 12:25:03.935252 10968 leader_election.cc:304] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:25:03.936342 13006 raft_consensus.cc:2804] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:25:03.936931 13006 raft_consensus.cc:697] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 5 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:25:03.937939 13006 consensus_queue.cc:237] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:03.942893 10920 raft_consensus.cc:2468] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 5.
I20260709 12:25:03.961704 10751 catalog_manager.cc:5697] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 7 to 8, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 8 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:03.978137 10752 catalog_manager.cc:5697] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 4 to 5, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 5 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:04.016300 13002 raft_consensus.cc:993] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08: : Instructing follower e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:25:04.017009 13002 raft_consensus.cc:1081] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 LEADER]: Signalling peer e2d5c637307a407ab688f5ccd6f0fcea to start an election
W20260709 12:25:04.166456 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 154287us
I20260709 12:25:04.167928 10929 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:59622
I20260709 12:25:04.215958 10929 raft_consensus.cc:493] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:04.216441 10929 raft_consensus.cc:3060] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:04.234803 10929 raft_consensus.cc:515] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } }
W20260709 12:25:04.270167 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 55849.8us
I20260709 12:25:04.274108 10926 raft_consensus.cc:1275] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:25:04.278148 10929 leader_election.cc:290] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 election: Requested vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265)
W20260709 12:25:04.302181 10969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 87548.5us
I20260709 12:25:04.302666 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:04.303241 10849 raft_consensus.cc:3060] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:04.320464 10926 raft_consensus.cc:1275] T 9211e3b6d81447798824045b9515c0ee P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:25:04.322234 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 49259.9us
I20260709 12:25:04.324545 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:04.325565 11001 raft_consensus.cc:3055] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:04.326040 11001 raft_consensus.cc:740] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:25:04.328539 10849 raft_consensus.cc:2468] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 5.
I20260709 12:25:04.330433 10894 leader_election.cc:304] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:25:04.330250 11001 consensus_queue.cc:260] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } }
I20260709 12:25:04.331310 11001 raft_consensus.cc:3060] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:04.341089 11001 raft_consensus.cc:2468] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 5.
W20260709 12:25:04.342530 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 62749.2us
I20260709 12:25:04.334229 12952 raft_consensus.cc:2804] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:25:04.353732 12952 raft_consensus.cc:697] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:04.355093 12952 consensus_queue.cc:237] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } }
I20260709 12:25:04.383386 13035 consensus_queue.cc:1048] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
W20260709 12:25:04.424145 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 76170.6us
W20260709 12:25:04.420238 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 72249.4us
I20260709 12:25:04.430312 12962 consensus_queue.cc:1048] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:04.436446 10920 raft_consensus.cc:1275] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:25:04.465255 11001 raft_consensus.cc:1275] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:25:04.492395 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 55497.1us
I20260709 12:25:04.497335 10752 catalog_manager.cc:5697] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 4 to 5, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 5 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:04.526561 10926 raft_consensus.cc:1275] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:25:04.529486 10846 raft_consensus.cc:1275] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:25:04.547086 13002 consensus_queue.cc:1048] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:25:04.563449 10994 raft_consensus.cc:1275] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:04.572932 13052 consensus_queue.cc:1048] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:04.574527 12884 consensus_queue.cc:1048] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:04.581900 12962 consensus_queue.cc:1048] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:04.584589 10850 raft_consensus.cc:1275] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:25:04.657478 10926 consensus_queue.cc:237] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:04.679226 12962 consensus_queue.cc:1048] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:25:04.710211 13058 consensus_queue.cc:1048] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:25:04.731318  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:25:04.759419 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 49134.4us
W20260709 12:25:04.825201 10895 consensus_peers.cc:597] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613): Couldn't send request to peer 3c52e0825c02476e89d84da9bb849f5d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 69fd8fdac2fa449e9e184f3d668ea1a7. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:04.827807 10994 raft_consensus.cc:1275] T 69fd8fdac2fa449e9e184f3d668ea1a7 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:04.830754 13059 consensus_queue.cc:1048] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:25:04.840577 11001 raft_consensus.cc:1275] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:25:04.848595 13062 consensus_queue.cc:1048] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:04.872676 10848 raft_consensus.cc:1275] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:04.886758 13037 consensus_queue.cc:1048] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:04.999675 10849 raft_consensus.cc:1275] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:25:05.034240 13080 log.cc:927] Time spent T 69fd8fdac2fa449e9e184f3d668ea1a7 P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
W20260709 12:25:05.058661 13081 log.cc:927] Time spent T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 12:25:05.060599 13037 consensus_queue.cc:1048] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
W20260709 12:25:05.089859 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 69100.2us
W20260709 12:25:05.168869 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 67432.4us
W20260709 12:25:05.181061 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 46251.9us
W20260709 12:25:05.131448 13082 log.cc:927] Time spent T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.208s	user 0.005s	sys 0.006s
W20260709 12:25:05.424399 10969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 172471us
I20260709 12:25:05.413178 13053 raft_consensus.cc:2955] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 LEADER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:25:05.474556 10853 raft_consensus.cc:2955] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
W20260709 12:25:05.490376 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 307445us
I20260709 12:25:05.499218 10850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
mode: GRACEFUL
new_leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:47358
I20260709 12:25:05.517867 10850 raft_consensus.cc:606] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 8 LEADER]: Received request to transfer leadership to TS edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:05.578549 11000 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "60dca008c268416c8e63091506d1653e"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
mode: GRACEFUL
new_leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:32960
I20260709 12:25:05.579629 11000 raft_consensus.cc:606] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 5 LEADER]: Received request to transfer leadership to TS e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:05.621474 10929 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
mode: GRACEFUL
new_leader_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:41546
I20260709 12:25:05.624408 10929 raft_consensus.cc:606] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 LEADER]: Received request to transfer leadership to TS 80cd7d227db44f34a6108591dad9c040
I20260709 12:25:05.632952 13093 raft_consensus.cc:993] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040: : Instructing follower edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:25:05.614442 10997 raft_consensus.cc:2955] T 69fd8fdac2fa449e9e184f3d668ea1a7 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:25:05.633630 13093 raft_consensus.cc:1081] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 8 LEADER]: Signalling peer edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:25:05.671271 13053 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:50034 (request call id 4) took 1017 ms. Trace:
I20260709 12:25:05.671878 13053 rpcz_store.cc:276] 0709 12:25:04.653959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:04.655263 (+  1304us) service_pool.cc:224] Handling call
0709 12:25:04.666627 (+ 11364us) log.cc:844] Serialized 499 byte log entry
0709 12:25:05.671159 (+1004532us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":854,"raft.queue_time_us":2591,"raft.run_cpu_time_us":2257,"raft.run_wall_time_us":2255,"thread_start_us":142856,"threads_started":1,"wal-append.queue_time_us":142931}
I20260709 12:25:05.700829 10853 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
mode: GRACEFUL
new_leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:47358
I20260709 12:25:05.709167 11000 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:37512
I20260709 12:25:05.710279 11000 raft_consensus.cc:493] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:05.705401 10853 raft_consensus.cc:606] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 6 LEADER]: Received request to transfer leadership to TS e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:05.710891 11000 raft_consensus.cc:3060] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:05.740904 13104 ts_tablet_manager.cc:933] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d: Initiating tablet copy from peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:05.811939 11000 raft_consensus.cc:515] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:05.830534  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:25:05.834177 10996 raft_consensus.cc:1240] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:05.820945 13089 raft_consensus.cc:993] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08: : Instructing follower e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:25:05.835968 13089 raft_consensus.cc:1081] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 5 LEADER]: Signalling peer e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:25:05.847327 13104 tablet_copy_client.cc:323] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Beginning tablet copy session from remote peer at address 127.9.116.66:39339
I20260709 12:25:05.851135 13097 raft_consensus.cc:993] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea: : Instructing follower 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:25:05.852825  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:05.860100 13099 consensus_queue.cc:1059] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:05.861474 10939 tablet_copy_service.cc:140] P e2d5c637307a407ab688f5ccd6f0fcea: Received BeginTabletCopySession request for tablet 69fd8fdac2fa449e9e184f3d668ea1a7 from peer 3c52e0825c02476e89d84da9bb849f5d ({username='slave'} at 127.0.0.1:50036)
I20260709 12:25:05.862259 10939 tablet_copy_service.cc:161] P e2d5c637307a407ab688f5ccd6f0fcea: Beginning new tablet copy session on tablet 69fd8fdac2fa449e9e184f3d668ea1a7 from peer 3c52e0825c02476e89d84da9bb849f5d at {username='slave'} at 127.0.0.1:50036: session id = 3c52e0825c02476e89d84da9bb849f5d-69fd8fdac2fa449e9e184f3d668ea1a7
I20260709 12:25:05.863329 13061 raft_consensus.cc:3055] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:05.863891 13061 raft_consensus.cc:740] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:05.856935 13097 raft_consensus.cc:1081] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 LEADER]: Signalling peer 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:25:05.864398  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:05.844471 10849 consensus_queue.cc:237] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:05.872197 10929 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "60dca008c268416c8e63091506d1653e"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:59622
I20260709 12:25:05.873080 10929 raft_consensus.cc:493] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:05.873548 10929 raft_consensus.cc:3060] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:05.868901 13061 consensus_queue.cc:260] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:05.877807 13061 raft_consensus.cc:3060] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:05.903028 10848 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:56394
I20260709 12:25:05.904176 10848 raft_consensus.cc:493] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:05.904557 10848 raft_consensus.cc:3060] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:05.913048 10929 raft_consensus.cc:515] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:05.930153 11000 leader_election.cc:290] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:25:05.941855 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:25:05.942747 11623 raft_consensus.cc:3060] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:05.956367 10929 leader_election.cc:290] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:05.960485 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:05.961616 11000 raft_consensus.cc:3055] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:05.962029 11000 raft_consensus.cc:740] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:25:05.964567 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:05.965798 10939 tablet_copy_source_session.cc:215] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:25:05.965935 10850 raft_consensus.cc:3060] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:05.967901 11000 consensus_queue.cc:260] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:05.974048 11000 raft_consensus.cc:3060] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:05.980665 13104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69fd8fdac2fa449e9e184f3d668ea1a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:05.986409 11000 raft_consensus.cc:2468] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 6.
I20260709 12:25:05.940842 10751 catalog_manager.cc:5697] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: config changed from index -1 to 4, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New cstate: current_term: 4 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:05.987994 10850 raft_consensus.cc:2468] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 6.
I20260709 12:25:05.988025 10895 leader_election.cc:304] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:25:05.989158 13059 raft_consensus.cc:2804] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:05.989727 13059 raft_consensus.cc:697] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:05.990962 13059 consensus_queue.cc:237] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:05.998116 11623 raft_consensus.cc:2468] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 9.
I20260709 12:25:05.999893 10969 leader_election.cc:304] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:25:06.001219 13058 raft_consensus.cc:2804] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:06.001829 13058 raft_consensus.cc:697] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:25:06.003460 13058 consensus_queue.cc:237] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:06.039225 10928 raft_consensus.cc:1275] T ab816bcc6183447994a2cc013e46c5f8 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:25:06.040525 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:06.042520 11000 raft_consensus.cc:1275] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:25:06.061666 10848 raft_consensus.cc:515] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:06.063797 10849 raft_consensus.cc:2468] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 9.
I20260709 12:25:06.069801 12962 consensus_queue.cc:1048] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:25:06.072480 10848 leader_election.cc:290] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:06.070006 13093 raft_consensus.cc:993] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040: : Instructing follower e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:25:06.076924 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:06.080837 10929 raft_consensus.cc:3055] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:06.081323 10929 raft_consensus.cc:740] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:06.083133 10922 raft_consensus.cc:1240] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:06.083490 10929 consensus_queue.cc:260] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:06.084805 13093 raft_consensus.cc:1081] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 6 LEADER]: Signalling peer e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:25:06.084818 10929 raft_consensus.cc:3060] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:06.094352 10929 raft_consensus.cc:2468] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 6.
I20260709 12:25:06.114257 10922 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:59626
I20260709 12:25:06.114912 10922 raft_consensus.cc:493] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:06.115289 10922 raft_consensus.cc:3060] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:25:06.124419 10820 consensus_peers.cc:597] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 -> Peer 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613): Couldn't send request to peer 3c52e0825c02476e89d84da9bb849f5d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ab816bcc6183447994a2cc013e46c5f8. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:06.124998 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 75691us
I20260709 12:25:06.130069 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:06.130941 11000 raft_consensus.cc:3060] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:06.138423 12997 consensus_queue.cc:1048] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 12:25:06.124413 10819 leader_election.cc:304] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:25:06.160409 11000 raft_consensus.cc:2468] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 6.
W20260709 12:25:06.168857 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 45272us
I20260709 12:25:06.177054 13100 raft_consensus.cc:2804] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:06.177722 13100 raft_consensus.cc:697] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [term 6 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:06.178810 13100 consensus_queue.cc:237] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:06.227249 10922 raft_consensus.cc:515] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:06.232673 12962 raft_consensus.cc:2955] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:25:06.252084 13104 tablet_copy_client.cc:806] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 0 data blocks...
I20260709 12:25:06.253194 13104 tablet_copy_client.cc:670] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:25:06.264614 10929 raft_consensus.cc:2955] T ab816bcc6183447994a2cc013e46c5f8 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:25:06.266345 13104 tablet_copy_client.cc:538] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:25:06.275360 11000 raft_consensus.cc:2955] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:25:06.279358 13104 tablet_bootstrap.cc:492] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap starting.
I20260709 12:25:06.288250 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:06.288921 10849 raft_consensus.cc:3055] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:06.289229 10849 raft_consensus.cc:740] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:06.289723 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:06.290388 10999 raft_consensus.cc:3060] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:06.290535 10922 leader_election.cc:290] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:06.290021 10849 consensus_queue.cc:260] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:06.296155 10849 raft_consensus.cc:3060] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:06.398100 10849 raft_consensus.cc:2468] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 7.
I20260709 12:25:06.400069 10999 raft_consensus.cc:2468] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 7.
I20260709 12:25:06.285722 10847 consensus_queue.cc:237] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:06.409472 10895 leader_election.cc:304] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:25:06.450228 13092 raft_consensus.cc:2804] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:06.461567 13092 raft_consensus.cc:697] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 7 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:06.475852 13092 consensus_queue.cc:237] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:06.550607 10997 raft_consensus.cc:1275] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:25:06.561084 10846 raft_consensus.cc:1275] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:25:06.571144 13053 consensus_queue.cc:1048] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:25:06.576830 10751 catalog_manager.cc:5697] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 5 to 6, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 6 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:06.583988 10751 catalog_manager.cc:5697] T ab816bcc6183447994a2cc013e46c5f8 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: config changed from index -1 to 3, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New cstate: current_term: 2 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:25:06.592427 10751 catalog_manager.cc:5697] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 6 to 7, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 7 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:06.594776 13059 consensus_queue.cc:1048] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:25:06.615130 11621 raft_consensus.cc:1275] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:06.617053 13089 consensus_queue.cc:1048] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:06.634469 13104 tablet_bootstrap.cc:492] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:06.644867 10850 raft_consensus.cc:1275] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:06.646785 13123 ts_tablet_manager.cc:933] T ab816bcc6183447994a2cc013e46c5f8 P 3c52e0825c02476e89d84da9bb849f5d: Initiating tablet copy from peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265)
I20260709 12:25:06.651144 13104 tablet_bootstrap.cc:492] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap complete.
I20260709 12:25:06.695734 13104 ts_tablet_manager.cc:1403] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d: Time spent bootstrapping tablet: real 0.417s	user 0.043s	sys 0.008s
I20260709 12:25:06.713794 13104 raft_consensus.cc:359] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:06.714854 13104 raft_consensus.cc:740] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Initialized, Role: LEARNER
I20260709 12:25:06.727607 13104 consensus_queue.cc:260] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:06.767354 10752 catalog_manager.cc:5697] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: term changed from 8 to 9, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 9 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
W20260709 12:25:06.794911 13120 log.cc:927] Time spent T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 12:25:06.844973 13123 tablet_copy_client.cc:323] T ab816bcc6183447994a2cc013e46c5f8 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Beginning tablet copy session from remote peer at address 127.9.116.65:46265
I20260709 12:25:06.846439 13104 ts_tablet_manager.cc:1434] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d: Time spent starting tablet: real 0.143s	user 0.009s	sys 0.000s
I20260709 12:25:06.847026 11001 raft_consensus.cc:1275] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:25:06.864645 10939 tablet_copy_service.cc:342] P e2d5c637307a407ab688f5ccd6f0fcea: Request end of tablet copy session 3c52e0825c02476e89d84da9bb849f5d-69fd8fdac2fa449e9e184f3d668ea1a7 received from {username='slave'} at 127.0.0.1:50036
I20260709 12:25:06.865334 10939 tablet_copy_service.cc:434] P e2d5c637307a407ab688f5ccd6f0fcea: ending tablet copy session 3c52e0825c02476e89d84da9bb849f5d-69fd8fdac2fa449e9e184f3d668ea1a7 on tablet 69fd8fdac2fa449e9e184f3d668ea1a7 with peer 3c52e0825c02476e89d84da9bb849f5d
W20260709 12:25:06.856600 10820 consensus_peers.cc:597] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 -> Peer 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613): Couldn't send request to peer 3c52e0825c02476e89d84da9bb849f5d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9211e3b6d81447798824045b9515c0ee. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:06.880748 11621 raft_consensus.cc:1217] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d [term 4 LEARNER]: Deduplicated request from leader. Original: 4.3->[4.4-4.4]   Dedup: 4.4->[]
I20260709 12:25:06.883276 10998 raft_consensus.cc:1275] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:25:06.886031 10920 raft_consensus.cc:1275] T 9211e3b6d81447798824045b9515c0ee P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:25:06.949465 13100 consensus_queue.cc:1048] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:06.955075 13100 consensus_queue.cc:1048] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:25:06.971406 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 48905.6us
I20260709 12:25:07.008503 10751 catalog_manager.cc:5697] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 5 to 6, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 6 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:07.045212 12962 consensus_queue.cc:1048] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:07.064306 10864 tablet_copy_service.cc:140] P 80cd7d227db44f34a6108591dad9c040: Received BeginTabletCopySession request for tablet ab816bcc6183447994a2cc013e46c5f8 from peer 3c52e0825c02476e89d84da9bb849f5d ({username='slave'} at 127.0.0.1:46480)
I20260709 12:25:07.065013 10864 tablet_copy_service.cc:161] P 80cd7d227db44f34a6108591dad9c040: Beginning new tablet copy session on tablet ab816bcc6183447994a2cc013e46c5f8 from peer 3c52e0825c02476e89d84da9bb849f5d at {username='slave'} at 127.0.0.1:46480: session id = 3c52e0825c02476e89d84da9bb849f5d-ab816bcc6183447994a2cc013e46c5f8
I20260709 12:25:07.068646 10994 raft_consensus.cc:1275] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:25:07.089067 10923 raft_consensus.cc:1275] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:25:07.095896 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 77652.4us
I20260709 12:25:07.134491 13089 consensus_queue.cc:1048] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:07.182287 10864 tablet_copy_source_session.cc:215] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:25:07.183161 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 127430us
W20260709 12:25:07.188979 10969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 173296us
W20260709 12:25:07.196909 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 137731us
I20260709 12:25:07.204109 13104 ts_tablet_manager.cc:933] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d: Initiating tablet copy from peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265)
I20260709 12:25:07.295266 13123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab816bcc6183447994a2cc013e46c5f8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:25:07.305222 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 140184us
W20260709 12:25:07.312315 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 116136us
I20260709 12:25:07.346496 13097 consensus_queue.cc:1048] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:25:07.314370 13098 consensus_queue.cc:1048] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.116s
I20260709 12:25:07.396708 10848 raft_consensus.cc:1275] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:25:07.399304 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 91836us
W20260709 12:25:07.414275 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 46806.9us
I20260709 12:25:07.495985 13142 consensus_queue.cc:1048] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:07.531132 12962 raft_consensus.cc:2955] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:25:07.551678 13104 tablet_copy_client.cc:323] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Beginning tablet copy session from remote peer at address 127.9.116.65:46265
I20260709 12:25:07.600733 13123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:45890 (request call id 115) took 1016 ms. Trace:
I20260709 12:25:07.601325 13123 rpcz_store.cc:276] 0709 12:25:06.584455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:06.584597 (+   142us) service_pool.cc:224] Handling call
0709 12:25:06.660865 (+ 76268us) ts_tablet_manager.cc:934] T ab816bcc6183447994a2cc013e46c5f8 P 3c52e0825c02476e89d84da9bb849f5d: Initiating tablet copy from peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265)
0709 12:25:07.230024 (+569159us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:25:07.589092 (+359068us) tablet_metadata.cc:665] Metadata flushed
0709 12:25:07.589237 (+   145us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:25:07.599684 (+ 10447us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:25:07.600087 (+   403us) tablet_replica.cc:206] Creating consensus instance
0709 12:25:07.600552 (+   465us) ts_tablet_manager.cc:989] Replica registered.
0709 12:25:07.600645 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":34543,"tablet-copy.queue_time_us":61385,"thread_start_us":210994,"threads_started":2}
I20260709 12:25:07.604043 13123 tablet_copy_client.cc:806] T ab816bcc6183447994a2cc013e46c5f8 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 0 data blocks...
I20260709 12:25:07.604789 13123 tablet_copy_client.cc:670] T ab816bcc6183447994a2cc013e46c5f8 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 1 WAL segments...
W20260709 12:25:07.617801 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 67965.8us
I20260709 12:25:07.620678 12962 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:46472 (request call id 5) took 1366 ms. Trace:
I20260709 12:25:07.621392 12962 rpcz_store.cc:276] 0709 12:25:06.254410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:06.254603 (+   193us) service_pool.cc:224] Handling call
0709 12:25:06.464277 (+209674us) log.cc:844] Serialized 499 byte log entry
0709 12:25:06.887153 (+422876us) spinlock_profiling.cc:243] Waited 3.89 ms on lock 0x7b180004e220. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f759ac63ab1 00007f759ac70281 00007f7591d9b522 00007f7591d9d7c1 00007f7591d9d779 00007f7591d9d709 00007f7591d9d6d1 00007f7591d9c9cd 0000000000388634 0000000000388479 00007f7591d7e83a
0709 12:25:06.960449 (+ 73296us) spinlock_profiling.cc:243] Waited 2.11 ms on lock 0x7b4c00005080. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7593154a20 00007f7593165a29 00007f759316613f 00007f759312a2ab 00007f7593157f3c 00007f75931583fe 00007f75933e550b 00007f7594de4381 00007f7594de226b 00007f7594de8d53 00007f7594de8cd9
0709 12:25:07.620584 (+660135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35978,"raft.queue_time_us":58473,"raft.run_cpu_time_us":15448,"raft.run_wall_time_us":330632,"spinlock_wait_cycles":13809280,"thread_start_us":221218,"threads_started":1,"wal-append.queue_time_us":253185}
I20260709 12:25:07.628381 13053 raft_consensus.cc:1064] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea: attempting to promote NON_VOTER 3c52e0825c02476e89d84da9bb849f5d to VOTER
W20260709 12:25:07.641464 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 101025us
I20260709 12:25:07.671820 10864 tablet_copy_service.cc:140] P 80cd7d227db44f34a6108591dad9c040: Received BeginTabletCopySession request for tablet 9211e3b6d81447798824045b9515c0ee from peer 3c52e0825c02476e89d84da9bb849f5d ({username='slave'} at 127.0.0.1:46480)
I20260709 12:25:07.672870 10864 tablet_copy_service.cc:161] P 80cd7d227db44f34a6108591dad9c040: Beginning new tablet copy session on tablet 9211e3b6d81447798824045b9515c0ee from peer 3c52e0825c02476e89d84da9bb849f5d at {username='slave'} at 127.0.0.1:46480: session id = 3c52e0825c02476e89d84da9bb849f5d-9211e3b6d81447798824045b9515c0ee
I20260709 12:25:07.689210 10854 consensus_queue.cc:237] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:07.706589 10996 raft_consensus.cc:2955] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:25:07.710546 10864 tablet_copy_source_session.cc:215] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:25:07.740477 13123 tablet_copy_client.cc:538] T ab816bcc6183447994a2cc013e46c5f8 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:25:07.741176 10926 raft_consensus.cc:1275] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:25:07.675151 13053 consensus_queue.cc:237] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 2, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:07.752679 10926 raft_consensus.cc:2955] T 9211e3b6d81447798824045b9515c0ee P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:25:07.761282 13104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9211e3b6d81447798824045b9515c0ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:07.773118 10996 raft_consensus.cc:1275] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:25:07.789444 10820 consensus_peers.cc:597] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 -> Peer 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613): Couldn't send request to peer 3c52e0825c02476e89d84da9bb849f5d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 73d7ffc5e5d146d1b661abde11cf2f04. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:07.796026 13146 consensus_queue.cc:1048] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:25:07.839643 10751 catalog_manager.cc:5697] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: config changed from index -1 to 3, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New cstate: current_term: 2 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:25:07.854125 13146 consensus_queue.cc:1048] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:25:07.868227 13160 log.cc:927] Time spent T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
W20260709 12:25:07.893401 13163 log.cc:927] Time spent T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:25:07.907015 13123 tablet_bootstrap.cc:492] T ab816bcc6183447994a2cc013e46c5f8 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap starting.
I20260709 12:25:07.911851 12997 raft_consensus.cc:2955] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [term 6 LEADER]: Committing config change with OpId 6.5: config changed from index -1 to 5, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:25:07.925998 10998 raft_consensus.cc:2955] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Committing config change with OpId 6.5: config changed from index -1 to 5, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:25:07.939137 10924 raft_consensus.cc:2955] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Committing config change with OpId 6.5: config changed from index -1 to 5, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:25:07.967653 10994 raft_consensus.cc:1275] T 69fd8fdac2fa449e9e184f3d668ea1a7 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:25:07.969482 11623 raft_consensus.cc:1275] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d [term 4 LEARNER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:25:07.986009 13145 consensus_queue.cc:1048] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:25:07.992735 10845 raft_consensus.cc:1275] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:25:08.028218  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:08.025915 13090 consensus_queue.cc:1048] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:25:08.075918 13053 consensus_queue.cc:1048] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:25:08.153461 13104 tablet_copy_client.cc:806] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 0 data blocks...
I20260709 12:25:08.154413 13104 tablet_copy_client.cc:670] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:25:08.184571 13104 tablet_copy_client.cc:538] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:25:08.264429 10994 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
mode: GRACEFUL
new_leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:32960
I20260709 12:25:08.265157 10994 raft_consensus.cc:606] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 5 LEADER]: Received request to transfer leadership to TS e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:08.267122 13142 raft_consensus.cc:2955] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:08.270458 10994 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
mode: GRACEFUL
new_leader_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:32960
I20260709 12:25:08.271111 10994 raft_consensus.cc:606] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 LEADER]: Received request to transfer leadership to TS 80cd7d227db44f34a6108591dad9c040
I20260709 12:25:08.275892 13171 ts_tablet_manager.cc:933] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d: Initiating tablet copy from peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265)
I20260709 12:25:08.277635 10846 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
mode: GRACEFUL
new_leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:47358
I20260709 12:25:08.288367 10846 raft_consensus.cc:606] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 2 LEADER]: Received request to transfer leadership to TS edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:08.295096 11003 raft_consensus.cc:2955] T 69fd8fdac2fa449e9e184f3d668ea1a7 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:08.297081 13035 raft_consensus.cc:993] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08: : Instructing follower 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:25:08.302449 13035 raft_consensus.cc:1081] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 LEADER]: Signalling peer 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:25:08.316135 10846 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:56388
I20260709 12:25:08.316762 10846 raft_consensus.cc:493] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:08.317178 10846 raft_consensus.cc:3060] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:08.319794 10924 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
mode: GRACEFUL
new_leader_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:41546
I20260709 12:25:08.320400 10924 raft_consensus.cc:606] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Received request to transfer leadership to TS 80cd7d227db44f34a6108591dad9c040
I20260709 12:25:08.320631 13123 tablet_bootstrap.cc:492] T ab816bcc6183447994a2cc013e46c5f8 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:08.321604 13123 tablet_bootstrap.cc:492] T ab816bcc6183447994a2cc013e46c5f8 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap complete.
I20260709 12:25:08.322336 13123 ts_tablet_manager.cc:1403] T ab816bcc6183447994a2cc013e46c5f8 P 3c52e0825c02476e89d84da9bb849f5d: Time spent bootstrapping tablet: real 0.416s	user 0.042s	sys 0.014s
I20260709 12:25:08.327378  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:25:08.331437  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:08.342020 13104 tablet_bootstrap.cc:492] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap starting.
I20260709 12:25:08.365368  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:08.358556 10846 raft_consensus.cc:515] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:08.364797 10751 catalog_manager.cc:5697] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 reported cstate change: config changed from index -1 to 5, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New cstate: current_term: 6 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:08.419190 13171 tablet_copy_client.cc:323] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Beginning tablet copy session from remote peer at address 127.9.116.65:46265
I20260709 12:25:08.426255 10846 leader_election.cc:290] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 10 election: Requested vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:25:08.453259 10846 raft_consensus.cc:2955] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:08.456730 11622 raft_consensus.cc:2955] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:08.457911 11621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:25:08.458914 11621 raft_consensus.cc:3060] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:08.459082 10864 tablet_copy_service.cc:140] P 80cd7d227db44f34a6108591dad9c040: Received BeginTabletCopySession request for tablet 73d7ffc5e5d146d1b661abde11cf2f04 from peer 3c52e0825c02476e89d84da9bb849f5d ({username='slave'} at 127.0.0.1:46480)
I20260709 12:25:08.459761 10864 tablet_copy_service.cc:161] P 80cd7d227db44f34a6108591dad9c040: Beginning new tablet copy session on tablet 73d7ffc5e5d146d1b661abde11cf2f04 from peer 3c52e0825c02476e89d84da9bb849f5d at {username='slave'} at 127.0.0.1:46480: session id = 3c52e0825c02476e89d84da9bb849f5d-73d7ffc5e5d146d1b661abde11cf2f04
I20260709 12:25:08.468988 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:08.469666 11003 raft_consensus.cc:3055] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:08.469959 11003 raft_consensus.cc:740] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:25:08.477715 11003 consensus_queue.cc:260] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:08.485577 11003 raft_consensus.cc:3060] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:08.537762 13149 raft_consensus.cc:993] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08: : Instructing follower e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:25:08.538488 13149 raft_consensus.cc:1081] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 5 LEADER]: Signalling peer e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:25:08.553126 10845 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:56372
I20260709 12:25:08.553896 10845 raft_consensus.cc:606] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [term 6 LEADER]: Received request to transfer leadership
I20260709 12:25:08.556852 10924 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:59622
I20260709 12:25:08.557516 10924 raft_consensus.cc:493] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:08.560051 10924 raft_consensus.cc:3060] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:08.572432 13098 raft_consensus.cc:993] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040: : Instructing follower e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:25:08.573001 13098 raft_consensus.cc:1081] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [term 6 LEADER]: Signalling peer e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:25:08.554455 10751 catalog_manager.cc:5697] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: config changed from index 4 to 5, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:08.585641 10925 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:59626
I20260709 12:25:08.586606 10925 raft_consensus.cc:493] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:08.587272 10925 raft_consensus.cc:3060] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:08.599890 10926 consensus_queue.cc:237] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:08.604679 10850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:56372
I20260709 12:25:08.605317 10850 raft_consensus.cc:606] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [term 6 LEADER]: Received request to transfer leadership
I20260709 12:25:08.609634 13093 raft_consensus.cc:993] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040: : Instructing follower edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:25:08.611299 10864 tablet_copy_source_session.cc:215] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:25:08.442073 13123 raft_consensus.cc:359] T ab816bcc6183447994a2cc013e46c5f8 P 3c52e0825c02476e89d84da9bb849f5d [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:08.616086 11003 raft_consensus.cc:2468] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 10.
I20260709 12:25:08.616629 11621 raft_consensus.cc:2468] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 10.
I20260709 12:25:08.625550 10850 raft_consensus.cc:1275] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:25:08.628055 10924 raft_consensus.cc:515] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:08.614908 13123 raft_consensus.cc:740] T ab816bcc6183447994a2cc013e46c5f8 P 3c52e0825c02476e89d84da9bb849f5d [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Initialized, Role: LEARNER
W20260709 12:25:08.626837 10738 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 73d7ffc5e5d146d1b661abde11cf2f04 already in progress [suppressed 6 similar messages]
I20260709 12:25:08.633004 10924 leader_election.cc:290] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:08.634312 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:08.646077 10846 raft_consensus.cc:3060] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:08.634613 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:08.639497 13171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73d7ffc5e5d146d1b661abde11cf2f04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:08.641440 13093 raft_consensus.cc:1081] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 2 LEADER]: Signalling peer edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:25:08.647383 10996 raft_consensus.cc:3055] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:08.649158 10996 raft_consensus.cc:740] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:25:08.650763 13090 consensus_queue.cc:1048] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:08.647750 10820 leader_election.cc:304] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:25:08.654743 12962 raft_consensus.cc:2804] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:08.653683 10996 consensus_queue.cc:260] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:08.660538 12962 raft_consensus.cc:697] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 10 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:08.661702 12962 consensus_queue.cc:237] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:08.669474 11003 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:37512
I20260709 12:25:08.670163 11003 raft_consensus.cc:493] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:08.670516 11003 raft_consensus.cc:3060] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:08.676055 10846 raft_consensus.cc:2468] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 6.
I20260709 12:25:08.677911 11003 raft_consensus.cc:515] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:08.680174 11003 leader_election.cc:290] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:08.683816 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:08.684932 10850 raft_consensus.cc:3055] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:08.685279 10850 raft_consensus.cc:740] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:08.685945 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:08.687316 10926 raft_consensus.cc:3060] T 9211e3b6d81447798824045b9515c0ee P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:08.683269 10925 raft_consensus.cc:515] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:08.694684 11623 raft_consensus.cc:1275] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:25:08.696614 10925 leader_election.cc:290] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:08.697080 10996 raft_consensus.cc:3060] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:08.698573 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:08.699239 11003 raft_consensus.cc:3060] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:25:08.703431 10738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 77098.1us
I20260709 12:25:08.706184 10926 raft_consensus.cc:2468] T 9211e3b6d81447798824045b9515c0ee P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 3.
I20260709 12:25:08.711680 10996 raft_consensus.cc:2468] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 6.
I20260709 12:25:08.686235 10850 consensus_queue.cc:260] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:08.714977 10850 raft_consensus.cc:3060] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:08.716569 11003 raft_consensus.cc:2468] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 7.
I20260709 12:25:08.718889 10895 leader_election.cc:304] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:25:08.718777 13097 consensus_queue.cc:1048] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:08.719869 10895 leader_election.cc:304] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:25:08.720675 13142 raft_consensus.cc:2804] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:08.720757 13036 raft_consensus.cc:2804] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:08.721987 10968 leader_election.cc:304] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:25:08.729437 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:08.732502 10846 raft_consensus.cc:3055] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:08.733034 10846 raft_consensus.cc:740] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:08.741092 10751 catalog_manager.cc:5697] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 9 to 10, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 10 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:08.721218 13142 raft_consensus.cc:697] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:08.749046 10850 raft_consensus.cc:2468] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 3.
I20260709 12:25:08.730768 13036 raft_consensus.cc:697] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:08.736395 13150 raft_consensus.cc:2804] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:08.733923 10846 consensus_queue.cc:260] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:08.745540 13142 consensus_queue.cc:237] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:08.757884 13036 consensus_queue.cc:237] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:08.758397 10846 raft_consensus.cc:3060] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:08.769467 13097 raft_consensus.cc:2955] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:08.771225 13150 raft_consensus.cc:697] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 3 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:25:08.772456 13150 consensus_queue.cc:237] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:08.793128 11623 raft_consensus.cc:2955] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:08.703434 13123 consensus_queue.cc:260] T ab816bcc6183447994a2cc013e46c5f8 P 3c52e0825c02476e89d84da9bb849f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:08.808727 10846 raft_consensus.cc:2468] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 7.
I20260709 12:25:08.857414 10850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:56372
I20260709 12:25:08.858126 10850 raft_consensus.cc:606] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Received request to transfer leadership
I20260709 12:25:08.858270 13168 raft_consensus.cc:993] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea: : Instructing follower 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:25:08.858541 10850 raft_consensus.cc:614] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:08.858857 13168 raft_consensus.cc:1081] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Signalling peer 80cd7d227db44f34a6108591dad9c040 to start an election
W20260709 12:25:08.882937 10800 auto_rebalancer.cc:893] Removing replace marker failed: Replica 80cd7d227db44f34a6108591dad9c040 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
W20260709 12:25:08.883344 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 91958.8us
W20260709 12:25:08.883528 10800 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 12:25:08.883986 10800 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 12:25:08.929563 10751 catalog_manager.cc:5697] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 6 to 7, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 7 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:08.940665 10846 raft_consensus.cc:2955] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:08.960053 10850 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:56394
I20260709 12:25:08.960918 10850 raft_consensus.cc:493] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:08.961645 10850 raft_consensus.cc:3060] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:08.978771 10750 catalog_manager.cc:5697] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: config changed from index 5 to 6, VOTER edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) evicted. New cstate: current_term: 4 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:09.008661 10749 catalog_manager.cc:5697] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 2 to 3, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 3 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:09.018743 10850 raft_consensus.cc:515] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:09.040841 10850 leader_election.cc:290] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:09.050757 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:09.056617 10994 raft_consensus.cc:3060] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:25:09.061184 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 45694.1us
I20260709 12:25:09.067952 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:09.068849 10924 raft_consensus.cc:3055] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:25:09.069226 10924 raft_consensus.cc:740] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:09.073884 10924 consensus_queue.cc:260] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:09.090000 11623 raft_consensus.cc:1217] T ab816bcc6183447994a2cc013e46c5f8 P 3c52e0825c02476e89d84da9bb849f5d [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:25:09.113085 13171 tablet_copy_client.cc:806] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 0 data blocks...
I20260709 12:25:09.113827 13171 tablet_copy_client.cc:670] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:25:09.139894 10924 raft_consensus.cc:3060] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:09.154249 10751 catalog_manager.cc:5697] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 5 to 6, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 6 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:09.158237 10994 raft_consensus.cc:2468] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 4.
W20260709 12:25:09.159813 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 128433us
W20260709 12:25:09.160960 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 58866.7us
I20260709 12:25:09.165205 11623 raft_consensus.cc:1275] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:25:09.190619 13123 ts_tablet_manager.cc:1434] T ab816bcc6183447994a2cc013e46c5f8 P 3c52e0825c02476e89d84da9bb849f5d: Time spent starting tablet: real 0.863s	user 0.024s	sys 0.077s
W20260709 12:25:09.191267 13123 ts_tablet_manager.cc:1467] T ab816bcc6183447994a2cc013e46c5f8 P 3c52e0825c02476e89d84da9bb849f5d: Tablet startup took 864ms
I20260709 12:25:09.196394 10924 raft_consensus.cc:2468] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 4.
I20260709 12:25:09.209229 10820 leader_election.cc:304] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:25:09.228150 10846 raft_consensus.cc:1275] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:25:09.238786 13188 raft_consensus.cc:2804] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:25:09.239738 13188 raft_consensus.cc:697] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:09.240944 13188 consensus_queue.cc:237] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:25:09.191785 13123 ts_tablet_manager.cc:1469] T ab816bcc6183447994a2cc013e46c5f8 P 3c52e0825c02476e89d84da9bb849f5d: Trace:
0709 12:25:06.584455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:06.584597 (+   142us) service_pool.cc:224] Handling call
0709 12:25:06.660865 (+ 76268us) ts_tablet_manager.cc:934] T ab816bcc6183447994a2cc013e46c5f8 P 3c52e0825c02476e89d84da9bb849f5d: Initiating tablet copy from peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265)
0709 12:25:07.230024 (+569159us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:25:07.589092 (+359068us) tablet_metadata.cc:665] Metadata flushed
0709 12:25:07.589237 (+   145us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:25:07.599684 (+ 10447us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:25:07.600087 (+   403us) tablet_replica.cc:206] Creating consensus instance
0709 12:25:07.600552 (+   465us) ts_tablet_manager.cc:989] Replica registered.
0709 12:25:07.600645 (+    93us) inbound_call.cc:177] Queueing success response
0709 12:25:07.906559 (+305914us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:25:08.327128 (+420569us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:25:08.357401 (+ 30273us) tablet_replica.cc:261] Starting instrumentation
0709 12:25:08.433164 (+ 75763us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":34543,"raft.queue_time_us":10466,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":1158,"tablet-copy.queue_time_us":61385,"tablet-download-pool.queue_time_us":144,"tablet-download-pool.run_cpu_time_us":1641,"tablet-download-pool.run_wall_time_us":134952,"thread_start_us":328237,"threads_started":3}
I20260709 12:25:09.245293 10738 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 69fd8fdac2fa449e9e184f3d668ea1a7 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:25:09.252243 13104 tablet_bootstrap.cc:492] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:09.253954 13171 tablet_copy_client.cc:538] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:25:09.259305 10994 raft_consensus.cc:1275] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:25:09.259609 10992 tablet_service.cc:1558] Processing DeleteTablet for tablet 69fd8fdac2fa449e9e184f3d668ea1a7 with delete_type TABLET_DATA_TOMBSTONED (TS edcc56ddd3264984b4da6c1db59e7f08 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:37496
I20260709 12:25:09.261893 10929 raft_consensus.cc:1275] T 9211e3b6d81447798824045b9515c0ee P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 12:25:09.267160 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 58022.1us
I20260709 12:25:09.271519 13185 consensus_queue.cc:1048] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:25:09.275875 13053 consensus_queue.cc:1048] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:09.265689 13104 tablet_bootstrap.cc:492] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap complete.
I20260709 12:25:09.280925 13104 ts_tablet_manager.cc:1403] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d: Time spent bootstrapping tablet: real 0.939s	user 0.046s	sys 0.031s
I20260709 12:25:09.304984 13191 tablet_replica.cc:333] T 69fd8fdac2fa449e9e184f3d668ea1a7 P edcc56ddd3264984b4da6c1db59e7f08: stopping tablet replica
I20260709 12:25:09.306489 13191 raft_consensus.cc:2243] T 69fd8fdac2fa449e9e184f3d668ea1a7 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:09.307889 13191 raft_consensus.cc:2272] T 69fd8fdac2fa449e9e184f3d668ea1a7 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:09.335036 13181 consensus_queue.cc:1048] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 12:25:09.347811 13104 raft_consensus.cc:359] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:09.348809 13104 raft_consensus.cc:740] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Initialized, Role: LEARNER
I20260709 12:25:09.339200 10864 tablet_copy_service.cc:342] P 80cd7d227db44f34a6108591dad9c040: Request end of tablet copy session 3c52e0825c02476e89d84da9bb849f5d-ab816bcc6183447994a2cc013e46c5f8 received from {username='slave'} at 127.0.0.1:46480
I20260709 12:25:09.332074 13093 consensus_queue.cc:1048] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
W20260709 12:25:09.398636 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 73523.5us
I20260709 12:25:09.410111 13191 ts_tablet_manager.cc:1916] T 69fd8fdac2fa449e9e184f3d668ea1a7 P edcc56ddd3264984b4da6c1db59e7f08: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:25:09.411888 13104 consensus_queue.cc:260] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:09.382861 10864 tablet_copy_service.cc:434] P 80cd7d227db44f34a6108591dad9c040: ending tablet copy session 3c52e0825c02476e89d84da9bb849f5d-ab816bcc6183447994a2cc013e46c5f8 on tablet ab816bcc6183447994a2cc013e46c5f8 with peer 3c52e0825c02476e89d84da9bb849f5d
I20260709 12:25:09.422659 13171 tablet_bootstrap.cc:492] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap starting.
W20260709 12:25:09.433832 10969 consensus_peers.cc:597] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613): Couldn't send request to peer 3c52e0825c02476e89d84da9bb849f5d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:09.435456 10998 raft_consensus.cc:1275] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:25:09.494330 10994 raft_consensus.cc:1275] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:25:09.504004 13104 ts_tablet_manager.cc:1434] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d: Time spent starting tablet: real 0.208s	user 0.014s	sys 0.004s
I20260709 12:25:09.513193 13191 ts_tablet_manager.cc:1929] T 69fd8fdac2fa449e9e184f3d668ea1a7 P edcc56ddd3264984b4da6c1db59e7f08: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.5
W20260709 12:25:09.513958 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 47318.3us
I20260709 12:25:09.518018 10864 tablet_copy_service.cc:342] P 80cd7d227db44f34a6108591dad9c040: Request end of tablet copy session 3c52e0825c02476e89d84da9bb849f5d-9211e3b6d81447798824045b9515c0ee received from {username='slave'} at 127.0.0.1:46480
I20260709 12:25:09.518698 10864 tablet_copy_service.cc:434] P 80cd7d227db44f34a6108591dad9c040: ending tablet copy session 3c52e0825c02476e89d84da9bb849f5d-9211e3b6d81447798824045b9515c0ee on tablet 9211e3b6d81447798824045b9515c0ee with peer 3c52e0825c02476e89d84da9bb849f5d
I20260709 12:25:09.539207 13188 consensus_queue.cc:1048] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:09.550396 13090 consensus_queue.cc:1048] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
W20260709 12:25:09.560974 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 228235us
I20260709 12:25:09.562731 10750 catalog_manager.cc:5697] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 3 to 4, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 4 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:09.574424 10845 raft_consensus.cc:1275] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 12:25:09.577368 10895 consensus_peers.cc:597] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613): Couldn't send request to peer 3c52e0825c02476e89d84da9bb849f5d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:09.546227 13191 log.cc:1199] T 69fd8fdac2fa449e9e184f3d668ea1a7 P edcc56ddd3264984b4da6c1db59e7f08: Deleting WAL directory at /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599781984018-9681-0/minicluster-data/ts-2-root/wals/69fd8fdac2fa449e9e184f3d668ea1a7
I20260709 12:25:09.608695 10851 raft_consensus.cc:1275] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:25:09.621834 10739 catalog_manager.cc:5028] TS edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): tablet 69fd8fdac2fa449e9e184f3d668ea1a7 (table test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]) successfully deleted
I20260709 12:25:09.624267 13168 consensus_queue.cc:1048] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:09.663890 13126 consensus_queue.cc:1048] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
W20260709 12:25:09.760576 13205 log.cc:927] Time spent T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
W20260709 12:25:09.743909 13184 log.cc:927] Time spent T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 12:25:09.795037 11003 raft_consensus.cc:1275] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:25:09.905076 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 212412us
I20260709 12:25:09.941028 13100 raft_consensus.cc:1064] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040: attempting to promote NON_VOTER 3c52e0825c02476e89d84da9bb849f5d to VOTER
W20260709 12:25:09.969887 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 307116us
W20260709 12:25:09.998027 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 91848us
W20260709 12:25:10.026408 10969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 44716.7us
W20260709 12:25:10.049662 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 68116us
I20260709 12:25:10.051872 10929 raft_consensus.cc:1275] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:25:09.972186  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:25:10.140878 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 47955.6us
I20260709 12:25:10.045526 13196 consensus_queue.cc:1048] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
W20260709 12:25:10.155184 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 104145us
W20260709 12:25:10.175879 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 118606us
W20260709 12:25:10.226305 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 76068.4us
I20260709 12:25:10.268828 13100 consensus_queue.cc:237] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:10.330819 11621 raft_consensus.cc:1275] T ab816bcc6183447994a2cc013e46c5f8 P 3c52e0825c02476e89d84da9bb849f5d [term 2 LEARNER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
W20260709 12:25:10.333664 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 189193us
W20260709 12:25:10.342376 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 292022us
W20260709 12:25:10.449232 13099 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.033s	sys 0.042s
I20260709 12:25:10.575436 10923 raft_consensus.cc:1275] T ab816bcc6183447994a2cc013e46c5f8 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:25:10.575563 11000 raft_consensus.cc:1275] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:25:10.390520 13213 consensus_queue.cc:1048] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.097s
I20260709 12:25:10.379343 13209 consensus_queue.cc:1048] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.210s
W20260709 12:25:10.580433 13099 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.825s	user 0.034s	sys 0.042s
W20260709 12:25:10.663451 13204 log.cc:927] Time spent T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260709 12:25:10.714190 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 102901us
I20260709 12:25:10.717224 11623 raft_consensus.cc:3060] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d [term 2 LEARNER]: Advancing to term 3
I20260709 12:25:10.734560 13238 raft_consensus.cc:493] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:25:10.735253 13238 raft_consensus.cc:515] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:10.814807 13036 raft_consensus.cc:493] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
W20260709 12:25:10.822875 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 107638us
W20260709 12:25:10.867864 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 58807.4us
I20260709 12:25:10.815554 13036 raft_consensus.cc:515] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:10.910749 13036 leader_election.cc:290] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:10.912570 13213 raft_consensus.cc:493] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:25:10.913233 13213 raft_consensus.cc:515] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:10.914960 13213 leader_election.cc:290] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:10.917472 13036 raft_consensus.cc:493] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:25:10.918393 13036 raft_consensus.cc:515] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:10.921464 13036 leader_election.cc:290] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:10.982547 13036 raft_consensus.cc:493] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:25:10.983347 13036 raft_consensus.cc:515] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:10.996548 13193 raft_consensus.cc:493] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
W20260709 12:25:11.015993 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 147349us
W20260709 12:25:11.024201 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 120862us
I20260709 12:25:11.018427 13036 leader_election.cc:290] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:11.027083 13157 consensus_queue.cc:1048] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 12:25:11.047829 10923 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
mode: GRACEFUL
new_leader_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:41546
I20260709 12:25:11.048489 10923 raft_consensus.cc:606] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 4 LEADER]: Received request to transfer leadership to TS 80cd7d227db44f34a6108591dad9c040
I20260709 12:25:11.058183 13238 leader_election.cc:290] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:11.059284 13099 consensus_queue.cc:1048] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:11.083819 10996 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
mode: GRACEFUL
new_leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:32960
I20260709 12:25:11.084524 10996 raft_consensus.cc:606] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 LEADER]: Received request to transfer leadership to TS e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:11.021773 13193 raft_consensus.cc:515] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:11.085740 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:11.108124 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:11.107748 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:11.114846 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:11.125223 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18294423a68a4671bf6c5a0f98645e4c" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:11.128371 13230 raft_consensus.cc:993] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea: : Instructing follower 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:25:11.129001 13230 raft_consensus.cc:1081] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 4 LEADER]: Signalling peer 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:25:11.129750 13193 leader_election.cc:290] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:11.135978 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:11.139712 13201 raft_consensus.cc:493] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:25:11.140439 13201 raft_consensus.cc:515] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:11.143256 13171 tablet_bootstrap.cc:492] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:11.144362 13171 tablet_bootstrap.cc:492] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap complete.
I20260709 12:25:11.145114 13171 ts_tablet_manager.cc:1403] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d: Time spent bootstrapping tablet: real 1.763s	user 0.040s	sys 0.025s
I20260709 12:25:11.160815 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:11.165197 10927 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
mode: GRACEFUL
new_leader_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:41546
I20260709 12:25:11.166018 10927 raft_consensus.cc:606] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 5 LEADER]: Received request to transfer leadership to TS 80cd7d227db44f34a6108591dad9c040
I20260709 12:25:11.178049 13201 leader_election.cc:290] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:25:11.179144 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 73190.6us
I20260709 12:25:11.181782 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:11.197359 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18294423a68a4671bf6c5a0f98645e4c" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:11.199215 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:11.200228 10850 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:56394
I20260709 12:25:11.195225 10820 leader_election.cc:304] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:11.215381 10850 raft_consensus.cc:493] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:11.216045 10850 raft_consensus.cc:3060] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:11.219148 10820 leader_election.cc:304] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:11.224742 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:11.188928 13097 raft_consensus.cc:493] T 9211e3b6d81447798824045b9515c0ee P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:25:11.232839 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:11.194036 13090 raft_consensus.cc:493] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:25:11.226231 13188 raft_consensus.cc:2749] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:25:11.222204 13192 raft_consensus.cc:2749] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:11.250219 13090 raft_consensus.cc:515] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:11.254509 13090 leader_election.cc:290] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:11.251834 10850 raft_consensus.cc:515] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:11.280072 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:11.282533 10850 leader_election.cc:290] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:11.213321 13171 raft_consensus.cc:359] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [term 6 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:11.294725 13171 raft_consensus.cc:740] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [term 6 LEARNER]: Becoming Follower/Learner. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Initialized, Role: LEARNER
I20260709 12:25:11.301765 10850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
mode: GRACEFUL
new_leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:47358
I20260709 12:25:11.301889 13171 consensus_queue.cc:260] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:11.302548 10850 raft_consensus.cc:606] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Received request to transfer leadership to TS edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:25:11.308534 13249 log.cc:927] Time spent T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d: Append to log took a long time: real 0.134s	user 0.002s	sys 0.000s
I20260709 12:25:11.264740 13100 raft_consensus.cc:493] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:25:11.312847 13100 raft_consensus.cc:515] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:25:11.316309 13255 log.cc:927] Time spent T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:25:11.242822 13097 raft_consensus.cc:515] T 9211e3b6d81447798824045b9515c0ee P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
W20260709 12:25:11.404800 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 142844us
I20260709 12:25:11.322392 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:11.347198 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:11.340622 13251 raft_consensus.cc:993] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08: : Instructing follower e2d5c637307a407ab688f5ccd6f0fcea to start an election
W20260709 12:25:11.343483 13248 log.cc:927] Time spent T ab816bcc6183447994a2cc013e46c5f8 P 3c52e0825c02476e89d84da9bb849f5d: Append to log took a long time: real 0.170s	user 0.000s	sys 0.003s
I20260709 12:25:11.594985 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
W20260709 12:25:11.422155 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 90988.1us
I20260709 12:25:11.596396 10929 raft_consensus.cc:3055] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:11.596740 10929 raft_consensus.cc:740] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:11.596921  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:25:11.319501 13100 leader_election.cc:290] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:11.597638 10929 consensus_queue.cc:260] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:11.598763  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:11.598913 13126 raft_consensus.cc:1081] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 LEADER]: Signalling peer e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:25:11.599960  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:11.600859 13097 leader_election.cc:290] T 9211e3b6d81447798824045b9515c0ee P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:11.601287 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:11.321925 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:11.602320 10997 raft_consensus.cc:3060] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:11.598737 10929 raft_consensus.cc:3060] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:11.507408 10895 leader_election.cc:304] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:25:11.604483 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 97175.7us
I20260709 12:25:11.605216 10895 leader_election.cc:304] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:11.606191 13142 raft_consensus.cc:2749] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:11.606889 13142 raft_consensus.cc:2749] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:25:11.610162 10929 raft_consensus.cc:2468] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 5.
I20260709 12:25:11.615000 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:11.536047 13226 raft_consensus.cc:1064] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08: attempting to promote NON_VOTER 3c52e0825c02476e89d84da9bb849f5d to VOTER
I20260709 12:25:11.620709 13226 consensus_queue.cc:237] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:11.624562 13259 raft_consensus.cc:493] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:25:11.625485 13259 raft_consensus.cc:515] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:11.632498 10895 leader_election.cc:304] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:11.420142 13171 ts_tablet_manager.cc:1434] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d: Time spent starting tablet: real 0.275s	user 0.009s	sys 0.002s
W20260709 12:25:11.679808 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 45596.2us
I20260709 12:25:11.681236 10895 leader_election.cc:304] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:11.687786 10895 leader_election.cc:304] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:11.694763 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:11.698415 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:11.705202 10997 raft_consensus.cc:2468] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 5.
W20260709 12:25:11.669341 13171 ts_tablet_manager.cc:1467] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d: Tablet startup took 523ms
I20260709 12:25:11.669562 13142 raft_consensus.cc:2749] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:11.691612 13036 raft_consensus.cc:2749] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:11.734612 10854 raft_consensus.cc:1240] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:11.729993 10923 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:59622
I20260709 12:25:11.736485 10923 raft_consensus.cc:493] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:11.736920 10923 raft_consensus.cc:3060] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:25:11.794230 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 76605.3us
W20260709 12:25:11.794883 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 78349.7us
I20260709 12:25:11.797644 10820 leader_election.cc:304] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:25:11.804204 11624 raft_consensus.cc:3060] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [term 6 LEARNER]: Advancing to term 7
I20260709 12:25:11.733525 13259 leader_election.cc:290] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:11.826886 11621 raft_consensus.cc:1275] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d [term 3 LEARNER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:25:11.848083 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
W20260709 12:25:11.862360 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 65613.2us
I20260709 12:25:11.840559 13257 raft_consensus.cc:2804] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:25:11.870041 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 61924.6us
I20260709 12:25:11.884466 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:25:11.880157 10895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:11.714365 13171 ts_tablet_manager.cc:1469] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d: Trace:
0709 12:25:08.176563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:08.176696 (+   133us) service_pool.cc:224] Handling call
0709 12:25:08.276285 (+ 99589us) ts_tablet_manager.cc:934] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d: Initiating tablet copy from peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265)
0709 12:25:08.635887 (+359602us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:25:08.860256 (+224369us) tablet_metadata.cc:665] Metadata flushed
0709 12:25:08.860421 (+   165us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:25:09.112164 (+251743us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:25:09.112474 (+   310us) tablet_replica.cc:206] Creating consensus instance
0709 12:25:09.112817 (+   343us) ts_tablet_manager.cc:989] Replica registered.
0709 12:25:09.112873 (+    56us) inbound_call.cc:177] Queueing success response
0709 12:25:09.382351 (+269478us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:25:11.145452 (+1763101us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:25:11.167896 (+ 22444us) tablet_replica.cc:261] Starting instrumentation
0709 12:25:11.168593 (+   697us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":51262,"mutex_wait_us":895,"raft.queue_time_us":850,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":98,"tablet-copy.queue_time_us":65478,"tablet-download-pool.queue_time_us":167,"tablet-download-pool.run_cpu_time_us":1162,"tablet-download-pool.run_wall_time_us":139386,"thread_start_us":94782,"threads_started":2}
I20260709 12:25:11.875283 13262 consensus_queue.cc:1048] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
W20260709 12:25:11.902631 13260 log.cc:927] Time spent T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 12:25:11.872845 13257 raft_consensus.cc:697] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 5 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:11.906225 13257 consensus_queue.cc:237] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:11.879385 13215 raft_consensus.cc:2749] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:11.896363 13181 raft_consensus.cc:493] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:25:11.910789 13181 raft_consensus.cc:515] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:11.913420 13181 leader_election.cc:290] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:11.894316 10923 raft_consensus.cc:515] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:11.930400 10920 raft_consensus.cc:1240] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:11.938118 10923 leader_election.cc:290] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:11.979739 13181 raft_consensus.cc:493] T e9331e5342644ca2bae19187b083a7d5 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:25:11.982396 13181 raft_consensus.cc:515] T e9331e5342644ca2bae19187b083a7d5 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:11.984967 13181 leader_election.cc:290] T e9331e5342644ca2bae19187b083a7d5 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:11.985121 13211 raft_consensus.cc:2955] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:11.993034 13231 raft_consensus.cc:993] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040: : Instructing follower edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:25:12.003960 13221 raft_consensus.cc:493] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
W20260709 12:25:12.003334 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 121861us
I20260709 12:25:12.004594 13221 raft_consensus.cc:515] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:12.006986 13221 leader_election.cc:290] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:12.014979 13231 raft_consensus.cc:1081] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Signalling peer edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:25:12.016746 10819 leader_election.cc:304] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:12.019239 13236 raft_consensus.cc:2749] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:12.023252 13036 raft_consensus.cc:993] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea: : Instructing follower 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:25:12.023866 13036 raft_consensus.cc:1081] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 5 LEADER]: Signalling peer 80cd7d227db44f34a6108591dad9c040 to start an election
W20260709 12:25:12.022604 10969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:12.033425 10894 leader_election.cc:304] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:12.034705 13090 raft_consensus.cc:2749] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:12.058501 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b17195a94142039c40f598ed006c94" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:12.061559 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9331e5342644ca2bae19187b083a7d5" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:12.063170 10845 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:56394
I20260709 12:25:12.064018 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b17195a94142039c40f598ed006c94" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:12.065450 10864 tablet_copy_service.cc:342] P 80cd7d227db44f34a6108591dad9c040: Request end of tablet copy session 3c52e0825c02476e89d84da9bb849f5d-73d7ffc5e5d146d1b661abde11cf2f04 received from {username='slave'} at 127.0.0.1:46480
I20260709 12:25:12.066169 10864 tablet_copy_service.cc:434] P 80cd7d227db44f34a6108591dad9c040: ending tablet copy session 3c52e0825c02476e89d84da9bb849f5d-73d7ffc5e5d146d1b661abde11cf2f04 on tablet 73d7ffc5e5d146d1b661abde11cf2f04 with peer 3c52e0825c02476e89d84da9bb849f5d
I20260709 12:25:12.064047 10845 raft_consensus.cc:493] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:12.067229 10845 raft_consensus.cc:3060] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:12.067840 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:12.069128 10894 leader_election.cc:304] T 9211e3b6d81447798824045b9515c0ee P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:12.088073 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:12.088984 10854 raft_consensus.cc:3060] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:12.089165 11621 raft_consensus.cc:2955] T ab816bcc6183447994a2cc013e46c5f8 P 3c52e0825c02476e89d84da9bb849f5d [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:12.095728 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:12.104241 10996 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:37512
I20260709 12:25:12.104846 10996 raft_consensus.cc:493] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:12.105237 10996 raft_consensus.cc:3060] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:12.109206 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:12.082453 13142 raft_consensus.cc:2749] T 9211e3b6d81447798824045b9515c0ee P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:25:12.114063 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9331e5342644ca2bae19187b083a7d5" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:12.109011 10845 raft_consensus.cc:515] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:12.116950 10996 raft_consensus.cc:515] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:12.119956 10996 leader_election.cc:290] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:12.126243 11003 raft_consensus.cc:3055] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:12.126752 11003 raft_consensus.cc:740] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:25:12.126248 13225 consensus_queue.cc:1059] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:25:12.141426 10920 raft_consensus.cc:2955] T ab816bcc6183447994a2cc013e46c5f8 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:12.152405 11000 raft_consensus.cc:1240] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:12.153885 10845 leader_election.cc:290] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:12.154488 10819 leader_election.cc:304] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:12.155905 13269 raft_consensus.cc:2749] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:12.161950 11003 consensus_queue.cc:260] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:12.164041 11003 raft_consensus.cc:3060] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:12.168130 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:25:12.176888 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 59143.3us
I20260709 12:25:12.180750 10854 raft_consensus.cc:2468] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 9.
I20260709 12:25:12.183094 10895 leader_election.cc:304] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:12.185171 13142 raft_consensus.cc:2749] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:12.185820 10895 leader_election.cc:304] T e9331e5342644ca2bae19187b083a7d5 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:12.186713 13142 raft_consensus.cc:2749] T e9331e5342644ca2bae19187b083a7d5 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:25:12.187312 11003 raft_consensus.cc:2468] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 9.
I20260709 12:25:12.198578 10894 leader_election.cc:304] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
W20260709 12:25:12.223611 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 46054.7us
I20260709 12:25:12.228579 13142 raft_consensus.cc:493] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:25:12.229390 13142 raft_consensus.cc:515] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:12.231518 13142 leader_election.cc:290] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:12.232030 13182 raft_consensus.cc:2804] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:12.234767 13182 raft_consensus.cc:697] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:12.235989 13182 consensus_queue.cc:237] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:12.223289 10750 catalog_manager.cc:5697] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 4 to 5, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 5 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:12.241631 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:12.246237 10819 leader_election.cc:304] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:12.247205 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:12.249471 13270 raft_consensus.cc:2749] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:12.251955 10996 raft_consensus.cc:3060] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:12.255190 10921 raft_consensus.cc:1275] T 9211e3b6d81447798824045b9515c0ee P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:25:12.265686 11003 raft_consensus.cc:2955] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:12.250311 13269 consensus_queue.cc:1059] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:25:12.278191 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:12.435491 10920 raft_consensus.cc:3055] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:12.436004 10920 raft_consensus.cc:740] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:12.436800 10920 consensus_queue.cc:260] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:12.437955 10920 raft_consensus.cc:3060] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:12.451756 13270 raft_consensus.cc:3055] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:12.281342 10996 raft_consensus.cc:2468] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 6.
I20260709 12:25:12.452311 13270 raft_consensus.cc:740] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:12.453630 13270 consensus_queue.cc:260] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:12.455196 10846 raft_consensus.cc:1275] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:25:12.459878 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:12.455264 13270 raft_consensus.cc:3060] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:25:12.473609 10969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 117437us
W20260709 12:25:12.480151 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 45224us
I20260709 12:25:12.495263 10920 raft_consensus.cc:2468] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 6.
I20260709 12:25:12.508409 13126 consensus_queue.cc:1048] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:25:12.511114 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:12.511835 10929 raft_consensus.cc:3060] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:12.521647 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:12.522145 10999 raft_consensus.cc:1240] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:12.535058 10929 raft_consensus.cc:2468] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 5.
I20260709 12:25:12.544948 10752 catalog_manager.cc:5697] T ab816bcc6183447994a2cc013e46c5f8 P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: config changed from index 3 to 4, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:12.566704 10923 raft_consensus.cc:1275] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:25:12.593434 10820 leader_election.cc:304] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
W20260709 12:25:12.598551 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 123628us
W20260709 12:25:12.602491 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 86185.7us
W20260709 12:25:12.642850 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 51492.2us
W20260709 12:25:12.645151 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 54344.5us
I20260709 12:25:12.607942 13261 raft_consensus.cc:2804] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:25:12.683043 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 75475.3us
I20260709 12:25:12.620631 13266 consensus_queue.cc:1048] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
W20260709 12:25:12.699208 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 90053us
I20260709 12:25:12.666633 13261 raft_consensus.cc:697] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 6 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:12.698005 13209 consensus_queue.cc:1048] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
W20260709 12:25:12.763561 13278 log.cc:927] Time spent T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:25:12.761868 13261 consensus_queue.cc:237] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:25:12.793483 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 149582us
W20260709 12:25:12.799850 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 151355us
I20260709 12:25:12.821565 10895 leader_election.cc:304] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:12.843859 10846 raft_consensus.cc:1275] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:25:12.850363 13282 raft_consensus.cc:2749] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:25:12.901257 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 49038.6us
I20260709 12:25:12.919072 13142 consensus_queue.cc:1048] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:12.929829  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:12.953322 10848 raft_consensus.cc:2468] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 5.
I20260709 12:25:12.961141 11001 raft_consensus.cc:1275] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:25:12.964576 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 270057us
W20260709 12:25:13.000773 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 179287us
I20260709 12:25:13.011088 10968 leader_election.cc:304] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:25:13.012183 13225 raft_consensus.cc:2804] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:25:13.012786 13225 raft_consensus.cc:697] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:25:13.013760 13225 consensus_queue.cc:237] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:13.061414 10996 raft_consensus.cc:1275] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:25:13.098814 13230 consensus_queue.cc:1048] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:25:13.180148 13306 log.cc:927] Time spent T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
W20260709 12:25:13.410140 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 312485us
W20260709 12:25:13.427484 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 326027us
W20260709 12:25:13.434922 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 341930us
W20260709 12:25:13.435230 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 337791us
I20260709 12:25:13.502373 13201 raft_consensus.cc:1064] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea: attempting to promote NON_VOTER 3c52e0825c02476e89d84da9bb849f5d to VOTER
I20260709 12:25:13.539698 10750 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60730 (request call id 200) took 1337 ms. Trace:
I20260709 12:25:13.540297 10750 rpcz_store.cc:276] 0709 12:25:12.196631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:12.196758 (+   127us) service_pool.cc:224] Handling call
0709 12:25:13.533883 (+1337125us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:12.495977 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:12.539157 (+ 43180us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:12.539194 (+    37us) write_op.cc:435] Acquired schema lock
0709 12:25:12.539212 (+    18us) tablet.cc:662] Decoding operations
0709 12:25:12.539540 (+   328us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:12.539635 (+    95us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:12.539667 (+    32us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:25:12.539875 (+   208us) tablet.cc:701] Row locks acquired
0709 12:25:12.539893 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:25:12.540049 (+   156us) write_op.cc:270] Start()
0709 12:25:12.540193 (+   144us) write_op.cc:276] Timestamp: P: 1783599912540000 usec, L: 0
0709 12:25:12.540218 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:25:12.541006 (+   788us) log.cc:844] Serialized 538 byte log entry
0709 12:25:13.002951 (+461945us) op_driver.cc:464] REPLICATION: finished
0709 12:25:13.433536 (+430585us) write_op.cc:301] APPLY: starting
0709 12:25:13.433665 (+   129us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:13.433812 (+   147us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:13.433973 (+   161us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:13.434318 (+   345us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:13.434557 (+   239us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:25:13.434611 (+    54us) write_op.cc:312] APPLY: finished
0709 12:25:13.446143 (+ 11532us) log.cc:844] Serialized 23 byte log entry
0709 12:25:13.457838 (+ 11695us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:13.460002 (+  2164us) write_op.cc:454] Released schema lock
0709 12:25:13.462737 (+  2735us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:13.496176 (+ 33439us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:13.496224 (+    48us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":81,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":429919,"apply.run_cpu_time_us":2536,"apply.run_wall_time_us":57878,"num_ops":1,"prepare.queue_time_us":229443,"prepare.run_cpu_time_us":12692,"prepare.run_wall_time_us":182594,"raft.queue_time_us":651241,"raft.run_cpu_time_us":79184,"raft.run_wall_time_us":588682,"replication_time_us":462586,"thread_start_us":428830,"threads_started":4,"wal-append.queue_time_us":163930}]]}
W20260709 12:25:13.595386 13304 log.cc:927] Time spent T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.211s	user 0.006s	sys 0.006s
I20260709 12:25:13.589138 13201 consensus_queue.cc:237] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:13.654281 10752 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36188 (request call id 88) took 1162 ms. Trace:
W20260709 12:25:13.662497 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 197214us
W20260709 12:25:13.680682 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 110720us
I20260709 12:25:13.654700 10752 rpcz_store.cc:276] 0709 12:25:12.491692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:12.491820 (+   128us) service_pool.cc:224] Handling call
0709 12:25:13.654209 (+1162389us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:12.695300 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:12.703619 (+  8319us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:12.703649 (+    30us) write_op.cc:435] Acquired schema lock
0709 12:25:12.703666 (+    17us) tablet.cc:662] Decoding operations
0709 12:25:12.703984 (+   318us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:12.704030 (+    46us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:12.704065 (+    35us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:25:12.704231 (+   166us) tablet.cc:701] Row locks acquired
0709 12:25:12.704252 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:25:12.704378 (+   126us) write_op.cc:270] Start()
0709 12:25:12.704476 (+    98us) write_op.cc:276] Timestamp: P: 1783599912704331 usec, L: 0
0709 12:25:12.704495 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:25:12.727973 (+ 23478us) log.cc:844] Serialized 595 byte log entry
0709 12:25:13.379679 (+651706us) op_driver.cc:464] REPLICATION: finished
0709 12:25:13.502129 (+122450us) write_op.cc:301] APPLY: starting
0709 12:25:13.502257 (+   128us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:13.502394 (+   137us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:13.502554 (+   160us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:13.502804 (+   250us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:13.503025 (+   221us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:25:13.503097 (+    72us) write_op.cc:312] APPLY: finished
0709 12:25:13.503358 (+   261us) log.cc:844] Serialized 23 byte log entry
0709 12:25:13.503591 (+   233us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:13.503701 (+   110us) write_op.cc:454] Released schema lock
0709 12:25:13.503755 (+    54us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":28977,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":122208,"apply.run_cpu_time_us":1980,"apply.run_wall_time_us":1981,"num_ops":1,"prepare.queue_time_us":101055,"prepare.run_cpu_time_us":3081,"prepare.run_wall_time_us":51274,"replication_time_us":674986,"thread_start_us":188085,"threads_started":1}]]}
I20260709 12:25:13.696328 13266 raft_consensus.cc:493] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:13.746362 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 181599us
I20260709 12:25:13.755911 13221 consensus_queue.cc:1048] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 12:25:13.756808 13036 raft_consensus.cc:493] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:25:13.757570 13036 raft_consensus.cc:515] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:13.759939 13142 raft_consensus.cc:493] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:25:13.760871 13142 raft_consensus.cc:515] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:13.762737 10749 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60734 (request call id 201) took 1207 ms. Trace:
I20260709 12:25:13.763192 10749 rpcz_store.cc:276] 0709 12:25:12.555555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:12.555904 (+   349us) service_pool.cc:224] Handling call
0709 12:25:12.965108 (+409204us) spinlock_profiling.cc:243] Waited 51.1 ms on lock 0x7b540007b554. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df2090 00007f7594e90f3a 00007f759ac46e9c 00007f759ad4504e 00007f75992062a4 00007f7599206232 00007f7599206161 00007f75992060dc 00007f7599205392 00007f75931c348c 00007f75931c28c6
0709 12:25:13.762661 (+797553us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9968,"reported_tablets":2,"spinlock_wait_cycles":117463936}
I20260709 12:25:13.715284 13266 raft_consensus.cc:515] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:13.771540 13266 leader_election.cc:290] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:13.779592 13036 leader_election.cc:290] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:13.786660 13142 leader_election.cc:290] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:13.794082 13231 raft_consensus.cc:493] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:25:13.802202 10921 raft_consensus.cc:1275] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:25:13.803095 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:13.794947 13293 raft_consensus.cc:493] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:25:13.822041 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18294423a68a4671bf6c5a0f98645e4c" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:25:13.822340 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 101807us
I20260709 12:25:13.821870 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:13.821609 13293 raft_consensus.cc:515] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:13.834615 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab816bcc6183447994a2cc013e46c5f8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:25:13.815600 13231 raft_consensus.cc:515] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:13.847224 13231 leader_election.cc:290] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:25:13.807118 13310 log.cc:927] Time spent T 9211e3b6d81447798824045b9515c0ee P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 12:25:13.849797 13293 leader_election.cc:290] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:25:13.869560 10749 catalog_manager.cc:5697] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 4 to 5, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 5 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
W20260709 12:25:13.891644 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 66473.8us
I20260709 12:25:13.906627 10749 catalog_manager.cc:5697] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 8 to 9, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 9 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } }
I20260709 12:25:13.907562 11001 raft_consensus.cc:1275] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:25:13.912547 13299 consensus_queue.cc:1048] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:13.916194 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:13.922895 13266 raft_consensus.cc:2955] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 3 to 5, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:13.933948 10849 raft_consensus.cc:1275] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:25:13.937919 11624 raft_consensus.cc:1275] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [term 7 LEARNER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:25:13.932132 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:13.939009 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab816bcc6183447994a2cc013e46c5f8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:13.957260 10996 raft_consensus.cc:1275] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:25:13.959635 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:13.961531 10849 raft_consensus.cc:1275] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:25:13.954380 13182 consensus_queue.cc:1048] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:13.959506 10968 leader_election.cc:304] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:13.957233 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18294423a68a4671bf6c5a0f98645e4c" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:13.971174 10928 raft_consensus.cc:1275] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:25:13.973942 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab816bcc6183447994a2cc013e46c5f8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:13.980283 13225 raft_consensus.cc:2749] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:13.986244 10853 raft_consensus.cc:2955] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 3 to 5, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:13.999876 10921 raft_consensus.cc:2955] T 9211e3b6d81447798824045b9515c0ee P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 3 to 5, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:14.040748 13287 consensus_queue.cc:1048] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:14.079445 13321 consensus_queue.cc:1048] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:25:14.085826 10968 leader_election.cc:304] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
W20260709 12:25:14.103806 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 82682.7us
I20260709 12:25:14.083439 13284 consensus_queue.cc:1048] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 12:25:14.097420 13317 raft_consensus.cc:2749] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:14.261803 13311 raft_consensus.cc:493] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:25:14.262724 13311 raft_consensus.cc:515] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:14.314549 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:14.321987 13232 raft_consensus.cc:493] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:14.322595 13232 raft_consensus.cc:515] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:14.324815 13232 leader_election.cc:290] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:14.333068 11624 raft_consensus.cc:2955] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 3 to 5, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:14.350947 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:14.330083 13311 leader_election.cc:290] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:14.352015 10925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
mode: GRACEFUL
new_leader_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:41546
I20260709 12:25:14.352672 10925 raft_consensus.cc:606] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Received request to transfer leadership to TS 80cd7d227db44f34a6108591dad9c040
I20260709 12:25:14.353082 10925 raft_consensus.cc:614] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:25:14.360414 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 46746.5us
I20260709 12:25:14.361611 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:25:14.367959 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 250490us
W20260709 12:25:14.368124 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 50598.4us
I20260709 12:25:14.373788 10894 leader_election.cc:304] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:14.381045 10894 leader_election.cc:304] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:14.367694 13239 raft_consensus.cc:493] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:25:14.417615 10853 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
mode: GRACEFUL
new_leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:47358
I20260709 12:25:14.418428 10853 raft_consensus.cc:606] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Received request to transfer leadership to TS edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:14.426151 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:14.440569 13239 raft_consensus.cc:515] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:14.386646 13215 raft_consensus.cc:2749] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:14.408696 13090 raft_consensus.cc:2749] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:25:14.386303 13327 consensus_queue.cc:1048] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.094s
I20260709 12:25:14.480840 13239 leader_election.cc:290] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:14.380041 13314 consensus_queue.cc:1048] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
W20260709 12:25:14.496850 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 73196.5us
W20260709 12:25:14.507931 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 129934us
I20260709 12:25:14.531073 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:14.561614 10819 leader_election.cc:304] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:14.564813 13269 raft_consensus.cc:2749] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:14.579128 10927 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
mode: GRACEFUL
new_leader_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:41546
I20260709 12:25:14.579943 10927 raft_consensus.cc:606] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Received request to transfer leadership to TS 80cd7d227db44f34a6108591dad9c040
I20260709 12:25:14.595820 13332 raft_consensus.cc:493] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:25:14.596789 13332 raft_consensus.cc:515] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:14.614146 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:14.617149 13202 raft_consensus.cc:493] T ab816bcc6183447994a2cc013e46c5f8 P 3c52e0825c02476e89d84da9bb849f5d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:25:14.617839 13202 raft_consensus.cc:515] T ab816bcc6183447994a2cc013e46c5f8 P 3c52e0825c02476e89d84da9bb849f5d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:14.625324 13202 leader_election.cc:290] T ab816bcc6183447994a2cc013e46c5f8 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:14.630689 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab816bcc6183447994a2cc013e46c5f8" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:14.638387 10995 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
mode: GRACEFUL
new_leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:32960
I20260709 12:25:14.639493 10995 raft_consensus.cc:606] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 LEADER]: Received request to transfer leadership to TS e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:14.658070 10968 leader_election.cc:304] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:14.667914  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:25:14.668440 10894 leader_election.cc:304] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:14.669852  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:14.670866  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:14.671079 10752 catalog_manager.cc:5697] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 5 to 6, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 6 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:14.677981 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab816bcc6183447994a2cc013e46c5f8" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:14.630108 13332 leader_election.cc:290] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:25:14.752969 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 68279.8us
W20260709 12:25:14.754693 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 91175.4us
I20260709 12:25:14.764179 13327 raft_consensus.cc:2955] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 LEADER]: Committing config change with OpId 7.7: config changed from index 5 to 7, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:14.772254 11588 leader_election.cc:304] T ab816bcc6183447994a2cc013e46c5f8 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:14.772939 13182 raft_consensus.cc:993] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea: : Instructing follower 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:25:14.773397 13182 raft_consensus.cc:1081] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Signalling peer 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:25:14.773231 13202 raft_consensus.cc:2749] T ab816bcc6183447994a2cc013e46c5f8 P 3c52e0825c02476e89d84da9bb849f5d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:14.681159 13263 raft_consensus.cc:2749] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:25:14.804129 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 48212.7us
I20260709 12:25:14.806013 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:14.812705 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:14.818022 11624 raft_consensus.cc:2955] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 5 to 7, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:14.844022 10749 catalog_manager.cc:5697] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: config changed from index 3 to 5, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
W20260709 12:25:14.850381 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 81993.8us
I20260709 12:25:14.861233 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:14.864401 10851 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:56394
I20260709 12:25:14.865008 10851 raft_consensus.cc:493] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:14.865392 10851 raft_consensus.cc:3060] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:14.876959 10853 raft_consensus.cc:2955] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 5 to 7, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:14.882891 13331 raft_consensus.cc:993] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08: : Instructing follower e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:25:14.883515 13331 raft_consensus.cc:1081] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 LEADER]: Signalling peer e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:25:14.885074 10851 raft_consensus.cc:515] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:14.889004 10851 leader_election.cc:290] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:14.889791 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:14.890425 10921 raft_consensus.cc:3055] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:25:14.890713 10921 raft_consensus.cc:740] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:14.891497 10921 consensus_queue.cc:260] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:14.892783 10921 raft_consensus.cc:3060] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:14.924216 10921 raft_consensus.cc:2468] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 4.
I20260709 12:25:14.928825 10819 leader_election.cc:304] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:25:14.929859 13269 raft_consensus.cc:2804] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:25:14.930706 13269 raft_consensus.cc:697] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:14.924235 10847 consensus_queue.cc:237] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:14.931892 13269 consensus_queue.cc:237] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:14.967713 11621 raft_consensus.cc:1275] T ab816bcc6183447994a2cc013e46c5f8 P 3c52e0825c02476e89d84da9bb849f5d [term 2 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:25:14.969553 13296 consensus_queue.cc:1048] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:25:14.981899 13285 log.cc:927] Time spent T 00000000000000000000000000000000 P 9619ad7a9e7f4d9b8039487e3ee77243: Append to log took a long time: real 0.066s	user 0.004s	sys 0.002s
I20260709 12:25:14.991654 13036 raft_consensus.cc:2749] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:15.001300 13290 raft_consensus.cc:2955] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:15.005903 10749 catalog_manager.cc:5697] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: config changed from index 5 to 7, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New cstate: current_term: 7 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:14.996622 10996 raft_consensus.cc:2955] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 5 to 7, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:15.018174 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab816bcc6183447994a2cc013e46c5f8" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:25:15.029313 10819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:15.036967 11624 raft_consensus.cc:2955] T ab816bcc6183447994a2cc013e46c5f8 P 3c52e0825c02476e89d84da9bb849f5d [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:15.045609 10929 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:59622
I20260709 12:25:15.046276 10929 raft_consensus.cc:493] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:15.046644 10929 raft_consensus.cc:3060] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:15.047547 10968 leader_election.cc:304] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:15.048692 13311 raft_consensus.cc:2749] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:15.064747 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:15.065402 10998 raft_consensus.cc:3060] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:15.067559 11003 raft_consensus.cc:1275] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:25:15.055151 10929 raft_consensus.cc:515] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:15.084335 10738 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ab816bcc6183447994a2cc013e46c5f8 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:25:15.083446 10998 raft_consensus.cc:2468] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 4.
I20260709 12:25:15.136852 10749 catalog_manager.cc:5697] T ab816bcc6183447994a2cc013e46c5f8 P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: config changed from index 4 to 5, VOTER e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) evicted. New cstate: current_term: 2 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:15.146867 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:15.147462 10996 raft_consensus.cc:3055] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:15.147791 10996 raft_consensus.cc:740] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:25:15.148548 10996 consensus_queue.cc:260] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:15.149637 10996 raft_consensus.cc:3060] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:15.151840 11001 consensus_queue.cc:237] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:15.157173 13257 raft_consensus.cc:993] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040: : Instructing follower edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:25:15.157719 13257 raft_consensus.cc:1081] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Signalling peer edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:25:15.160372 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:15.161005 10850 raft_consensus.cc:3060] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:15.164052 10912 tablet_service.cc:1558] Processing DeleteTablet for tablet ab816bcc6183447994a2cc013e46c5f8 with delete_type TABLET_DATA_TOMBSTONED (TS e2d5c637307a407ab688f5ccd6f0fcea not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:59610
I20260709 12:25:15.146234 10929 leader_election.cc:290] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:15.166394 13296 consensus_queue.cc:1048] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:25:15.168159 10927 consensus_queue.cc:237] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:15.174649 10850 raft_consensus.cc:2468] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 3.
I20260709 12:25:15.176321 10968 leader_election.cc:304] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:15.177764 13353 raft_consensus.cc:2749] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:15.181031 10894 leader_election.cc:304] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:25:15.182543 13346 raft_consensus.cc:2804] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:15.183604 13346 raft_consensus.cc:697] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:15.184561 13346 consensus_queue.cc:237] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:15.188989 10996 raft_consensus.cc:2468] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 3.
I20260709 12:25:15.202150 11624 raft_consensus.cc:1275] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d [term 3 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:25:15.204624 10998 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:37512
I20260709 12:25:15.205480 10998 raft_consensus.cc:493] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:15.206003 10998 raft_consensus.cc:3060] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:15.216077 13361 tablet_replica.cc:333] T ab816bcc6183447994a2cc013e46c5f8 P e2d5c637307a407ab688f5ccd6f0fcea: stopping tablet replica
I20260709 12:25:15.222254 13311 consensus_queue.cc:1048] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:15.234858 11624 raft_consensus.cc:1275] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:25:15.239564 13215 consensus_queue.cc:1048] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:15.243898 11002 raft_consensus.cc:2955] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:15.252285 11003 raft_consensus.cc:1275] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:25:15.252924 10998 raft_consensus.cc:515] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:15.254832 10998 leader_election.cc:290] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:15.230161 10749 catalog_manager.cc:5697] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 3 to 4, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 4 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:15.281118 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:15.281302 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:15.281780 10929 raft_consensus.cc:3060] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:15.281915 10847 raft_consensus.cc:3055] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:15.282471 10847 raft_consensus.cc:740] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:15.276319 13361 raft_consensus.cc:2243] T ab816bcc6183447994a2cc013e46c5f8 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:15.285908 10850 raft_consensus.cc:1275] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:25:15.283250 10847 consensus_queue.cc:260] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:15.296783 10847 raft_consensus.cc:3060] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:15.287678 13347 consensus_queue.cc:1048] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 12:25:15.297820 13361 raft_consensus.cc:2272] T ab816bcc6183447994a2cc013e46c5f8 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:15.308369 13361 ts_tablet_manager.cc:1916] T ab816bcc6183447994a2cc013e46c5f8 P e2d5c637307a407ab688f5ccd6f0fcea: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:25:15.308488 13327 raft_consensus.cc:2955] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 LEADER]: Committing config change with OpId 7.8: config changed from index 7 to 8, VOTER 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:15.325780 13311 raft_consensus.cc:2955] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:15.329517 11624 raft_consensus.cc:2955] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:15.336973 10929 raft_consensus.cc:2468] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 5.
I20260709 12:25:15.340996 11621 raft_consensus.cc:2955] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 7 to 8, VOTER 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:15.330571 10752 catalog_manager.cc:5697] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 2 to 3, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 3 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:15.364909 10751 catalog_manager.cc:5697] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: config changed from index 5 to 6, VOTER e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) evicted. New cstate: current_term: 3 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:15.368626 10968 leader_election.cc:304] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:25:15.383813 13350 raft_consensus.cc:2804] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:25:15.401865 10847 raft_consensus.cc:2468] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 5.
I20260709 12:25:15.398643 13350 raft_consensus.cc:697] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 5 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:25:15.410765 11002 raft_consensus.cc:1275] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:15.417402 13344 consensus_queue.cc:1048] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:25:15.430941 13350 consensus_queue.cc:237] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:25:15.451870 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 61784.2us
I20260709 12:25:15.459812 13239 consensus_queue.cc:1048] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:15.469031 11002 raft_consensus.cc:2955] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 7 to 8, VOTER 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:15.487389 13361 ts_tablet_manager.cc:1929] T ab816bcc6183447994a2cc013e46c5f8 P e2d5c637307a407ab688f5ccd6f0fcea: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:25:15.487967 13361 log.cc:1199] T ab816bcc6183447994a2cc013e46c5f8 P e2d5c637307a407ab688f5ccd6f0fcea: Deleting WAL directory at /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599781984018-9681-0/minicluster-data/ts-1-root/wals/ab816bcc6183447994a2cc013e46c5f8
I20260709 12:25:15.495357 10738 catalog_manager.cc:5028] TS e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): tablet ab816bcc6183447994a2cc013e46c5f8 (table test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]) successfully deleted
I20260709 12:25:15.513141 10912 tablet_service.cc:1558] Processing DeleteTablet for tablet 9211e3b6d81447798824045b9515c0ee with delete_type TABLET_DATA_TOMBSTONED (TS e2d5c637307a407ab688f5ccd6f0fcea not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:59610
I20260709 12:25:15.522233 10847 raft_consensus.cc:2955] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
W20260709 12:25:15.548674 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 78756.1us
I20260709 12:25:15.571650 13361 tablet_replica.cc:333] T 9211e3b6d81447798824045b9515c0ee P e2d5c637307a407ab688f5ccd6f0fcea: stopping tablet replica
I20260709 12:25:15.573666 13361 raft_consensus.cc:2243] T 9211e3b6d81447798824045b9515c0ee P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:15.575385 13361 raft_consensus.cc:2272] T 9211e3b6d81447798824045b9515c0ee P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:15.601164 13361 ts_tablet_manager.cc:1916] T 9211e3b6d81447798824045b9515c0ee P e2d5c637307a407ab688f5ccd6f0fcea: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:25:15.639992 10739 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9211e3b6d81447798824045b9515c0ee with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:25:15.670790 10738 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 73d7ffc5e5d146d1b661abde11cf2f04 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:25:15.675774 10751 catalog_manager.cc:5697] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: config changed from index 7 to 8, VOTER 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) evicted. New cstate: current_term: 7 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:15.680382 10923 raft_consensus.cc:1275] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:15.689632 10752 catalog_manager.cc:5697] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 4 to 5, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 5 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
W20260709 12:25:15.700395 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 176981us
W20260709 12:25:15.892678 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 102636us
I20260709 12:25:15.896054 13290 consensus_queue.cc:1048] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:25:15.905967 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 86922.7us
I20260709 12:25:15.959827 10845 raft_consensus.cc:1275] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:15.963474 13361 ts_tablet_manager.cc:1929] T 9211e3b6d81447798824045b9515c0ee P e2d5c637307a407ab688f5ccd6f0fcea: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 12:25:15.964465 13361 log.cc:1199] T 9211e3b6d81447798824045b9515c0ee P e2d5c637307a407ab688f5ccd6f0fcea: Deleting WAL directory at /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599781984018-9681-0/minicluster-data/ts-1-root/wals/9211e3b6d81447798824045b9515c0ee
I20260709 12:25:15.969913 10738 catalog_manager.cc:5028] TS e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): tablet 9211e3b6d81447798824045b9515c0ee (table test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]) successfully deleted
I20260709 12:25:15.982779  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:15.984727 10835 tablet_service.cc:1558] Processing DeleteTablet for tablet 73d7ffc5e5d146d1b661abde11cf2f04 with delete_type TABLET_DATA_TOMBSTONED (TS 80cd7d227db44f34a6108591dad9c040 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:56372
I20260709 12:25:16.020681 13371 consensus_queue.cc:1048] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:16.035434 10925 raft_consensus.cc:1275] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:25:16.065657 13381 tablet_replica.cc:333] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040: stopping tablet replica
I20260709 12:25:16.072548 11003 raft_consensus.cc:1275] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:16.067555 13381 raft_consensus.cc:2243] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:16.166096 13364 consensus_queue.cc:1048] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:25:16.167356 10851 raft_consensus.cc:1275] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:25:16.173645 13229 consensus_queue.cc:1048] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:25:16.140484 13381 raft_consensus.cc:2272] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:16.201857 13036 consensus_queue.cc:1048] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:16.256913 13381 ts_tablet_manager.cc:1916] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:25:16.412057 13385 log.cc:927] Time spent T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 12:25:16.549813 13381 ts_tablet_manager.cc:1929] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 7.7
I20260709 12:25:16.550432 13381 log.cc:1199] T 73d7ffc5e5d146d1b661abde11cf2f04 P 80cd7d227db44f34a6108591dad9c040: Deleting WAL directory at /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599781984018-9681-0/minicluster-data/ts-0-root/wals/73d7ffc5e5d146d1b661abde11cf2f04
I20260709 12:25:16.575248 10738 catalog_manager.cc:5028] TS 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): tablet 73d7ffc5e5d146d1b661abde11cf2f04 (table test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]) successfully deleted
I20260709 12:25:16.621302 10848 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
mode: GRACEFUL
new_leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:47358
I20260709 12:25:16.622196 10848 raft_consensus.cc:606] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 5 LEADER]: Received request to transfer leadership to TS edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:16.629794 10921 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "435d66c6d38c4d8a90a81975a6a0cb13"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
mode: GRACEFUL
new_leader_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:41546
I20260709 12:25:16.630740 10921 raft_consensus.cc:606] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Received request to transfer leadership to TS 80cd7d227db44f34a6108591dad9c040
I20260709 12:25:16.643327 10848 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
mode: GRACEFUL
new_leader_uuid: "3c52e0825c02476e89d84da9bb849f5d"
 from {username='slave'} at 127.0.0.1:47358
I20260709 12:25:16.644055 10848 raft_consensus.cc:606] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 10 LEADER]: Received request to transfer leadership to TS 3c52e0825c02476e89d84da9bb849f5d
I20260709 12:25:16.648712 10996 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
mode: GRACEFUL
new_leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:32960
I20260709 12:25:16.649293 10996 raft_consensus.cc:606] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 LEADER]: Received request to transfer leadership to TS e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:16.656454 10845 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c63ecfc9bd3945818cfe15c03f001315"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
mode: GRACEFUL
new_leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:47358
I20260709 12:25:16.657254 10845 raft_consensus.cc:606] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Received request to transfer leadership to TS edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:16.665788 10921 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
mode: GRACEFUL
new_leader_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:41546
I20260709 12:25:16.666468 10921 raft_consensus.cc:606] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 LEADER]: Received request to transfer leadership to TS 80cd7d227db44f34a6108591dad9c040
I20260709 12:25:16.667985  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:25:16.669909  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:16.671079  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:16.771136 13393 raft_consensus.cc:993] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040: : Instructing follower edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:25:16.771799 13393 raft_consensus.cc:1081] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Signalling peer edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:25:16.774626 10996 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c63ecfc9bd3945818cfe15c03f001315"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:37512
I20260709 12:25:16.775602 10996 raft_consensus.cc:493] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:16.776074 10996 raft_consensus.cc:3060] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:16.798878 10996 raft_consensus.cc:515] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:16.814097 10996 leader_election.cc:290] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:16.816311 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63ecfc9bd3945818cfe15c03f001315" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:16.817231 10845 raft_consensus.cc:3055] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:16.817540 10845 raft_consensus.cc:740] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:16.818385 10845 consensus_queue.cc:260] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:16.820129 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63ecfc9bd3945818cfe15c03f001315" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:16.820812 10923 raft_consensus.cc:3060] T c63ecfc9bd3945818cfe15c03f001315 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:16.825261 10845 raft_consensus.cc:3060] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:16.857540 13394 raft_consensus.cc:993] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040: : Instructing follower edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:25:16.858522 13394 raft_consensus.cc:1081] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 5 LEADER]: Signalling peer edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:25:16.864655 10996 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:37512
I20260709 12:25:16.865300 10996 raft_consensus.cc:493] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:16.865672 10996 raft_consensus.cc:3060] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:16.880998 10923 raft_consensus.cc:2468] T c63ecfc9bd3945818cfe15c03f001315 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 5.
I20260709 12:25:16.884893 10968 leader_election.cc:304] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:25:16.886644 13239 raft_consensus.cc:2804] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:25:16.887205 13239 raft_consensus.cc:697] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:25:16.888139 13239 consensus_queue.cc:237] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:16.899868 10996 raft_consensus.cc:515] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:16.901991 10996 leader_election.cc:290] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:16.904673 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:16.905390 10848 raft_consensus.cc:3055] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:16.905689 10848 raft_consensus.cc:740] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:16.907835 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:16.908739 10925 raft_consensus.cc:3060] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:16.914666 13267 raft_consensus.cc:993] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08: : Instructing follower e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:25:16.915280 13267 raft_consensus.cc:1081] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 LEADER]: Signalling peer e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:25:16.917255 10929 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:59622
I20260709 12:25:16.918043 10929 raft_consensus.cc:493] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:16.918509 10929 raft_consensus.cc:3060] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:16.906490 10848 consensus_queue.cc:260] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:16.931509 10848 raft_consensus.cc:3060] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:16.937433 13371 raft_consensus.cc:993] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea: : Instructing follower 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:25:16.938156 13371 raft_consensus.cc:1081] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Signalling peer 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:25:16.940719 10853 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "435d66c6d38c4d8a90a81975a6a0cb13"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:56394
I20260709 12:25:16.941507 10853 raft_consensus.cc:493] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:16.942154 10853 raft_consensus.cc:3060] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:16.951383 10925 raft_consensus.cc:2468] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 6.
I20260709 12:25:16.953153 10968 leader_election.cc:304] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:25:16.955312 13364 raft_consensus.cc:2804] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:16.964323 13364 raft_consensus.cc:697] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 6 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:25:16.965590 13364 consensus_queue.cc:237] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:16.969412 10929 raft_consensus.cc:515] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:16.972602 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:16.973402 10849 raft_consensus.cc:3060] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:16.951141 10845 raft_consensus.cc:2468] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 5.
I20260709 12:25:16.985263 10853 raft_consensus.cc:515] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:16.990187 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c6d38c4d8a90a81975a6a0cb13" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:16.990769 10923 raft_consensus.cc:3055] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:16.991092 10923 raft_consensus.cc:740] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:16.991291 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c6d38c4d8a90a81975a6a0cb13" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:16.992370 11002 raft_consensus.cc:3060] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:16.993271 10923 consensus_queue.cc:260] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:17.000077 10923 raft_consensus.cc:3060] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:17.000702 10853 leader_election.cc:290] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:17.006425 11002 raft_consensus.cc:2468] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 7.
I20260709 12:25:17.005220 10849 raft_consensus.cc:2468] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 5.
I20260709 12:25:17.008970 10923 raft_consensus.cc:2468] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 7.
I20260709 12:25:17.010490 10819 leader_election.cc:304] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:25:17.020120 10848 raft_consensus.cc:2468] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 6.
I20260709 12:25:17.058506 10929 leader_election.cc:290] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:17.077431 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:17.078157 11002 raft_consensus.cc:3055] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:17.078457 11002 raft_consensus.cc:740] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
W20260709 12:25:17.079468 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 69059.5us
I20260709 12:25:17.089617 13372 raft_consensus.cc:2804] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:17.090301 13372 raft_consensus.cc:697] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 7 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:17.091243 13372 consensus_queue.cc:237] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:17.091912 11002 consensus_queue.cc:260] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:17.093276 11002 raft_consensus.cc:3060] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:17.080583 10894 leader_election.cc:304] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:25:17.099311 13371 raft_consensus.cc:2804] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:25:17.100006 13371 raft_consensus.cc:697] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:17.101496 13392 raft_consensus.cc:993] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea: : Instructing follower 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:25:17.101356 13371 consensus_queue.cc:237] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:17.102063 13392 raft_consensus.cc:1081] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 LEADER]: Signalling peer 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:25:17.107775 11002 raft_consensus.cc:2468] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 5.
I20260709 12:25:17.109989 10749 catalog_manager.cc:5697] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 4 to 5, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 5 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:17.112540 10749 catalog_manager.cc:5697] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 5 to 6, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 6 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:17.144459 13394 raft_consensus.cc:993] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040: : Instructing follower 3c52e0825c02476e89d84da9bb849f5d to start an election
I20260709 12:25:17.145361 13344 raft_consensus.cc:1081] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 10 LEADER]: Signalling peer 3c52e0825c02476e89d84da9bb849f5d to start an election
I20260709 12:25:17.153286 11624 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150"
dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
 from {username='slave'} at 127.0.0.1:45890
I20260709 12:25:17.153909 11624 raft_consensus.cc:493] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:17.154243 11624 raft_consensus.cc:3060] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:17.157290 10848 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:56394
I20260709 12:25:17.158208 10848 raft_consensus.cc:493] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:17.158654 10848 raft_consensus.cc:3060] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:17.178449 11624 raft_consensus.cc:515] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:25:17.186764 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 46516.3us
I20260709 12:25:17.204531 10848 raft_consensus.cc:515] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:17.225499 11624 leader_election.cc:290] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 11 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:17.226691 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:17.227370 11002 raft_consensus.cc:3060] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:17.231436 10848 leader_election.cc:290] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:17.232803 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:17.233510 10996 raft_consensus.cc:3060] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:17.276296 10996 raft_consensus.cc:2468] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 6.
I20260709 12:25:17.277233 11001 raft_consensus.cc:1240] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:17.275239 10752 catalog_manager.cc:5697] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 6 to 7, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 7 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:17.280627 10751 catalog_manager.cc:5697] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 4 to 5, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 5 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:17.285728 13375 consensus_queue.cc:1059] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:25:17.285722 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:17.287343 10853 raft_consensus.cc:3055] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:17.287834 10853 raft_consensus.cc:740] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:17.288717 10853 consensus_queue.cc:260] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:17.290009 10853 raft_consensus.cc:3060] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:17.290777 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:17.286862 13375 raft_consensus.cc:3055] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:17.292241 13375 raft_consensus.cc:740] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:17.292898 11002 raft_consensus.cc:2468] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 11.
I20260709 12:25:17.287302 10923 consensus_queue.cc:237] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:17.294368 11589 leader_election.cc:304] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:25:17.295337 13398 raft_consensus.cc:2804] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:17.295533 10820 leader_election.cc:304] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:25:17.296043 13398 raft_consensus.cc:697] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [term 11 LEADER]: Becoming Leader. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
I20260709 12:25:17.296624 13394 raft_consensus.cc:2804] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:17.297116 13394 raft_consensus.cc:697] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 6 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:17.296932 13398 consensus_queue.cc:237] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:17.298118 13394 consensus_queue.cc:237] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:17.302709 13375 consensus_queue.cc:260] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:17.305194 10853 raft_consensus.cc:2468] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 11.
I20260709 12:25:17.312747 13375 raft_consensus.cc:3060] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:17.391340 10848 raft_consensus.cc:1275] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:25:17.419073 13239 consensus_queue.cc:1048] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
W20260709 12:25:17.477082 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 55561.1us
I20260709 12:25:17.495326 10750 catalog_manager.cc:5697] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: term changed from 10 to 11, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68). New cstate: current_term: 11 leader_uuid: "3c52e0825c02476e89d84da9bb849f5d" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:17.578694 10927 raft_consensus.cc:1275] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:25:17.579751 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 74248.5us
W20260709 12:25:17.602852 10895 consensus_peers.cc:597] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613): Couldn't send request to peer 3c52e0825c02476e89d84da9bb849f5d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 442726a7f1e441248ec80a98b31eb341. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:17.604151 10925 raft_consensus.cc:2468] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 6.
I20260709 12:25:17.680227 11001 raft_consensus.cc:1275] T 442726a7f1e441248ec80a98b31eb341 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:25:17.752362 13353 consensus_queue.cc:1048] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:25:17.762457 10996 raft_consensus.cc:1275] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:25:17.764088 10848 raft_consensus.cc:1275] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:25:17.768601 10848 raft_consensus.cc:1275] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:25:17.778889 11002 raft_consensus.cc:1275] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:25:17.783004 13416 consensus_queue.cc:1048] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:17.785516 10846 raft_consensus.cc:1275] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:25:17.789696 11002 raft_consensus.cc:1275] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:25:17.792394 13411 consensus_queue.cc:1048] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:25:17.796161 10996 raft_consensus.cc:1275] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:25:17.797322 13417 consensus_queue.cc:1048] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:25:17.808948 13417 consensus_queue.cc:1048] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:17.813488 10750 catalog_manager.cc:5697] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 5 to 6, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 6 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:17.824648 13416 consensus_queue.cc:1048] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:25:17.838027 13397 consensus_queue.cc:1048] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:25:17.836957 13409 consensus_queue.cc:1048] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:25:17.853252 10849 raft_consensus.cc:1275] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:25:17.853585 10927 raft_consensus.cc:1275] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:25:17.869861 13409 consensus_queue.cc:1048] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:25:17.896441 13422 ts_tablet_manager.cc:933] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d: Initiating tablet copy from peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:25:17.898782 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 74669.3us
I20260709 12:25:17.945250 13422 tablet_copy_client.cc:323] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Beginning tablet copy session from remote peer at address 127.9.116.66:39339
I20260709 12:25:17.860311 13411 consensus_queue.cc:1048] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 12:25:17.993988 10939 tablet_copy_service.cc:140] P e2d5c637307a407ab688f5ccd6f0fcea: Received BeginTabletCopySession request for tablet 442726a7f1e441248ec80a98b31eb341 from peer 3c52e0825c02476e89d84da9bb849f5d ({username='slave'} at 127.0.0.1:50036)
I20260709 12:25:17.994678 10939 tablet_copy_service.cc:161] P e2d5c637307a407ab688f5ccd6f0fcea: Beginning new tablet copy session on tablet 442726a7f1e441248ec80a98b31eb341 from peer 3c52e0825c02476e89d84da9bb849f5d at {username='slave'} at 127.0.0.1:50036: session id = 3c52e0825c02476e89d84da9bb849f5d-442726a7f1e441248ec80a98b31eb341
I20260709 12:25:18.103971  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:18.169837 10925 raft_consensus.cc:1275] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:25:18.156168 10939 tablet_copy_source_session.cc:215] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:25:18.146186 13402 log.cc:927] Time spent T 00000000000000000000000000000000 P 9619ad7a9e7f4d9b8039487e3ee77243: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 12:25:18.206658 13422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 442726a7f1e441248ec80a98b31eb341. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:18.224663 13418 raft_consensus.cc:2955] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
W20260709 12:25:18.248039 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 293615us
I20260709 12:25:18.271490 10927 raft_consensus.cc:1275] T c63ecfc9bd3945818cfe15c03f001315 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:25:18.273766 10996 raft_consensus.cc:2955] T 442726a7f1e441248ec80a98b31eb341 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:25:18.288926 13372 consensus_queue.cc:1048] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
W20260709 12:25:18.355149 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 50311.4us
W20260709 12:25:18.368063 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 64675.4us
W20260709 12:25:18.391795 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 50236us
I20260709 12:25:18.346056 13267 consensus_queue.cc:1048] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
W20260709 12:25:18.408473 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 59701.5us
I20260709 12:25:18.427676 10846 raft_consensus.cc:2955] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
W20260709 12:25:18.506400 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 86112us
W20260709 12:25:18.511200 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 82141us
I20260709 12:25:18.433851 13438 consensus_queue.cc:1048] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.074s
W20260709 12:25:18.571235 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 59194.8us
W20260709 12:25:18.571951 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 142268us
W20260709 12:25:18.690440 13437 log.cc:927] Time spent T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
W20260709 12:25:18.694311 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 74813.9us
W20260709 12:25:18.701064 13420 log.cc:927] Time spent T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:25:18.766443 10848 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "24c913e527ff46578e084c41eab7bb9d"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
mode: GRACEFUL
new_leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:47358
I20260709 12:25:18.767310 10848 raft_consensus.cc:606] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Received request to transfer leadership to TS edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:25:18.801481 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 96437.6us
W20260709 12:25:18.821487 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 93699.7us
W20260709 12:25:18.843897 13443 log.cc:927] Time spent T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 12:25:18.834126 13422 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:45904 (request call id 187) took 1038 ms. Trace:
I20260709 12:25:18.818341 13418 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:50034 (request call id 5) took 1517 ms. Trace:
I20260709 12:25:18.892998 13418 rpcz_store.cc:276] 0709 12:25:17.283696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:17.285038 (+  1342us) service_pool.cc:224] Handling call
0709 12:25:17.297619 (+ 12581us) log.cc:844] Serialized 499 byte log entry
0709 12:25:18.769909 (+1472290us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13566,"raft.queue_time_us":50442,"raft.run_cpu_time_us":2137,"raft.run_wall_time_us":23638,"thread_start_us":364881,"threads_started":3,"wal-append.queue_time_us":92158,"wal-append.run_cpu_time_us":2231,"wal-append.run_wall_time_us":1051194}
I20260709 12:25:18.892666 13422 rpcz_store.cc:276] 0709 12:25:17.796142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:17.796278 (+   136us) service_pool.cc:224] Handling call
0709 12:25:17.896976 (+100698us) ts_tablet_manager.cc:934] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d: Initiating tablet copy from peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
0709 12:25:18.205007 (+308031us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:25:18.407541 (+202534us) tablet_metadata.cc:665] Metadata flushed
0709 12:25:18.412964 (+  5423us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:25:18.833049 (+420085us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:25:18.833448 (+   399us) tablet_replica.cc:206] Creating consensus instance
0709 12:25:18.833835 (+   387us) ts_tablet_manager.cc:989] Replica registered.
0709 12:25:18.833959 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":435,"tablet-copy.queue_time_us":99266,"thread_start_us":69953,"threads_started":2}
I20260709 12:25:18.905908 13422 tablet_copy_client.cc:806] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 0 data blocks...
I20260709 12:25:18.906744 13422 tablet_copy_client.cc:670] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:25:18.907855 10925 consensus_queue.cc:237] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:18.917207 13422 tablet_copy_client.cc:538] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:25:18.949280 13408 raft_consensus.cc:493] T c63ecfc9bd3945818cfe15c03f001315 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:18.949904 13408 raft_consensus.cc:515] T c63ecfc9bd3945818cfe15c03f001315 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:18.972460 13408 leader_election.cc:290] T c63ecfc9bd3945818cfe15c03f001315 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:19.007889 13378 raft_consensus.cc:493] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:19.008517 13378 raft_consensus.cc:515] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:19.010634 13378 leader_election.cc:290] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:19.020843 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:19.042703 13422 tablet_bootstrap.cc:492] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap starting.
I20260709 12:25:19.053299 10927 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
mode: GRACEFUL
new_leader_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:41546
I20260709 12:25:19.053999 10927 raft_consensus.cc:606] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 4 LEADER]: Received request to transfer leadership to TS 80cd7d227db44f34a6108591dad9c040
W20260709 12:25:19.054311 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 87407.2us
I20260709 12:25:19.059057 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:19.104029 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63ecfc9bd3945818cfe15c03f001315" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:19.108604 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63ecfc9bd3945818cfe15c03f001315" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:19.112522 11003 raft_consensus.cc:1275] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:25:19.130049 10854 raft_consensus.cc:1275] T e3d9a61ecaf84695b70f8519ee57706f P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:25:19.157402 11003 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c72fddfc26044838a71a798f3371636b"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
mode: GRACEFUL
new_leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:32960
W20260709 12:25:19.228293 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 93362.3us
W20260709 12:25:19.241309 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 145199us
I20260709 12:25:19.242525 13392 consensus_queue.cc:1048] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:19.243084 10820 leader_election.cc:304] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:19.245244 13482 raft_consensus.cc:993] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040: : Instructing follower edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:25:19.233844 11003 raft_consensus.cc:606] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 8 LEADER]: Received request to transfer leadership to TS e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:19.268694 13344 raft_consensus.cc:2749] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:19.328645 13448 raft_consensus.cc:493] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:25:19.329512 13448 raft_consensus.cc:515] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:19.360042  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:25:19.362841  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:19.365758  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:19.388990 13436 raft_consensus.cc:1081] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Signalling peer edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:25:19.418108 13408 consensus_queue.cc:1048] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:19.424552 10895 leader_election.cc:304] T c63ecfc9bd3945818cfe15c03f001315 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:19.429453 13448 leader_election.cc:290] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:25:19.461412 13449 raft_consensus.cc:993] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea: : Instructing follower 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:25:19.461992 13449 raft_consensus.cc:1081] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 4 LEADER]: Signalling peer 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:25:19.474790 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:25:19.481688 10895 consensus_peers.cc:597] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613): Couldn't send request to peer 3c52e0825c02476e89d84da9bb849f5d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e3d9a61ecaf84695b70f8519ee57706f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:19.496243 11621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:25:19.512722 10895 leader_election.cc:304] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:19.514757 13484 raft_consensus.cc:2749] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:19.518023 13425 raft_consensus.cc:993] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08: : Instructing follower e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:25:19.518795 13425 raft_consensus.cc:1081] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 8 LEADER]: Signalling peer e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:25:19.523940 10849 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:56394
I20260709 12:25:19.524883 10849 raft_consensus.cc:493] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:19.525455 10849 raft_consensus.cc:3060] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:19.551752 11001 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "24c913e527ff46578e084c41eab7bb9d"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:37512
I20260709 12:25:19.552543 11001 raft_consensus.cc:493] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:19.552945 11001 raft_consensus.cc:3060] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:19.553552 13412 raft_consensus.cc:2749] T c63ecfc9bd3945818cfe15c03f001315 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:25:19.562219 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 44549.6us
I20260709 12:25:19.591717 10925 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c72fddfc26044838a71a798f3371636b"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:59622
I20260709 12:25:19.592368 10925 raft_consensus.cc:493] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:19.592751 10925 raft_consensus.cc:3060] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:19.609658 10849 raft_consensus.cc:515] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:19.610771 10848 raft_consensus.cc:1240] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:19.619836 10849 leader_election.cc:290] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:25:19.638248 10751 catalog_manager.cc:5697] T 442726a7f1e441248ec80a98b31eb341 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: config changed from index -1 to 3, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New cstate: current_term: 2 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:25:19.628878 11001 raft_consensus.cc:515] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:19.649118 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:19.651178 11002 raft_consensus.cc:1240] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:19.650940 13484 consensus_queue.cc:1059] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 12:25:19.673758 10925 raft_consensus.cc:515] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:19.678928 11621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:25:19.679780 11621 raft_consensus.cc:3060] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:19.691134 10923 raft_consensus.cc:3055] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:19.691514 10923 raft_consensus.cc:740] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:19.692989 11001 leader_election.cc:290] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:19.694260 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:19.694862 10848 raft_consensus.cc:3060] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:19.700649 10925 leader_election.cc:290] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:19.703558 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:19.704644 10998 raft_consensus.cc:3055] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:19.705289 10998 raft_consensus.cc:740] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:25:19.714811 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c913e527ff46578e084c41eab7bb9d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:19.717188 10923 consensus_queue.cc:260] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:19.715503 10925 raft_consensus.cc:3060] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:19.687400 13436 consensus_queue.cc:1059] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 12:25:19.724118 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c913e527ff46578e084c41eab7bb9d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:19.718806 10998 consensus_queue.cc:260] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:19.734279 10998 raft_consensus.cc:3060] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:19.737478 10923 raft_consensus.cc:3060] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:19.747932 10848 raft_consensus.cc:2468] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 9.
I20260709 12:25:19.749568 10894 leader_election.cc:304] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
W20260709 12:25:19.763622 10969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:19.763783 13435 raft_consensus.cc:2804] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:19.764460 13435 raft_consensus.cc:697] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 9 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:19.765677 13435 consensus_queue.cc:237] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:19.782392 13416 raft_consensus.cc:2955] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 7 LEADER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:25:19.801748 10853 raft_consensus.cc:3055] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:19.802395 10853 raft_consensus.cc:740] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:19.803282 10853 consensus_queue.cc:260] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:19.820935 10923 raft_consensus.cc:2468] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 5.
W20260709 12:25:19.858982 13492 log.cc:927] Time spent T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 12:25:19.850777 10819 leader_election.cc:304] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
W20260709 12:25:19.865008 13484 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 12:25:19.865909 13478 raft_consensus.cc:2804] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:25:19.866477 13478 raft_consensus.cc:697] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 5 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:19.867326 13478 consensus_queue.cc:237] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:19.889689 11621 raft_consensus.cc:2468] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 5.
I20260709 12:25:19.898052 11003 raft_consensus.cc:2955] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:25:19.908042 10998 raft_consensus.cc:2468] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 9.
I20260709 12:25:19.923333 10853 raft_consensus.cc:3060] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:19.927114 10849 raft_consensus.cc:2955] T e3d9a61ecaf84695b70f8519ee57706f P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:25:20.000227 10853 raft_consensus.cc:2468] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 5.
I20260709 12:25:20.008512 10925 raft_consensus.cc:2468] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 5.
W20260709 12:25:20.013043 13482 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
W20260709 12:25:20.115330 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 44177.5us
W20260709 12:25:20.116441 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 43943.2us
I20260709 12:25:20.165521 13422 tablet_bootstrap.cc:492] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:25:20.166742 13422 tablet_bootstrap.cc:492] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap complete.
I20260709 12:25:20.167622 13422 ts_tablet_manager.cc:1403] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d: Time spent bootstrapping tablet: real 1.125s	user 0.047s	sys 0.036s
W20260709 12:25:20.173434 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 60795.4us
I20260709 12:25:20.230437 10850 consensus_queue.cc:237] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
W20260709 12:25:20.238576 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 172653us
I20260709 12:25:20.241477 10968 leader_election.cc:304] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:25:20.243443 13505 raft_consensus.cc:2804] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:25:20.244103 13505 raft_consensus.cc:697] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 5 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:25:20.245092 13505 consensus_queue.cc:237] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:20.250650 10851 raft_consensus.cc:1275] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:25:20.249432 13422 raft_consensus.cc:359] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [term 2 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:20.252478 13422 raft_consensus.cc:740] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Initialized, Role: LEARNER
I20260709 12:25:20.254690 13422 consensus_queue.cc:260] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:20.258054 13408 consensus_queue.cc:1048] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:20.262635 13422 ts_tablet_manager.cc:1434] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d: Time spent starting tablet: real 0.095s	user 0.008s	sys 0.001s
I20260709 12:25:20.265324 10939 tablet_copy_service.cc:342] P e2d5c637307a407ab688f5ccd6f0fcea: Request end of tablet copy session 3c52e0825c02476e89d84da9bb849f5d-442726a7f1e441248ec80a98b31eb341 received from {username='slave'} at 127.0.0.1:50036
I20260709 12:25:20.266021 10939 tablet_copy_service.cc:434] P e2d5c637307a407ab688f5ccd6f0fcea: ending tablet copy session 3c52e0825c02476e89d84da9bb849f5d-442726a7f1e441248ec80a98b31eb341 on tablet 442726a7f1e441248ec80a98b31eb341 with peer 3c52e0825c02476e89d84da9bb849f5d
I20260709 12:25:20.271236 11001 raft_consensus.cc:1275] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:25:20.287364 13484 consensus_queue.cc:1048] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 12:25:20.307451 13422 ts_tablet_manager.cc:933] T e3d9a61ecaf84695b70f8519ee57706f P 3c52e0825c02476e89d84da9bb849f5d: Initiating tablet copy from peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:20.329216 10923 raft_consensus.cc:1275] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:25:20.333076 13447 consensus_queue.cc:1048] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
W20260709 12:25:20.345836 10820 consensus_peers.cc:597] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 -> Peer 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613): Couldn't send request to peer 3c52e0825c02476e89d84da9bb849f5d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 53b0e2cbee394228af2190d22e7ea9ef. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:20.349506 10995 raft_consensus.cc:1275] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:25:20.377183 13481 consensus_queue.cc:1048] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:25:20.392977 13422 tablet_copy_client.cc:323] T e3d9a61ecaf84695b70f8519ee57706f P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Beginning tablet copy session from remote peer at address 127.9.116.66:39339
I20260709 12:25:20.393421 11623 raft_consensus.cc:1217] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:25:20.400098 10939 tablet_copy_service.cc:140] P e2d5c637307a407ab688f5ccd6f0fcea: Received BeginTabletCopySession request for tablet e3d9a61ecaf84695b70f8519ee57706f from peer 3c52e0825c02476e89d84da9bb849f5d ({username='slave'} at 127.0.0.1:50036)
I20260709 12:25:20.404198 10939 tablet_copy_service.cc:161] P e2d5c637307a407ab688f5ccd6f0fcea: Beginning new tablet copy session on tablet e3d9a61ecaf84695b70f8519ee57706f from peer 3c52e0825c02476e89d84da9bb849f5d at {username='slave'} at 127.0.0.1:50036: session id = 3c52e0825c02476e89d84da9bb849f5d-e3d9a61ecaf84695b70f8519ee57706f
I20260709 12:25:20.401278 11623 raft_consensus.cc:2955] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [term 2 LEARNER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:25:20.428138 10925 raft_consensus.cc:1275] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:25:20.432185 13482 consensus_queue.cc:1048] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:25:20.436681 11621 raft_consensus.cc:1275] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:25:20.438179 13513 log.cc:927] Time spent T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:25:20.460302 13447 consensus_queue.cc:1048] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:20.463932 10751 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60736 (request call id 234) took 1346 ms. Trace:
I20260709 12:25:20.483682 10750 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60730 (request call id 212) took 1130 ms. Trace:
I20260709 12:25:20.484305 10750 rpcz_store.cc:276] 0709 12:25:19.353896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:19.354108 (+   212us) service_pool.cc:224] Handling call
0709 12:25:20.483577 (+1129469us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":91382,"reported_tablets":7}
I20260709 12:25:20.472571 10751 rpcz_store.cc:276] 0709 12:25:19.117306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:19.117533 (+   227us) service_pool.cc:224] Handling call
0709 12:25:20.463854 (+1346321us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:19.980092 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:19.980800 (+   708us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:19.980843 (+    43us) write_op.cc:435] Acquired schema lock
0709 12:25:19.980861 (+    18us) tablet.cc:662] Decoding operations
0709 12:25:19.981254 (+   393us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:19.981340 (+    86us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:19.981376 (+    36us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:25:19.981583 (+   207us) tablet.cc:701] Row locks acquired
0709 12:25:19.981599 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:25:19.981769 (+   170us) write_op.cc:270] Start()
0709 12:25:19.981920 (+   151us) write_op.cc:276] Timestamp: P: 1783599919981708 usec, L: 0
0709 12:25:19.981951 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 12:25:19.982953 (+  1002us) log.cc:844] Serialized 595 byte log entry
0709 12:25:20.200765 (+217812us) spinlock_profiling.cc:243] Waited 8.91 ms on lock 0x7b4400022b4c. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7591c23db1 00007f7591cc1c85 00007f7591cc26a2 00007f7594a341db 00007f7594a2faaf 00007f7591d7e0ac 00007f759abd89a9 00007f7591d9a69b 00007f7591d9893f 00007f7591d9ac02 00007f7594a2220b
0709 12:25:20.332501 (+131736us) op_driver.cc:464] REPLICATION: finished
0709 12:25:20.432285 (+ 99784us) write_op.cc:301] APPLY: starting
0709 12:25:20.432382 (+    97us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:20.432493 (+   111us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:20.432520 (+    27us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:20.432774 (+   254us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:20.432967 (+   193us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:25:20.433017 (+    50us) write_op.cc:312] APPLY: finished
0709 12:25:20.433198 (+   181us) log.cc:844] Serialized 23 byte log entry
0709 12:25:20.433363 (+   165us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:20.433447 (+    84us) write_op.cc:454] Released schema lock
0709 12:25:20.433485 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:20.433840 (+   355us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:20.433868 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":110084,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":99538,"apply.run_cpu_time_us":1543,"apply.run_wall_time_us":1549,"num_ops":1,"prepare.queue_time_us":324784,"prepare.run_cpu_time_us":19256,"prepare.run_wall_time_us":256777,"raft.queue_time_us":81205,"raft.run_cpu_time_us":8719,"raft.run_wall_time_us":90993,"replication_time_us":350424,"spinlock_wait_cycles":20494592,"thread_start_us":626447,"threads_started":4,"wal-append.queue_time_us":266286}]]}
W20260709 12:25:20.541061 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 50220.3us
I20260709 12:25:20.601778 10939 tablet_copy_source_session.cc:215] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:25:20.636535 13422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3d9a61ecaf84695b70f8519ee57706f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:25:20.642144 13518 log.cc:927] Time spent T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:25:20.649297 13478 raft_consensus.cc:2955] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 6 LEADER]: Committing config change with OpId 6.5: config changed from index -1 to 5, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:25:20.690706 10851 raft_consensus.cc:1275] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:25:20.691377 10998 raft_consensus.cc:2955] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Committing config change with OpId 6.5: config changed from index -1 to 5, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:25:20.707458 13229 consensus_queue.cc:1048] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 12:25:20.729396  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:25:20.778486 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 70204.8us
I20260709 12:25:20.795209 10922 raft_consensus.cc:2955] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Committing config change with OpId 6.5: config changed from index -1 to 5, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
W20260709 12:25:20.851986 13522 log.cc:927] Time spent T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 12:25:20.881758 10750 catalog_manager.cc:5697] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: term changed from 4 to 5, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 5 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:20.882681 10998 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
mode: GRACEFUL
new_leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:32960
I20260709 12:25:20.883432 10998 raft_consensus.cc:606] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 4 LEADER]: Received request to transfer leadership to TS e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:20.889698 10751 catalog_manager.cc:5697] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 8 to 9, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 9 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } }
W20260709 12:25:20.897205 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 114461us
I20260709 12:25:20.895893 10751 catalog_manager.cc:5697] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: config changed from index -1 to 6, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New cstate: current_term: 7 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:25:20.900179 10751 catalog_manager.cc:5697] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 4 to 5, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 5 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
W20260709 12:25:20.919517 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 72914.8us
I20260709 12:25:20.911343 13422 tablet_copy_client.cc:806] T e3d9a61ecaf84695b70f8519ee57706f P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 0 data blocks...
W20260709 12:25:20.930145 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 55465.6us
I20260709 12:25:20.943027 10851 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
mode: GRACEFUL
new_leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:47358
I20260709 12:25:20.943941 10851 raft_consensus.cc:606] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 6 LEADER]: Received request to transfer leadership to TS edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:20.965154 11001 consensus_queue.cc:237] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:20.963344 13422 tablet_copy_client.cc:670] T e3d9a61ecaf84695b70f8519ee57706f P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:25:21.035050 13529 ts_tablet_manager.cc:933] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d: Initiating tablet copy from peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265)
I20260709 12:25:21.026301 13448 raft_consensus.cc:1064] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea: attempting to promote NON_VOTER 3c52e0825c02476e89d84da9bb849f5d to VOTER
W20260709 12:25:21.082054 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 91570us
W20260709 12:25:21.084432 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 118949us
I20260709 12:25:21.097886 10929 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "60dca008c268416c8e63091506d1653e"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
mode: GRACEFUL
new_leader_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:41546
I20260709 12:25:21.100167 10929 raft_consensus.cc:606] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Received request to transfer leadership to TS 80cd7d227db44f34a6108591dad9c040
W20260709 12:25:21.135975 10969 consensus_peers.cc:597] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613): Couldn't send request to peer 3c52e0825c02476e89d84da9bb849f5d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 577c93bfc0d84ec6ad610cad0cf16899. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:21.141038 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 57524.8us
W20260709 12:25:21.145505 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 48636.4us
W20260709 12:25:21.146461 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 55214.2us
W20260709 12:25:21.152125 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 68591.6us
I20260709 12:25:21.142016 13448 consensus_queue.cc:237] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:21.200145 10849 raft_consensus.cc:1275] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:25:21.213102  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:25:21.223155  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:25:21.212651 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 63810us
I20260709 12:25:21.230845 13412 raft_consensus.cc:993] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea: : Instructing follower 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:25:21.231690 13422 tablet_copy_client.cc:538] T e3d9a61ecaf84695b70f8519ee57706f P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:25:21.214370 13529 tablet_copy_client.cc:323] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Beginning tablet copy session from remote peer at address 127.9.116.65:46265
I20260709 12:25:21.243037 13456 consensus_queue.cc:1048] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:21.248556 10864 tablet_copy_service.cc:140] P 80cd7d227db44f34a6108591dad9c040: Received BeginTabletCopySession request for tablet 53b0e2cbee394228af2190d22e7ea9ef from peer 3c52e0825c02476e89d84da9bb849f5d ({username='slave'} at 127.0.0.1:46480)
I20260709 12:25:21.249328 10864 tablet_copy_service.cc:161] P 80cd7d227db44f34a6108591dad9c040: Beginning new tablet copy session on tablet 53b0e2cbee394228af2190d22e7ea9ef from peer 3c52e0825c02476e89d84da9bb849f5d at {username='slave'} at 127.0.0.1:46480: session id = 3c52e0825c02476e89d84da9bb849f5d-53b0e2cbee394228af2190d22e7ea9ef
I20260709 12:25:21.236052 13502 raft_consensus.cc:1081] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Signalling peer 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:25:21.260768 13290 raft_consensus.cc:993] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040: : Instructing follower edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:25:21.263934 10929 raft_consensus.cc:1275] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:25:21.261406 13290 raft_consensus.cc:1081] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 6 LEADER]: Signalling peer edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:25:21.277635 11001 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:37512
I20260709 12:25:21.278697 11001 raft_consensus.cc:493] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:21.279232 11001 raft_consensus.cc:3060] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:21.287137 10922 raft_consensus.cc:1275] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 12:25:21.298064 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 133523us
I20260709 12:25:21.303913 10845 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "60dca008c268416c8e63091506d1653e"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:56394
I20260709 12:25:21.304843 10845 raft_consensus.cc:493] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:21.305286 10845 raft_consensus.cc:3060] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:21.281939 13422 tablet_bootstrap.cc:492] T e3d9a61ecaf84695b70f8519ee57706f P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap starting.
I20260709 12:25:21.319885 11001 raft_consensus.cc:515] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:21.320981 10845 raft_consensus.cc:515] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:21.330122 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:21.330324 10845 leader_election.cc:290] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:21.330782 10929 raft_consensus.cc:3055] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:21.331115 10929 raft_consensus.cc:740] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:21.334005 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:21.334954 11001 leader_election.cc:290] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:21.334663 10845 raft_consensus.cc:3055] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:21.335753 10845 raft_consensus.cc:740] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:21.337123  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:21.333858 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:21.339322 10995 raft_consensus.cc:3060] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:21.335948 10929 consensus_queue.cc:260] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:21.340335 10929 raft_consensus.cc:3060] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:21.348543 10853 raft_consensus.cc:2955] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:25:21.343760 13423 raft_consensus.cc:2955] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 LEADER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:25:21.370303 10848 raft_consensus.cc:1275] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:25:21.376092 13448 consensus_queue.cc:1048] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:25:21.389797 10929 raft_consensus.cc:2468] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 7.
I20260709 12:25:21.390941 10819 leader_election.cc:304] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:25:21.336704 10845 consensus_queue.cc:260] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:21.392206 10845 raft_consensus.cc:3060] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:21.393112 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:21.393733 10929 raft_consensus.cc:3060] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:21.399149 13478 raft_consensus.cc:2804] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:21.399837 13478 raft_consensus.cc:697] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [term 7 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:21.400755 13478 consensus_queue.cc:237] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:21.411167 10929 raft_consensus.cc:2468] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 7.
I20260709 12:25:21.412423 10995 raft_consensus.cc:2468] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 7.
I20260709 12:25:21.417639 10845 raft_consensus.cc:2468] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 7.
I20260709 12:25:21.421737 10864 tablet_copy_source_session.cc:215] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:25:21.432331 11623 raft_consensus.cc:1275] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [term 2 LEARNER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:25:21.442471 11000 raft_consensus.cc:1275] T 442726a7f1e441248ec80a98b31eb341 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:25:21.462656 13529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53b0e2cbee394228af2190d22e7ea9ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:21.458384 13505 consensus_queue.cc:1048] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 12:25:21.460765 13504 consensus_queue.cc:1048] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:25:21.481139 13408 consensus_queue.cc:1048] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 12:25:21.520641 10968 leader_election.cc:304] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:25:21.536842 13504 raft_consensus.cc:993] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08: : Instructing follower e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:25:21.537213 13470 raft_consensus.cc:2804] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:21.537432 13504 raft_consensus.cc:1081] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 4 LEADER]: Signalling peer e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:25:21.537861 13470 raft_consensus.cc:697] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [term 7 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:25:21.538808 13470 consensus_queue.cc:237] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
W20260709 12:25:21.599308 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 59322.5us
W20260709 12:25:21.619906 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 137866us
I20260709 12:25:21.630698 10751 catalog_manager.cc:5697] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 reported cstate change: config changed from index -1 to 6, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New cstate: current_term: 7 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:25:21.656433 13500 consensus_queue.cc:1048] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:25:21.665874 10751 catalog_manager.cc:5697] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 reported cstate change: config changed from index -1 to 5, term changed from 6 to 7, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to <none>, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New cstate: current_term: 7 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:25:21.668154 10751 catalog_manager.cc:5697] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 6 to 7, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 7 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:21.675900 10921 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:59622
I20260709 12:25:21.676745 10921 raft_consensus.cc:493] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:21.677112 10921 raft_consensus.cc:3060] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:21.680287 13448 raft_consensus.cc:2955] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:21.700035 10921 raft_consensus.cc:515] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:21.712455 10921 leader_election.cc:290] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 election: Requested vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:25:21.717916 10845 raft_consensus.cc:2955] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:21.740415 10921 raft_consensus.cc:1240] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:21.786195 13529 tablet_copy_client.cc:806] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 0 data blocks...
I20260709 12:25:21.787324 11621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:25:21.787958 11621 raft_consensus.cc:3060] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:21.798894 13529 tablet_copy_client.cc:670] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:25:21.930081 10922 raft_consensus.cc:2955] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:25:21.994074 11622 raft_consensus.cc:2955] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:21.999495 11621 raft_consensus.cc:2468] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 5.
W20260709 12:25:22.000418 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.StartTabletCopy -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 213749us
I20260709 12:25:22.004699 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:22.008592 11000 raft_consensus.cc:3055] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:22.009012 11000 raft_consensus.cc:740] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:25:22.012259 11000 consensus_queue.cc:260] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:22.026367 11000 raft_consensus.cc:3060] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:25:22.013247 13549 log.cc:927] Time spent T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 12:25:22.193485 13553 ts_tablet_manager.cc:933] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d: Initiating tablet copy from peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:22.316286 10995 raft_consensus.cc:1275] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:25:22.319923 13553 tablet_copy_client.cc:323] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Beginning tablet copy session from remote peer at address 127.9.116.67:39945
I20260709 12:25:22.366060 11000 raft_consensus.cc:2468] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 5.
W20260709 12:25:22.426250 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 168327us
W20260709 12:25:22.427690 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 83959.7us
I20260709 12:25:22.438792 13422 tablet_bootstrap.cc:492] T e3d9a61ecaf84695b70f8519ee57706f P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:22.440410 13422 tablet_bootstrap.cc:492] T e3d9a61ecaf84695b70f8519ee57706f P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap complete.
I20260709 12:25:22.440747 10895 leader_election.cc:304] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:25:22.441468 13422 ts_tablet_manager.cc:1403] T e3d9a61ecaf84695b70f8519ee57706f P 3c52e0825c02476e89d84da9bb849f5d: Time spent bootstrapping tablet: real 1.160s	user 0.039s	sys 0.041s
I20260709 12:25:22.451786 10929 raft_consensus.cc:1275] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:25:22.457146 13524 raft_consensus.cc:2804] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:25:22.457985 13524 raft_consensus.cc:697] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 5 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:22.459218 13524 consensus_queue.cc:237] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:25:22.486181 10969 consensus_peers.cc:597] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613): Couldn't send request to peer 3c52e0825c02476e89d84da9bb849f5d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:22.488399 11013 tablet_copy_service.cc:140] P edcc56ddd3264984b4da6c1db59e7f08: Received BeginTabletCopySession request for tablet 577c93bfc0d84ec6ad610cad0cf16899 from peer 3c52e0825c02476e89d84da9bb849f5d ({username='slave'} at 127.0.0.1:57514)
I20260709 12:25:22.489070 11013 tablet_copy_service.cc:161] P edcc56ddd3264984b4da6c1db59e7f08: Beginning new tablet copy session on tablet 577c93bfc0d84ec6ad610cad0cf16899 from peer 3c52e0825c02476e89d84da9bb849f5d at {username='slave'} at 127.0.0.1:57514: session id = 3c52e0825c02476e89d84da9bb849f5d-577c93bfc0d84ec6ad610cad0cf16899
I20260709 12:25:22.490466 10849 raft_consensus.cc:1275] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:25:22.559692 13422 raft_consensus.cc:359] T e3d9a61ecaf84695b70f8519ee57706f P 3c52e0825c02476e89d84da9bb849f5d [term 7 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:22.561571 13422 raft_consensus.cc:740] T e3d9a61ecaf84695b70f8519ee57706f P 3c52e0825c02476e89d84da9bb849f5d [term 7 LEARNER]: Becoming Follower/Learner. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Initialized, Role: LEARNER
I20260709 12:25:22.562714 13422 consensus_queue.cc:260] T e3d9a61ecaf84695b70f8519ee57706f P 3c52e0825c02476e89d84da9bb849f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:22.569690 11013 tablet_copy_source_session.cc:215] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:25:22.603690 13422 ts_tablet_manager.cc:1434] T e3d9a61ecaf84695b70f8519ee57706f P 3c52e0825c02476e89d84da9bb849f5d: Time spent starting tablet: real 0.161s	user 0.022s	sys 0.002s
I20260709 12:25:22.606467 10939 tablet_copy_service.cc:342] P e2d5c637307a407ab688f5ccd6f0fcea: Request end of tablet copy session 3c52e0825c02476e89d84da9bb849f5d-e3d9a61ecaf84695b70f8519ee57706f received from {username='slave'} at 127.0.0.1:50036
I20260709 12:25:22.607023 10939 tablet_copy_service.cc:434] P e2d5c637307a407ab688f5ccd6f0fcea: ending tablet copy session 3c52e0825c02476e89d84da9bb849f5d-e3d9a61ecaf84695b70f8519ee57706f on tablet e3d9a61ecaf84695b70f8519ee57706f with peer 3c52e0825c02476e89d84da9bb849f5d
I20260709 12:25:22.616154 13564 consensus_queue.cc:1048] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:22.616609 10995 raft_consensus.cc:2955] T 442726a7f1e441248ec80a98b31eb341 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:22.627063 13553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 577c93bfc0d84ec6ad610cad0cf16899. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:22.654392 13553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:45920 (request call id 154) took 1104 ms. Trace:
I20260709 12:25:22.654950 13553 rpcz_store.cc:276] 0709 12:25:21.549869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:21.550052 (+   183us) service_pool.cc:224] Handling call
0709 12:25:22.194043 (+643991us) ts_tablet_manager.cc:934] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d: Initiating tablet copy from peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
0709 12:25:22.625817 (+431774us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:25:22.644225 (+ 18408us) tablet_metadata.cc:665] Metadata flushed
0709 12:25:22.644373 (+   148us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:25:22.651989 (+  7616us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:25:22.652285 (+   296us) tablet_replica.cc:206] Creating consensus instance
0709 12:25:22.654176 (+  1891us) ts_tablet_manager.cc:989] Replica registered.
0709 12:25:22.654257 (+    81us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":51573,"tablet-copy.queue_time_us":569532,"thread_start_us":246816,"threads_started":2}
I20260709 12:25:22.689836 13550 consensus_queue.cc:1048] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:22.697570 13553 tablet_copy_client.cc:806] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 0 data blocks...
I20260709 12:25:22.698501 13553 tablet_copy_client.cc:670] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:25:22.703193 13529 tablet_copy_client.cc:538] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:25:22.704212 10921 raft_consensus.cc:1275] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:25:22.716295 10751 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60730 (request call id 214) took 1125 ms. Trace:
I20260709 12:25:22.726378 10752 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60734 (request call id 218) took 1061 ms. Trace:
I20260709 12:25:22.726403 13447 consensus_queue.cc:1048] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:22.728595 10752 rpcz_store.cc:276] 0709 12:25:21.664896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:21.676548 (+ 11652us) service_pool.cc:224] Handling call
0709 12:25:21.787433 (+110885us) spinlock_profiling.cc:243] Waited 7.07 ms on lock 0x7b5400002210. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7591c23db1 00007f7591d64640 00007f759ac3b846 00007f759ad4590e 00007f75992062a4 00007f7599206232 00007f7599206161 00007f75992060dc 00007f7599205392 00007f75931c348c 00007f75931c28c6
0709 12:25:22.726290 (+938857us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":3,"spinlock_wait_cycles":16255744}
I20260709 12:25:22.731628 13553 tablet_copy_client.cc:538] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:25:22.716885 10751 rpcz_store.cc:276] 0709 12:25:21.590400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:21.595509 (+  5109us) service_pool.cc:224] Handling call
0709 12:25:22.716199 (+1120690us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:22.332962 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:22.333687 (+   725us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:22.333727 (+    40us) write_op.cc:435] Acquired schema lock
0709 12:25:22.333739 (+    12us) tablet.cc:662] Decoding operations
0709 12:25:22.334310 (+   571us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:22.334371 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:22.334398 (+    27us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:25:22.334703 (+   305us) tablet.cc:701] Row locks acquired
0709 12:25:22.334720 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:25:22.334872 (+   152us) write_op.cc:270] Start()
0709 12:25:22.334999 (+   127us) write_op.cc:276] Timestamp: P: 1783599922334822 usec, L: 0
0709 12:25:22.335016 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 12:25:22.416665 (+ 81649us) log.cc:844] Serialized 1388 byte log entry
0709 12:25:22.560159 (+143494us) op_driver.cc:464] REPLICATION: finished
0709 12:25:22.671162 (+111003us) write_op.cc:301] APPLY: starting
0709 12:25:22.671248 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:22.671402 (+   154us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:22.671532 (+   130us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:22.699050 (+ 27518us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:22.699294 (+   244us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:25:22.699336 (+    42us) write_op.cc:312] APPLY: finished
0709 12:25:22.705927 (+  6591us) log.cc:844] Serialized 35 byte log entry
0709 12:25:22.708754 (+  2827us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:22.708859 (+   105us) write_op.cc:454] Released schema lock
0709 12:25:22.708908 (+    49us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":110739,"apply.run_cpu_time_us":5655,"apply.run_wall_time_us":48677,"num_ops":3,"prepare.queue_time_us":404298,"prepare.run_cpu_time_us":3844,"prepare.run_wall_time_us":84072,"replication_time_us":224962,"thread_start_us":403199,"threads_started":2}]]}
I20260709 12:25:22.729285 10750 catalog_manager.cc:5697] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: config changed from index 3 to 4, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:22.726992 10749 catalog_manager.cc:5697] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: leader changed from <none> to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 7 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:22.793622 13576 consensus_queue.cc:1048] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:22.863656 13529 tablet_bootstrap.cc:492] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap starting.
I20260709 12:25:22.911826 11622 raft_consensus.cc:1217] T e3d9a61ecaf84695b70f8519ee57706f P 3c52e0825c02476e89d84da9bb849f5d [term 7 LEARNER]: Deduplicated request from leader. Original: 7.5->[7.6-7.6]   Dedup: 7.6->[]
I20260709 12:25:22.925976 13553 tablet_bootstrap.cc:492] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap starting.
I20260709 12:25:23.012398 11002 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:37496
I20260709 12:25:23.013252 11002 raft_consensus.cc:606] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [term 7 LEADER]: Received request to transfer leadership
I20260709 12:25:23.012455 10749 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60736 (request call id 236) took 1363 ms. Trace:
I20260709 12:25:23.014658 10749 rpcz_store.cc:276] 0709 12:25:21.648929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:21.649093 (+   164us) service_pool.cc:224] Handling call
0709 12:25:23.012384 (+1363291us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:22.799873 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:22.800412 (+   539us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:22.800461 (+    49us) write_op.cc:435] Acquired schema lock
0709 12:25:22.800476 (+    15us) tablet.cc:662] Decoding operations
0709 12:25:22.801132 (+   656us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:22.801174 (+    42us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:22.801203 (+    29us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:25:22.836571 (+ 35368us) tablet.cc:701] Row locks acquired
0709 12:25:22.839703 (+  3132us) write_op.cc:260] PREPARE: finished
0709 12:25:22.855830 (+ 16127us) write_op.cc:270] Start()
0709 12:25:22.865076 (+  9246us) write_op.cc:276] Timestamp: P: 1783599922852910 usec, L: 0
0709 12:25:22.865107 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 12:25:22.906097 (+ 40990us) log.cc:844] Serialized 595 byte log entry
0709 12:25:22.954773 (+ 48676us) spinlock_profiling.cc:243] Waited 5.59 ms on lock 0x7b540007b554. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e83e28 00007f75988be581 00007f75988bdd58 00007f75988c29f1 00007f75988c29a9 00007f75988c2939 00007f75988c2901 00007f75988c1b2d 0000000000388634 0000000000388479
0709 12:25:22.963642 (+  8869us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b180030b9e0. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f759ac63ab1 00007f759ac70281 00007f75988bf41d 00007f75988c171a 00007f75988c16a8 00007f75988c1628 00007f75988c15e3 00007f75988c07fc 00007f759acf32f6 00007f759acedaa8 00007f7594e94310
0709 12:25:22.964263 (+   621us) op_driver.cc:464] REPLICATION: finished
0709 12:25:22.970290 (+  6027us) write_op.cc:301] APPLY: starting
0709 12:25:22.972373 (+  2083us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:22.974234 (+  1861us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:22.974266 (+    32us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:22.977694 (+  3428us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:22.980240 (+  2546us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:25:22.980288 (+    48us) write_op.cc:312] APPLY: finished
0709 12:25:22.980486 (+   198us) log.cc:844] Serialized 23 byte log entry
0709 12:25:22.980665 (+   179us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:22.980753 (+    88us) write_op.cc:454] Released schema lock
0709 12:25:22.980792 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:22.981117 (+   325us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:22.981151 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6221,"reported_tablets":3,"spinlock_wait_cycles":61184,"child_traces":[["op",{"apply.queue_time_us":2508,"apply.run_cpu_time_us":2226,"apply.run_wall_time_us":11753,"num_ops":1,"prepare.queue_time_us":14320,"prepare.run_cpu_time_us":6322,"prepare.run_wall_time_us":155095,"replication_time_us":49914,"spinlock_wait_cycles":43200640}]]}
I20260709 12:25:23.037410 10752 catalog_manager.cc:5697] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 4 to 5, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 5 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:23.047233 11001 raft_consensus.cc:1275] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:25:23.048760 13570 consensus_queue.cc:1048] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:25:23.133666 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 56974.3us
W20260709 12:25:23.157570 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 80126.4us
I20260709 12:25:23.163888 10995 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:37496
I20260709 12:25:23.164515 10995 raft_consensus.cc:606] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [term 7 LEADER]: Received request to transfer leadership
W20260709 12:25:23.231360 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 62257us
W20260709 12:25:23.265878 10894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:23.466535 10929 consensus_queue.cc:237] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:25:23.478025 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 322770us
I20260709 12:25:23.479100 13553 tablet_bootstrap.cc:700] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d: Time spent opening tablet: real 0.289s	user 0.009s	sys 0.012s
W20260709 12:25:23.482609 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 149277us
I20260709 12:25:23.484078 11621 raft_consensus.cc:1275] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:25:23.561722 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 53934.9us
W20260709 12:25:23.660127 10739 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 53b0e2cbee394228af2190d22e7ea9ef already in progress
I20260709 12:25:23.701364  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:25:23.738933 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 147723us
W20260709 12:25:23.744575 10739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 84521.9us
W20260709 12:25:23.855347 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 50276us
I20260709 12:25:23.760906 13448 consensus_queue.cc:1048] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 12:25:23.912467 13456 raft_consensus.cc:993] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08: : Instructing follower 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:25:23.915495 10851 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "60dca008c268416c8e63091506d1653e"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
mode: GRACEFUL
new_leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:47358
I20260709 12:25:23.913367 13456 raft_consensus.cc:1081] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [term 7 LEADER]: Signalling peer 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:25:23.937798 10851 raft_consensus.cc:606] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [term 7 LEADER]: Received request to transfer leadership to TS edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:23.943732 11622 raft_consensus.cc:1275] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [term 2 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:25:24.035705 13529 tablet_bootstrap.cc:492] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:24.037436 13529 tablet_bootstrap.cc:492] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap complete.
I20260709 12:25:24.046705 10925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "69fd8fdac2fa449e9e184f3d668ea1a7"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
mode: GRACEFUL
new_leader_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:41546
I20260709 12:25:24.047516 10925 raft_consensus.cc:606] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 LEADER]: Received request to transfer leadership to TS 80cd7d227db44f34a6108591dad9c040
I20260709 12:25:24.071676 10925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
mode: GRACEFUL
new_leader_uuid: "3c52e0825c02476e89d84da9bb849f5d"
 from {username='slave'} at 127.0.0.1:41546
I20260709 12:25:24.072420 10925 raft_consensus.cc:606] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 LEADER]: Received request to transfer leadership to TS 3c52e0825c02476e89d84da9bb849f5d
I20260709 12:25:24.076712 10848 raft_consensus.cc:1275] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:25:24.098874 10848 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:56388
I20260709 12:25:24.099706 10848 raft_consensus.cc:493] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:24.100131 10848 raft_consensus.cc:3060] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:24.074286 13529 ts_tablet_manager.cc:1403] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d: Time spent bootstrapping tablet: real 1.226s	user 0.044s	sys 0.017s
I20260709 12:25:24.113359 10995 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:37496
I20260709 12:25:24.121593 10995 raft_consensus.cc:606] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [term 7 LEADER]: Received request to transfer leadership
I20260709 12:25:24.114557 10848 raft_consensus.cc:515] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
W20260709 12:25:24.163414 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 46582.6us
I20260709 12:25:24.108737 13622 raft_consensus.cc:993] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040: : Instructing follower edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:25:24.118216 13621 consensus_queue.cc:1048] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
W20260709 12:25:24.176105 13591 log.cc:927] Time spent T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 12:25:24.192662 13611 raft_consensus.cc:1081] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [term 7 LEADER]: Signalling peer edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:25:24.207891 13505 raft_consensus.cc:493] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:25:24.248911 13606 raft_consensus.cc:993] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea: : Instructing follower 3c52e0825c02476e89d84da9bb849f5d to start an election
I20260709 12:25:24.249646 13545 raft_consensus.cc:1081] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 LEADER]: Signalling peer 3c52e0825c02476e89d84da9bb849f5d to start an election
I20260709 12:25:24.265277 13531 raft_consensus.cc:493] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:25:24.270087 13551 raft_consensus.cc:993] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea: : Instructing follower 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:25:24.269680 13531 raft_consensus.cc:515] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:24.270586 13551 raft_consensus.cc:1081] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 LEADER]: Signalling peer 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:25:24.276415 11623 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04"
dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
 from {username='slave'} at 127.0.0.1:45904
I20260709 12:25:24.277170 11623 raft_consensus.cc:493] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:24.277623 11623 raft_consensus.cc:3060] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:24.304567 13602 raft_consensus.cc:493] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:25:24.305202 13602 raft_consensus.cc:515] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:24.260149 13505 raft_consensus.cc:515] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:24.314288 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:24.315527 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:24.317140 10998 raft_consensus.cc:3055] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:24.317854 10998 raft_consensus.cc:740] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:25:24.320784 10998 consensus_queue.cc:260] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:24.322146 10998 raft_consensus.cc:3060] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:25:24.325193 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 66269.2us
W20260709 12:25:24.330238 10969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 292812us
I20260709 12:25:24.340200 11623 raft_consensus.cc:515] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:24.307399 13602 leader_election.cc:290] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:24.302762 13529 raft_consensus.cc:359] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d [term 7 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:24.347635 13505 leader_election.cc:290] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:24.356850 13531 leader_election.cc:290] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:24.358646 10848 leader_election.cc:290] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:24.426177 13529 raft_consensus.cc:740] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d [term 7 LEARNER]: Becoming Follower/Learner. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Initialized, Role: LEARNER
I20260709 12:25:24.387596 10996 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
mode: GRACEFUL
new_leader_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:32960
I20260709 12:25:24.428301 10996 raft_consensus.cc:606] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 3 LEADER]: Received request to transfer leadership to TS 80cd7d227db44f34a6108591dad9c040
I20260709 12:25:24.427241 13529 consensus_queue.cc:260] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:24.386361 11623 leader_election.cc:290] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 8 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:24.394063 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:24.438427 10995 raft_consensus.cc:3060] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:24.394886 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:25:24.396397 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 79181.7us
I20260709 12:25:24.404402 13606 raft_consensus.cc:1064] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea: attempting to promote NON_VOTER 3c52e0825c02476e89d84da9bb849f5d to VOTER
W20260709 12:25:24.411026 10969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:24.449352 10996 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
mode: GRACEFUL
new_leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:32960
I20260709 12:25:24.450253 10996 raft_consensus.cc:606] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 LEADER]: Received request to transfer leadership to TS e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:24.452116  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:25:24.454782  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:24.448269 13606 consensus_queue.cc:237] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 4, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:24.466156 11001 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "60dca008c268416c8e63091506d1653e"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:37512
I20260709 12:25:24.485872 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:24.478572 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:24.454950 10995 raft_consensus.cc:2468] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 8.
I20260709 12:25:24.493526  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:24.493778 11001 raft_consensus.cc:493] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:24.494210 11001 raft_consensus.cc:3060] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:25:24.456928 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 45686us
I20260709 12:25:24.496088 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:24.496788 10924 raft_consensus.cc:3060] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:24.437659 13529 ts_tablet_manager.cc:1434] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d: Time spent starting tablet: real 0.297s	user 0.008s	sys 0.002s
W20260709 12:25:24.504104 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 281451us
W20260709 12:25:24.504937 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 353865us
I20260709 12:25:24.509471 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:24.514714 11001 raft_consensus.cc:515] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:24.523078 10998 raft_consensus.cc:2468] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 8.
I20260709 12:25:24.524971 11001 leader_election.cc:290] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:24.526207 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:24.544963 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:24.545974 10925 raft_consensus.cc:3055] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:24.546383 10925 raft_consensus.cc:740] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:24.567790 10925 consensus_queue.cc:260] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:24.569140 10925 raft_consensus.cc:3060] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:25:24.604075 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 68730us
I20260709 12:25:24.605458 11588 leader_election.cc:304] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:24.621762 10853 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "69fd8fdac2fa449e9e184f3d668ea1a7"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:56394
I20260709 12:25:24.622253 13639 raft_consensus.cc:2749] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:24.618311 10925 raft_consensus.cc:2468] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 8.
I20260709 12:25:24.529597 13608 consensus_queue.cc:1048] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.092s
I20260709 12:25:24.622536 10853 raft_consensus.cc:493] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:24.632550 10853 raft_consensus.cc:3060] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:24.637769 11589 leader_election.cc:304] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:25:24.638950 13605 raft_consensus.cc:2804] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:24.650508 13605 raft_consensus.cc:697] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [term 8 LEADER]: Becoming Leader. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
I20260709 12:25:24.651443 13605 consensus_queue.cc:237] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:24.653434 10924 raft_consensus.cc:2468] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 8.
I20260709 12:25:24.666491 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:24.674911 10853 raft_consensus.cc:515] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:24.677189 10819 leader_election.cc:304] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:25:24.678223 10853 leader_election.cc:290] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:25:24.669140 10864 tablet_copy_service.cc:342] P 80cd7d227db44f34a6108591dad9c040: Request end of tablet copy session 3c52e0825c02476e89d84da9bb849f5d-53b0e2cbee394228af2190d22e7ea9ef received from {username='slave'} at 127.0.0.1:46480
I20260709 12:25:24.686165 10864 tablet_copy_service.cc:434] P 80cd7d227db44f34a6108591dad9c040: ending tablet copy session 3c52e0825c02476e89d84da9bb849f5d-53b0e2cbee394228af2190d22e7ea9ef on tablet 53b0e2cbee394228af2190d22e7ea9ef with peer 3c52e0825c02476e89d84da9bb849f5d
W20260709 12:25:24.686484 10800 auto_rebalancer.cc:893] Removing replace marker failed: Replica edcc56ddd3264984b4da6c1db59e7f08 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
W20260709 12:25:24.687026 10800 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 53b0e2cbee394228af2190d22e7ea9ef already in progress
W20260709 12:25:24.687333 10800 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 53b0e2cbee394228af2190d22e7ea9ef already in progress
I20260709 12:25:24.696477 13596 raft_consensus.cc:2804] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:24.697506 13596 raft_consensus.cc:697] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 8 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:24.684182 13633 raft_consensus.cc:493] T 442726a7f1e441248ec80a98b31eb341 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:25:24.713174 13633 raft_consensus.cc:515] T 442726a7f1e441248ec80a98b31eb341 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:24.699182 13596 consensus_queue.cc:237] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
W20260709 12:25:24.746450 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 62708.4us
I20260709 12:25:24.753229 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fd8fdac2fa449e9e184f3d668ea1a7" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:25:24.753921 11624 raft_consensus.cc:3060] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:24.765967 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fd8fdac2fa449e9e184f3d668ea1a7" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:24.766644 10927 raft_consensus.cc:3055] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:24.766935 10927 raft_consensus.cc:740] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:24.767634 10927 consensus_queue.cc:260] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:24.769359 10968 leader_election.cc:304] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:24.771162 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:24.771947 10853 raft_consensus.cc:3055] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:24.768726 10927 raft_consensus.cc:3060] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:24.772302 10853 raft_consensus.cc:740] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:24.776502 11623 raft_consensus.cc:1275] T e3d9a61ecaf84695b70f8519ee57706f P 3c52e0825c02476e89d84da9bb849f5d [term 7 LEARNER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:25:24.778226 10853 consensus_queue.cc:260] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:24.779304 10853 raft_consensus.cc:3060] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:24.781080 11001 raft_consensus.cc:1275] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:25:24.786080 10895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:24.793037 10848 raft_consensus.cc:1275] T e3d9a61ecaf84695b70f8519ee57706f P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:25:24.770285 13353 raft_consensus.cc:2749] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:24.801783 11624 raft_consensus.cc:2468] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 5.
I20260709 12:25:24.815442 13526 consensus_queue.cc:1048] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:24.817075 13600 raft_consensus.cc:2955] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:24.819347 13635 consensus_queue.cc:1048] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:25:24.823498 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 45540.8us
I20260709 12:25:24.827026 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:24.827812 10924 raft_consensus.cc:3060] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:24.785501 13614 raft_consensus.cc:493] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:25:24.837037 10927 raft_consensus.cc:2468] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 5.
I20260709 12:25:24.837896 10924 raft_consensus.cc:2468] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 8.
I20260709 12:25:24.848781 10853 raft_consensus.cc:2468] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 8.
I20260709 12:25:24.855859 10968 leader_election.cc:304] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:24.882373 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:24.882823 10968 leader_election.cc:304] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:25:24.861028 13505 raft_consensus.cc:2749] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:24.902387 11623 raft_consensus.cc:2955] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:24.905174 10750 catalog_manager.cc:5697] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: term changed from 7 to 8, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68). New cstate: current_term: 8 leader_uuid: "3c52e0825c02476e89d84da9bb849f5d" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:24.848915 13614 raft_consensus.cc:515] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:24.912213 13625 raft_consensus.cc:2804] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:25:24.948992 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 96243.8us
I20260709 12:25:24.949769 10819 leader_election.cc:304] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:25:24.933228 13603 consensus_queue.cc:1048] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:25:24.965869 13394 raft_consensus.cc:2804] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:25:24.967434 13625 raft_consensus.cc:697] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 8 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:25:24.997846 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:25.014806 13614 leader_election.cc:290] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
W20260709 12:25:25.016001 13642 log.cc:927] Time spent T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d: Append to log took a long time: real 0.145s	user 0.001s	sys 0.001s
I20260709 12:25:25.005075 13394 raft_consensus.cc:697] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 5 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:25.025676 13394 consensus_queue.cc:237] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:25.028614 13633 leader_election.cc:290] T 442726a7f1e441248ec80a98b31eb341 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:25:25.029994 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:25:25.032209 13553 tablet_bootstrap.cc:492] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:25.032662 10969 leader_election.cc:304] T 442726a7f1e441248ec80a98b31eb341 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:25.033231 13505 raft_consensus.cc:993] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08: : Instructing follower e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:25:25.033375 13553 tablet_bootstrap.cc:492] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap complete.
I20260709 12:25:25.054348 13649 raft_consensus.cc:2749] T 442726a7f1e441248ec80a98b31eb341 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:25.055753 13505 raft_consensus.cc:1081] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 LEADER]: Signalling peer e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:25:25.063320 10925 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:59622
I20260709 12:25:25.063971 10925 raft_consensus.cc:493] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:25.064349 10925 raft_consensus.cc:3060] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:25:25.071506 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 50454.5us
I20260709 12:25:25.073979 10925 raft_consensus.cc:515] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:25.078747 10925 leader_election.cc:290] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 election: Requested vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:25:25.089203 13633 raft_consensus.cc:993] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08: : Instructing follower 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:25:25.089762 13633 raft_consensus.cc:1081] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 3 LEADER]: Signalling peer 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:25:25.094199 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:25:25.097002 13553 ts_tablet_manager.cc:1403] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d: Time spent bootstrapping tablet: real 2.171s	user 0.067s	sys 0.047s
I20260709 12:25:25.099615 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:25.100404 10996 raft_consensus.cc:3055] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:25.100744 10996 raft_consensus.cc:740] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:25:25.101133 10925 raft_consensus.cc:1275] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:25:25.107188 13639 consensus_queue.cc:1048] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:25.108686 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: true dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:25:25.109338 11623 raft_consensus.cc:3060] T b289bc89d592435fb63c7fcf580d95a4 P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:25.101784 10996 consensus_queue.cc:260] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:25.112643 10996 raft_consensus.cc:3060] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:25.128042 11623 raft_consensus.cc:2468] T b289bc89d592435fb63c7fcf580d95a4 P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 9.
I20260709 12:25:25.133534 10749 catalog_manager.cc:5697] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 7 to 8, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 8 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:25.142300 10996 raft_consensus.cc:2468] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 9.
I20260709 12:25:25.153149 10895 leader_election.cc:304] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:25:25.115039 13625 consensus_queue.cc:237] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:25.159525 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:25.162477 13613 raft_consensus.cc:2804] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:25.165640 13613 raft_consensus.cc:697] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:25.166600 13613 consensus_queue.cc:237] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:25.173659 13608 raft_consensus.cc:2955] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 7 LEADER]: Committing config change with OpId 7.7: config changed from index 6 to 7, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:25.180656 10850 raft_consensus.cc:2955] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:25.199012 10854 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:56388
I20260709 12:25:25.199802 10854 raft_consensus.cc:493] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:25.200726 10854 raft_consensus.cc:3060] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:25.219265 11001 raft_consensus.cc:1275] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:25:25.217408 10848 raft_consensus.cc:2955] T e3d9a61ecaf84695b70f8519ee57706f P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:25.223932 11623 raft_consensus.cc:3060] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d [term 7 LEARNER]: Advancing to term 8
I20260709 12:25:25.284560 11623 raft_consensus.cc:1275] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d [term 8 LEARNER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:25:25.296320 13553 raft_consensus.cc:359] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d [term 7 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:25.297765 13553 raft_consensus.cc:740] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d [term 7 LEARNER]: Becoming Follower/Learner. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Initialized, Role: LEARNER
I20260709 12:25:25.297425 10854 raft_consensus.cc:515] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:25.253801 13622 consensus_queue.cc:1048] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:25:25.301817 10854 leader_election.cc:290] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 election: Requested vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:25:25.325132 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:25:25.325949 11623 raft_consensus.cc:3060] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:25:25.332325 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 61165.7us
I20260709 12:25:25.324472 13644 consensus_queue.cc:1048] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 12:25:25.344791 11623 raft_consensus.cc:2468] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 4.
I20260709 12:25:25.348495 10995 raft_consensus.cc:1275] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:25:25.298765 13553 consensus_queue.cc:260] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:25.349618 10820 leader_election.cc:304] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040; no voters: 
I20260709 12:25:25.334158 13600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:59610 (request call id 70) took 2167 ms. Trace:
I20260709 12:25:25.362555 13600 rpcz_store.cc:276] 0709 12:25:23.165199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:23.165380 (+   181us) service_pool.cc:224] Handling call
0709 12:25:23.622137 (+456757us) spinlock_profiling.cc:243] Waited 6.49 ms on lock 0x7b2c00000398. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7593781a11 00007f7593790a0a 00007f7593790693 00007f7593790631 00007f7594ec33f1 00007f7594dfc9fe 00007f7594e83749 00007f7594e8476a 00007f7594e8391b 00007f7594e8f03c 00007f7594e8e6b3
0709 12:25:23.625665 (+  3528us) log.cc:844] Serialized 494 byte log entry
0709 12:25:24.086146 (+460481us) spinlock_profiling.cc:243] Waited 22.2 ms on lock 0x7b4c0001ef40. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7593154a20 00007f7593165a29 00007f759316613f 00007f759312a2ab 00007f7593157f3c 00007f75931583fe 00007f75933e550b 00007f7594de4381 00007f7594de226b 00007f7594de8d53 00007f7594de8cd9
0709 12:25:25.332075 (+1245929us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":337,"mutex_wait_us":64117,"raft.queue_time_us":119175,"raft.run_cpu_time_us":5536,"raft.run_wall_time_us":234792,"spinlock_wait_cycles":66034816,"thread_start_us":206462,"threads_started":2,"wal-append.queue_time_us":202770,"wal-append.run_cpu_time_us":1689,"wal-append.run_wall_time_us":1001695}
I20260709 12:25:25.365089 10738 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 442726a7f1e441248ec80a98b31eb341 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:25:25.367110 13553 ts_tablet_manager.cc:1434] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d: Time spent starting tablet: real 0.270s	user 0.010s	sys 0.000s
I20260709 12:25:25.366518 10995 raft_consensus.cc:2955] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:25.367684 13639 consensus_queue.cc:1048] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:25:25.356950 13652 log.cc:927] Time spent T 00000000000000000000000000000000 P 9619ad7a9e7f4d9b8039487e3ee77243: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 12:25:25.382652 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:25.395375 11001 raft_consensus.cc:3055] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:25:25.395834 11001 raft_consensus.cc:740] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:25:25.397804 11001 consensus_queue.cc:260] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:25.417330 11013 tablet_copy_service.cc:342] P edcc56ddd3264984b4da6c1db59e7f08: Request end of tablet copy session 3c52e0825c02476e89d84da9bb849f5d-577c93bfc0d84ec6ad610cad0cf16899 received from {username='slave'} at 127.0.0.1:57514
I20260709 12:25:25.400508 13598 raft_consensus.cc:2804] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:25:25.458686 11001 raft_consensus.cc:3060] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:25.464149 11013 tablet_copy_service.cc:434] P edcc56ddd3264984b4da6c1db59e7f08: ending tablet copy session 3c52e0825c02476e89d84da9bb849f5d-577c93bfc0d84ec6ad610cad0cf16899 on tablet 577c93bfc0d84ec6ad610cad0cf16899 with peer 3c52e0825c02476e89d84da9bb849f5d
I20260709 12:25:25.471232 11623 raft_consensus.cc:2955] T e3d9a61ecaf84695b70f8519ee57706f P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:25.525995 11621 raft_consensus.cc:1217] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d [term 7 LEARNER]: Deduplicated request from leader. Original: 7.5->[7.6-7.6]   Dedup: 7.6->[]
I20260709 12:25:25.543902 11001 raft_consensus.cc:2468] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 4.
I20260709 12:25:25.464728 13598 raft_consensus.cc:697] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:25.585176 13598 consensus_queue.cc:237] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:25:25.595666 13664 log.cc:927] Time spent T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.162s	user 0.004s	sys 0.000s
W20260709 12:25:25.610287 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 269197us
I20260709 12:25:25.611164 10819 leader_election.cc:304] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:25.611977 13622 raft_consensus.cc:2749] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:25.618021 10751 catalog_manager.cc:5697] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 7 to 8, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 8 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
W20260709 12:25:25.646370 13665 log.cc:927] Time spent T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.226s	user 0.000s	sys 0.003s
I20260709 12:25:25.671481 10924 raft_consensus.cc:1275] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:25:25.673278 11001 raft_consensus.cc:1275] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:25:25.685680 10924 raft_consensus.cc:1275] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 12:25:25.687239 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 51971.8us
I20260709 12:25:25.696189  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:25.743882 10927 raft_consensus.cc:1275] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:25:25.747627 11623 raft_consensus.cc:1275] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:25:25.749109 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 54242.4us
I20260709 12:25:25.752678 11623 raft_consensus.cc:1275] T b289bc89d592435fb63c7fcf580d95a4 P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:25:25.748998 13425 consensus_queue.cc:1048] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 12:25:25.758641 13592 consensus_queue.cc:1048] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:25.761631 13660 consensus_queue.cc:1048] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:25.807518 13635 consensus_queue.cc:1048] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 12:25:25.832417 13661 consensus_queue.cc:1048] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 12:25:25.841166 10846 raft_consensus.cc:1275] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:25:25.814352 13660 consensus_queue.cc:1048] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
W20260709 12:25:25.981482 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 44145.6us
I20260709 12:25:26.157054 11622 raft_consensus.cc:1275] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:25:26.177522 10750 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36188 (request call id 108) took 1381 ms. Trace:
I20260709 12:25:26.178381 10750 rpcz_store.cc:276] 0709 12:25:24.796485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:24.796647 (+   162us) service_pool.cc:224] Handling call
0709 12:25:26.177407 (+1380760us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:24.999922 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:25.034213 (+ 34291us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:25.034251 (+    38us) write_op.cc:435] Acquired schema lock
0709 12:25:25.034268 (+    17us) tablet.cc:662] Decoding operations
0709 12:25:25.034968 (+   700us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:25.035026 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:25.035060 (+    34us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:25:25.035240 (+   180us) tablet.cc:701] Row locks acquired
0709 12:25:25.035259 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:25:25.035389 (+   130us) write_op.cc:270] Start()
0709 12:25:25.035520 (+   131us) write_op.cc:276] Timestamp: P: 1783599925035351 usec, L: 0
0709 12:25:25.035551 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 12:25:25.036294 (+   743us) log.cc:844] Serialized 533 byte log entry
0709 12:25:25.773741 (+737447us) spinlock_profiling.cc:243] Waited 8.46 ms on lock 0x7b540007baa0. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e06343 00007f7594e09d75 00007f7594e09d09 00007f7594e09c99 00007f7594e09c61 00007f7594e08f5d 0000000000388634 0000000000388479 00007f7591d9b475 00007f7591d9d7c1
0709 12:25:25.774086 (+   345us) op_driver.cc:464] REPLICATION: finished
0709 12:25:26.155358 (+381272us) write_op.cc:301] APPLY: starting
0709 12:25:26.155469 (+   111us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:26.155630 (+   161us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:26.155664 (+    34us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:26.156250 (+   586us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:26.156594 (+   344us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:25:26.156713 (+   119us) write_op.cc:312] APPLY: finished
0709 12:25:26.157034 (+   321us) log.cc:844] Serialized 23 byte log entry
0709 12:25:26.158248 (+  1214us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:26.158355 (+   107us) write_op.cc:454] Released schema lock
0709 12:25:26.158419 (+    64us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:26.158896 (+   477us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:26.158922 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":380982,"apply.run_cpu_time_us":2631,"apply.run_wall_time_us":3554,"num_ops":1,"prepare.queue_time_us":51043,"prepare.run_cpu_time_us":15833,"prepare.run_wall_time_us":142921,"raft.queue_time_us":482883,"raft.run_cpu_time_us":55248,"raft.run_wall_time_us":264205,"replication_time_us":738396,"spinlock_wait_cycles":19466752,"thread_start_us":446808,"threads_started":4,"wal-append.queue_time_us":153077}]]}
I20260709 12:25:26.183547 10752 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60734 (request call id 223) took 1007 ms. Trace:
I20260709 12:25:26.191066 10752 rpcz_store.cc:276] 0709 12:25:25.176450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:25.176605 (+   155us) service_pool.cc:224] Handling call
0709 12:25:26.183479 (+1006874us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8507,"reported_tablets":1,"spinlock_wait_cycles":219392}
W20260709 12:25:26.192865 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 324941us
I20260709 12:25:26.196835 13625 consensus_queue.cc:1048] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:26.234663 10749 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60730 (request call id 219) took 1146 ms. Trace:
I20260709 12:25:26.219178 13594 consensus_queue.cc:1048] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
W20260709 12:25:26.242274 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 46668.2us
I20260709 12:25:26.235134 10749 rpcz_store.cc:276] 0709 12:25:25.087988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:25.088202 (+   214us) service_pool.cc:224] Handling call
0709 12:25:25.130015 (+ 41813us) spinlock_profiling.cc:243] Waited 35.6 ms on lock 0x7b540007b554. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df2090 00007f7594e90f3a 00007f759ac46e9c 00007f759ad4504e 00007f75992062a4 00007f7599206232 00007f7599206161 00007f75992060dc 00007f7599205392 00007f75931c348c 00007f75931c28c6
0709 12:25:26.234587 (+1104572us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:25.161464 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:25.162083 (+   619us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:25.162118 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:25:25.162131 (+    13us) tablet.cc:662] Decoding operations
0709 12:25:25.162516 (+   385us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:25.162572 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:25.162598 (+    26us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:25:25.162823 (+   225us) tablet.cc:701] Row locks acquired
0709 12:25:25.162841 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:25:25.163001 (+   160us) write_op.cc:270] Start()
0709 12:25:25.163136 (+   135us) write_op.cc:276] Timestamp: P: 1783599925162953 usec, L: 0
0709 12:25:25.163159 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:25:25.163861 (+   702us) log.cc:844] Serialized 595 byte log entry
0709 12:25:25.995954 (+832093us) op_driver.cc:464] REPLICATION: finished
0709 12:25:26.159272 (+163318us) write_op.cc:301] APPLY: starting
0709 12:25:26.159367 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:26.159508 (+   141us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:26.159666 (+   158us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:26.159934 (+   268us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:26.160151 (+   217us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:25:26.160220 (+    69us) write_op.cc:312] APPLY: finished
0709 12:25:26.160456 (+   236us) log.cc:844] Serialized 23 byte log entry
0709 12:25:26.215845 (+ 55389us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:26.215942 (+    97us) write_op.cc:454] Released schema lock
0709 12:25:26.215990 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:26.216505 (+   515us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:26.216574 (+    69us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":81831168,"child_traces":[["op",{"apply.queue_time_us":130873,"apply.run_cpu_time_us":2078,"apply.run_wall_time_us":57189,"num_ops":1,"prepare.queue_time_us":133,"prepare.run_cpu_time_us":2666,"prepare.run_wall_time_us":2666,"replication_time_us":832624,"thread_start_us":159888,"threads_started":1}]]}
I20260709 12:25:26.322280 13689 raft_consensus.cc:1064] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08: attempting to promote NON_VOTER 3c52e0825c02476e89d84da9bb849f5d to VOTER
I20260709 12:25:26.326375 13689 consensus_queue.cc:237] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 4, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:26.414891 10995 raft_consensus.cc:1275] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 12:25:26.408349 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 94318.2us
I20260709 12:25:26.431612 10752 catalog_manager.cc:5697] T b289bc89d592435fb63c7fcf580d95a4 P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: term changed from 8 to 9, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 9 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:26.455781 10752 catalog_manager.cc:5697] T e3d9a61ecaf84695b70f8519ee57706f P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: config changed from index 6 to 7, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New cstate: current_term: 7 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:26.483603 10752 catalog_manager.cc:5697] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: config changed from index 4 to 5, VOTER edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) evicted. New cstate: current_term: 2 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
W20260709 12:25:26.505229 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 57183.8us
I20260709 12:25:26.545928 11624 raft_consensus.cc:1275] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d [term 7 LEARNER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:25:26.487255 10752 catalog_manager.cc:5697] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: term changed from 4 to 5, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 5 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
W20260709 12:25:26.565979 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 55434.9us
I20260709 12:25:26.565516 13625 consensus_queue.cc:1048] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:25:26.581998 13618 raft_consensus.cc:1064] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040: attempting to promote NON_VOTER 3c52e0825c02476e89d84da9bb849f5d to VOTER
I20260709 12:25:26.586004 13618 consensus_queue.cc:237] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:26.622951 10851 raft_consensus.cc:1275] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:25:26.619956 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 74426.1us
W20260709 12:25:26.648700 10818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:26.684130 10992 tablet_service.cc:1558] Processing DeleteTablet for tablet 442726a7f1e441248ec80a98b31eb341 with delete_type TABLET_DATA_TOMBSTONED (TS edcc56ddd3264984b4da6c1db59e7f08 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:37496
I20260709 12:25:26.737105 10924 raft_consensus.cc:1275] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:25:26.783560 13615 consensus_queue.cc:1048] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:26.785187 13290 consensus_queue.cc:1048] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:26.835697 13701 tablet_replica.cc:333] T 442726a7f1e441248ec80a98b31eb341 P edcc56ddd3264984b4da6c1db59e7f08: stopping tablet replica
I20260709 12:25:26.837729 13701 raft_consensus.cc:2243] T 442726a7f1e441248ec80a98b31eb341 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:26.846194 10751 catalog_manager.cc:5697] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: term changed from 3 to 4, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 4 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:26.857515 13470 consensus_queue.cc:1048] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:26.864711 13701 raft_consensus.cc:2272] T 442726a7f1e441248ec80a98b31eb341 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:26.866314 10817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:26.863291 10922 consensus_queue.cc:237] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:26.889077 13701 ts_tablet_manager.cc:1916] T 442726a7f1e441248ec80a98b31eb341 P edcc56ddd3264984b4da6c1db59e7f08: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:25:26.917630 11622 raft_consensus.cc:1275] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d [term 8 LEARNER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:25:26.924074 10995 raft_consensus.cc:1275] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:25:27.020831 13478 consensus_queue.cc:1048] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 12:25:27.023814 13394 consensus_queue.cc:1048] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 12:25:27.143908 10928 raft_consensus.cc:1275] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:25:27.217795 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 76888.9us
I20260709 12:25:27.244581 13701 ts_tablet_manager.cc:1929] T 442726a7f1e441248ec80a98b31eb341 P edcc56ddd3264984b4da6c1db59e7f08: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:25:27.245293 13701 log.cc:1199] T 442726a7f1e441248ec80a98b31eb341 P edcc56ddd3264984b4da6c1db59e7f08: Deleting WAL directory at /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599781984018-9681-0/minicluster-data/ts-2-root/wals/442726a7f1e441248ec80a98b31eb341
I20260709 12:25:27.307822 13693 raft_consensus.cc:493] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:25:27.308620 13693 raft_consensus.cc:515] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
W20260709 12:25:27.310151 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 83650.3us
I20260709 12:25:27.320864 13618 consensus_queue.cc:1048] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:27.326454 10853 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
mode: GRACEFUL
new_leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:47358
I20260709 12:25:27.327247 10853 raft_consensus.cc:606] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 5 LEADER]: Received request to transfer leadership to TS edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:27.338156 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:27.395628 13564 raft_consensus.cc:2955] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 LEADER]: Committing config change with OpId 7.7: config changed from index 6 to 7, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:27.342337 13693 leader_election.cc:290] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:25:27.425873 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 81750.5us
I20260709 12:25:27.452981 13694 raft_consensus.cc:2955] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 8 LEADER]: Committing config change with OpId 8.8: config changed from index 5 to 8, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:27.274992 10739 catalog_manager.cc:5028] TS edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): tablet 442726a7f1e441248ec80a98b31eb341 (table test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]) successfully deleted
I20260709 12:25:27.473443 11623 raft_consensus.cc:1275] T e3d9a61ecaf84695b70f8519ee57706f P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:25:27.504664 10739 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 237612us
I20260709 12:25:27.484831 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:27.489225 11002 raft_consensus.cc:1275] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:25:27.492228 11001 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
mode: GRACEFUL
new_leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:32960
I20260709 12:25:27.510618 11001 raft_consensus.cc:606] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08 [term 4 LEADER]: Received request to transfer leadership to TS e2d5c637307a407ab688f5ccd6f0fcea
W20260709 12:25:27.549512 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 161208us
I20260709 12:25:27.573053 10921 raft_consensus.cc:2955] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 5 to 8, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:27.579751 13526 consensus_queue.cc:1048] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:25:27.656661 11623 raft_consensus.cc:2955] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
W20260709 12:25:27.728753 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 63960.4us
I20260709 12:25:27.747925 10994 raft_consensus.cc:2955] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 5 to 8, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:27.759001 10850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
mode: GRACEFUL
new_leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:47358
I20260709 12:25:27.759824 10850 raft_consensus.cc:606] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 5 LEADER]: Received request to transfer leadership to TS e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:27.770817 11622 raft_consensus.cc:2955] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 5 to 8, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:27.798808 10854 raft_consensus.cc:2955] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
W20260709 12:25:27.820017 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 226867us
I20260709 12:25:27.838470 10850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "60dca008c268416c8e63091506d1653e"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
mode: GRACEFUL
new_leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:47358
I20260709 12:25:27.839233 10850 raft_consensus.cc:606] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Received request to transfer leadership to TS edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:27.840148 10850 raft_consensus.cc:614] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:27.843086 13694 raft_consensus.cc:993] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040: : Instructing follower edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:25:27.843689 13694 raft_consensus.cc:1081] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 5 LEADER]: Signalling peer edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:25:27.846828 10751 catalog_manager.cc:5697] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: config changed from index 6 to 7, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New cstate: current_term: 7 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:27.866050 10996 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:37512
I20260709 12:25:27.866887 10996 raft_consensus.cc:493] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:27.867352 10996 raft_consensus.cc:3060] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:27.879702 10929 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
mode: GRACEFUL
new_leader_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:41546
I20260709 12:25:27.880348 10929 raft_consensus.cc:606] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Received request to transfer leadership to TS 80cd7d227db44f34a6108591dad9c040
I20260709 12:25:27.882915  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:25:27.884907  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:27.886082  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:27.886190 10996 raft_consensus.cc:515] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:27.899272 10895 leader_election.cc:304] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:27.898996 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:27.906335 10996 leader_election.cc:290] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:27.906406 10851 raft_consensus.cc:3055] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:27.907169 10851 raft_consensus.cc:740] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:27.910763 13661 raft_consensus.cc:2749] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:27.910858 13713 consensus_queue.cc:1048] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 12:25:27.919855 10851 consensus_queue.cc:260] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:27.973049 10851 raft_consensus.cc:3060] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:27.999778 13564 raft_consensus.cc:993] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08: : Instructing follower e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:25:28.000566 13647 raft_consensus.cc:1081] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08 [term 4 LEADER]: Signalling peer e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:25:28.014621 10750 catalog_manager.cc:5697] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: config changed from index 5 to 8, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New cstate: current_term: 8 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:28.023985 10851 raft_consensus.cc:2468] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 6.
I20260709 12:25:28.030126 10994 consensus_queue.cc:237] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:28.047835 10929 raft_consensus.cc:2955] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:28.077863 11622 raft_consensus.cc:1275] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:25:28.080021 13647 consensus_queue.cc:1048] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:28.080400 10854 raft_consensus.cc:1275] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:25:28.092005 10968 leader_election.cc:304] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:25:28.108462 10928 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:59622
I20260709 12:25:28.109110 10928 raft_consensus.cc:493] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:28.109458 10928 raft_consensus.cc:3060] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:28.111991 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:28.112882 10922 raft_consensus.cc:3060] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:28.117852 10854 consensus_queue.cc:237] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:28.139816 13725 raft_consensus.cc:2955] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 7 LEADER]: Committing config change with OpId 7.8: config changed from index 7 to 8, VOTER 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:28.147099 10928 raft_consensus.cc:515] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:28.149554 10928 leader_election.cc:290] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:28.155735 13457 consensus_queue.cc:1048] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 12:25:28.178766 10928 raft_consensus.cc:1275] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:25:28.128222 13625 raft_consensus.cc:2804] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:28.184716 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:28.185956 10851 raft_consensus.cc:3060] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:28.189369 13564 raft_consensus.cc:2955] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 LEADER]: Committing config change with OpId 7.8: config changed from index 7 to 8, VOTER e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:28.193162 11622 raft_consensus.cc:2955] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 7 to 8, VOTER e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:28.213111 11623 raft_consensus.cc:1275] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:25:28.191758 13694 consensus_queue.cc:1048] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 12:25:28.211740 13625 raft_consensus.cc:697] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:25:28.232695 13618 consensus_queue.cc:1048] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:28.232556 13625 consensus_queue.cc:237] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:25:28.241537 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 114936us
I20260709 12:25:28.246510 10922 raft_consensus.cc:2468] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 6.
I20260709 12:25:28.256872 10851 raft_consensus.cc:2468] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 5.
I20260709 12:25:28.270309 10853 raft_consensus.cc:1240] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:28.287767 11622 raft_consensus.cc:2955] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Committing config change with OpId 8.9: config changed from index 8 to 9, VOTER edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
W20260709 12:25:28.316944 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 64421.4us
I20260709 12:25:28.338193 10749 catalog_manager.cc:5697] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: config changed from index 7 to 8, VOTER e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) evicted. New cstate: current_term: 7 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:28.325392 13625 consensus_queue.cc:1059] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 12:25:28.341740 13625 raft_consensus.cc:3055] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:28.342231 13625 raft_consensus.cc:740] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:25:28.282582 13723 raft_consensus.cc:2955] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 8 LEADER]: Committing config change with OpId 8.9: config changed from index 8 to 9, VOTER edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:28.361524 10912 tablet_service.cc:1558] Processing DeleteTablet for tablet 577c93bfc0d84ec6ad610cad0cf16899 with delete_type TABLET_DATA_TOMBSTONED (TS e2d5c637307a407ab688f5ccd6f0fcea not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:59610
I20260709 12:25:28.364969 10752 catalog_manager.cc:5697] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 5 to 6, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 6 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:28.373080 10750 catalog_manager.cc:5697] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: config changed from index 8 to 9, VOTER edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) evicted. New cstate: current_term: 8 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:28.381081 10851 raft_consensus.cc:2955] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 7 to 8, VOTER e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:28.343248 13625 consensus_queue.cc:260] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:25:28.407829 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 86202.4us
I20260709 12:25:28.410760 11622 raft_consensus.cc:2955] T e3d9a61ecaf84695b70f8519ee57706f P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 7 to 8, VOTER 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:28.438867 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:28.438764 13625 raft_consensus.cc:3060] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:28.444728 10739 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 577c93bfc0d84ec6ad610cad0cf16899 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:25:28.471362 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 183098us
I20260709 12:25:28.477141 13725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:59610 (request call id 71) took 1612 ms. Trace:
I20260709 12:25:28.478147 13725 rpcz_store.cc:276] 0709 12:25:26.860271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:26.860444 (+   173us) service_pool.cc:224] Handling call
0709 12:25:26.880020 (+ 19576us) log.cc:844] Serialized 494 byte log entry
0709 12:25:27.163255 (+283235us) spinlock_profiling.cc:243] Waited 1.14 ms on lock 0x7b540024b6a0. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e01142 00007f7594de1eaa 00007f7594de8d53 00007f7594de8cd9 00007f7594de8c69 00007f7594de8c31 00007f7594de7dfd 0000000000388634 0000000000388479 00007f7591d9b475
0709 12:25:27.275996 (+112741us) spinlock_profiling.cc:243] Waited 1.73 ms on lock 0x7b540024b6a0. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e08b26 00007f7594e0249a 00007f7594e01714 00007f7594de1eaa 00007f7594de8d53 00007f7594de8cd9 00007f7594de8c69 00007f7594de8c31 00007f7594de7dfd 0000000000388634
0709 12:25:28.471841 (+1195845us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":572,"raft.run_cpu_time_us":14522,"raft.run_wall_time_us":430291,"spinlock_wait_cycles":6598400,"thread_start_us":121948,"threads_started":1,"wal-append.queue_time_us":184778,"wal-append.run_cpu_time_us":2708,"wal-append.run_wall_time_us":1058322}
I20260709 12:25:28.474654 11000 raft_consensus.cc:2955] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 7 to 8, VOTER 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:28.497768 10738 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e3d9a61ecaf84695b70f8519ee57706f with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:25:28.505276 10738 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 53b0e2cbee394228af2190d22e7ea9ef with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:25:28.508258 10894 leader_election.cc:304] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:25:28.511436 13738 raft_consensus.cc:2804] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:25:28.512089 13738 raft_consensus.cc:697] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 5 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:28.513026 13738 consensus_queue.cc:237] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:28.533613 10923 raft_consensus.cc:2955] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Committing config change with OpId 8.9: config changed from index 8 to 9, VOTER edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:28.536348 13744 tablet_replica.cc:333] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea: stopping tablet replica
I20260709 12:25:28.537653 13744 raft_consensus.cc:2243] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:28.541869 10992 tablet_service.cc:1558] Processing DeleteTablet for tablet 53b0e2cbee394228af2190d22e7ea9ef with delete_type TABLET_DATA_TOMBSTONED (TS edcc56ddd3264984b4da6c1db59e7f08 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:37496
I20260709 12:25:28.545047 10750 catalog_manager.cc:5697] T e3d9a61ecaf84695b70f8519ee57706f P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: config changed from index 7 to 8, VOTER 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) evicted. New cstate: current_term: 7 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:28.538632 13744 raft_consensus.cc:2272] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:28.585466 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 56121.7us
I20260709 12:25:28.588167 10835 tablet_service.cc:1558] Processing DeleteTablet for tablet e3d9a61ecaf84695b70f8519ee57706f with delete_type TABLET_DATA_TOMBSTONED (TS 80cd7d227db44f34a6108591dad9c040 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:56372
I20260709 12:25:28.595526 13744 ts_tablet_manager.cc:1916] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:25:28.597064 13723 raft_consensus.cc:493] T e3d9a61ecaf84695b70f8519ee57706f P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:25:28.597750 13723 raft_consensus.cc:515] T e3d9a61ecaf84695b70f8519ee57706f P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:28.607250 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d9a61ecaf84695b70f8519ee57706f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:28.609468 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d9a61ecaf84695b70f8519ee57706f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:25:28.604768 13723 leader_election.cc:290] T e3d9a61ecaf84695b70f8519ee57706f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:25:28.619302 10994 raft_consensus.cc:2468] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 5.
I20260709 12:25:28.647073 13746 tablet_replica.cc:333] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08: stopping tablet replica
I20260709 12:25:28.648432 13746 raft_consensus.cc:2243] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:28.650293 13746 raft_consensus.cc:2272] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:28.676097 10920 raft_consensus.cc:1240] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 5 LEADER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:28.710269 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d9a61ecaf84695b70f8519ee57706f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:28.721540 13747 tablet_replica.cc:333] T e3d9a61ecaf84695b70f8519ee57706f P 80cd7d227db44f34a6108591dad9c040: stopping tablet replica
I20260709 12:25:28.728263 13661 raft_consensus.cc:993] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea: : Instructing follower 80cd7d227db44f34a6108591dad9c040 to start an election
W20260709 12:25:28.724869 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 71184.8us
I20260709 12:25:28.731930 13661 raft_consensus.cc:1081] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Signalling peer 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:25:28.723526 13747 raft_consensus.cc:2243] T e3d9a61ecaf84695b70f8519ee57706f P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:28.740375 10922 raft_consensus.cc:1275] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:25:28.747123 13746 ts_tablet_manager.cc:1916] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:25:28.749466 13747 raft_consensus.cc:2272] T e3d9a61ecaf84695b70f8519ee57706f P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:28.754120 13625 consensus_queue.cc:1048] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:28.760273 10820 leader_election.cc:304] T e3d9a61ecaf84695b70f8519ee57706f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:28.765437 10749 catalog_manager.cc:5697] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 4 to 5, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 5 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:28.761219 13747 ts_tablet_manager.cc:1916] T e3d9a61ecaf84695b70f8519ee57706f P 80cd7d227db44f34a6108591dad9c040: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:25:28.764333 10820 raft_consensus.cc:2686] T e3d9a61ecaf84695b70f8519ee57706f P 80cd7d227db44f34a6108591dad9c040: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:25:28.807122 13742 raft_consensus.cc:993] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040: : Instructing follower e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:25:28.807683 13742 raft_consensus.cc:1081] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 5 LEADER]: Signalling peer e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:25:28.854067 10847 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:56394
I20260709 12:25:28.854363 10851 raft_consensus.cc:1275] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:25:28.854877 10847 raft_consensus.cc:493] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:28.855276 10847 raft_consensus.cc:3060] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:28.856688 10925 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:59626
I20260709 12:25:28.857405 10925 raft_consensus.cc:493] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:28.857739 10925 raft_consensus.cc:3060] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:28.864514 13744 ts_tablet_manager.cc:1929] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 7.7
I20260709 12:25:28.865247 13744 log.cc:1199] T 577c93bfc0d84ec6ad610cad0cf16899 P e2d5c637307a407ab688f5ccd6f0fcea: Deleting WAL directory at /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599781984018-9681-0/minicluster-data/ts-1-root/wals/577c93bfc0d84ec6ad610cad0cf16899
I20260709 12:25:28.867674 10738 catalog_manager.cc:5028] TS e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): tablet 577c93bfc0d84ec6ad610cad0cf16899 (table test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]) successfully deleted
I20260709 12:25:28.880548 10925 raft_consensus.cc:515] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:28.893321 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:25:28.894182 11624 raft_consensus.cc:3060] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:28.905750 10925 leader_election.cc:290] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:25:28.935453 11624 raft_consensus.cc:2468] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 6.
I20260709 12:25:28.909682 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:28.938280 13747 ts_tablet_manager.cc:1929] T e3d9a61ecaf84695b70f8519ee57706f P 80cd7d227db44f34a6108591dad9c040: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 7.7
I20260709 12:25:28.996001 10846 raft_consensus.cc:3055] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:28.996196 13747 log.cc:1199] T e3d9a61ecaf84695b70f8519ee57706f P 80cd7d227db44f34a6108591dad9c040: Deleting WAL directory at /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599781984018-9681-0/minicluster-data/ts-0-root/wals/e3d9a61ecaf84695b70f8519ee57706f
I20260709 12:25:28.907299 10847 raft_consensus.cc:515] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:28.996345 10895 leader_election.cc:304] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:25:28.997443 13743 raft_consensus.cc:2804] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:28.944332 13746 ts_tablet_manager.cc:1929] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 8.8
I20260709 12:25:28.998036 13743 raft_consensus.cc:697] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:28.998301 13746 log.cc:1199] T 53b0e2cbee394228af2190d22e7ea9ef P edcc56ddd3264984b4da6c1db59e7f08: Deleting WAL directory at /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599781984018-9681-0/minicluster-data/ts-2-root/wals/53b0e2cbee394228af2190d22e7ea9ef
I20260709 12:25:28.996407 10846 raft_consensus.cc:740] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:28.950399 11000 raft_consensus.cc:1275] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:25:28.961545 13601 consensus_queue.cc:1048] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:25:28.999785 10846 consensus_queue.cc:260] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:29.001123 10846 raft_consensus.cc:3060] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:28.999117 13743 consensus_queue.cc:237] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:29.001351 13725 consensus_queue.cc:1048] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:29.002274 10739 catalog_manager.cc:5028] TS edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): tablet 53b0e2cbee394228af2190d22e7ea9ef (table test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]) successfully deleted
I20260709 12:25:28.998054 10847 leader_election.cc:290] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:29.025712 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:29.030369 10925 raft_consensus.cc:3055] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:25:29.030750 10925 raft_consensus.cc:740] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:29.035001 10738 catalog_manager.cc:5028] TS 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): tablet e3d9a61ecaf84695b70f8519ee57706f (table test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]) successfully deleted
I20260709 12:25:29.015214 10846 raft_consensus.cc:2468] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 6.
I20260709 12:25:29.035147 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:29.038183 10997 raft_consensus.cc:3060] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:29.037902 10925 consensus_queue.cc:260] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:29.039328 10925 raft_consensus.cc:3060] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:29.052718 10854 raft_consensus.cc:1275] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:25:29.063512 13738 consensus_queue.cc:1048] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:25:29.073989 10997 raft_consensus.cc:2468] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 4.
I20260709 12:25:29.096249 10750 catalog_manager.cc:5697] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 5 to 6, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 6 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:29.100642 10925 raft_consensus.cc:2468] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 4.
I20260709 12:25:29.111284 10820 leader_election.cc:304] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:25:29.121521 13694 raft_consensus.cc:2804] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:25:29.123517 13694 raft_consensus.cc:697] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:29.124639 13694 consensus_queue.cc:237] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:25:29.260315 13753 log.cc:927] Time spent T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.098s	user 0.001s	sys 0.008s
I20260709 12:25:29.261664  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:25:29.276048 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 117440us
I20260709 12:25:29.348318 10750 catalog_manager.cc:5697] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 3 to 4, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 4 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:29.423915 10922 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
mode: GRACEFUL
new_leader_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:41546
I20260709 12:25:29.424845 10922 raft_consensus.cc:606] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Received request to transfer leadership to TS 80cd7d227db44f34a6108591dad9c040
I20260709 12:25:29.425377 10922 raft_consensus.cc:614] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:29.475915 10921 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
mode: GRACEFUL
new_leader_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:41546
I20260709 12:25:29.476534 10921 raft_consensus.cc:606] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 LEADER]: Received request to transfer leadership to TS 80cd7d227db44f34a6108591dad9c040
I20260709 12:25:29.652678 10996 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
mode: GRACEFUL
new_leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:32960
I20260709 12:25:29.653522 10996 raft_consensus.cc:606] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 5 LEADER]: Received request to transfer leadership to TS e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:29.666306 10854 raft_consensus.cc:1275] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:25:29.674157 13734 consensus_queue.cc:1048] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:29.675750 10925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e3d9a61ecaf84695b70f8519ee57706f"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
mode: GRACEFUL
new_leader_uuid: "3c52e0825c02476e89d84da9bb849f5d"
 from {username='slave'} at 127.0.0.1:41546
I20260709 12:25:29.676388 10925 raft_consensus.cc:606] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 7 LEADER]: Received request to transfer leadership to TS 3c52e0825c02476e89d84da9bb849f5d
I20260709 12:25:29.703769 10854 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
mode: GRACEFUL
new_leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:47358
I20260709 12:25:29.704607 10854 raft_consensus.cc:606] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Received request to transfer leadership to TS edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:29.711666 11000 raft_consensus.cc:1275] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:29.718566 13759 consensus_queue.cc:1048] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:25:29.734203 10846 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
mode: GRACEFUL
new_leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:47358
I20260709 12:25:29.734954 10846 raft_consensus.cc:606] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040 [term 3 LEADER]: Received request to transfer leadership to TS edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:29.736603 10925 raft_consensus.cc:1275] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:29.759298  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:25:29.758734 13761 consensus_queue.cc:1048] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:25:29.773540 11624 raft_consensus.cc:1275] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:25:29.773653  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:29.775449  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:29.848471 13760 raft_consensus.cc:993] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea: : Instructing follower 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:25:29.849339 13760 raft_consensus.cc:1081] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 LEADER]: Signalling peer 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:25:29.852272 10850 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:56394
I20260709 12:25:29.853094 10850 raft_consensus.cc:493] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:29.853502 10850 raft_consensus.cc:3060] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:29.874969 10850 raft_consensus.cc:515] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:29.877822 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:29.878496 10928 raft_consensus.cc:3055] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:29.878844 10928 raft_consensus.cc:740] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:29.882437 10850 leader_election.cc:290] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:29.879726 10928 consensus_queue.cc:260] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:29.884449 10928 raft_consensus.cc:3060] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:29.891952 10928 raft_consensus.cc:2468] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 6.
I20260709 12:25:29.901350 10819 leader_election.cc:304] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:25:29.902262 13759 raft_consensus.cc:2804] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:29.903039 13759 raft_consensus.cc:697] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 6 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:29.905926 13759 consensus_queue.cc:237] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:25:29.912992 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 141811us
W20260709 12:25:29.988610 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 74914.9us
I20260709 12:25:30.080796 10750 catalog_manager.cc:5697] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 5 to 6, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 6 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
W20260709 12:25:30.112479 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 122627us
I20260709 12:25:30.115444 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:30.116155 10996 raft_consensus.cc:3060] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:30.166887 13760 consensus_queue.cc:1048] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 12:25:30.215703 13724 raft_consensus.cc:993] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea: : Instructing follower 3c52e0825c02476e89d84da9bb849f5d to start an election
I20260709 12:25:30.216356 13724 raft_consensus.cc:1081] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 7 LEADER]: Signalling peer 3c52e0825c02476e89d84da9bb849f5d to start an election
I20260709 12:25:30.235075 10996 raft_consensus.cc:2468] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 6.
I20260709 12:25:30.256413 11624 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e3d9a61ecaf84695b70f8519ee57706f"
dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
 from {username='slave'} at 127.0.0.1:45904
I20260709 12:25:30.257573 11624 raft_consensus.cc:493] T e3d9a61ecaf84695b70f8519ee57706f P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:30.258105 11624 raft_consensus.cc:3060] T e3d9a61ecaf84695b70f8519ee57706f P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:30.261546 10994 consensus_queue.cc:237] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:30.270294 11624 raft_consensus.cc:515] T e3d9a61ecaf84695b70f8519ee57706f P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:25:30.321234 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 47972.3us
W20260709 12:25:30.416633 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 98253.3us
I20260709 12:25:30.418833 11624 leader_election.cc:290] T e3d9a61ecaf84695b70f8519ee57706f P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 8 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:25:30.421013 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 122494us
I20260709 12:25:30.424213 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d9a61ecaf84695b70f8519ee57706f" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:30.424834 11001 raft_consensus.cc:3060] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:30.428303 13778 raft_consensus.cc:993] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040: : Instructing follower edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:25:30.429045 13778 raft_consensus.cc:1081] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Signalling peer edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:25:30.447252 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d9a61ecaf84695b70f8519ee57706f" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:30.448076 10923 raft_consensus.cc:3055] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:30.448422 10923 raft_consensus.cc:740] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:30.449158 10923 consensus_queue.cc:260] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:30.451335 10923 raft_consensus.cc:3060] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:30.450039 13778 raft_consensus.cc:993] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040: : Instructing follower edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:25:30.464247 13778 raft_consensus.cc:1081] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040 [term 3 LEADER]: Signalling peer edcc56ddd3264984b4da6c1db59e7f08 to start an election
W20260709 12:25:30.464823 10969 consensus_peers.cc:597] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613): Couldn't send request to peer 3c52e0825c02476e89d84da9bb849f5d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c2937f569e8041d9a71a575dc1b9d74d. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:30.457091 13776 log.cc:927] Time spent T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d: Append to log took a long time: real 0.155s	user 0.002s	sys 0.000s
I20260709 12:25:30.490453 10923 raft_consensus.cc:2468] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 8.
I20260709 12:25:30.507282 11001 raft_consensus.cc:2468] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 8.
I20260709 12:25:30.523902 11589 leader_election.cc:304] T e3d9a61ecaf84695b70f8519ee57706f P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:25:30.538367 13770 raft_consensus.cc:2804] T e3d9a61ecaf84695b70f8519ee57706f P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:30.543030 13770 raft_consensus.cc:697] T e3d9a61ecaf84695b70f8519ee57706f P 3c52e0825c02476e89d84da9bb849f5d [term 8 LEADER]: Becoming Leader. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
I20260709 12:25:30.544219 13770 consensus_queue.cc:237] T e3d9a61ecaf84695b70f8519ee57706f P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:25:30.564824 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 77882.3us
I20260709 12:25:30.651633 10920 raft_consensus.cc:1275] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:25:30.660048 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 344098us
W20260709 12:25:30.728978 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 66962.8us
I20260709 12:25:30.739545 13788 raft_consensus.cc:993] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08: : Instructing follower e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:25:30.741547 13788 raft_consensus.cc:1081] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 5 LEADER]: Signalling peer e2d5c637307a407ab688f5ccd6f0fcea to start an election
W20260709 12:25:30.749951 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 336838us
I20260709 12:25:30.769404 10995 raft_consensus.cc:1240] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:30.774204 10921 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:59622
I20260709 12:25:30.775090 10921 raft_consensus.cc:493] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:30.775480 10921 raft_consensus.cc:3060] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:30.778940 10920 raft_consensus.cc:1275] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:25:30.800843 10921 raft_consensus.cc:515] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:30.803660 10921 leader_election.cc:290] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:25:30.810113 10950 debug-util.cc:398] Leaking SignalData structure 0x7b08000a0180 after lost signal to thread 9684
W20260709 12:25:30.811369 10950 debug-util.cc:398] Leaking SignalData structure 0x7b08001c1660 after lost signal to thread 10786
W20260709 12:25:30.812724 10950 debug-util.cc:398] Leaking SignalData structure 0x7b08002097c0 after lost signal to thread 10878
W20260709 12:25:30.813880 10950 debug-util.cc:398] Leaking SignalData structure 0x7b08003619c0 after lost signal to thread 10953
W20260709 12:25:30.815018 10950 debug-util.cc:398] Leaking SignalData structure 0x7b0800381720 after lost signal to thread 11027
W20260709 12:25:30.817669 10950 debug-util.cc:398] Leaking SignalData structure 0x7b0800332220 after lost signal to thread 11648
I20260709 12:25:30.823872 13786 consensus_queue.cc:1048] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:25:30.841372 10999 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:37512
I20260709 12:25:30.842226 10999 raft_consensus.cc:493] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:30.842629 10999 raft_consensus.cc:3060] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:30.845387 10853 raft_consensus.cc:1275] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:25:30.845582 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:30.846263 11001 raft_consensus.cc:3055] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:30.846627 11001 raft_consensus.cc:740] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:25:30.847409 11001 consensus_queue.cc:260] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:30.848505 11001 raft_consensus.cc:3060] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:30.850018 11000 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:37512
I20260709 12:25:30.855182 11000 raft_consensus.cc:493] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:30.855654 11000 raft_consensus.cc:3060] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:30.866998 10995 raft_consensus.cc:1275] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:25:30.874161 11000 raft_consensus.cc:515] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:30.880415 13790 consensus_queue.cc:1048] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 12:25:30.889072 10994 raft_consensus.cc:1240] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 3. Current term is 4. Ops: []
I20260709 12:25:30.889356 11000 leader_election.cc:290] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:30.886011 13788 consensus_queue.cc:1048] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:25:30.879525 11001 raft_consensus.cc:2468] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 6.
I20260709 12:25:30.891494 10895 leader_election.cc:304] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:25:30.892335 13661 raft_consensus.cc:2804] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:30.892822 13661 raft_consensus.cc:697] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:30.893826 13661 consensus_queue.cc:237] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:30.930089 10999 raft_consensus.cc:515] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:25:30.945165 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 60088.7us
I20260709 12:25:30.947593 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:30.948287 10847 raft_consensus.cc:3055] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:25:30.948627 10847 raft_consensus.cc:740] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:30.948463 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:30.949241 10920 raft_consensus.cc:3060] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:30.949433 10847 consensus_queue.cc:260] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:30.950412 10847 raft_consensus.cc:3060] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:25:30.956223 10894 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.015s	sys 0.007s
W20260709 12:25:30.956604 10894 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.015s	sys 0.007s
I20260709 12:25:30.961433 10999 leader_election.cc:290] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:30.967743 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:30.968568 10850 raft_consensus.cc:3055] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:30.968991 10850 raft_consensus.cc:740] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:30.972487 10850 consensus_queue.cc:260] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:30.972958 10847 raft_consensus.cc:2468] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 4.
I20260709 12:25:30.974045 10850 raft_consensus.cc:3060] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:30.977159 10921 raft_consensus.cc:1275] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:25:30.978840 10968 leader_election.cc:304] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:25:30.980521 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:30.981843 13786 raft_consensus.cc:2804] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:25:30.982048 10921 raft_consensus.cc:3060] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:30.982487 13786 raft_consensus.cc:697] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 4 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:25:30.983531 13786 consensus_queue.cc:237] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:30.987426 13782 consensus_queue.cc:1048] T e3d9a61ecaf84695b70f8519ee57706f P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 12:25:30.996608 10928 raft_consensus.cc:2955] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Committing config change with OpId 6.5: config changed from index -1 to 5, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:25:30.992743 13793 raft_consensus.cc:2955] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 6 LEADER]: Committing config change with OpId 6.5: config changed from index -1 to 5, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:25:31.013427 10749 catalog_manager.cc:5697] T e3d9a61ecaf84695b70f8519ee57706f P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: term changed from 7 to 8, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68). New cstate: current_term: 8 leader_uuid: "3c52e0825c02476e89d84da9bb849f5d" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:31.018896 10850 raft_consensus.cc:2468] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 5.
I20260709 12:25:31.024499 10968 leader_election.cc:304] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:25:31.026381 13769 raft_consensus.cc:2804] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:25:31.026732 10997 raft_consensus.cc:1275] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:25:31.027752 13769 raft_consensus.cc:697] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:25:31.028970 13769 consensus_queue.cc:237] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:31.029950 13770 consensus_queue.cc:1048] T e3d9a61ecaf84695b70f8519ee57706f P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:31.044921 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:31.045650 10854 raft_consensus.cc:3060] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:31.109014 10854 raft_consensus.cc:2468] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 6.
I20260709 12:25:31.114351 10920 raft_consensus.cc:2468] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 4.
I20260709 12:25:31.094743 10845 consensus_queue.cc:237] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:31.119032 10921 raft_consensus.cc:2468] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 5.
W20260709 12:25:31.130764 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 90928us
W20260709 12:25:31.136601 10817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:31.144713 13797 ts_tablet_manager.cc:933] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d: Initiating tablet copy from peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:25:31.168897 10817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:31.212658 10998 raft_consensus.cc:1240] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 LEADER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:31.239606 10751 catalog_manager.cc:5697] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 3 to 4, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 4 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:31.245276 10998 raft_consensus.cc:1275] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:25:31.240586 13797 tablet_copy_client.cc:323] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Beginning tablet copy session from remote peer at address 127.9.116.67:39945
I20260709 12:25:31.247815 10751 catalog_manager.cc:5697] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 4 to 5, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 5 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:31.258782 13761 consensus_queue.cc:1048] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:31.264357 13781 consensus_queue.cc:1048] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:25:31.266693 11013 tablet_copy_service.cc:140] P edcc56ddd3264984b4da6c1db59e7f08: Received BeginTabletCopySession request for tablet c2937f569e8041d9a71a575dc1b9d74d from peer 3c52e0825c02476e89d84da9bb849f5d ({username='slave'} at 127.0.0.1:57514)
I20260709 12:25:31.267360 11013 tablet_copy_service.cc:161] P edcc56ddd3264984b4da6c1db59e7f08: Beginning new tablet copy session on tablet c2937f569e8041d9a71a575dc1b9d74d from peer 3c52e0825c02476e89d84da9bb849f5d at {username='slave'} at 127.0.0.1:57514: session id = 3c52e0825c02476e89d84da9bb849f5d-c2937f569e8041d9a71a575dc1b9d74d
W20260709 12:25:31.280542 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 54894.3us
I20260709 12:25:31.286017 10928 raft_consensus.cc:1240] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 4. Current term is 5. Ops: []
W20260709 12:25:31.283161 10820 consensus_peers.cc:597] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 -> Peer 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613): Couldn't send request to peer 3c52e0825c02476e89d84da9bb849f5d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9f0dd1f84a304be0be5f4e4bf2aae6de. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:31.316339 10818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:31.326534 13808 raft_consensus.cc:493] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:25:31.328848 10920 raft_consensus.cc:1240] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 3. Current term is 4. Ops: []
I20260709 12:25:31.328655 13808 raft_consensus.cc:515] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:31.330950 13808 leader_election.cc:290] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:31.333320 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:31.337369 11013 tablet_copy_source_session.cc:215] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:25:31.346035 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:31.349061 11002 raft_consensus.cc:1275] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:25:31.354370 10928 raft_consensus.cc:1275] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:25:31.360176 10895 leader_election.cc:304] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:31.372187 13797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2937f569e8041d9a71a575dc1b9d74d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.373255 13725 raft_consensus.cc:2749] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:31.373811 13809 consensus_queue.cc:1048] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:25:31.385438 13761 consensus_queue.cc:1048] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:31.409605 13787 raft_consensus.cc:2955] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 6 LEADER]: Committing config change with OpId 6.6: config changed from index -1 to 6, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:25:31.410182 10847 raft_consensus.cc:2955] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Committing config change with OpId 6.5: config changed from index -1 to 5, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:25:31.423178 11002 raft_consensus.cc:2955] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index -1 to 6, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:25:31.433852 10923 raft_consensus.cc:1275] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:25:31.456326 10851 raft_consensus.cc:1275] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:25:31.454257 13647 consensus_queue.cc:1048] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:25:31.466902 10851 raft_consensus.cc:1275] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:25:31.468295 13724 consensus_queue.cc:1048] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:31.472510 10922 raft_consensus.cc:2955] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index -1 to 6, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:25:31.476869 13718 consensus_queue.cc:1048] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:25:31.504251 13797 tablet_copy_client.cc:806] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 0 data blocks...
I20260709 12:25:31.516662 13797 tablet_copy_client.cc:670] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:25:31.517489 10922 raft_consensus.cc:1275] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:25:31.520855 13771 consensus_queue.cc:1048] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:25:31.522042 13811 log.cc:927] Time spent T 00000000000000000000000000000000 P 9619ad7a9e7f4d9b8039487e3ee77243: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 12:25:31.526469 10750 catalog_manager.cc:5697] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 5 to 6, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 6 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:31.532857 10750 catalog_manager.cc:5697] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: config changed from index -1 to 5, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New cstate: current_term: 6 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:25:31.540375 13797 tablet_copy_client.cc:538] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:25:31.559854 10845 raft_consensus.cc:1275] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:25:31.564772 13793 consensus_queue.cc:1048] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:31.587275 11002 consensus_queue.cc:237] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:31.619314 13797 tablet_bootstrap.cc:492] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap starting.
I20260709 12:25:31.725750  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:25:31.727250 10969 consensus_peers.cc:597] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613): Couldn't send request to peer 3c52e0825c02476e89d84da9bb849f5d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 18294423a68a4671bf6c5a0f98645e4c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:31.746704 10922 raft_consensus.cc:1275] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:25:31.746006 10749 catalog_manager.cc:5697] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: config changed from index -1 to 6, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New cstate: current_term: 6 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:25:31.753770 10847 raft_consensus.cc:1275] T 18294423a68a4671bf6c5a0f98645e4c P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:25:31.770653 13793 consensus_queue.cc:1048] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:25:31.813269 13793 consensus_queue.cc:1048] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:25:31.856606 13784 raft_consensus.cc:2955] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
W20260709 12:25:31.863852 11024 debug-util.cc:398] Leaking SignalData structure 0x7b08001499a0 after lost signal to thread 9684
W20260709 12:25:31.865504 11024 debug-util.cc:398] Leaking SignalData structure 0x7b08001724a0 after lost signal to thread 10786
W20260709 12:25:31.866848 11024 debug-util.cc:398] Leaking SignalData structure 0x7b080037b480 after lost signal to thread 10878
W20260709 12:25:31.869561 11024 debug-util.cc:398] Leaking SignalData structure 0x7b0800050160 after lost signal to thread 10953
W20260709 12:25:31.871449 11024 debug-util.cc:398] Leaking SignalData structure 0x7b0800366760 after lost signal to thread 11027
W20260709 12:25:31.877507 11024 debug-util.cc:398] Leaking SignalData structure 0x7b080038b1e0 after lost signal to thread 11648
I20260709 12:25:31.879727 10922 raft_consensus.cc:2955] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:25:31.938751 10750 catalog_manager.cc:5697] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: config changed from index -1 to 4, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New cstate: current_term: 3 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:31.949705 13830 ts_tablet_manager.cc:933] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 3c52e0825c02476e89d84da9bb849f5d: Initiating tablet copy from peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265)
I20260709 12:25:31.950901 10847 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
mode: GRACEFUL
new_leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:47358
I20260709 12:25:31.951615 10847 raft_consensus.cc:606] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 5 LEADER]: Received request to transfer leadership to TS e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:31.960120 10847 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
mode: GRACEFUL
new_leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:47358
I20260709 12:25:31.960942 10847 raft_consensus.cc:606] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Received request to transfer leadership to TS edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:31.967872 10847 raft_consensus.cc:2955] T 18294423a68a4671bf6c5a0f98645e4c P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:25:31.984475 13797 tablet_bootstrap.cc:492] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=1 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:31.991634 11002 consensus_queue.cc:237] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:31.997723 10920 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
mode: GRACEFUL
new_leader_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:41546
I20260709 12:25:31.998525 10920 raft_consensus.cc:606] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Received request to transfer leadership to TS 80cd7d227db44f34a6108591dad9c040
I20260709 12:25:31.993566 13830 tablet_copy_client.cc:323] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Beginning tablet copy session from remote peer at address 127.9.116.65:46265
I20260709 12:25:32.003353 10998 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
mode: GRACEFUL
new_leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:32960
I20260709 12:25:31.995973 13797 tablet_bootstrap.cc:492] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap complete.
I20260709 12:25:32.004132 10998 raft_consensus.cc:606] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 LEADER]: Received request to transfer leadership to TS e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:32.004850 13797 ts_tablet_manager.cc:1403] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d: Time spent bootstrapping tablet: real 0.386s	user 0.037s	sys 0.004s
I20260709 12:25:32.006561 10864 tablet_copy_service.cc:140] P 80cd7d227db44f34a6108591dad9c040: Received BeginTabletCopySession request for tablet 9f0dd1f84a304be0be5f4e4bf2aae6de from peer 3c52e0825c02476e89d84da9bb849f5d ({username='slave'} at 127.0.0.1:46480)
I20260709 12:25:32.007217 10864 tablet_copy_service.cc:161] P 80cd7d227db44f34a6108591dad9c040: Beginning new tablet copy session on tablet 9f0dd1f84a304be0be5f4e4bf2aae6de from peer 3c52e0825c02476e89d84da9bb849f5d at {username='slave'} at 127.0.0.1:46480: session id = 3c52e0825c02476e89d84da9bb849f5d-9f0dd1f84a304be0be5f4e4bf2aae6de
I20260709 12:25:32.009968 13797 raft_consensus.cc:359] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d [term 6 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:32.011116 13797 raft_consensus.cc:740] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d [term 6 LEARNER]: Becoming Follower/Learner. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Initialized, Role: LEARNER
I20260709 12:25:32.011963 13797 consensus_queue.cc:260] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:32.022655 13797 ts_tablet_manager.cc:1434] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.003s
I20260709 12:25:32.025492 11013 tablet_copy_service.cc:342] P edcc56ddd3264984b4da6c1db59e7f08: Request end of tablet copy session 3c52e0825c02476e89d84da9bb849f5d-c2937f569e8041d9a71a575dc1b9d74d received from {username='slave'} at 127.0.0.1:57514
I20260709 12:25:32.026085 11013 tablet_copy_service.cc:434] P edcc56ddd3264984b4da6c1db59e7f08: ending tablet copy session 3c52e0825c02476e89d84da9bb849f5d-c2937f569e8041d9a71a575dc1b9d74d on tablet c2937f569e8041d9a71a575dc1b9d74d with peer 3c52e0825c02476e89d84da9bb849f5d
I20260709 12:25:32.041033 10922 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
mode: GRACEFUL
new_leader_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:41546
I20260709 12:25:32.041685 10922 raft_consensus.cc:606] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 7 LEADER]: Received request to transfer leadership to TS 80cd7d227db44f34a6108591dad9c040
I20260709 12:25:32.043401  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:25:32.045544  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:32.046540  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:32.094398 10864 tablet_copy_source_session.cc:215] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:25:32.123263 13830 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f0dd1f84a304be0be5f4e4bf2aae6de. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:25:32.125630 10969 consensus_peers.cc:597] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613): Couldn't send request to peer 3c52e0825c02476e89d84da9bb849f5d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 60dca008c268416c8e63091506d1653e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:32.129124 10922 raft_consensus.cc:1275] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:25:32.128068 10847 raft_consensus.cc:1275] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:25:32.140242 13771 consensus_queue.cc:1048] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 12:25:32.151697 13601 consensus_queue.cc:1048] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:32.205911 13787 raft_consensus.cc:993] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040: : Instructing follower edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:25:32.217216 13787 raft_consensus.cc:1081] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Signalling peer edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:25:32.222781 11002 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:37512
I20260709 12:25:32.223397 11002 raft_consensus.cc:493] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:32.223798 11002 raft_consensus.cc:3060] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:32.239442 13797 ts_tablet_manager.cc:933] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d: Initiating tablet copy from peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:32.243167 11002 raft_consensus.cc:515] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:32.264952 11002 leader_election.cc:290] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:25:32.266376 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: true dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:25:32.267630 11622 raft_consensus.cc:3060] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:32.277750 13797 tablet_copy_client.cc:323] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Beginning tablet copy session from remote peer at address 127.9.116.67:39945
I20260709 12:25:32.276958 13601 raft_consensus.cc:2955] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 8 LEADER]: Committing config change with OpId 8.8: config changed from index -1 to 8, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:25:32.284042 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:32.284687 11013 tablet_copy_service.cc:140] P edcc56ddd3264984b4da6c1db59e7f08: Received BeginTabletCopySession request for tablet 18294423a68a4671bf6c5a0f98645e4c from peer 3c52e0825c02476e89d84da9bb849f5d ({username='slave'} at 127.0.0.1:57514)
I20260709 12:25:32.285293 11013 tablet_copy_service.cc:161] P edcc56ddd3264984b4da6c1db59e7f08: Beginning new tablet copy session on tablet 18294423a68a4671bf6c5a0f98645e4c from peer 3c52e0825c02476e89d84da9bb849f5d at {username='slave'} at 127.0.0.1:57514: session id = 3c52e0825c02476e89d84da9bb849f5d-18294423a68a4671bf6c5a0f98645e4c
I20260709 12:25:32.284714 10847 raft_consensus.cc:3055] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:32.285519 13830 tablet_copy_client.cc:806] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 0 data blocks...
I20260709 12:25:32.285837 10847 raft_consensus.cc:740] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:32.286224 13830 tablet_copy_client.cc:670] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:25:32.286652 10847 consensus_queue.cc:260] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:32.287833 10847 raft_consensus.cc:3060] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:32.288735 13809 raft_consensus.cc:993] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea: : Instructing follower 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:25:32.289264 13809 raft_consensus.cc:1081] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Signalling peer 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:25:32.293125 10922 raft_consensus.cc:2955] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index -1 to 8, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:25:32.301770 10851 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:56394
I20260709 12:25:32.302767 10851 raft_consensus.cc:493] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:32.303220 10851 raft_consensus.cc:3060] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:32.314381 13833 raft_consensus.cc:993] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040: : Instructing follower e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:25:32.315711 13833 raft_consensus.cc:1081] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 5 LEADER]: Signalling peer e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:25:32.323757 13830 tablet_copy_client.cc:538] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:25:32.327960 10851 raft_consensus.cc:515] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:32.328611 11622 raft_consensus.cc:2468] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 5.
I20260709 12:25:32.329447 11624 raft_consensus.cc:1240] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:32.330497 10928 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:59626
I20260709 12:25:32.333527 10969 leader_election.cc:304] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:25:32.335137 10847 raft_consensus.cc:2468] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 5.
I20260709 12:25:32.338451 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:32.339294 10923 raft_consensus.cc:3055] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:32.339721 10923 raft_consensus.cc:740] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:32.340711 10923 consensus_queue.cc:260] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:32.341990 10923 raft_consensus.cc:3060] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:32.331314 10928 raft_consensus.cc:493] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:32.344679 10928 raft_consensus.cc:3060] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:32.345753 13784 raft_consensus.cc:2804] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:25:32.346388 13784 raft_consensus.cc:697] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 5 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:25:32.347254 13784 consensus_queue.cc:237] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:32.349653 10750 catalog_manager.cc:5697] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: config changed from index -1 to 8, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New cstate: current_term: 8 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:25:32.357666 13793 raft_consensus.cc:993] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08: : Instructing follower e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:25:32.358346 13793 raft_consensus.cc:1081] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 LEADER]: Signalling peer e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:25:32.328788 11013 tablet_copy_source_session.cc:215] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:25:32.366698 10923 raft_consensus.cc:2468] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 7.
I20260709 12:25:32.367942 13797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18294423a68a4671bf6c5a0f98645e4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:32.368160 10819 leader_election.cc:304] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:25:32.368927 13787 raft_consensus.cc:2804] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:32.369407 13787 raft_consensus.cc:697] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 7 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:32.370374 13787 consensus_queue.cc:237] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:32.371415 10851 leader_election.cc:290] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:32.372843 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:32.373582 11002 raft_consensus.cc:3060] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:32.380719 10847 raft_consensus.cc:2955] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index -1 to 8, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:25:32.399823 10752 catalog_manager.cc:5697] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 6 to 7, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 7 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:32.404227 10928 raft_consensus.cc:515] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:32.407559 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:32.408381 10847 raft_consensus.cc:3055] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:32.410528 10847 raft_consensus.cc:740] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:32.411744 10847 consensus_queue.cc:260] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:32.413005 10847 raft_consensus.cc:3060] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:32.409535 10928 leader_election.cc:290] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:32.427933 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:32.428639 10994 raft_consensus.cc:3060] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:32.436363 10923 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:59622
I20260709 12:25:32.437096 10923 raft_consensus.cc:493] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:32.437510 10923 raft_consensus.cc:3060] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:32.439994 10847 raft_consensus.cc:2468] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 6.
I20260709 12:25:32.442539 10894 leader_election.cc:304] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:25:32.444540 11002 raft_consensus.cc:2468] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 7.
I20260709 12:25:32.446625 13661 raft_consensus.cc:2804] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:32.447229 13661 raft_consensus.cc:697] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:32.448160 13661 consensus_queue.cc:237] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:32.454111 11622 raft_consensus.cc:1217] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d [term 6 LEARNER]: Deduplicated request from leader. Original: 6.4->[6.5-6.5]   Dedup: 6.5->[]
I20260709 12:25:32.470144 10994 raft_consensus.cc:2468] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 6.
I20260709 12:25:32.476557 10923 raft_consensus.cc:515] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:32.498162 13830 tablet_bootstrap.cc:492] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap starting.
I20260709 12:25:32.510848 10923 leader_election.cc:290] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:32.513422 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:32.514616 10994 raft_consensus.cc:3055] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:32.515004 10994 raft_consensus.cc:740] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:25:32.522715 10752 catalog_manager.cc:5697] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 4 to 5, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 5 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:32.528337 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:32.529724 10847 raft_consensus.cc:3060] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:32.526310 10994 consensus_queue.cc:260] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:32.537760 10994 raft_consensus.cc:3060] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:32.549589 10994 raft_consensus.cc:2468] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 6.
I20260709 12:25:32.550483 13797 tablet_copy_client.cc:806] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 0 data blocks...
I20260709 12:25:32.551242 13797 tablet_copy_client.cc:670] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:25:32.553081 10750 catalog_manager.cc:5697] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 5 to 6, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 6 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:32.568446 10895 leader_election.cc:304] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:25:32.565544 13797 tablet_copy_client.cc:538] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:25:32.575225 13841 raft_consensus.cc:2804] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:32.577173 13724 raft_consensus.cc:993] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea: : Instructing follower 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:25:32.584043 13841 raft_consensus.cc:697] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:32.585578 13724 raft_consensus.cc:1081] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 7 LEADER]: Signalling peer 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:25:32.585211 13841 consensus_queue.cc:237] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:32.596848 10847 raft_consensus.cc:2468] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 6.
W20260709 12:25:32.681700 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 105244us
I20260709 12:25:32.688599 10854 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:56394
I20260709 12:25:32.689231 10854 raft_consensus.cc:493] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:32.689589 10854 raft_consensus.cc:3060] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:32.707873 10854 raft_consensus.cc:515] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:32.733439 10854 leader_election.cc:290] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:25:32.752490 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 74614.2us
W20260709 12:25:32.809561 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 52570.7us
W20260709 12:25:32.815687 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 62479.7us
I20260709 12:25:32.819444 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:32.820132 10928 raft_consensus.cc:3055] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:32.820444 10928 raft_consensus.cc:740] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:32.823074 10928 consensus_queue.cc:260] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:32.824195 10928 raft_consensus.cc:3060] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:32.918422 10928 raft_consensus.cc:2468] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 8.
W20260709 12:25:32.950529 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 64313.2us
W20260709 12:25:32.976436 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 153884us
I20260709 12:25:32.979079 10920 raft_consensus.cc:1275] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:25:32.979444 10819 leader_election.cc:304] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:25:32.998715 13855 ts_tablet_manager.cc:933] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d: Initiating tablet copy from peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:25:33.029884 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 132249us
W20260709 12:25:33.075198 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 95820.1us
I20260709 12:25:33.081391 10853 raft_consensus.cc:1275] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:25:33.099382 10996 raft_consensus.cc:1275] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:25:33.075625 13787 raft_consensus.cc:2804] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:25:33.143071 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 161487us
I20260709 12:25:33.178058  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:33.178737 10752 catalog_manager.cc:5697] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 5 to 6, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 6 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:33.195729 13797 tablet_bootstrap.cc:492] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap starting.
W20260709 12:25:33.217696 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 107875us
I20260709 12:25:33.128031 13855 tablet_copy_client.cc:323] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Beginning tablet copy session from remote peer at address 127.9.116.67:39945
I20260709 12:25:33.192343 13851 consensus_queue.cc:1048] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.147s
W20260709 12:25:33.262876 13830 log.cc:927] Time spent T 9f0dd1f84a304be0be5f4e4bf2aae6de P 3c52e0825c02476e89d84da9bb849f5d: Append to log took a long time: real 0.289s	user 0.001s	sys 0.000s
I20260709 12:25:33.283434 13787 raft_consensus.cc:697] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 8 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:33.284629 13787 consensus_queue.cc:237] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:33.266676 13598 consensus_queue.cc:1048] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 12:25:33.304184 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:33.304841 11002 raft_consensus.cc:3060] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:33.309288 13841 consensus_queue.cc:1048] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:25:33.317056 11623 raft_consensus.cc:1275] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:25:33.322204 11002 raft_consensus.cc:2468] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 8.
I20260709 12:25:33.325027 11013 tablet_copy_service.cc:140] P edcc56ddd3264984b4da6c1db59e7f08: Received BeginTabletCopySession request for tablet 60dca008c268416c8e63091506d1653e from peer 3c52e0825c02476e89d84da9bb849f5d ({username='slave'} at 127.0.0.1:57514)
I20260709 12:25:33.325800 11013 tablet_copy_service.cc:161] P edcc56ddd3264984b4da6c1db59e7f08: Beginning new tablet copy session on tablet 60dca008c268416c8e63091506d1653e from peer 3c52e0825c02476e89d84da9bb849f5d at {username='slave'} at 127.0.0.1:57514: session id = 3c52e0825c02476e89d84da9bb849f5d-60dca008c268416c8e63091506d1653e
I20260709 12:25:33.326131 10998 raft_consensus.cc:1275] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:25:33.342958 13718 consensus_queue.cc:1048] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:25:33.369904 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 92701.6us
W20260709 12:25:33.371313 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 57403.4us
I20260709 12:25:33.378458 10998 raft_consensus.cc:1275] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:25:33.413530 13788 raft_consensus.cc:1064] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08: attempting to promote NON_VOTER 3c52e0825c02476e89d84da9bb849f5d to VOTER
I20260709 12:25:33.407593 13694 consensus_queue.cc:1048] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 12:25:33.417011 11013 tablet_copy_source_session.cc:215] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:25:33.442152 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 155798us
I20260709 12:25:33.430189 13856 consensus_queue.cc:1048] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:25:33.485136 13855 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60dca008c268416c8e63091506d1653e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:33.513437 13788 consensus_queue.cc:237] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 3, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:33.523066 10749 catalog_manager.cc:5697] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 7 to 8, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 8 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:33.564520 10851 raft_consensus.cc:1275] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
W20260709 12:25:33.587904 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 44701.3us
I20260709 12:25:33.616778 10847 raft_consensus.cc:1275] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:25:33.633325 13856 consensus_queue.cc:1048] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:33.663458 13718 consensus_queue.cc:1048] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:33.750150 13830 tablet_bootstrap.cc:492] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:33.796720 13830 tablet_bootstrap.cc:492] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap complete.
I20260709 12:25:33.797804 13830 ts_tablet_manager.cc:1403] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 3c52e0825c02476e89d84da9bb849f5d: Time spent bootstrapping tablet: real 1.300s	user 0.051s	sys 0.021s
I20260709 12:25:33.804737 10922 raft_consensus.cc:1275] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:25:33.806802 10928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
mode: GRACEFUL
new_leader_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:41546
I20260709 12:25:33.821728 13830 raft_consensus.cc:359] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 3c52e0825c02476e89d84da9bb849f5d [term 6 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:33.822815 13830 raft_consensus.cc:740] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 3c52e0825c02476e89d84da9bb849f5d [term 6 LEARNER]: Becoming Follower/Learner. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Initialized, Role: LEARNER
I20260709 12:25:33.855508 10928 raft_consensus.cc:606] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Received request to transfer leadership to TS 80cd7d227db44f34a6108591dad9c040
I20260709 12:25:33.850831 13850 consensus_queue.cc:1048] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
W20260709 12:25:33.950610 13889 log.cc:927] Time spent T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
W20260709 12:25:33.950769 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 48230.8us
W20260709 12:25:33.961467 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 90457.1us
I20260709 12:25:33.978572 10994 raft_consensus.cc:1275] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:25:33.964991 13891 log.cc:927] Time spent T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 12:25:34.012884 13895 log.cc:927] Time spent T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:25:33.867313 13830 consensus_queue.cc:260] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 3c52e0825c02476e89d84da9bb849f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:34.026707 13598 consensus_queue.cc:1048] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:34.017422 13855 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:45920 (request call id 197) took 1236 ms. Trace:
I20260709 12:25:34.029873 13855 rpcz_store.cc:276] 0709 12:25:32.789964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:32.793330 (+  3366us) service_pool.cc:224] Handling call
0709 12:25:33.028072 (+234742us) ts_tablet_manager.cc:934] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d: Initiating tablet copy from peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
0709 12:25:33.441705 (+413633us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:25:33.791256 (+349551us) tablet_metadata.cc:665] Metadata flushed
0709 12:25:33.791378 (+   122us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:25:34.016613 (+225235us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:25:34.016932 (+   319us) tablet_replica.cc:206] Creating consensus instance
0709 12:25:34.017254 (+   322us) ts_tablet_manager.cc:989] Replica registered.
0709 12:25:34.017320 (+    66us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":38162,"tablet-copy.queue_time_us":181108,"thread_start_us":174495,"threads_started":2}
I20260709 12:25:34.031978 13855 tablet_copy_client.cc:806] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 0 data blocks...
I20260709 12:25:34.043713 10994 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
mode: GRACEFUL
new_leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:32960
I20260709 12:25:34.044792 10994 raft_consensus.cc:606] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 LEADER]: Received request to transfer leadership to TS e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:34.074026 13830 ts_tablet_manager.cc:1434] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 3c52e0825c02476e89d84da9bb849f5d: Time spent starting tablet: real 0.276s	user 0.009s	sys 0.002s
I20260709 12:25:34.043778 13855 tablet_copy_client.cc:670] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:25:34.107546 11624 raft_consensus.cc:1217] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 3c52e0825c02476e89d84da9bb849f5d [term 6 LEARNER]: Deduplicated request from leader. Original: 6.5->[6.6-6.6]   Dedup: 6.6->[]
I20260709 12:25:34.113200 10864 tablet_copy_service.cc:342] P 80cd7d227db44f34a6108591dad9c040: Request end of tablet copy session 3c52e0825c02476e89d84da9bb849f5d-9f0dd1f84a304be0be5f4e4bf2aae6de received from {username='slave'} at 127.0.0.1:46480
I20260709 12:25:34.113943 10864 tablet_copy_service.cc:434] P 80cd7d227db44f34a6108591dad9c040: ending tablet copy session 3c52e0825c02476e89d84da9bb849f5d-9f0dd1f84a304be0be5f4e4bf2aae6de on tablet 9f0dd1f84a304be0be5f4e4bf2aae6de with peer 3c52e0825c02476e89d84da9bb849f5d
I20260709 12:25:34.128789 10923 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7ac83709373b4efd9c3aa1472a9f9022"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
mode: GRACEFUL
new_leader_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:41546
I20260709 12:25:34.129735 10923 raft_consensus.cc:606] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 LEADER]: Received request to transfer leadership to TS 80cd7d227db44f34a6108591dad9c040
I20260709 12:25:34.141746 13867 raft_consensus.cc:993] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea: : Instructing follower 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:25:34.142529 13661 raft_consensus.cc:1081] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 LEADER]: Signalling peer 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:25:34.163498 10994 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8b17195a94142039c40f598ed006c94"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
mode: GRACEFUL
new_leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:32960
I20260709 12:25:34.164446 10994 raft_consensus.cc:606] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 LEADER]: Received request to transfer leadership to TS e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:34.160337 13855 tablet_copy_client.cc:538] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:25:34.286437 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 47269.6us
W20260709 12:25:34.417109 13896 log.cc:927] Time spent T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:25:34.417887 10852 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7ac83709373b4efd9c3aa1472a9f9022"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:56394
I20260709 12:25:34.418906 10852 raft_consensus.cc:493] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:34.419400 10852 raft_consensus.cc:3060] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:25:34.429867 13904 log.cc:927] Time spent T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.224s	user 0.001s	sys 0.000s
I20260709 12:25:34.465350 10852 raft_consensus.cc:515] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:34.525439 10852 leader_election.cc:290] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:25:34.526265 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 227204us
I20260709 12:25:34.550393 11624 raft_consensus.cc:1275] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d [term 6 LEARNER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 12:25:34.552407 13906 log.cc:927] Time spent T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
W20260709 12:25:34.565179 13901 log.cc:927] Time spent T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.284s	user 0.002s	sys 0.000s
W20260709 12:25:34.585714 13894 log.cc:927] Time spent T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.681s	user 0.002s	sys 0.002s
I20260709 12:25:34.647732 13797 tablet_bootstrap.cc:492] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:34.651050 13855 tablet_bootstrap.cc:492] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap starting.
I20260709 12:25:34.653128 13797 tablet_bootstrap.cc:492] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap complete.
I20260709 12:25:34.657748 10848 raft_consensus.cc:1240] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 2. Current term is 3. Ops: []
I20260709 12:25:34.661193 13797 ts_tablet_manager.cc:1403] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d: Time spent bootstrapping tablet: real 1.466s	user 0.041s	sys 0.061s
I20260709 12:25:34.665681 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac83709373b4efd9c3aa1472a9f9022" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:34.666476 10928 raft_consensus.cc:3055] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:34.666551 10848 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
mode: GRACEFUL
new_leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:47358
I20260709 12:25:34.666884 10928 raft_consensus.cc:740] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:34.667152 10848 raft_consensus.cc:606] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 8 LEADER]: Received request to transfer leadership to TS e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:34.667718 10928 consensus_queue.cc:260] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:34.668870 10928 raft_consensus.cc:3060] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:34.699353 10928 raft_consensus.cc:2468] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 3.
I20260709 12:25:34.702955  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:25:34.706058  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:34.707402 10846 raft_consensus.cc:1275] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:25:34.713136  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:34.755049 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac83709373b4efd9c3aa1472a9f9022" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
W20260709 12:25:34.755412 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 205480us
I20260709 12:25:34.755945 10996 raft_consensus.cc:3060] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:34.756636 13718 raft_consensus.cc:993] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08: : Instructing follower e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:25:34.759605 13848 raft_consensus.cc:1081] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 LEADER]: Signalling peer e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:25:34.767477 10996 raft_consensus.cc:2468] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 3.
I20260709 12:25:34.788225 10925 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:59622
I20260709 12:25:34.788892 10925 raft_consensus.cc:493] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:34.789283 10925 raft_consensus.cc:3060] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:34.805225 10925 raft_consensus.cc:515] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:34.809698 13797 raft_consensus.cc:359] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:34.810721 13797 raft_consensus.cc:740] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Initialized, Role: LEARNER
I20260709 12:25:34.811479 13797 consensus_queue.cc:260] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:34.817443 13797 ts_tablet_manager.cc:1434] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d: Time spent starting tablet: real 0.156s	user 0.007s	sys 0.001s
I20260709 12:25:34.822167 13927 raft_consensus.cc:493] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:25:34.822894 13927 raft_consensus.cc:515] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:34.827314 10925 leader_election.cc:290] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:34.829282 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:34.829900 10996 raft_consensus.cc:3055] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:34.830204 10996 raft_consensus.cc:740] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:25:34.831144 10996 consensus_queue.cc:260] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:34.829510 13864 raft_consensus.cc:993] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08: : Instructing follower e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:25:34.840186 13864 raft_consensus.cc:1081] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 LEADER]: Signalling peer e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:25:34.845680 10925 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e8b17195a94142039c40f598ed006c94"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:59622
I20260709 12:25:34.846426 10925 raft_consensus.cc:493] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:34.846854 10925 raft_consensus.cc:3060] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:34.852975 10996 raft_consensus.cc:3060] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:34.863685 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:34.870491 11622 raft_consensus.cc:1217] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4]   Dedup: 3.4->[]
I20260709 12:25:34.888713 10925 raft_consensus.cc:515] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:34.895047 10928 raft_consensus.cc:1275] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:25:34.899462 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:34.901949 10925 leader_election.cc:290] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:34.904753 13876 raft_consensus.cc:493] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:25:34.905458 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b17195a94142039c40f598ed006c94" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:34.905503 13876 raft_consensus.cc:515] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:34.906924 11003 raft_consensus.cc:3055] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:34.907486 11003 raft_consensus.cc:740] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:25:34.908322 11003 consensus_queue.cc:260] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:34.909294 11003 raft_consensus.cc:3060] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:34.909335 13876 leader_election.cc:290] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:34.912688 10851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56394 (request call id 2639) took 1065 ms. Trace:
I20260709 12:25:34.913522 11013 tablet_copy_service.cc:342] P edcc56ddd3264984b4da6c1db59e7f08: Request end of tablet copy session 3c52e0825c02476e89d84da9bb849f5d-18294423a68a4671bf6c5a0f98645e4c received from {username='slave'} at 127.0.0.1:57514
I20260709 12:25:34.914027 11013 tablet_copy_service.cc:434] P edcc56ddd3264984b4da6c1db59e7f08: ending tablet copy session 3c52e0825c02476e89d84da9bb849f5d-18294423a68a4671bf6c5a0f98645e4c on tablet 18294423a68a4671bf6c5a0f98645e4c with peer 3c52e0825c02476e89d84da9bb849f5d
I20260709 12:25:34.918525 11003 raft_consensus.cc:2468] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 3.
I20260709 12:25:34.862295 13927 leader_election.cc:290] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:34.956355 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:34.957094 10846 raft_consensus.cc:3060] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:34.957428 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b17195a94142039c40f598ed006c94" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:34.958406 10853 raft_consensus.cc:3060] T e8b17195a94142039c40f598ed006c94 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:34.932188 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:34.886684 13718 consensus_queue.cc:1048] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 12:25:34.913180 10851 rpcz_store.cc:276] 0709 12:25:33.847594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:33.849560 (+  1966us) service_pool.cc:224] Handling call
0709 12:25:33.849914 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:33.850171 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:25:33.956728 (+106557us) log.cc:844] Serialized 14 byte log entry
0709 12:25:34.912187 (+955459us) spinlock_profiling.cc:243] Waited 21.3 ms on lock 0x7b18001a0bc0. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f759ac63ab1 00007f759ac70281 00007f7594a304bc 00007f7591d7e48b 00007f759abd89a9 00007f7591d9a69b 00007f7591d9893f 00007f7591d98455 00007f7594e80060 00007f7594e92716 00007f7594ea3287
0709 12:25:34.912293 (+   106us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:34.912343 (+    50us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:34.912395 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:34.912459 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:34.912583 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9840,"prepare.queue_time_us":182828,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":6030,"raft.queue_time_us":32221,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":4279,"spinlock_wait_cycles":48977792,"thread_start_us":165819,"threads_started":2}
I20260709 12:25:34.961416 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:34.968986 10850 raft_consensus.cc:2468] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 6.
I20260709 12:25:34.971197 13873 raft_consensus.cc:493] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:25:34.971947 13873 raft_consensus.cc:515] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:34.968142 13914 consensus_queue.cc:1048] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 12:25:34.975339 13873 leader_election.cc:290] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:34.988735 10819 leader_election.cc:304] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:25:34.990909 13858 raft_consensus.cc:2804] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:34.991973 13858 raft_consensus.cc:697] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [term 3 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:34.993063 13858 consensus_queue.cc:237] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:34.913105 10996 raft_consensus.cc:2468] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 7.
I20260709 12:25:35.004768 10846 raft_consensus.cc:2468] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 7.
I20260709 12:25:35.007879 13882 consensus_queue.cc:1048] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:35.020063 10968 leader_election.cc:304] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:35.024261 13847 raft_consensus.cc:2749] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:35.024587 13787 raft_consensus.cc:1064] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040: attempting to promote NON_VOTER 3c52e0825c02476e89d84da9bb849f5d to VOTER
I20260709 12:25:35.022639 10853 raft_consensus.cc:2468] T e8b17195a94142039c40f598ed006c94 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 3.
I20260709 12:25:35.025470 10852 raft_consensus.cc:1240] T e8b17195a94142039c40f598ed006c94 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 2. Current term is 3. Ops: []
W20260709 12:25:35.027709 10969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 139641us
I20260709 12:25:35.027974 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:25:35.032001 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 78979.3us
I20260709 12:25:35.032837 10895 leader_election.cc:304] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:25:35.033700 13867 raft_consensus.cc:2804] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:35.034014 10895 leader_election.cc:304] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:25:35.034426 13867 raft_consensus.cc:697] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:35.034281 13787 consensus_queue.cc:237] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 4, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:35.036566 13661 raft_consensus.cc:2804] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:35.037132 13661 raft_consensus.cc:697] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:35.038268 13661 consensus_queue.cc:237] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:35.042515 13867 consensus_queue.cc:237] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:35.077047 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:35.097213 10894 leader_election.cc:304] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:35.098218 13932 raft_consensus.cc:993] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea: : Instructing follower 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:25:35.098937 13932 raft_consensus.cc:1081] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Signalling peer 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:25:35.130800 10852 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:56394
I20260709 12:25:35.131618 10852 raft_consensus.cc:493] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:35.132066 10852 raft_consensus.cc:3060] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:35.111436 13851 raft_consensus.cc:2804] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:35.142990 10852 raft_consensus.cc:515] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:35.157326 10819 leader_election.cc:304] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:35.173215 10852 leader_election.cc:290] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:35.200158 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:35.200858 10998 raft_consensus.cc:3060] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:35.201509 13910 raft_consensus.cc:2749] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:25:35.200774 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 43801.8us
I20260709 12:25:35.207433 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:35.208135 10925 raft_consensus.cc:3055] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:35.208468 10925 raft_consensus.cc:740] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:35.209332 10925 consensus_queue.cc:260] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:35.210850 10925 raft_consensus.cc:3060] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:35.250869 11623 raft_consensus.cc:1275] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 3c52e0825c02476e89d84da9bb849f5d [term 6 LEARNER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:25:35.267491 10925 raft_consensus.cc:2468] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 7.
I20260709 12:25:35.275928 10819 leader_election.cc:304] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:25:35.281715 13868 raft_consensus.cc:993] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040: : Instructing follower e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:25:35.289846 10998 raft_consensus.cc:2468] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 7.
I20260709 12:25:35.293107 13851 raft_consensus.cc:493] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:25:35.293645 13851 raft_consensus.cc:3060] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:35.309337 13850 consensus_queue.cc:1048] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:35.317533 13694 raft_consensus.cc:2804] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:35.325847 13873 raft_consensus.cc:1081] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 8 LEADER]: Signalling peer e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:25:35.319778 13647 raft_consensus.cc:2955] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 6 LEADER]: Committing config change with OpId 6.6: config changed from index 5 to 6, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:35.355791 13858 raft_consensus.cc:493] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:25:35.381260 13858 raft_consensus.cc:515] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:35.408428 13858 leader_election.cc:290] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:25:35.407745 11622 raft_consensus.cc:2955] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 5 to 6, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:35.420831 10750 catalog_manager.cc:5697] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 2 to 3, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 3 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:35.445222 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:25:35.445261 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:35.464274 10751 catalog_manager.cc:5697] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: config changed from index 5 to 6, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New cstate: current_term: 6 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:35.472625 10846 raft_consensus.cc:2955] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 5 to 6, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:35.485440 10923 raft_consensus.cc:1275] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:25:35.488298 11003 raft_consensus.cc:1275] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:25:35.492219 10925 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:59626
I20260709 12:25:35.505972 10925 raft_consensus.cc:493] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:35.506553 10925 raft_consensus.cc:3060] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:35.474907 13694 raft_consensus.cc:697] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 7 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:35.533985 10925 raft_consensus.cc:515] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:35.537156 10925 leader_election.cc:290] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:25:35.553107 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 65651.6us
I20260709 12:25:35.560259 13694 consensus_queue.cc:237] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:35.571697 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:35.572381 10998 raft_consensus.cc:3060] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:35.569128 10820 leader_election.cc:304] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:35.574678 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:35.575281 10853 raft_consensus.cc:3055] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:35.575464 10847 raft_consensus.cc:1275] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:25:35.575615 10853 raft_consensus.cc:740] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:35.579360 10853 consensus_queue.cc:260] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:35.553035 13923 consensus_queue.cc:1048] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:25:35.588260 10853 raft_consensus.cc:3060] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:35.593613 10998 raft_consensus.cc:2468] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 9.
I20260709 12:25:35.594569 13850 consensus_queue.cc:1048] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 12:25:35.601884 10853 raft_consensus.cc:2468] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 9.
I20260709 12:25:35.605778 10895 leader_election.cc:304] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:25:35.594720 13860 raft_consensus.cc:2749] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:35.621796 13855 tablet_bootstrap.cc:492] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:35.623142 13855 tablet_bootstrap.cc:492] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap complete.
I20260709 12:25:35.624059 13855 ts_tablet_manager.cc:1403] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d: Time spent bootstrapping tablet: real 0.973s	user 0.070s	sys 0.064s
I20260709 12:25:35.627259 10997 raft_consensus.cc:1240] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:35.629187 13928 raft_consensus.cc:2804] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:35.629796 13928 raft_consensus.cc:697] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:35.630733 13928 consensus_queue.cc:237] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:35.628561 13853 raft_consensus.cc:1064] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08: attempting to promote NON_VOTER 3c52e0825c02476e89d84da9bb849f5d to VOTER
I20260709 12:25:35.663897 10998 raft_consensus.cc:1275] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:25:35.667647 10998 raft_consensus.cc:1275] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:25:35.670433 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 44207.3us
I20260709 12:25:35.674177 13851 raft_consensus.cc:515] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:35.675741 13853 consensus_queue.cc:237] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:35.676388 10924 raft_consensus.cc:1240] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:35.679656 10998 raft_consensus.cc:1275] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:35.723201 10923 raft_consensus.cc:1275] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:35.715337 13841 consensus_queue.cc:1048] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:25:35.745736 13851 leader_election.cc:290] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:25:35.691016 13878 consensus_queue.cc:1048] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:25:35.747943 13870 consensus_queue.cc:1048] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:35.749162 13855 raft_consensus.cc:359] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [term 8 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:35.750051 13855 raft_consensus.cc:740] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [term 8 LEARNER]: Becoming Follower/Learner. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Initialized, Role: LEARNER
I20260709 12:25:35.750790 13855 consensus_queue.cc:260] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:35.711197 13920 consensus_queue.cc:1059] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:25:35.715041 13923 consensus_queue.cc:1048] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 12:25:35.776396 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:25:35.782971 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:35.795908 13855 ts_tablet_manager.cc:1434] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d: Time spent starting tablet: real 0.171s	user 0.005s	sys 0.004s
I20260709 12:25:35.820358 10895 leader_election.cc:304] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:35.853027 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
W20260709 12:25:35.863724 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 43578.1us
I20260709 12:25:35.845868 11013 tablet_copy_service.cc:342] P edcc56ddd3264984b4da6c1db59e7f08: Request end of tablet copy session 3c52e0825c02476e89d84da9bb849f5d-60dca008c268416c8e63091506d1653e received from {username='slave'} at 127.0.0.1:57514
I20260709 12:25:35.904400 10849 raft_consensus.cc:1275] T e8b17195a94142039c40f598ed006c94 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:35.873685 13951 raft_consensus.cc:2749] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:25:35.951996 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 60270.4us
I20260709 12:25:35.941865 11013 tablet_copy_service.cc:434] P edcc56ddd3264984b4da6c1db59e7f08: ending tablet copy session 3c52e0825c02476e89d84da9bb849f5d-60dca008c268416c8e63091506d1653e on tablet 60dca008c268416c8e63091506d1653e with peer 3c52e0825c02476e89d84da9bb849f5d
W20260709 12:25:36.064083 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 71171.7us
W20260709 12:25:36.080046 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 141783us
I20260709 12:25:35.990468 13949 consensus_queue.cc:1048] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.074s
I20260709 12:25:36.107197 11623 raft_consensus.cc:1275] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d [term 3 LEARNER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:25:36.109395 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 119503us
I20260709 12:25:36.097496 13963 consensus_queue.cc:1048] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
W20260709 12:25:36.142343 13958 log.cc:927] Time spent T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.320s	user 0.002s	sys 0.007s
W20260709 12:25:36.138707 13961 log.cc:927] Time spent T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:25:36.165285 11623 raft_consensus.cc:1217] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [term 8 LEARNER]: Deduplicated request from leader. Original: 8.7->[8.8-8.8]   Dedup: 8.8->[]
I20260709 12:25:36.170089  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:36.176829 10846 raft_consensus.cc:1275] T 18294423a68a4671bf6c5a0f98645e4c P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:25:36.182997 13960 log.cc:927] Time spent T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:25:36.186677 13848 raft_consensus.cc:3055] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:36.187166 13848 raft_consensus.cc:740] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
W20260709 12:25:36.187901 13959 log.cc:927] Time spent T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.242s	user 0.000s	sys 0.003s
W20260709 12:25:36.190810 13957 log.cc:927] Time spent T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.286s	user 0.000s	sys 0.002s
I20260709 12:25:36.191071 10928 raft_consensus.cc:1275] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:25:36.193697 13931 consensus_queue.cc:1048] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:36.180248 13771 consensus_queue.cc:1048] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
W20260709 12:25:36.246945 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 49307.1us
W20260709 12:25:36.253752 13955 log.cc:927] Time spent T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.404s	user 0.002s	sys 0.000s
I20260709 12:25:36.265027 11003 raft_consensus.cc:1275] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:25:36.212739 13787 raft_consensus.cc:2955] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 6 LEADER]: Committing config change with OpId 6.7: config changed from index 6 to 7, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:36.299688 10846 raft_consensus.cc:1275] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:25:36.268006 10924 raft_consensus.cc:2955] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 6 to 7, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:36.328043 13913 consensus_queue.cc:1048] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:25:36.359090 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 147706us
I20260709 12:25:36.375392 13848 consensus_queue.cc:260] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:25:36.423205 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 132975us
W20260709 12:25:36.521495 13954 log.cc:927] Time spent T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.661s	user 0.004s	sys 0.000s
W20260709 12:25:36.545855 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 241077us
I20260709 12:25:36.572806 13864 consensus_queue.cc:1048] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:25:36.638250 10750 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60730 (request call id 243) took 1454 ms. Trace:
I20260709 12:25:36.643193 10751 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36188 (request call id 132) took 1192 ms. Trace:
I20260709 12:25:36.711936 13923 consensus_queue.cc:1048] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:25:36.715868 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:36.730721 10752 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60736 (request call id 269) took 1289 ms. Trace:
I20260709 12:25:36.717648 13848 raft_consensus.cc:3060] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:36.776782 10920 raft_consensus.cc:1275] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:25:36.788395 10927 raft_consensus.cc:1240] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:36.792912 10994 raft_consensus.cc:1275] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:25:36.795892 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 462085us
I20260709 12:25:36.802151 11624 raft_consensus.cc:2955] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 6 to 7, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:36.830053 13883 consensus_queue.cc:1048] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:25:36.830842 13983 log.cc:927] Time spent T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.152s	user 0.002s	sys 0.000s
I20260709 12:25:36.643862 10751 rpcz_store.cc:276] 0709 12:25:35.451244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:35.451414 (+   170us) service_pool.cc:224] Handling call
0709 12:25:36.643049 (+1191635us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:35.740450 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:35.741011 (+   561us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:35.741046 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:25:35.741063 (+    17us) tablet.cc:662] Decoding operations
0709 12:25:35.741493 (+   430us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:35.741543 (+    50us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:35.741573 (+    30us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:25:35.741774 (+   201us) tablet.cc:701] Row locks acquired
0709 12:25:35.741792 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:25:35.741934 (+   142us) write_op.cc:270] Start()
0709 12:25:35.742190 (+   256us) write_op.cc:276] Timestamp: P: 1783599935741887 usec, L: 0
0709 12:25:35.742217 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 12:25:35.743042 (+   825us) log.cc:844] Serialized 595 byte log entry
0709 12:25:36.524386 (+781344us) op_driver.cc:464] REPLICATION: finished
0709 12:25:36.524846 (+   460us) write_op.cc:301] APPLY: starting
0709 12:25:36.524957 (+   111us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:36.525102 (+   145us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:36.525266 (+   164us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:36.525814 (+   548us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:36.526152 (+   338us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:25:36.526227 (+    75us) write_op.cc:312] APPLY: finished
0709 12:25:36.526527 (+   300us) log.cc:844] Serialized 23 byte log entry
0709 12:25:36.526729 (+   202us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:36.526844 (+   115us) write_op.cc:454] Released schema lock
0709 12:25:36.526895 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:36.527451 (+   556us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:36.527491 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":112414,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":158,"apply.run_cpu_time_us":2442,"apply.run_wall_time_us":2443,"num_ops":1,"prepare.queue_time_us":260029,"prepare.run_cpu_time_us":2864,"prepare.run_wall_time_us":2863,"replication_time_us":782009}]]}
I20260709 12:25:36.638782 10750 rpcz_store.cc:276] 0709 12:25:35.184011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:35.184159 (+   148us) service_pool.cc:224] Handling call
0709 12:25:36.638107 (+1453948us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:35.602850 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:35.639821 (+ 36971us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:35.639874 (+    53us) write_op.cc:435] Acquired schema lock
0709 12:25:35.639902 (+    28us) tablet.cc:662] Decoding operations
0709 12:25:35.661249 (+ 21347us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:35.661347 (+    98us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:35.662914 (+  1567us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:25:35.668833 (+  5919us) tablet.cc:701] Row locks acquired
0709 12:25:35.668853 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:25:35.669008 (+   155us) write_op.cc:270] Start()
0709 12:25:35.669130 (+   122us) write_op.cc:276] Timestamp: P: 1783599935668962 usec, L: 0
0709 12:25:35.669152 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:25:35.672061 (+  2909us) log.cc:844] Serialized 538 byte log entry
0709 12:25:36.005292 (+333231us) op_driver.cc:464] REPLICATION: finished
0709 12:25:36.185771 (+180479us) write_op.cc:301] APPLY: starting
0709 12:25:36.185868 (+    97us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:36.185970 (+   102us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:36.186081 (+   111us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:36.186328 (+   247us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:36.186539 (+   211us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:25:36.186581 (+    42us) write_op.cc:312] APPLY: finished
0709 12:25:36.186779 (+   198us) log.cc:844] Serialized 23 byte log entry
0709 12:25:36.186959 (+   180us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:36.187037 (+    78us) write_op.cc:454] Released schema lock
0709 12:25:36.187076 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:36.187525 (+   449us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:36.187558 (+    33us) write_op.cc:454] Released schema lock
0709 12:25:36.523820 (+336262us) spinlock_profiling.cc:243] Waited 8.63 ms on lock 0x7b540007b554. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e8532a 00007f7594e0af14 00007f7594e0aec3 00007f7594e0ae38 00007f7594e0adf3 00007f7594e0a0dc 00007f7594e33e16 00007f7594e1bcbb 00007f7594e0639d 00007f7594e09d75
Metrics: {"reported_tablets":7,"spinlock_wait_cycles":4992,"child_traces":[["op",{"apply.queue_time_us":154866,"apply.run_cpu_time_us":1737,"apply.run_wall_time_us":6803,"mutex_wait_us":8564,"num_ops":1,"prepare.queue_time_us":140225,"prepare.run_cpu_time_us":5928,"prepare.run_wall_time_us":131558,"raft.queue_time_us":784839,"raft.run_cpu_time_us":25214,"raft.run_wall_time_us":528215,"replication_time_us":335956,"spinlock_wait_cycles":19839744,"thread_start_us":363671,"threads_started":4,"wal-append.queue_time_us":60023}]]}
I20260709 12:25:36.731285 10752 rpcz_store.cc:276] 0709 12:25:35.441678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:35.453532 (+ 11854us) service_pool.cc:224] Handling call
0709 12:25:36.730658 (+1277126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":168703,"reported_tablets":1}
W20260709 12:25:36.908855 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 136834us
W20260709 12:25:36.914026 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 111205us
I20260709 12:25:36.907182 10749 catalog_manager.cc:5697] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 2 to 3, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 3 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:36.955991 10749 catalog_manager.cc:5697] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 6 to 7, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 7 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:36.958287 10997 raft_consensus.cc:2955] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 6 to 7, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:37.019019 13724 raft_consensus.cc:493] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:25:37.020488 13724 raft_consensus.cc:515] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:37.031109 13867 consensus_queue.cc:1048] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
W20260709 12:25:37.041798 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 45437.9us
I20260709 12:25:37.045426 13724 leader_election.cc:290] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:25:37.056257 13911 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.006s	sys 0.006s
W20260709 12:25:37.056991 13911 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.006s	sys 0.006s
I20260709 12:25:37.120500 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18294423a68a4671bf6c5a0f98645e4c" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:37.148736 13981 raft_consensus.cc:1064] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08: attempting to promote NON_VOTER 3c52e0825c02476e89d84da9bb849f5d to VOTER
I20260709 12:25:37.153949 13981 consensus_queue.cc:237] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:25:37.164170 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 250830us
W20260709 12:25:37.223098 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 98348.4us
W20260709 12:25:37.223788 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 56740us
W20260709 12:25:37.277275 13848 consensus_meta.cc:287] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08: Time spent flushing consensus metadata: real 0.540s	user 0.012s	sys 0.011s
I20260709 12:25:37.313297 11622 raft_consensus.cc:1275] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [term 8 LEARNER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:25:37.293843 13601 raft_consensus.cc:2955] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:37.328948 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18294423a68a4671bf6c5a0f98645e4c" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:37.336051 13981 consensus_queue.cc:1048] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:25:37.344322 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 45412.9us
I20260709 12:25:37.356060 10751 catalog_manager.cc:5697] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: config changed from index 6 to 7, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New cstate: current_term: 6 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:37.369969 10923 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
mode: GRACEFUL
new_leader_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:41546
I20260709 12:25:37.370965 10923 raft_consensus.cc:606] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 LEADER]: Received request to transfer leadership to TS 80cd7d227db44f34a6108591dad9c040
I20260709 12:25:37.404795 11622 raft_consensus.cc:2955] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:37.428022 10922 raft_consensus.cc:1275] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:25:37.440032 10848 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
mode: GRACEFUL
new_leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:47358
I20260709 12:25:37.440814 10848 raft_consensus.cc:606] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 8 LEADER]: Received request to transfer leadership to TS e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:37.447219 10849 raft_consensus.cc:2955] T 18294423a68a4671bf6c5a0f98645e4c P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:37.452314 10848 raft_consensus.cc:1275] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:25:37.453408 13981 consensus_queue.cc:1048] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:37.465162 13998 raft_consensus.cc:993] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea: : Instructing follower 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:25:37.465785 13998 raft_consensus.cc:1081] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 LEADER]: Signalling peer 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:25:37.470314 10924 raft_consensus.cc:2955] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:37.480553 10848 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "834361a055d34950b4edecba39f07657"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
mode: GRACEFUL
new_leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:47358
I20260709 12:25:37.482043 10848 raft_consensus.cc:606] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 7 LEADER]: Received request to transfer leadership to TS e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:37.485011 10894 leader_election.cc:304] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:37.497450 13882 consensus_queue.cc:1048] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:37.514242 10997 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e9331e5342644ca2bae19187b083a7d5"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
mode: GRACEFUL
new_leader_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:32960
I20260709 12:25:37.515004 10997 raft_consensus.cc:606] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 LEADER]: Received request to transfer leadership to TS 80cd7d227db44f34a6108591dad9c040
I20260709 12:25:37.525642 10850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
mode: GRACEFUL
new_leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:47358
I20260709 12:25:37.527956 13784 raft_consensus.cc:993] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08: : Instructing follower 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:25:37.528716 13784 raft_consensus.cc:1081] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 LEADER]: Signalling peer 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:25:37.530017 10850 raft_consensus.cc:606] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 8 LEADER]: Received request to transfer leadership to TS edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:37.532040  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:25:37.538676  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:25:37.543510 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 65044.7us
I20260709 12:25:37.553879 10850 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e9331e5342644ca2bae19187b083a7d5"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:56388
I20260709 12:25:37.565258 10850 raft_consensus.cc:493] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:37.568953 10850 raft_consensus.cc:3060] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:37.592267 13994 raft_consensus.cc:493] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:25:37.593526 13994 raft_consensus.cc:515] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:37.630784 10850 raft_consensus.cc:515] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:37.641490 13982 raft_consensus.cc:2749] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:25:37.643806 13868 raft_consensus.cc:993] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040: : Instructing follower e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:25:37.644493 13862 raft_consensus.cc:1081] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 8 LEADER]: Signalling peer e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:25:37.651013 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:37.654066 13994 leader_election.cc:290] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:37.654780 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:37.655422 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:37.656368 10921 raft_consensus.cc:2393] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3c52e0825c02476e89d84da9bb849f5d in current term 7: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:25:37.656566 10997 raft_consensus.cc:2468] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 7.
I20260709 12:25:37.658653 11588 leader_election.cc:304] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:37.659904 13994 raft_consensus.cc:3060] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:37.676160 10849 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:56394
I20260709 12:25:37.677129 10849 raft_consensus.cc:493] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:37.677918 10849 raft_consensus.cc:3060] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:37.681816 13598 raft_consensus.cc:493] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:25:37.682581 13598 raft_consensus.cc:515] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:37.724504 10849 raft_consensus.cc:515] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:37.730335 10928 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:59626
I20260709 12:25:37.731881 10928 raft_consensus.cc:493] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:37.732261 10928 raft_consensus.cc:3060] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:37.739710 10849 leader_election.cc:290] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 10 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:37.758751 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:37.759465 11003 raft_consensus.cc:3060] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:37.762806 10928 raft_consensus.cc:515] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:37.777526 10850 leader_election.cc:290] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:37.779891 10928 leader_election.cc:290] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:25:37.779356 13998 raft_consensus.cc:493] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.784054 13998 raft_consensus.cc:515] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:37.796254 10749 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60734 (request call id 245) took 2333 ms. Trace:
W20260709 12:25:37.809329 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 45355us
I20260709 12:25:37.811455 13920 raft_consensus.cc:2955] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 8 LEADER]: Committing config change with OpId 8.9: config changed from index 8 to 9, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:37.819016  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:37.821084 13994 raft_consensus.cc:2749] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:37.830579 13998 leader_election.cc:290] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:25:37.832716 13598 leader_election.cc:290] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:25:37.838631 11623 raft_consensus.cc:2955] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Committing config change with OpId 8.9: config changed from index 8 to 9, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:37.826450 10752 catalog_manager.cc:5697] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 6 to 7, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 7 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:37.861467 10752 catalog_manager.cc:5697] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 8 to 9, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 9 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } }
I20260709 12:25:37.848805 11003 raft_consensus.cc:2468] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 10.
I20260709 12:25:37.796806 10749 rpcz_store.cc:276] 0709 12:25:35.458748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:35.459632 (+   884us) service_pool.cc:224] Handling call
0709 12:25:37.792234 (+2332602us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:37.160529 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:37.161483 (+   954us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:37.161554 (+    71us) write_op.cc:435] Acquired schema lock
0709 12:25:37.161577 (+    23us) tablet.cc:662] Decoding operations
0709 12:25:37.162161 (+   584us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:37.162352 (+   191us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:37.162436 (+    84us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:25:37.190151 (+ 27715us) tablet.cc:701] Row locks acquired
0709 12:25:37.234681 (+ 44530us) write_op.cc:260] PREPARE: finished
0709 12:25:37.234959 (+   278us) write_op.cc:270] Start()
0709 12:25:37.235195 (+   236us) write_op.cc:276] Timestamp: P: 1783599937234875 usec, L: 0
0709 12:25:37.235497 (+   302us) op_driver.cc:348] REPLICATION: starting
0709 12:25:37.239029 (+  3532us) log.cc:844] Serialized 923 byte log entry
0709 12:25:37.534826 (+295797us) op_driver.cc:464] REPLICATION: finished
0709 12:25:37.719952 (+185126us) write_op.cc:301] APPLY: starting
0709 12:25:37.720228 (+   276us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:37.720559 (+   331us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:37.741210 (+ 20651us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:37.752223 (+ 11013us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:37.752635 (+   412us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:25:37.752703 (+    68us) write_op.cc:312] APPLY: finished
0709 12:25:37.753100 (+   397us) log.cc:844] Serialized 29 byte log entry
0709 12:25:37.753355 (+   255us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:37.753450 (+    95us) write_op.cc:454] Released schema lock
0709 12:25:37.753519 (+    69us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:37.754065 (+   546us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:37.754094 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":268271,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":184727,"apply.run_cpu_time_us":3861,"apply.run_wall_time_us":34135,"num_ops":2,"prepare.queue_time_us":197531,"prepare.run_cpu_time_us":5641,"prepare.run_wall_time_us":81372,"replication_time_us":299097,"thread_start_us":150241,"threads_started":2}]]}
I20260709 12:25:37.894364 10751 catalog_manager.cc:5697] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: config changed from index 4 to 5, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:37.924256 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9331e5342644ca2bae19187b083a7d5" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:37.925122 10994 raft_consensus.cc:3055] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:25:37.925506 10994 raft_consensus.cc:740] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:25:37.926608 10994 consensus_queue.cc:260] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:37.930693 10994 raft_consensus.cc:3060] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:37.973033 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:37.974510 10997 raft_consensus.cc:2468] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 7.
I20260709 12:25:37.981263 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9331e5342644ca2bae19187b083a7d5" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:37.981889 10928 raft_consensus.cc:3060] T e9331e5342644ca2bae19187b083a7d5 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:37.991726 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:37.992440 10922 raft_consensus.cc:3055] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:37.992735 10922 raft_consensus.cc:740] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:37.993520 10922 consensus_queue.cc:260] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:37.994526 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:25:37.995558 11623 raft_consensus.cc:2468] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 7.
I20260709 12:25:37.997360 10922 raft_consensus.cc:3060] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:37.996237 10752 catalog_manager.cc:5697] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: config changed from index 8 to 9, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New cstate: current_term: 8 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:38.005542 10928 raft_consensus.cc:2468] T e9331e5342644ca2bae19187b083a7d5 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 4.
I20260709 12:25:38.015204 10922 raft_consensus.cc:2468] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 10.
I20260709 12:25:38.021349 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:38.022404 10921 raft_consensus.cc:2393] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 7: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:25:38.024649 10850 raft_consensus.cc:1240] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 3. Current term is 4. Ops: []
I20260709 12:25:38.027822 10851 raft_consensus.cc:2955] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Committing config change with OpId 8.9: config changed from index 8 to 9, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:38.032331 10819 leader_election.cc:304] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:25:38.033273 10819 leader_election.cc:304] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:25:38.034106 13694 raft_consensus.cc:2804] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:25:38.034632 13694 raft_consensus.cc:697] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:38.038199 10923 raft_consensus.cc:1240] T e9331e5342644ca2bae19187b083a7d5 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 3. Current term is 4. Ops: []
I20260709 12:25:38.036288 13694 consensus_queue.cc:237] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:38.049150 10994 raft_consensus.cc:2468] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 4.
I20260709 12:25:38.050881 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: true dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:25:38.051489 11623 raft_consensus.cc:3060] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:38.053584 11000 raft_consensus.cc:1240] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:38.054793 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:38.055414 10998 raft_consensus.cc:2468] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 7.
I20260709 12:25:38.075109 11623 raft_consensus.cc:2468] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 9.
I20260709 12:25:38.078763 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:25:38.089360 11622 raft_consensus.cc:2468] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 7.
I20260709 12:25:38.088060 14016 raft_consensus.cc:2804] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:38.090708 14016 raft_consensus.cc:697] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 10 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:38.091727 14016 consensus_queue.cc:237] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:25:38.088514 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 55316.5us
I20260709 12:25:38.134661 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:38.135519 10852 raft_consensus.cc:3055] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:38.135893 10852 raft_consensus.cc:740] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:38.136879 10852 consensus_queue.cc:260] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:38.138300 10852 raft_consensus.cc:3060] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:25:38.152127 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:38.158991 10994 consensus_queue.cc:237] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:38.166610 10997 consensus_queue.cc:237] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:38.169179 10850 raft_consensus.cc:1240] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 10 LEADER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:38.170172 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:38.212910 10851 raft_consensus.cc:2468] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 6.
I20260709 12:25:38.177983 10924 raft_consensus.cc:1240] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:38.178471 10852 raft_consensus.cc:2468] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 9.
I20260709 12:25:38.204918 14015 raft_consensus.cc:993] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040: : Instructing follower edcc56ddd3264984b4da6c1db59e7f08 to start an election
W20260709 12:25:38.218593 10893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:38.225596 13694 raft_consensus.cc:1081] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 8 LEADER]: Signalling peer edcc56ddd3264984b4da6c1db59e7f08 to start an election
W20260709 12:25:38.231843 10892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:38.233485 13598 raft_consensus.cc:993] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040: : Instructing follower e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:25:38.234081 13598 raft_consensus.cc:1081] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 7 LEADER]: Signalling peer e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:25:38.238996 10894 leader_election.cc:304] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:25:38.240314 13841 raft_consensus.cc:2804] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:38.240869 13841 raft_consensus.cc:697] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 9 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:38.241736 11623 raft_consensus.cc:1275] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:25:38.242120 13841 consensus_queue.cc:237] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:38.244022 13601 consensus_queue.cc:1048] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:38.246939 10923 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "834361a055d34950b4edecba39f07657"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:59626
I20260709 12:25:38.247517 10923 raft_consensus.cc:493] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:38.247874 10923 raft_consensus.cc:3060] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:38.252169 13864 raft_consensus.cc:2955] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 8 LEADER]: Committing config change with OpId 8.10: config changed from index 9 to 10, VOTER 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:38.277397 11623 raft_consensus.cc:2955] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Committing config change with OpId 8.10: config changed from index 9 to 10, VOTER 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:38.279678 10923 raft_consensus.cc:515] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:38.286295 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:38.286971 10851 raft_consensus.cc:3055] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:38.287281 10851 raft_consensus.cc:740] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:38.288369 10851 consensus_queue.cc:260] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:38.289696 10851 raft_consensus.cc:3060] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:38.297616 10923 leader_election.cc:290] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:25:38.300737 10969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:38.318838 10968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:38.335489 10751 catalog_manager.cc:5697] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: config changed from index 9 to 10, VOTER 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) evicted. New cstate: current_term: 8 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:38.358260 11622 raft_consensus.cc:1275] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d [term 3 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:25:38.363480 13920 consensus_queue.cc:1048] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:38.377208 13784 raft_consensus.cc:2955] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:38.381178 11622 raft_consensus.cc:2955] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:38.414528 10739 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 18294423a68a4671bf6c5a0f98645e4c with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:25:38.426074 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 76825.1us
I20260709 12:25:38.428845 10895 leader_election.cc:304] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:25:38.429884 13911 raft_consensus.cc:2804] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:38.430387 13911 raft_consensus.cc:493] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:38.431197 13911 raft_consensus.cc:3060] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:38.438905 10739 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 60dca008c268416c8e63091506d1653e with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:25:38.442785 10923 raft_consensus.cc:1275] T e9331e5342644ca2bae19187b083a7d5 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:25:38.434669 10752 catalog_manager.cc:5697] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: config changed from index 5 to 6, VOTER 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) evicted. New cstate: current_term: 3 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:38.444679 14016 consensus_queue.cc:1048] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:38.460547 11003 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:37512
I20260709 12:25:38.464006 10851 raft_consensus.cc:2468] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 8.
I20260709 12:25:38.461462 11003 raft_consensus.cc:493] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:38.472637 11003 raft_consensus.cc:3060] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:25:38.497445 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 73998.5us
W20260709 12:25:38.541627 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 55583.8us
I20260709 12:25:38.544795 10894 leader_election.cc:304] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:25:38.545924 13876 raft_consensus.cc:2804] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:38.546473 13876 raft_consensus.cc:697] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:38.547408 13876 consensus_queue.cc:237] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:38.574167 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:38.574877 11000 raft_consensus.cc:3060] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:38.581480 11003 raft_consensus.cc:515] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:38.584240 11003 leader_election.cc:290] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:38.615777 10851 consensus_queue.cc:237] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:38.623350 11000 raft_consensus.cc:2468] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 8.
I20260709 12:25:38.633814 10835 tablet_service.cc:1558] Processing DeleteTablet for tablet 60dca008c268416c8e63091506d1653e with delete_type TABLET_DATA_TOMBSTONED (TS 80cd7d227db44f34a6108591dad9c040 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:56372
W20260709 12:25:38.637374 10968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:38.640735 10923 raft_consensus.cc:2955] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Committing config change with OpId 8.9: config changed from index 8 to 9, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:38.656675 10921 raft_consensus.cc:1275] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:25:38.657997 10820 leader_election.cc:304] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:38.659350 10844 tablet_service.cc:1558] Processing DeleteTablet for tablet 18294423a68a4671bf6c5a0f98645e4c with delete_type TABLET_DATA_TOMBSTONED (TS 80cd7d227db44f34a6108591dad9c040 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:56372
I20260709 12:25:38.663415 14027 tablet_replica.cc:333] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040: stopping tablet replica
I20260709 12:25:38.664419 10924 raft_consensus.cc:1275] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:25:38.664880 14027 raft_consensus.cc:2243] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:38.666181 13862 consensus_queue.cc:1048] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:38.666599 14027 raft_consensus.cc:2272] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:38.668776 13868 raft_consensus.cc:2804] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:38.669479 13868 raft_consensus.cc:493] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:25:38.669879 13868 raft_consensus.cc:3060] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:38.672107 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:38.672950 10928 raft_consensus.cc:3060] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:38.677399 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:38.678387 10851 raft_consensus.cc:3055] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:38.682520 10851 raft_consensus.cc:740] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:38.683455 10851 consensus_queue.cc:260] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:38.684615 10851 raft_consensus.cc:3060] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:38.689782 13911 raft_consensus.cc:515] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:38.699456 10998 raft_consensus.cc:1275] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:25:38.700400 10928 raft_consensus.cc:2468] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 9.
I20260709 12:25:38.725147 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:38.701174 11000 raft_consensus.cc:1240] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:38.705135 14027 ts_tablet_manager.cc:1916] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:25:38.699462 10997 raft_consensus.cc:1275] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:25:38.710913 10852 raft_consensus.cc:1275] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:25:38.710150 10922 raft_consensus.cc:1275] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:25:38.701431 11623 raft_consensus.cc:1275] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:25:38.706836 13911 leader_election.cc:290] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:25:38.748172 10851 raft_consensus.cc:2468] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 9.
I20260709 12:25:38.768005 10922 raft_consensus.cc:1275] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:25:38.770879 10751 catalog_manager.cc:5697] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 3 to 4, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 4 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:38.772727 10751 catalog_manager.cc:5697] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 9 to 10, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 10 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:38.744922 13841 consensus_queue.cc:1048] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 12:25:38.790525 14015 raft_consensus.cc:2955] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 6 LEADER]: Committing config change with OpId 6.8: config changed from index 7 to 8, VOTER edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:38.795504 13868 raft_consensus.cc:515] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:38.795277 10922 raft_consensus.cc:2955] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Committing config change with OpId 6.8: config changed from index 7 to 8, VOTER edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:38.797209 10850 raft_consensus.cc:3060] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:38.804919 14016 consensus_queue.cc:1048] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:38.809612 13868 leader_election.cc:290] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
W20260709 12:25:38.820197 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 44305.5us
I20260709 12:25:38.819221 10850 raft_consensus.cc:2468] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 8.
W20260709 12:25:38.832448 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 100292us
I20260709 12:25:38.833595 13868 consensus_queue.cc:1048] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:38.853034 14027 ts_tablet_manager.cc:1929] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 8.9
I20260709 12:25:38.854357 14027 log.cc:1199] T 60dca008c268416c8e63091506d1653e P 80cd7d227db44f34a6108591dad9c040: Deleting WAL directory at /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599781984018-9681-0/minicluster-data/ts-0-root/wals/60dca008c268416c8e63091506d1653e
I20260709 12:25:38.856983 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:38.857865 10923 raft_consensus.cc:2368] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 7. Current term is 8.
I20260709 12:25:38.862504 13868 consensus_queue.cc:1048] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:38.863490 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:38.864346 10968 leader_election.cc:304] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:25:38.866695 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:25:38.866554 13848 raft_consensus.cc:2804] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:38.868266 13848 raft_consensus.cc:697] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 9 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:25:38.869155 13848 consensus_queue.cc:237] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:38.878481 14016 consensus_queue.cc:1048] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:38.879192 10819 leader_election.cc:400] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 election: Vote denied by peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339) with higher term. Message: Invalid argument: T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 7. Current term is 8.
I20260709 12:25:38.879496 10819 leader_election.cc:403] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:25:38.880355 14032 raft_consensus.cc:2749] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339) with higher term. Message: Invalid argument: T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 7. Current term is 8.
I20260709 12:25:38.891191 10738 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9f0dd1f84a304be0be5f4e4bf2aae6de with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:25:38.894718 11000 raft_consensus.cc:2468] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 7.
I20260709 12:25:38.918027 11623 raft_consensus.cc:2468] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 7.
I20260709 12:25:38.928035 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:38.929091 11000 raft_consensus.cc:3060] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:38.950899 11000 raft_consensus.cc:2468] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 8.
I20260709 12:25:38.960076 11624 raft_consensus.cc:2955] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Committing config change with OpId 6.8: config changed from index 7 to 8, VOTER edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:38.983069 11622 raft_consensus.cc:1275] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 12:25:38.975422 14034 log.cc:927] Time spent T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.055s	user 0.002s	sys 0.000s
I20260709 12:25:38.989017 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:25:38.989622 11622 raft_consensus.cc:3060] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:38.966789 13784 consensus_queue.cc:1048] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:25:39.002801 10752 catalog_manager.cc:5697] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 8 to 9, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 9 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:39.006620 10752 catalog_manager.cc:5697] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 reported cstate change: config changed from index 7 to 8, VOTER edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) evicted. New cstate: current_term: 6 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:39.050741 11622 raft_consensus.cc:2468] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 8.
I20260709 12:25:39.059201 10738 catalog_manager.cc:5028] TS 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): tablet 60dca008c268416c8e63091506d1653e (table test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]) successfully deleted
I20260709 12:25:39.059993 14027 tablet_replica.cc:333] T 18294423a68a4671bf6c5a0f98645e4c P 80cd7d227db44f34a6108591dad9c040: stopping tablet replica
I20260709 12:25:39.061160 14027 raft_consensus.cc:2243] T 18294423a68a4671bf6c5a0f98645e4c P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:39.062088 14027 raft_consensus.cc:2272] T 18294423a68a4671bf6c5a0f98645e4c P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:39.090653 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 125596us
I20260709 12:25:39.118846 10997 raft_consensus.cc:1275] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:25:39.122911 10895 leader_election.cc:304] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:25:39.104936 14042 consensus_queue.cc:1048] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
W20260709 12:25:39.187165 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 53427.9us
I20260709 12:25:39.211529  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:39.212013 13911 consensus_queue.cc:1048] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:25:39.208806 13952 log.cc:927] Time spent T 00000000000000000000000000000000 P 9619ad7a9e7f4d9b8039487e3ee77243: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:25:39.208097 13876 raft_consensus.cc:2804] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:39.261233 13876 raft_consensus.cc:697] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 8 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:39.264910 13876 consensus_queue.cc:237] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:39.273638 14027 ts_tablet_manager.cc:1916] T 18294423a68a4671bf6c5a0f98645e4c P 80cd7d227db44f34a6108591dad9c040: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:25:39.304257 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 115709us
I20260709 12:25:39.333689 10922 raft_consensus.cc:2955] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:39.354153 10923 raft_consensus.cc:2955] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Committing config change with OpId 8.10: config changed from index 9 to 10, VOTER 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:39.368352 14056 consensus_queue.cc:1048] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
W20260709 12:25:39.460768 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 80896.2us
I20260709 12:25:39.504370 10850 raft_consensus.cc:1275] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:25:39.518067 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 51458.2us
I20260709 12:25:39.541976 13911 consensus_queue.cc:1048] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:39.551743 10750 catalog_manager.cc:5697] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 8 to 9, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 9 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:39.527249 14027 ts_tablet_manager.cc:1929] T 18294423a68a4671bf6c5a0f98645e4c P 80cd7d227db44f34a6108591dad9c040: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 12:25:39.575198 10921 raft_consensus.cc:1275] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:25:39.580401 10992 tablet_service.cc:1558] Processing DeleteTablet for tablet 9f0dd1f84a304be0be5f4e4bf2aae6de with delete_type TABLET_DATA_TOMBSTONED (TS edcc56ddd3264984b4da6c1db59e7f08 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:37496
I20260709 12:25:39.575776 14027 log.cc:1199] T 18294423a68a4671bf6c5a0f98645e4c P 80cd7d227db44f34a6108591dad9c040: Deleting WAL directory at /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599781984018-9681-0/minicluster-data/ts-0-root/wals/18294423a68a4671bf6c5a0f98645e4c
I20260709 12:25:39.631804 13784 consensus_queue.cc:1048] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:25:39.657981 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 280082us
I20260709 12:25:39.661767 10738 catalog_manager.cc:5028] TS 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): tablet 18294423a68a4671bf6c5a0f98645e4c (table test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]) successfully deleted
I20260709 12:25:39.703708 10850 raft_consensus.cc:1275] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:25:39.740597 10850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
mode: GRACEFUL
new_leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:47358
I20260709 12:25:39.741446 10850 raft_consensus.cc:606] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 7 LEADER]: Received request to transfer leadership to TS edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:39.711658 14074 tablet_replica.cc:333] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08: stopping tablet replica
I20260709 12:25:39.744428 14074 raft_consensus.cc:2243] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:39.753961 11003 raft_consensus.cc:1275] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:25:39.763633 14013 consensus_queue.cc:1048] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:39.770746 10750 catalog_manager.cc:5697] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 7 to 8, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 8 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } }
I20260709 12:25:39.773924 14074 raft_consensus.cc:2272] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:39.790396 14067 consensus_queue.cc:1048] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:39.801635 11623 raft_consensus.cc:1275] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:25:39.835393 10848 raft_consensus.cc:1275] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:25:39.867905 10751 catalog_manager.cc:5697] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: config changed from index 6 to 5, term changed from 6 to 8, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from VOTER to NON_VOTER, now has a pending config: VOTER 80cd7d227db44f34a6108591dad9c040 (127.9.116.65), VOTER e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66), VOTER edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67), VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68). New cstate: current_term: 8 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:39.890100 13841 consensus_queue.cc:1048] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 12:25:39.920768 14074 ts_tablet_manager.cc:1916] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:25:39.947746 14081 log.cc:927] Time spent T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:25:39.949092 14052 consensus_queue.cc:1048] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
W20260709 12:25:39.983753 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 77036.3us
I20260709 12:25:40.041576 10849 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
mode: GRACEFUL
new_leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:47358
I20260709 12:25:40.042210 10849 raft_consensus.cc:606] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 6 LEADER]: Received request to transfer leadership to TS edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:40.042608 10849 raft_consensus.cc:630] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 6 LEADER]: Rejecting request to transfer leadership because tablet server edcc56ddd3264984b4da6c1db59e7f08 is not a voter in the active config
I20260709 12:25:40.050900 10922 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
mode: GRACEFUL
new_leader_uuid: "3c52e0825c02476e89d84da9bb849f5d"
 from {username='slave'} at 127.0.0.1:41546
I20260709 12:25:40.051537 10922 raft_consensus.cc:606] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 LEADER]: Received request to transfer leadership to TS 3c52e0825c02476e89d84da9bb849f5d
I20260709 12:25:40.055989 14064 raft_consensus.cc:993] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040: : Instructing follower edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:25:40.056596 14064 raft_consensus.cc:1081] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 7 LEADER]: Signalling peer edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:25:40.072225 14074 ts_tablet_manager.cc:1929] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 6.7
I20260709 12:25:40.077234 10849 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
mode: GRACEFUL
new_leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:47358
I20260709 12:25:40.077998 10849 raft_consensus.cc:606] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 7 LEADER]: Received request to transfer leadership to TS edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:40.080626 14074 log.cc:1199] T 9f0dd1f84a304be0be5f4e4bf2aae6de P edcc56ddd3264984b4da6c1db59e7f08: Deleting WAL directory at /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599781984018-9681-0/minicluster-data/ts-2-root/wals/9f0dd1f84a304be0be5f4e4bf2aae6de
I20260709 12:25:40.091398 11002 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:37512
I20260709 12:25:40.092278 11002 raft_consensus.cc:493] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:40.092674 11002 raft_consensus.cc:3060] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:40.113125 10849 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
mode: GRACEFUL
new_leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:47358
I20260709 12:25:40.114544 10849 raft_consensus.cc:606] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Received request to transfer leadership to TS edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:40.115021 10849 raft_consensus.cc:614] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:40.121341  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:25:40.103022 10739 catalog_manager.cc:5028] TS edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): tablet 9f0dd1f84a304be0be5f4e4bf2aae6de (table test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]) successfully deleted
I20260709 12:25:40.130882  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:40.131901  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:40.133589 10750 catalog_manager.cc:5697] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: config changed from index 5 to 6, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 80cd7d227db44f34a6108591dad9c040 (127.9.116.65), VOTER e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66), VOTER edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67), VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68). New cstate: current_term: 8 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:40.143537 11002 raft_consensus.cc:515] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:40.146227 11002 leader_election.cc:290] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:40.151837 10921 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:59610
I20260709 12:25:40.152565 10921 raft_consensus.cc:606] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 8 LEADER]: Received request to transfer leadership
I20260709 12:25:40.181672 10921 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:59610
I20260709 12:25:40.182273 10921 raft_consensus.cc:606] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 8 LEADER]: Received request to transfer leadership
W20260709 12:25:40.183399 10738 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for c2937f569e8041d9a71a575dc1b9d74d already in progress
W20260709 12:25:40.191758 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 54854.1us
W20260709 12:25:40.192553 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 53500.4us
I20260709 12:25:40.194015 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:40.194602 10849 raft_consensus.cc:3055] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:40.196597 10849 raft_consensus.cc:740] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:40.197440 10849 consensus_queue.cc:260] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:40.199679 10849 raft_consensus.cc:3060] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:40.233156 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:40.233853 10921 raft_consensus.cc:3060] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:25:40.231884 10738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 48506.8us
I20260709 12:25:40.239413 10849 raft_consensus.cc:2468] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 8.
I20260709 12:25:40.240875 10968 leader_election.cc:304] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:25:40.242031 14021 raft_consensus.cc:2804] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:40.242502 14061 raft_consensus.cc:993] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea: : Instructing follower 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:25:40.242643 14021 raft_consensus.cc:697] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 8 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:25:40.243088 14061 raft_consensus.cc:1081] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 8 LEADER]: Signalling peer 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:25:40.243643 14021 consensus_queue.cc:237] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:40.245491 14066 raft_consensus.cc:2955] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 8 LEADER]: Committing config change with OpId 6.6: config changed from index 5 to 6, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:40.254770 10849 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:56394
I20260709 12:25:40.255497 10921 raft_consensus.cc:2468] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 8.
I20260709 12:25:40.256069 10849 raft_consensus.cc:493] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:40.265571 10849 raft_consensus.cc:3060] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:40.267318 14061 raft_consensus.cc:993] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea: : Instructing follower 3c52e0825c02476e89d84da9bb849f5d to start an election
I20260709 12:25:40.267858 10923 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:59610
I20260709 12:25:40.268014 14035 raft_consensus.cc:1081] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 LEADER]: Signalling peer 3c52e0825c02476e89d84da9bb849f5d to start an election
I20260709 12:25:40.290493 10849 raft_consensus.cc:515] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:40.324838 11623 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4"
dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
 from {username='slave'} at 127.0.0.1:45904
I20260709 12:25:40.325562 11623 raft_consensus.cc:493] T b289bc89d592435fb63c7fcf580d95a4 P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:40.325915 11623 raft_consensus.cc:3060] T b289bc89d592435fb63c7fcf580d95a4 P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:40.337667 11623 raft_consensus.cc:515] T b289bc89d592435fb63c7fcf580d95a4 P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:40.340723 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:40.341353 10922 raft_consensus.cc:3055] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:40.341655 10922 raft_consensus.cc:740] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:40.342418 10922 consensus_queue.cc:260] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:40.343310 10922 raft_consensus.cc:3060] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:40.344871 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:40.345526 11002 raft_consensus.cc:3060] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:40.345930 11623 leader_election.cc:290] T b289bc89d592435fb63c7fcf580d95a4 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 10 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:40.352473 10923 raft_consensus.cc:606] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 8 LEADER]: Received request to transfer leadership
I20260709 12:25:40.360486 10751 catalog_manager.cc:5697] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 7 to 8, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 8 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
W20260709 12:25:40.367367 10800 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 12:25:40.367936 10800 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for c2937f569e8041d9a71a575dc1b9d74d already in progress
W20260709 12:25:40.368274 10800 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for c2937f569e8041d9a71a575dc1b9d74d already in progress
I20260709 12:25:40.380302 10922 raft_consensus.cc:2468] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 10.
I20260709 12:25:40.395934 11002 raft_consensus.cc:2468] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 10.
I20260709 12:25:40.397679 11589 leader_election.cc:304] T b289bc89d592435fb63c7fcf580d95a4 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:25:40.398913 14063 raft_consensus.cc:2804] T b289bc89d592435fb63c7fcf580d95a4 P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:40.399740 14063 raft_consensus.cc:697] T b289bc89d592435fb63c7fcf580d95a4 P 3c52e0825c02476e89d84da9bb849f5d [term 10 LEADER]: Becoming Leader. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
I20260709 12:25:40.400653 14063 consensus_queue.cc:237] T b289bc89d592435fb63c7fcf580d95a4 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:40.404858 10852 raft_consensus.cc:1240] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:40.411899 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:40.412918 10922 raft_consensus.cc:3055] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:40.413296 10922 raft_consensus.cc:740] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:40.415724 10849 leader_election.cc:290] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:25:40.416993 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: true dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:25:40.417517 11623 raft_consensus.cc:3060] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:40.419020 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:40.419530 11003 raft_consensus.cc:3060] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:40.414409 10922 consensus_queue.cc:260] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:40.424396 14035 consensus_queue.cc:1059] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 12:25:40.453502 11003 raft_consensus.cc:2468] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 9.
I20260709 12:25:40.457050 11623 raft_consensus.cc:2468] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 9.
I20260709 12:25:40.458683 10820 leader_election.cc:304] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:25:40.460085 14064 raft_consensus.cc:2804] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:40.462895 14064 raft_consensus.cc:697] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 9 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:40.464080 14064 consensus_queue.cc:237] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:40.476765 10922 raft_consensus.cc:3060] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:40.497675 10922 raft_consensus.cc:2468] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 9.
I20260709 12:25:40.502895 10749 catalog_manager.cc:5697] T b289bc89d592435fb63c7fcf580d95a4 P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: term changed from 9 to 10, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68). New cstate: current_term: 10 leader_uuid: "3c52e0825c02476e89d84da9bb849f5d" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:40.510033 10751 catalog_manager.cc:5697] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 8 to 9, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 9 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:40.568048 13598 raft_consensus.cc:993] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040: : Instructing follower edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:25:40.568609 14049 raft_consensus.cc:1081] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 7 LEADER]: Signalling peer edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:25:40.571214 11002 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:37512
I20260709 12:25:40.572160 11002 raft_consensus.cc:493] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:40.572592 11002 raft_consensus.cc:3060] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:40.599081 11002 raft_consensus.cc:515] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:40.605209 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:40.606083 10852 raft_consensus.cc:3055] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:40.606436 10852 raft_consensus.cc:740] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:40.609783 10852 consensus_queue.cc:260] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:40.611186 10852 raft_consensus.cc:3060] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:40.613641 11002 leader_election.cc:290] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:40.623194 10852 raft_consensus.cc:2468] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 8.
I20260709 12:25:40.625303 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:40.626165 10921 raft_consensus.cc:3060] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:40.627827 10968 leader_election.cc:304] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:25:40.629805 13601 raft_consensus.cc:2804] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:40.630381 13601 raft_consensus.cc:697] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:25:40.631309 13601 consensus_queue.cc:237] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:40.644471 10921 raft_consensus.cc:2468] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 8.
I20260709 12:25:40.694989 10751 catalog_manager.cc:5697] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 7 to 8, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 8 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:40.751814 10921 raft_consensus.cc:1275] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:25:40.760169 13601 consensus_queue.cc:1048] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:40.781167 10852 raft_consensus.cc:1275] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:25:40.785709 13848 consensus_queue.cc:1048] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:40.883678 10922 raft_consensus.cc:1275] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:25:40.887055 14063 consensus_queue.cc:1048] T b289bc89d592435fb63c7fcf580d95a4 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:25:40.894304 11623 raft_consensus.cc:1275] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:25:40.900918 14086 consensus_queue.cc:1048] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:40.941107 11002 raft_consensus.cc:1275] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:25:40.945169 14063 consensus_queue.cc:1048] T b289bc89d592435fb63c7fcf580d95a4 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:41.088057 10920 raft_consensus.cc:1275] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:25:41.090246 14086 consensus_queue.cc:1048] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:41.106762 11002 raft_consensus.cc:1275] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:25:41.117594 14086 consensus_queue.cc:1048] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:41.231395 10852 raft_consensus.cc:1275] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:25:41.233443 13864 consensus_queue.cc:1048] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:41.274811 10922 raft_consensus.cc:1275] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:25:41.277402 14021 consensus_queue.cc:1048] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:25:41.430032  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:41.556777 10852 consensus_queue.cc:237] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:41.579205 11622 raft_consensus.cc:1275] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:41.585744 14086 consensus_queue.cc:1048] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:41.599845 14100 raft_consensus.cc:2955] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 9 LEADER]: Committing config change with OpId 9.9: config changed from index 6 to 9, VOTER e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:41.610248 10920 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
mode: GRACEFUL
new_leader_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:41546
I20260709 12:25:41.612843 10920 raft_consensus.cc:606] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Received request to transfer leadership to TS 80cd7d227db44f34a6108591dad9c040
I20260709 12:25:41.620803 11623 raft_consensus.cc:2955] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 6 to 9, VOTER e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:41.626084 10849 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7ac83709373b4efd9c3aa1472a9f9022"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
mode: GRACEFUL
new_leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:47358
I20260709 12:25:41.626801 10849 raft_consensus.cc:606] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [term 3 LEADER]: Received request to transfer leadership to TS edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:41.643473 10998 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
mode: GRACEFUL
new_leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:32960
I20260709 12:25:41.644338 10998 raft_consensus.cc:606] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 9 LEADER]: Received request to transfer leadership to TS e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:41.645963  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:25:41.647461 10738 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c2937f569e8041d9a71a575dc1b9d74d with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:25:41.647931  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:41.648881  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:41.662446 10998 raft_consensus.cc:1275] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:41.667196 14100 consensus_queue.cc:1048] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:41.674559 10998 raft_consensus.cc:2955] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 6 to 9, VOTER e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:41.675251 10749 catalog_manager.cc:5697] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 reported cstate change: config changed from index 6 to 9, VOTER e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) evicted. New cstate: current_term: 9 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:41.755515 14103 raft_consensus.cc:993] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea: : Instructing follower 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:25:41.756350 14103 raft_consensus.cc:1081] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Signalling peer 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:25:41.759465 10852 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:56394
I20260709 12:25:41.760118 10852 raft_consensus.cc:493] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:41.760473 10852 raft_consensus.cc:3060] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:41.779888 10852 raft_consensus.cc:515] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:41.785392 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:41.786163 10998 raft_consensus.cc:3060] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:41.790464 11002 consensus_queue.cc:237] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:41.783742 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:41.800392 10922 raft_consensus.cc:3055] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:41.800758 10922 raft_consensus.cc:740] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:41.801996 10922 consensus_queue.cc:260] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:41.824692 10922 raft_consensus.cc:3060] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:41.825709 10852 leader_election.cc:290] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:41.827098 10998 raft_consensus.cc:2468] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 7.
I20260709 12:25:41.863519 10820 leader_election.cc:304] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:25:41.871973 10922 raft_consensus.cc:2468] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 7.
I20260709 12:25:41.872077 14099 raft_consensus.cc:2804] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:41.878799 14099 raft_consensus.cc:697] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 7 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:41.879912 14099 consensus_queue.cc:237] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:41.902004 10852 raft_consensus.cc:1275] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 12:25:41.908967 10969 consensus_peers.cc:597] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613): Couldn't send request to peer 3c52e0825c02476e89d84da9bb849f5d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c63ecfc9bd3945818cfe15c03f001315. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:41.911605 13864 consensus_queue.cc:1048] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:25:41.913986 10922 raft_consensus.cc:1275] T c63ecfc9bd3945818cfe15c03f001315 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:25:41.923275 14086 raft_consensus.cc:993] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040: : Instructing follower edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:25:41.923952 14086 raft_consensus.cc:1081] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [term 3 LEADER]: Signalling peer edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:25:41.926010 11002 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7ac83709373b4efd9c3aa1472a9f9022"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:37512
I20260709 12:25:41.926719 11002 raft_consensus.cc:493] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:41.927096 11002 raft_consensus.cc:3060] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:41.926994 13864 consensus_queue.cc:1048] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:25:41.927975 14084 raft_consensus.cc:993] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08: : Instructing follower e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:25:41.929248 13848 raft_consensus.cc:1081] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 9 LEADER]: Signalling peer e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:25:41.933035 10922 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:59622
I20260709 12:25:41.933713 10922 raft_consensus.cc:493] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:41.934055 10922 raft_consensus.cc:3060] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:41.939232 11002 raft_consensus.cc:515] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:41.948315 11002 leader_election.cc:290] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:41.950874 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac83709373b4efd9c3aa1472a9f9022" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:41.951679 10849 raft_consensus.cc:3055] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:25:41.952015 10849 raft_consensus.cc:740] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:41.953127 10849 consensus_queue.cc:260] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:41.956445 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac83709373b4efd9c3aa1472a9f9022" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:41.957252 10921 raft_consensus.cc:3060] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:41.967829 10849 raft_consensus.cc:3060] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:41.945837 10922 raft_consensus.cc:515] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:41.971078 10922 leader_election.cc:290] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 10 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:41.972281 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:41.973712 11002 raft_consensus.cc:3055] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:41.974077 11002 raft_consensus.cc:740] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:25:41.974895 11002 consensus_queue.cc:260] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:41.975813 10921 raft_consensus.cc:2468] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 4.
I20260709 12:25:41.976643 11002 raft_consensus.cc:3060] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:41.977277 10968 leader_election.cc:304] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:25:41.990902 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:41.978369 13848 raft_consensus.cc:2804] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:25:41.991576 10847 raft_consensus.cc:3060] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:41.995222 13848 raft_consensus.cc:697] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:25:41.996328 13848 consensus_queue.cc:237] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:41.991570 10849 raft_consensus.cc:2468] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 4.
I20260709 12:25:41.999639 11002 raft_consensus.cc:2468] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 10.
I20260709 12:25:42.010644 10895 leader_election.cc:304] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:25:42.011722 14066 raft_consensus.cc:2804] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:42.012326 14066 raft_consensus.cc:697] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 10 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:42.014078 14066 consensus_queue.cc:237] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:42.050876 10847 raft_consensus.cc:2468] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 10.
I20260709 12:25:42.061759 13864 raft_consensus.cc:2955] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 LEADER]: Committing config change with OpId 5.5: config changed from index -1 to 5, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:25:42.064616 10852 raft_consensus.cc:2955] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index -1 to 5, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:25:42.095876 10912 tablet_service.cc:1558] Processing DeleteTablet for tablet c2937f569e8041d9a71a575dc1b9d74d with delete_type TABLET_DATA_TOMBSTONED (TS e2d5c637307a407ab688f5ccd6f0fcea not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:59610
I20260709 12:25:42.106230 10920 raft_consensus.cc:2955] T c63ecfc9bd3945818cfe15c03f001315 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index -1 to 5, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:25:42.120086 10749 catalog_manager.cc:5697] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 9 to 10, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 10 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:42.136694 10850 consensus_queue.cc:237] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:42.147387 10751 catalog_manager.cc:5697] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 6 to 7, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 7 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:42.161083 14116 tablet_replica.cc:333] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea: stopping tablet replica
I20260709 12:25:42.167708 14116 raft_consensus.cc:2243] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.168627 14116 raft_consensus.cc:2272] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.171517 11002 raft_consensus.cc:1275] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 12:25:42.172539 10820 consensus_peers.cc:597] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 -> Peer 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613): Couldn't send request to peer 3c52e0825c02476e89d84da9bb849f5d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 435d66c6d38c4d8a90a81975a6a0cb13. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:42.179991 14116 ts_tablet_manager.cc:1916] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:25:42.180630 10922 raft_consensus.cc:1275] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:25:42.182901 14099 consensus_queue.cc:1048] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:42.194437 14100 consensus_queue.cc:1048] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:42.193094 10750 catalog_manager.cc:5697] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 3 to 4, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 4 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:42.212072 10750 catalog_manager.cc:5697] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: config changed from index -1 to 5, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New cstate: current_term: 5 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:42.236665 14116 ts_tablet_manager.cc:1929] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 9.8
I20260709 12:25:42.247252 14116 log.cc:1199] T c2937f569e8041d9a71a575dc1b9d74d P e2d5c637307a407ab688f5ccd6f0fcea: Deleting WAL directory at /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599781984018-9681-0/minicluster-data/ts-1-root/wals/c2937f569e8041d9a71a575dc1b9d74d
I20260709 12:25:42.249668 10738 catalog_manager.cc:5028] TS e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): tablet c2937f569e8041d9a71a575dc1b9d74d (table test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]) successfully deleted
I20260709 12:25:42.276669 14086 raft_consensus.cc:2955] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 7 LEADER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:25:42.288264 11002 raft_consensus.cc:2955] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:25:42.317452 10922 raft_consensus.cc:2955] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:25:42.333839 10850 consensus_queue.cc:237] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:42.366904 10922 raft_consensus.cc:1275] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 12:25:42.367339 10820 consensus_peers.cc:597] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 -> Peer 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613): Couldn't send request to peer 3c52e0825c02476e89d84da9bb849f5d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1f0741f995c74b5c91290f42110a3187. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:42.355202 10751 catalog_manager.cc:5697] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: config changed from index -1 to 6, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New cstate: current_term: 7 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:25:42.369668 11002 raft_consensus.cc:1275] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:25:42.369470 14100 consensus_queue.cc:1048] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:42.377396 10998 raft_consensus.cc:1275] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:25:42.379227 14086 consensus_queue.cc:1048] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:42.380409 14100 consensus_queue.cc:1048] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:42.412377 14086 raft_consensus.cc:2955] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 10 LEADER]: Committing config change with OpId 10.8: config changed from index -1 to 8, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:25:42.424173 10921 raft_consensus.cc:1275] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:25:42.425788 10850 raft_consensus.cc:1275] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:42.428727 14064 consensus_queue.cc:1048] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:25:42.434456 11002 raft_consensus.cc:1275] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:25:42.437120 14066 consensus_queue.cc:1048] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:42.454344 10922 raft_consensus.cc:2955] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index -1 to 8, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:25:42.468061 13864 consensus_queue.cc:1048] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:25:42.548954 10927 raft_consensus.cc:1275] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:42.578467 10751 catalog_manager.cc:5697] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: config changed from index -1 to 8, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New cstate: current_term: 10 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
W20260709 12:25:42.601511 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 85450us
I20260709 12:25:42.664849 14129 ts_tablet_manager.cc:933] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d: Initiating tablet copy from peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:42.587596 14084 consensus_queue.cc:1048] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.095s
W20260709 12:25:42.716471 14126 log.cc:927] Time spent T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.165s	user 0.002s	sys 0.000s
W20260709 12:25:42.730333 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 206886us
I20260709 12:25:42.750415 10852 raft_consensus.cc:1275] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:25:42.778537 14103 consensus_queue.cc:1048] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
W20260709 12:25:42.819536 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 51020.5us
I20260709 12:25:42.822134  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:42.800473 14129 tablet_copy_client.cc:323] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Beginning tablet copy session from remote peer at address 127.9.116.67:39945
I20260709 12:25:42.857849 10927 consensus_queue.cc:237] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
W20260709 12:25:42.861919 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 170129us
W20260709 12:25:42.896234 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 58609.1us
W20260709 12:25:42.898643 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 202677us
W20260709 12:25:42.926540 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 102978us
I20260709 12:25:42.955421 11013 tablet_copy_service.cc:140] P edcc56ddd3264984b4da6c1db59e7f08: Received BeginTabletCopySession request for tablet c63ecfc9bd3945818cfe15c03f001315 from peer 3c52e0825c02476e89d84da9bb849f5d ({username='slave'} at 127.0.0.1:57514)
I20260709 12:25:42.956256 11013 tablet_copy_service.cc:161] P edcc56ddd3264984b4da6c1db59e7f08: Beginning new tablet copy session on tablet c63ecfc9bd3945818cfe15c03f001315 from peer 3c52e0825c02476e89d84da9bb849f5d at {username='slave'} at 127.0.0.1:57514: session id = 3c52e0825c02476e89d84da9bb849f5d-c63ecfc9bd3945818cfe15c03f001315
I20260709 12:25:43.000231 11003 raft_consensus.cc:2955] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index -1 to 8, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:25:43.098585 10852 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
mode: GRACEFUL
new_leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:47358
I20260709 12:25:43.099512 10852 raft_consensus.cc:606] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 7 LEADER]: Received request to transfer leadership to TS edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:43.172516 11013 tablet_copy_source_session.cc:215] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:25:43.178362 14129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c63ecfc9bd3945818cfe15c03f001315. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:43.186671 14135 raft_consensus.cc:993] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040: : Instructing follower edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:25:43.186900 14168 ts_tablet_manager.cc:933] T 435d66c6d38c4d8a90a81975a6a0cb13 P 3c52e0825c02476e89d84da9bb849f5d: Initiating tablet copy from peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265)
W20260709 12:25:43.190279 14123 log.cc:927] Time spent T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 12:25:43.192526 14122 log.cc:927] Time spent T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:25:43.193133 14086 raft_consensus.cc:1081] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 7 LEADER]: Signalling peer edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:25:43.204311 10927 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "834361a055d34950b4edecba39f07657"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
mode: GRACEFUL
new_leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:41546
I20260709 12:25:43.204952 10927 raft_consensus.cc:606] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 LEADER]: Received request to transfer leadership to TS edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:43.214124 10998 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:37512
I20260709 12:25:43.214865 10998 raft_consensus.cc:493] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:43.215238 10998 raft_consensus.cc:3060] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:25:43.221719 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 208092us
I20260709 12:25:43.239743 10998 raft_consensus.cc:515] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:43.247973 10998 leader_election.cc:290] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:25:43.271445 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 263663us
I20260709 12:25:43.301249 10998 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
mode: GRACEFUL
new_leader_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:32960
I20260709 12:25:43.301944 10998 raft_consensus.cc:606] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 5 LEADER]: Received request to transfer leadership to TS 80cd7d227db44f34a6108591dad9c040
I20260709 12:25:43.305552 10846 raft_consensus.cc:1275] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:25:43.432740 14168 tablet_copy_client.cc:323] T 435d66c6d38c4d8a90a81975a6a0cb13 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Beginning tablet copy session from remote peer at address 127.9.116.65:46265
W20260709 12:25:43.462224 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 149037us
W20260709 12:25:43.479916 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 167124us
I20260709 12:25:43.489028 14171 ts_tablet_manager.cc:933] T 1f0741f995c74b5c91290f42110a3187 P 3c52e0825c02476e89d84da9bb849f5d: Initiating tablet copy from peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265)
I20260709 12:25:43.521850 14175 raft_consensus.cc:993] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08: : Instructing follower 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:25:43.498888 14142 consensus_queue.cc:1048] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:25:43.522516 14175 raft_consensus.cc:1081] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 5 LEADER]: Signalling peer 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:25:43.525313 10925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dad6a1da21304fcfacab384a6afc4101"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
mode: GRACEFUL
new_leader_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:41546
I20260709 12:25:43.525977 10925 raft_consensus.cc:606] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Received request to transfer leadership to TS 80cd7d227db44f34a6108591dad9c040
I20260709 12:25:43.530825  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:25:43.533936  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:43.534899  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:43.535935 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:43.539139 10850 raft_consensus.cc:3055] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:43.539448 10850 raft_consensus.cc:740] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:43.521956 14129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:45920 (request call id 272) took 1017 ms. Trace:
I20260709 12:25:43.546609 10998 raft_consensus.cc:1275] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:25:43.540238 10850 consensus_queue.cc:260] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:43.552322 10850 raft_consensus.cc:3060] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:43.559975 10852 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:56388
I20260709 12:25:43.560649 10852 raft_consensus.cc:493] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:43.561046 10852 raft_consensus.cc:3060] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:43.603440 10850 raft_consensus.cc:2468] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 8.
I20260709 12:25:43.604460 10852 raft_consensus.cc:515] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:43.551038 14129 rpcz_store.cc:276] 0709 12:25:42.504228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:42.504449 (+   221us) service_pool.cc:224] Handling call
0709 12:25:42.665312 (+160863us) ts_tablet_manager.cc:934] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d: Initiating tablet copy from peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
0709 12:25:43.176762 (+511450us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:25:43.195526 (+ 18764us) tablet_metadata.cc:665] Metadata flushed
0709 12:25:43.196682 (+  1156us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:25:43.489474 (+292792us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:25:43.521275 (+ 31801us) tablet_replica.cc:206] Creating consensus instance
0709 12:25:43.521773 (+   498us) ts_tablet_manager.cc:989] Replica registered.
0709 12:25:43.521855 (+    82us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":40238,"tablet-copy.queue_time_us":91722,"thread_start_us":104945,"threads_started":2}
I20260709 12:25:43.606745 10852 leader_election.cc:290] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 election: Requested vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
W20260709 12:25:43.640033 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 48933.8us
I20260709 12:25:43.648398 10968 leader_election.cc:304] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:25:43.649740 13864 raft_consensus.cc:2804] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:43.650414 13864 raft_consensus.cc:697] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 8 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:25:43.651523 13864 consensus_queue.cc:237] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:43.652105 14171 tablet_copy_client.cc:323] T 1f0741f995c74b5c91290f42110a3187 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Beginning tablet copy session from remote peer at address 127.9.116.65:46265
I20260709 12:25:43.654104 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:43.656991 11003 raft_consensus.cc:3055] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:43.657449 11003 raft_consensus.cc:740] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:25:43.661557 11003 consensus_queue.cc:260] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:43.663692 11003 raft_consensus.cc:3060] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:25:43.678560 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 70978.8us
I20260709 12:25:43.680418 11003 raft_consensus.cc:2468] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 6.
I20260709 12:25:43.682364 10820 leader_election.cc:304] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:25:43.685173 10846 raft_consensus.cc:1240] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:43.687706 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: true dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:25:43.688374 11622 raft_consensus.cc:3060] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:43.641494 14129 tablet_copy_client.cc:806] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 0 data blocks...
I20260709 12:25:43.695447 14129 tablet_copy_client.cc:670] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:25:43.700057 14157 raft_consensus.cc:2804] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:43.700754 14157 raft_consensus.cc:697] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 6 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:43.701850 14157 consensus_queue.cc:237] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:43.713960 11622 raft_consensus.cc:2468] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 6.
I20260709 12:25:43.717655 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:43.718487 10924 raft_consensus.cc:3060] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:43.724639 14129 tablet_copy_client.cc:538] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:25:43.726799 14066 raft_consensus.cc:993] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea: : Instructing follower edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:25:43.727470 14066 raft_consensus.cc:1081] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 LEADER]: Signalling peer edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:25:43.737982 14143 consensus_queue.cc:1048] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:25:43.747838 10895 consensus_peers.cc:597] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613): Couldn't send request to peer 3c52e0825c02476e89d84da9bb849f5d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1bf2fcbf6a2d4432a846a1e5cfa1c52a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:43.756255 11002 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "834361a055d34950b4edecba39f07657"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:37500
I20260709 12:25:43.756973 11002 raft_consensus.cc:493] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:43.757373 11002 raft_consensus.cc:3060] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:43.789479 10924 raft_consensus.cc:2468] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 8.
I20260709 12:25:43.791633 11002 raft_consensus.cc:515] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:43.808298 10864 tablet_copy_service.cc:140] P 80cd7d227db44f34a6108591dad9c040: Received BeginTabletCopySession request for tablet 435d66c6d38c4d8a90a81975a6a0cb13 from peer 3c52e0825c02476e89d84da9bb849f5d ({username='slave'} at 127.0.0.1:46480)
I20260709 12:25:43.809126 10864 tablet_copy_service.cc:161] P 80cd7d227db44f34a6108591dad9c040: Beginning new tablet copy session on tablet 435d66c6d38c4d8a90a81975a6a0cb13 from peer 3c52e0825c02476e89d84da9bb849f5d at {username='slave'} at 127.0.0.1:46480: session id = 3c52e0825c02476e89d84da9bb849f5d-435d66c6d38c4d8a90a81975a6a0cb13
I20260709 12:25:43.841993 11002 leader_election.cc:290] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:43.843161 10749 catalog_manager.cc:5697] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 7 to 8, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 8 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:43.847323 10863 tablet_copy_service.cc:140] P 80cd7d227db44f34a6108591dad9c040: Received BeginTabletCopySession request for tablet 1f0741f995c74b5c91290f42110a3187 from peer 3c52e0825c02476e89d84da9bb849f5d ({username='slave'} at 127.0.0.1:46480)
I20260709 12:25:43.848542 10863 tablet_copy_service.cc:161] P 80cd7d227db44f34a6108591dad9c040: Beginning new tablet copy session on tablet 1f0741f995c74b5c91290f42110a3187 from peer 3c52e0825c02476e89d84da9bb849f5d at {username='slave'} at 127.0.0.1:46480: session id = 3c52e0825c02476e89d84da9bb849f5d-1f0741f995c74b5c91290f42110a3187
I20260709 12:25:43.852437 14148 raft_consensus.cc:493] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:25:43.853331 14148 raft_consensus.cc:515] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:43.854625 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:43.855464 10852 raft_consensus.cc:3060] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:43.856669 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:43.857478 10921 raft_consensus.cc:3055] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:43.857880 10921 raft_consensus.cc:740] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:43.858953 10921 consensus_queue.cc:260] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:43.868626 10921 raft_consensus.cc:3060] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:43.861688 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:25:43.860641 14148 leader_election.cc:290] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:25:43.873340 10863 tablet_copy_source_session.cc:215] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:25:43.877693 10852 raft_consensus.cc:2468] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 9.
I20260709 12:25:43.872157 10750 catalog_manager.cc:5697] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 5 to 6, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 6 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:43.895117 10864 tablet_copy_source_session.cc:215] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:25:43.911428 14129 tablet_bootstrap.cc:492] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap starting.
I20260709 12:25:43.914856 10968 leader_election.cc:304] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:25:43.920858 14138 raft_consensus.cc:2804] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:43.923026 14138 raft_consensus.cc:697] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:25:43.924372 14138 consensus_queue.cc:237] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:43.923352 10921 raft_consensus.cc:2468] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 9.
I20260709 12:25:43.936367 14185 raft_consensus.cc:2955] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 5 LEADER]: Committing config change with OpId 5.5: config changed from index -1 to 5, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:25:43.955545 11003 raft_consensus.cc:2955] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index -1 to 5, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:25:44.003278 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:44.006840 14171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f0741f995c74b5c91290f42110a3187. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:44.008172 14168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 435d66c6d38c4d8a90a81975a6a0cb13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:44.030766 14143 raft_consensus.cc:993] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea: : Instructing follower 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:25:44.031646 14143 raft_consensus.cc:1081] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Signalling peer 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:25:44.049913 14185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:50034 (request call id 8) took 1269 ms. Trace:
I20260709 12:25:44.050400 14185 rpcz_store.cc:276] 0709 12:25:42.780440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:42.781950 (+  1510us) service_pool.cc:224] Handling call
0709 12:25:42.853857 (+ 71907us) spinlock_profiling.cc:243] Waited 4.07 ms on lock 0x7b540024caa0. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e05520 00007f7594e8eb42 00007f7594e8d800 00007f7599e4ed29 00007f75933cd1d4 00007f75933cd162 00007f75933cd091 00007f75933cd00c 00007f75933cc2c2 00007f75931c348c
0709 12:25:42.891031 (+ 37174us) log.cc:844] Serialized 499 byte log entry
0709 12:25:43.038740 (+147709us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x7b540024caa0. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594dfddbe 00007f7594e08930 00007f7594e088d8 00007f7594e08858 00007f7594e08813 00007f7594e07a9c 00007f759acf32f6 00007f759acedaa8 00007f7594e447cb 00007f7594e472c0
0709 12:25:44.049799 (+1011059us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":450,"mutex_wait_us":19913,"raft.queue_time_us":35801,"raft.run_cpu_time_us":3104,"raft.run_wall_time_us":200505,"spinlock_wait_cycles":45526528,"thread_start_us":193511,"threads_started":2,"wal-append.queue_time_us":64582}
I20260709 12:25:44.072880 10819 leader_election.cc:304] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:44.075045 14157 raft_consensus.cc:2749] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:44.087069 10852 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dad6a1da21304fcfacab384a6afc4101"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:56394
I20260709 12:25:44.087834 10852 raft_consensus.cc:493] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:44.088250 10852 raft_consensus.cc:3060] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:44.099789 10847 raft_consensus.cc:2955] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index -1 to 5, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:25:44.116709 10749 catalog_manager.cc:5697] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: config changed from index -1 to 5, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New cstate: current_term: 5 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:44.128628 10852 raft_consensus.cc:515] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:44.130695 10852 leader_election.cc:290] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:44.147987 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6a1da21304fcfacab384a6afc4101" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:44.148706 11003 raft_consensus.cc:3060] T dad6a1da21304fcfacab384a6afc4101 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:44.162362 10998 raft_consensus.cc:1275] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 12:25:44.164350 10921 raft_consensus.cc:1275] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:25:44.173863 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6a1da21304fcfacab384a6afc4101" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:44.174738 10921 raft_consensus.cc:3055] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:25:44.175141 10921 raft_consensus.cc:740] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:44.176311 10921 consensus_queue.cc:260] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:25:44.184675 10893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:44.190305 10921 raft_consensus.cc:3060] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:44.197609 11003 raft_consensus.cc:2468] T dad6a1da21304fcfacab384a6afc4101 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 4.
I20260709 12:25:44.201071 10921 raft_consensus.cc:2468] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 4.
I20260709 12:25:44.173081 14175 consensus_queue.cc:1048] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:25:44.208308 10820 leader_election.cc:304] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:25:44.204231 14064 consensus_queue.cc:1048] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 12:25:44.217893 14171 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:45890 (request call id 380) took 1132 ms. Trace:
I20260709 12:25:44.218446 14171 rpcz_store.cc:276] 0709 12:25:43.085990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:43.086129 (+   139us) service_pool.cc:224] Handling call
0709 12:25:43.498366 (+412237us) ts_tablet_manager.cc:934] T 1f0741f995c74b5c91290f42110a3187 P 3c52e0825c02476e89d84da9bb849f5d: Initiating tablet copy from peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265)
0709 12:25:44.005589 (+507223us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:25:44.033151 (+ 27562us) tablet_metadata.cc:665] Metadata flushed
0709 12:25:44.033279 (+   128us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:25:44.195993 (+162714us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:25:44.208915 (+ 12922us) tablet_replica.cc:206] Creating consensus instance
0709 12:25:44.217721 (+  8806us) ts_tablet_manager.cc:989] Replica registered.
0709 12:25:44.217802 (+    81us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":9081,"tablet-copy.queue_time_us":350373,"thread_start_us":257711,"threads_started":2}
I20260709 12:25:44.220011 14171 tablet_copy_client.cc:806] T 1f0741f995c74b5c91290f42110a3187 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 0 data blocks...
I20260709 12:25:44.220651 14171 tablet_copy_client.cc:670] T 1f0741f995c74b5c91290f42110a3187 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:25:44.225206 14136 raft_consensus.cc:2804] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:25:44.229698 14168 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:45890 (request call id 377) took 1183 ms. Trace:
I20260709 12:25:44.230223 14168 rpcz_store.cc:276] 0709 12:25:43.046062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:43.047468 (+  1406us) service_pool.cc:224] Handling call
0709 12:25:43.193468 (+146000us) ts_tablet_manager.cc:934] T 435d66c6d38c4d8a90a81975a6a0cb13 P 3c52e0825c02476e89d84da9bb849f5d: Initiating tablet copy from peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265)
0709 12:25:44.006578 (+813110us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:25:44.041714 (+ 35136us) tablet_metadata.cc:665] Metadata flushed
0709 12:25:44.041857 (+   143us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:25:44.214573 (+172716us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:25:44.222891 (+  8318us) tablet_replica.cc:206] Creating consensus instance
0709 12:25:44.229563 (+  6672us) ts_tablet_manager.cc:989] Replica registered.
0709 12:25:44.229631 (+    68us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":64917,"tablet-copy.queue_time_us":2192,"thread_start_us":163824,"threads_started":2}
I20260709 12:25:44.231657 14168 tablet_copy_client.cc:806] T 435d66c6d38c4d8a90a81975a6a0cb13 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 0 data blocks...
I20260709 12:25:44.232249 14168 tablet_copy_client.cc:670] T 435d66c6d38c4d8a90a81975a6a0cb13 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:25:44.238690 14136 raft_consensus.cc:697] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:44.245676 14136 consensus_queue.cc:237] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:44.293409 10852 raft_consensus.cc:1275] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:25:44.296969 14202 ts_tablet_manager.cc:933] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d: Initiating tablet copy from peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:44.302747 10751 catalog_manager.cc:5697] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 8 to 9, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 9 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:44.344709 14202 tablet_copy_client.cc:323] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Beginning tablet copy session from remote peer at address 127.9.116.66:39339
I20260709 12:25:44.346935 10939 tablet_copy_service.cc:140] P e2d5c637307a407ab688f5ccd6f0fcea: Received BeginTabletCopySession request for tablet 1bf2fcbf6a2d4432a846a1e5cfa1c52a from peer 3c52e0825c02476e89d84da9bb849f5d ({username='slave'} at 127.0.0.1:50036)
I20260709 12:25:44.347538 10939 tablet_copy_service.cc:161] P e2d5c637307a407ab688f5ccd6f0fcea: Beginning new tablet copy session on tablet 1bf2fcbf6a2d4432a846a1e5cfa1c52a from peer 3c52e0825c02476e89d84da9bb849f5d at {username='slave'} at 127.0.0.1:50036: session id = 3c52e0825c02476e89d84da9bb849f5d-1bf2fcbf6a2d4432a846a1e5cfa1c52a
I20260709 12:25:44.353067 14129 tablet_bootstrap.cc:492] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=1 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:44.354617 14129 tablet_bootstrap.cc:492] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap complete.
W20260709 12:25:44.355365 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 62580us
I20260709 12:25:44.358315 10939 tablet_copy_source_session.cc:215] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:25:44.362157 14202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bf2fcbf6a2d4432a846a1e5cfa1c52a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:44.369836 11622 raft_consensus.cc:1275] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 12:25:44.374208 10924 raft_consensus.cc:1275] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:25:44.382648 13864 consensus_queue.cc:1048] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:44.389443 14129 ts_tablet_manager.cc:1403] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d: Time spent bootstrapping tablet: real 0.478s	user 0.052s	sys 0.023s
I20260709 12:25:44.398676 14167 consensus_queue.cc:1048] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:44.416371 14148 consensus_queue.cc:1048] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:44.446285 14129 raft_consensus.cc:359] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d [term 5 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:44.448223 14171 tablet_copy_client.cc:538] T 1f0741f995c74b5c91290f42110a3187 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:25:44.458495 14168 tablet_copy_client.cc:538] T 435d66c6d38c4d8a90a81975a6a0cb13 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:25:44.447293 14129 raft_consensus.cc:740] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d [term 5 LEARNER]: Becoming Follower/Learner. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Initialized, Role: LEARNER
I20260709 12:25:44.471987 14129 consensus_queue.cc:260] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:44.475095 14129 ts_tablet_manager.cc:1434] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d: Time spent starting tablet: real 0.085s	user 0.008s	sys 0.000s
I20260709 12:25:44.462071 10751 catalog_manager.cc:5697] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 3 to 4, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 4 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
W20260709 12:25:44.512753 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 48435.4us
I20260709 12:25:44.531016 11013 tablet_copy_service.cc:342] P edcc56ddd3264984b4da6c1db59e7f08: Request end of tablet copy session 3c52e0825c02476e89d84da9bb849f5d-c63ecfc9bd3945818cfe15c03f001315 received from {username='slave'} at 127.0.0.1:57514
I20260709 12:25:44.542899 11013 tablet_copy_service.cc:434] P edcc56ddd3264984b4da6c1db59e7f08: ending tablet copy session 3c52e0825c02476e89d84da9bb849f5d-c63ecfc9bd3945818cfe15c03f001315 on tablet c63ecfc9bd3945818cfe15c03f001315 with peer 3c52e0825c02476e89d84da9bb849f5d
I20260709 12:25:44.600236 11620 raft_consensus.cc:1217] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d [term 5 LEARNER]: Deduplicated request from leader. Original: 5.4->[5.5-5.5]   Dedup: 5.5->[]
I20260709 12:25:44.644857 10852 raft_consensus.cc:1275] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 12:25:44.661918 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 104567us
W20260709 12:25:44.690982 14207 log.cc:927] Time spent T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 12:25:44.738619 14168 tablet_bootstrap.cc:492] T 435d66c6d38c4d8a90a81975a6a0cb13 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap starting.
I20260709 12:25:44.739097 14212 consensus_queue.cc:1048] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:25:44.805791  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:25:44.870895 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 110358us
I20260709 12:25:44.910410 14171 tablet_bootstrap.cc:492] T 1f0741f995c74b5c91290f42110a3187 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap starting.
I20260709 12:25:44.927771 14202 tablet_copy_client.cc:806] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 0 data blocks...
I20260709 12:25:44.928501 14202 tablet_copy_client.cc:670] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:25:44.973371 10924 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3ad755c012434396a53498486697a9b4"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
mode: GRACEFUL
new_leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:41546
I20260709 12:25:44.974074 10924 raft_consensus.cc:606] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Received request to transfer leadership to TS edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:44.999861 10998 raft_consensus.cc:1275] T dad6a1da21304fcfacab384a6afc4101 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:25:45.013474 14218 raft_consensus.cc:1064] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08: attempting to promote NON_VOTER 3c52e0825c02476e89d84da9bb849f5d to VOTER
I20260709 12:25:45.029803 14202 tablet_copy_client.cc:538] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:25:45.062430 10923 raft_consensus.cc:1275] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:25:45.076644 14214 consensus_queue.cc:1048] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:45.080665 14211 consensus_queue.cc:1048] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:45.110685 14048 raft_consensus.cc:993] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea: : Instructing follower edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:25:45.115379 10851 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "69fd8fdac2fa449e9e184f3d668ea1a7"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
mode: GRACEFUL
new_leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:47358
I20260709 12:25:45.116449 10851 raft_consensus.cc:606] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 5 LEADER]: Received request to transfer leadership to TS e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:45.061852 14218 consensus_queue.cc:237] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 3, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:45.134390 14165 raft_consensus.cc:1081] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Signalling peer edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:25:45.142863 11003 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
mode: GRACEFUL
new_leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:32960
I20260709 12:25:45.143736 11003 raft_consensus.cc:606] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 LEADER]: Received request to transfer leadership to TS e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:45.178207 10851 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
mode: GRACEFUL
new_leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:47358
I20260709 12:25:45.179113 10851 raft_consensus.cc:606] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 6 LEADER]: Received request to transfer leadership to TS e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:45.208106 10994 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
mode: GRACEFUL
new_leader_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:32960
I20260709 12:25:45.208787 10994 raft_consensus.cc:606] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 LEADER]: Received request to transfer leadership to TS 80cd7d227db44f34a6108591dad9c040
I20260709 12:25:45.229612  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:25:45.231473  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:45.232337  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:45.282310 14202 tablet_bootstrap.cc:492] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap starting.
W20260709 12:25:45.284737 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 117706us
I20260709 12:25:45.289824 11003 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3ad755c012434396a53498486697a9b4"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:37500
I20260709 12:25:45.290551 11003 raft_consensus.cc:493] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:45.293892 11003 raft_consensus.cc:3060] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:45.318518 11003 raft_consensus.cc:515] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:45.325008 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:45.331544 11003 leader_election.cc:290] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:25:45.347342 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: true dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:25:45.355193 11622 raft_consensus.cc:3060] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:45.358517 14084 raft_consensus.cc:993] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08: : Instructing follower e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:25:45.359400 14084 raft_consensus.cc:1081] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 LEADER]: Signalling peer e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:25:45.394888 14086 raft_consensus.cc:993] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040: : Instructing follower e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:25:45.399466 14086 raft_consensus.cc:1081] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 5 LEADER]: Signalling peer e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:25:45.409332 10921 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:59622
I20260709 12:25:45.409492 11622 raft_consensus.cc:2468] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 7.
I20260709 12:25:45.410211 10921 raft_consensus.cc:493] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:45.411109 10921 raft_consensus.cc:3060] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:45.412863 10969 leader_election.cc:304] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:25:45.415751 13864 raft_consensus.cc:2804] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:45.416433 13864 raft_consensus.cc:697] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:25:45.417022 10920 raft_consensus.cc:3055] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:45.417449 10920 raft_consensus.cc:740] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:45.417227 13864 consensus_queue.cc:237] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:45.420495 10920 consensus_queue.cc:260] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:45.421921 10920 raft_consensus.cc:3060] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:45.425685 14171 tablet_bootstrap.cc:492] T 1f0741f995c74b5c91290f42110a3187 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:25:45.434598 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 51989.1us
I20260709 12:25:45.457072 10921 raft_consensus.cc:515] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:45.465950 10921 leader_election.cc:290] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:45.471065 10920 raft_consensus.cc:2468] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 7.
W20260709 12:25:45.481859 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 46450.9us
I20260709 12:25:45.483007 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:45.488382 11003 raft_consensus.cc:3055] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:45.491624 10921 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "69fd8fdac2fa449e9e184f3d668ea1a7"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:59626
I20260709 12:25:45.492400 10921 raft_consensus.cc:493] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 12:25:45.492439 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 46794.4us
I20260709 12:25:45.492889 10921 raft_consensus.cc:3060] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:45.488855 11003 raft_consensus.cc:740] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:25:45.509339 11003 consensus_queue.cc:260] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:45.500873 14171 tablet_bootstrap.cc:492] T 1f0741f995c74b5c91290f42110a3187 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap complete.
I20260709 12:25:45.518211 10921 raft_consensus.cc:515] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:45.525969 10921 leader_election.cc:290] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:25:45.527758 11003 raft_consensus.cc:3060] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:45.528429 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fd8fdac2fa449e9e184f3d668ea1a7" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:25:45.529057 11622 raft_consensus.cc:3060] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:45.532085 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:45.532752 10852 raft_consensus.cc:3060] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:45.533907 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fd8fdac2fa449e9e184f3d668ea1a7" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:45.534509 10846 raft_consensus.cc:3055] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:45.534801 10846 raft_consensus.cc:740] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:45.535557 10846 consensus_queue.cc:260] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:45.536896 10846 raft_consensus.cc:3060] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:45.538641 14137 raft_consensus.cc:993] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040: : Instructing follower e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:25:45.539232 14137 raft_consensus.cc:1081] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 6 LEADER]: Signalling peer e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:25:45.543977 10921 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:59626
I20260709 12:25:45.544713 10921 raft_consensus.cc:493] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:45.545128 10921 raft_consensus.cc:3060] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:45.545007 10852 raft_consensus.cc:2468] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 7.
I20260709 12:25:45.556481 11620 raft_consensus.cc:1275] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d [term 5 LEARNER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:25:45.562983 10846 raft_consensus.cc:2468] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 6.
I20260709 12:25:45.571362 10894 leader_election.cc:304] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:25:45.576251 10894 leader_election.cc:304] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:25:45.583735 14142 raft_consensus.cc:2804] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:45.570987 14171 ts_tablet_manager.cc:1403] T 1f0741f995c74b5c91290f42110a3187 P 3c52e0825c02476e89d84da9bb849f5d: Time spent bootstrapping tablet: real 0.661s	user 0.028s	sys 0.030s
I20260709 12:25:45.578502 11003 raft_consensus.cc:2468] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 7.
I20260709 12:25:45.587551 10921 raft_consensus.cc:515] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:45.605885 11622 raft_consensus.cc:2468] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 6.
I20260709 12:25:45.621150 10921 leader_election.cc:290] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:25:45.622418 14154 raft_consensus.cc:993] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08: : Instructing follower 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:25:45.633728 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
W20260709 12:25:45.624820 14231 log.cc:927] Time spent T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 12:25:45.635939 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: true dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:25:45.639014 11622 raft_consensus.cc:3060] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:25:45.636579 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 99929.4us
I20260709 12:25:45.636919 10847 raft_consensus.cc:3055] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:45.641048 10847 raft_consensus.cc:740] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:45.619019 14142 raft_consensus.cc:697] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:45.623014 14108 raft_consensus.cc:2804] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:45.648526 11622 raft_consensus.cc:2468] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 7.
I20260709 12:25:45.641970 10847 consensus_queue.cc:260] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:45.654033 10895 leader_election.cc:304] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:25:45.654479 10847 raft_consensus.cc:3060] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:45.662532 14237 raft_consensus.cc:1081] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 LEADER]: Signalling peer 80cd7d227db44f34a6108591dad9c040 to start an election
W20260709 12:25:45.658950 10969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 70219.9us
I20260709 12:25:45.676739 14142 consensus_queue.cc:237] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:45.679348 14108 raft_consensus.cc:697] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:45.680584 14108 consensus_queue.cc:237] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:45.677269 14228 raft_consensus.cc:2804] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:45.730403 10847 raft_consensus.cc:2468] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 7.
W20260709 12:25:45.737648 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 83700.9us
I20260709 12:25:45.730854 14228 raft_consensus.cc:697] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 7 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:45.746271 10847 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:56388
I20260709 12:25:45.748855 10847 raft_consensus.cc:493] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:45.749222 10847 raft_consensus.cc:3060] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:25:45.746381 14227 log.cc:927] Time spent T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:25:45.713344 14171 raft_consensus.cc:359] T 1f0741f995c74b5c91290f42110a3187 P 3c52e0825c02476e89d84da9bb849f5d [term 10 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:45.768118 10921 raft_consensus.cc:1275] T c63ecfc9bd3945818cfe15c03f001315 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:25:45.772825 14171 raft_consensus.cc:740] T 1f0741f995c74b5c91290f42110a3187 P 3c52e0825c02476e89d84da9bb849f5d [term 10 LEARNER]: Becoming Follower/Learner. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Initialized, Role: LEARNER
I20260709 12:25:45.780717 14171 consensus_queue.cc:260] T 1f0741f995c74b5c91290f42110a3187 P 3c52e0825c02476e89d84da9bb849f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:45.777078 10847 raft_consensus.cc:515] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:45.783243 14171 ts_tablet_manager.cc:1434] T 1f0741f995c74b5c91290f42110a3187 P 3c52e0825c02476e89d84da9bb849f5d: Time spent starting tablet: real 0.198s	user 0.008s	sys 0.000s
I20260709 12:25:45.785133 10847 leader_election.cc:290] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:45.789358 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:45.807471 10921 raft_consensus.cc:3060] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:45.758903 14235 consensus_queue.cc:1048] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.171s
I20260709 12:25:45.792313 14228 consensus_queue.cc:237] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:45.829929 11623 raft_consensus.cc:1275] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:25:45.866741 14084 consensus_queue.cc:1048] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 12:25:45.858992 14237 consensus_queue.cc:1048] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:25:45.902096 10921 raft_consensus.cc:2468] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 6.
W20260709 12:25:45.942432 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 81689us
I20260709 12:25:45.943667 10819 leader_election.cc:304] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:25:45.944774 14247 raft_consensus.cc:2804] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:45.951220 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:45.951974 10999 raft_consensus.cc:3055] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:45.952262 10999 raft_consensus.cc:740] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:25:45.953269 10999 consensus_queue.cc:260] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:25:45.953289 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 119119us
I20260709 12:25:45.954512 10999 raft_consensus.cc:3060] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:25:45.956583 10969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 122069us
I20260709 12:25:45.957952 10922 raft_consensus.cc:1275] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:25:45.958985 10929 raft_consensus.cc:1240] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:45.984566 10999 raft_consensus.cc:2468] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 6.
I20260709 12:25:45.996248 10850 raft_consensus.cc:1275] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:25:45.998816 14084 consensus_queue.cc:1048] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:45.998840 10864 tablet_copy_service.cc:342] P 80cd7d227db44f34a6108591dad9c040: Request end of tablet copy session 3c52e0825c02476e89d84da9bb849f5d-1f0741f995c74b5c91290f42110a3187 received from {username='slave'} at 127.0.0.1:46480
I20260709 12:25:46.000409 10864 tablet_copy_service.cc:434] P 80cd7d227db44f34a6108591dad9c040: ending tablet copy session 3c52e0825c02476e89d84da9bb849f5d-1f0741f995c74b5c91290f42110a3187 on tablet 1f0741f995c74b5c91290f42110a3187 with peer 3c52e0825c02476e89d84da9bb849f5d
I20260709 12:25:46.002086 14168 tablet_bootstrap.cc:492] T 435d66c6d38c4d8a90a81975a6a0cb13 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:45.987383 14247 raft_consensus.cc:697] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 6 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:46.003700 14168 tablet_bootstrap.cc:492] T 435d66c6d38c4d8a90a81975a6a0cb13 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap complete.
I20260709 12:25:46.034336 10752 catalog_manager.cc:5697] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: term changed from 6 to 7, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 7 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:46.043390 14247 consensus_queue.cc:237] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:46.055514 14168 ts_tablet_manager.cc:1403] T 435d66c6d38c4d8a90a81975a6a0cb13 P 3c52e0825c02476e89d84da9bb849f5d: Time spent bootstrapping tablet: real 1.317s	user 0.057s	sys 0.006s
I20260709 12:25:46.086632 10751 catalog_manager.cc:5697] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 6 to 7, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 7 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:46.094053 10751 catalog_manager.cc:5697] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 5 to 6, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 6 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:46.098331 10751 catalog_manager.cc:5697] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 6 to 7, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 7 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:46.108389 11623 raft_consensus.cc:1275] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:25:46.170434 11621 raft_consensus.cc:1217] T 1f0741f995c74b5c91290f42110a3187 P 3c52e0825c02476e89d84da9bb849f5d [term 10 LEARNER]: Deduplicated request from leader. Original: 10.7->[10.8-10.8]   Dedup: 10.8->[]
I20260709 12:25:46.174829 14168 raft_consensus.cc:359] T 435d66c6d38c4d8a90a81975a6a0cb13 P 3c52e0825c02476e89d84da9bb849f5d [term 7 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:46.176080 14168 raft_consensus.cc:740] T 435d66c6d38c4d8a90a81975a6a0cb13 P 3c52e0825c02476e89d84da9bb849f5d [term 7 LEARNER]: Becoming Follower/Learner. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Initialized, Role: LEARNER
I20260709 12:25:46.176935 14168 consensus_queue.cc:260] T 435d66c6d38c4d8a90a81975a6a0cb13 P 3c52e0825c02476e89d84da9bb849f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:46.181352 14251 consensus_queue.cc:1048] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 12:25:46.172695 14228 consensus_queue.cc:1048] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 12:25:46.199323 10999 raft_consensus.cc:1275] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:25:46.220332 14168 ts_tablet_manager.cc:1434] T 435d66c6d38c4d8a90a81975a6a0cb13 P 3c52e0825c02476e89d84da9bb849f5d: Time spent starting tablet: real 0.164s	user 0.010s	sys 0.000s
I20260709 12:25:46.213050 14103 consensus_queue.cc:1048] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 12:25:46.222080 14202 tablet_bootstrap.cc:492] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:46.231124 14202 tablet_bootstrap.cc:492] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap complete.
I20260709 12:25:46.236763 14235 raft_consensus.cc:2955] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 LEADER]: Committing config change with OpId 5.6: config changed from index 5 to 6, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:46.246935 14202 ts_tablet_manager.cc:1403] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d: Time spent bootstrapping tablet: real 0.965s	user 0.033s	sys 0.036s
I20260709 12:25:46.270896 10920 raft_consensus.cc:2955] T c63ecfc9bd3945818cfe15c03f001315 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:46.277030 10846 raft_consensus.cc:1240] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 6 LEADER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:46.285319 10851 raft_consensus.cc:1275] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:25:46.289708 10847 raft_consensus.cc:1275] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:25:46.319772 10864 tablet_copy_service.cc:342] P 80cd7d227db44f34a6108591dad9c040: Request end of tablet copy session 3c52e0825c02476e89d84da9bb849f5d-435d66c6d38c4d8a90a81975a6a0cb13 received from {username='slave'} at 127.0.0.1:46480
I20260709 12:25:46.326124 10864 tablet_copy_service.cc:434] P 80cd7d227db44f34a6108591dad9c040: ending tablet copy session 3c52e0825c02476e89d84da9bb849f5d-435d66c6d38c4d8a90a81975a6a0cb13 on tablet 435d66c6d38c4d8a90a81975a6a0cb13 with peer 3c52e0825c02476e89d84da9bb849f5d
I20260709 12:25:46.329916 14164 consensus_queue.cc:1048] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 12:25:46.342190 14202 raft_consensus.cc:359] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [term 5 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:46.308552 14066 consensus_queue.cc:1048] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 12:25:46.386608 10846 raft_consensus.cc:1275] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:25:46.371814 14202 raft_consensus.cc:740] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [term 5 LEARNER]: Becoming Follower/Learner. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Initialized, Role: LEARNER
I20260709 12:25:46.426417 14202 consensus_queue.cc:260] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:46.427395 11621 raft_consensus.cc:1275] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:25:46.440899 14202 ts_tablet_manager.cc:1434] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d: Time spent starting tablet: real 0.193s	user 0.003s	sys 0.006s
I20260709 12:25:46.429625 14164 consensus_queue.cc:1048] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 12:25:46.446050 10939 tablet_copy_service.cc:342] P e2d5c637307a407ab688f5ccd6f0fcea: Request end of tablet copy session 3c52e0825c02476e89d84da9bb849f5d-1bf2fcbf6a2d4432a846a1e5cfa1c52a received from {username='slave'} at 127.0.0.1:50036
I20260709 12:25:46.446712 10939 tablet_copy_service.cc:434] P e2d5c637307a407ab688f5ccd6f0fcea: ending tablet copy session 3c52e0825c02476e89d84da9bb849f5d-1bf2fcbf6a2d4432a846a1e5cfa1c52a on tablet 1bf2fcbf6a2d4432a846a1e5cfa1c52a with peer 3c52e0825c02476e89d84da9bb849f5d
I20260709 12:25:46.455459 11621 raft_consensus.cc:2955] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
W20260709 12:25:46.487058 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 56081.8us
W20260709 12:25:46.487304 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 71676.7us
I20260709 12:25:46.487154 14165 consensus_queue.cc:1048] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 12:25:46.452185 10852 raft_consensus.cc:2955] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:46.526364 10999 raft_consensus.cc:1275] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:25:46.529121 14217 consensus_queue.cc:1048] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:25:46.529151 11620 raft_consensus.cc:1217] T 435d66c6d38c4d8a90a81975a6a0cb13 P 3c52e0825c02476e89d84da9bb849f5d [term 7 LEARNER]: Deduplicated request from leader. Original: 7.5->[7.6-7.6]   Dedup: 7.6->[]
I20260709 12:25:46.532042 11622 raft_consensus.cc:1217] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [term 5 LEARNER]: Deduplicated request from leader. Original: 5.4->[5.5-5.5]   Dedup: 5.5->[]
I20260709 12:25:46.592377 14217 raft_consensus.cc:1064] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040: attempting to promote NON_VOTER 3c52e0825c02476e89d84da9bb849f5d to VOTER
I20260709 12:25:46.716511 14217 consensus_queue.cc:237] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 6, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:25:46.804152 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 74775.9us
I20260709 12:25:46.862931 10921 raft_consensus.cc:1275] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:25:46.876590  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:46.905857 10750 catalog_manager.cc:5697] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 5 to 6, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 6 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:46.913710 11623 raft_consensus.cc:1275] T 1f0741f995c74b5c91290f42110a3187 P 3c52e0825c02476e89d84da9bb849f5d [term 10 LEARNER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:25:46.918411 11003 raft_consensus.cc:1275] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:25:46.921130 14148 consensus_queue.cc:1048] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:46.923724 14211 consensus_queue.cc:1048] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:46.961021 10752 catalog_manager.cc:5697] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: config changed from index 5 to 6, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New cstate: current_term: 5 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:46.968772 10929 raft_consensus.cc:1275] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:25:47.001044 14211 raft_consensus.cc:1064] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040: attempting to promote NON_VOTER 3c52e0825c02476e89d84da9bb849f5d to VOTER
I20260709 12:25:47.009423 14164 raft_consensus.cc:1064] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea: attempting to promote NON_VOTER 3c52e0825c02476e89d84da9bb849f5d to VOTER
I20260709 12:25:47.015115 14164 consensus_queue.cc:237] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 3, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:47.028429 14211 consensus_queue.cc:237] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 4, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:47.041491 10994 raft_consensus.cc:1275] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:25:47.042526 11623 raft_consensus.cc:1275] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [term 5 LEARNER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 12:25:47.044426 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 51524.6us
I20260709 12:25:47.043910 14164 consensus_queue.cc:1048] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:47.046644 14048 consensus_queue.cc:1048] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:47.060338 10853 raft_consensus.cc:1275] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:25:47.087743 14222 consensus_queue.cc:1048] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:25:47.107848 10994 consensus_queue.cc:237] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:47.129908 14136 consensus_queue.cc:1048] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 12:25:47.188972 14132 raft_consensus.cc:2955] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 10 LEADER]: Committing config change with OpId 10.9: config changed from index 8 to 9, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:47.214406 11621 raft_consensus.cc:1275] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:25:47.224481 14235 consensus_queue.cc:1048] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 12:25:47.253826 14290 raft_consensus.cc:2955] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 LEADER]: Committing config change with OpId 5.7: config changed from index 6 to 7, VOTER e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
W20260709 12:25:47.313159 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 171745us
I20260709 12:25:47.343520 11620 raft_consensus.cc:1275] T 435d66c6d38c4d8a90a81975a6a0cb13 P 3c52e0825c02476e89d84da9bb849f5d [term 7 LEARNER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:25:47.313159 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 181843us
I20260709 12:25:47.345714 11623 raft_consensus.cc:2955] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 6 to 7, VOTER e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:47.487922 10994 raft_consensus.cc:1275] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:25:47.497120 10851 raft_consensus.cc:1275] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:25:47.510275 11620 raft_consensus.cc:2955] T 1f0741f995c74b5c91290f42110a3187 P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 8 to 9, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:47.535876 14287 consensus_queue.cc:1048] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:47.508781 14108 consensus_queue.cc:1048] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:25:47.592685 10929 raft_consensus.cc:1275] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:25:47.597851 11003 raft_consensus.cc:2955] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 8 to 9, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:47.621827 10739 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c63ecfc9bd3945818cfe15c03f001315 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:25:47.633394 10817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:47.652598 14298 consensus_queue.cc:1048] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:47.663558 14285 consensus_queue.cc:1048] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:47.768839 14214 consensus_queue.cc:1048] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:25:47.784456 10920 raft_consensus.cc:2955] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 8 to 9, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:47.772320 14164 raft_consensus.cc:2955] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 5 LEADER]: Committing config change with OpId 5.6: config changed from index 5 to 6, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:47.845000 10749 catalog_manager.cc:5697] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: config changed from index 6 to 7, VOTER e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) evicted. New cstate: current_term: 5 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:47.909989 10997 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
mode: GRACEFUL
new_leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:32960
I20260709 12:25:47.911269 10997 raft_consensus.cc:606] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 8 LEADER]: Received request to transfer leadership to TS e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:47.917483 10921 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
mode: GRACEFUL
new_leader_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:41546
I20260709 12:25:47.918422 10921 raft_consensus.cc:606] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 LEADER]: Received request to transfer leadership to TS 80cd7d227db44f34a6108591dad9c040
I20260709 12:25:47.941355 10847 raft_consensus.cc:2955] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 6 to 7, VOTER e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:47.946028 10848 raft_consensus.cc:2955] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:47.964977 10851 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab816bcc6183447994a2cc013e46c5f8"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
mode: GRACEFUL
new_leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:47358
I20260709 12:25:47.965626 10851 raft_consensus.cc:606] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [term 2 LEADER]: Received request to transfer leadership to TS edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:47.964507 10751 catalog_manager.cc:5697] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 reported cstate change: config changed from index 8 to 9, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New cstate: current_term: 10 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:47.969990 14099 raft_consensus.cc:2955] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 7 LEADER]: Committing config change with OpId 7.7: config changed from index 6 to 7, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:47.989311 11623 raft_consensus.cc:2955] T 435d66c6d38c4d8a90a81975a6a0cb13 P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
W20260709 12:25:47.993484 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 207399us
I20260709 12:25:48.002152 11003 raft_consensus.cc:2955] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:48.032414 10920 raft_consensus.cc:2955] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:48.071851 10847 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
mode: GRACEFUL
new_leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:47358
I20260709 12:25:48.072671 10847 raft_consensus.cc:606] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 6 LEADER]: Received request to transfer leadership to TS edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:48.076656 10999 raft_consensus.cc:2955] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:48.086274  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:25:48.088689  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:48.089962  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:48.126504 14099 raft_consensus.cc:993] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040: : Instructing follower edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:25:48.127880 14099 raft_consensus.cc:1081] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 6 LEADER]: Signalling peer edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:25:48.130692 11003 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:37512
I20260709 12:25:48.131520 11003 raft_consensus.cc:493] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:48.131980 11003 raft_consensus.cc:3060] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:48.149626 11003 raft_consensus.cc:515] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:48.209118 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:48.207229 14295 raft_consensus.cc:993] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08: : Instructing follower e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:25:48.210078 10848 raft_consensus.cc:3055] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:48.210337 14295 raft_consensus.cc:1081] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 8 LEADER]: Signalling peer e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:25:48.210497 10848 raft_consensus.cc:740] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:48.211802 10848 consensus_queue.cc:260] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:48.213151 10848 raft_consensus.cc:3060] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:48.209686 11003 leader_election.cc:290] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:48.222682 14099 raft_consensus.cc:993] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040: : Instructing follower edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:25:48.223423 14099 raft_consensus.cc:1081] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [term 2 LEADER]: Signalling peer edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:25:48.226531 11620 raft_consensus.cc:2955] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:48.240531 14164 raft_consensus.cc:993] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea: : Instructing follower 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:25:48.241171 14164 raft_consensus.cc:1081] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 LEADER]: Signalling peer 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:25:48.246307 10851 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:56394
I20260709 12:25:48.246941 10851 raft_consensus.cc:493] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:48.247421 10851 raft_consensus.cc:3060] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:48.250989 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:48.251753 10920 raft_consensus.cc:3060] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:48.256758 10921 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:59622
I20260709 12:25:48.257448 10921 raft_consensus.cc:493] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:48.257853 10921 raft_consensus.cc:3060] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:48.238476 11003 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ab816bcc6183447994a2cc013e46c5f8"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:37512
I20260709 12:25:48.265251 11003 raft_consensus.cc:493] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:48.265867 11003 raft_consensus.cc:3060] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:48.272212 10848 raft_consensus.cc:2468] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 7.
I20260709 12:25:48.272922 10920 raft_consensus.cc:2468] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 7.
I20260709 12:25:48.257853 10851 raft_consensus.cc:515] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:48.291077 11003 raft_consensus.cc:515] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:48.317445 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:48.318094 10920 raft_consensus.cc:3055] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:48.318436 10920 raft_consensus.cc:740] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:48.319725 10921 raft_consensus.cc:515] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:48.321584 10920 consensus_queue.cc:260] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:48.324322 11003 leader_election.cc:290] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:25:48.324184 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:48.326333 10848 raft_consensus.cc:3060] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:48.326601 10920 raft_consensus.cc:3060] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:48.328641 10921 leader_election.cc:290] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:48.332190 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:48.332953 10994 raft_consensus.cc:3055] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:48.333146 10968 leader_election.cc:304] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:25:48.334161 14298 raft_consensus.cc:2804] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:48.333278 10994 raft_consensus.cc:740] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:25:48.334662 14298 raft_consensus.cc:697] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:25:48.335119 10994 consensus_queue.cc:260] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:48.335649 14298 consensus_queue.cc:237] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:48.337008 10994 raft_consensus.cc:3060] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:48.338996 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab816bcc6183447994a2cc013e46c5f8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:48.339645 10847 raft_consensus.cc:3055] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:48.339967 10847 raft_consensus.cc:740] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:48.340884 10847 consensus_queue.cc:260] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:48.342237 10847 raft_consensus.cc:3060] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:48.351056 11620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab816bcc6183447994a2cc013e46c5f8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:25:48.351804 11620 raft_consensus.cc:3060] T ab816bcc6183447994a2cc013e46c5f8 P 3c52e0825c02476e89d84da9bb849f5d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:48.368209 10851 leader_election.cc:290] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:48.368687 10848 raft_consensus.cc:2468] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 9.
I20260709 12:25:48.372792 10894 leader_election.cc:304] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:25:48.373579 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:48.374258 11003 raft_consensus.cc:3060] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:48.386027 10920 raft_consensus.cc:2468] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 8.
I20260709 12:25:48.382663 10847 raft_consensus.cc:2468] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 3.
I20260709 12:25:48.387792 10994 raft_consensus.cc:2468] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 9.
I20260709 12:25:48.388809 10968 leader_election.cc:304] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:25:48.392398 14108 raft_consensus.cc:493] T c63ecfc9bd3945818cfe15c03f001315 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:25:48.393154 14108 raft_consensus.cc:515] T c63ecfc9bd3945818cfe15c03f001315 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:48.400097 11003 raft_consensus.cc:2468] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 8.
I20260709 12:25:48.396607 10819 leader_election.cc:304] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:25:48.404599 14185 raft_consensus.cc:2804] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:48.405381 14185 raft_consensus.cc:697] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 9 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:48.406386 14185 consensus_queue.cc:237] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:48.407992 14108 leader_election.cc:290] T c63ecfc9bd3945818cfe15c03f001315 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:25:48.408571 14293 raft_consensus.cc:2804] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:48.409373 14293 raft_consensus.cc:697] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:25:48.410418 14293 consensus_queue.cc:237] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:48.415365 14136 raft_consensus.cc:2804] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:48.416010 14136 raft_consensus.cc:697] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 8 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:48.416939 14136 consensus_queue.cc:237] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:48.423993 11620 raft_consensus.cc:2468] T ab816bcc6183447994a2cc013e46c5f8 P 3c52e0825c02476e89d84da9bb849f5d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 3.
I20260709 12:25:48.427349 11623 raft_consensus.cc:1240] T ab816bcc6183447994a2cc013e46c5f8 P 3c52e0825c02476e89d84da9bb849f5d [term 3 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 2. Current term is 3. Ops: []
I20260709 12:25:48.430225 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63ecfc9bd3945818cfe15c03f001315" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:48.432106 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63ecfc9bd3945818cfe15c03f001315" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:48.432937 11621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63ecfc9bd3945818cfe15c03f001315" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:25:48.473052 10912 tablet_service.cc:1558] Processing DeleteTablet for tablet c63ecfc9bd3945818cfe15c03f001315 with delete_type TABLET_DATA_TOMBSTONED (TS e2d5c637307a407ab688f5ccd6f0fcea not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:59610
I20260709 12:25:48.491030 10895 leader_election.cc:304] T c63ecfc9bd3945818cfe15c03f001315 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:48.495525 14142 raft_consensus.cc:2749] T c63ecfc9bd3945818cfe15c03f001315 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:48.551739 10751 catalog_manager.cc:5697] T 435d66c6d38c4d8a90a81975a6a0cb13 P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: config changed from index 6 to 7, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New cstate: current_term: 7 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:48.554177 10751 catalog_manager.cc:5697] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: config changed from index 5 to 6, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New cstate: current_term: 5 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:48.582435 14320 tablet_replica.cc:333] T c63ecfc9bd3945818cfe15c03f001315 P e2d5c637307a407ab688f5ccd6f0fcea: stopping tablet replica
I20260709 12:25:48.585978 14320 raft_consensus.cc:2243] T c63ecfc9bd3945818cfe15c03f001315 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:48.595419 14320 raft_consensus.cc:2272] T c63ecfc9bd3945818cfe15c03f001315 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:48.629518 10749 catalog_manager.cc:5697] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 6 to 7, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 7 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:48.631477 10749 catalog_manager.cc:5697] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 2 to 3, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 3 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:48.670114 10752 catalog_manager.cc:5697] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 7 to 8, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 8 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:48.678316 14320 ts_tablet_manager.cc:1916] T c63ecfc9bd3945818cfe15c03f001315 P e2d5c637307a407ab688f5ccd6f0fcea: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:25:48.695940 10751 catalog_manager.cc:5697] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 8 to 9, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 9 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:48.721066 10920 consensus_queue.cc:237] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:48.727622 10848 consensus_queue.cc:237] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:48.731400 11621 raft_consensus.cc:1275] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:25:48.732926 14185 consensus_queue.cc:1048] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:48.735895 10847 raft_consensus.cc:1275] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:25:48.745252 14185 consensus_queue.cc:1048] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:48.758805 14142 raft_consensus.cc:2955] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 5 LEADER]: Committing config change with OpId 5.7: config changed from index 6 to 7, VOTER edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:48.764806 11620 raft_consensus.cc:2955] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 6 to 7, VOTER edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:48.765198 10854 raft_consensus.cc:2955] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 6 to 7, VOTER edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:48.787827 10847 consensus_queue.cc:237] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:48.803224 10752 catalog_manager.cc:5697] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: config changed from index 6 to 7, VOTER edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) evicted. New cstate: current_term: 5 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:48.807201 14320 ts_tablet_manager.cc:1929] T c63ecfc9bd3945818cfe15c03f001315 P e2d5c637307a407ab688f5ccd6f0fcea: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 5.6
I20260709 12:25:48.810708 10920 raft_consensus.cc:1275] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:25:48.820732 14320 log.cc:1199] T c63ecfc9bd3945818cfe15c03f001315 P e2d5c637307a407ab688f5ccd6f0fcea: Deleting WAL directory at /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599781984018-9681-0/minicluster-data/ts-1-root/wals/c63ecfc9bd3945818cfe15c03f001315
I20260709 12:25:48.828120 11621 raft_consensus.cc:1275] T 1f0741f995c74b5c91290f42110a3187 P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:25:48.834743 11621 raft_consensus.cc:1275] T 435d66c6d38c4d8a90a81975a6a0cb13 P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:25:48.838881 10994 raft_consensus.cc:1275] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:25:48.843030 10992 tablet_service.cc:1558] Processing DeleteTablet for tablet 1bf2fcbf6a2d4432a846a1e5cfa1c52a with delete_type TABLET_DATA_TOMBSTONED (TS edcc56ddd3264984b4da6c1db59e7f08 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:37496
I20260709 12:25:48.843421 10738 catalog_manager.cc:5028] TS e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): tablet c63ecfc9bd3945818cfe15c03f001315 (table test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]) successfully deleted
I20260709 12:25:48.848930 14285 consensus_queue.cc:1048] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:48.849601 14136 consensus_queue.cc:1048] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:48.856714 14285 consensus_queue.cc:1048] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:48.858448 14136 consensus_queue.cc:1048] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:48.860088 10738 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1bf2fcbf6a2d4432a846a1e5cfa1c52a with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:25:48.872453 14211 raft_consensus.cc:2955] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 7 LEADER]: Committing config change with OpId 7.8: config changed from index 7 to 8, VOTER e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:48.884409 10994 raft_consensus.cc:2955] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 7 to 8, VOTER e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:48.891333 11620 raft_consensus.cc:1275] T ab816bcc6183447994a2cc013e46c5f8 P 3c52e0825c02476e89d84da9bb849f5d [term 3 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:25:48.897521 10920 raft_consensus.cc:1275] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:25:48.903862 10854 raft_consensus.cc:1275] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:25:48.904774 14321 consensus_queue.cc:1048] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:48.906297 14321 consensus_queue.cc:1048] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:48.911074 11623 raft_consensus.cc:2955] T 435d66c6d38c4d8a90a81975a6a0cb13 P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 7 to 8, VOTER e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:48.924620 10999 raft_consensus.cc:1275] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:25:48.913992 14285 raft_consensus.cc:2955] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 10 LEADER]: Committing config change with OpId 10.10: config changed from index 9 to 10, VOTER edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:48.962719 10854 raft_consensus.cc:1275] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:25:48.939311 14185 consensus_queue.cc:1048] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 12:25:48.987175 10921 raft_consensus.cc:1275] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:25:48.997241 14136 consensus_queue.cc:1048] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:25:48.998574 14290 consensus_queue.cc:1048] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 12:25:49.001047 14323 tablet_replica.cc:333] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08: stopping tablet replica
I20260709 12:25:49.002974 14323 raft_consensus.cc:2243] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:49.004768 14323 raft_consensus.cc:2272] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:49.027076 10752 catalog_manager.cc:5697] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: config changed from index 7 to 8, VOTER e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) evicted. New cstate: current_term: 7 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:49.088557 10854 raft_consensus.cc:1275] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:25:49.093004 14321 consensus_queue.cc:1048] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:49.115795 14323 ts_tablet_manager.cc:1916] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:25:49.152233 10969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 101143us
W20260709 12:25:49.169327 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 86853.6us
I20260709 12:25:49.175885 10999 raft_consensus.cc:1275] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:25:49.196492 10738 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1f0741f995c74b5c91290f42110a3187 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:25:49.183121 10912 tablet_service.cc:1558] Processing DeleteTablet for tablet 435d66c6d38c4d8a90a81975a6a0cb13 with delete_type TABLET_DATA_TOMBSTONED (TS e2d5c637307a407ab688f5ccd6f0fcea not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:59610
I20260709 12:25:49.230880 14320 tablet_replica.cc:333] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea: stopping tablet replica
W20260709 12:25:49.262292 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 65718.3us
I20260709 12:25:49.266116 10738 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 435d66c6d38c4d8a90a81975a6a0cb13 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:25:49.267495 14335 consensus_queue.cc:1048] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
W20260709 12:25:49.282545 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 93610.2us
W20260709 12:25:49.299820 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 225081us
W20260709 12:25:49.335202 14327 log.cc:927] Time spent T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 12:25:49.355388 14320 raft_consensus.cc:2243] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:49.392925 14320 raft_consensus.cc:2272] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:49.418372 14245 consensus_queue.cc:1048] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:49.478197 14320 ts_tablet_manager.cc:1916] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:25:49.627674  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:49.685410 10927 raft_consensus.cc:2955] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Committing config change with OpId 10.10: config changed from index 9 to 10, VOTER edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
W20260709 12:25:49.727802 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 162150us
I20260709 12:25:49.775985 10929 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
mode: GRACEFUL
new_leader_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:41546
I20260709 12:25:49.778944 10929 raft_consensus.cc:606] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 LEADER]: Received request to transfer leadership to TS 80cd7d227db44f34a6108591dad9c040
I20260709 12:25:49.779217 10752 catalog_manager.cc:5697] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: config changed from index 9 to 10, VOTER edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) evicted. New cstate: current_term: 10 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:49.813057 14323 ts_tablet_manager.cc:1929] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 5.6
I20260709 12:25:49.813776 14323 log.cc:1199] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P edcc56ddd3264984b4da6c1db59e7f08: Deleting WAL directory at /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599781984018-9681-0/minicluster-data/ts-2-root/wals/1bf2fcbf6a2d4432a846a1e5cfa1c52a
W20260709 12:25:49.816198 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 44749.6us
I20260709 12:25:49.820637 10847 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
mode: GRACEFUL
new_leader_uuid: "3c52e0825c02476e89d84da9bb849f5d"
 from {username='slave'} at 127.0.0.1:47358
I20260709 12:25:49.821385 10847 raft_consensus.cc:606] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 10 LEADER]: Received request to transfer leadership to TS 3c52e0825c02476e89d84da9bb849f5d
I20260709 12:25:49.821115 11621 raft_consensus.cc:2955] T 1f0741f995c74b5c91290f42110a3187 P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Committing config change with OpId 10.10: config changed from index 9 to 10, VOTER edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:49.828055 10929 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ef3220c51df47db8859f07ab745fad5"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
mode: GRACEFUL
new_leader_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:41546
I20260709 12:25:49.828737 10929 raft_consensus.cc:606] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Received request to transfer leadership to TS 80cd7d227db44f34a6108591dad9c040
I20260709 12:25:49.832657 11003 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
mode: GRACEFUL
new_leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:32960
I20260709 12:25:49.833349 11003 raft_consensus.cc:606] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 LEADER]: Received request to transfer leadership to TS e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:49.835178  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:25:49.837378  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:49.838274  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:49.864125 10739 catalog_manager.cc:5028] TS edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): tablet 1bf2fcbf6a2d4432a846a1e5cfa1c52a (table test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]) successfully deleted
I20260709 12:25:49.868376 14320 ts_tablet_manager.cc:1929] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 7.7
I20260709 12:25:49.882138 14285 raft_consensus.cc:993] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040: : Instructing follower 3c52e0825c02476e89d84da9bb849f5d to start an election
I20260709 12:25:49.883949 14285 raft_consensus.cc:1081] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 10 LEADER]: Signalling peer 3c52e0825c02476e89d84da9bb849f5d to start an election
I20260709 12:25:49.882160 14320 log.cc:1199] T 435d66c6d38c4d8a90a81975a6a0cb13 P e2d5c637307a407ab688f5ccd6f0fcea: Deleting WAL directory at /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599781984018-9681-0/minicluster-data/ts-1-root/wals/435d66c6d38c4d8a90a81975a6a0cb13
I20260709 12:25:49.887331 10738 catalog_manager.cc:5028] TS e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): tablet 435d66c6d38c4d8a90a81975a6a0cb13 (table test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]) successfully deleted
I20260709 12:25:49.892028 14142 raft_consensus.cc:993] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea: : Instructing follower 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:25:49.892716 14048 raft_consensus.cc:1081] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 LEADER]: Signalling peer 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:25:49.895015 10847 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:56394
I20260709 12:25:49.895903 10847 raft_consensus.cc:493] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:49.896373 10847 raft_consensus.cc:3060] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:49.899652 11620 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187"
dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
 from {username='slave'} at 127.0.0.1:45890
I20260709 12:25:49.900426 11620 raft_consensus.cc:493] T 1f0741f995c74b5c91290f42110a3187 P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:49.900856 11620 raft_consensus.cc:3060] T 1f0741f995c74b5c91290f42110a3187 P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:49.912434 11620 raft_consensus.cc:515] T 1f0741f995c74b5c91290f42110a3187 P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:49.924803 10847 raft_consensus.cc:515] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:49.943166 11620 leader_election.cc:290] T 1f0741f995c74b5c91290f42110a3187 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 11 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:49.944355 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:49.946779 10929 raft_consensus.cc:3060] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:49.948623 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:49.949683 10848 raft_consensus.cc:3055] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:49.950022 10848 raft_consensus.cc:740] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:49.950850 10848 consensus_queue.cc:260] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:49.953936 10848 raft_consensus.cc:3060] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:49.960242 10929 raft_consensus.cc:2468] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 11.
I20260709 12:25:49.961928 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:49.962729 10927 raft_consensus.cc:3055] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:49.963141 10927 raft_consensus.cc:740] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:49.964385 11588 leader_election.cc:304] T 1f0741f995c74b5c91290f42110a3187 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:25:49.964675 10927 consensus_queue.cc:260] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:49.968642 10848 raft_consensus.cc:2468] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 11.
I20260709 12:25:49.968838 14140 raft_consensus.cc:2804] T 1f0741f995c74b5c91290f42110a3187 P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:49.971240 10847 leader_election.cc:290] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:49.972193 10927 raft_consensus.cc:3060] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:49.985692 14140 raft_consensus.cc:697] T 1f0741f995c74b5c91290f42110a3187 P 3c52e0825c02476e89d84da9bb849f5d [term 11 LEADER]: Becoming Leader. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
I20260709 12:25:49.986800 14140 consensus_queue.cc:237] T 1f0741f995c74b5c91290f42110a3187 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:49.979859 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:49.993358 10997 raft_consensus.cc:3060] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:50.011976 10992 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f0741f995c74b5c91290f42110a3187 with delete_type TABLET_DATA_TOMBSTONED (TS edcc56ddd3264984b4da6c1db59e7f08 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:37496
I20260709 12:25:50.016062 14323 tablet_replica.cc:333] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08: stopping tablet replica
I20260709 12:25:50.017241 14323 raft_consensus.cc:2243] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:50.018026 14323 raft_consensus.cc:2272] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:50.031258 10752 catalog_manager.cc:5697] T 1f0741f995c74b5c91290f42110a3187 P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: term changed from 10 to 11, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68). New cstate: current_term: 11 leader_uuid: "3c52e0825c02476e89d84da9bb849f5d" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:50.046500 10927 raft_consensus.cc:2468] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 8.
I20260709 12:25:50.048094 10819 leader_election.cc:304] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:25:50.053472 14285 raft_consensus.cc:2804] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:50.054390 14285 raft_consensus.cc:697] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 8 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:50.055449 14285 consensus_queue.cc:237] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:50.063320 14323 ts_tablet_manager.cc:1916] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:25:50.073967 10997 raft_consensus.cc:2468] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 8.
I20260709 12:25:50.088807 14142 raft_consensus.cc:993] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea: : Instructing follower 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:25:50.089509 14142 raft_consensus.cc:1081] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Signalling peer 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:25:50.094126 10848 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4ef3220c51df47db8859f07ab745fad5"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:56394
I20260709 12:25:50.095247 10848 raft_consensus.cc:493] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:50.096122 10848 raft_consensus.cc:3060] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:50.110526 10848 raft_consensus.cc:515] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:50.113708 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef3220c51df47db8859f07ab745fad5" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:50.115016 10927 raft_consensus.cc:3055] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:25:50.115406 10927 raft_consensus.cc:740] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:50.116369 10927 consensus_queue.cc:260] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:50.118449 10927 raft_consensus.cc:3060] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:50.130538 10927 raft_consensus.cc:2468] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 4.
I20260709 12:25:50.132791 10819 leader_election.cc:304] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:25:50.135669 10848 leader_election.cc:290] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:50.143618 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef3220c51df47db8859f07ab745fad5" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:50.143890 14349 raft_consensus.cc:2804] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:25:50.152068 14349 raft_consensus.cc:697] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:50.153081 14349 consensus_queue.cc:237] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:50.158473 10997 raft_consensus.cc:3060] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:50.175506 10752 catalog_manager.cc:5697] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 7 to 8, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 8 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:50.194972 10997 raft_consensus.cc:2468] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 4.
I20260709 12:25:50.242192 14293 raft_consensus.cc:993] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08: : Instructing follower e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:25:50.242890 14293 raft_consensus.cc:1081] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 LEADER]: Signalling peer e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:25:50.268193 10927 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:59622
I20260709 12:25:50.268936 10927 raft_consensus.cc:493] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:50.269309 10927 raft_consensus.cc:3060] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:50.269318 14323 ts_tablet_manager.cc:1929] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 10.9
I20260709 12:25:50.281929 14323 log.cc:1199] T 1f0741f995c74b5c91290f42110a3187 P edcc56ddd3264984b4da6c1db59e7f08: Deleting WAL directory at /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599781984018-9681-0/minicluster-data/ts-2-root/wals/1f0741f995c74b5c91290f42110a3187
I20260709 12:25:50.305575 10739 catalog_manager.cc:5028] TS edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): tablet 1f0741f995c74b5c91290f42110a3187 (table test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]) successfully deleted
I20260709 12:25:50.329468 10927 raft_consensus.cc:515] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:50.332468 10752 catalog_manager.cc:5697] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 3 to 4, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 4 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:50.334162 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:50.334960 10997 raft_consensus.cc:3055] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:50.335299 10997 raft_consensus.cc:740] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:25:50.335932 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:50.336623 10851 raft_consensus.cc:3060] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:50.336899 10997 consensus_queue.cc:260] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:50.340050 10997 raft_consensus.cc:3060] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:50.347684 10927 leader_election.cc:290] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:50.350244 10851 raft_consensus.cc:2468] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 9.
I20260709 12:25:50.352380 10894 leader_election.cc:304] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:25:50.353374 14048 raft_consensus.cc:2804] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:50.353967 14048 raft_consensus.cc:697] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:50.354882 14048 consensus_queue.cc:237] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:50.399824 10997 raft_consensus.cc:2468] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 9.
I20260709 12:25:50.405695 10752 catalog_manager.cc:5697] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 8 to 9, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 9 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:50.505195 10851 raft_consensus.cc:1275] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:25:50.511983 14359 consensus_queue.cc:1048] T 1f0741f995c74b5c91290f42110a3187 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:25:50.575126 10927 raft_consensus.cc:1275] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:25:50.577011 14359 consensus_queue.cc:1048] T 1f0741f995c74b5c91290f42110a3187 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:50.610678 11003 raft_consensus.cc:1275] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:25:50.613416 14350 consensus_queue.cc:1048] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:50.626053 10929 raft_consensus.cc:1275] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:25:50.627947 14211 consensus_queue.cc:1048] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:50.655125 10923 raft_consensus.cc:1275] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:25:50.665196 14349 consensus_queue.cc:1048] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:50.723028 11003 raft_consensus.cc:1275] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:25:50.733924 14285 consensus_queue.cc:1048] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:50.852936 10851 raft_consensus.cc:1275] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:25:50.854898 14048 consensus_queue.cc:1048] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:50.875306 11003 raft_consensus.cc:1275] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:25:50.878575 14142 consensus_queue.cc:1048] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:25:51.050449  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:51.241637 10994 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
mode: GRACEFUL
new_leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:32960
I20260709 12:25:51.242321 10994 raft_consensus.cc:606] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 8 LEADER]: Received request to transfer leadership to TS e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:51.247082 10929 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
mode: GRACEFUL
new_leader_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:41546
I20260709 12:25:51.248422 10929 raft_consensus.cc:606] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 LEADER]: Received request to transfer leadership to TS 80cd7d227db44f34a6108591dad9c040
I20260709 12:25:51.251801 10851 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
mode: GRACEFUL
new_leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:47358
I20260709 12:25:51.252444 10851 raft_consensus.cc:606] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 7 LEADER]: Received request to transfer leadership to TS edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:51.253996  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:25:51.255978  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:51.256795  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:51.384763 14381 raft_consensus.cc:993] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08: : Instructing follower e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:25:51.385440 14381 raft_consensus.cc:1081] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 8 LEADER]: Signalling peer e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:25:51.386251 14185 raft_consensus.cc:993] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea: : Instructing follower 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:25:51.386826 14185 raft_consensus.cc:1081] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 LEADER]: Signalling peer 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:25:51.389432 10851 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:56394
I20260709 12:25:51.389987 10851 raft_consensus.cc:493] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:51.390471 10851 raft_consensus.cc:3060] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:51.392313 10929 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:59622
I20260709 12:25:51.392923 10929 raft_consensus.cc:493] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:51.393289 10929 raft_consensus.cc:3060] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:51.397881 11003 consensus_queue.cc:237] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:51.416054 10851 raft_consensus.cc:515] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } }
I20260709 12:25:51.410624 10929 raft_consensus.cc:515] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:51.420957 10851 leader_election.cc:290] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:51.422451 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:51.423132 11003 raft_consensus.cc:3060] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:51.424067 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:51.424714 10922 raft_consensus.cc:3055] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:51.425009 10922 raft_consensus.cc:740] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:51.425855 10922 consensus_queue.cc:260] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } }
I20260709 12:25:51.427246 10922 raft_consensus.cc:3060] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:25:51.427788 10969 consensus_peers.cc:597] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613): Couldn't send request to peer 3c52e0825c02476e89d84da9bb849f5d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f5b822586ed04f2cb681fefd045b3f6d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:51.430508 11003 raft_consensus.cc:2468] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 6.
I20260709 12:25:51.431964 10820 leader_election.cc:304] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:25:51.432112 10927 raft_consensus.cc:1275] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:51.432861 14350 raft_consensus.cc:2804] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:51.433362 14350 raft_consensus.cc:697] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [term 6 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:51.434231 14350 consensus_queue.cc:237] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } }
I20260709 12:25:51.435459 14381 consensus_queue.cc:1048] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:25:51.438910 10848 raft_consensus.cc:1275] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:51.442092 14293 consensus_queue.cc:1048] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:51.446573 10929 leader_election.cc:290] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:51.447470 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:51.447762 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:51.448230 10851 raft_consensus.cc:3060] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:51.448585 10997 raft_consensus.cc:3055] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:51.448992 10997 raft_consensus.cc:740] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:25:51.449838 10997 consensus_queue.cc:260] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:51.450981 10997 raft_consensus.cc:3060] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:51.456883 10851 raft_consensus.cc:2468] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 9.
I20260709 12:25:51.458492 10894 leader_election.cc:304] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:25:51.459565 14142 raft_consensus.cc:2804] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:51.460212 14142 raft_consensus.cc:697] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 9 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:51.461316 14142 consensus_queue.cc:237] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:51.476611 10997 raft_consensus.cc:2468] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 9.
I20260709 12:25:51.523684 14381 raft_consensus.cc:2955] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 4 LEADER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:25:51.522730 10749 catalog_manager.cc:5697] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 8 to 9, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 9 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:51.532898 10922 raft_consensus.cc:2468] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 6.
I20260709 12:25:51.533442 10752 catalog_manager.cc:5697] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 5 to 6, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 6 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:51.541760 10851 raft_consensus.cc:2955] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:25:51.540503 10922 raft_consensus.cc:2955] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:25:51.572072 14211 raft_consensus.cc:993] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040: : Instructing follower edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:25:51.572641 14211 raft_consensus.cc:1081] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 7 LEADER]: Signalling peer edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:25:51.574592 10997 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:37512
I20260709 12:25:51.575505 10997 raft_consensus.cc:493] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:51.575996 10997 raft_consensus.cc:3060] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:51.594314 11003 consensus_queue.cc:237] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:51.596750 10750 catalog_manager.cc:5697] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: config changed from index -1 to 4, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New cstate: current_term: 4 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:51.619925 10997 raft_consensus.cc:515] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:51.626327 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:51.627024 10851 raft_consensus.cc:3055] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:51.627333 10851 raft_consensus.cc:740] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:51.628563 10851 consensus_queue.cc:260] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:51.629397 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:51.630237 10922 raft_consensus.cc:3060] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:51.631244 10997 leader_election.cc:290] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:51.629901 10851 raft_consensus.cc:3060] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:51.652333 10851 raft_consensus.cc:2468] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 8.
I20260709 12:25:51.653796 10968 leader_election.cc:304] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:25:51.653483 10922 raft_consensus.cc:2468] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 8.
I20260709 12:25:51.655503 14339 raft_consensus.cc:2804] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:51.656215 14339 raft_consensus.cc:697] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 8 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:25:51.657415 14339 consensus_queue.cc:237] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:25:51.672257 10969 consensus_peers.cc:597] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613): Couldn't send request to peer 3c52e0825c02476e89d84da9bb849f5d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ee998be153d94f6f91c39dace2c32f19. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:51.678383 10929 raft_consensus.cc:1275] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:25:51.681756 10848 raft_consensus.cc:1275] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:25:51.682308 14382 consensus_queue.cc:1048] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:51.686094 14339 consensus_queue.cc:1048] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:51.743878 14295 raft_consensus.cc:2955] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 LEADER]: Committing config change with OpId 7.7: config changed from index -1 to 7, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:25:51.790558 10854 raft_consensus.cc:2955] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index -1 to 7, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:25:51.797220 10922 raft_consensus.cc:2955] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index -1 to 7, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:25:51.810184 10750 catalog_manager.cc:5697] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 7 to 8, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 8 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:51.826169 10851 consensus_queue.cc:237] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:51.845832 11003 raft_consensus.cc:1275] T dad6a1da21304fcfacab384a6afc4101 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 12:25:51.846292 10820 consensus_peers.cc:597] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 -> Peer 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613): Couldn't send request to peer 3c52e0825c02476e89d84da9bb849f5d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dad6a1da21304fcfacab384a6afc4101. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:51.847196 14389 consensus_queue.cc:1048] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:25:51.849938 10752 catalog_manager.cc:5697] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: config changed from index -1 to 7, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New cstate: current_term: 7 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:25:51.869863 10922 raft_consensus.cc:1275] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:51.880476 14350 consensus_queue.cc:1048] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:51.963011 14402 ts_tablet_manager.cc:933] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d: Initiating tablet copy from peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:52.056667 14402 tablet_copy_client.cc:323] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Beginning tablet copy session from remote peer at address 127.9.116.67:39945
I20260709 12:25:52.394299  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:25:52.507197 11003 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.037s	sys 0.034s
W20260709 12:25:52.510684 11003 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.039s	sys 0.034s
I20260709 12:25:52.531744 14407 raft_consensus.cc:2955] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
W20260709 12:25:52.541149 10895 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.007s	sys 0.000s
W20260709 12:25:52.541877 10895 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.007s	sys 0.000s
W20260709 12:25:52.542274 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 541686us
W20260709 12:25:52.896950 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 162181us
I20260709 12:25:52.974949 14405 raft_consensus.cc:493] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:25:53.000540 10994 raft_consensus.cc:1275] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:25:53.002069 14142 raft_consensus.cc:493] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:25:53.005540 11003 raft_consensus.cc:1275] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:25:52.983930 14411 raft_consensus.cc:493] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:25:53.004194 14142 raft_consensus.cc:515] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:53.039731 14405 raft_consensus.cc:515] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:53.052374 14142 leader_election.cc:290] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:53.019737 14409 raft_consensus.cc:493] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:25:53.049875 14408 raft_consensus.cc:493] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:25:53.062158 14408 raft_consensus.cc:515] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:53.064314 14410 raft_consensus.cc:493] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:25:53.065081 14408 leader_election.cc:290] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:25:53.065577 10875 debug-util.cc:398] Leaking SignalData structure 0x7b080011b280 after lost signal to thread 9684
W20260709 12:25:53.066893 10875 debug-util.cc:398] Leaking SignalData structure 0x7b080011ade0 after lost signal to thread 10786
W20260709 12:25:53.067294 10875 debug-util.cc:398] Leaking SignalData structure 0x7b08001b2360 after lost signal to thread 10800
I20260709 12:25:53.067062 14409 raft_consensus.cc:515] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:53.073938 14142 raft_consensus.cc:493] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:25:53.075219 14142 raft_consensus.cc:515] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:53.080554 14142 leader_election.cc:290] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:25:53.042284 14411 raft_consensus.cc:515] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:53.086273 14405 leader_election.cc:290] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:53.088019 14295 raft_consensus.cc:493] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:25:53.083892 10999 raft_consensus.cc:2955] T dad6a1da21304fcfacab384a6afc4101 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:25:53.099416 14099 raft_consensus.cc:493] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:25:53.104696 14099 raft_consensus.cc:515] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:53.088637 14295 raft_consensus.cc:515] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:53.111517 10854 raft_consensus.cc:1275] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:25:53.112991 14350 raft_consensus.cc:493] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:25:53.113199 14099 leader_election.cc:290] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:53.114176 14415 raft_consensus.cc:493] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
W20260709 12:25:53.114578 14407 consensus_meta.cc:287] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040: Time spent flushing consensus metadata: real 0.580s	user 0.009s	sys 0.002s
I20260709 12:25:53.114789 14415 raft_consensus.cc:515] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:53.115641 14389 raft_consensus.cc:493] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:25:53.116523 14389 raft_consensus.cc:515] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:53.118160 14415 leader_election.cc:290] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:25:53.119792 14339 raft_consensus.cc:493] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:25:53.120180 14411 leader_election.cc:290] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:53.120461 14409 leader_election.cc:290] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:53.113691 14350 raft_consensus.cc:515] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:53.120891 14411 raft_consensus.cc:493] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:25:53.120626 14339 raft_consensus.cc:515] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:53.121556 14411 raft_consensus.cc:515] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:53.112984 14295 leader_election.cc:290] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:53.123006 14339 leader_election.cc:290] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:53.123715 14407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:46472 (request call id 12) took 1292 ms. Trace:
I20260709 12:25:53.124270 14142 raft_consensus.cc:493] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:25:53.124229 14407 rpcz_store.cc:276] 0709 12:25:51.822780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:51.823022 (+   242us) service_pool.cc:224] Handling call
0709 12:25:51.835322 (+ 12300us) log.cc:844] Serialized 499 byte log entry
0709 12:25:53.115327 (+1280005us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3818,"raft.run_cpu_time_us":2020,"raft.run_wall_time_us":2035,"thread_start_us":5883,"threads_started":1,"wal-append.queue_time_us":18168}
I20260709 12:25:53.125110 14142 raft_consensus.cc:515] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:53.065085 14410 raft_consensus.cc:515] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:53.124410 14417 raft_consensus.cc:493] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:25:53.129814 14417 raft_consensus.cc:515] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:53.128547 14410 leader_election.cc:290] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:53.127215 14142 leader_election.cc:290] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:25:53.126737 14350 leader_election.cc:290] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:25:53.141824 14417 leader_election.cc:290] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:25:53.143838 10800 auto_rebalancer.cc:629] Failed to schedule move for tablet 12c494f15d054d2bba575010ccfbb60f: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:25:53.148586 14142 raft_consensus.cc:493] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:25:53.149300 14142 raft_consensus.cc:515] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:53.150534 14411 leader_election.cc:290] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:25:53.123092 14408 raft_consensus.cc:493] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:25:53.143977 14359 raft_consensus.cc:493] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:25:53.145113 11013 tablet_copy_service.cc:140] P edcc56ddd3264984b4da6c1db59e7f08: Received BeginTabletCopySession request for tablet f5b822586ed04f2cb681fefd045b3f6d from peer 3c52e0825c02476e89d84da9bb849f5d ({username='slave'} at 127.0.0.1:57514)
I20260709 12:25:53.151849 14142 leader_election.cc:290] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:25:53.151561 14408 raft_consensus.cc:515] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:53.141734 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:53.152279 11013 tablet_copy_service.cc:161] P edcc56ddd3264984b4da6c1db59e7f08: Beginning new tablet copy session on tablet f5b822586ed04f2cb681fefd045b3f6d from peer 3c52e0825c02476e89d84da9bb849f5d at {username='slave'} at 127.0.0.1:57514: session id = 3c52e0825c02476e89d84da9bb849f5d-f5b822586ed04f2cb681fefd045b3f6d
I20260709 12:25:53.147136 14389 leader_election.cc:290] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:25:53.154726 14408 leader_election.cc:290] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:53.151873 14359 raft_consensus.cc:515] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:53.161247 14339 raft_consensus.cc:493] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:25:53.162135 14339 raft_consensus.cc:515] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:53.164386 14389 raft_consensus.cc:493] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:53.164830 14339 leader_election.cc:290] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:53.164988 14389 raft_consensus.cc:515] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:53.167229 14389 leader_election.cc:290] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:53.168985 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:53.190109 11621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:25:53.192157 14408 raft_consensus.cc:493] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:25:53.192682 14420 ts_tablet_manager.cc:933] T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d: Initiating tablet copy from peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265)
I20260709 12:25:53.192785 14408 raft_consensus.cc:515] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:53.194384 11619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:25:53.196372 14185 raft_consensus.cc:493] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:53.197016 14185 raft_consensus.cc:515] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } }
I20260709 12:25:53.199016 14417 raft_consensus.cc:493] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:25:53.199546 14417 raft_consensus.cc:515] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:53.201319 14417 leader_election.cc:290] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:53.201701 14389 raft_consensus.cc:493] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:25:53.202708 14389 raft_consensus.cc:515] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:53.203743 14185 leader_election.cc:290] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265)
W20260709 12:25:53.204638 10875 debug-util.cc:398] Leaking SignalData structure 0x7b080014d8c0 after lost signal to thread 10878
I20260709 12:25:53.205528 14389 leader_election.cc:290] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:25:53.208496 14389 raft_consensus.cc:493] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:25:53.211177 14414 raft_consensus.cc:493] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:25:53.212059 14414 raft_consensus.cc:515] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:53.214588 14414 leader_election.cc:290] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:53.217002 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18294423a68a4671bf6c5a0f98645e4c" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:53.217736 10926 raft_consensus.cc:2468] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 3.
I20260709 12:25:53.219095 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:53.219283 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:53.219728 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:53.220222 10999 raft_consensus.cc:2468] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 7.
I20260709 12:25:53.220573 10929 raft_consensus.cc:1275] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:25:53.219175 11588 leader_election.cc:304] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:25:53.221252 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d9a61ecaf84695b70f8519ee57706f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:53.221964 14416 raft_consensus.cc:2804] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:25:53.222405 14416 raft_consensus.cc:493] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d [term 3 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:25:53.222779 14416 raft_consensus.cc:3060] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:25:53.222957 10875 debug-util.cc:398] Leaking SignalData structure 0x7b080026ea00 after lost signal to thread 10953
I20260709 12:25:53.224745 14417 raft_consensus.cc:493] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:25:53.195313 14408 leader_election.cc:290] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:53.225328 14417 raft_consensus.cc:515] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:53.227684 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18294423a68a4671bf6c5a0f98645e4c" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:53.228439 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:53.224121 10749 catalog_manager.cc:5697] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 reported cstate change: config changed from index -1 to 4, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New cstate: current_term: 4 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:53.230383 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:25:53.233435 10875 debug-util.cc:398] Leaking SignalData structure 0x7b0800399220 after lost signal to thread 11027
W20260709 12:25:53.235407 10875 debug-util.cc:398] Leaking SignalData structure 0x7b0800334ee0 after lost signal to thread 11648
I20260709 12:25:53.237082 11620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d9a61ecaf84695b70f8519ee57706f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:25:53.239866 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:53.167392 14359 leader_election.cc:290] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:53.255961 11620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18294423a68a4671bf6c5a0f98645e4c" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:25:53.257174 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:53.238109 14417 leader_election.cc:290] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:25:53.257941 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18294423a68a4671bf6c5a0f98645e4c" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:53.265167 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:53.261204 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5794ba618e514e28a7542ab6af39d8c9" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:25:53.266055 10851 raft_consensus.cc:2468] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 4.
I20260709 12:25:53.271549 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:53.272979 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:53.219398 14339 raft_consensus.cc:493] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:25:53.209144 14389 raft_consensus.cc:515] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:53.269590 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:53.277853 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:53.283499 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:53.283844 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:53.284663 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:53.284659 10999 raft_consensus.cc:2468] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 6.
I20260709 12:25:53.281769 10848 raft_consensus.cc:2468] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 9.
I20260709 12:25:53.289705 10999 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
mode: GRACEFUL
new_leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:32960
I20260709 12:25:53.290340 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:53.290709 10999 raft_consensus.cc:606] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 6 LEADER]: Received request to transfer leadership to TS e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:53.290340 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:53.279733 14382 raft_consensus.cc:493] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:25:53.291988 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:53.292495 14423 raft_consensus.cc:493] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:25:53.293116 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:53.293040 14423 raft_consensus.cc:515] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:53.298174 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:53.292172 14382 raft_consensus.cc:515] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:53.288525 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:53.303732 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:53.298833 10929 raft_consensus.cc:2468] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 7.
I20260709 12:25:53.301231 14142 raft_consensus.cc:493] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:25:53.304484 14142 raft_consensus.cc:515] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:53.307185 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:53.302697 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:53.309311 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5794ba618e514e28a7542ab6af39d8c9" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:53.291712 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:25:53.315842 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:53.313889 11588 leader_election.cc:304] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:25:53.317193 10851 raft_consensus.cc:2468] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 5.
I20260709 12:25:53.318291 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:53.262408 14211 consensus_queue.cc:1048] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:25:53.325371 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:53.286787 11619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:25:53.317997 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:53.329268 10922 raft_consensus.cc:1275] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:25:53.289033 14408 raft_consensus.cc:493] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:25:53.330556 14142 leader_election.cc:290] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:53.295279 11618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:25:53.306313 10926 raft_consensus.cc:2955] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:25:53.289125 14293 raft_consensus.cc:493] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:25:53.307664 14185 raft_consensus.cc:493] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:25:53.334776 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:53.334069 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:53.341111 10922 raft_consensus.cc:2468] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 8.
W20260709 12:25:53.340059 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 71274.4us
I20260709 12:25:53.352016 11617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:25:53.289541 14339 raft_consensus.cc:515] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:53.336506 14420 tablet_copy_client.cc:323] T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Beginning tablet copy session from remote peer at address 127.9.116.65:46265
I20260709 12:25:53.360116 14185 raft_consensus.cc:515] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:53.423810 14421 raft_consensus.cc:2804] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:53.425091 14412 raft_consensus.cc:493] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:53.356971 14293 raft_consensus.cc:515] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:53.364367 14423 leader_election.cc:290] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:53.354427 14408 raft_consensus.cc:515] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:25:53.468130 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 154340us
W20260709 12:25:53.472589 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 148477us
W20260709 12:25:53.474900 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 207376us
W20260709 12:25:53.476737 10969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 173613us
W20260709 12:25:53.600032 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 291351us
I20260709 12:25:53.607775 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:53.413697 14419 raft_consensus.cc:493] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:25:53.362480 14381 raft_consensus.cc:493] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:53.320649 14410 consensus_queue.cc:1048] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:25:53.329602 14405 raft_consensus.cc:493] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
W20260709 12:25:53.617369 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 263475us
W20260709 12:25:53.617888 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 277961us
I20260709 12:25:53.620661 14048 raft_consensus.cc:493] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:25:53.624917 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:53.634575 14142 raft_consensus.cc:493] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:25:53.629998 14389 leader_election.cc:290] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:53.642515 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:53.644624 14142 raft_consensus.cc:515] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:53.623345 14421 raft_consensus.cc:493] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:25:53.630095 11013 tablet_copy_source_session.cc:215] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:25:53.651006 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:53.646522 14048 raft_consensus.cc:515] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:53.670194 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:53.671738 14293 leader_election.cc:290] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:53.672060 14382 leader_election.cc:290] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:25:53.672746 14427 raft_consensus.cc:493] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:25:53.673319 14427 raft_consensus.cc:515] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:53.670001 10929 raft_consensus.cc:2468] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 8.
I20260709 12:25:53.652482 11589 leader_election.cc:304] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:53.700603 10820 leader_election.cc:304] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:53.703882 14048 leader_election.cc:290] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:25:53.654410 14421 raft_consensus.cc:3060] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:53.715863 10922 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
mode: GRACEFUL
new_leader_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:41546
I20260709 12:25:53.722590 10922 raft_consensus.cc:606] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 9 LEADER]: Received request to transfer leadership to TS 80cd7d227db44f34a6108591dad9c040
I20260709 12:25:53.716944 14418 raft_consensus.cc:493] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:25:53.719368 14185 leader_election.cc:290] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:53.720149 14339 leader_election.cc:290] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:53.643296 14381 raft_consensus.cc:515] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:53.654783 14405 raft_consensus.cc:515] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:53.631192 14412 raft_consensus.cc:515] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:53.733549 14408 leader_election.cc:290] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:53.640511 14419 raft_consensus.cc:515] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:53.772380 14381 leader_election.cc:290] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:53.759984 14423 raft_consensus.cc:2749] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:25:53.783114 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 148324us
W20260709 12:25:53.786549 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 116524us
I20260709 12:25:53.790465 10894 leader_election.cc:304] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:25:53.779516 14407 raft_consensus.cc:2749] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:53.775481 14412 leader_election.cc:290] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:53.776305 11616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:25:53.776140 14433 raft_consensus.cc:493] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:25:53.744849 14418 raft_consensus.cc:515] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:53.812961 14405 leader_election.cc:290] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:53.833767 14427 leader_election.cc:290] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:25:53.844405 14142 leader_election.cc:290] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:53.832595 14419 leader_election.cc:290] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:25:53.854040 14418 leader_election.cc:290] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:25:53.860450 14440 raft_consensus.cc:2804] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:25:53.861012 14440 raft_consensus.cc:493] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:25:53.861356 14440 raft_consensus.cc:3060] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:53.863977 14430 ts_tablet_manager.cc:933] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d: Initiating tablet copy from peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:25:53.873785 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 171176us
W20260709 12:25:53.877352 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 197347us
W20260709 12:25:53.797307 14416 consensus_meta.cc:287] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d: Time spent flushing consensus metadata: real 0.574s	user 0.010s	sys 0.010s
I20260709 12:25:53.892587 10819 leader_election.cc:304] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:53.898074 14421 raft_consensus.cc:515] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:53.900427 14350 raft_consensus.cc:2749] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:53.901455 10820 leader_election.cc:304] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:53.888298 14419 consensus_queue.cc:1048] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 12:25:53.903254 10819 leader_election.cc:304] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:53.905778 10819 leader_election.cc:304] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:25:53.910094 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 257619us
I20260709 12:25:53.911634 10819 leader_election.cc:304] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:53.913736 10819 leader_election.cc:304] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:25:53.915170 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 124796us
W20260709 12:25:53.916332 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 122320us
I20260709 12:25:53.916699 10894 leader_election.cc:304] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:25:53.920583 10819 leader_election.cc:304] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:53.912063 14211 raft_consensus.cc:2749] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:53.909672 14350 raft_consensus.cc:2749] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:53.926671 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:53.926393 10819 leader_election.cc:304] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:53.917475 14427 raft_consensus.cc:2804] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:53.891469 14416 raft_consensus.cc:515] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:53.925859 14405 raft_consensus.cc:2749] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:53.946218 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:53.930141 14418 raft_consensus.cc:2749] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:53.948403 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:53.922223 14430 tablet_copy_client.cc:323] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Beginning tablet copy session from remote peer at address 127.9.116.67:39945
I20260709 12:25:53.945102 14427 raft_consensus.cc:493] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:53.950752 14427 raft_consensus.cc:3060] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:53.952126 14416 leader_election.cc:290] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 4 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:53.930022 14402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5b822586ed04f2cb681fefd045b3f6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.953639 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:53.954785 11623 raft_consensus.cc:1240] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 3. Current term is 4. Ops: []
I20260709 12:25:53.919258 14389 raft_consensus.cc:2749] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:53.921432 11616 raft_consensus.cc:1240] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:53.804280 14433 raft_consensus.cc:515] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:53.936117 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:53.958828 14433 leader_election.cc:290] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:25:53.959930 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18294423a68a4671bf6c5a0f98645e4c" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:53.960947 14433 consensus_queue.cc:1059] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:53.936638 10864 tablet_copy_service.cc:140] P 80cd7d227db44f34a6108591dad9c040: Received BeginTabletCopySession request for tablet dad6a1da21304fcfacab384a6afc4101 from peer 3c52e0825c02476e89d84da9bb849f5d ({username='slave'} at 127.0.0.1:46480)
I20260709 12:25:53.928596 14447 raft_consensus.cc:2804] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:53.964805 14381 raft_consensus.cc:3055] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:25:53.964963 11616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:25:53.965179 14447 raft_consensus.cc:493] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:25:53.965307 14381 raft_consensus.cc:740] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:25:53.965806 14447 raft_consensus.cc:3060] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:53.966382 14293 consensus_queue.cc:1059] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:53.966549 14381 consensus_queue.cc:260] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:53.967515 14293 raft_consensus.cc:3055] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:53.967557 14381 raft_consensus.cc:3060] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:53.968026 14293 raft_consensus.cc:740] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:25:53.929880 14445 raft_consensus.cc:2749] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:53.944417 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:53.968977 14293 consensus_queue.cc:260] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:53.970326 14293 raft_consensus.cc:3060] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:53.965180 10864 tablet_copy_service.cc:161] P 80cd7d227db44f34a6108591dad9c040: Beginning new tablet copy session on tablet dad6a1da21304fcfacab384a6afc4101 from peer 3c52e0825c02476e89d84da9bb849f5d at {username='slave'} at 127.0.0.1:46480: session id = 3c52e0825c02476e89d84da9bb849f5d-dad6a1da21304fcfacab384a6afc4101
I20260709 12:25:53.982218 14445 raft_consensus.cc:493] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:25:53.982892 14445 raft_consensus.cc:515] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:53.985759 14445 leader_election.cc:290] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:53.986837 14445 raft_consensus.cc:493] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:25:53.989452 10894 leader_election.cc:304] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:25:53.994701 14449 raft_consensus.cc:2804] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:53.995232 14449 raft_consensus.cc:493] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:25:53.995695 14449 raft_consensus.cc:3060] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:53.996413 10999 raft_consensus.cc:2468] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 8.
I20260709 12:25:53.999462 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18294423a68a4671bf6c5a0f98645e4c" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:54.001609 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:54.004652 11013 tablet_copy_service.cc:140] P edcc56ddd3264984b4da6c1db59e7f08: Received BeginTabletCopySession request for tablet ee998be153d94f6f91c39dace2c32f19 from peer 3c52e0825c02476e89d84da9bb849f5d ({username='slave'} at 127.0.0.1:57514)
I20260709 12:25:54.005273 11013 tablet_copy_service.cc:161] P edcc56ddd3264984b4da6c1db59e7f08: Beginning new tablet copy session on tablet ee998be153d94f6f91c39dace2c32f19 from peer 3c52e0825c02476e89d84da9bb849f5d at {username='slave'} at 127.0.0.1:57514: session id = 3c52e0825c02476e89d84da9bb849f5d-ee998be153d94f6f91c39dace2c32f19
I20260709 12:25:54.006294 14421 leader_election.cc:290] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 8 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:54.009130 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:53.987623 14445 raft_consensus.cc:515] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:54.016691 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:54.017241 10996 raft_consensus.cc:2468] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 4.
I20260709 12:25:54.018685 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:54.016376 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:54.024966 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:54.025293 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:54.025815 10853 raft_consensus.cc:2468] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 6.
I20260709 12:25:54.026098 14408 consensus_queue.cc:1048] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:54.012605 14445 leader_election.cc:290] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:54.031378 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:54.031837 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:54.031376 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac83709373b4efd9c3aa1472a9f9022" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:54.035049 14408 raft_consensus.cc:993] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea: : Instructing follower 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:25:54.035630 14408 raft_consensus.cc:1081] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 9 LEADER]: Signalling peer 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:25:54.014855 10864 tablet_copy_source_session.cc:215] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:25:54.047154 14402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:45920 (request call id 372) took 2102 ms. Trace:
I20260709 12:25:54.049525 11588 leader_election.cc:304] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:54.051167 14438 raft_consensus.cc:2749] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:54.044059 11589 leader_election.cc:304] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:54.046017 10895 leader_election.cc:304] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:25:54.033342 14449 raft_consensus.cc:515] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:54.059528 10894 leader_election.cc:304] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:25:54.060885 14142 raft_consensus.cc:2804] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:54.061455 14142 raft_consensus.cc:493] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:25:54.061947 14142 raft_consensus.cc:3060] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:54.057041 10895 leader_election.cc:304] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:54.064635 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:54.065997 10854 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:56394
I20260709 12:25:54.066594 10854 raft_consensus.cc:493] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:54.066942 10854 raft_consensus.cc:3060] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:54.058583 14444 raft_consensus.cc:2804] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:25:54.068886 14444 raft_consensus.cc:697] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d [term 4 LEADER]: Becoming Leader. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
I20260709 12:25:54.069859 14444 consensus_queue.cc:237] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:54.073786 14420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dad6a1da21304fcfacab384a6afc4101. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.074998 10996 raft_consensus.cc:2468] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 8.
I20260709 12:25:54.061862 14408 raft_consensus.cc:2804] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:54.081561 14408 raft_consensus.cc:493] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:25:54.081992 14408 raft_consensus.cc:3060] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:54.083873 10854 raft_consensus.cc:515] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:54.085680 11589 leader_election.cc:304] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:54.058302 14440 raft_consensus.cc:515] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
W20260709 12:25:54.087316 14451 log.cc:927] Time spent T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 12:25:54.088425 14435 raft_consensus.cc:2749] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:54.092866 14440 leader_election.cc:290] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:54.093154 14416 raft_consensus.cc:2804] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:54.047654 14402 rpcz_store.cc:276] 0709 12:25:51.940823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:51.941025 (+   202us) service_pool.cc:224] Handling call
0709 12:25:51.963531 (+ 22506us) ts_tablet_manager.cc:934] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d: Initiating tablet copy from peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
0709 12:25:53.925652 (+1962121us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:25:54.010462 (+ 84810us) tablet_metadata.cc:665] Metadata flushed
0709 12:25:54.010613 (+   151us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:25:54.026770 (+ 16157us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:25:54.027082 (+   312us) tablet_replica.cc:206] Creating consensus instance
0709 12:25:54.042962 (+ 15880us) ts_tablet_manager.cc:989] Replica registered.
0709 12:25:54.043050 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":354,"tablet-copy.queue_time_us":21195,"thread_start_us":112539,"threads_started":2}
I20260709 12:25:54.095393 14416 raft_consensus.cc:697] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [term 8 LEADER]: Becoming Leader. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
I20260709 12:25:54.095499 11013 tablet_copy_source_session.cc:215] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:25:54.096256 14402 tablet_copy_client.cc:806] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 0 data blocks...
I20260709 12:25:54.096962 14416 consensus_queue.cc:237] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:54.098474 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:54.099406 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9331e5342644ca2bae19187b083a7d5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:54.100103 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:54.100119 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:54.101536 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
W20260709 12:25:54.102852 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:54.105341 14430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee998be153d94f6f91c39dace2c32f19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.105600 14427 raft_consensus.cc:515] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:54.107000 10850 raft_consensus.cc:2393] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 9: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:25:54.109300 10848 raft_consensus.cc:1240] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:54.097258 14402 tablet_copy_client.cc:670] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:25:54.108382 10895 leader_election.cc:304] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:54.116039 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:54.116791 14142 raft_consensus.cc:515] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:54.118839 10854 leader_election.cc:290] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 10 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:25:54.121337 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:54.122094 10929 raft_consensus.cc:3055] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:54.122463 10929 raft_consensus.cc:740] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:54.125664 10895 leader_election.cc:304] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:54.123427 10929 consensus_queue.cc:260] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:54.155691 10929 raft_consensus.cc:3060] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:54.159621 14142 leader_election.cc:290] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:54.166107 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:25:54.166880 10895 leader_election.cc:304] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:54.171195 10895 leader_election.cc:304] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:54.172022 14142 raft_consensus.cc:2749] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:25:54.169397 14435 raft_consensus.cc:2749] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:25:54.177475 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:54.159965 14440 raft_consensus.cc:2749] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:54.180343 14432 raft_consensus.cc:2749] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:54.184144 11619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63ecfc9bd3945818cfe15c03f001315" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:25:54.185786 11616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab816bcc6183447994a2cc013e46c5f8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:25:54.158540 14405 raft_consensus.cc:493] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:25:54.187263 14405 raft_consensus.cc:515] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:54.189807 14402 tablet_copy_client.cc:538] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:25:54.190785 14427 leader_election.cc:290] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:54.191905 10895 leader_election.cc:304] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:25:54.192735 14435 raft_consensus.cc:2804] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:54.193115 14435 raft_consensus.cc:493] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:25:54.193455 14435 raft_consensus.cc:3060] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:54.194363 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:54.197954 14449 leader_election.cc:290] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:54.204644 10895 leader_election.cc:304] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:54.206388 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:54.115264 14447 raft_consensus.cc:515] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:54.213109 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:54.220323 10922 raft_consensus.cc:3060] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:54.222609 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:54.213236 14410 raft_consensus.cc:2749] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:54.226258 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:54.232479 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:54.241719 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: true dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:25:54.244657 10929 raft_consensus.cc:2468] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 10.
I20260709 12:25:54.245915 10819 leader_election.cc:304] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:25:54.248395 10922 raft_consensus.cc:2468] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 9.
I20260709 12:25:54.250700 10819 leader_election.cc:304] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:25:54.249645 11616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:25:54.249794 14295 raft_consensus.cc:493] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:25:54.260434 14435 raft_consensus.cc:515] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } }
I20260709 12:25:54.264606 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:54.266157 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:54.266321 10968 leader_election.cc:304] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:54.260360 14295 raft_consensus.cc:515] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:54.267513 14211 raft_consensus.cc:2804] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:54.268070 14211 raft_consensus.cc:697] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 10 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:54.268916 14211 consensus_queue.cc:237] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:54.269310 14295 leader_election.cc:290] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:54.272462 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:54.272665 14435 leader_election.cc:290] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 election: Requested vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265)
I20260709 12:25:54.274439 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:54.283970 14415 raft_consensus.cc:2749] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:54.286336 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:54.289965 14447 leader_election.cc:290] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 10 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:54.290588 10749 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60730 (request call id 293) took 1104 ms. Trace:
W20260709 12:25:54.297853 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 47222.5us
I20260709 12:25:54.301918 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:54.291152 10749 rpcz_store.cc:276] 0709 12:25:53.186428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:53.186638 (+   210us) service_pool.cc:224] Handling call
0709 12:25:54.290448 (+1103810us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:53.272557 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:53.273178 (+   621us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:53.273212 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:25:53.273230 (+    18us) tablet.cc:662] Decoding operations
0709 12:25:53.273582 (+   352us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:53.273770 (+   188us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:53.273805 (+    35us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:25:53.274015 (+   210us) tablet.cc:701] Row locks acquired
0709 12:25:53.274034 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:25:53.274185 (+   151us) write_op.cc:270] Start()
0709 12:25:53.300177 (+ 25992us) write_op.cc:276] Timestamp: P: 1783599953274130 usec, L: 0
0709 12:25:53.314531 (+ 14354us) op_driver.cc:348] REPLICATION: starting
0709 12:25:53.418111 (+103580us) log.cc:844] Serialized 595 byte log entry
0709 12:25:54.055885 (+637774us) op_driver.cc:464] REPLICATION: finished
0709 12:25:54.257561 (+201676us) write_op.cc:301] APPLY: starting
0709 12:25:54.257650 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:54.257748 (+    98us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:54.257885 (+   137us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:54.258100 (+   215us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:54.258294 (+   194us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:25:54.258337 (+    43us) write_op.cc:312] APPLY: finished
0709 12:25:54.258523 (+   186us) log.cc:844] Serialized 23 byte log entry
0709 12:25:54.258808 (+   285us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:54.258897 (+    89us) write_op.cc:454] Released schema lock
0709 12:25:54.258936 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:54.259349 (+   413us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:54.259378 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":199196,"apply.run_cpu_time_us":1798,"apply.run_wall_time_us":1793,"num_ops":1,"prepare.queue_time_us":10659,"prepare.run_cpu_time_us":32711,"prepare.run_wall_time_us":579175,"raft.queue_time_us":112884,"raft.run_cpu_time_us":68913,"raft.run_wall_time_us":167923,"replication_time_us":741092,"thread_start_us":421176,"threads_started":4,"wal-append.queue_time_us":305547}]]}
I20260709 12:25:54.306707 14405 leader_election.cc:290] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:54.316740 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:54.322043 10968 leader_election.cc:304] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d
I20260709 12:25:54.226779 14408 raft_consensus.cc:515] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:54.337275 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:54.331941 10929 raft_consensus.cc:1240] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:54.350291 10968 leader_election.cc:304] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:54.330046 14419 raft_consensus.cc:2804] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:54.357746 10922 raft_consensus.cc:1240] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 7. Current term is 8. Ops: []
W20260709 12:25:54.360447 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:54.362716 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:54.364895 10820 leader_election.cc:304] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:54.375615 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:54.351197 14295 raft_consensus.cc:2804] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:54.383006 10853 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
mode: GRACEFUL
new_leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:47358
I20260709 12:25:54.385202 10853 raft_consensus.cc:606] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 6 LEADER]: Received request to transfer leadership to TS edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:54.333796 14422 consensus_queue.cc:1048] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.121s
I20260709 12:25:54.392900 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac83709373b4efd9c3aa1472a9f9022" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:54.389694 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:54.352540 14405 raft_consensus.cc:493] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:25:54.361423 14433 raft_consensus.cc:2749] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:54.398267 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab816bcc6183447994a2cc013e46c5f8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:54.377417 14383 raft_consensus.cc:993] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08: : Instructing follower e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:25:54.400506 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63ecfc9bd3945818cfe15c03f001315" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:54.403216 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:54.421794 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9331e5342644ca2bae19187b083a7d5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:54.423148 14430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:45920 (request call id 380) took 1159 ms. Trace:
W20260709 12:25:54.427938 14454 log.cc:927] Time spent T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 12:25:54.413079 14446 raft_consensus.cc:2749] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:54.413471 14405 raft_consensus.cc:515] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:54.451627 14405 leader_election.cc:290] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:54.452318 10848 raft_consensus.cc:2468] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 9.
I20260709 12:25:54.433967 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:54.455050 14430 rpcz_store.cc:276] 0709 12:25:53.263457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:53.274524 (+ 11067us) service_pool.cc:224] Handling call
0709 12:25:53.864414 (+589890us) ts_tablet_manager.cc:934] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d: Initiating tablet copy from peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
0709 12:25:54.103927 (+239513us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:25:54.285890 (+181963us) tablet_metadata.cc:665] Metadata flushed
0709 12:25:54.286082 (+   192us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:25:54.422258 (+136176us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:25:54.422665 (+   407us) tablet_replica.cc:206] Creating consensus instance
0709 12:25:54.423004 (+   339us) ts_tablet_manager.cc:989] Replica registered.
0709 12:25:54.423069 (+    65us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":16023,"tablet-copy.queue_time_us":441726,"thread_start_us":393141,"threads_started":2}
I20260709 12:25:54.459498 14430 tablet_copy_client.cc:806] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 0 data blocks...
I20260709 12:25:54.460213 14430 tablet_copy_client.cc:670] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:25:54.473433 10750 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60736 (request call id 324) took 1170 ms. Trace:
I20260709 12:25:54.483803 10750 rpcz_store.cc:276] 0709 12:25:53.302491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:53.303589 (+  1098us) service_pool.cc:224] Handling call
0709 12:25:54.473226 (+1169637us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
I20260709 12:25:54.388607 14295 raft_consensus.cc:493] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:25:54.488008 14295 raft_consensus.cc:3060] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:54.438253 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:54.442018 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:25:54.446911 10894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:54.437160 14381 raft_consensus.cc:1081] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 6 LEADER]: Signalling peer e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:25:54.484871 14433 raft_consensus.cc:493] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:25:54.497975 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:54.436676 14408 leader_election.cc:290] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:54.500228 10895 leader_election.cc:304] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:54.457556 14420 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:45890 (request call id 486) took 1374 ms. Trace:
I20260709 12:25:54.493821 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:54.512831 10922 raft_consensus.cc:1240] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 5. Current term is 6. Ops: []
W20260709 12:25:54.527153 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 210158us
W20260709 12:25:54.528631 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 178450us
I20260709 12:25:54.529803 10968 leader_election.cc:304] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:54.542313 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:54.546173 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
W20260709 12:25:54.552239 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 52073.2us
I20260709 12:25:54.553162 10895 leader_election.cc:304] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:54.553862 10968 leader_election.cc:304] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040
I20260709 12:25:54.554955 14142 raft_consensus.cc:2749] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:54.555135 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:54.563649 10895 leader_election.cc:304] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:54.544728 14433 raft_consensus.cc:515] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:54.574100 14433 leader_election.cc:290] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:54.562630 14293 raft_consensus.cc:493] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:25:54.575840 14293 raft_consensus.cc:515] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:54.577499 14413 raft_consensus.cc:493] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:25:54.578172 14413 raft_consensus.cc:515] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:54.578776 14293 leader_election.cc:290] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:54.582288 14408 raft_consensus.cc:2749] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:54.589967 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:54.531615 14419 raft_consensus.cc:697] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 9 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:54.586300 10895 leader_election.cc:304] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:25:54.599231 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 234382us
I20260709 12:25:54.602532 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
W20260709 12:25:54.605505 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 83527.7us
I20260709 12:25:54.584851 14422 raft_consensus.cc:2749] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:54.614210 10895 leader_election.cc:304] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:25:54.615238 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 59979.6us
I20260709 12:25:54.616127 10968 leader_election.cc:304] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040
I20260709 12:25:54.607784 14381 raft_consensus.cc:2749] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:54.618139 14413 leader_election.cc:290] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:54.542973 14420 rpcz_store.cc:276] 0709 12:25:53.083617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:53.084062 (+   445us) service_pool.cc:224] Handling call
0709 12:25:53.193078 (+109016us) ts_tablet_manager.cc:934] T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d: Initiating tablet copy from peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265)
0709 12:25:54.072543 (+879465us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:25:54.279187 (+206644us) tablet_metadata.cc:665] Metadata flushed
0709 12:25:54.279364 (+   177us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:25:54.456771 (+177407us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:25:54.457101 (+   330us) tablet_replica.cc:206] Creating consensus instance
0709 12:25:54.457426 (+   325us) ts_tablet_manager.cc:989] Replica registered.
0709 12:25:54.457490 (+    64us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":63570,"tablet-copy.queue_time_us":91884,"thread_start_us":131531,"threads_started":2}
I20260709 12:25:54.589811 14438 raft_consensus.cc:493] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:25:54.621138 10895 leader_election.cc:304] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:54.621790 14142 raft_consensus.cc:2749] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:25:54.595678 14432 raft_consensus.cc:2749] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:54.625139 10895 leader_election.cc:304] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:54.630878 14142 raft_consensus.cc:2749] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:54.626201 14420 tablet_copy_client.cc:806] T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 0 data blocks...
I20260709 12:25:54.638053 14420 tablet_copy_client.cc:670] T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:25:54.639802 14436 raft_consensus.cc:2749] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:25:54.610311 14293 raft_consensus.cc:493] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:25:54.635382 14408 raft_consensus.cc:2749] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:54.645748 14295 raft_consensus.cc:515] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:54.652752 14099 consensus_queue.cc:1059] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:25:54.652781 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 47461.2us
I20260709 12:25:54.654748 14465 raft_consensus.cc:3055] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:54.657712 14465 raft_consensus.cc:740] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:54.619642 14185 raft_consensus.cc:493] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:25:54.652933 14445 consensus_queue.cc:1059] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:54.675009 14470 raft_consensus.cc:493] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:25:54.624257 14413 raft_consensus.cc:2749] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:54.626289 14438 raft_consensus.cc:515] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:54.675701 14185 raft_consensus.cc:515] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:54.672854 14419 consensus_queue.cc:237] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:54.643674 14293 raft_consensus.cc:515] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:25:54.680722 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 158565us
I20260709 12:25:54.702262 10820 leader_election.cc:304] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:54.659006 14465 consensus_queue.cc:260] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } }
I20260709 12:25:54.683902 10752 catalog_manager.cc:5697] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: term changed from 3 to 4, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68). New cstate: current_term: 4 leader_uuid: "3c52e0825c02476e89d84da9bb849f5d" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:54.704887 10820 leader_election.cc:304] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:54.634559 14381 consensus_queue.cc:1059] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 12:25:54.711795 14465 raft_consensus.cc:3060] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:54.684804 14470 raft_consensus.cc:515] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:54.713189 14467 raft_consensus.cc:2749] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:54.710000 10894 leader_election.cc:304] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:54.714780 10968 leader_election.cc:304] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:54.683415 14415 raft_consensus.cc:493] T dad6a1da21304fcfacab384a6afc4101 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:25:54.718357 14402 tablet_bootstrap.cc:492] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap starting.
I20260709 12:25:54.731683 10894 leader_election.cc:304] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:54.718907 14426 raft_consensus.cc:2749] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:54.733459 14432 raft_consensus.cc:2749] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:54.735991 14440 raft_consensus.cc:2749] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:54.722379 14438 leader_election.cc:290] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:54.743047 10968 leader_election.cc:304] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:54.743446 10929 raft_consensus.cc:3060] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:54.744846 10968 leader_election.cc:304] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:54.724864 14185 leader_election.cc:290] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:54.727041 10895 leader_election.cc:304] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:54.733515 14339 raft_consensus.cc:3055] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:54.754940 14142 raft_consensus.cc:2749] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:54.754881 10894 leader_election.cc:304] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:54.728375 14389 raft_consensus.cc:3055] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:54.765515 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:54.766600 10927 raft_consensus.cc:1240] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:54.766923 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:54.767558 10923 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:59622
I20260709 12:25:54.768092 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:54.768204 10923 raft_consensus.cc:493] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:54.768726 10923 raft_consensus.cc:3060] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:54.768340 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b17195a94142039c40f598ed006c94" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:54.753320 10820 leader_election.cc:304] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:54.769917 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:54.771512 10820 leader_election.cc:304] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:54.748883 14383 raft_consensus.cc:2749] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:54.778805 10922 raft_consensus.cc:1240] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:25:54.751327 14381 raft_consensus.cc:2749] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:54.780603 10929 raft_consensus.cc:1275] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:25:54.755484 14413 raft_consensus.cc:2749] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:54.761425 14339 raft_consensus.cc:740] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:25:54.779639 14418 raft_consensus.cc:2749] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:25:54.788676 14295 leader_election.cc:290] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:25:54.776889 14420 tablet_copy_client.cc:538] T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:25:54.788796 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:54.772910 14436 raft_consensus.cc:2749] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:54.765067 14389 raft_consensus.cc:740] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:54.776065 14467 raft_consensus.cc:2749] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:54.803763 14293 leader_election.cc:290] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:54.740124 14415 raft_consensus.cc:515] T dad6a1da21304fcfacab384a6afc4101 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:54.814523 10820 leader_election.cc:304] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:25:54.819446 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 48022.2us
I20260709 12:25:54.784648 14470 leader_election.cc:290] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:54.797698 14430 tablet_copy_client.cc:538] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:25:54.839771 14475 raft_consensus.cc:493] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:25:54.840528 14389 consensus_queue.cc:260] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:54.840835 14475 raft_consensus.cc:515] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:54.841918 14389 raft_consensus.cc:3060] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:54.788921 14471 raft_consensus.cc:493] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:25:54.807471 14383 raft_consensus.cc:493] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:25:54.843350 10923 raft_consensus.cc:515] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:25:54.846585 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 71869.2us
W20260709 12:25:54.855072 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 90116us
I20260709 12:25:54.855811 10820 leader_election.cc:304] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:54.835022 14445 raft_consensus.cc:2749] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:54.858008 10820 leader_election.cc:304] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:54.839785 14415 leader_election.cc:290] T dad6a1da21304fcfacab384a6afc4101 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:54.842252 14295 consensus_queue.cc:1059] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:25:54.868295 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b17195a94142039c40f598ed006c94" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:54.871502 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:54.863533 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:54.865274 10923 leader_election.cc:290] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:54.869750 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:54.877525  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:25:54.864943 14350 raft_consensus.cc:2749] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:54.879551 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:54.880278  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:54.881613  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:54.846608 14383 raft_consensus.cc:515] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:54.885319 14472 consensus_queue.cc:1048] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:25:54.886399 14383 leader_election.cc:290] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:54.864064 14099 raft_consensus.cc:2749] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:54.893656 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:54.894588 10998 raft_consensus.cc:3055] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:54.894986 10998 raft_consensus.cc:740] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:25:54.848757 14339 consensus_queue.cc:260] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:54.901628 10998 consensus_queue.cc:260] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:54.908566 14339 raft_consensus.cc:3060] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:25:54.916535 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 139094us
I20260709 12:25:54.908638 10998 raft_consensus.cc:3060] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:25:54.923225 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:54.926390 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:54.929685 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:54.931839 11003 raft_consensus.cc:1240] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Rejecting Update request from peer 3c52e0825c02476e89d84da9bb849f5d for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:54.933348 11589 leader_election.cc:304] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:54.934654 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:54.913764 14383 raft_consensus.cc:3055] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:25:54.938288 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:54.847755 14471 raft_consensus.cc:515] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:54.926783 10968 leader_election.cc:304] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:54.945639 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:54.948918 10995 raft_consensus.cc:1275] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:25:54.949203 10926 raft_consensus.cc:3060] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:54.949666 11001 raft_consensus.cc:1275] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:25:54.951593 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:54.940157 10894 leader_election.cc:304] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:54.953218 10929 raft_consensus.cc:1240] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 6. Current term is 8. Ops: []
I20260709 12:25:54.953809 10921 raft_consensus.cc:1240] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:54.954523 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:54.936757 14359 raft_consensus.cc:2749] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:54.963100 10968 leader_election.cc:304] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:54.969063 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:54.971455 10854 raft_consensus.cc:3060] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:25:54.937932 14383 raft_consensus.cc:740] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:25:54.972048 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:54.956290 14433 raft_consensus.cc:2804] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:54.948661 11616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:25:54.971887 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6a1da21304fcfacab384a6afc4101" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:54.950099 14475 leader_election.cc:290] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:54.979043 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6a1da21304fcfacab384a6afc4101" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:54.979122 14480 consensus_queue.cc:1059] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 12:25:55.007786 10854 raft_consensus.cc:2468] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 8.
I20260709 12:25:54.984529 14350 raft_consensus.cc:993] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040: : Instructing follower edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:25:55.010342 14480 raft_consensus.cc:3055] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:55.010736 14480 raft_consensus.cc:740] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
I20260709 12:25:55.010833 14350 raft_consensus.cc:1081] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 6 LEADER]: Signalling peer edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:25:55.009557 14430 tablet_bootstrap.cc:492] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap starting.
I20260709 12:25:55.001587 10922 raft_consensus.cc:1275] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:25:55.001844 11622 raft_consensus.cc:3060] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:55.002982 14433 raft_consensus.cc:493] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:25:55.024950 14433 raft_consensus.cc:3060] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:55.003695 14477 raft_consensus.cc:2749] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:55.028227 14293 raft_consensus.cc:2749] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:25:55.029036 10969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 53736.2us
I20260709 12:25:55.036695 14471 leader_election.cc:290] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:55.018630 10998 raft_consensus.cc:2468] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 8.
W20260709 12:25:55.082322 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 106593us
I20260709 12:25:55.109747 11622 raft_consensus.cc:1275] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:25:55.099359 14489 consensus_queue.cc:1059] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:25:55.121479 14489 raft_consensus.cc:3055] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:55.121917 14489 raft_consensus.cc:740] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:25:55.112815 10968 leader_election.cc:304] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:55.122888 14099 consensus_queue.cc:1048] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:55.123457 10968 leader_election.cc:304] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:55.127069 10926 raft_consensus.cc:1275] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:25:55.127213 10894 leader_election.cc:304] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:25:55.129330 14471 raft_consensus.cc:2749] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:25:55.155906 14480 consensus_queue.cc:260] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:55.131899 14381 raft_consensus.cc:2749] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:55.146966 14444 consensus_queue.cc:1048] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:25:55.161676 14489 consensus_queue.cc:260] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:55.164904 14420 tablet_bootstrap.cc:492] T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap starting.
I20260709 12:25:55.285336 14480 raft_consensus.cc:3060] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:55.285848 14472 consensus_queue.cc:1048] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:55.170593 14383 consensus_queue.cc:260] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:55.290969 14383 raft_consensus.cc:3060] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:55.190790 11003 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:37512
I20260709 12:25:55.185931 10969 leader_election.cc:304] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:55.197971 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:55.201830 14438 consensus_queue.cc:1048] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:55.193379 10820 leader_election.cc:304] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:55.211439 14445 consensus_queue.cc:1048] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:25:55.300662 10969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 114831us
I20260709 12:25:55.246408 14433 raft_consensus.cc:515] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:55.135632 10968 leader_election.cc:304] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:55.295238 11003 raft_consensus.cc:493] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 12:25:55.295459 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 168337us
I20260709 12:25:55.313035 11589 leader_election.cc:304] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:55.340772 11003 raft_consensus.cc:3060] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:25:55.338022 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 144722us
W20260709 12:25:55.342871 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:55.341949 14381 raft_consensus.cc:2749] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:25:55.352857 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 217316us
I20260709 12:25:55.342108 14447 raft_consensus.cc:2804] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:25:55.361841 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 111491us
I20260709 12:25:55.349124 14350 raft_consensus.cc:2749] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:55.343945 14468 raft_consensus.cc:2749] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:55.358599 14474 raft_consensus.cc:2749] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:55.378022 11003 raft_consensus.cc:515] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:55.384804 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:55.400127 11003 leader_election.cc:290] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:55.387225 14461 consensus_queue.cc:1059] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:25:55.414745 14461 raft_consensus.cc:3055] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:55.415508 14461 raft_consensus.cc:740] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
W20260709 12:25:55.441627 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 66920.5us
W20260709 12:25:55.443781 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:55.458591 10999 raft_consensus.cc:1240] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:55.416677 14461 consensus_queue.cc:260] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:25:55.492072 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 113024us
I20260709 12:25:55.493435 10968 leader_election.cc:304] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:55.495949 10968 leader_election.cc:304] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:55.498699 10968 leader_election.cc:304] T dad6a1da21304fcfacab384a6afc4101 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:55.522301 10925 raft_consensus.cc:1275] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:25:55.620950 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 102033us
I20260709 12:25:55.492380 14433 leader_election.cc:290] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 10 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:25:55.626701 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 105709us
I20260709 12:25:55.508435 14479 raft_consensus.cc:2749] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:55.672135 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:25:55.675901 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 300588us
I20260709 12:25:55.498557 14474 raft_consensus.cc:2749] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:55.684302 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:55.684543 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:55.518047 14470 raft_consensus.cc:2749] T dad6a1da21304fcfacab384a6afc4101 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:55.690217 10846 raft_consensus.cc:3055] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:55.693799 10846 raft_consensus.cc:740] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:55.517357 14447 raft_consensus.cc:697] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 8 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:55.667770 14467 raft_consensus.cc:493] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:25:55.706727 10846 consensus_queue.cc:260] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:25:55.728315 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:55.743419 11003 raft_consensus.cc:1275] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 12:25:55.743978 11003 pending_rounds.cc:85] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08: Aborting all ops after (but not including) 5
I20260709 12:25:55.744204 11003 pending_rounds.cc:107] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:25:55.744491 11003 raft_consensus.cc:2889] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:55.764801 14447 consensus_queue.cc:237] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:55.774439 10752 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36188 (request call id 168) took 1157 ms. Trace:
I20260709 12:25:55.712404 14467 raft_consensus.cc:515] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:55.827929 14467 leader_election.cc:290] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:25:55.802778 14465 consensus_queue.cc:1048] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:25:55.898113 11619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:25:55.871963 14482 raft_consensus.cc:493] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
W20260709 12:25:55.935461 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:55.775154 10752 rpcz_store.cc:276] 0709 12:25:54.616917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:54.619079 (+  2162us) service_pool.cc:224] Handling call
0709 12:25:55.774355 (+1155276us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:54.846964 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:54.890066 (+ 43102us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:54.890110 (+    44us) write_op.cc:435] Acquired schema lock
0709 12:25:54.890129 (+    19us) tablet.cc:662] Decoding operations
0709 12:25:54.890537 (+   408us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:54.890620 (+    83us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:54.890655 (+    35us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:25:54.891071 (+   416us) tablet.cc:701] Row locks acquired
0709 12:25:54.891094 (+    23us) write_op.cc:260] PREPARE: finished
0709 12:25:54.891252 (+   158us) write_op.cc:270] Start()
0709 12:25:54.891378 (+   126us) write_op.cc:276] Timestamp: P: 1783599954891203 usec, L: 0
0709 12:25:54.891401 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:25:54.955712 (+ 64311us) log.cc:844] Serialized 533 byte log entry
0709 12:25:55.142338 (+186626us) op_driver.cc:464] REPLICATION: finished
0709 12:25:55.403193 (+260855us) write_op.cc:301] APPLY: starting
0709 12:25:55.407486 (+  4293us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:55.426505 (+ 19019us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:55.459685 (+ 33180us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:55.496387 (+ 36702us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:55.627149 (+130762us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:25:55.667691 (+ 40542us) write_op.cc:312] APPLY: finished
0709 12:25:55.692447 (+ 24756us) log.cc:844] Serialized 23 byte log entry
0709 12:25:55.708806 (+ 16359us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:55.714624 (+  5818us) write_op.cc:454] Released schema lock
0709 12:25:55.720359 (+  5735us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:55.758249 (+ 37890us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:55.758290 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":56857,"reported_tablets":1,"spinlock_wait_cycles":1655168,"child_traces":[["op",{"apply.queue_time_us":248063,"apply.run_cpu_time_us":3173,"apply.run_wall_time_us":330160,"num_ops":1,"prepare.queue_time_us":99954,"prepare.run_cpu_time_us":4305,"prepare.run_wall_time_us":136327,"replication_time_us":250607,"thread_start_us":259502,"threads_started":2}]]}
W20260709 12:25:55.945861 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 298817us
I20260709 12:25:55.952988 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:55.939630 14508 raft_consensus.cc:493] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:25:55.971980 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:55.972503 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:55.972673 10926 raft_consensus.cc:3060] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:55.986019 14498 consensus_queue.cc:1059] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 12:25:55.987484 14517 raft_consensus.cc:3055] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:55.987912 14517 raft_consensus.cc:740] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:55.988860 14517 consensus_queue.cc:260] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:55.996258 10820 leader_election.cc:304] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:56.007812 14381 raft_consensus.cc:493] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:25:56.011014 10926 raft_consensus.cc:2468] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 7.
W20260709 12:25:56.011713 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:56.008366 14381 raft_consensus.cc:515] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:56.017827 10968 leader_election.cc:304] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:56.026880 10968 leader_election.cc:304] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:55.939488 14482 raft_consensus.cc:515] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } }
I20260709 12:25:56.017103 14517 raft_consensus.cc:3060] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:56.067078 14488 raft_consensus.cc:2749] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:56.029671 14422 raft_consensus.cc:2749] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:56.047178 10968 leader_election.cc:304] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:25:56.007187 14508 raft_consensus.cc:515] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:25:56.086011 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 147001us
W20260709 12:25:56.108678 10895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:56.126787 14515 raft_consensus.cc:493] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:56.130107 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 83066.2us
W20260709 12:25:56.112129 14430 log.cc:927] Time spent T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 12:25:56.160106 14411 raft_consensus.cc:493] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.161221 14411 raft_consensus.cc:515] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:56.162289 14381 leader_election.cc:290] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:25:56.165309 14402 log.cc:927] Time spent T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d: Append to log took a long time: real 0.356s	user 0.005s	sys 0.001s
I20260709 12:25:56.166848 14484 raft_consensus.cc:2804] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:56.167527 14484 raft_consensus.cc:697] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:25:56.168594 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:56.173497 14467 raft_consensus.cc:493] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:25:56.174244 14467 raft_consensus.cc:515] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:56.168524 14484 consensus_queue.cc:237] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:56.185415 14525 raft_consensus.cc:2749] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:56.185527 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:56.127431 14515 raft_consensus.cc:515] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } }
I20260709 12:25:56.186627 10928 raft_consensus.cc:2393] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 8: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:25:56.190819 10846 raft_consensus.cc:3060] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:56.104699 14509 raft_consensus.cc:493] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:25:56.165238 14411 leader_election.cc:290] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:56.220834 14482 leader_election.cc:290] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265)
I20260709 12:25:56.191931 14509 raft_consensus.cc:515] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:56.235754 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:56.236752 10922 raft_consensus.cc:2393] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 7: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:25:56.238188 14509 leader_election.cc:290] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:56.244773 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:25:56.293260 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 342952us
W20260709 12:25:56.313938 14430 log.cc:927] Time spent T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:25:56.329241 10846 raft_consensus.cc:2468] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 7.
W20260709 12:25:56.312193 14522 log.cc:927] Time spent T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 12:25:56.340582 14515 leader_election.cc:290] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:56.342433 14467 leader_election.cc:290] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:56.343924 14402 tablet_bootstrap.cc:492] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=1 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:56.345039 14402 tablet_bootstrap.cc:492] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap complete.
I20260709 12:25:56.345866 14402 ts_tablet_manager.cc:1403] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d: Time spent bootstrapping tablet: real 1.628s	user 0.031s	sys 0.027s
I20260709 12:25:56.363340 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:56.384424 14517 raft_consensus.cc:493] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:25:56.363821 14421 raft_consensus.cc:493] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.401067 14531 raft_consensus.cc:493] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:25:56.401867 14531 raft_consensus.cc:515] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:56.401067 14421 raft_consensus.cc:515] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:56.408262 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:56.410576 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:56.411628 10922 raft_consensus.cc:2468] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 7.
I20260709 12:25:56.423687 10819 leader_election.cc:304] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:25:56.425077 14421 leader_election.cc:290] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:56.436642 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:56.372776 14467 consensus_queue.cc:1048] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 12:25:56.386263 14517 raft_consensus.cc:515] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:56.431299 14402 raft_consensus.cc:359] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:56.513291 10922 raft_consensus.cc:2468] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 8.
W20260709 12:25:56.531334 10820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:56.495020 14446 raft_consensus.cc:2804] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:56.532325 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:56.535621 10928 raft_consensus.cc:2393] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 6: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:25:56.462432 14489 raft_consensus.cc:3060] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:56.464891 14508 leader_election.cc:290] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:25:56.453140 14530 raft_consensus.cc:493] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:25:56.542430 14530 raft_consensus.cc:515] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:56.544884 14530 leader_election.cc:290] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:25:56.454978 14402 raft_consensus.cc:740] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Initialized, Role: LEARNER
W20260709 12:25:56.546945 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 114355us
I20260709 12:25:56.518379 14435 raft_consensus.cc:493] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:25:56.535234 14446 raft_consensus.cc:493] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:56.565691 14464 raft_consensus.cc:493] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.563943 14350 raft_consensus.cc:493] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:25:56.566289 14464 raft_consensus.cc:515] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:56.566537 14350 raft_consensus.cc:515] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:56.555253 14405 raft_consensus.cc:493] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:25:56.571167 14405 raft_consensus.cc:515] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:56.573789 14405 leader_election.cc:290] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:56.588119 14531 leader_election.cc:290] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:56.568745 14402 consensus_queue.cc:260] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:56.561759 14446 raft_consensus.cc:3060] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:56.613809 14464 leader_election.cc:290] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:56.555912 14435 raft_consensus.cc:515] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:56.637387 14517 leader_election.cc:290] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:25:56.615517 10752 catalog_manager.cc:5697] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 7 to 8, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68). New cstate: current_term: 8 leader_uuid: "3c52e0825c02476e89d84da9bb849f5d" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:56.639834 10752 catalog_manager.cc:5697] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 6 to 8, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 8 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:56.642531 10752 catalog_manager.cc:5697] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 9 to 10, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 10 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:56.652603 14461 raft_consensus.cc:3060] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:56.657510 14350 leader_election.cc:290] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:56.665548 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c6d38c4d8a90a81975a6a0cb13" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
W20260709 12:25:56.666282 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 71315.1us
I20260709 12:25:56.666638 14402 ts_tablet_manager.cc:1434] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d: Time spent starting tablet: real 0.320s	user 0.009s	sys 0.008s
I20260709 12:25:56.667701 14440 raft_consensus.cc:493] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:25:56.668318 14440 raft_consensus.cc:515] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:56.670553 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:56.671372 10853 raft_consensus.cc:2468] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 8.
I20260709 12:25:56.675395 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:56.676692 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:56.677917 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c6d38c4d8a90a81975a6a0cb13" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:56.684419 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:56.686200 11588 leader_election.cc:304] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:25:56.700342 10924 raft_consensus.cc:2393] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 5: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:25:56.701782 10994 raft_consensus.cc:2468] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 5.
I20260709 12:25:56.706790 14472 raft_consensus.cc:2804] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:56.708719 14472 raft_consensus.cc:493] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:56.709273 14472 raft_consensus.cc:3060] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:56.712428 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18294423a68a4671bf6c5a0f98645e4c" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:56.715341 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:56.700392 14470 raft_consensus.cc:493] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.670614 14440 leader_election.cc:290] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:25:56.710099 14422 raft_consensus.cc:493] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.721711 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:56.725317 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:56.734431 11000 raft_consensus.cc:2393] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 9: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:25:56.725749 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:25:56.728415 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63ecfc9bd3945818cfe15c03f001315" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:25:56.719250 10921 raft_consensus.cc:2468] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 8.
I20260709 12:25:56.737367 11002 raft_consensus.cc:1240] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 LEADER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:56.706672 14484 raft_consensus.cc:493] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:25:56.743278 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:56.745440 10997 raft_consensus.cc:2468] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 6.
I20260709 12:25:56.747247 10968 leader_election.cc:304] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:56.749327 11619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18294423a68a4671bf6c5a0f98645e4c" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:25:56.750682 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63ecfc9bd3945818cfe15c03f001315" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:56.751144 14488 raft_consensus.cc:2804] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:56.751639 14488 raft_consensus.cc:493] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:25:56.752027 14488 raft_consensus.cc:3060] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:56.718495 14433 raft_consensus.cc:493] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:25:56.760411 14433 raft_consensus.cc:515] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:56.762722 14433 leader_election.cc:290] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:56.743811 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:56.765012 10968 leader_election.cc:304] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040
I20260709 12:25:56.770167 10895 leader_election.cc:304] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:56.771804 10968 leader_election.cc:304] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:56.772131 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:56.773123 14517 raft_consensus.cc:493] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.767824 10819 leader_election.cc:304] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:25:56.776865 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:56.780232 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:56.785594 10845 raft_consensus.cc:1275] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:25:56.805439 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:56.733587 14470 raft_consensus.cc:515] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:56.774857 14482 raft_consensus.cc:2749] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:56.810606 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:56.748303 14422 raft_consensus.cc:515] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:56.783502 14512 raft_consensus.cc:2804] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:56.784060 14508 raft_consensus.cc:2749] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:56.778605 14435 leader_election.cc:290] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:56.830724 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:56.833359 14446 raft_consensus.cc:515] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } }
I20260709 12:25:56.833971 14411 consensus_queue.cc:1048] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:56.835963 14411 raft_consensus.cc:493] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:25:56.836616 10895 leader_election.cc:304] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:25:56.837713 10854 raft_consensus.cc:2368] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for earlier term 7. Current term is 8.
I20260709 12:25:56.839782 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:56.843631 14381 raft_consensus.cc:493] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:25:56.844364 14381 raft_consensus.cc:515] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:56.846966 11002 raft_consensus.cc:2468] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 6.
I20260709 12:25:56.806876 14185 raft_consensus.cc:2749] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:25:56.842538 14430 log.cc:927] Time spent T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:25:56.806808 14534 raft_consensus.cc:493] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.857786 14534 raft_consensus.cc:515] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:56.858597 14430 tablet_bootstrap.cc:492] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:56.764569 14484 raft_consensus.cc:515] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:56.880446 14484 leader_election.cc:290] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:56.848052 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:56.868463 14511 raft_consensus.cc:493] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:25:56.839432 14512 raft_consensus.cc:493] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:56.773806 14517 raft_consensus.cc:515] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:56.877981 14430 tablet_bootstrap.cc:492] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap complete.
I20260709 12:25:56.892942 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:56.895938 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:56.897081 10923 raft_consensus.cc:3060] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:56.836630 14411 raft_consensus.cc:515] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:56.884455 14511 raft_consensus.cc:515] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:56.890805 14440 raft_consensus.cc:2804] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:56.905165 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:56.925340 10995 raft_consensus.cc:2468] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 9.
I20260709 12:25:56.896029 10846 raft_consensus.cc:2468] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 9.
I20260709 12:25:56.949713 10895 leader_election.cc:304] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:56.867427 14534 leader_election.cc:290] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:56.974148 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:57.075333 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:57.036763 10923 raft_consensus.cc:2468] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 8.
W20260709 12:25:57.031157 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 81180.7us
I20260709 12:25:56.984244 10996 raft_consensus.cc:1275] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:25:56.891158 14512 raft_consensus.cc:3060] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:56.956439 10894 leader_election.cc:304] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
W20260709 12:25:57.086386 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 110952us
I20260709 12:25:57.091337 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9331e5342644ca2bae19187b083a7d5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:57.093302 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:57.093680 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:57.095052 10847 raft_consensus.cc:2468] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 5.
I20260709 12:25:57.095157 10846 raft_consensus.cc:2468] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 4.
W20260709 12:25:57.098415 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 142105us
I20260709 12:25:57.099754 10968 leader_election.cc:304] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
W20260709 12:25:57.103521 10820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:57.002761 14446 leader_election.cc:290] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:56.981000 14416 raft_consensus.cc:493] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:25:57.106562 14416 raft_consensus.cc:515] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:57.029779 14339 raft_consensus.cc:493] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.108980 14339 raft_consensus.cc:515] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:57.097642 11013 tablet_copy_service.cc:342] P edcc56ddd3264984b4da6c1db59e7f08: Request end of tablet copy session 3c52e0825c02476e89d84da9bb849f5d-f5b822586ed04f2cb681fefd045b3f6d received from {username='slave'} at 127.0.0.1:57514
I20260709 12:25:57.111919 11013 tablet_copy_service.cc:434] P edcc56ddd3264984b4da6c1db59e7f08: ending tablet copy session 3c52e0825c02476e89d84da9bb849f5d-f5b822586ed04f2cb681fefd045b3f6d on tablet f5b822586ed04f2cb681fefd045b3f6d with peer 3c52e0825c02476e89d84da9bb849f5d
I20260709 12:25:57.112850 14498 raft_consensus.cc:2804] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:57.113350 10995 raft_consensus.cc:2468] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 10.
I20260709 12:25:57.114178 10851 raft_consensus.cc:1275] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:25:57.113404 14381 leader_election.cc:290] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:25:57.041071 14430 ts_tablet_manager.cc:1403] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d: Time spent bootstrapping tablet: real 2.032s	user 0.048s	sys 0.024s
I20260709 12:25:56.929685 14440 raft_consensus.cc:493] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:57.135334 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6a1da21304fcfacab384a6afc4101" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:57.137125 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:57.144788 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:57.146865 10996 raft_consensus.cc:3060] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:25:56.982134 14535 raft_consensus.cc:2749] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:25:57.119086 14420 log.cc:927] Time spent T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:25:57.148865 10968 leader_election.cc:400] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265) with higher term. Message: Invalid argument: T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for earlier term 7. Current term is 8.
I20260709 12:25:57.169610 10968 leader_election.cc:403] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:57.148108 14411 leader_election.cc:290] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:57.038475 14422 leader_election.cc:290] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:57.118100 14415 raft_consensus.cc:2749] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:56.999987 14511 leader_election.cc:290] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:57.152559 14339 leader_election.cc:290] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:57.145565 14440 raft_consensus.cc:3060] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:57.158694 10819 leader_election.cc:304] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:25:57.159955 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:57.170812 14472 raft_consensus.cc:515] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:57.173370 14472 leader_election.cc:290] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 10 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:57.173676 11623 raft_consensus.cc:2368] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for earlier term 9. Current term is 10.
I20260709 12:25:57.113344 14498 raft_consensus.cc:493] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:57.176726 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:57.181113 10996 raft_consensus.cc:2468] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 8.
I20260709 12:25:57.181216 10925 raft_consensus.cc:3060] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Advancing to term 10
W20260709 12:25:57.182745 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 83589.8us
W20260709 12:25:57.183259 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 79303.4us
W20260709 12:25:57.232434 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 73865.4us
I20260709 12:25:57.005622 14488 raft_consensus.cc:515] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:57.183239 14498 raft_consensus.cc:3060] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:57.235790 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 48751.1us
W20260709 12:25:57.239820 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 71286.3us
W20260709 12:25:57.236711 14523 log.cc:927] Time spent T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 12:25:57.252049 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:57.252218 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:57.187762 14422 raft_consensus.cc:2749] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265) with higher term. Message: Invalid argument: T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for earlier term 7. Current term is 8.
I20260709 12:25:57.257028 10994 raft_consensus.cc:2468] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 8.
I20260709 12:25:57.263094 10968 leader_election.cc:304] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:25:57.245290 14505 raft_consensus.cc:2804] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:57.275228 14505 raft_consensus.cc:697] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [term 8 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:57.276185 14505 consensus_queue.cc:237] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } }
I20260709 12:25:57.278825 14420 tablet_bootstrap.cc:492] T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:57.270277 14488 leader_election.cc:290] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:57.272130 14517 leader_election.cc:290] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:57.281801 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9331e5342644ca2bae19187b083a7d5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:57.265755 10820 leader_election.cc:304] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:57.288514 10820 leader_election.cc:304] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:25:57.290179 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 119352us
I20260709 12:25:57.268002 10968 leader_election.cc:304] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:25:57.291895 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:57.292541 11002 raft_consensus.cc:3060] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:57.242553 14496 consensus_queue.cc:1048] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:25:57.253072 14411 raft_consensus.cc:493] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
W20260709 12:25:57.311592 14545 log.cc:927] Time spent T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:25:57.327898 14411 raft_consensus.cc:515] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:57.330871 14411 leader_election.cc:290] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:57.340382 14420 tablet_bootstrap.cc:492] T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap complete.
I20260709 12:25:57.285943 14461 raft_consensus.cc:2804] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:57.293627 14446 raft_consensus.cc:2749] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:25:57.398753 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 154915us
W20260709 12:25:57.399068 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 107043us
I20260709 12:25:57.309149 14488 raft_consensus.cc:2804] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:57.307035 14445 raft_consensus.cc:2749] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:57.437999 11002 raft_consensus.cc:2468] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 10.
I20260709 12:25:57.443065 11589 leader_election.cc:304] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:25:57.405283 14461 raft_consensus.cc:493] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:57.432013 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 171941us
I20260709 12:25:57.444831 14420 ts_tablet_manager.cc:1403] T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d: Time spent bootstrapping tablet: real 2.312s	user 0.032s	sys 0.026s
I20260709 12:25:57.431603 10820 leader_election.cc:304] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:25:57.461583 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 165419us
I20260709 12:25:57.434975 14488 raft_consensus.cc:493] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:57.442994 14543 raft_consensus.cc:493] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.425644 14501 consensus_queue.cc:1048] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:25:57.509769 10820 leader_election.cc:304] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:57.512365 14464 raft_consensus.cc:2749] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:57.511904 10820 leader_election.cc:304] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:57.514128 14506 raft_consensus.cc:2804] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:57.514721 14506 raft_consensus.cc:493] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:25:57.515187 14506 raft_consensus.cc:3060] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:57.517830 10820 leader_election.cc:304] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:57.518733 14464 raft_consensus.cc:2749] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:57.452435 14461 raft_consensus.cc:3060] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:57.505892 14468 raft_consensus.cc:2804] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:57.506600 14488 raft_consensus.cc:3060] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:57.503300 14445 raft_consensus.cc:3060] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:57.560879 10925 raft_consensus.cc:2468] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 10.
I20260709 12:25:57.565786 14512 raft_consensus.cc:515] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:57.508246 14543 raft_consensus.cc:515] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:57.570521 14468 raft_consensus.cc:697] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [term 10 LEADER]: Becoming Leader. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
I20260709 12:25:57.583560 14468 consensus_queue.cc:237] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:57.588140 14470 leader_election.cc:290] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:57.589707 14543 leader_election.cc:290] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:57.590859 14488 raft_consensus.cc:515] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:57.563182 14430 raft_consensus.cc:359] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [term 7 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:57.592370 14430 raft_consensus.cc:740] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [term 7 LEARNER]: Becoming Follower/Learner. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Initialized, Role: LEARNER
I20260709 12:25:57.593240 14488 leader_election.cc:290] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:57.593904 14416 leader_election.cc:290] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:57.593448 14430 consensus_queue.cc:260] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:57.597309 14430 ts_tablet_manager.cc:1434] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d: Time spent starting tablet: real 0.480s	user 0.011s	sys 0.001s
I20260709 12:25:57.606557 11616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:25:57.527478 14420 raft_consensus.cc:359] T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:57.615262 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:57.575186 14512 leader_election.cc:290] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:57.622295 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6a1da21304fcfacab384a6afc4101" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:57.600384 11622 raft_consensus.cc:1217] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [term 7 LEARNER]: Deduplicated request from leader. Original: 7.6->[7.7-7.7]   Dedup: 7.7->[]
I20260709 12:25:57.624769 14420 raft_consensus.cc:740] T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Initialized, Role: LEARNER
I20260709 12:25:57.628849 14420 consensus_queue.cc:260] T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:57.634407 10969 leader_election.cc:304] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
W20260709 12:25:57.644704 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 81506.8us
I20260709 12:25:57.645637 14415 raft_consensus.cc:2749] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:57.650566 14509 raft_consensus.cc:493] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:25:57.665359 14472 raft_consensus.cc:493] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:25:57.622349 14440 raft_consensus.cc:515] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:57.606587 14498 raft_consensus.cc:515] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:57.667919 14509 raft_consensus.cc:515] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:57.668287 14472 raft_consensus.cc:515] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:57.695202 14445 raft_consensus.cc:2749] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:57.696373 14472 leader_election.cc:290] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:57.701155 14498 leader_election.cc:290] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:57.702852 14506 raft_consensus.cc:515] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:57.757964 10921 raft_consensus.cc:2393] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 6: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:25:57.654744 11013 tablet_copy_service.cc:342] P edcc56ddd3264984b4da6c1db59e7f08: Request end of tablet copy session 3c52e0825c02476e89d84da9bb849f5d-ee998be153d94f6f91c39dace2c32f19 received from {username='slave'} at 127.0.0.1:57514
I20260709 12:25:57.765177 11013 tablet_copy_service.cc:434] P edcc56ddd3264984b4da6c1db59e7f08: ending tablet copy session 3c52e0825c02476e89d84da9bb849f5d-ee998be153d94f6f91c39dace2c32f19 on tablet ee998be153d94f6f91c39dace2c32f19 with peer 3c52e0825c02476e89d84da9bb849f5d
I20260709 12:25:57.768144 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:57.778828 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:57.734423  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:57.782395 10968 leader_election.cc:304] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:57.785681 11003 raft_consensus.cc:2468] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 4.
I20260709 12:25:57.790109 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:57.799041 10752 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60734 (request call id 297) took 1621 ms. Trace:
I20260709 12:25:57.816895 14543 raft_consensus.cc:2749] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:57.822306 14477 raft_consensus.cc:493] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.815318 14411 raft_consensus.cc:493] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.810390 14470 raft_consensus.cc:493] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:25:57.826169 14415 raft_consensus.cc:493] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:25:57.831562 14440 leader_election.cc:290] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:57.833423 14509 leader_election.cc:290] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:25:57.840763 14411 raft_consensus.cc:515] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:57.841533 14470 raft_consensus.cc:515] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:57.882043 14411 leader_election.cc:290] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:57.883051 14470 leader_election.cc:290] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:57.886746 11616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:25:57.887959 14420 ts_tablet_manager.cc:1434] T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d: Time spent starting tablet: real 0.371s	user 0.010s	sys 0.006s
I20260709 12:25:57.842859 14415 raft_consensus.cc:515] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:57.889204 14508 raft_consensus.cc:493] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:25:57.890349 14508 raft_consensus.cc:515] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:57.884970 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:57.899641 10920 raft_consensus.cc:3060] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:57.909461 14543 raft_consensus.cc:1064] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08: attempting to promote NON_VOTER 3c52e0825c02476e89d84da9bb849f5d to VOTER
I20260709 12:25:57.909723 14508 leader_election.cc:290] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:57.889973 14477 raft_consensus.cc:515] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:57.917462 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:57.891542 14415 leader_election.cc:290] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:57.918424 10845 raft_consensus.cc:2468] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 6.
I20260709 12:25:57.930686 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:57.931754 10998 raft_consensus.cc:3060] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:57.937364 14415 raft_consensus.cc:493] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.935688 11588 leader_election.cc:304] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:57.940217 14415 raft_consensus.cc:515] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:57.957901 14445 raft_consensus.cc:493] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.674014 14461 raft_consensus.cc:515] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:57.959081 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:57.958809 14445 raft_consensus.cc:515] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:57.960547 10996 raft_consensus.cc:2393] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 7: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:25:57.961781 14445 leader_election.cc:290] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:57.942210 14477 leader_election.cc:290] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:57.943025 14543 consensus_queue.cc:237] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:57.950088 14506 leader_election.cc:290] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:57.955315 14468 raft_consensus.cc:2749] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:57.972198 10749 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36188 (request call id 169) took 1653 ms. Trace:
I20260709 12:25:57.975754 14461 leader_election.cc:290] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:57.979946 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:57.800125 10752 rpcz_store.cc:276] 0709 12:25:56.176949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:56.177131 (+   182us) service_pool.cc:224] Handling call
0709 12:25:57.798710 (+1621579us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:56.768611 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:56.852309 (+ 83698us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:56.852352 (+    43us) write_op.cc:435] Acquired schema lock
0709 12:25:56.852371 (+    19us) tablet.cc:662] Decoding operations
0709 12:25:56.853025 (+   654us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:56.853090 (+    65us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:56.853123 (+    33us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:25:56.853527 (+   404us) tablet.cc:701] Row locks acquired
0709 12:25:56.853550 (+    23us) write_op.cc:260] PREPARE: finished
0709 12:25:56.853992 (+   442us) write_op.cc:270] Start()
0709 12:25:56.854159 (+   167us) write_op.cc:276] Timestamp: P: 1783599956853901 usec, L: 0
0709 12:25:56.854185 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:25:56.856065 (+  1880us) log.cc:844] Serialized 1298 byte log entry
0709 12:25:57.648175 (+792110us) op_driver.cc:464] REPLICATION: finished
0709 12:25:57.700087 (+ 51912us) write_op.cc:301] APPLY: starting
0709 12:25:57.700249 (+   162us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:57.700393 (+   144us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:57.700530 (+   137us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:57.701110 (+   580us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:57.701363 (+   253us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:25:57.701412 (+    49us) write_op.cc:312] APPLY: finished
0709 12:25:57.701673 (+   261us) log.cc:844] Serialized 35 byte log entry
0709 12:25:57.701876 (+   203us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:57.702008 (+   132us) write_op.cc:454] Released schema lock
0709 12:25:57.702053 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:57.702576 (+   523us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:57.702603 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":38849,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":49486,"apply.run_cpu_time_us":2479,"apply.run_wall_time_us":2485,"num_ops":3,"prepare.queue_time_us":82134,"prepare.run_cpu_time_us":79005,"prepare.run_wall_time_us":446779,"raft.queue_time_us":307133,"raft.run_cpu_time_us":22241,"raft.run_wall_time_us":63271,"replication_time_us":778078,"thread_start_us":615515,"threads_started":4,"wal-append.queue_time_us":424643}]]}
I20260709 12:25:57.987558 10920 raft_consensus.cc:2468] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 9.
I20260709 12:25:57.989919 10996 raft_consensus.cc:3060] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:57.996027 10895 leader_election.cc:400] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: Vote denied by peer 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613) with higher term. Message: Invalid argument: T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for earlier term 9. Current term is 10.
I20260709 12:25:58.001652 10895 leader_election.cc:403] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:58.005089 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:58.005327 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:58.006310 10851 raft_consensus.cc:2368] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for earlier term 8. Current term is 9.
I20260709 12:25:58.006173 10853 raft_consensus.cc:2468] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 9.
I20260709 12:25:57.988749 10749 rpcz_store.cc:276] 0709 12:25:56.318278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:56.320501 (+  2223us) service_pool.cc:224] Handling call
0709 12:25:57.971952 (+1651451us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":180919,"reported_tablets":4}
I20260709 12:25:57.989147 14415 leader_election.cc:290] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:58.018111 10998 raft_consensus.cc:2468] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 11.
I20260709 12:25:58.009043 14477 raft_consensus.cc:2749] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613) with higher term. Message: Invalid argument: T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for earlier term 9. Current term is 10.
I20260709 12:25:58.020941 11622 raft_consensus.cc:1217] T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d [term 4 LEARNER]: Deduplicated request from leader. Original: 4.3->[4.4-4.4]   Dedup: 4.4->[]
I20260709 12:25:58.050786 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:58.051721 10847 raft_consensus.cc:3060] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:58.056679 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:58.060554 10920 raft_consensus.cc:1275] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:25:58.065711 14475 consensus_queue.cc:1048] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 12:25:58.067982 10847 raft_consensus.cc:2468] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 6.
I20260709 12:25:58.066043 10749 catalog_manager.cc:5697] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "3c52e0825c02476e89d84da9bb849f5d" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:25:58.071257 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 138750us
I20260709 12:25:58.072049 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:58.072749 10845 raft_consensus.cc:3060] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:25:58.085804 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:58.087862 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:58.088856 10850 raft_consensus.cc:2393] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 6: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:25:58.111657 10996 raft_consensus.cc:2468] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 9.
I20260709 12:25:58.117193 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:58.118157 10849 raft_consensus.cc:3060] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:58.120141 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b17195a94142039c40f598ed006c94" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:58.120467 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:58.121551 10852 raft_consensus.cc:2468] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 9.
I20260709 12:25:58.120221 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:58.120591 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:58.133018 11002 raft_consensus.cc:1275] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:25:58.154474 10895 leader_election.cc:304] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:58.167009 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:58.170801 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:58.171555 10850 raft_consensus.cc:2468] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 9.
I20260709 12:25:58.178311 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:58.179314 10998 raft_consensus.cc:2368] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 6. Current term is 7.
I20260709 12:25:58.184110 14443 raft_consensus.cc:2749] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:58.203926 14443 raft_consensus.cc:493] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:25:58.204650 14443 raft_consensus.cc:515] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:58.207072 14443 leader_election.cc:290] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:58.212749 10849 raft_consensus.cc:2468] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 7.
I20260709 12:25:58.214399 10845 raft_consensus.cc:2468] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 11.
I20260709 12:25:58.224527 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:58.227902 14477 raft_consensus.cc:493] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:25:58.228709 14477 raft_consensus.cc:515] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:58.230160 10864 tablet_copy_service.cc:342] P 80cd7d227db44f34a6108591dad9c040: Request end of tablet copy session 3c52e0825c02476e89d84da9bb849f5d-dad6a1da21304fcfacab384a6afc4101 received from {username='slave'} at 127.0.0.1:46480
I20260709 12:25:58.230882 10864 tablet_copy_service.cc:434] P 80cd7d227db44f34a6108591dad9c040: ending tablet copy session 3c52e0825c02476e89d84da9bb849f5d-dad6a1da21304fcfacab384a6afc4101 on tablet dad6a1da21304fcfacab384a6afc4101 with peer 3c52e0825c02476e89d84da9bb849f5d
I20260709 12:25:58.230165 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:58.240120 14447 raft_consensus.cc:493] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:25:58.241132 14447 raft_consensus.cc:515] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:25:58.244714 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 121059us
I20260709 12:25:58.245694 10895 leader_election.cc:304] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:25:58.246526 14440 raft_consensus.cc:2804] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:25:58.246960 14440 raft_consensus.cc:493] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:25:58.247351 14440 raft_consensus.cc:3060] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:58.249289 10922 raft_consensus.cc:1275] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:25:58.249729 11623 raft_consensus.cc:1275] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [term 7 LEARNER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:25:58.253399 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:58.256808 14435 raft_consensus.cc:493] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:25:58.258138 10994 raft_consensus.cc:1275] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:25:58.257941 14435 raft_consensus.cc:515] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:58.259954 14410 raft_consensus.cc:493] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:25:58.261025 14410 raft_consensus.cc:515] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:58.267285 10968 leader_election.cc:400] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 election: Vote denied by peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265) with higher term. Message: Invalid argument: T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for earlier term 8. Current term is 9.
I20260709 12:25:58.267802 10968 leader_election.cc:403] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:25:58.231238 14477 leader_election.cc:290] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:58.264416 10894 leader_election.cc:304] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:25:58.269338 14415 raft_consensus.cc:2749] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265) with higher term. Message: Invalid argument: T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for earlier term 8. Current term is 9.
I20260709 12:25:58.269614 10968 leader_election.cc:304] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:25:58.269272 14410 leader_election.cc:290] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:58.270629 14435 leader_election.cc:290] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:25:58.286180 14461 raft_consensus.cc:2764] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:25:58.290060 14555 consensus_queue.cc:1048] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 12:25:58.289428 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:58.269224 14501 consensus_queue.cc:1048] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 12:25:58.304252 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:58.286736 14543 raft_consensus.cc:493] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:25:58.316838 10925 raft_consensus.cc:2468] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 7.
I20260709 12:25:58.321619 10922 raft_consensus.cc:2393] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 6: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:25:58.311257 14544 raft_consensus.cc:493] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:25:58.335116 14435 raft_consensus.cc:2804] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:58.322932 10895 leader_election.cc:304] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
W20260709 12:25:58.348489 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 84374.6us
W20260709 12:25:58.352149 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 58203.1us
I20260709 12:25:58.340950 11588 leader_election.cc:304] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:58.363983 14470 raft_consensus.cc:493] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:25:58.365010 14470 raft_consensus.cc:515] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:58.370059 14470 leader_election.cc:290] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:58.346127 14447 leader_election.cc:290] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:58.331488 14543 raft_consensus.cc:515] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:58.372916 14555 raft_consensus.cc:2749] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:58.391698 14544 raft_consensus.cc:515] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:58.380267 14477 raft_consensus.cc:2804] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:58.399757 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:58.400765 14435 raft_consensus.cc:493] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:58.401320 14435 raft_consensus.cc:3060] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:58.412783 10928 raft_consensus.cc:1275] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:25:58.404980 14477 raft_consensus.cc:697] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:58.401324 14440 raft_consensus.cc:515] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:58.416961 14440 leader_election.cc:290] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:58.415279 14477 consensus_queue.cc:237] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:58.424336 14544 leader_election.cc:290] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:58.432649 14543 leader_election.cc:290] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:25:58.446048 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 70766us
I20260709 12:25:58.454383 10820 leader_election.cc:304] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:25:58.457969 14512 raft_consensus.cc:2804] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:58.458359 14447 raft_consensus.cc:493] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:25:58.459461 14512 raft_consensus.cc:697] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 9 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:58.461304 14512 consensus_queue.cc:237] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:58.459385 14447 raft_consensus.cc:515] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:58.466603 10894 leader_election.cc:304] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:25:58.468298 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:58.482087 10820 leader_election.cc:400] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 election: Vote denied by peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945) with higher term. Message: Invalid argument: T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 6. Current term is 7.
I20260709 12:25:58.482511 10820 leader_election.cc:403] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:25:58.489485 10925 raft_consensus.cc:2368] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for earlier term 8. Current term is 9.
I20260709 12:25:58.487596 10894 leader_election.cc:304] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:25:58.494724 14440 raft_consensus.cc:2804] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:58.496292 14410 raft_consensus.cc:2804] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:58.511215 14446 consensus_queue.cc:1048] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:25:58.516110 14435 raft_consensus.cc:515] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:58.520154 14435 leader_election.cc:290] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:58.521595 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:58.522691 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b17195a94142039c40f598ed006c94" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:58.523859 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:58.524236 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:58.524780 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:58.528424 14447 leader_election.cc:290] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:58.540624 14350 raft_consensus.cc:2749] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945) with higher term. Message: Invalid argument: T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 6. Current term is 7.
I20260709 12:25:58.532076 14440 raft_consensus.cc:697] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:58.545091 14440 consensus_queue.cc:237] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:25:58.509923 14410 raft_consensus.cc:493] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:58.547955 14410 raft_consensus.cc:3060] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:58.557215 14544 raft_consensus.cc:493] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:25:58.558113 14544 raft_consensus.cc:515] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:58.562983 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:58.567435 10752 catalog_manager.cc:5697] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 8 to 9, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 9 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:58.569248 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:58.570309 10926 raft_consensus.cc:1275] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:25:58.571205 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:58.570611 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:58.567332 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:58.572424 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:58.589795 10928 raft_consensus.cc:2393] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 7: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:25:58.570708 14470 raft_consensus.cc:493] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
W20260709 12:25:58.597885 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 95865.1us
I20260709 12:25:58.591732 14470 raft_consensus.cc:515] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:58.604974 14470 leader_election.cc:290] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:58.605976 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
W20260709 12:25:58.607622 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 57013.7us
I20260709 12:25:58.608958 10968 leader_election.cc:400] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 election: Vote denied by peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339) with higher term. Message: Invalid argument: T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for earlier term 8. Current term is 9.
I20260709 12:25:58.610947 14543 consensus_queue.cc:1048] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:58.614972 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:58.618064 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:58.622339 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:58.628734 10968 leader_election.cc:304] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:58.630724 11003 raft_consensus.cc:2393] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 6: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:25:58.591661 14544 leader_election.cc:290] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:58.617295 14410 raft_consensus.cc:515] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:58.663952 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:58.651901 14501 raft_consensus.cc:2749] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:58.666514 10994 raft_consensus.cc:2468] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 10.
I20260709 12:25:58.668043 10922 raft_consensus.cc:2393] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 11: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:25:58.665583 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:25:58.674190 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 56473.3us
I20260709 12:25:58.686388 14443 raft_consensus.cc:493] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:25:58.668674 14435 raft_consensus.cc:493] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:25:58.687178 14443 raft_consensus.cc:515] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:58.689934 14410 leader_election.cc:290] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:58.687959 14435 raft_consensus.cc:515] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:58.712004 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:58.716172 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:25:58.669907 14477 raft_consensus.cc:493] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:25:58.721248 14477 raft_consensus.cc:515] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:58.726586 10819 leader_election.cc:304] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:58.728225 14350 consensus_queue.cc:1048] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:58.729020 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c913e527ff46578e084c41eab7bb9d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:58.730649 14350 raft_consensus.cc:2804] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:58.731104 14350 raft_consensus.cc:493] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:25:58.731310 14501 consensus_queue.cc:1048] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:58.734005 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:58.734980 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:58.735072 14435 leader_election.cc:290] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:58.731920 10750 catalog_manager.cc:5697] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 6 to 7, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 7 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:58.760751 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:58.762099 10996 raft_consensus.cc:2393] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 7: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:25:58.763279 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:58.731513 14350 raft_consensus.cc:3060] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:58.690414 14443 leader_election.cc:290] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:25:58.746363 10968 leader_election.cc:304] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:58.748198 14477 leader_election.cc:290] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:25:58.768389 14415 raft_consensus.cc:2749] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:25:58.767843 10968 leader_election.cc:304] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:58.770267 10968 leader_election.cc:304] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:58.755331 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:58.755779 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:58.770939 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:58.756639 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:58.757084 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:58.758037 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:58.761018 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:25:58.753234 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:58.756369 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c913e527ff46578e084c41eab7bb9d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:58.772601 11003 raft_consensus.cc:3060] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:58.744323 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:58.776196 10853 raft_consensus.cc:2393] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 7: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:25:58.789081 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:58.795042 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:58.792615 10968 leader_election.cc:304] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:58.797421 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:25:58.798048 10849 raft_consensus.cc:3060] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:25:58.797873 10968 leader_election.cc:304] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:58.770857 14415 raft_consensus.cc:2749] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:25:58.800944 10895 leader_election.cc:304] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:58.803903 10968 leader_election.cc:304] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:58.805537 10895 leader_election.cc:304] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:58.809161 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:58.789204 14477 raft_consensus.cc:493] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.811964 14477 raft_consensus.cc:515] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } }
I20260709 12:25:58.814350 14477 leader_election.cc:290] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265)
I20260709 12:25:58.807885 14543 raft_consensus.cc:2749] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:58.807502 14544 raft_consensus.cc:2749] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:58.822374 14443 raft_consensus.cc:2749] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:58.840847 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:58.841426 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:58.843899 10968 leader_election.cc:304] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040
I20260709 12:25:58.845681 10853 raft_consensus.cc:1275] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:25:58.846367 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:58.846747 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:58.848232 10849 raft_consensus.cc:2468] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 11.
I20260709 12:25:58.859202 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:58.840152 14415 raft_consensus.cc:2804] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:58.865420 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:58.869235 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:58.882344 10894 leader_election.cc:304] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:58.898518 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:58.885241 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:58.892516 10894 leader_election.cc:304] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:58.908471 10894 leader_election.cc:304] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:58.911424 10894 leader_election.cc:304] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:58.895884 14443 raft_consensus.cc:2749] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:58.917451 14443 raft_consensus.cc:2749] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:25:58.920318 14488 raft_consensus.cc:2749] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:58.889238 14415 raft_consensus.cc:697] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 7 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:25:58.933704 10968 leader_election.cc:304] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:58.940465 10968 leader_election.cc:304] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:58.951874 10968 leader_election.cc:304] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:58.953346 10968 leader_election.cc:304] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:58.939740 14461 raft_consensus.cc:2749] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:25:58.956918 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 45531.6us
I20260709 12:25:58.958293 10894 leader_election.cc:304] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:58.954942 14509 raft_consensus.cc:2749] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:58.948274 14544 consensus_queue.cc:1048] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 12:25:58.970357 14587 raft_consensus.cc:2749] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:58.970817 14449 raft_consensus.cc:2749] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:58.972523 14415 consensus_queue.cc:237] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:58.953706 14470 raft_consensus.cc:2749] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:58.987954 14576 raft_consensus.cc:2749] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:25:58.990669 14588 raft_consensus.cc:1064] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040: attempting to promote NON_VOTER 3c52e0825c02476e89d84da9bb849f5d to VOTER
I20260709 12:25:59.004079 14350 raft_consensus.cc:515] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:59.037717 11003 raft_consensus.cc:2468] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 11.
W20260709 12:25:59.056963 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 90421.6us
I20260709 12:25:59.057950 10894 leader_election.cc:304] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:59.040316 14501 raft_consensus.cc:2764] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:25:59.085376 10894 leader_election.cc:304] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:25:59.093111 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 152018us
I20260709 12:25:59.060969 10750 catalog_manager.cc:5697] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 4 to 6, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 6 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:59.083918 14440 raft_consensus.cc:2749] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:59.110222 14594 raft_consensus.cc:493] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:25:59.110994 14594 raft_consensus.cc:515] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:59.111720 14185 raft_consensus.cc:2749] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:59.114441 14185 raft_consensus.cc:2749] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:59.115739 10894 leader_election.cc:304] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:59.116717 10968 leader_election.cc:304] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:59.111428 14588 consensus_queue.cc:237] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 2, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:59.130981 14440 raft_consensus.cc:2749] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:59.131999 10848 raft_consensus.cc:1240] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:59.132061 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:25:59.134059 10894 leader_election.cc:304] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:25:59.135102 14543 raft_consensus.cc:493] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:25:59.135841 14543 raft_consensus.cc:515] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:59.115785 14477 raft_consensus.cc:2749] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:59.137971 14185 raft_consensus.cc:2804] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:59.138227 14543 leader_election.cc:290] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:59.138469 14185 raft_consensus.cc:697] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 11 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:25:59.138944 14543 raft_consensus.cc:2749] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:59.139767 14185 consensus_queue.cc:237] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:59.115000 14470 raft_consensus.cc:493] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:25:59.141989 14470 raft_consensus.cc:515] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:59.141386 14461 raft_consensus.cc:2955] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 LEADER]: Committing config change with OpId 7.8: config changed from index 7 to 8, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:59.135011 10894 leader_election.cc:304] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:59.116852 10750 catalog_manager.cc:5697] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 9 to 11, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 11 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:59.146358 10894 leader_election.cc:304] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040
I20260709 12:25:59.147554 10894 leader_election.cc:304] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040
I20260709 12:25:59.096800 14350 leader_election.cc:290] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:59.162633 14529 raft_consensus.cc:493] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:25:59.163359 14529 raft_consensus.cc:515] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:59.166253 14580 raft_consensus.cc:493] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:25:59.166949 14580 raft_consensus.cc:515] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:59.172118 14593 raft_consensus.cc:2749] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:59.176489 10928 raft_consensus.cc:2955] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 7 to 8, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:25:59.179445 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:59.179924 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad766f48812a4ddeb383179b1d84907b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:59.180789 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:59.183683 14449 raft_consensus.cc:2749] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:59.184226 10851 raft_consensus.cc:1275] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:25:59.196324 14590 consensus_queue.cc:1048] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 12:25:59.203842 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:25:59.204881 11623 raft_consensus.cc:2468] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 5.
I20260709 12:25:59.210060 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:59.212343 10929 raft_consensus.cc:1240] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:59.123986 14594 leader_election.cc:290] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:25:59.213800 10922 raft_consensus.cc:1275] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:25:59.224488 10850 raft_consensus.cc:1275] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:25:59.146998 14470 leader_election.cc:290] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:59.230916 10749 catalog_manager.cc:5697] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } }
I20260709 12:25:59.253039 11000 raft_consensus.cc:1275] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:25:59.286499 10969 leader_election.cc:304] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:59.271816 10850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
mode: GRACEFUL
new_leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:47358
I20260709 12:25:59.298281 10850 raft_consensus.cc:606] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 8 LEADER]: Received request to transfer leadership to TS edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:59.306149 11616 raft_consensus.cc:3060] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d [term 4 LEARNER]: Advancing to term 6
I20260709 12:25:59.291700 14410 consensus_queue.cc:1048] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:25:59.310295 14580 leader_election.cc:290] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:25:59.315248 14529 leader_election.cc:290] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:25:59.321309 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:59.321069 11619 raft_consensus.cc:2955] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 7 to 8, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
W20260709 12:25:59.328070 10969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 102762us
I20260709 12:25:59.329499 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:25:59.348366 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:25:59.355223 10819 leader_election.cc:304] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:25:59.367936 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 59852.2us
I20260709 12:25:59.372808 11001 raft_consensus.cc:1275] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:25:59.348459 14594 raft_consensus.cc:2804] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:59.361333 14445 raft_consensus.cc:2749] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:59.405457 10996 raft_consensus.cc:1275] T dad6a1da21304fcfacab384a6afc4101 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:25:59.384893 14594 raft_consensus.cc:493] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:25:59.425638 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:59.398746 11001 raft_consensus.cc:1275] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:25:59.433413 10926 raft_consensus.cc:1275] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:25:59.444193 14447 raft_consensus.cc:2749] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:59.434700 11589 leader_election.cc:304] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:25:59.451761 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 50729.7us
I20260709 12:25:59.431821 14594 raft_consensus.cc:3060] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:59.388128 14446 consensus_queue.cc:1059] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 12:25:59.385520 14506 consensus_queue.cc:1048] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 12:25:59.463236 14410 consensus_queue.cc:1048] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 12:25:59.437680 14509 consensus_queue.cc:1059] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:25:59.435376 14576 consensus_queue.cc:1048] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:25:59.462595 14445 consensus_queue.cc:1048] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 12:25:59.542182 14444 raft_consensus.cc:2749] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:59.558465 11616 raft_consensus.cc:1275] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d [term 6 LEARNER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:25:59.564695 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:59.565945 14575 raft_consensus.cc:3055] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:59.566613 14575 raft_consensus.cc:740] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:25:59.567638 14575 consensus_queue.cc:260] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:59.569027 14575 raft_consensus.cc:3060] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:59.589717 10926 raft_consensus.cc:1275] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:25:59.589387 11588 leader_election.cc:304] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:59.595755 10851 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ef3220c51df47db8859f07ab745fad5"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
mode: GRACEFUL
new_leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:47358
I20260709 12:25:59.596464 10851 raft_consensus.cc:606] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Received request to transfer leadership to TS edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:25:59.595469 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad766f48812a4ddeb383179b1d84907b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:25:59.598897 11618 raft_consensus.cc:1275] T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d [term 4 LEARNER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:25:59.599339 14475 raft_consensus.cc:2749] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:59.604431 14484 raft_consensus.cc:3055] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:59.604208 14470 consensus_queue.cc:1048] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:25:59.604877 14484 raft_consensus.cc:740] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:25:59.604456 10968 leader_election.cc:304] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:59.606658 14543 raft_consensus.cc:2749] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:59.606186 14484 consensus_queue.cc:260] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:25:59.609469 14484 raft_consensus.cc:3060] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:59.585988 10850 raft_consensus.cc:2955] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 7 to 8, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
W20260709 12:25:59.628561 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 182015us
I20260709 12:25:59.630210 11000 raft_consensus.cc:1275] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:25:59.637660 10968 leader_election.cc:304] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:59.592516 14477 consensus_queue.cc:1048] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 12:25:59.644769 14501 raft_consensus.cc:2749] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:25:59.695657 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 244792us
I20260709 12:25:59.696763 10845 raft_consensus.cc:1275] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:25:59.639238 14443 consensus_queue.cc:1048] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 12:25:59.726365 14583 consensus_queue.cc:1048] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
W20260709 12:25:59.760098 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 52841.6us
I20260709 12:25:59.805411 14594 raft_consensus.cc:515] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:25:59.808135 14594 leader_election.cc:290] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
W20260709 12:25:59.825307 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 141890us
I20260709 12:25:59.846452 10845 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
mode: GRACEFUL
new_leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:47358
I20260709 12:25:59.847357 10845 raft_consensus.cc:606] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 10 LEADER]: Received request to transfer leadership to TS e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:25:59.852399 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:25:59.878149 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:25:59.832773 14461 consensus_queue.cc:1048] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:25:59.854801 14350 consensus_queue.cc:1048] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:25:59.860096 14512 consensus_queue.cc:1048] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
W20260709 12:25:59.944844 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 50160.1us
W20260709 12:26:00.015822 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 88782.9us
W20260709 12:26:00.053941 14625 log.cc:927] Time spent T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
W20260709 12:26:00.067922 14629 log.cc:927] Time spent T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 12:26:00.064181 14543 raft_consensus.cc:493] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:00.108470 14543 raft_consensus.cc:515] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:00.124541 14543 leader_election.cc:290] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:00.211074 14463 raft_consensus.cc:993] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040: : Instructing follower edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:26:00.214833 10846 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
mode: GRACEFUL
new_leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:47358
I20260709 12:26:00.217070 10846 raft_consensus.cc:606] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 9 LEADER]: Received request to transfer leadership to TS edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:00.228735 14621 raft_consensus.cc:993] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040: : Instructing follower e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:26:00.229358 14621 raft_consensus.cc:1081] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 10 LEADER]: Signalling peer e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:26:00.232472 14463 raft_consensus.cc:1081] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Signalling peer edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:26:00.235637 11000 raft_consensus.cc:1240] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 5. Current term is 6. Ops: []
I20260709 12:26:00.248558 14606 consensus_queue.cc:1059] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:26:00.249782 14606 raft_consensus.cc:3055] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:26:00.250193 14606 raft_consensus.cc:740] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:00.251070 14606 consensus_queue.cc:260] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:00.252642 14606 raft_consensus.cc:3060] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:00.262590 10928 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:59626
I20260709 12:26:00.263482 10928 raft_consensus.cc:493] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:00.263964 10928 raft_consensus.cc:3060] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:00.276081 14620 raft_consensus.cc:2955] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:00.282029 10928 raft_consensus.cc:515] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:00.287927 10995 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4ef3220c51df47db8859f07ab745fad5"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:37512
I20260709 12:26:00.288525 10995 raft_consensus.cc:493] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:00.288897 10995 raft_consensus.cc:3060] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:00.294656 14591 raft_consensus.cc:993] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040: : Instructing follower edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:26:00.295231 14591 raft_consensus.cc:1081] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 8 LEADER]: Signalling peer edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:26:00.286527 10749 catalog_manager.cc:5697] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:00.297485 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 345491us
I20260709 12:26:00.303706 10923 raft_consensus.cc:2955] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:00.308094 10969 leader_election.cc:304] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:00.308498 10995 raft_consensus.cc:515] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:00.313428 10922 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
mode: GRACEFUL
new_leader_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:41546
I20260709 12:26:00.320247 10851 raft_consensus.cc:1275] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:26:00.314087 10922 raft_consensus.cc:606] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Received request to transfer leadership to TS 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:00.322394 10928 leader_election.cc:290] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:00.328970 10995 leader_election.cc:290] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:26:00.330801 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 233189us
I20260709 12:26:00.336813 11619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: true dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:00.337922 11619 raft_consensus.cc:3060] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:00.349978  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:26:00.354852 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:00.352846 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:00.357985 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef3220c51df47db8859f07ab745fad5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:00.364729 10929 raft_consensus.cc:3060] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:00.360666  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:00.337172 14642 raft_consensus.cc:2749] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:26:00.373005 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef3220c51df47db8859f07ab745fad5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:00.375712 10853 raft_consensus.cc:3055] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:00.376219 10853 raft_consensus.cc:740] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:00.387260 14449 raft_consensus.cc:1064] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea: attempting to promote NON_VOTER 3c52e0825c02476e89d84da9bb849f5d to VOTER
I20260709 12:26:00.390180 14449 consensus_queue.cc:237] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 4, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:00.397146 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 63916.4us
I20260709 12:26:00.379509 10853 consensus_queue.cc:260] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:00.420114 10923 raft_consensus.cc:1240] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 10. Current term is 11. Ops: []
I20260709 12:26:00.429440 14440 raft_consensus.cc:993] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea: : Instructing follower 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:26:00.429958 14440 raft_consensus.cc:1081] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Signalling peer 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:26:00.432760 14463 consensus_queue.cc:1059] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:26:00.433928 14463 raft_consensus.cc:3055] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:26:00.434369 14463 raft_consensus.cc:740] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:00.437960 14463 consensus_queue.cc:260] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:00.440191 14463 raft_consensus.cc:3060] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:00.445878 14611 raft_consensus.cc:993] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040: : Instructing follower edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:26:00.446502 14611 raft_consensus.cc:1081] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 9 LEADER]: Signalling peer edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:26:00.449405 10853 raft_consensus.cc:3060] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:00.458508 10847 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:56394
I20260709 12:26:00.458621 14614 consensus_queue.cc:1048] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:26:00.459266 10847 raft_consensus.cc:493] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:00.459851 10847 raft_consensus.cc:3060] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:00.458658 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:00.460103 10968 leader_election.cc:304] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:00.459336 10851 raft_consensus.cc:1275] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:26:00.461457 14508 raft_consensus.cc:2749] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:26:00.462283 11619 raft_consensus.cc:2468] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 11.
W20260709 12:26:00.463681 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 60133.9us
I20260709 12:26:00.468000 11000 raft_consensus.cc:1275] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:26:00.469048 10895 leader_election.cc:304] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:00.468293 11617 raft_consensus.cc:2955] T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:00.474157 10847 raft_consensus.cc:515] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:00.480983 10995 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:37512
I20260709 12:26:00.481603 10995 raft_consensus.cc:493] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:00.481900 14633 raft_consensus.cc:2804] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:26:00.482501 14633 raft_consensus.cc:697] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 11 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:00.480563 10853 raft_consensus.cc:2468] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 5.
I20260709 12:26:00.484372 11000 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:37512
I20260709 12:26:00.485100 11000 raft_consensus.cc:493] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:00.485455 11000 raft_consensus.cc:3060] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:00.485865 10929 raft_consensus.cc:2468] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 5.
I20260709 12:26:00.481999 10995 raft_consensus.cc:3060] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:00.486780 10968 leader_election.cc:304] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:00.477407 11003 raft_consensus.cc:2955] T dad6a1da21304fcfacab384a6afc4101 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:00.497517 10847 leader_election.cc:290] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:00.489817 14593 consensus_queue.cc:1048] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:26:00.512063 14449 consensus_queue.cc:1048] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:00.483529 14633 consensus_queue.cc:237] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:00.495250 14642 raft_consensus.cc:2804] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:00.519382 14642 raft_consensus.cc:697] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:26:00.519863 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:00.528158 10929 raft_consensus.cc:3055] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:26:00.528882 10929 raft_consensus.cc:740] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:00.503334  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:00.537907 11000 raft_consensus.cc:515] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:00.543663 10929 consensus_queue.cc:260] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:00.546033 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:00.552768 11001 raft_consensus.cc:3060] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:00.552829 10995 raft_consensus.cc:515] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:00.562587 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:00.563485 10853 raft_consensus.cc:3055] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:26:00.565140 10853 raft_consensus.cc:740] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:00.565948 10853 consensus_queue.cc:260] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:00.568575 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:00.569247 10845 raft_consensus.cc:3055] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:26:00.569752 10845 raft_consensus.cc:740] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:00.571878 11000 leader_election.cc:290] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 10 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:00.573776 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:00.574460 11623 raft_consensus.cc:3060] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:00.576042 10845 consensus_queue.cc:260] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:00.577627 10845 raft_consensus.cc:3060] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:00.580475 14642 consensus_queue.cc:237] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:00.583822 10751 catalog_manager.cc:5697] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: config changed from index 7 to 8, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New cstate: current_term: 7 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:00.591079 10929 raft_consensus.cc:3060] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:00.571704 10853 raft_consensus.cc:3060] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:00.601055 10995 leader_election.cc:290] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:00.606253 11623 raft_consensus.cc:2468] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 10.
I20260709 12:26:00.608385 10969 leader_election.cc:304] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:00.609519 10929 raft_consensus.cc:2468] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 7.
I20260709 12:26:00.620011 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:00.621349 10929 raft_consensus.cc:3060] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:00.628835 10845 raft_consensus.cc:2468] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 10.
I20260709 12:26:00.634351 14501 raft_consensus.cc:2804] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:26:00.637465 11619 raft_consensus.cc:1275] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d [term 6 LEARNER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:26:00.643481 10819 leader_election.cc:304] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:00.649806 10929 raft_consensus.cc:2468] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 9.
I20260709 12:26:00.651819 10853 raft_consensus.cc:2468] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 9.
I20260709 12:26:00.644440 14501 raft_consensus.cc:697] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 10 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:26:00.660845 14501 consensus_queue.cc:237] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:00.663177 11001 raft_consensus.cc:2468] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 7.
I20260709 12:26:00.667234 10852 raft_consensus.cc:2468] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 11.
I20260709 12:26:00.664163 10968 leader_election.cc:304] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:00.651968 14470 raft_consensus.cc:493] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
W20260709 12:26:00.696237 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 47493.3us
I20260709 12:26:00.677793 14589 raft_consensus.cc:2955] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Committing config change with OpId 6.6: config changed from index 4 to 6, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:00.688423 14350 raft_consensus.cc:2804] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:26:00.694955 14488 raft_consensus.cc:2804] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:26:00.688103 14470 raft_consensus.cc:515] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:00.731302 14185 raft_consensus.cc:493] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:00.732055 14185 raft_consensus.cc:515] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:00.716892 14350 raft_consensus.cc:697] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 7 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:00.737159 14440 consensus_queue.cc:1048] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:26:00.738214 14350 consensus_queue.cc:237] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:00.721261 14488 raft_consensus.cc:697] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:26:00.746862 11001 raft_consensus.cc:2955] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 4 to 6, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:00.787997 14488 consensus_queue.cc:237] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:00.787617 11624 raft_consensus.cc:2955] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 4 to 6, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:00.794556 14470 leader_election.cc:290] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:26:00.825454 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 99821.6us
I20260709 12:26:00.849906 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:00.853719 10925 raft_consensus.cc:2393] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 5: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:26:00.848201 14618 raft_consensus.cc:493] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:00.875922 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:00.903254 11000 raft_consensus.cc:2468] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 8.
I20260709 12:26:00.878410 14185 leader_election.cc:290] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:00.881903 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:00.906292 10852 raft_consensus.cc:2393] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 8: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:26:00.917091 14591 raft_consensus.cc:493] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:00.918695 14618 raft_consensus.cc:515] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:00.925571 14591 raft_consensus.cc:515] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:00.945152 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:00.936777 14618 leader_election.cc:290] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:00.952843 14591 leader_election.cc:290] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:00.954910 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:00.966651 10752 catalog_manager.cc:5697] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:00.957369 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:00.957935 10895 leader_election.cc:304] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:00.972810 14636 raft_consensus.cc:2804] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:26:00.973254 14636 raft_consensus.cc:493] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:00.973598 14636 raft_consensus.cc:3060] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:00.973677 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:00.974355 10928 raft_consensus.cc:2468] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 5.
I20260709 12:26:00.974928 11589 leader_election.cc:304] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:00.976905 14475 raft_consensus.cc:2749] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:26:00.981942 10749 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60730 (request call id 295) took 1560 ms. Trace:
I20260709 12:26:00.985875 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:00.986565 10845 raft_consensus.cc:2468] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 5.
I20260709 12:26:00.990258 10819 leader_election.cc:304] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:00.996217 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:00.997668 11000 raft_consensus.cc:2468] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 4.
I20260709 12:26:01.000191 10968 leader_election.cc:304] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:00.982688 10749 rpcz_store.cc:276] 0709 12:25:59.421952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:59.422159 (+   207us) service_pool.cc:224] Handling call
0709 12:26:00.981860 (+1559701us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:00.316614 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:00.317173 (+   559us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:00.317205 (+    32us) write_op.cc:435] Acquired schema lock
0709 12:26:00.317224 (+    19us) tablet.cc:662] Decoding operations
0709 12:26:00.317586 (+   362us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:00.317659 (+    73us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:00.317686 (+    27us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:26:00.317865 (+   179us) tablet.cc:701] Row locks acquired
0709 12:26:00.317882 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:26:00.318025 (+   143us) write_op.cc:270] Start()
0709 12:26:00.318138 (+   113us) write_op.cc:276] Timestamp: P: 1783599960317975 usec, L: 0
0709 12:26:00.318161 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:26:00.409241 (+ 91080us) log.cc:844] Serialized 538 byte log entry
0709 12:26:00.717091 (+307850us) op_driver.cc:464] REPLICATION: finished
0709 12:26:00.919868 (+202777us) write_op.cc:301] APPLY: starting
0709 12:26:00.922748 (+  2880us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:00.928521 (+  5773us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:00.931707 (+  3186us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:00.932016 (+   309us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:00.932206 (+   190us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:26:00.932255 (+    49us) write_op.cc:312] APPLY: finished
0709 12:26:00.932441 (+   186us) log.cc:844] Serialized 23 byte log entry
0709 12:26:00.932616 (+   175us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:00.932690 (+    74us) write_op.cc:454] Released schema lock
0709 12:26:00.932728 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:00.933143 (+   415us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:00.933170 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":6,"spinlock_wait_cycles":3456,"child_traces":[["op",{"apply.queue_time_us":149590,"apply.run_cpu_time_us":1989,"apply.run_wall_time_us":17759,"num_ops":1,"prepare.queue_time_us":7110,"prepare.run_cpu_time_us":17797,"prepare.run_wall_time_us":215128,"raft.queue_time_us":366469,"raft.run_cpu_time_us":11790,"raft.run_wall_time_us":132918,"replication_time_us":379122,"spinlock_wait_cycles":9600,"thread_start_us":283041,"threads_started":4,"wal-append.queue_time_us":86873}]]}
I20260709 12:26:01.001145 14631 raft_consensus.cc:2804] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:01.012089 14631 raft_consensus.cc:493] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:01.012444 14631 raft_consensus.cc:3060] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:01.017403 10851 raft_consensus.cc:2955] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 4 to 6, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:01.005913 14484 raft_consensus.cc:2804] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:01.022724 14484 raft_consensus.cc:493] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:01.023525 14484 raft_consensus.cc:3060] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:01.026022 14636 raft_consensus.cc:515] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:01.031558 14636 leader_election.cc:290] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:01.031912 14631 raft_consensus.cc:515] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:01.037501 14631 leader_election.cc:290] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:01.034372 11624 raft_consensus.cc:1275] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:26:01.042271 14185 consensus_queue.cc:1048] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:26:01.055805 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 47529.3us
I20260709 12:26:01.040027 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:01.067353 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:01.068763 10928 raft_consensus.cc:3060] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:01.080488 10994 raft_consensus.cc:2468] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 8.
I20260709 12:26:01.085187 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:01.089709 10846 raft_consensus.cc:2393] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 8: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:26:01.080667 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:01.083030 10895 leader_election.cc:304] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:01.099028 10928 raft_consensus.cc:2468] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 6.
I20260709 12:26:01.093636 10751 catalog_manager.cc:5697] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: config changed from index 4 to 6, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New cstate: current_term: 6 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:01.101398 10751 catalog_manager.cc:5697] T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: config changed from index 4 to 5, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:01.119036 10928 raft_consensus.cc:1275] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:26:01.120110 11617 raft_consensus.cc:1275] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:26:01.120867 10752 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60736 (request call id 331) took 1243 ms. Trace:
I20260709 12:26:01.121245 10752 rpcz_store.cc:276] 0709 12:25:59.877841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:59.877985 (+   144us) service_pool.cc:224] Handling call
0709 12:26:00.038957 (+160972us) spinlock_profiling.cc:243] Waited 7.98 ms on lock 0x7b5400002210. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7591c23db1 00007f7591d63b71 00007f7591d640b2 00007f759acdd759 00007f759ac75a76 00007f759ac46d58 00007f759ad4504e 00007f75992062a4 00007f7599206232 00007f7599206161 00007f75992060dc
0709 12:26:01.120808 (+1081851us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:00.985990 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:00.986527 (+   537us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:00.986570 (+    43us) write_op.cc:435] Acquired schema lock
0709 12:26:00.986588 (+    18us) tablet.cc:662] Decoding operations
0709 12:26:00.986948 (+   360us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:00.987006 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:00.987036 (+    30us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:26:00.987202 (+   166us) tablet.cc:701] Row locks acquired
0709 12:26:00.987219 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:26:00.987371 (+   152us) write_op.cc:270] Start()
0709 12:26:00.987477 (+   106us) write_op.cc:276] Timestamp: P: 1783599960987312 usec, L: 0
0709 12:26:00.987498 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:26:01.107733 (+120235us) log.cc:844] Serialized 538 byte log entry
0709 12:26:01.114161 (+  6428us) op_driver.cc:464] REPLICATION: finished
0709 12:26:01.114583 (+   422us) write_op.cc:301] APPLY: starting
0709 12:26:01.114669 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:01.114778 (+   109us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:01.114912 (+   134us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:01.115173 (+   261us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:01.115384 (+   211us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:26:01.115436 (+    52us) write_op.cc:312] APPLY: finished
0709 12:26:01.115663 (+   227us) log.cc:844] Serialized 23 byte log entry
0709 12:26:01.115822 (+   159us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:01.115904 (+    82us) write_op.cc:454] Released schema lock
0709 12:26:01.115944 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:01.117175 (+  1231us) spinlock_profiling.cc:243] Waited 87.1 ms on lock 0x7b540007b554. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e83e28 00007f75988be581 00007f75988bdd58 00007f75988c29f1 00007f75988c29a9 00007f75988c2939 00007f75988c2901 00007f75988c1b2d 0000000000388634 0000000000388479
0709 12:26:01.117352 (+   177us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:01.117376 (+    24us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":3,"spinlock_wait_cycles":18345216,"child_traces":[["op",{"apply.queue_time_us":145,"apply.run_cpu_time_us":1742,"apply.run_wall_time_us":1741,"num_ops":1,"prepare.queue_time_us":174,"prepare.run_cpu_time_us":6230,"prepare.run_wall_time_us":131334,"replication_time_us":126521,"spinlock_wait_cycles":200442112}]]}
I20260709 12:26:01.128320 10819 leader_election.cc:304] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:01.129155 14658 consensus_queue.cc:1048] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:26:01.105737 14636 raft_consensus.cc:2804] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:26:01.131758 10994 consensus_queue.cc:237] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:01.133230 14641 consensus_queue.cc:1048] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:01.120015 10750 catalog_manager.cc:5697] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:01.149999 14636 raft_consensus.cc:697] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:01.154731 14636 consensus_queue.cc:237] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:01.157856 14588 raft_consensus.cc:2804] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:01.158465 14588 raft_consensus.cc:697] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [term 6 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:01.159356 14588 consensus_queue.cc:237] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:01.173205 10750 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60734 (request call id 299) took 1464 ms. Trace:
I20260709 12:26:01.173710 10750 rpcz_store.cc:276] 0709 12:25:59.708848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:59.716101 (+  7253us) service_pool.cc:224] Handling call
0709 12:26:01.173132 (+1457031us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:01.155087 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:01.155636 (+   549us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:01.155661 (+    25us) write_op.cc:435] Acquired schema lock
0709 12:26:01.155673 (+    12us) tablet.cc:662] Decoding operations
0709 12:26:01.155979 (+   306us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:01.156026 (+    47us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:01.156052 (+    26us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:26:01.156223 (+   171us) tablet.cc:701] Row locks acquired
0709 12:26:01.156239 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:26:01.156377 (+   138us) write_op.cc:270] Start()
0709 12:26:01.156585 (+   208us) write_op.cc:276] Timestamp: P: 1783599961156333 usec, L: 0
0709 12:26:01.156600 (+    15us) op_driver.cc:348] REPLICATION: starting
0709 12:26:01.157180 (+   580us) log.cc:844] Serialized 538 byte log entry
0709 12:26:01.161751 (+  4571us) op_driver.cc:464] REPLICATION: finished
0709 12:26:01.165412 (+  3661us) write_op.cc:301] APPLY: starting
0709 12:26:01.165477 (+    65us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:01.165576 (+    99us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:01.165666 (+    90us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:01.165865 (+   199us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:01.166028 (+   163us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:26:01.166071 (+    43us) write_op.cc:312] APPLY: finished
0709 12:26:01.166259 (+   188us) log.cc:844] Serialized 23 byte log entry
0709 12:26:01.166396 (+   137us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:01.166471 (+    75us) write_op.cc:454] Released schema lock
0709 12:26:01.166528 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:01.166807 (+   279us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:01.166835 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":165096,"reported_tablets":4,"spinlock_wait_cycles":949504,"child_traces":[["op",{"apply.queue_time_us":3490,"apply.run_cpu_time_us":1375,"apply.run_wall_time_us":1375,"num_ops":1,"prepare.queue_time_us":7847,"prepare.run_cpu_time_us":2222,"prepare.run_wall_time_us":2349,"replication_time_us":5022}]]}
W20260709 12:26:01.177464 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 49214.9us
I20260709 12:26:01.183650 10923 raft_consensus.cc:1275] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:26:01.188262 10848 raft_consensus.cc:1275] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:26:01.179340 14484 raft_consensus.cc:515] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:01.212509 14484 leader_election.cc:290] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:01.213174 11002 raft_consensus.cc:3060] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:01.251663 10854 raft_consensus.cc:1275] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:26:01.250813 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:01.272790 10851 raft_consensus.cc:1275] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:26:01.280404 11002 raft_consensus.cc:2468] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 6.
I20260709 12:26:01.282110 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:01.259617 14593 consensus_queue.cc:1048] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 12:26:01.259877 14597 consensus_queue.cc:1048] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:26:01.264140 14641 consensus_queue.cc:1048] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 12:26:01.287418 10852 raft_consensus.cc:1275] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:26:01.287019 10925 raft_consensus.cc:2368] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for earlier term 5. Current term is 6.
I20260709 12:26:01.306286 10968 leader_election.cc:400] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 election: Vote denied by peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339) with higher term. Message: Invalid argument: T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for earlier term 5. Current term is 6.
I20260709 12:26:01.306682 10968 leader_election.cc:403] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:26:01.311098 10994 raft_consensus.cc:1275] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:26:01.313154 14641 raft_consensus.cc:2749] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339) with higher term. Message: Invalid argument: T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for earlier term 5. Current term is 6.
I20260709 12:26:01.314503 14578 consensus_queue.cc:1048] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:26:01.316368 14658 consensus_queue.cc:1048] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:26:01.288017 14642 consensus_queue.cc:1048] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 12:26:01.454814 10848 raft_consensus.cc:1275] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:26:01.461861 14631 raft_consensus.cc:493] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:01.462433 14631 raft_consensus.cc:515] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:01.464866 14631 leader_election.cc:290] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:26:01.468601 14667 log.cc:927] Time spent T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.149s	user 0.001s	sys 0.004s
I20260709 12:26:01.481244 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:01.480547 14470 consensus_queue.cc:1048] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
W20260709 12:26:01.524233 14672 log.cc:927] Time spent T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.107s	user 0.001s	sys 0.001s
W20260709 12:26:01.541982 14665 log.cc:927] Time spent T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d: Append to log took a long time: real 0.237s	user 0.003s	sys 0.000s
W20260709 12:26:01.585590 14666 log.cc:927] Time spent T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.270s	user 0.003s	sys 0.000s
I20260709 12:26:01.598392 10750 catalog_manager.cc:5697] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: term changed from 10 to 11, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 11 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:01.608667 10750 catalog_manager.cc:5697] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: term changed from 9 to 10, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 10 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:01.610442 10923 raft_consensus.cc:1275] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:26:01.610517 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:01.625877 10996 raft_consensus.cc:2468] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 8.
I20260709 12:26:01.617182 10994 raft_consensus.cc:1275] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:26:01.626526 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 48311.4us
I20260709 12:26:01.629559 11617 raft_consensus.cc:1275] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:26:01.634382 14470 consensus_queue.cc:1048] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:26:01.642277 14475 raft_consensus.cc:493] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:01.642959 14475 raft_consensus.cc:515] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:01.645419 14475 leader_election.cc:290] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:01.646994 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:01.647727 10929 raft_consensus.cc:2468] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 6.
I20260709 12:26:01.649283 10994 raft_consensus.cc:1275] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:26:01.621284 14484 raft_consensus.cc:2955] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 LEADER]: Committing config change with OpId 7.9: config changed from index 8 to 9, VOTER e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:01.650424 11588 leader_election.cc:304] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:01.651422 14475 raft_consensus.cc:2804] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:01.651889 14475 raft_consensus.cc:493] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:01.652346 14475 raft_consensus.cc:3060] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:01.657322 14641 consensus_queue.cc:1048] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:26:01.667526 10751 catalog_manager.cc:5697] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 6 to 7, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 7 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:01.695482 14475 raft_consensus.cc:515] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:01.709916 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:01.713120 10751 catalog_manager.cc:5697] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:01.711153 10820 leader_election.cc:304] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:01.721239 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:01.722096 10994 raft_consensus.cc:2393] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3c52e0825c02476e89d84da9bb849f5d in current term 6: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:26:01.726576 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:01.727438 10996 raft_consensus.cc:2393] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3c52e0825c02476e89d84da9bb849f5d in current term 6: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:26:01.740662 10929 raft_consensus.cc:2468] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 6.
I20260709 12:26:01.744191 11588 leader_election.cc:304] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:01.746023 11624 raft_consensus.cc:2955] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Committing config change with OpId 7.9: config changed from index 8 to 9, VOTER e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:01.727238 14463 raft_consensus.cc:2804] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:26:01.718338 14475 leader_election.cc:290] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 6 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:01.727070 14578 consensus_queue.cc:1048] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 12:26:01.748704 14617 raft_consensus.cc:2804] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:01.752406 14463 raft_consensus.cc:493] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:01.756697 14576 consensus_queue.cc:1048] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:26:01.774181 14463 raft_consensus.cc:3060] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:01.776381 14617 raft_consensus.cc:697] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [term 6 LEADER]: Becoming Leader. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
I20260709 12:26:01.809831 14617 consensus_queue.cc:237] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:01.846206 10739 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ee998be153d94f6f91c39dace2c32f19 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:01.881368 10929 raft_consensus.cc:1275] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:26:01.902192 14681 consensus_queue.cc:1048] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:01.918231 10848 raft_consensus.cc:2955] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Committing config change with OpId 7.9: config changed from index 8 to 9, VOTER e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:01.945609 14463 raft_consensus.cc:515] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:01.949918 10852 raft_consensus.cc:1240] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 8. Current term is 9. Ops: []
I20260709 12:26:01.964954 14185 consensus_queue.cc:1059] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:01.965830 14185 raft_consensus.cc:3055] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:26:01.966130 14185 raft_consensus.cc:740] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:01.967546 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:01.966871 14185 consensus_queue.cc:260] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:01.976686 14185 raft_consensus.cc:3060] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:02.041198 14509 raft_consensus.cc:493] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:02.041826 14509 raft_consensus.cc:515] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:02.050794 14463 leader_election.cc:290] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:02.058347 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:02.060726 14509 leader_election.cc:290] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:02.066347 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:02.067277 10926 raft_consensus.cc:2468] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 6.
I20260709 12:26:02.082295 10968 leader_election.cc:304] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:02.084461 14488 raft_consensus.cc:2804] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:26:02.084906 14488 raft_consensus.cc:493] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:02.085263 14488 raft_consensus.cc:3060] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:02.129833 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:02.147565 10929 raft_consensus.cc:2410] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:26:02.161589 10819 leader_election.cc:304] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:02.162510 14575 raft_consensus.cc:2749] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:26:02.176182 14488 raft_consensus.cc:515] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:02.184077 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:02.184767 10925 raft_consensus.cc:3060] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:02.178750 14488 leader_election.cc:290] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:02.197628 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:02.212169 10925 raft_consensus.cc:2468] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 7.
I20260709 12:26:02.224474  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:02.225418 10968 leader_election.cc:304] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:02.229904 14509 raft_consensus.cc:2804] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:26:02.231796 14509 raft_consensus.cc:697] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 7 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:26:02.234084 14509 consensus_queue.cc:237] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:02.278653 10752 catalog_manager.cc:5697] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 8 to 9, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 9 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:02.286389 10848 consensus_queue.cc:237] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:02.287865 10752 catalog_manager.cc:5697] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 4 to 5, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 5 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:02.320659 10929 raft_consensus.cc:1275] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:02.325892 11000 raft_consensus.cc:1240] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 7 LEADER]: Rejecting Update request from peer 3c52e0825c02476e89d84da9bb849f5d for earlier term 6. Current term is 7. Ops: []
I20260709 12:26:02.343559 14691 consensus_queue.cc:1059] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:26:02.344630 14691 consensus_queue.cc:1243] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Peer edcc56ddd3264984b4da6c1db59e7f08 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:26:02.345397 14691 raft_consensus.cc:3055] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:26:02.346104 14691 raft_consensus.cc:740] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
I20260709 12:26:02.346930 14691 consensus_queue.cc:260] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:02.348276 14691 raft_consensus.cc:3060] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:02.323105 14681 consensus_queue.cc:1048] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:26:02.345453 11624 raft_consensus.cc:1275] T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:02.353344 10929 raft_consensus.cc:1240] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Rejecting Update request from peer 3c52e0825c02476e89d84da9bb849f5d for earlier term 6. Current term is 7. Ops: []
I20260709 12:26:02.360217 14681 consensus_queue.cc:1048] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:26:02.396862 10749 catalog_manager.cc:5697] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 7 to 8, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 8 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:02.412283 14638 raft_consensus.cc:2955] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:02.427814 10929 raft_consensus.cc:2955] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:02.450354 10750 catalog_manager.cc:5697] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: term changed from 5 to 6, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68). New cstate: current_term: 6 leader_uuid: "3c52e0825c02476e89d84da9bb849f5d" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:02.452466 10750 catalog_manager.cc:5697] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: config changed from index 8 to 9, VOTER e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) evicted. New cstate: current_term: 7 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:02.492595 10929 consensus_queue.cc:237] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:02.505594 14477 raft_consensus.cc:493] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:02.507182 14477 raft_consensus.cc:515] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:02.507826 10912 tablet_service.cc:1558] Processing DeleteTablet for tablet ee998be153d94f6f91c39dace2c32f19 with delete_type TABLET_DATA_TOMBSTONED (TS e2d5c637307a407ab688f5ccd6f0fcea not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:59610
I20260709 12:26:02.513878 14477 leader_election.cc:290] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:02.515987 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:02.520454 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:02.523778 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:02.524513 11623 raft_consensus.cc:2955] T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:02.528029 10895 leader_election.cc:304] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:02.530773 10752 catalog_manager.cc:5697] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 6 to 7, leader changed from 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 7 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:02.544984 14443 raft_consensus.cc:2749] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:26:02.552105 10738 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet dad6a1da21304fcfacab384a6afc4101 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:02.631605 10749 catalog_manager.cc:5697] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 reported cstate change: config changed from index 5 to 6, VOTER edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) evicted. New cstate: current_term: 4 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:02.642969 14699 tablet_replica.cc:333] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea: stopping tablet replica
I20260709 12:26:02.693948 10928 raft_consensus.cc:1275] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:26:02.708132 14544 consensus_queue.cc:1048] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 12:26:02.731933 14699 raft_consensus.cc:2243] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:02.733358 14699 raft_consensus.cc:2272] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:02.752904 10992 tablet_service.cc:1558] Processing DeleteTablet for tablet dad6a1da21304fcfacab384a6afc4101 with delete_type TABLET_DATA_TOMBSTONED (TS edcc56ddd3264984b4da6c1db59e7f08 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:37496
I20260709 12:26:02.823732 10928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
mode: GRACEFUL
new_leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:41546
I20260709 12:26:02.824420 10928 raft_consensus.cc:606] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 9 LEADER]: Received request to transfer leadership to TS edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:26:02.840536 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 136454us
I20260709 12:26:02.846463 11617 raft_consensus.cc:1275] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:26:02.846983 10994 raft_consensus.cc:1275] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:26:02.856323 14589 consensus_queue.cc:1048] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:26:02.886221 11623 raft_consensus.cc:1275] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 12:26:02.886633 11623 pending_rounds.cc:85] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d: Aborting all ops after (but not including) 7
I20260709 12:26:02.886878 11623 pending_rounds.cc:107] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 12:26:02.887176 11623 raft_consensus.cc:2889] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:02.889199 14509 consensus_queue.cc:1048] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:26:02.889711 14706 tablet_replica.cc:333] T dad6a1da21304fcfacab384a6afc4101 P edcc56ddd3264984b4da6c1db59e7f08: stopping tablet replica
I20260709 12:26:02.894065 14706 raft_consensus.cc:2243] T dad6a1da21304fcfacab384a6afc4101 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:02.898348 14706 raft_consensus.cc:2272] T dad6a1da21304fcfacab384a6afc4101 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:02.897128 14699 ts_tablet_manager.cc:1916] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:02.915375 14706 ts_tablet_manager.cc:1916] T dad6a1da21304fcfacab384a6afc4101 P edcc56ddd3264984b4da6c1db59e7f08: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:02.908135 14701 consensus_queue.cc:1048] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 12:26:02.955273 10928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
mode: GRACEFUL
new_leader_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:41546
I20260709 12:26:02.955929 10928 raft_consensus.cc:606] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 5 LEADER]: Received request to transfer leadership to TS 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:02.988828 10928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
mode: GRACEFUL
new_leader_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:41546
I20260709 12:26:02.989455 10928 raft_consensus.cc:606] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Received request to transfer leadership to TS 80cd7d227db44f34a6108591dad9c040
W20260709 12:26:03.015836 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 44783.7us
I20260709 12:26:03.029654 10848 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
mode: GRACEFUL
new_leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:47358
I20260709 12:26:03.030279 10848 raft_consensus.cc:606] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 8 LEADER]: Received request to transfer leadership to TS edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:03.034854  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:26:03.035348 14589 raft_consensus.cc:2955] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Committing config change with OpId 6.7: config changed from index 6 to 7, VOTER 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:03.037359  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:03.049225  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:03.038595 11617 raft_consensus.cc:2955] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 6 to 7, VOTER 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:03.052759 10738 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f5b822586ed04f2cb681fefd045b3f6d with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:03.093964 10752 catalog_manager.cc:5697] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: config changed from index 6 to 7, VOTER 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) evicted. New cstate: current_term: 6 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:03.115226 14614 raft_consensus.cc:993] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea: : Instructing follower 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:26:03.115803 14614 raft_consensus.cc:1081] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 5 LEADER]: Signalling peer 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:26:03.119349 10851 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:56394
I20260709 12:26:03.120139 10851 raft_consensus.cc:493] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:03.120663 10851 raft_consensus.cc:3060] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:03.125504 14700 raft_consensus.cc:993] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea: : Instructing follower 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:26:03.126117 14700 raft_consensus.cc:1081] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Signalling peer 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:26:03.128257 10844 tablet_service.cc:1558] Processing DeleteTablet for tablet f5b822586ed04f2cb681fefd045b3f6d with delete_type TABLET_DATA_TOMBSTONED (TS 80cd7d227db44f34a6108591dad9c040 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:56372
I20260709 12:26:03.131889 10848 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:56394
I20260709 12:26:03.132503 10848 raft_consensus.cc:493] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:03.132843 10848 raft_consensus.cc:3060] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:03.138950 11000 raft_consensus.cc:2955] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 6 to 7, VOTER 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:03.147482 14700 raft_consensus.cc:493] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:03.148190 14700 raft_consensus.cc:515] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:03.150023 10851 raft_consensus.cc:515] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:03.152684 14700 leader_election.cc:290] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:03.154765 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:03.155735 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:03.173368 10928 raft_consensus.cc:3055] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:26:03.173728 10928 raft_consensus.cc:740] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:03.174719 10928 consensus_queue.cc:260] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:03.176313 10928 raft_consensus.cc:3060] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:03.177213 14706 ts_tablet_manager.cc:1929] T dad6a1da21304fcfacab384a6afc4101 P edcc56ddd3264984b4da6c1db59e7f08: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.5
I20260709 12:26:03.177991 14706 log.cc:1199] T dad6a1da21304fcfacab384a6afc4101 P edcc56ddd3264984b4da6c1db59e7f08: Deleting WAL directory at /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599781984018-9681-0/minicluster-data/ts-2-root/wals/dad6a1da21304fcfacab384a6afc4101
I20260709 12:26:03.156965 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:03.179816 14704 raft_consensus.cc:993] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea: : Instructing follower edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:26:03.180104 10852 raft_consensus.cc:2468] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 9.
I20260709 12:26:03.180397 14704 raft_consensus.cc:1081] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 9 LEADER]: Signalling peer edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:26:03.181807 10894 leader_election.cc:304] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:03.161353 10851 leader_election.cc:290] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:03.162578 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:03.183828 11623 raft_consensus.cc:3060] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:03.184748 14700 raft_consensus.cc:2804] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:26:03.185223 14700 raft_consensus.cc:493] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:03.185565 14700 raft_consensus.cc:3060] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:03.208887 11623 raft_consensus.cc:2468] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 6.
I20260709 12:26:03.210175 10820 leader_election.cc:304] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040; no voters: 
I20260709 12:26:03.211011 14575 raft_consensus.cc:2804] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:03.211591 14575 raft_consensus.cc:697] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 6 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:03.212549 14575 consensus_queue.cc:237] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:03.236370 14713 tablet_replica.cc:333] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040: stopping tablet replica
I20260709 12:26:03.233168 14699 ts_tablet_manager.cc:1929] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 7.8
I20260709 12:26:03.237618 14699 log.cc:1199] T ee998be153d94f6f91c39dace2c32f19 P e2d5c637307a407ab688f5ccd6f0fcea: Deleting WAL directory at /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599781984018-9681-0/minicluster-data/ts-1-root/wals/ee998be153d94f6f91c39dace2c32f19
I20260709 12:26:03.216272 10848 raft_consensus.cc:515] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:03.223806 11003 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:37500
I20260709 12:26:03.239450 11003 raft_consensus.cc:493] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:03.239949 11003 raft_consensus.cc:3060] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:03.240013 10848 leader_election.cc:290] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:03.231091 14700 raft_consensus.cc:515] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:03.214771 10928 raft_consensus.cc:2468] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 6.
I20260709 12:26:03.242797 14700 leader_election.cc:290] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 10 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:03.241885 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:03.243746 10923 raft_consensus.cc:3055] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:26:03.244105 10923 raft_consensus.cc:740] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:03.246615 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:03.246902 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: true dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:03.247627 11623 raft_consensus.cc:3060] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:03.254675 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:03.255550 10848 raft_consensus.cc:3060] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:03.251801 10923 consensus_queue.cc:260] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:03.218597 10739 catalog_manager.cc:5028] TS edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): tablet dad6a1da21304fcfacab384a6afc4101 (table test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]) successfully deleted
I20260709 12:26:03.245373 10738 catalog_manager.cc:5028] TS e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): tablet ee998be153d94f6f91c39dace2c32f19 (table test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]) successfully deleted
I20260709 12:26:03.262789 10923 raft_consensus.cc:3060] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:03.244526 14713 raft_consensus.cc:2243] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:03.261981 11623 raft_consensus.cc:2468] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 7.
I20260709 12:26:03.265297 10820 leader_election.cc:304] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040; no voters: 
I20260709 12:26:03.265319 14713 raft_consensus.cc:2272] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:03.266899 14582 raft_consensus.cc:2804] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:26:03.267654 14582 raft_consensus.cc:697] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 7 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:03.268718 14582 consensus_queue.cc:237] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:03.271764 14713 ts_tablet_manager.cc:1916] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:26:03.263471 10739 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 44896.7us
I20260709 12:26:03.261965 11003 raft_consensus.cc:515] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:03.293776 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:03.294394 10851 raft_consensus.cc:3060] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:03.299012 10923 raft_consensus.cc:2468] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 7.
I20260709 12:26:03.308022 10851 raft_consensus.cc:2468] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 10.
I20260709 12:26:03.308291 14702 raft_consensus.cc:493] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:03.309309 11003 leader_election.cc:290] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 10 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:03.310971 10968 leader_election.cc:304] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:03.312741 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:03.313050 14509 raft_consensus.cc:2804] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:26:03.313359 10929 raft_consensus.cc:3055] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:26:03.313750 10929 raft_consensus.cc:740] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:03.314528 10929 consensus_queue.cc:260] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:03.308974 14702 raft_consensus.cc:515] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:03.315447 10929 raft_consensus.cc:3060] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:03.317641 14702 leader_election.cc:290] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:03.309846 10846 raft_consensus.cc:1240] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 9. Current term is 10. Ops: []
I20260709 12:26:03.321558 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:03.313653 14509 raft_consensus.cc:697] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 10 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:26:03.324491 14509 consensus_queue.cc:237] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:03.324954 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:03.325701 10928 raft_consensus.cc:2368] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for earlier term 9. Current term is 10.
I20260709 12:26:03.326535 14713 ts_tablet_manager.cc:1929] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 6.6
I20260709 12:26:03.327036 14713 log.cc:1199] T f5b822586ed04f2cb681fefd045b3f6d P 80cd7d227db44f34a6108591dad9c040: Deleting WAL directory at /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599781984018-9681-0/minicluster-data/ts-0-root/wals/f5b822586ed04f2cb681fefd045b3f6d
I20260709 12:26:03.327450 10929 raft_consensus.cc:2468] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 10.
I20260709 12:26:03.331091 10968 leader_election.cc:400] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Vote denied by peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339) with higher term. Message: Invalid argument: T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for earlier term 9. Current term is 10.
I20260709 12:26:03.331401 10738 catalog_manager.cc:5028] TS 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): tablet f5b822586ed04f2cb681fefd045b3f6d (table test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]) successfully deleted
I20260709 12:26:03.332536 10968 leader_election.cc:403] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:03.336166 14702 raft_consensus.cc:3060] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:26:03.376719 10751 catalog_manager.cc:5697] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 5 to 6, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 6 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:03.363066 14702 raft_consensus.cc:2749] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339) with higher term. Message: Invalid argument: T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for earlier term 9. Current term is 10.
I20260709 12:26:03.401626 14578 raft_consensus.cc:993] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040: : Instructing follower edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:26:03.402370 14578 raft_consensus.cc:1081] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 8 LEADER]: Signalling peer edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:26:03.406504 11003 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:37512
I20260709 12:26:03.407651 11003 raft_consensus.cc:493] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:03.408238 11003 raft_consensus.cc:3060] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:03.409785 10848 raft_consensus.cc:2468] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 10.
I20260709 12:26:03.434175 10751 catalog_manager.cc:5697] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 9 to 10, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 10 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:03.448153 10894 leader_election.cc:304] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:03.449712 14705 raft_consensus.cc:2804] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:26:03.453058 14705 raft_consensus.cc:697] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:03.454300 14705 consensus_queue.cc:237] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:03.469313 10749 catalog_manager.cc:5697] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 6 to 7, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 7 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:03.499279 11003 raft_consensus.cc:515] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:03.501355 11003 leader_election.cc:290] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:03.502820 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:03.502355 10751 catalog_manager.cc:5697] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:03.503384 10851 raft_consensus.cc:3055] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:26:03.503736 10851 raft_consensus.cc:740] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:03.504416 10851 consensus_queue.cc:260] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:03.505642 10851 raft_consensus.cc:3060] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:03.510983 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:03.516986 10923 raft_consensus.cc:3060] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:03.532582 10851 raft_consensus.cc:2468] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 9.
I20260709 12:26:03.533175 10923 raft_consensus.cc:2468] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 9.
I20260709 12:26:03.533978 10968 leader_election.cc:304] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:03.535291 14658 raft_consensus.cc:2804] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:26:03.535861 14658 raft_consensus.cc:697] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:26:03.536723 14658 consensus_queue.cc:237] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:03.565014 10751 catalog_manager.cc:5697] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 8 to 9, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 9 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:03.581853 10741 maintenance_manager.cc:419] P 9619ad7a9e7f4d9b8039487e3ee77243: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033393
I20260709 12:26:03.660310 10929 raft_consensus.cc:1275] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:26:03.664938 14582 consensus_queue.cc:1048] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:26:03.667017 11623 raft_consensus.cc:1275] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:26:03.684325 14575 consensus_queue.cc:1048] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:26:03.759177 11617 raft_consensus.cc:1275] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:26:03.776024 10928 raft_consensus.cc:1275] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:26:03.762750 14582 consensus_queue.cc:1048] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 12:26:03.784004 14575 consensus_queue.cc:1048] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:26:03.811407 10923 raft_consensus.cc:1275] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:26:03.815956 14484 consensus_queue.cc:1048] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:26:03.831561 10851 raft_consensus.cc:1275] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:26:03.842329 10851 raft_consensus.cc:1275] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:26:03.844027 14705 consensus_queue.cc:1048] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:03.844515 14484 consensus_queue.cc:1048] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:26:03.978435 11003 raft_consensus.cc:1275] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 12:26:03.996421 14724 log.cc:927] Time spent T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
W20260709 12:26:04.046439 14727 log.cc:927] Time spent T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.075s	user 0.001s	sys 0.001s
W20260709 12:26:04.055284 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 70988.8us
I20260709 12:26:04.087862 10846 raft_consensus.cc:1275] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 12:26:04.106462 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 119490us
I20260709 12:26:04.122668 10929 raft_consensus.cc:1275] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 12:26:04.139309 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 97525us
W20260709 12:26:04.193886 10969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 71584.4us
I20260709 12:26:04.133073 14589 consensus_queue.cc:1048] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.057s
W20260709 12:26:04.195786 14727 log.cc:927] Time spent T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 12:26:04.205667 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 70921.5us
W20260709 12:26:04.204373 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 76498.5us
W20260709 12:26:04.205387 14728 log.cc:927] Time spent T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 12:26:04.244807 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 48980us
I20260709 12:26:04.284471  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:26:04.309964 10969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 84763.4us
W20260709 12:26:04.313565 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 172302us
W20260709 12:26:04.322525 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 95147.9us
W20260709 12:26:04.315460 14716 log.cc:927] Time spent T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
W20260709 12:26:04.329370 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 116108us
I20260709 12:26:04.342041 14751 consensus_queue.cc:1048] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:26:04.355779 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 75085.2us
W20260709 12:26:04.519114 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 239653us
W20260709 12:26:04.529661 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 195920us
W20260709 12:26:04.665506 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 54265.7us
W20260709 12:26:04.690605 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 58826.1us
I20260709 12:26:04.645819 14733 consensus_queue.cc:1048] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
W20260709 12:26:04.804792 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 113196us
W20260709 12:26:04.887805 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 176610us
W20260709 12:26:04.922771 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 123340us
W20260709 12:26:05.024885 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 98184.9us
I20260709 12:26:05.191893 11003 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
mode: GRACEFUL
new_leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:32960
I20260709 12:26:05.195381 11003 raft_consensus.cc:606] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 7 LEADER]: Received request to transfer leadership to TS e2d5c637307a407ab688f5ccd6f0fcea
W20260709 12:26:05.270917 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 46495us
W20260709 12:26:05.285898 10969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 48657.3us
W20260709 12:26:05.296437 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 75982.1us
W20260709 12:26:05.315680 10740 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.260s	user 0.069s	sys 0.054s
I20260709 12:26:05.347019 14730 raft_consensus.cc:993] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08: : Instructing follower e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:26:05.347718 14730 raft_consensus.cc:1081] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 7 LEADER]: Signalling peer e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:26:05.355549 10740 maintenance_manager.cc:643] P 9619ad7a9e7f4d9b8039487e3ee77243: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 1.772s	user 0.227s	sys 0.094s Metrics: {"bytes_written":29077,"cfile_init":1,"dirs.queue_time_us":182566,"dirs.run_cpu_time_us":579,"dirs.run_wall_time_us":28623,"drs_written":1,"lbm_read_time_us":552,"lbm_reads_lt_1ms":4,"lbm_write_time_us":4433,"lbm_writes_lt_1ms":31,"peak_mem_usage":0,"rows_written":63,"thread_start_us":244384,"threads_started":2,"wal-append.queue_time_us":233176}
I20260709 12:26:05.359771 10741 maintenance_manager.cc:419] P 9619ad7a9e7f4d9b8039487e3ee77243: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 11970 bytes on disk
I20260709 12:26:05.363078 10926 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:59622
I20260709 12:26:05.363879 10926 raft_consensus.cc:493] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:05.364599 10926 raft_consensus.cc:3060] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:05.368896 10740 maintenance_manager.cc:643] P 9619ad7a9e7f4d9b8039487e3ee77243: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.008s	user 0.003s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":5310,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":3}
I20260709 12:26:05.457705 10926 raft_consensus.cc:515] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:05.461403 10926 leader_election.cc:290] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:05.463399 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:05.464305 11000 raft_consensus.cc:3055] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:26:05.464620 11000 raft_consensus.cc:740] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:26:05.465484 11000 consensus_queue.cc:260] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:05.466789 11000 raft_consensus.cc:3060] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:05.467536 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:05.468279 10851 raft_consensus.cc:3060] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:05.476811 11000 raft_consensus.cc:2468] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 8.
I20260709 12:26:05.478178 10895 leader_election.cc:304] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:05.482134 10851 raft_consensus.cc:2468] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 8.
I20260709 12:26:05.479316 14746 raft_consensus.cc:2804] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:26:05.493649 14746 raft_consensus.cc:697] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 8 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:05.494695 14746 consensus_queue.cc:237] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:05.502871 10925 consensus_queue.cc:237] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:26:05.505679 10926 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
mode: GRACEFUL
new_leader_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:41546
I20260709 12:26:05.506434 10926 raft_consensus.cc:606] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 10 LEADER]: Received request to transfer leadership to TS 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:05.526365  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:26:05.528553  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:05.529418  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:05.573222 10851 raft_consensus.cc:1275] T e8b17195a94142039c40f598ed006c94 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:26:05.574549 11000 raft_consensus.cc:1275] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:26:05.577142 14786 consensus_queue.cc:1048] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:26:05.579912 10895 consensus_peers.cc:597] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613): Couldn't send request to peer 3c52e0825c02476e89d84da9bb849f5d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e8b17195a94142039c40f598ed006c94. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:05.580708 14705 consensus_queue.cc:1048] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:05.594056 10750 catalog_manager.cc:5697] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 7 to 8, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 8 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:05.655341 11000 raft_consensus.cc:2955] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:26:05.657366 10851 raft_consensus.cc:2955] T e8b17195a94142039c40f598ed006c94 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:26:05.675364 14589 raft_consensus.cc:2955] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:26:05.692288 14705 raft_consensus.cc:993] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea: : Instructing follower 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:26:05.692857 14705 raft_consensus.cc:1081] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 10 LEADER]: Signalling peer 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:26:05.705199 10846 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:56394
I20260709 12:26:05.705880 10846 raft_consensus.cc:493] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:05.706265 10846 raft_consensus.cc:3060] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:05.754956 10846 raft_consensus.cc:515] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:05.771281 10846 leader_election.cc:290] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 11 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:05.772084 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:05.772869 10925 raft_consensus.cc:3055] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:26:05.773182 10925 raft_consensus.cc:740] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:05.773308 10926 consensus_queue.cc:237] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:26:05.774046 10925 consensus_queue.cc:260] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:05.775193 10925 raft_consensus.cc:3060] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:05.778007 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:05.778738 11000 raft_consensus.cc:3060] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:05.791821 10925 raft_consensus.cc:2468] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 11.
I20260709 12:26:05.793241 10819 leader_election.cc:304] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:05.794054 11000 raft_consensus.cc:2468] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 11.
I20260709 12:26:05.794531 10752 catalog_manager.cc:5697] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: config changed from index -1 to 4, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New cstate: current_term: 3 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:26:05.798017 14578 raft_consensus.cc:2804] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:26:05.803938 14578 raft_consensus.cc:697] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 11 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:05.805184 14578 consensus_queue.cc:237] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:05.884485 10895 consensus_peers.cc:597] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613): Couldn't send request to peer 3c52e0825c02476e89d84da9bb849f5d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 834361a055d34950b4edecba39f07657. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:05.920471 11000 raft_consensus.cc:1275] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:26:05.930711 10847 raft_consensus.cc:1275] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:26:05.935992 14756 consensus_queue.cc:1048] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:26:05.950395 14705 consensus_queue.cc:1048] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:26:05.964625 10846 raft_consensus.cc:1275] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:26:05.980598 14705 consensus_queue.cc:1048] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:06.003873 14756 raft_consensus.cc:2955] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 LEADER]: Committing config change with OpId 11.9: config changed from index -1 to 9, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:26:06.017030 10851 raft_consensus.cc:2955] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index -1 to 9, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:26:06.014050 10994 raft_consensus.cc:2955] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index -1 to 9, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:26:06.034662 11000 raft_consensus.cc:1275] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:26:06.044008 14744 consensus_queue.cc:1048] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:06.067857 10752 catalog_manager.cc:5697] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 10 to 11, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 11 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:06.075773 10800 auto_rebalancer.cc:629] Failed to schedule move for tablet f52e71e935934a298445f2f87c913f9e: Illegal state: Replica e2d5c637307a407ab688f5ccd6f0fcea is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } }
I20260709 12:26:06.081022 10847 consensus_queue.cc:237] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:26:06.167269 10752 catalog_manager.cc:5697] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: config changed from index -1 to 9, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New cstate: current_term: 11 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:06.239607 14806 ts_tablet_manager.cc:933] T e8b17195a94142039c40f598ed006c94 P 3c52e0825c02476e89d84da9bb849f5d: Initiating tablet copy from peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:06.285440 10926 raft_consensus.cc:1275] T e9331e5342644ca2bae19187b083a7d5 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 12:26:06.285915 10820 consensus_peers.cc:597] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 -> Peer 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613): Couldn't send request to peer 3c52e0825c02476e89d84da9bb849f5d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e9331e5342644ca2bae19187b083a7d5. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:06.287530 10996 raft_consensus.cc:1275] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:26:06.288075 14761 consensus_queue.cc:1048] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:06.288134 14806 tablet_copy_client.cc:323] T e8b17195a94142039c40f598ed006c94 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Beginning tablet copy session from remote peer at address 127.9.116.66:39339
I20260709 12:26:06.291424 10939 tablet_copy_service.cc:140] P e2d5c637307a407ab688f5ccd6f0fcea: Received BeginTabletCopySession request for tablet e8b17195a94142039c40f598ed006c94 from peer 3c52e0825c02476e89d84da9bb849f5d ({username='slave'} at 127.0.0.1:50036)
I20260709 12:26:06.292037 10939 tablet_copy_service.cc:161] P e2d5c637307a407ab688f5ccd6f0fcea: Beginning new tablet copy session on tablet e8b17195a94142039c40f598ed006c94 from peer 3c52e0825c02476e89d84da9bb849f5d at {username='slave'} at 127.0.0.1:50036: session id = 3c52e0825c02476e89d84da9bb849f5d-e8b17195a94142039c40f598ed006c94
I20260709 12:26:06.302583 14761 consensus_queue.cc:1048] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:06.333694 10939 tablet_copy_source_session.cc:215] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:06.340427 14806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8b17195a94142039c40f598ed006c94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:06.343187 10926 raft_consensus.cc:1275] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:26:06.345458 14768 consensus_queue.cc:1048] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:26:06.343303 10994 raft_consensus.cc:2955] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:26:06.338513 14761 raft_consensus.cc:2955] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:26:06.382684 10925 raft_consensus.cc:2955] T e9331e5342644ca2bae19187b083a7d5 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:26:06.391548 10752 catalog_manager.cc:5697] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: config changed from index -1 to 4, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New cstate: current_term: 4 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:26:06.419692 10996 raft_consensus.cc:1275] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:26:06.422472 14575 consensus_queue.cc:1048] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:26:06.539741 14811 ts_tablet_manager.cc:933] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d: Initiating tablet copy from peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:06.560937 14811 tablet_copy_client.cc:323] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Beginning tablet copy session from remote peer at address 127.9.116.66:39339
I20260709 12:26:06.562870 10939 tablet_copy_service.cc:140] P e2d5c637307a407ab688f5ccd6f0fcea: Received BeginTabletCopySession request for tablet 834361a055d34950b4edecba39f07657 from peer 3c52e0825c02476e89d84da9bb849f5d ({username='slave'} at 127.0.0.1:50036)
I20260709 12:26:06.563390 10939 tablet_copy_service.cc:161] P e2d5c637307a407ab688f5ccd6f0fcea: Beginning new tablet copy session on tablet 834361a055d34950b4edecba39f07657 from peer 3c52e0825c02476e89d84da9bb849f5d at {username='slave'} at 127.0.0.1:50036: session id = 3c52e0825c02476e89d84da9bb849f5d-834361a055d34950b4edecba39f07657
I20260709 12:26:06.622242 10939 tablet_copy_source_session.cc:215] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:06.635450 14811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 834361a055d34950b4edecba39f07657. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:06.649586  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:06.631670 14806 tablet_copy_client.cc:806] T e8b17195a94142039c40f598ed006c94 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:06.664037 14806 tablet_copy_client.cc:670] T e8b17195a94142039c40f598ed006c94 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:06.689659 14806 tablet_copy_client.cc:538] T e8b17195a94142039c40f598ed006c94 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:06.742938 14806 tablet_bootstrap.cc:492] T e8b17195a94142039c40f598ed006c94 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap starting.
I20260709 12:26:06.758987 14811 tablet_copy_client.cc:806] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:06.768142 10851 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
mode: GRACEFUL
new_leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:47358
I20260709 12:26:06.769164 10851 raft_consensus.cc:606] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 6 LEADER]: Received request to transfer leadership to TS e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:06.766573 14811 tablet_copy_client.cc:670] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:06.775261 10925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
mode: GRACEFUL
new_leader_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:41546
I20260709 12:26:06.775902 10925 raft_consensus.cc:606] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 LEADER]: Received request to transfer leadership to TS 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:06.785502 14811 tablet_copy_client.cc:538] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:06.801076 10851 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
mode: GRACEFUL
new_leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:47358
I20260709 12:26:06.801963 10851 raft_consensus.cc:606] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Received request to transfer leadership to TS edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:06.813912  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:26:06.815680  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:06.816529  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:06.857182 14811 tablet_bootstrap.cc:492] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap starting.
I20260709 12:26:06.870383 14744 raft_consensus.cc:993] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea: : Instructing follower 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:26:06.871333 14786 raft_consensus.cc:1081] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 LEADER]: Signalling peer 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:26:06.873633 10851 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:56394
I20260709 12:26:06.874303 10851 raft_consensus.cc:493] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:06.874675 10851 raft_consensus.cc:3060] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:06.925889 10851 raft_consensus.cc:515] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:06.931154 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:06.931898 10926 raft_consensus.cc:3055] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:06.932245 10926 raft_consensus.cc:740] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:06.933077 10926 consensus_queue.cc:260] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:06.934666 10926 raft_consensus.cc:3060] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:06.973268 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:06.973924 10994 raft_consensus.cc:3060] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:06.988250 10851 leader_election.cc:290] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:06.988801 10994 raft_consensus.cc:2468] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 5.
I20260709 12:26:06.990374 10820 leader_election.cc:304] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:06.991518 10926 raft_consensus.cc:2468] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 5.
I20260709 12:26:06.993556 14814 ts_tablet_manager.cc:933] T e9331e5342644ca2bae19187b083a7d5 P 3c52e0825c02476e89d84da9bb849f5d: Initiating tablet copy from peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265)
I20260709 12:26:07.009179 14768 raft_consensus.cc:2804] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:07.036679 14768 raft_consensus.cc:697] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 5 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:07.037603 14768 consensus_queue.cc:237] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:07.078778 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 89585.9us
I20260709 12:26:07.101059 14814 tablet_copy_client.cc:323] T e9331e5342644ca2bae19187b083a7d5 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Beginning tablet copy session from remote peer at address 127.9.116.65:46265
I20260709 12:26:07.123672 10864 tablet_copy_service.cc:140] P 80cd7d227db44f34a6108591dad9c040: Received BeginTabletCopySession request for tablet e9331e5342644ca2bae19187b083a7d5 from peer 3c52e0825c02476e89d84da9bb849f5d ({username='slave'} at 127.0.0.1:46480)
I20260709 12:26:07.133476 10864 tablet_copy_service.cc:161] P 80cd7d227db44f34a6108591dad9c040: Beginning new tablet copy session on tablet e9331e5342644ca2bae19187b083a7d5 from peer 3c52e0825c02476e89d84da9bb849f5d at {username='slave'} at 127.0.0.1:46480: session id = 3c52e0825c02476e89d84da9bb849f5d-e9331e5342644ca2bae19187b083a7d5
W20260709 12:26:07.141171 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 70384.3us
W20260709 12:26:07.148396 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 79061.9us
I20260709 12:26:07.286700 10864 tablet_copy_source_session.cc:215] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:07.308022 14814 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9331e5342644ca2bae19187b083a7d5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:26:07.369097 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 268334us
W20260709 12:26:07.446357 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 67078.9us
W20260709 12:26:07.456930 14811 log.cc:927] Time spent T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d: Append to log took a long time: real 0.093s	user 0.004s	sys 0.000s
W20260709 12:26:07.604525 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 106093us
W20260709 12:26:07.616061 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 124842us
W20260709 12:26:07.627751 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 96021.5us
I20260709 12:26:07.754519 14806 tablet_bootstrap.cc:492] T e8b17195a94142039c40f598ed006c94 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:07.762521 10748 catalog_manager.cc:5697] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 4 to 5, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 5 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:07.789029 14811 tablet_bootstrap.cc:492] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:07.790151 14811 tablet_bootstrap.cc:492] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap complete.
I20260709 12:26:07.791065 14811 ts_tablet_manager.cc:1403] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d: Time spent bootstrapping tablet: real 0.934s	user 0.055s	sys 0.012s
I20260709 12:26:07.780768 14806 tablet_bootstrap.cc:492] T e8b17195a94142039c40f598ed006c94 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap complete.
I20260709 12:26:07.798893 14806 ts_tablet_manager.cc:1403] T e8b17195a94142039c40f598ed006c94 P 3c52e0825c02476e89d84da9bb849f5d: Time spent bootstrapping tablet: real 1.056s	user 0.030s	sys 0.076s
W20260709 12:26:07.814124 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 128233us
I20260709 12:26:07.826794 14814 tablet_copy_client.cc:806] T e9331e5342644ca2bae19187b083a7d5 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:07.834503 14814 tablet_copy_client.cc:670] T e9331e5342644ca2bae19187b083a7d5 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:07.867424 14806 raft_consensus.cc:359] T e8b17195a94142039c40f598ed006c94 P 3c52e0825c02476e89d84da9bb849f5d [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
W20260709 12:26:07.878837 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 216973us
I20260709 12:26:07.868505 14806 raft_consensus.cc:740] T e8b17195a94142039c40f598ed006c94 P 3c52e0825c02476e89d84da9bb849f5d [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Initialized, Role: LEARNER
I20260709 12:26:07.885157 14833 raft_consensus.cc:993] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040: : Instructing follower e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:26:07.885740 14833 raft_consensus.cc:1081] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 6 LEADER]: Signalling peer e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:26:07.896440 10929 raft_consensus.cc:1275] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:26:07.897398 10925 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:59626
I20260709 12:26:07.898082 10925 raft_consensus.cc:493] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:07.898427 10925 raft_consensus.cc:3060] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:07.906057 10925 raft_consensus.cc:515] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:07.909127 14811 raft_consensus.cc:359] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [term 11 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:26:07.910179 14811 raft_consensus.cc:740] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [term 11 LEARNER]: Becoming Follower/Learner. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Initialized, Role: LEARNER
I20260709 12:26:07.920852 14806 consensus_queue.cc:260] T e8b17195a94142039c40f598ed006c94 P 3c52e0825c02476e89d84da9bb849f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:26:07.923990 10925 leader_election.cc:290] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:07.925770 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: true dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:07.926414 11624 raft_consensus.cc:3060] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:07.930708 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:07.931386 10847 raft_consensus.cc:3055] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:26:07.931691 10847 raft_consensus.cc:740] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:07.933243 14806 ts_tablet_manager.cc:1434] T e8b17195a94142039c40f598ed006c94 P 3c52e0825c02476e89d84da9bb849f5d: Time spent starting tablet: real 0.134s	user 0.006s	sys 0.002s
I20260709 12:26:07.935278 10939 tablet_copy_service.cc:342] P e2d5c637307a407ab688f5ccd6f0fcea: Request end of tablet copy session 3c52e0825c02476e89d84da9bb849f5d-e8b17195a94142039c40f598ed006c94 received from {username='slave'} at 127.0.0.1:50036
I20260709 12:26:07.935962 10939 tablet_copy_service.cc:434] P e2d5c637307a407ab688f5ccd6f0fcea: ending tablet copy session 3c52e0825c02476e89d84da9bb849f5d-e8b17195a94142039c40f598ed006c94 on tablet e8b17195a94142039c40f598ed006c94 with peer 3c52e0825c02476e89d84da9bb849f5d
I20260709 12:26:07.932873 10847 consensus_queue.cc:260] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:07.940295 10847 raft_consensus.cc:3060] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:07.910917 14811 consensus_queue.cc:260] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:26:07.943151 14811 ts_tablet_manager.cc:1434] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d: Time spent starting tablet: real 0.152s	user 0.007s	sys 0.003s
I20260709 12:26:07.952713 10939 tablet_copy_service.cc:342] P e2d5c637307a407ab688f5ccd6f0fcea: Request end of tablet copy session 3c52e0825c02476e89d84da9bb849f5d-834361a055d34950b4edecba39f07657 received from {username='slave'} at 127.0.0.1:50036
I20260709 12:26:07.953250 10939 tablet_copy_service.cc:434] P e2d5c637307a407ab688f5ccd6f0fcea: ending tablet copy session 3c52e0825c02476e89d84da9bb849f5d-834361a055d34950b4edecba39f07657 on tablet 834361a055d34950b4edecba39f07657 with peer 3c52e0825c02476e89d84da9bb849f5d
I20260709 12:26:07.953233 11624 raft_consensus.cc:2468] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 7.
I20260709 12:26:07.956693 10895 leader_election.cc:304] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:07.957731 14824 raft_consensus.cc:2804] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:26:07.958371 14824 raft_consensus.cc:697] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 7 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:07.959363 14824 consensus_queue.cc:237] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:08.005641  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:08.045537 10996 raft_consensus.cc:1275] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:26:08.086257 11624 raft_consensus.cc:1240] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 6. Current term is 7. Ops: []
I20260709 12:26:08.100647 11616 raft_consensus.cc:1217] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [term 11 LEARNER]: Deduplicated request from leader. Original: 11.8->[11.9-11.9]   Dedup: 11.9->[]
I20260709 12:26:08.153468 14850 consensus_queue.cc:1048] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:08.178038 10847 raft_consensus.cc:2468] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 7.
I20260709 12:26:08.199481 14814 tablet_copy_client.cc:538] T e9331e5342644ca2bae19187b083a7d5 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:08.231909 14850 raft_consensus.cc:993] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040: : Instructing follower edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:26:08.232285 14768 consensus_queue.cc:1048] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:08.232764 14850 raft_consensus.cc:1081] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Signalling peer edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:26:08.232887 10750 catalog_manager.cc:5697] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 6 to 7, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 7 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:08.340417 10994 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:37512
I20260709 12:26:08.341722 10994 raft_consensus.cc:493] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:08.342149 10994 raft_consensus.cc:3060] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:08.371393 14814 tablet_bootstrap.cc:492] T e9331e5342644ca2bae19187b083a7d5 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap starting.
I20260709 12:26:08.394891 10994 raft_consensus.cc:515] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:08.418444 11624 raft_consensus.cc:1217] T e8b17195a94142039c40f598ed006c94 P 3c52e0825c02476e89d84da9bb849f5d [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4]   Dedup: 3.4->[]
I20260709 12:26:08.466732 10845 raft_consensus.cc:1275] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:26:08.476076 10994 leader_election.cc:290] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:08.502472 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:08.503537 10929 raft_consensus.cc:3060] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:08.590431 10929 raft_consensus.cc:2468] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 5.
I20260709 12:26:08.593122 10968 leader_election.cc:304] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:08.596832 14729 raft_consensus.cc:2804] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:08.598937 14729 raft_consensus.cc:697] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:26:08.608824 14729 consensus_queue.cc:237] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:08.654587 11624 raft_consensus.cc:1275] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:26:08.657860 14851 consensus_queue.cc:1048] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
W20260709 12:26:08.708104 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 233486us
I20260709 12:26:08.709638 14868 consensus_queue.cc:1048] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:26:08.712227 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:08.712939 10846 raft_consensus.cc:3055] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:08.713318 10846 raft_consensus.cc:740] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:08.718922 10846 consensus_queue.cc:260] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:08.720283 10846 raft_consensus.cc:3060] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:08.741305 10923 raft_consensus.cc:1240] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:08.783227 10994 raft_consensus.cc:1240] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 LEADER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:08.798218 10847 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
mode: GRACEFUL
new_leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:47358
I20260709 12:26:08.798992 10847 raft_consensus.cc:606] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 5 LEADER]: Received request to transfer leadership to TS edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:08.776922 10750 catalog_manager.cc:5697] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 4 to 5, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 5 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:08.805794 10846 raft_consensus.cc:2468] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 5.
W20260709 12:26:08.809623 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 69224us
I20260709 12:26:08.841195 14851 raft_consensus.cc:1064] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea: attempting to promote NON_VOTER 3c52e0825c02476e89d84da9bb849f5d to VOTER
I20260709 12:26:08.850984 14851 consensus_queue.cc:237] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:08.961261 14864 log.cc:927] Time spent T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.064s	user 0.000s	sys 0.002s
I20260709 12:26:08.968920 14854 raft_consensus.cc:1064] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea: attempting to promote NON_VOTER 3c52e0825c02476e89d84da9bb849f5d to VOTER
I20260709 12:26:08.973044 14854 consensus_queue.cc:237] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:08.990734 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 110425us
I20260709 12:26:09.020110 11616 raft_consensus.cc:1275] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [term 11 LEARNER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:26:09.022913 14842 raft_consensus.cc:493] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:09.039498 14842 raft_consensus.cc:515] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:09.045045 14832 consensus_queue.cc:1048] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:26:09.048345 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 114906us
I20260709 12:26:09.060663 14842 leader_election.cc:290] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:26:09.061836 10969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 130657us
I20260709 12:26:09.065698 10995 raft_consensus.cc:1275] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:26:09.076560 10849 raft_consensus.cc:1275] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:26:09.080868 14868 consensus_queue.cc:1048] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:26:09.073588 14851 raft_consensus.cc:493] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:09.106936 14850 raft_consensus.cc:993] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040: : Instructing follower edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:26:09.106531 14851 raft_consensus.cc:515] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:09.107517 14850 raft_consensus.cc:1081] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 5 LEADER]: Signalling peer edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:26:09.110287 14851 leader_election.cc:290] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:09.114375 10923 raft_consensus.cc:1275] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:26:09.171104 14880 consensus_queue.cc:1048] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:09.172825 11001 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:37512
I20260709 12:26:09.173673 11001 raft_consensus.cc:493] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:09.174167 11001 raft_consensus.cc:3060] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:09.167635 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:09.180475 14846 consensus_queue.cc:1048] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:09.166261 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:09.210108 11001 raft_consensus.cc:515] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:09.212251 14814 tablet_bootstrap.cc:492] T e9331e5342644ca2bae19187b083a7d5 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=1 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:09.213331 14814 tablet_bootstrap.cc:492] T e9331e5342644ca2bae19187b083a7d5 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap complete.
I20260709 12:26:09.214119 14814 ts_tablet_manager.cc:1403] T e9331e5342644ca2bae19187b083a7d5 P 3c52e0825c02476e89d84da9bb849f5d: Time spent bootstrapping tablet: real 0.843s	user 0.038s	sys 0.011s
I20260709 12:26:09.234162 10853 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
mode: GRACEFUL
new_leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:47358
I20260709 12:26:09.240394 10853 raft_consensus.cc:606] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 11 LEADER]: Received request to transfer leadership to TS e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:09.251648  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:26:09.257687  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:09.258359 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:09.259227 10848 raft_consensus.cc:3055] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:26:09.259543 10848 raft_consensus.cc:740] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:09.259609  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:09.263701 10848 consensus_queue.cc:260] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:09.279493 10848 raft_consensus.cc:3060] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:09.283289 11001 leader_election.cc:290] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:09.320053 10848 raft_consensus.cc:2468] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 6.
I20260709 12:26:09.342921 10848 raft_consensus.cc:1275] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:26:09.349472 14814 raft_consensus.cc:359] T e9331e5342644ca2bae19187b083a7d5 P 3c52e0825c02476e89d84da9bb849f5d [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:26:09.350423 14814 raft_consensus.cc:740] T e9331e5342644ca2bae19187b083a7d5 P 3c52e0825c02476e89d84da9bb849f5d [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Initialized, Role: LEARNER
I20260709 12:26:09.357800 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:09.360441 10847 raft_consensus.cc:1275] T e8b17195a94142039c40f598ed006c94 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:26:09.375406 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:09.351114 14814 consensus_queue.cc:260] T e9331e5342644ca2bae19187b083a7d5 P 3c52e0825c02476e89d84da9bb849f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
W20260709 12:26:09.388862 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 144378us
I20260709 12:26:09.402220 14814 ts_tablet_manager.cc:1434] T e9331e5342644ca2bae19187b083a7d5 P 3c52e0825c02476e89d84da9bb849f5d: Time spent starting tablet: real 0.188s	user 0.012s	sys 0.001s
I20260709 12:26:09.410344 11616 raft_consensus.cc:1217] T e9331e5342644ca2bae19187b083a7d5 P 3c52e0825c02476e89d84da9bb849f5d [term 4 LEARNER]: Deduplicated request from leader. Original: 4.3->[4.4-4.4]   Dedup: 4.4->[]
I20260709 12:26:09.418040 14705 consensus_queue.cc:1048] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:26:09.441059 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 192189us
I20260709 12:26:09.450479 10894 leader_election.cc:304] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:09.452100 14895 raft_consensus.cc:2749] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:26:09.453738 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 195899us
I20260709 12:26:09.456765 11003 raft_consensus.cc:1275] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:26:09.457728 14705 consensus_queue.cc:1048] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:09.465049 11624 raft_consensus.cc:1275] T e8b17195a94142039c40f598ed006c94 P 3c52e0825c02476e89d84da9bb849f5d [term 3 LEARNER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:26:09.474663 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:09.475309 10925 raft_consensus.cc:3060] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:09.486323 10968 leader_election.cc:304] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:09.490060 14896 raft_consensus.cc:2804] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:09.492461 14896 raft_consensus.cc:697] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:26:09.493458 14896 consensus_queue.cc:237] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:09.498138 10925 raft_consensus.cc:2468] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 6.
I20260709 12:26:09.514477 14705 consensus_queue.cc:1048] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:09.522348 14895 raft_consensus.cc:2955] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 LEADER]: Committing config change with OpId 11.10: config changed from index 9 to 10, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:09.527249 14884 consensus_queue.cc:1048] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:26:09.536242 10748 catalog_manager.cc:5697] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 5 to 6, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 6 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:09.564661 11588 leader_election.cc:304] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:09.565822 14843 raft_consensus.cc:2749] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:26:09.580927 11003 raft_consensus.cc:2955] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:09.641438 14885 raft_consensus.cc:993] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040: : Instructing follower e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:26:09.642078 14885 raft_consensus.cc:1081] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 11 LEADER]: Signalling peer e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:26:09.641439 10864 tablet_copy_service.cc:342] P 80cd7d227db44f34a6108591dad9c040: Request end of tablet copy session 3c52e0825c02476e89d84da9bb849f5d-e9331e5342644ca2bae19187b083a7d5 received from {username='slave'} at 127.0.0.1:46480
I20260709 12:26:09.649019 10864 tablet_copy_service.cc:434] P 80cd7d227db44f34a6108591dad9c040: ending tablet copy session 3c52e0825c02476e89d84da9bb849f5d-e9331e5342644ca2bae19187b083a7d5 on tablet e9331e5342644ca2bae19187b083a7d5 with peer 3c52e0825c02476e89d84da9bb849f5d
W20260709 12:26:09.652700 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 56719.6us
I20260709 12:26:09.657698 10750 catalog_manager.cc:5697] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: config changed from index 9 to 10, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New cstate: current_term: 11 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:09.667080 10921 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:59626
I20260709 12:26:09.668027 10921 raft_consensus.cc:493] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:09.668430 10921 raft_consensus.cc:3060] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:09.679023 11617 raft_consensus.cc:2955] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:09.709558 14895 raft_consensus.cc:2955] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:09.718075 10921 raft_consensus.cc:515] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:09.756132 10921 leader_election.cc:290] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 12 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:09.757123 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:09.757964 10852 raft_consensus.cc:3055] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:26:09.758368 10852 raft_consensus.cc:740] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:09.759656 10852 consensus_queue.cc:260] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:09.761338 10852 raft_consensus.cc:3060] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:09.768129 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:09.769055 10995 raft_consensus.cc:3060] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:09.733783 11617 raft_consensus.cc:2955] T e8b17195a94142039c40f598ed006c94 P 3c52e0825c02476e89d84da9bb849f5d [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:09.807348 14865 raft_consensus.cc:1064] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040: attempting to promote NON_VOTER 3c52e0825c02476e89d84da9bb849f5d to VOTER
W20260709 12:26:09.822736 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RunLeaderElection -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 49093us
I20260709 12:26:09.847812 10852 raft_consensus.cc:2468] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 12.
I20260709 12:26:09.852114 10846 raft_consensus.cc:2955] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:09.843415 14865 consensus_queue.cc:237] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 2, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:09.895535 10995 raft_consensus.cc:2468] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 12.
I20260709 12:26:09.898722 10895 leader_election.cc:304] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:09.911916 11618 raft_consensus.cc:1275] T e9331e5342644ca2bae19187b083a7d5 P 3c52e0825c02476e89d84da9bb849f5d [term 4 LEARNER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:26:09.921315 14833 consensus_queue.cc:1048] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:09.932174 10995 raft_consensus.cc:1275] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:26:09.933915 14894 raft_consensus.cc:2804] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:26:09.934751 14894 raft_consensus.cc:697] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 12 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:09.935803 14894 consensus_queue.cc:237] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:09.936040 10921 consensus_queue.cc:237] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:09.933739 14833 consensus_queue.cc:1048] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:26:09.945013 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 46381.6us
I20260709 12:26:09.956141 10921 raft_consensus.cc:1275] T e9331e5342644ca2bae19187b083a7d5 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:26:09.960224 11624 raft_consensus.cc:1275] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:26:09.974536 10750 catalog_manager.cc:5697] T e8b17195a94142039c40f598ed006c94 P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: config changed from index 4 to 5, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:09.958468 10995 raft_consensus.cc:2955] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:09.987671 14829 consensus_queue.cc:1048] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:09.990061 10848 raft_consensus.cc:1275] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:26:09.990741 10852 raft_consensus.cc:2955] T e8b17195a94142039c40f598ed006c94 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:09.995980 14824 consensus_queue.cc:1048] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:26:10.002789 10921 raft_consensus.cc:1275] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:26:10.025588 14868 consensus_queue.cc:1048] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 12:26:10.049643 14873 consensus_queue.cc:1048] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:26:10.051607 14895 raft_consensus.cc:2955] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 LEADER]: Committing config change with OpId 11.11: config changed from index 10 to 11, VOTER edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:10.061749 10846 raft_consensus.cc:2955] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Committing config change with OpId 11.11: config changed from index 10 to 11, VOTER edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:10.104465 14883 raft_consensus.cc:2955] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:10.132315 10750 catalog_manager.cc:5697] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 11 to 12, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 12 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:10.145022 10854 raft_consensus.cc:1275] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:26:10.147132 10996 raft_consensus.cc:2955] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:10.162550 10925 consensus_queue.cc:237] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:10.150624 14846 consensus_queue.cc:1048] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:26:10.195715 10752 catalog_manager.cc:5697] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 reported cstate change: config changed from index 10 to 11, VOTER edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) evicted. New cstate: current_term: 11 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:10.249444 10996 raft_consensus.cc:1275] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:26:10.252280 11618 raft_consensus.cc:2955] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Committing config change with OpId 11.11: config changed from index 10 to 11, VOTER edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:10.321233 10748 catalog_manager.cc:5697] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: config changed from index 4 to 5, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:10.332125 11617 raft_consensus.cc:2955] T e9331e5342644ca2bae19187b083a7d5 P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:10.326460 14705 consensus_queue.cc:1048] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 12:26:10.343799 11616 raft_consensus.cc:1275] T e8b17195a94142039c40f598ed006c94 P 3c52e0825c02476e89d84da9bb849f5d [term 3 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:26:10.344817 10992 tablet_service.cc:1558] Processing DeleteTablet for tablet 834361a055d34950b4edecba39f07657 with delete_type TABLET_DATA_TOMBSTONED (TS edcc56ddd3264984b4da6c1db59e7f08 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:37496
I20260709 12:26:10.349599 10738 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 834361a055d34950b4edecba39f07657 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:10.349080 10925 raft_consensus.cc:2955] T e9331e5342644ca2bae19187b083a7d5 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
W20260709 12:26:10.370067 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 44147.9us
I20260709 12:26:10.396600 14705 consensus_queue.cc:1048] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:10.406486 10996 raft_consensus.cc:1275] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:26:10.444247 14884 consensus_queue.cc:1048] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:26:10.444779 14853 raft_consensus.cc:2955] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:10.453874 11624 raft_consensus.cc:2955] T e8b17195a94142039c40f598ed006c94 P 3c52e0825c02476e89d84da9bb849f5d [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:10.459594 10996 raft_consensus.cc:2955] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:10.488482 14916 tablet_replica.cc:333] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08: stopping tablet replica
I20260709 12:26:10.489903 14916 raft_consensus.cc:2243] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:10.490795 14916 raft_consensus.cc:2272] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:10.580950 14916 ts_tablet_manager.cc:1916] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:10.606946 14916 ts_tablet_manager.cc:1929] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 11.10
I20260709 12:26:10.607470 14916 log.cc:1199] T 834361a055d34950b4edecba39f07657 P edcc56ddd3264984b4da6c1db59e7f08: Deleting WAL directory at /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599781984018-9681-0/minicluster-data/ts-2-root/wals/834361a055d34950b4edecba39f07657
I20260709 12:26:10.809134 10738 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e8b17195a94142039c40f598ed006c94 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:10.841292 10847 raft_consensus.cc:1275] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:26:10.554459  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:10.610558 10739 catalog_manager.cc:5028] TS edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): tablet 834361a055d34950b4edecba39f07657 (table test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]) successfully deleted
W20260709 12:26:10.852294 10739 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 241969us
I20260709 12:26:10.947302 14884 consensus_queue.cc:1048] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
W20260709 12:26:11.103945 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 92336us
I20260709 12:26:11.116042 10750 catalog_manager.cc:5697] T e8b17195a94142039c40f598ed006c94 P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: config changed from index 5 to 6, VOTER 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) evicted. New cstate: current_term: 3 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
W20260709 12:26:11.171870 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 150286us
I20260709 12:26:11.208667 11003 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
mode: GRACEFUL
new_leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:32960
I20260709 12:26:11.209533 11003 raft_consensus.cc:606] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 LEADER]: Received request to transfer leadership to TS e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:11.241793 10925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
mode: GRACEFUL
new_leader_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:41546
I20260709 12:26:11.242790 10925 raft_consensus.cc:606] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 LEADER]: Received request to transfer leadership to TS 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:11.247870 10925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c72fddfc26044838a71a798f3371636b"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
mode: GRACEFUL
new_leader_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:41546
I20260709 12:26:11.248481 10925 raft_consensus.cc:606] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 9 LEADER]: Received request to transfer leadership to TS 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:11.251365 11003 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
mode: GRACEFUL
new_leader_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:32960
I20260709 12:26:11.252010 11003 raft_consensus.cc:606] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 LEADER]: Received request to transfer leadership to TS 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:11.253564  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:26:11.255877  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:11.256918  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:11.303833 10852 consensus_queue.cc:237] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:11.309278 14881 raft_consensus.cc:993] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08: : Instructing follower 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:26:11.309909 14881 raft_consensus.cc:1081] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 LEADER]: Signalling peer 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:26:11.323057 14786 raft_consensus.cc:993] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea: : Instructing follower 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:26:11.324952 14895 raft_consensus.cc:1081] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 LEADER]: Signalling peer 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:26:11.333611 10854 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:56394
I20260709 12:26:11.334233 10854 raft_consensus.cc:493] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:11.334602 10854 raft_consensus.cc:3060] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:11.344370 10849 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:56388
I20260709 12:26:11.345306 10849 raft_consensus.cc:493] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:11.345649 10849 raft_consensus.cc:3060] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:11.355424 11619 raft_consensus.cc:1275] T e9331e5342644ca2bae19187b083a7d5 P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:11.358989 14865 consensus_queue.cc:1048] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:26:11.360184 10996 raft_consensus.cc:1275] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:11.362519 10854 raft_consensus.cc:515] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:11.380450 10849 raft_consensus.cc:515] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:11.382411 10846 raft_consensus.cc:1240] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 7. Current term is 8. Ops: []
I20260709 12:26:11.386518 14865 consensus_queue.cc:1048] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:26:11.387370 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:11.388278 10925 raft_consensus.cc:3055] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:11.388664 10925 raft_consensus.cc:740] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:11.390599 10925 consensus_queue.cc:260] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:11.392452 10925 raft_consensus.cc:3060] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:11.400936 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:11.402205 11003 raft_consensus.cc:3055] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:26:11.402849 11003 raft_consensus.cc:740] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:26:11.408726 11003 consensus_queue.cc:260] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:11.410022 11003 raft_consensus.cc:3060] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:11.412653 10854 leader_election.cc:290] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:11.420033 10849 leader_election.cc:290] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 election: Requested vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:11.429373 11619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:11.430168 11619 raft_consensus.cc:3060] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:11.430430 11617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: true dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:11.431075 11617 raft_consensus.cc:3060] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:11.441059 11619 raft_consensus.cc:2468] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 3.
W20260709 12:26:11.441795 14938 log.cc:927] Time spent T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.069s	user 0.000s	sys 0.002s
I20260709 12:26:11.450456 14865 raft_consensus.cc:2955] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:11.468294 11617 raft_consensus.cc:2468] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 8.
I20260709 12:26:11.476533 11003 raft_consensus.cc:2468] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 8.
I20260709 12:26:11.455479 10820 leader_election.cc:304] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040; no voters: 
I20260709 12:26:11.471635 10925 raft_consensus.cc:2468] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 3.
I20260709 12:26:11.484822 14919 raft_consensus.cc:2804] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:11.485666 14919 raft_consensus.cc:697] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 3 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:11.486725 14919 consensus_queue.cc:237] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:11.496382 14850 raft_consensus.cc:493] T e8b17195a94142039c40f598ed006c94 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:11.497015 14850 raft_consensus.cc:515] T e8b17195a94142039c40f598ed006c94 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:11.505007 14850 leader_election.cc:290] T e8b17195a94142039c40f598ed006c94 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:11.510984 10820 leader_election.cc:304] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:11.520220 14833 raft_consensus.cc:2804] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:26:11.520861 14833 raft_consensus.cc:697] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 8 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:11.521770 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b17195a94142039c40f598ed006c94" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:11.522465 14833 consensus_queue.cc:237] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:11.541049 10738 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e9331e5342644ca2bae19187b083a7d5 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:11.548784 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b17195a94142039c40f598ed006c94" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:11.552919 11617 raft_consensus.cc:2955] T e9331e5342644ca2bae19187b083a7d5 P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:11.570233 11619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b17195a94142039c40f598ed006c94" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:11.581001 10820 leader_election.cc:304] T e8b17195a94142039c40f598ed006c94 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:11.581758 10844 tablet_service.cc:1558] Processing DeleteTablet for tablet e8b17195a94142039c40f598ed006c94 with delete_type TABLET_DATA_TOMBSTONED (TS 80cd7d227db44f34a6108591dad9c040 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:56372
I20260709 12:26:11.582954 14850 raft_consensus.cc:2749] T e8b17195a94142039c40f598ed006c94 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:11.599496 10994 raft_consensus.cc:2955] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:11.670656 14705 raft_consensus.cc:993] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea: : Instructing follower 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:26:11.671456 14705 raft_consensus.cc:1081] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 9 LEADER]: Signalling peer 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:26:11.686906 10846 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c72fddfc26044838a71a798f3371636b"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:56394
I20260709 12:26:11.687547 10846 raft_consensus.cc:493] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:11.687965 10846 raft_consensus.cc:3060] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:11.689898 10748 catalog_manager.cc:5697] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 reported cstate change: config changed from index 5 to 6, VOTER e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) evicted. New cstate: current_term: 4 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:11.702375 14783 raft_consensus.cc:993] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08: : Instructing follower e2d5c637307a407ab688f5ccd6f0fcea to start an election
W20260709 12:26:11.704375 14941 log.cc:927] Time spent T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 12:26:11.697185 10748 catalog_manager.cc:5697] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 2 to 3, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 3 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:11.707455 10748 catalog_manager.cc:5697] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 7 to 8, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 8 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:11.710780 10846 raft_consensus.cc:515] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:11.716257 14783 raft_consensus.cc:1081] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 LEADER]: Signalling peer e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:26:11.717209 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:11.717919 10925 raft_consensus.cc:3055] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:26:11.718212 10925 raft_consensus.cc:740] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:11.719009 14943 tablet_replica.cc:333] T e8b17195a94142039c40f598ed006c94 P 80cd7d227db44f34a6108591dad9c040: stopping tablet replica
I20260709 12:26:11.719053 10925 consensus_queue.cc:260] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:11.724144 10921 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:59622
I20260709 12:26:11.725149 10921 raft_consensus.cc:493] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:11.725571 10921 raft_consensus.cc:3060] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:11.727237 10846 leader_election.cc:290] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 10 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:11.729046 10925 raft_consensus.cc:3060] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:11.729450 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:11.732409 10996 raft_consensus.cc:3060] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:11.762945 14943 raft_consensus.cc:2243] T e8b17195a94142039c40f598ed006c94 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:11.764134 14943 raft_consensus.cc:2272] T e8b17195a94142039c40f598ed006c94 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:11.768983 14943 ts_tablet_manager.cc:1916] T e8b17195a94142039c40f598ed006c94 P 80cd7d227db44f34a6108591dad9c040: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:11.778906 10921 raft_consensus.cc:515] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:11.791911 10925 raft_consensus.cc:2468] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 10.
I20260709 12:26:11.795053 10996 raft_consensus.cc:2468] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 10.
I20260709 12:26:11.793975 10819 leader_election.cc:304] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:11.799453 10921 leader_election.cc:290] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:11.803689 14919 raft_consensus.cc:2804] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:26:11.804347 14919 raft_consensus.cc:697] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 10 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:11.805197 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:11.806095 10995 raft_consensus.cc:3055] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:26:11.806504 10995 raft_consensus.cc:740] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:26:11.807463 10995 consensus_queue.cc:260] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:11.809116 10995 raft_consensus.cc:3060] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:11.805553 14919 consensus_queue.cc:237] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:11.826262 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:11.830046 10846 raft_consensus.cc:3060] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:11.851081 10995 raft_consensus.cc:2468] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 7.
I20260709 12:26:11.857475 10895 leader_election.cc:304] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:11.858712 14832 raft_consensus.cc:2804] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:26:11.859314 14832 raft_consensus.cc:697] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:11.860466 14832 consensus_queue.cc:237] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:11.867959 10846 raft_consensus.cc:2468] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 7.
W20260709 12:26:11.898098 11645 debug-util.cc:398] Leaking SignalData structure 0x7b080037b340 after lost signal to thread 9684
W20260709 12:26:11.899650 11645 debug-util.cc:398] Leaking SignalData structure 0x7b0800257300 after lost signal to thread 10786
I20260709 12:26:11.900431 10912 tablet_service.cc:1558] Processing DeleteTablet for tablet e9331e5342644ca2bae19187b083a7d5 with delete_type TABLET_DATA_TOMBSTONED (TS e2d5c637307a407ab688f5ccd6f0fcea not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:59610
W20260709 12:26:11.901130 11645 debug-util.cc:398] Leaking SignalData structure 0x7b08002d0ce0 after lost signal to thread 10878
W20260709 12:26:11.904403 11645 debug-util.cc:398] Leaking SignalData structure 0x7b0800116d20 after lost signal to thread 10953
W20260709 12:26:11.906155 11645 debug-util.cc:398] Leaking SignalData structure 0x7b0800391fe0 after lost signal to thread 11027
W20260709 12:26:11.917061 11645 debug-util.cc:398] Leaking SignalData structure 0x7b0800375d20 after lost signal to thread 11648
W20260709 12:26:11.918320 11645 debug-util.cc:398] Leaking SignalData structure 0x7b08003396c0 after lost signal to thread 14889
I20260709 12:26:11.917158 14943 ts_tablet_manager.cc:1929] T e8b17195a94142039c40f598ed006c94 P 80cd7d227db44f34a6108591dad9c040: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 12:26:11.923614 14943 log.cc:1199] T e8b17195a94142039c40f598ed006c94 P 80cd7d227db44f34a6108591dad9c040: Deleting WAL directory at /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599781984018-9681-0/minicluster-data/ts-0-root/wals/e8b17195a94142039c40f598ed006c94
I20260709 12:26:11.943111 10738 catalog_manager.cc:5028] TS 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): tablet e8b17195a94142039c40f598ed006c94 (table test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]) successfully deleted
I20260709 12:26:11.950520 10752 catalog_manager.cc:5697] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 9 to 10, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 10 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:11.959434 14947 tablet_replica.cc:333] T e9331e5342644ca2bae19187b083a7d5 P e2d5c637307a407ab688f5ccd6f0fcea: stopping tablet replica
I20260709 12:26:11.961172 14947 raft_consensus.cc:2243] T e9331e5342644ca2bae19187b083a7d5 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:11.962319 14947 raft_consensus.cc:2272] T e9331e5342644ca2bae19187b083a7d5 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:11.966019 14947 ts_tablet_manager.cc:1916] T e9331e5342644ca2bae19187b083a7d5 P e2d5c637307a407ab688f5ccd6f0fcea: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:12.007194 10925 raft_consensus.cc:1275] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:26:12.010653 14833 consensus_queue.cc:1048] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:12.012679 10752 catalog_manager.cc:5697] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 6 to 7, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 7 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:12.036077 11617 raft_consensus.cc:1275] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [term 3 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:26:12.039129 14833 consensus_queue.cc:1048] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:26:12.078047 10995 raft_consensus.cc:1275] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:26:12.080965 14919 consensus_queue.cc:1048] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:26:12.097292 14947 ts_tablet_manager.cc:1929] T e9331e5342644ca2bae19187b083a7d5 P e2d5c637307a407ab688f5ccd6f0fcea: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.5
I20260709 12:26:12.098186 14947 log.cc:1199] T e9331e5342644ca2bae19187b083a7d5 P e2d5c637307a407ab688f5ccd6f0fcea: Deleting WAL directory at /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599781984018-9681-0/minicluster-data/ts-1-root/wals/e9331e5342644ca2bae19187b083a7d5
I20260709 12:26:12.136842 10738 catalog_manager.cc:5028] TS e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): tablet e9331e5342644ca2bae19187b083a7d5 (table test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]) successfully deleted
I20260709 12:26:12.213012 11617 raft_consensus.cc:1275] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:26:12.220531 14919 consensus_queue.cc:1048] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 12:26:12.262655 10996 raft_consensus.cc:1275] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:26:12.264897 14919 consensus_queue.cc:1048] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:26:12.320923 10854 raft_consensus.cc:1275] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:26:12.334417 14832 consensus_queue.cc:1048] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:26:12.355373 10929 raft_consensus.cc:1275] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:26:12.371124 14850 consensus_queue.cc:1048] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:26:12.425678 10994 raft_consensus.cc:1275] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:26:12.428056 14832 consensus_queue.cc:1048] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:26:12.610224  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:12.746673 10854 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
mode: GRACEFUL
new_leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:47358
I20260709 12:26:12.747375 10854 raft_consensus.cc:606] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 7 LEADER]: Received request to transfer leadership to TS e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:12.758570 10846 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
mode: GRACEFUL
new_leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:47358
I20260709 12:26:12.759488 10846 raft_consensus.cc:606] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 8 LEADER]: Received request to transfer leadership to TS edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:12.764516 10925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
mode: GRACEFUL
new_leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:41546
I20260709 12:26:12.765244 10925 raft_consensus.cc:606] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Received request to transfer leadership to TS edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:12.767719  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:26:12.769516  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:12.770305  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:12.794064 14919 raft_consensus.cc:993] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040: : Instructing follower edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:26:12.794663 14954 raft_consensus.cc:1081] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 8 LEADER]: Signalling peer edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:26:12.798182 10995 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:37512
I20260709 12:26:12.799106 10995 raft_consensus.cc:493] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:12.799652 10995 raft_consensus.cc:3060] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:12.834326 10995 raft_consensus.cc:515] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:12.839342 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:12.840173 10846 raft_consensus.cc:3055] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:26:12.840543 10846 raft_consensus.cc:740] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:12.841393 10846 consensus_queue.cc:260] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:12.842649 10846 raft_consensus.cc:3060] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:12.866178 10995 leader_election.cc:290] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:12.869309 11617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: true dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:12.870846 11617 raft_consensus.cc:3060] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:12.894054 10846 raft_consensus.cc:2468] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 9.
I20260709 12:26:12.895975 10968 leader_election.cc:304] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:12.897074 14846 raft_consensus.cc:2804] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:26:12.897607 14846 raft_consensus.cc:697] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:26:12.898561 14846 consensus_queue.cc:237] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:12.922058 10751 catalog_manager.cc:5697] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 8 to 9, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 9 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:12.980690 11617 raft_consensus.cc:2468] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 9.
I20260709 12:26:13.001554 14786 raft_consensus.cc:993] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea: : Instructing follower edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:26:13.002218 14786 raft_consensus.cc:1081] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Signalling peer edcc56ddd3264984b4da6c1db59e7f08 to start an election
I20260709 12:26:13.007017 10995 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:37500
I20260709 12:26:13.008093 10995 raft_consensus.cc:493] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:13.009091 10995 raft_consensus.cc:3060] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:13.046057 14865 raft_consensus.cc:993] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040: : Instructing follower e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:26:13.046684 14865 raft_consensus.cc:1081] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 7 LEADER]: Signalling peer e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:26:13.054723 10925 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:59626
I20260709 12:26:13.055953 10925 raft_consensus.cc:493] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:13.056628 10925 raft_consensus.cc:3060] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:13.120699 10994 consensus_queue.cc:237] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
W20260709 12:26:13.137600 10969 consensus_peers.cc:597] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613): Couldn't send request to peer 3c52e0825c02476e89d84da9bb849f5d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4ef3220c51df47db8859f07ab745fad5. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:13.097224 10995 raft_consensus.cc:515] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:13.152302 11616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:13.152948 11616 raft_consensus.cc:3060] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:13.155508 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:13.156260 10923 raft_consensus.cc:3055] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:26:13.156665 10923 raft_consensus.cc:740] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:13.157764 10920 raft_consensus.cc:1275] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:26:13.157482 10923 consensus_queue.cc:260] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:13.160213 14881 consensus_queue.cc:1048] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:13.153581 10925 raft_consensus.cc:515] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:13.161639 10854 raft_consensus.cc:1275] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:26:13.169342 10923 raft_consensus.cc:3060] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:13.174175 14881 consensus_queue.cc:1048] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:13.151145 10995 leader_election.cc:290] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:13.186172 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:13.186831 10852 raft_consensus.cc:3055] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:26:13.187121 10852 raft_consensus.cc:740] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:13.200276 10925 leader_election.cc:290] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:13.202641 11617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: true dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:13.203967 11617 raft_consensus.cc:3060] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:13.214671 10852 consensus_queue.cc:260] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:13.216138 10852 raft_consensus.cc:3060] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:13.230630 10923 raft_consensus.cc:2468] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 7.
I20260709 12:26:13.261526 10852 raft_consensus.cc:2468] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 8.
I20260709 12:26:13.280539 11617 raft_consensus.cc:2468] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 8.
I20260709 12:26:13.281977 11616 raft_consensus.cc:2468] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 7.
I20260709 12:26:13.329142 10895 leader_election.cc:304] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
W20260709 12:26:13.284474 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 56876.8us
W20260709 12:26:13.331676 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 111465us
I20260709 12:26:13.331044 10969 leader_election.cc:304] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:13.343636 14962 raft_consensus.cc:2804] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:26:13.366905 14972 raft_consensus.cc:2804] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:26:13.369279 14972 raft_consensus.cc:697] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 7 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:26:13.370669 14972 consensus_queue.cc:237] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:13.362473 14962 raft_consensus.cc:697] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 8 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:13.374333 14962 consensus_queue.cc:237] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:13.376307 10854 raft_consensus.cc:1275] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 12:26:13.394141 11616 raft_consensus.cc:1275] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 12:26:13.396369 14974 consensus_queue.cc:1048] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:26:13.401367 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 58606.8us
I20260709 12:26:13.416407 14970 consensus_queue.cc:1048] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:26:13.421160 14968 raft_consensus.cc:2955] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 LEADER]: Committing config change with OpId 5.5: config changed from index -1 to 5, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:26:13.432732 10921 raft_consensus.cc:2955] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index -1 to 5, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:26:13.437852 10852 raft_consensus.cc:2955] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index -1 to 5, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:26:13.451297 10751 catalog_manager.cc:5697] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 7 to 8, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 8 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:13.540911 10750 catalog_manager.cc:5697] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040 reported cstate change: config changed from index -1 to 5, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New cstate: current_term: 5 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:26:13.614243 10994 consensus_queue.cc:237] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
W20260709 12:26:13.637513 10969 consensus_peers.cc:597] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613): Couldn't send request to peer 3c52e0825c02476e89d84da9bb849f5d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 87cb7b380c8446e6ab1355c203218967. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:13.638500 10854 raft_consensus.cc:1275] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:26:13.640719 14973 consensus_queue.cc:1048] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:26:13.647298 10921 raft_consensus.cc:1275] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:26:13.649806 14973 consensus_queue.cc:1048] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:26:13.661116 10748 catalog_manager.cc:5697] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 6 to 7, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 7 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:13.680384 14974 raft_consensus.cc:2955] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 LEADER]: Committing config change with OpId 9.8: config changed from index -1 to 8, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:26:13.683069 10923 raft_consensus.cc:2955] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index -1 to 8, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:26:13.689055 14991 ts_tablet_manager.cc:933] T 4ef3220c51df47db8859f07ab745fad5 P 3c52e0825c02476e89d84da9bb849f5d: Initiating tablet copy from peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:13.733256 10854 raft_consensus.cc:2955] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index -1 to 8, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:26:13.743875 14991 tablet_copy_client.cc:323] T 4ef3220c51df47db8859f07ab745fad5 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Beginning tablet copy session from remote peer at address 127.9.116.67:39945
I20260709 12:26:13.759536 11013 tablet_copy_service.cc:140] P edcc56ddd3264984b4da6c1db59e7f08: Received BeginTabletCopySession request for tablet 4ef3220c51df47db8859f07ab745fad5 from peer 3c52e0825c02476e89d84da9bb849f5d ({username='slave'} at 127.0.0.1:57514)
I20260709 12:26:13.760744 11013 tablet_copy_service.cc:161] P edcc56ddd3264984b4da6c1db59e7f08: Beginning new tablet copy session on tablet 4ef3220c51df47db8859f07ab745fad5 from peer 3c52e0825c02476e89d84da9bb849f5d at {username='slave'} at 127.0.0.1:57514: session id = 3c52e0825c02476e89d84da9bb849f5d-4ef3220c51df47db8859f07ab745fad5
I20260709 12:26:13.759475 10750 catalog_manager.cc:5697] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: config changed from index -1 to 8, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New cstate: current_term: 9 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:26:13.759351 10852 consensus_queue.cc:237] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:26:13.800877 11013 tablet_copy_source_session.cc:215] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:13.805796 14991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ef3220c51df47db8859f07ab745fad5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:13.822835 10921 raft_consensus.cc:1275] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:26:13.829448 14973 consensus_queue.cc:1048] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:26:13.848754 10921 raft_consensus.cc:1275] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 12:26:13.850208 10820 consensus_peers.cc:597] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 -> Peer 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613): Couldn't send request to peer 3c52e0825c02476e89d84da9bb849f5d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9b5cbc6740ba4e518cfc3499d4a01d2a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:13.850703 10994 raft_consensus.cc:1275] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:26:13.855660 14978 consensus_queue.cc:1048] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:13.865357 14954 consensus_queue.cc:1048] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:13.894415 11616 raft_consensus.cc:1275] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:26:13.896806 14954 raft_consensus.cc:2955] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:26:13.906411 14968 consensus_queue.cc:1048] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:26:13.916519 10921 raft_consensus.cc:2955] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:26:13.910501 10994 raft_consensus.cc:2955] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:26:13.936751  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:13.972201 11617 raft_consensus.cc:1275] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:26:13.981416 10995 consensus_queue.cc:237] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:26:13.996256 14832 consensus_queue.cc:1048] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:26:14.004262 10852 raft_consensus.cc:1275] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:26:14.006006 14832 consensus_queue.cc:1048] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:26:14.018056 10752 catalog_manager.cc:5697] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 reported cstate change: config changed from index -1 to 5, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New cstate: current_term: 4 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:14.073139 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 64825.6us
I20260709 12:26:14.092844 15005 ts_tablet_manager.cc:933] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d: Initiating tablet copy from peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:14.104964 10854 raft_consensus.cc:1275] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 12:26:14.105005 10969 consensus_peers.cc:597] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613): Couldn't send request to peer 3c52e0825c02476e89d84da9bb849f5d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3357adbb6a514faf958aff009c4e4af8. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:14.108446 10925 raft_consensus.cc:1275] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:26:14.110564 14972 consensus_queue.cc:1048] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:14.112811 14972 consensus_queue.cc:1048] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:14.132269 15005 tablet_copy_client.cc:323] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Beginning tablet copy session from remote peer at address 127.9.116.67:39945
I20260709 12:26:14.140115 11013 tablet_copy_service.cc:140] P edcc56ddd3264984b4da6c1db59e7f08: Received BeginTabletCopySession request for tablet 87cb7b380c8446e6ab1355c203218967 from peer 3c52e0825c02476e89d84da9bb849f5d ({username='slave'} at 127.0.0.1:57514)
I20260709 12:26:14.140854 11013 tablet_copy_service.cc:161] P edcc56ddd3264984b4da6c1db59e7f08: Beginning new tablet copy session on tablet 87cb7b380c8446e6ab1355c203218967 from peer 3c52e0825c02476e89d84da9bb849f5d at {username='slave'} at 127.0.0.1:57514: session id = 3c52e0825c02476e89d84da9bb849f5d-87cb7b380c8446e6ab1355c203218967
I20260709 12:26:14.148923 14991 tablet_copy_client.cc:806] T 4ef3220c51df47db8859f07ab745fad5 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:14.158214 14991 tablet_copy_client.cc:670] T 4ef3220c51df47db8859f07ab745fad5 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:14.155308 11013 tablet_copy_source_session.cc:215] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:14.145947 14972 raft_consensus.cc:2955] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 LEADER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:26:14.189625 15005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87cb7b380c8446e6ab1355c203218967. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:14.217808 10852 raft_consensus.cc:2955] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:26:14.204555 14991 tablet_copy_client.cc:538] T 4ef3220c51df47db8859f07ab745fad5 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:14.294337 15010 ts_tablet_manager.cc:933] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d: Initiating tablet copy from peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265)
I20260709 12:26:14.335995 10752 catalog_manager.cc:5697] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: config changed from index -1 to 4, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New cstate: current_term: 4 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:14.320963 10921 raft_consensus.cc:2955] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:26:14.378118 15005 tablet_copy_client.cc:806] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:14.378758 15005 tablet_copy_client.cc:670] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:14.381114 10996 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
mode: GRACEFUL
new_leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:32960
I20260709 12:26:14.381764 10996 raft_consensus.cc:606] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 LEADER]: Received request to transfer leadership to TS e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:14.405274 14991 tablet_bootstrap.cc:492] T 4ef3220c51df47db8859f07ab745fad5 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap starting.
I20260709 12:26:14.407521 15010 tablet_copy_client.cc:323] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Beginning tablet copy session from remote peer at address 127.9.116.65:46265
I20260709 12:26:14.409055 15005 tablet_copy_client.cc:538] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:14.425184 10921 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ad766f48812a4ddeb383179b1d84907b"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
mode: GRACEFUL
new_leader_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:41546
I20260709 12:26:14.426252 10921 raft_consensus.cc:606] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [term 2 LEADER]: Received request to transfer leadership to TS 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:14.447919 10864 tablet_copy_service.cc:140] P 80cd7d227db44f34a6108591dad9c040: Received BeginTabletCopySession request for tablet 9b5cbc6740ba4e518cfc3499d4a01d2a from peer 3c52e0825c02476e89d84da9bb849f5d ({username='slave'} at 127.0.0.1:46480)
I20260709 12:26:14.448529 10864 tablet_copy_service.cc:161] P 80cd7d227db44f34a6108591dad9c040: Beginning new tablet copy session on tablet 9b5cbc6740ba4e518cfc3499d4a01d2a from peer 3c52e0825c02476e89d84da9bb849f5d at {username='slave'} at 127.0.0.1:46480: session id = 3c52e0825c02476e89d84da9bb849f5d-9b5cbc6740ba4e518cfc3499d4a01d2a
I20260709 12:26:14.453922 10995 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
mode: GRACEFUL
new_leader_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:32960
I20260709 12:26:14.454612 10995 raft_consensus.cc:606] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 LEADER]: Received request to transfer leadership to TS 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:14.456434  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:26:14.459987  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:14.461330  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:14.467749 10864 tablet_copy_source_session.cc:215] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:14.487154 15010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b5cbc6740ba4e518cfc3499d4a01d2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:14.495352 15005 tablet_bootstrap.cc:492] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap starting.
I20260709 12:26:14.555701 15010 tablet_copy_client.cc:806] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:14.561574 14832 raft_consensus.cc:993] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea: : Instructing follower 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:26:14.562170 14962 raft_consensus.cc:1081] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [term 2 LEADER]: Signalling peer 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:26:14.563978 10854 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ad766f48812a4ddeb383179b1d84907b"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:56394
I20260709 12:26:14.564620 10854 raft_consensus.cc:493] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:14.565091 10854 raft_consensus.cc:3060] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:14.575244 10854 raft_consensus.cc:515] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:14.575933 15010 tablet_copy_client.cc:670] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:14.583236 15010 tablet_copy_client.cc:538] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:14.600306 10854 leader_election.cc:290] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:14.602741 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad766f48812a4ddeb383179b1d84907b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:14.603600 10996 raft_consensus.cc:3060] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:14.615653 10996 raft_consensus.cc:2468] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 3.
I20260709 12:26:14.616648 10995 raft_consensus.cc:1240] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:14.622277 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad766f48812a4ddeb383179b1d84907b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:14.623013 10921 raft_consensus.cc:3055] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:14.623189 15013 ts_tablet_manager.cc:933] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d: Initiating tablet copy from peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:14.623332 10921 raft_consensus.cc:740] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:14.624383 10921 consensus_queue.cc:260] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:14.644621 10820 leader_election.cc:304] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:14.645684 14954 raft_consensus.cc:2804] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:14.646243 14954 raft_consensus.cc:697] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [term 3 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:14.647161 14954 consensus_queue.cc:237] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:14.664667 10921 raft_consensus.cc:3060] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:14.709250 14968 raft_consensus.cc:993] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08: : Instructing follower e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:26:14.709873 14968 raft_consensus.cc:1081] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 LEADER]: Signalling peer e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:26:14.711733 10929 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:59622
I20260709 12:26:14.712348 10929 raft_consensus.cc:493] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:14.712710 10929 raft_consensus.cc:3060] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:14.730588 10921 raft_consensus.cc:2468] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 3.
I20260709 12:26:14.733101 15013 tablet_copy_client.cc:323] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Beginning tablet copy session from remote peer at address 127.9.116.67:39945
I20260709 12:26:14.744484 11013 tablet_copy_service.cc:140] P edcc56ddd3264984b4da6c1db59e7f08: Received BeginTabletCopySession request for tablet 3357adbb6a514faf958aff009c4e4af8 from peer 3c52e0825c02476e89d84da9bb849f5d ({username='slave'} at 127.0.0.1:57514)
I20260709 12:26:14.745306 11013 tablet_copy_service.cc:161] P edcc56ddd3264984b4da6c1db59e7f08: Beginning new tablet copy session on tablet 3357adbb6a514faf958aff009c4e4af8 from peer 3c52e0825c02476e89d84da9bb849f5d at {username='slave'} at 127.0.0.1:57514: session id = 3c52e0825c02476e89d84da9bb849f5d-3357adbb6a514faf958aff009c4e4af8
I20260709 12:26:14.755761 11013 tablet_copy_source_session.cc:215] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:14.780246 15013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3357adbb6a514faf958aff009c4e4af8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:14.811112 15013 tablet_copy_client.cc:806] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:14.812032 15013 tablet_copy_client.cc:670] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:14.814927 10752 catalog_manager.cc:5697] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 2 to 3, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 3 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:14.834779 15013 tablet_copy_client.cc:538] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:14.827196 10929 raft_consensus.cc:515] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:14.841619 10929 leader_election.cc:290] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 10 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:14.844429 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:14.845362 10996 raft_consensus.cc:3055] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:26:14.845729 10996 raft_consensus.cc:740] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:26:14.846590 10996 consensus_queue.cc:260] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:14.848898 15013 tablet_bootstrap.cc:492] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap starting.
I20260709 12:26:14.849403 14991 tablet_bootstrap.cc:492] T 4ef3220c51df47db8859f07ab745fad5 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:14.847905 10996 raft_consensus.cc:3060] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:14.850481 14991 tablet_bootstrap.cc:492] T 4ef3220c51df47db8859f07ab745fad5 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap complete.
I20260709 12:26:14.851274 14991 ts_tablet_manager.cc:1403] T 4ef3220c51df47db8859f07ab745fad5 P 3c52e0825c02476e89d84da9bb849f5d: Time spent bootstrapping tablet: real 0.446s	user 0.034s	sys 0.018s
W20260709 12:26:14.852331 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 51321.5us
I20260709 12:26:14.822499 15010 tablet_bootstrap.cc:492] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap starting.
I20260709 12:26:14.854732 14991 raft_consensus.cc:359] T 4ef3220c51df47db8859f07ab745fad5 P 3c52e0825c02476e89d84da9bb849f5d [term 5 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:26:14.868054 14991 raft_consensus.cc:740] T 4ef3220c51df47db8859f07ab745fad5 P 3c52e0825c02476e89d84da9bb849f5d [term 5 LEARNER]: Becoming Follower/Learner. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Initialized, Role: LEARNER
I20260709 12:26:14.869079 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:14.869870 10846 raft_consensus.cc:3060] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:14.869062 14991 consensus_queue.cc:260] T 4ef3220c51df47db8859f07ab745fad5 P 3c52e0825c02476e89d84da9bb849f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
W20260709 12:26:14.881615 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 70368us
I20260709 12:26:14.893062 14991 ts_tablet_manager.cc:1434] T 4ef3220c51df47db8859f07ab745fad5 P 3c52e0825c02476e89d84da9bb849f5d: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.001s
I20260709 12:26:14.895295 10846 raft_consensus.cc:2468] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 10.
I20260709 12:26:14.901672 15013 tablet_bootstrap.cc:492] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:14.911520 15013 tablet_bootstrap.cc:492] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap complete.
I20260709 12:26:14.904487 11013 tablet_copy_service.cc:342] P edcc56ddd3264984b4da6c1db59e7f08: Request end of tablet copy session 3c52e0825c02476e89d84da9bb849f5d-4ef3220c51df47db8859f07ab745fad5 received from {username='slave'} at 127.0.0.1:57514
I20260709 12:26:14.912354 10894 leader_election.cc:304] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:14.893105 10996 raft_consensus.cc:2468] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 10.
I20260709 12:26:14.928709 14832 raft_consensus.cc:2804] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:26:14.929332 14832 raft_consensus.cc:697] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:14.930171 14832 consensus_queue.cc:237] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:14.933733 11013 tablet_copy_service.cc:434] P edcc56ddd3264984b4da6c1db59e7f08: ending tablet copy session 3c52e0825c02476e89d84da9bb849f5d-4ef3220c51df47db8859f07ab745fad5 on tablet 4ef3220c51df47db8859f07ab745fad5 with peer 3c52e0825c02476e89d84da9bb849f5d
I20260709 12:26:14.936765 15013 ts_tablet_manager.cc:1403] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d: Time spent bootstrapping tablet: real 0.088s	user 0.028s	sys 0.011s
I20260709 12:26:14.953130 15013 raft_consensus.cc:359] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:26:14.948978 14973 raft_consensus.cc:993] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08: : Instructing follower 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:26:14.957324 10752 catalog_manager.cc:5697] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 9 to 10, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 10 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:14.964268 15013 raft_consensus.cc:740] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Initialized, Role: LEARNER
I20260709 12:26:14.985215 15013 consensus_queue.cc:260] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:26:14.988140 14974 raft_consensus.cc:1081] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 LEADER]: Signalling peer 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:26:15.001410 15013 ts_tablet_manager.cc:1434] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.001s
I20260709 12:26:15.005065 11013 tablet_copy_service.cc:342] P edcc56ddd3264984b4da6c1db59e7f08: Request end of tablet copy session 3c52e0825c02476e89d84da9bb849f5d-3357adbb6a514faf958aff009c4e4af8 received from {username='slave'} at 127.0.0.1:57514
I20260709 12:26:15.005687 11013 tablet_copy_service.cc:434] P edcc56ddd3264984b4da6c1db59e7f08: ending tablet copy session 3c52e0825c02476e89d84da9bb849f5d-3357adbb6a514faf958aff009c4e4af8 on tablet 3357adbb6a514faf958aff009c4e4af8 with peer 3c52e0825c02476e89d84da9bb849f5d
I20260709 12:26:15.022048 15005 tablet_bootstrap.cc:492] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:15.024176 15005 tablet_bootstrap.cc:492] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap complete.
W20260709 12:26:15.032410 15021 log.cc:927] Time spent T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
W20260709 12:26:15.039526 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 74837.7us
I20260709 12:26:15.039881 15005 ts_tablet_manager.cc:1403] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d: Time spent bootstrapping tablet: real 0.545s	user 0.038s	sys 0.011s
W20260709 12:26:15.048638 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 83963.6us
I20260709 12:26:15.069123 15005 raft_consensus.cc:359] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d [term 9 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:26:15.070123 15005 raft_consensus.cc:740] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d [term 9 LEARNER]: Becoming Follower/Learner. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Initialized, Role: LEARNER
I20260709 12:26:15.070871 15005 consensus_queue.cc:260] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:26:15.096271 15005 ts_tablet_manager.cc:1434] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d: Time spent starting tablet: real 0.044s	user 0.002s	sys 0.006s
I20260709 12:26:15.098711 11013 tablet_copy_service.cc:342] P edcc56ddd3264984b4da6c1db59e7f08: Request end of tablet copy session 3c52e0825c02476e89d84da9bb849f5d-87cb7b380c8446e6ab1355c203218967 received from {username='slave'} at 127.0.0.1:57514
I20260709 12:26:15.099870 11013 tablet_copy_service.cc:434] P edcc56ddd3264984b4da6c1db59e7f08: ending tablet copy session 3c52e0825c02476e89d84da9bb849f5d-87cb7b380c8446e6ab1355c203218967 on tablet 87cb7b380c8446e6ab1355c203218967 with peer 3c52e0825c02476e89d84da9bb849f5d
I20260709 12:26:15.102059 10929 raft_consensus.cc:1275] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:15.104664 10846 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:56388
I20260709 12:26:15.115317 11616 raft_consensus.cc:1217] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [term 4 LEARNER]: Deduplicated request from leader. Original: 4.3->[4.4-4.4]   Dedup: 4.4->[]
I20260709 12:26:15.119009 10846 raft_consensus.cc:493] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:15.121042 10846 raft_consensus.cc:3060] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:15.117842 10995 raft_consensus.cc:1275] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:15.126171 15022 consensus_queue.cc:1048] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:15.160111 15022 consensus_queue.cc:1048] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:15.176680 11616 raft_consensus.cc:1217] T 4ef3220c51df47db8859f07ab745fad5 P 3c52e0825c02476e89d84da9bb849f5d [term 5 LEARNER]: Deduplicated request from leader. Original: 5.4->[5.5-5.5]   Dedup: 5.5->[]
I20260709 12:26:15.202155 15010 tablet_bootstrap.cc:492] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:15.220285 15010 tablet_bootstrap.cc:492] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap complete.
I20260709 12:26:15.221661 15010 ts_tablet_manager.cc:1403] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d: Time spent bootstrapping tablet: real 0.399s	user 0.044s	sys 0.006s
I20260709 12:26:15.225899 15010 raft_consensus.cc:359] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:26:15.227052 15010 raft_consensus.cc:740] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Initialized, Role: LEARNER
I20260709 12:26:15.262004 10846 raft_consensus.cc:515] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:15.279834 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:15.280567 10996 raft_consensus.cc:3055] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:26:15.280879 10996 raft_consensus.cc:740] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:26:15.281643 10996 consensus_queue.cc:260] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:15.283018 10996 raft_consensus.cc:3060] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:15.277885 10846 leader_election.cc:290] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 10 election: Requested vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:15.302290 10852 raft_consensus.cc:1240] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 9. Current term is 10. Ops: []
W20260709 12:26:15.331012 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 63231.2us
I20260709 12:26:15.335530 10996 raft_consensus.cc:2468] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 10.
W20260709 12:26:15.409543 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 137206us
I20260709 12:26:15.410039 10820 leader_election.cc:304] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:15.418947 14978 raft_consensus.cc:2804] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:26:15.436092 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 220911us
I20260709 12:26:15.336925 15010 consensus_queue.cc:260] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:26:15.453676 11617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: true dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:15.454423 11617 raft_consensus.cc:3060] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:15.454262 15010 ts_tablet_manager.cc:1434] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d: Time spent starting tablet: real 0.232s	user 0.013s	sys 0.000s
I20260709 12:26:15.446638 14978 raft_consensus.cc:697] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 10 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:15.494771 11617 raft_consensus.cc:2468] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 10.
W20260709 12:26:15.496614 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 47649us
W20260709 12:26:15.549525 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 51808.2us
W20260709 12:26:15.569410 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 100385us
W20260709 12:26:15.603260 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 52933.1us
I20260709 12:26:15.605952 14978 consensus_queue.cc:237] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:15.667357 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 52242.3us
I20260709 12:26:15.681459  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:15.682850 10864 tablet_copy_service.cc:342] P 80cd7d227db44f34a6108591dad9c040: Request end of tablet copy session 3c52e0825c02476e89d84da9bb849f5d-9b5cbc6740ba4e518cfc3499d4a01d2a received from {username='slave'} at 127.0.0.1:46480
I20260709 12:26:15.683322 10864 tablet_copy_service.cc:434] P 80cd7d227db44f34a6108591dad9c040: ending tablet copy session 3c52e0825c02476e89d84da9bb849f5d-9b5cbc6740ba4e518cfc3499d4a01d2a on tablet 9b5cbc6740ba4e518cfc3499d4a01d2a with peer 3c52e0825c02476e89d84da9bb849f5d
I20260709 12:26:15.879164 10995 raft_consensus.cc:1275] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:26:15.922413 11616 raft_consensus.cc:1217] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d [term 9 LEARNER]: Deduplicated request from leader. Original: 9.7->[9.8-9.8]   Dedup: 9.8->[]
W20260709 12:26:15.937052 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 60441.1us
I20260709 12:26:15.968122 15055 consensus_queue.cc:1048] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:26:15.950754 10752 catalog_manager.cc:5697] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 9 to 10, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 10 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:15.969617 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 74154.5us
I20260709 12:26:15.988765 10849 raft_consensus.cc:1275] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:26:16.049063 15048 consensus_queue.cc:1048] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 12:26:16.065001 15038 raft_consensus.cc:1064] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08: attempting to promote NON_VOTER 3c52e0825c02476e89d84da9bb849f5d to VOTER
I20260709 12:26:16.074290 15038 consensus_queue.cc:237] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 2, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:16.162206 11620 raft_consensus.cc:1217] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d [term 4 LEARNER]: Deduplicated request from leader. Original: 4.4->[4.5-4.5]   Dedup: 4.5->[]
I20260709 12:26:16.344264 14973 raft_consensus.cc:1064] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08: attempting to promote NON_VOTER 3c52e0825c02476e89d84da9bb849f5d to VOTER
I20260709 12:26:16.347368 14973 consensus_queue.cc:237] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 3, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:16.611759 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 105172us
W20260709 12:26:16.645612 15065 log.cc:927] Time spent T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
W20260709 12:26:16.683027 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 125821us
W20260709 12:26:16.684764 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 227251us
I20260709 12:26:16.710539 14968 raft_consensus.cc:493] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:16.736299 10929 raft_consensus.cc:1275] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:26:16.711190 14968 raft_consensus.cc:515] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:16.743364 11621 raft_consensus.cc:1275] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 10 index: 12. (index mismatch)
I20260709 12:26:16.747375 11615 raft_consensus.cc:1275] T 4ef3220c51df47db8859f07ab745fad5 P 3c52e0825c02476e89d84da9bb849f5d [term 5 LEARNER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:26:16.749763 15071 raft_consensus.cc:1064] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08: attempting to promote NON_VOTER 3c52e0825c02476e89d84da9bb849f5d to VOTER
I20260709 12:26:16.751782 15046 consensus_queue.cc:1048] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:26:16.764873 15071 consensus_queue.cc:237] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 6, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:16.797487 10921 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
mode: GRACEFUL
new_leader_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:41546
I20260709 12:26:16.798170 10921 raft_consensus.cc:606] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 8 LEADER]: Received request to transfer leadership to TS 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:16.815372 14975 consensus_queue.cc:1048] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:26:16.823027 10996 raft_consensus.cc:1275] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 10 index: 12. (index mismatch)
I20260709 12:26:16.838039 15078 consensus_queue.cc:1048] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 12:26:16.841387 11623 raft_consensus.cc:1275] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [term 4 LEARNER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 12:26:16.842738 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 44757.3us
I20260709 12:26:16.845477 15043 consensus_queue.cc:1048] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:16.847877 10996 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "24c913e527ff46578e084c41eab7bb9d"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
mode: GRACEFUL
new_leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:32960
I20260709 12:26:16.853842 10996 raft_consensus.cc:606] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 5 LEADER]: Received request to transfer leadership to TS e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:16.875782 10847 raft_consensus.cc:1275] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:26:16.878492 10925 raft_consensus.cc:1275] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:26:16.876084 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad766f48812a4ddeb383179b1d84907b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:16.893080 10852 raft_consensus.cc:1275] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:26:16.909631 15049 consensus_queue.cc:1048] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 12:26:16.973882 10920 raft_consensus.cc:1275] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:26:16.911525 15024 consensus_queue.cc:1048] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.069s
I20260709 12:26:16.993212 15035 consensus_queue.cc:1048] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:26:16.980602 15073 consensus_queue.cc:1048] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:26:16.992050 15022 raft_consensus.cc:493] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:17.015367 15022 raft_consensus.cc:515] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:17.017793 15022 leader_election.cc:290] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:17.042490 14968 leader_election.cc:290] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:17.047839 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad766f48812a4ddeb383179b1d84907b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:17.071159  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:26:17.073469  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:17.074522  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:17.075057 11623 raft_consensus.cc:1275] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d [term 9 LEARNER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:26:17.111950 10968 leader_election.cc:304] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:17.114226 15073 consensus_queue.cc:1048] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:26:17.116520 15073 raft_consensus.cc:2749] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:17.135228 10852 raft_consensus.cc:1275] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:26:17.150696 15036 raft_consensus.cc:993] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea: : Instructing follower 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:26:17.152339 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:17.168238 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:17.122010 15038 raft_consensus.cc:2955] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 LEADER]: Committing config change with OpId 5.6: config changed from index 5 to 6, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:17.185865 15087 consensus_queue.cc:1048] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:26:17.193825 15050 consensus_queue.cc:1048] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:26:17.175657 15036 raft_consensus.cc:1081] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 8 LEADER]: Signalling peer 80cd7d227db44f34a6108591dad9c040 to start an election
I20260709 12:26:17.199630 10752 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60730 (request call id 348) took 1291 ms. Trace:
I20260709 12:26:17.203001 10923 raft_consensus.cc:2955] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:17.257212 10853 raft_consensus.cc:2955] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
W20260709 12:26:17.370369 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 92303.4us
I20260709 12:26:17.200347 10752 rpcz_store.cc:276] 0709 12:26:15.907821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:15.908027 (+   206us) service_pool.cc:224] Handling call
0709 12:26:17.199431 (+1291404us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:16.130881 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:16.170008 (+ 39127us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:16.170071 (+    63us) write_op.cc:435] Acquired schema lock
0709 12:26:16.170099 (+    28us) tablet.cc:662] Decoding operations
0709 12:26:16.327107 (+157008us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:16.360741 (+ 33634us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:16.360804 (+    63us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:26:16.372583 (+ 11779us) tablet.cc:701] Row locks acquired
0709 12:26:16.382723 (+ 10140us) write_op.cc:260] PREPARE: finished
0709 12:26:16.411436 (+ 28713us) write_op.cc:270] Start()
0709 12:26:16.428594 (+ 17158us) write_op.cc:276] Timestamp: P: 1783599976393019 usec, L: 0
0709 12:26:16.430469 (+  1875us) op_driver.cc:348] REPLICATION: starting
0709 12:26:16.474638 (+ 44169us) log.cc:844] Serialized 533 byte log entry
0709 12:26:16.818409 (+343771us) op_driver.cc:464] REPLICATION: finished
0709 12:26:17.103188 (+284779us) write_op.cc:301] APPLY: starting
0709 12:26:17.103321 (+   133us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:17.106606 (+  3285us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:17.106739 (+   133us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:17.107659 (+   920us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:17.107923 (+   264us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 12:26:17.107984 (+    61us) write_op.cc:312] APPLY: finished
0709 12:26:17.108210 (+   226us) log.cc:844] Serialized 25 byte log entry
0709 12:26:17.109725 (+  1515us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:17.109833 (+   108us) write_op.cc:454] Released schema lock
0709 12:26:17.109876 (+    43us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:17.111005 (+  1129us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:17.111035 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":259992,"apply.run_cpu_time_us":4108,"apply.run_wall_time_us":25329,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8307,"num_ops":1,"prepare.queue_time_us":154666,"prepare.run_cpu_time_us":40372,"prepare.run_wall_time_us":603014,"raft.queue_time_us":57623,"raft.run_cpu_time_us":39032,"raft.run_wall_time_us":99372,"replication_time_us":387769,"thread_start_us":474892,"threads_started":4,"wal-append.queue_time_us":257753}]]}
I20260709 12:26:17.370704 11622 raft_consensus.cc:2955] T 4ef3220c51df47db8859f07ab745fad5 P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
W20260709 12:26:17.475082 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 203868us
W20260709 12:26:17.527696 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 257080us
W20260709 12:26:17.523522 15086 log.cc:927] Time spent T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 12:26:17.534202 15092 log.cc:927] Time spent T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d: Append to log took a long time: real 0.091s	user 0.002s	sys 0.001s
W20260709 12:26:17.591691 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 134158us
W20260709 12:26:17.587445 15097 log.cc:927] Time spent T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d: Append to log took a long time: real 0.139s	user 0.002s	sys 0.000s
W20260709 12:26:17.601708 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 52999.4us
W20260709 12:26:17.601006 15095 log.cc:927] Time spent T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.152s	user 0.001s	sys 0.001s
I20260709 12:26:17.611824 10819 leader_election.cc:304] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:26:17.633560 15094 log.cc:927] Time spent T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.180s	user 0.001s	sys 0.001s
I20260709 12:26:17.628888 15098 raft_consensus.cc:2749] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:26:17.674628 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 65895.8us
W20260709 12:26:17.674175 15096 log.cc:927] Time spent T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.223s	user 0.002s	sys 0.000s
I20260709 12:26:17.692476 10853 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:56394
I20260709 12:26:17.693104 10853 raft_consensus.cc:493] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:17.693480 10853 raft_consensus.cc:3060] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:17.709455 15019 raft_consensus.cc:1064] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040: attempting to promote NON_VOTER 3c52e0825c02476e89d84da9bb849f5d to VOTER
I20260709 12:26:17.708334 15108 raft_consensus.cc:2955] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 LEADER]: Committing config change with OpId 9.9: config changed from index 8 to 9, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:17.712728 15019 consensus_queue.cc:237] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:17.737339 15073 raft_consensus.cc:2955] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:17.740316 15109 raft_consensus.cc:993] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08: : Instructing follower e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:26:17.740942 14975 raft_consensus.cc:1081] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 5 LEADER]: Signalling peer e2d5c637307a407ab688f5ccd6f0fcea to start an election
I20260709 12:26:17.761300 10752 catalog_manager.cc:5697] T 4ef3220c51df47db8859f07ab745fad5 P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: config changed from index 5 to 6, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New cstate: current_term: 5 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:17.778019 10853 raft_consensus.cc:515] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:17.783694 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 95224.9us
I20260709 12:26:17.795282 10853 leader_election.cc:290] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:17.790522 11623 raft_consensus.cc:2955] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 8 to 9, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:17.826457 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:17.827208 11003 raft_consensus.cc:3060] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:26:17.839047 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 53182.2us
I20260709 12:26:17.857201 10921 raft_consensus.cc:2955] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:17.845644 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:17.867337 10920 raft_consensus.cc:3055] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:26:17.867733 10920 raft_consensus.cc:740] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:17.870846 11003 raft_consensus.cc:2468] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 9.
I20260709 12:26:17.904039 10925 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "24c913e527ff46578e084c41eab7bb9d"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:59622
I20260709 12:26:17.905000 10925 raft_consensus.cc:493] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:17.905488 10925 raft_consensus.cc:3060] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:17.877091 10920 consensus_queue.cc:260] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:17.923199 10920 raft_consensus.cc:3060] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:17.952292 10850 raft_consensus.cc:2955] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
W20260709 12:26:17.969059 15081 log.cc:927] Time spent T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:26:17.978183 10820 leader_election.cc:304] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:18.002846 15024 raft_consensus.cc:2804] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:26:18.004252 15024 raft_consensus.cc:697] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 9 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:18.005612 15024 consensus_queue.cc:237] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:18.038803 15112 log.cc:927] Time spent T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 12:26:18.060847 10925 raft_consensus.cc:515] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:18.064155 10920 raft_consensus.cc:2468] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 9.
I20260709 12:26:18.088603 10925 leader_election.cc:290] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:26:18.023217 15097 log.cc:927] Time spent T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:26:18.095995 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c913e527ff46578e084c41eab7bb9d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:18.096786 10848 raft_consensus.cc:3060] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:18.112953 10850 raft_consensus.cc:2955] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 8 to 9, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:18.119195 10848 raft_consensus.cc:2468] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 6.
I20260709 12:26:18.120980 10894 leader_election.cc:304] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:18.171664 11003 raft_consensus.cc:1240] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 8. Current term is 9. Ops: []
I20260709 12:26:18.211530 11623 raft_consensus.cc:2955] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:18.179476 15077 raft_consensus.cc:2804] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:18.261508 10921 raft_consensus.cc:2955] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 8 to 9, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:18.272398 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c913e527ff46578e084c41eab7bb9d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:18.273080 11000 raft_consensus.cc:3055] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:26:18.273345 11000 raft_consensus.cc:740] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:26:18.293056 11000 consensus_queue.cc:260] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:18.313997 11000 raft_consensus.cc:3060] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:18.293356 15077 raft_consensus.cc:697] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:18.347240 15077 consensus_queue.cc:237] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:18.422513 10752 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.108s	sys 0.178s
W20260709 12:26:18.423668 10752 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.109s	sys 0.178s
W20260709 12:26:18.425848 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 307183us
I20260709 12:26:18.460469 10920 raft_consensus.cc:1240] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 5. Current term is 6. Ops: []
I20260709 12:26:18.472103 14832 raft_consensus.cc:493] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:18.473573 14832 raft_consensus.cc:515] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:18.478453 14832 leader_election.cc:290] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:18.485606 11622 raft_consensus.cc:1275] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d [term 4 LEARNER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:26:18.557914 10968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:18.617133 10854 raft_consensus.cc:1240] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 5. Current term is 6. Ops: []
I20260709 12:26:18.640231 15031 raft_consensus.cc:493] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:18.491202 14962 raft_consensus.cc:493] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:18.644356 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad766f48812a4ddeb383179b1d84907b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:18.645538 15022 consensus_queue.cc:1048] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:26:18.652432 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad766f48812a4ddeb383179b1d84907b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:18.653251 11000 raft_consensus.cc:2468] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 6.
I20260709 12:26:18.492789 10996 raft_consensus.cc:1275] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:18.765548 14975 raft_consensus.cc:493] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:18.767791 15077 raft_consensus.cc:493] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:18.768203 14975 raft_consensus.cc:515] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:26:18.768724 15077 raft_consensus.cc:515] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:18.769781 14962 raft_consensus.cc:515] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:26:18.752571 15031 raft_consensus.cc:515] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:18.792472 10925 raft_consensus.cc:1275] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:18.805589 15077 leader_election.cc:290] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:18.806191 14962 leader_election.cc:290] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:18.808847 15031 leader_election.cc:290] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:26:18.809703 10969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:18.819860 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6a1da21304fcfacab384a6afc4101" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:18.828815 10927 raft_consensus.cc:1275] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:26:18.832963 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:18.862802 10752 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36188 (request call id 224) took 1301 ms. Trace:
I20260709 12:26:18.765574  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:18.913586 11002 raft_consensus.cc:1275] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:26:18.916416 14954 consensus_queue.cc:1048] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:26:18.925570 10748 catalog_manager.cc:5697] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: config changed from index 8 to 9, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New cstate: current_term: 9 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:18.947641 10895 leader_election.cc:304] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:26:18.948621 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 52643.8us
I20260709 12:26:18.951864 15077 raft_consensus.cc:2749] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:18.955018 11620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6a1da21304fcfacab384a6afc4101" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:18.946661 14975 leader_election.cc:290] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:18.981185 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:18.982366 10996 raft_consensus.cc:2468] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 4.
I20260709 12:26:18.988485 11001 raft_consensus.cc:1275] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:26:19.007345 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 150149us
I20260709 12:26:18.951999 15120 consensus_queue.cc:1048] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 12:26:19.015709 10895 leader_election.cc:304] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:19.022262 15072 raft_consensus.cc:2749] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:19.022063 15022 consensus_queue.cc:1048] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:26:19.041623 10895 leader_election.cc:304] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:19.049908 15053 raft_consensus.cc:2804] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:19.050458 15053 raft_consensus.cc:493] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:19.050868 15053 raft_consensus.cc:3060] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:19.053845 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:19.054102 14962 consensus_queue.cc:1048] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:19.058208 15101 consensus_queue.cc:1048] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 12:26:18.863543 10752 rpcz_store.cc:276] 0709 12:26:17.561487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:17.561835 (+   348us) service_pool.cc:224] Handling call
0709 12:26:18.862599 (+1300764us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:18.338104 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:18.346775 (+  8671us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:18.346823 (+    48us) write_op.cc:435] Acquired schema lock
0709 12:26:18.346845 (+    22us) tablet.cc:662] Decoding operations
0709 12:26:18.347221 (+   376us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:18.347301 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:18.347335 (+    34us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:26:18.347522 (+   187us) tablet.cc:701] Row locks acquired
0709 12:26:18.347545 (+    23us) write_op.cc:260] PREPARE: finished
0709 12:26:18.347753 (+   208us) write_op.cc:270] Start()
0709 12:26:18.347882 (+   129us) write_op.cc:276] Timestamp: P: 1783599978347690 usec, L: 0
0709 12:26:18.347905 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:26:18.348729 (+   824us) log.cc:844] Serialized 595 byte log entry
0709 12:26:18.390434 (+ 41705us) op_driver.cc:464] REPLICATION: finished
0709 12:26:18.391869 (+  1435us) write_op.cc:301] APPLY: starting
0709 12:26:18.391936 (+    67us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:18.506054 (+114118us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:18.506263 (+   209us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:18.612058 (+105795us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:18.612596 (+   538us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 12:26:18.612685 (+    89us) write_op.cc:312] APPLY: finished
0709 12:26:18.613313 (+   628us) log.cc:844] Serialized 25 byte log entry
0709 12:26:18.613787 (+   474us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:18.613995 (+   208us) write_op.cc:454] Released schema lock
0709 12:26:18.614078 (+    83us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:18.654301 (+ 40223us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:18.654336 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":170482,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":1208,"apply.run_cpu_time_us":43119,"apply.run_wall_time_us":262234,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8307,"num_ops":1,"prepare.queue_time_us":528399,"prepare.run_cpu_time_us":32807,"prepare.run_wall_time_us":56658,"raft.queue_time_us":4104,"raft.run_cpu_time_us":1446,"raft.run_wall_time_us":1446,"replication_time_us":42377,"thread_start_us":676793,"threads_started":4,"wal-append.queue_time_us":34912}]]}
W20260709 12:26:19.071660 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 60484us
W20260709 12:26:19.077020 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 58750.2us
I20260709 12:26:19.103610 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:19.104351 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:26:19.144243 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 62595.1us
W20260709 12:26:19.152400 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 49898us
I20260709 12:26:19.190237 10854 raft_consensus.cc:1275] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:26:19.199072 10969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:19.196329 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:19.216077 15037 consensus_queue.cc:1048] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 12:26:19.241834 11588 leader_election.cc:304] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:19.284756 15130 raft_consensus.cc:2749] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:26:19.293768 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 46273us
I20260709 12:26:19.417820 15053 raft_consensus.cc:515] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:26:19.420531 10922 raft_consensus.cc:2393] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 5: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:26:19.421175 15053 leader_election.cc:290] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:26:19.427417 15135 log.cc:927] Time spent T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.240s	user 0.002s	sys 0.000s
I20260709 12:26:19.440152 15051 raft_consensus.cc:2955] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 5 to 6, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:19.474035 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
W20260709 12:26:19.490803 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 128294us
W20260709 12:26:19.493335 15132 log.cc:927] Time spent T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.305s	user 0.003s	sys 0.000s
I20260709 12:26:19.495245 11002 raft_consensus.cc:2955] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:20.408344 15150 raft_consensus.cc:493] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:20.411644 15150 raft_consensus.cc:515] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:20.416008 15150 leader_election.cc:290] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:20.446046 15153 raft_consensus.cc:493] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:20.446429 15151 raft_consensus.cc:493] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:20.446846 15153 raft_consensus.cc:515] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:20.444651 15051 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.941s	user 0.025s	sys 0.026s
W20260709 12:26:20.451661 15051 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.948s	user 0.026s	sys 0.026s
I20260709 12:26:20.449846 15153 leader_election.cc:290] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:20.447021 15151 raft_consensus.cc:515] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:20.465977 15151 leader_election.cc:290] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:20.467932 10922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59622 (request call id 2999) took 1415 ms. Trace:
I20260709 12:26:20.501513 10922 rpcz_store.cc:276] 0709 12:26:19.052531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:19.053407 (+   876us) service_pool.cc:224] Handling call
0709 12:26:20.467488 (+1414081us) spinlock_profiling.cc:243] Waited 366 ms on lock 0x7b5400205dd4. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e8c2fa 00007f7599e4db17 00007f75933c86d4 00007f75933c8662 00007f75933c8591 00007f75933c850c 00007f75933c77c2 00007f75931c348c 00007f75931c28c6 00007f75931c226f
0709 12:26:20.467812 (+   324us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":840923520}
I20260709 12:26:20.469223 15155 raft_consensus.cc:493] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:20.503412 15155 raft_consensus.cc:515] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:20.506703 15155 leader_election.cc:290] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:20.489415 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:20.507501 10995 raft_consensus.cc:2468] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 7.
W20260709 12:26:20.491051 11002 consensus_meta.cc:287] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08: Time spent flushing consensus metadata: real 0.987s	user 0.017s	sys 0.003s
I20260709 12:26:20.500449 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:20.520740 15138 raft_consensus.cc:493] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:20.521523 15138 raft_consensus.cc:515] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:20.524474 15138 leader_election.cc:290] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:20.525103 10921 raft_consensus.cc:1240] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:26:20.525573 11002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37512 (request call id 3335) took 1047 ms. Trace:
I20260709 12:26:20.526065 11002 rpcz_store.cc:276] 0709 12:26:19.477885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:19.494542 (+ 16657us) service_pool.cc:224] Handling call
0709 12:26:19.494889 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:19.495114 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:26:20.512522 (+1017408us) log.cc:844] Serialized 14 byte log entry
0709 12:26:20.525139 (+ 12617us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:20.525190 (+    51us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:26:20.525245 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:20.525310 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:20.525486 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":366,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":140,"thread_start_us":12280,"threads_started":1}
I20260709 12:26:20.629812 10820 leader_election.cc:304] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:20.647790 15146 raft_consensus.cc:493] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:20.634366 15041 raft_consensus.cc:493] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:20.635807 15075 raft_consensus.cc:493] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:20.649682 15041 raft_consensus.cc:515] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:20.653030 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b17195a94142039c40f598ed006c94" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:20.653400 15041 leader_election.cc:290] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:20.650477 15075 raft_consensus.cc:515] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } }
I20260709 12:26:20.648826 15146 raft_consensus.cc:515] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:20.631538 15064 raft_consensus.cc:493] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:20.656399 15064 raft_consensus.cc:515] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:20.657465 15075 leader_election.cc:290] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265)
I20260709 12:26:20.657984 15146 leader_election.cc:290] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:20.658819 15064 leader_election.cc:290] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:20.643776 15062 raft_consensus.cc:493] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:20.659610 15146 raft_consensus.cc:493] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
W20260709 12:26:20.658780 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 124984us
I20260709 12:26:20.630726 15024 raft_consensus.cc:493] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:20.527465 10921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59626 (request call id 3420) took 1421 ms. Trace:
I20260709 12:26:20.660218 15041 raft_consensus.cc:2804] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:26:20.671315 15041 raft_consensus.cc:493] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:20.671830 15041 raft_consensus.cc:3060] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:20.677951 15077 raft_consensus.cc:493] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:20.658075 15075 raft_consensus.cc:493] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:20.664258 10921 rpcz_store.cc:276] 0709 12:26:19.106337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:19.106594 (+   257us) service_pool.cc:224] Handling call
0709 12:26:20.524622 (+1418028us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:20.525573 (+   951us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:20.527224 (+  1651us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b5400205dd0. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e878ad 00007f7599e4c419 00007f75933c3bd4 00007f75933c3b62 00007f75933c3a91 00007f75933c3a0c 00007f75933c2cc2 00007f75931c348c 00007f75931c28c6 00007f75931c226f
0709 12:26:20.527371 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3259824896}
I20260709 12:26:20.668833 15057 raft_consensus.cc:493] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:20.670122 10748 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60736 (request call id 384) took 2728 ms. Trace:
I20260709 12:26:20.669907 15024 raft_consensus.cc:515] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:20.670763 15155 raft_consensus.cc:493] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:20.678454 11003 consensus_queue.cc:237] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:20.527920 10968 leader_election.cc:304] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:20.678712 15077 raft_consensus.cc:515] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:20.695075 15057 raft_consensus.cc:515] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:20.625681 15138 raft_consensus.cc:493] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:20.702090 15138 raft_consensus.cc:515] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:20.702698 15057 leader_election.cc:290] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:20.661281 15062 raft_consensus.cc:515] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:20.704640 15138 leader_election.cc:290] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:20.706336 15062 leader_election.cc:290] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:20.708154 15151 raft_consensus.cc:493] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:20.708899 15151 raft_consensus.cc:515] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:20.708907 14954 raft_consensus.cc:493] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:20.709928 14954 raft_consensus.cc:515] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:20.711549 15151 leader_election.cc:290] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:20.707387 15101 raft_consensus.cc:493] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:20.715504 14954 leader_election.cc:290] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
W20260709 12:26:20.718222 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 190401us
I20260709 12:26:20.528285 15107 raft_consensus.cc:493] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:20.665720 15064 raft_consensus.cc:493] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:20.717330 15155 raft_consensus.cc:515] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:20.720510 15024 leader_election.cc:290] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:20.702769 15077 leader_election.cc:290] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:20.629835 15157 raft_consensus.cc:493] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:20.744350 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:20.717793 15050 raft_consensus.cc:3060] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:20.746397 11620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:20.717114 10751 catalog_manager.cc:5697] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: config changed from index 4 to 5, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:20.691735 15146 raft_consensus.cc:515] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:20.824476 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:20.691969 10748 rpcz_store.cc:276] 0709 12:26:17.941509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:17.941821 (+   312us) service_pool.cc:224] Handling call
0709 12:26:20.670037 (+2728216us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:19.096245 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:19.096989 (+   744us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:19.097045 (+    56us) write_op.cc:435] Acquired schema lock
0709 12:26:19.097064 (+    19us) tablet.cc:662] Decoding operations
0709 12:26:19.097541 (+   477us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:19.097655 (+   114us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:19.097689 (+    34us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:26:19.098021 (+   332us) tablet.cc:701] Row locks acquired
0709 12:26:19.098078 (+    57us) write_op.cc:260] PREPARE: finished
0709 12:26:19.098319 (+   241us) write_op.cc:270] Start()
0709 12:26:19.098529 (+   210us) write_op.cc:276] Timestamp: P: 1783599979098217 usec, L: 0
0709 12:26:19.098561 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 12:26:19.099494 (+   933us) log.cc:844] Serialized 595 byte log entry
0709 12:26:19.196249 (+ 96755us) op_driver.cc:464] REPLICATION: finished
0709 12:26:19.345343 (+149094us) write_op.cc:301] APPLY: starting
0709 12:26:19.345633 (+   290us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:19.347220 (+  1587us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:19.347387 (+   167us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:19.379415 (+ 32028us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:19.379664 (+   249us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 12:26:19.379712 (+    48us) write_op.cc:312] APPLY: finished
0709 12:26:19.379941 (+   229us) log.cc:844] Serialized 25 byte log entry
0709 12:26:19.380123 (+   182us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:19.380207 (+    84us) write_op.cc:454] Released schema lock
0709 12:26:19.380248 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:19.380682 (+   434us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:19.380714 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":41350,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":146363,"apply.run_cpu_time_us":4493,"apply.run_wall_time_us":35320,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8307,"num_ops":1,"prepare.queue_time_us":133375,"prepare.run_cpu_time_us":3842,"prepare.run_wall_time_us":50579,"replication_time_us":87274,"thread_start_us":144768,"threads_started":2}]]}
I20260709 12:26:20.693138 15075 raft_consensus.cc:515] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:20.871737 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 124528us
I20260709 12:26:20.753764 15062 raft_consensus.cc:493] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:20.878255 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:20.850984 15155 leader_election.cc:290] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:20.852216 15057 raft_consensus.cc:493] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:20.877934 15077 raft_consensus.cc:493] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:20.877241 14954 raft_consensus.cc:493] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:20.756690 15064 raft_consensus.cc:515] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:20.717339 15101 raft_consensus.cc:515] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:20.883128 15151 raft_consensus.cc:493] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:20.887465 15024 raft_consensus.cc:493] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:20.908593 15150 raft_consensus.cc:493] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:21.018968 10854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56394 (request call id 3898) took 1392 ms. Trace:
I20260709 12:26:20.824433 15157 raft_consensus.cc:515] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:20.913429 15031 raft_consensus.cc:493] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:20.755916 15107 raft_consensus.cc:515] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:21.032368 10854 rpcz_store.cc:276] 0709 12:26:19.530232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:19.530561 (+   329us) service_pool.cc:224] Handling call
0709 12:26:19.530862 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:19.531032 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:26:20.722086 (+1191054us) log.cc:844] Serialized 14 byte log entry
0709 12:26:20.917655 (+195569us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:20.917711 (+    56us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:26:20.917756 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:20.917840 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:20.917975 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29215,"prepare.queue_time_us":1191832,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"thread_start_us":162979,"threads_started":1}
W20260709 12:26:21.034157 10783 debug-util.cc:398] Leaking SignalData structure 0x7b08002c2b20 after lost signal to thread 9684
W20260709 12:26:21.076315 10783 debug-util.cc:398] Leaking SignalData structure 0x7b08002e7880 after lost signal to thread 10786
I20260709 12:26:20.968032 15051 raft_consensus.cc:493] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:21.034473 14954 raft_consensus.cc:515] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:20.910012 15062 raft_consensus.cc:515] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:21.094188 10845 raft_consensus.cc:2468] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 9.
I20260709 12:26:20.913720 15057 raft_consensus.cc:515] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:21.107992 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:21.110510 10847 raft_consensus.cc:2468] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 10.
W20260709 12:26:21.112532 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 101810us
I20260709 12:26:21.067302 15077 raft_consensus.cc:515] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:21.108182 15154 raft_consensus.cc:493] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:21.114667 15099 raft_consensus.cc:493] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:21.115509 15162 raft_consensus.cc:493] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:21.064616 15024 raft_consensus.cc:515] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:21.067421 15150 raft_consensus.cc:515] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:21.104616 15155 raft_consensus.cc:493] T 4ef3220c51df47db8859f07ab745fad5 P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
W20260709 12:26:21.118482 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 240600us
I20260709 12:26:21.072651 15151 raft_consensus.cc:515] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:21.088322 15031 raft_consensus.cc:515] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:21.106989 15051 raft_consensus.cc:515] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:21.181424 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 424839us
W20260709 12:26:21.186666 10968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:21.155249 14954 leader_election.cc:290] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:21.173512 15130 raft_consensus.cc:493] T 435d66c6d38c4d8a90a81975a6a0cb13 P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:21.154438 15154 raft_consensus.cc:515] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:21.180723 15153 raft_consensus.cc:493] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
W20260709 12:26:21.228521 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 202465us
I20260709 12:26:21.297441 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:21.214669 14954 raft_consensus.cc:493] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:21.175048 15155 raft_consensus.cc:515] T 4ef3220c51df47db8859f07ab745fad5 P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:21.297187 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b17195a94142039c40f598ed006c94" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:21.173300 15099 raft_consensus.cc:515] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:21.183355 15162 raft_consensus.cc:515] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:21.357398 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac83709373b4efd9c3aa1472a9f9022" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:21.315495 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:21.316102 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:21.314648 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fd8fdac2fa449e9e184f3d668ea1a7" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:21.308908 15024 leader_election.cc:290] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:21.301214 15146 leader_election.cc:290] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:21.453226 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:21.455788 15128 raft_consensus.cc:493] T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:21.457767 15155 leader_election.cc:290] T 4ef3220c51df47db8859f07ab745fad5 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:21.458421 15047 raft_consensus.cc:493] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:21.460915 15179 raft_consensus.cc:493] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:21.462191 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:26:21.464300 10783 debug-util.cc:398] Leaking SignalData structure 0x7b08002fa820 after lost signal to thread 10878
W20260709 12:26:21.497444 10783 debug-util.cc:398] Leaking SignalData structure 0x7b080030bf40 after lost signal to thread 10879
I20260709 12:26:21.466328 15181 raft_consensus.cc:493] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:21.505008 15101 leader_election.cc:290] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:21.505188 15181 raft_consensus.cc:515] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:21.506649 15101 raft_consensus.cc:493] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:21.467360 15167 raft_consensus.cc:493] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:21.507864 15167 raft_consensus.cc:515] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:21.508433 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352aa49c65194abbb863d7553a091f11" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:21.509961 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac83709373b4efd9c3aa1472a9f9022" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:21.510179 15031 leader_election.cc:290] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:21.510228 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:21.511047 11000 raft_consensus.cc:2468] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 9.
I20260709 12:26:21.467821 15182 raft_consensus.cc:493] T e9331e5342644ca2bae19187b083a7d5 P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:21.315745 15153 raft_consensus.cc:515] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:21.511868 15182 raft_consensus.cc:515] T e9331e5342644ca2bae19187b083a7d5 P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:21.512383 15041 consensus_meta.cc:287] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040: Time spent flushing consensus metadata: real 0.840s	user 0.014s	sys 0.000s
I20260709 12:26:21.512811 11003 raft_consensus.cc:2468] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 9.
I20260709 12:26:21.513301 15153 leader_election.cc:290] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:21.513959 15177 raft_consensus.cc:493] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:21.514142 15182 leader_election.cc:290] T e9331e5342644ca2bae19187b083a7d5 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:21.468922 15077 leader_election.cc:290] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:21.312721 15062 leader_election.cc:290] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:21.514565 15177 raft_consensus.cc:515] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:21.515234 15192 raft_consensus.cc:493] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:21.515705 15180 raft_consensus.cc:493] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:21.515908 15192 raft_consensus.cc:515] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:21.516312 15180 raft_consensus.cc:515] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:21.517278 15177 leader_election.cc:290] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:21.519047 15192 leader_election.cc:290] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:21.519655 15184 raft_consensus.cc:493] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:21.520411 15184 raft_consensus.cc:515] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:21.521345 10783 debug-util.cc:398] Leaking SignalData structure 0x7b08000354e0 after lost signal to thread 10953
W20260709 12:26:21.521750 10783 debug-util.cc:398] Leaking SignalData structure 0x7b08000354c0 after lost signal to thread 10954
I20260709 12:26:21.522900 15183 raft_consensus.cc:493] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:21.487480 15146 raft_consensus.cc:493] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:21.372206 15022 raft_consensus.cc:493] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:21.524019 15181 leader_election.cc:290] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:21.524296 15170 raft_consensus.cc:493] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:21.519066 15180 leader_election.cc:290] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:21.524513 15022 raft_consensus.cc:515] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:21.524955 15170 raft_consensus.cc:515] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:21.374344 15064 leader_election.cc:290] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:21.352924 15168 raft_consensus.cc:493] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:21.528218 15168 raft_consensus.cc:515] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:21.530249 15162 leader_election.cc:290] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:21.353080 15169 raft_consensus.cc:493] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:21.530813 15168 leader_election.cc:290] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:21.379981 15072 raft_consensus.cc:493] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:21.531112 15169 raft_consensus.cc:515] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:21.329816 15160 raft_consensus.cc:493] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:21.353413 15158 raft_consensus.cc:493] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:21.329560 15163 raft_consensus.cc:493] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:21.399353 15075 leader_election.cc:290] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:21.336330 15159 raft_consensus.cc:493] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:21.373946 15161 raft_consensus.cc:493] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:21.356874 15073 raft_consensus.cc:493] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:21.501015 15089 raft_consensus.cc:493] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:21.502327 15154 leader_election.cc:290] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:21.502698 15059 raft_consensus.cc:493] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:21.487043 15128 raft_consensus.cc:515] T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:21.504014 15050 consensus_meta.cc:287] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08: Time spent flushing consensus metadata: real 0.670s	user 0.008s	sys 0.004s
I20260709 12:26:21.503822 15047 raft_consensus.cc:515] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:21.523141 10783 debug-util.cc:398] Leaking SignalData structure 0x7b080034e060 after lost signal to thread 11027
W20260709 12:26:21.565164 10783 debug-util.cc:398] Leaking SignalData structure 0x7b08003657e0 after lost signal to thread 11028
I20260709 12:26:21.295877 15130 raft_consensus.cc:515] T 435d66c6d38c4d8a90a81975a6a0cb13 P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:21.397269 15082 raft_consensus.cc:493] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
W20260709 12:26:21.479065 10969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:21.531661 15072 raft_consensus.cc:515] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:21.535669 15077 raft_consensus.cc:493] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:21.536916 15169 leader_election.cc:290] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:21.538198 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:21.467849 15057 leader_election.cc:290] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:26:21.543406 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 271398us
I20260709 12:26:21.354920 14954 raft_consensus.cc:515] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:21.594884 15177 raft_consensus.cc:493] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:21.595855 15177 raft_consensus.cc:515] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:21.527346 15022 leader_election.cc:290] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:21.597407 14954 leader_election.cc:290] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:21.597805 15022 raft_consensus.cc:493] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:21.598260 15177 leader_election.cc:290] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:21.598999 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9331e5342644ca2bae19187b083a7d5" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:21.598928 15022 raft_consensus.cc:515] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:21.599715 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:21.600502 15152 raft_consensus.cc:493] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:21.519414 15157 leader_election.cc:290] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:21.482795 15107 leader_election.cc:290] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:21.594969 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef3220c51df47db8859f07ab745fad5" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:26:21.566475 10783 debug-util.cc:398] Leaking SignalData structure 0x7b080036f2c0 after lost signal to thread 11648
I20260709 12:26:21.571133 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:21.573537 15099 leader_election.cc:290] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:21.580791 15150 leader_election.cc:290] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:21.523942 15183 raft_consensus.cc:515] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:21.522914 15184 leader_election.cc:290] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:21.542279 15170 leader_election.cc:290] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:21.592451 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef3220c51df47db8859f07ab745fad5" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:21.593081 15188 raft_consensus.cc:493] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:21.622471 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:21.594411 15153 raft_consensus.cc:493] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:21.512936 15041 raft_consensus.cc:515] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:21.556444 14962 raft_consensus.cc:493] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
W20260709 12:26:21.606858 10783 debug-util.cc:398] Leaking SignalData structure 0x7b0800351180 after lost signal to thread 11649
I20260709 12:26:21.507304 15101 raft_consensus.cc:515] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:21.583369 15089 raft_consensus.cc:515] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:21.562036 15073 raft_consensus.cc:515] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:21.613402 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab816bcc6183447994a2cc013e46c5f8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:21.614537 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:21.611066 15174 raft_consensus.cc:493] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:21.616010 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:21.568913 15053 raft_consensus.cc:493] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:21.568589 15050 raft_consensus.cc:2749] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:21.608140 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:26:21.618837 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 103981us
I20260709 12:26:21.619661 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:21.619928 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:21.562147 15161 raft_consensus.cc:515] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:21.619437 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef3220c51df47db8859f07ab745fad5" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:21.824517 10928 raft_consensus.cc:2468] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 5.
I20260709 12:26:21.598160 14954 raft_consensus.cc:493] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:21.633708 15051 leader_election.cc:290] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:21.827966 14954 raft_consensus.cc:515] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:21.636874 15167 leader_election.cc:290] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:21.587114 10925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "69fd8fdac2fa449e9e184f3d668ea1a7"
dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
mode: GRACEFUL
new_leader_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:41546
I20260709 12:26:21.601173 15152 raft_consensus.cc:515] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:21.829993 10925 raft_consensus.cc:606] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Received request to transfer leadership to TS 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:21.830536 14954 leader_election.cc:290] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:21.601805 15022 leader_election.cc:290] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:21.642235 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:21.637518 15195 raft_consensus.cc:493] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:21.836246 15195 raft_consensus.cc:515] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:21.839071 15195 leader_election.cc:290] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:21.608151 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:21.617643 15107 raft_consensus.cc:493] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
W20260709 12:26:21.849133 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 200844us
W20260709 12:26:21.650483 10783 debug-util.cc:398] Leaking SignalData structure 0x7b08003579a0 after lost signal to thread 15131
I20260709 12:26:21.611974 15162 raft_consensus.cc:493] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:21.523967 15146 raft_consensus.cc:515] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:21.651903 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:21.671949 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63ecfc9bd3945818cfe15c03f001315" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:21.568821 15059 raft_consensus.cc:515] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:21.698189 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef3220c51df47db8859f07ab745fad5" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:21.543018 15160 raft_consensus.cc:515] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:21.603379 15077 raft_consensus.cc:515] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:21.892444 15107 raft_consensus.cc:515] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:21.961239 10969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 59904.5us
I20260709 12:26:21.542686 15158 raft_consensus.cc:515] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:21.568996 15179 raft_consensus.cc:515] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:21.566536 15159 raft_consensus.cc:515] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:21.710273 15151 leader_election.cc:290] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:21.785718 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5794ba618e514e28a7542ab6af39d8c9" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:21.706346 15176 raft_consensus.cc:493] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:21.707124 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:21.646149 15188 raft_consensus.cc:515] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:21.786816 15062 raft_consensus.cc:493] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:21.788281 15041 leader_election.cc:290] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:21.789073 11619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:21.790288 11617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18294423a68a4671bf6c5a0f98645e4c" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:21.565912 15163 raft_consensus.cc:515] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:21.791603 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d9a61ecaf84695b70f8519ee57706f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:21.794399 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:21.610746 15082 raft_consensus.cc:515] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:21.822374 10968 leader_election.cc:304] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
W20260709 12:26:21.844988 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 52199.7us
I20260709 12:26:21.966678 15130 leader_election.cc:290] T 435d66c6d38c4d8a90a81975a6a0cb13 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:21.848573 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:21.647416 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:21.997500 11003 raft_consensus.cc:2468] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 8.
W20260709 12:26:21.879313 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 230579us
I20260709 12:26:21.885372 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:21.698434 15153 raft_consensus.cc:515] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:21.901981 10994 raft_consensus.cc:1240] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:21.904053 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:21.832343 15152 leader_election.cc:290] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:21.940445 15171 raft_consensus.cc:493] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:21.941445 15128 leader_election.cc:290] T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:21.942288 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:21.615594 15024 consensus_queue.cc:1059] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:26:21.674938 14962 raft_consensus.cc:515] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:21.958813 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 64477us
I20260709 12:26:21.959290 11618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:22.021519 15047 leader_election.cc:290] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:22.021963 11618 raft_consensus.cc:2468] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 3.
I20260709 12:26:21.850417 15053 raft_consensus.cc:515] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:21.987978 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:21.846765 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:21.892783 15174 raft_consensus.cc:515] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:21.991767 15077 leader_election.cc:290] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:21.991315 15062 raft_consensus.cc:515] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:22.000104 11623 raft_consensus.cc:1275] T 4ef3220c51df47db8859f07ab745fad5 P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:26:21.958885 15160 leader_election.cc:290] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:21.998692 10996 raft_consensus.cc:2468] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 6.
I20260709 12:26:22.006006 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18294423a68a4671bf6c5a0f98645e4c" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:26:22.003228 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 180950us
I20260709 12:26:22.006229 11615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d9a61ecaf84695b70f8519ee57706f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:22.006006 15207 raft_consensus.cc:2804] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:22.018908 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef3220c51df47db8859f07ab745fad5" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:21.984130 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:21.963065 15162 raft_consensus.cc:515] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:21.982589 15176 raft_consensus.cc:515] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:22.255731 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 226272us
W20260709 12:26:22.078933 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 51155.2us
I20260709 12:26:22.026046 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fd8fdac2fa449e9e184f3d668ea1a7" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:22.751768 10751 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60734 (request call id 359) took 4500 ms. Trace:
I20260709 12:26:22.888761 10819 leader_election.cc:304] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:22.078327 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:22.175874 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:22.734567 10752 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36188 (request call id 225) took 3639 ms. Trace:
I20260709 12:26:22.893501 10752 rpcz_store.cc:276] 0709 12:26:19.095077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:19.095557 (+   480us) service_pool.cc:224] Handling call
0709 12:26:22.734457 (+3638900us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1179,"reported_tablets":3}
I20260709 12:26:22.089213 11621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:22.116367 10969 leader_election.cc:304] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:22.908123 11621 raft_consensus.cc:2468] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 4.
I20260709 12:26:22.910284 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef3220c51df47db8859f07ab745fad5" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:22.910496 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:22.911113 10929 raft_consensus.cc:2468] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 5.
I20260709 12:26:22.914914 10995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37500 (request call id 3805) took 1124 ms. Trace:
I20260709 12:26:22.894670 15207 raft_consensus.cc:493] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:22.912026 15174 leader_election.cc:290] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:22.915544 10929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50036 (request call id 817) took 1080 ms. Trace:
I20260709 12:26:22.913208 11621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45904 (request call id 860) took 1067 ms. Trace:
I20260709 12:26:22.916417 10996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37500 (request call id 3810) took 1095 ms. Trace:
I20260709 12:26:22.912314 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:22.915676 11000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37500 (request call id 3804) took 1097 ms. Trace:
I20260709 12:26:22.913661 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:22.074867 11620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:22.002388 15158 leader_election.cc:290] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:22.893107 10926 raft_consensus.cc:2468] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 8.
I20260709 12:26:23.048513 10926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50036 (request call id 824) took 1120 ms. Trace:
I20260709 12:26:22.917320 10922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50036 (request call id 819) took 1052 ms. Trace:
I20260709 12:26:22.915325 10995 rpcz_store.cc:276] 0709 12:26:21.790014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:22.914068 (+1124054us) service_pool.cc:224] Handling call
0709 12:26:22.914422 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:22.914611 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:22.914635 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:22.914675 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:26:22.914711 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:22.914758 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:22.914859 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:22.751098 10750 catalog_manager.cc:5697] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 8 to 9, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 9 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:22.916656 11621 rpcz_store.cc:276] 0709 12:26:21.841564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:21.850580 (+  9016us) service_pool.cc:224] Handling call
0709 12:26:22.908817 (+1058237us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:26:23.008164 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 119472us
I20260709 12:26:23.042310 11000 rpcz_store.cc:276] 0709 12:26:21.789689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:21.983806 (+194117us) service_pool.cc:224] Handling call
0709 12:26:22.887282 (+903476us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:23.009346 10968 leader_election.cc:304] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:23.045562 11001 raft_consensus.cc:2468] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 4.
I20260709 12:26:22.920157 10929 rpcz_store.cc:276] 0709 12:26:21.835004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:22.914654 (+1079650us) service_pool.cc:224] Handling call
0709 12:26:22.914997 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:22.915229 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:22.915259 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:22.915307 (+    48us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:26:22.915352 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:22.915401 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:22.915491 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:22.002671 15107 leader_election.cc:290] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:23.049000 10926 rpcz_store.cc:276] 0709 12:26:21.928499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:22.131146 (+202647us) service_pool.cc:224] Handling call
0709 12:26:23.048420 (+917274us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:26:23.056762 10969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 993694us
I20260709 12:26:22.918974 10999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37500 (request call id 3807) took 1099 ms. Trace:
I20260709 12:26:23.046955 10921 raft_consensus.cc:2468] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 8.
I20260709 12:26:23.042066 10996 rpcz_store.cc:276] 0709 12:26:21.794191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:21.885066 (+ 90875us) service_pool.cc:224] Handling call
0709 12:26:22.887086 (+1002020us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:23.041486 10924 raft_consensus.cc:2468] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 3.
I20260709 12:26:23.049669 10922 rpcz_store.cc:276] 0709 12:26:21.837242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:21.846372 (+  9130us) service_pool.cc:224] Handling call
0709 12:26:22.889356 (+1042984us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:23.061084 10999 rpcz_store.cc:276] 0709 12:26:21.790654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:21.967200 (+176546us) service_pool.cc:224] Handling call
0709 12:26:22.890095 (+922895us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:22.897133 15082 leader_election.cc:290] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:22.548949 14962 leader_election.cc:290] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:22.545482 15188 leader_election.cc:290] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:22.443727 15146 leader_election.cc:290] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:23.061499 11620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45904 (request call id 865) took 1046 ms. Trace:
I20260709 12:26:23.039955 15160 raft_consensus.cc:493] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:23.047601 11618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45904 (request call id 861) took 1031 ms. Trace:
I20260709 12:26:22.022441 15161 leader_election.cc:290] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:22.157150 15183 leader_election.cc:290] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:22.820050 15196 raft_consensus.cc:493] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:22.407687 15128 raft_consensus.cc:493] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:22.770977 15153 leader_election.cc:290] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:22.830554 15200 raft_consensus.cc:493] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:22.254896 15181 raft_consensus.cc:493] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:22.174678 15072 leader_election.cc:290] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:23.067682 10922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50036 (request call id 821) took 1228 ms. Trace:
I20260709 12:26:23.151976 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aed74af73a488f8b691578ca370226" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:23.152207 10922 rpcz_store.cc:276] 0709 12:26:21.839838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:23.066809 (+1226971us) service_pool.cc:224] Handling call
0709 12:26:23.067132 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:23.067322 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:23.067354 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:23.067396 (+    42us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:26:23.067431 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:23.067485 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:23.067623 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:23.067239 10923 raft_consensus.cc:2468] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 5.
I20260709 12:26:23.070103 11617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:22.155418 15203 raft_consensus.cc:493] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:22.961838 15207 raft_consensus.cc:3060] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:22.090524 15073 leader_election.cc:290] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:23.047101 15151 raft_consensus.cc:2749] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:22.274650 15179 leader_election.cc:290] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:23.078950 11621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aed74af73a488f8b691578ca370226" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:22.403908 15101 leader_election.cc:290] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:23.081674 10924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50036 (request call id 822) took 1234 ms. Trace:
I20260709 12:26:22.896636 15059 leader_election.cc:290] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:26:23.085108 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 184290us
I20260709 12:26:23.181548 10924 rpcz_store.cc:276] 0709 12:26:21.847638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:23.066607 (+1218969us) service_pool.cc:224] Handling call
0709 12:26:23.080887 (+ 14280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:23.081079 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:23.081115 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:23.081158 (+    43us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:26:23.081296 (+   138us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:23.081408 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:23.081595 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:23.073583 11620 rpcz_store.cc:276] 0709 12:26:22.014968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:22.074541 (+ 59573us) service_pool.cc:224] Handling call
0709 12:26:23.061391 (+986850us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:23.085041 10926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50036 (request call id 820) took 1246 ms. Trace:
I20260709 12:26:23.295149 10926 rpcz_store.cc:276] 0709 12:26:21.838581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:23.067777 (+1229196us) service_pool.cc:224] Handling call
0709 12:26:23.084446 (+ 16669us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:23.084657 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:23.084681 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:23.084728 (+    47us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:26:23.084791 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:23.084860 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:23.084983 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:22.025039 15171 raft_consensus.cc:515] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:22.890534 10751 rpcz_store.cc:276] 0709 12:26:18.251713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:18.252184 (+   471us) service_pool.cc:224] Handling call
0709 12:26:22.751634 (+4499450us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:21.222209 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:21.467724 (+245515us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:21.467768 (+    44us) write_op.cc:435] Acquired schema lock
0709 12:26:21.467791 (+    23us) tablet.cc:662] Decoding operations
0709 12:26:21.468190 (+   399us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:21.468253 (+    63us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:21.468281 (+    28us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:26:21.468467 (+   186us) tablet.cc:701] Row locks acquired
0709 12:26:21.468479 (+    12us) write_op.cc:260] PREPARE: finished
0709 12:26:21.468638 (+   159us) write_op.cc:270] Start()
0709 12:26:21.468746 (+   108us) write_op.cc:276] Timestamp: P: 1783599981468591 usec, L: 0
0709 12:26:21.468761 (+    15us) op_driver.cc:348] REPLICATION: starting
0709 12:26:21.469473 (+   712us) log.cc:844] Serialized 595 byte log entry
0709 12:26:21.835059 (+365586us) op_driver.cc:464] REPLICATION: finished
0709 12:26:21.959847 (+124788us) write_op.cc:301] APPLY: starting
0709 12:26:21.960047 (+   200us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:22.012035 (+ 51988us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:22.078555 (+ 66520us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:22.330191 (+251636us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:22.403696 (+ 73505us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 12:26:22.430936 (+ 27240us) write_op.cc:312] APPLY: finished
0709 12:26:22.566276 (+135340us) log.cc:844] Serialized 25 byte log entry
0709 12:26:22.583378 (+ 17102us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:22.602620 (+ 19242us) write_op.cc:454] Released schema lock
0709 12:26:22.634101 (+ 31481us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:22.778783 (+144682us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:22.794276 (+ 15493us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":25856,"reported_tablets":2,"spinlock_wait_cycles":350976,"child_traces":[["op",{"apply.queue_time_us":124453,"apply.run_cpu_time_us":8469,"apply.run_wall_time_us":751508,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8307,"num_ops":1,"prepare.queue_time_us":160310,"prepare.run_cpu_time_us":11155,"prepare.run_wall_time_us":352119,"raft.queue_time_us":44181,"raft.run_cpu_time_us":9181,"raft.run_wall_time_us":61249,"replication_time_us":366118,"thread_start_us":299330,"threads_started":4,"wal-append.queue_time_us":319043}]]}
I20260709 12:26:23.091383 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:23.068801 11615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45920 (request call id 742) took 1090 ms. Trace:
I20260709 12:26:23.104507 11003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37500 (request call id 3802) took 1451 ms. Trace:
I20260709 12:26:23.303886 11003 rpcz_store.cc:276] 0709 12:26:21.652749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:23.101665 (+1448916us) service_pool.cc:224] Handling call
0709 12:26:23.103914 (+  2249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:23.104132 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:23.104159 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:23.104205 (+    46us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:26:23.104250 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:23.104310 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:23.104423 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:23.305444 10928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50036 (request call id 826) took 1328 ms. Trace:
I20260709 12:26:23.115869 11002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37500 (request call id 3801) took 1474 ms. Trace:
I20260709 12:26:23.306773 11002 rpcz_store.cc:276] 0709 12:26:21.641646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:22.919767 (+1278121us) service_pool.cc:224] Handling call
0709 12:26:22.975388 (+ 55621us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:23.063216 (+ 87828us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:23.063245 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:23.063291 (+    46us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:26:23.063335 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:23.115553 (+ 52218us) spinlock_profiling.cc:243] Waited 87.6 ms on lock 0x7b54003052d4. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e88e01 00007f7594e8783e 00007f7599e4c419 00007f75933c3bd4 00007f75933c3b62 00007f75933c3a91 00007f75933c3a0c 00007f75933c2cc2 00007f75931c348c 00007f75931c28c6
0709 12:26:23.115633 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:23.115785 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":201393536}
I20260709 12:26:23.103179 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:23.087670 15183 raft_consensus.cc:493] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:23.140344 15163 leader_election.cc:290] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:23.143996 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad766f48812a4ddeb383179b1d84907b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:23.309361 11000 raft_consensus.cc:2468] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 3.
I20260709 12:26:23.144845 15176 leader_election.cc:290] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:23.145110 11616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fd8fdac2fa449e9e184f3d668ea1a7" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:23.305964 10928 rpcz_store.cc:276] 0709 12:26:21.980221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:23.082355 (+1102134us) service_pool.cc:224] Handling call
0709 12:26:23.305355 (+223000us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:23.145787 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:23.146652 14954 raft_consensus.cc:3055] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:23.147403 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:23.078004 14962 raft_consensus.cc:493] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:23.148886 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:23.153635 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:23.170557 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:23.322938 10854 raft_consensus.cc:2468] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 8.
I20260709 12:26:23.182412 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
W20260709 12:26:23.169387 10923 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59626 (request call id 3444) took 1564 ms (client timeout 1604 ms). Trace:
I20260709 12:26:23.184651 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:26:23.161216 10921 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59622 (request call id 3015) took 1510 ms (client timeout 1867 ms). Trace:
W20260709 12:26:23.324832 10921 rpcz_store.cc:269] 0709 12:26:21.650770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:21.791301 (+140531us) service_pool.cc:224] Handling call
0709 12:26:23.160918 (+1369617us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b540012a7d4. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e8c2fa 00007f7599e4db17 00007f75933c86d4 00007f75933c8662 00007f75933c8591 00007f75933c850c 00007f75933c77c2 00007f75931c348c 00007f75931c28c6 00007f75931c226f
0709 12:26:23.161125 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2425457408}
W20260709 12:26:23.323935 10923 rpcz_store.cc:269] 0709 12:26:21.604795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:21.607259 (+  2464us) service_pool.cc:224] Handling call
0709 12:26:23.169178 (+1561919us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b54002076d4. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e8c2fa 00007f7599e4db17 00007f75933c86d4 00007f75933c8662 00007f75933c8591 00007f75933c850c 00007f75933c77c2 00007f75931c348c 00007f75931c28c6 00007f75931c226f
0709 12:26:23.169326 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2858620800}
I20260709 12:26:23.322300 10995 raft_consensus.cc:2468] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 10.
I20260709 12:26:23.324000 10852 raft_consensus.cc:2468] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 11.
I20260709 12:26:23.091698 15089 leader_election.cc:290] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:23.200919 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:23.083662 11618 rpcz_store.cc:276] 0709 12:26:21.886545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:21.898112 (+ 11567us) service_pool.cc:224] Handling call
0709 12:26:22.917928 (+1019816us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:23.204460 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:23.211674 15203 raft_consensus.cc:515] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:23.086237 15160 raft_consensus.cc:515] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:23.338977 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 329778us
I20260709 12:26:23.340164 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:23.097566 15196 raft_consensus.cc:515] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:23.342010 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63ecfc9bd3945818cfe15c03f001315" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:23.258857 10927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50036 (request call id 816) took 1426 ms. Trace:
I20260709 12:26:23.260241 10925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59622 (request call id 3014) took 1622 ms. Trace:
I20260709 12:26:23.156054 15200 raft_consensus.cc:515] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:23.155287 11622 raft_consensus.cc:2955] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:23.183338 15153 raft_consensus.cc:493] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:23.103366 15214 raft_consensus.cc:493] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:23.093135 15217 raft_consensus.cc:2804] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:26:23.083110 15146 raft_consensus.cc:2749] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:23.312954 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:23.350113 10845 raft_consensus.cc:2468] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 7.
I20260709 12:26:23.310935 11616 raft_consensus.cc:2468] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 6.
I20260709 12:26:23.311923 10998 raft_consensus.cc:2468] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 9.
I20260709 12:26:23.317167 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef3220c51df47db8859f07ab745fad5" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:23.317957 15183 raft_consensus.cc:515] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:23.318651 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fd8fdac2fa449e9e184f3d668ea1a7" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:23.319660 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
W20260709 12:26:23.319923 10969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 261403us
I20260709 12:26:23.314880 10996 raft_consensus.cc:2468] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 9.
I20260709 12:26:23.328225 11620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab816bcc6183447994a2cc013e46c5f8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:23.330983 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:23.329567 15062 leader_election.cc:290] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:23.331845 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:23.329428 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9331e5342644ca2bae19187b083a7d5" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:23.332877 11619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352aa49c65194abbb863d7553a091f11" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:23.333721 11621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5794ba618e514e28a7542ab6af39d8c9" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:23.320709 15053 leader_election.cc:290] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:23.335299 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef3220c51df47db8859f07ab745fad5" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:23.303651 11615 rpcz_store.cc:276] 0709 12:26:21.978648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:21.982828 (+  4180us) service_pool.cc:224] Handling call
0709 12:26:23.066364 (+1083536us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:23.353956 10853 raft_consensus.cc:2468] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 6.
I20260709 12:26:23.182492 15181 raft_consensus.cc:515] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:23.344403 10925 rpcz_store.cc:276] 0709 12:26:21.639322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:21.831181 (+191859us) service_pool.cc:224] Handling call
0709 12:26:23.169695 (+1338514us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:23.169870 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:23.169893 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:23.169931 (+    38us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:26:23.169959 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:23.170007 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:23.259971 (+ 89964us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b54002076d0. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e878ad 00007f7599e4c419 00007f75933c3bd4 00007f75933c3b62 00007f75933c3a91 00007f75933c3a0c 00007f75933c2cc2 00007f75931c348c 00007f75931c28c6 00007f75931c226f
0709 12:26:23.260155 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3077589888}
I20260709 12:26:23.343377 10927 rpcz_store.cc:276] 0709 12:26:21.832550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:22.912630 (+1080080us) service_pool.cc:224] Handling call
0709 12:26:23.161462 (+248832us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:23.161746 (+   284us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:23.161791 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:23.161858 (+    67us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:26:23.161907 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:23.161988 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:23.258470 (+ 96482us) spinlock_profiling.cc:243] Waited 248 ms on lock 0x7b540012a7d0. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e878ad 00007f7599e4c419 00007f75933c3bd4 00007f75933c3b62 00007f75933c3a91 00007f75933c3a0c 00007f75933c2cc2 00007f75931c348c 00007f75931c28c6 00007f75931c226f
0709 12:26:23.258718 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":571052800}
I20260709 12:26:23.367530 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:23.324800 11001 raft_consensus.cc:2468] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 10.
I20260709 12:26:23.351079 10850 raft_consensus.cc:2468] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 5.
I20260709 12:26:23.156406 15128 raft_consensus.cc:515] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:23.355633 11620 raft_consensus.cc:2468] T ab816bcc6183447994a2cc013e46c5f8 P 3c52e0825c02476e89d84da9bb849f5d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 3.
W20260709 12:26:23.359954 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 463588us
I20260709 12:26:23.359107 11624 raft_consensus.cc:2468] T 4ef3220c51df47db8859f07ab745fad5 P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 5.
I20260709 12:26:23.361876 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac8522e549a46e09593fa4c2e175557" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:23.361894 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:23.314450 14954 raft_consensus.cc:740] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:23.357002 10846 raft_consensus.cc:2468] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 7.
I20260709 12:26:23.327944 15223 raft_consensus.cc:493] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:23.388032 10929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50036 (request call id 818) took 1551 ms. Trace:
I20260709 12:26:23.388546 10929 rpcz_store.cc:276] 0709 12:26:21.836283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:23.063358 (+1227075us) service_pool.cc:224] Handling call
0709 12:26:23.080027 (+ 16669us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:23.363127 (+283100us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:23.363157 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:23.363195 (+    38us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:26:23.363224 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:23.387771 (+ 24547us) spinlock_profiling.cc:243] Waited 283 ms on lock 0x7b54002882d4. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e88e01 00007f7594e8783e 00007f7599e4c419 00007f75933c3bd4 00007f75933c3b62 00007f75933c3a91 00007f75933c3a0c 00007f75933c2cc2 00007f75931c348c 00007f75931c28c6
0709 12:26:23.387825 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:23.387968 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":650615168}
I20260709 12:26:23.369218 11616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:23.338536 15162 leader_election.cc:290] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:23.348529 15217 raft_consensus.cc:493] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:23.372149 11618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:23.342527 15159 leader_election.cc:290] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:23.380601 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:23.397362 10848 raft_consensus.cc:1240] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 7. Current term is 8. Ops: []
I20260709 12:26:23.392633 10820 leader_election.cc:304] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:23.378750 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:23.397209 11621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:23.388393 10895 leader_election.cc:304] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:23.391924 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:23.329342 14962 raft_consensus.cc:515] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:23.386078 10920 raft_consensus.cc:2468] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 7.
I20260709 12:26:23.398651 11617 raft_consensus.cc:2468] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 9.
I20260709 12:26:23.405297 10820 leader_election.cc:304] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:23.408816 15200 leader_election.cc:290] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:23.411028 15183 leader_election.cc:290] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:23.411813 15101 raft_consensus.cc:2749] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:23.415951 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:23.418525 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c6d38c4d8a90a81975a6a0cb13" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:23.419543 11001 raft_consensus.cc:2468] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 7.
I20260709 12:26:23.420809 15181 leader_election.cc:290] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:23.421270 15128 leader_election.cc:290] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:23.380465 15107 consensus_queue.cc:1048] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:26:23.421880 15174 raft_consensus.cc:2804] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:26:23.422353 15174 raft_consensus.cc:493] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:23.422748 15174 raft_consensus.cc:3060] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:23.424026 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6a1da21304fcfacab384a6afc4101" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:23.425225 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:23.425326 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c913e527ff46578e084c41eab7bb9d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:26:23.426229 10894 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.116.65:46265 timed out after 1.500s (SENT)
I20260709 12:26:23.427218 15220 raft_consensus.cc:493] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:23.427738 11618 raft_consensus.cc:2468] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 11.
I20260709 12:26:23.427814 15220 raft_consensus.cc:515] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:23.430738 15176 raft_consensus.cc:493] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:23.431313 15176 raft_consensus.cc:515] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } }
I20260709 12:26:23.432085 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:23.395890 15217 raft_consensus.cc:3060] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:23.433560 15176 leader_election.cc:290] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265)
I20260709 12:26:23.436292 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:23.436043 14954 consensus_queue.cc:260] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:23.437111 10998 raft_consensus.cc:2468] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 5.
I20260709 12:26:23.437922 14954 raft_consensus.cc:3060] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:23.438198 15053 raft_consensus.cc:2804] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:23.438668 15053 raft_consensus.cc:493] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:23.439044 15053 raft_consensus.cc:3060] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:26:23.437880 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 49552.9us
I20260709 12:26:23.444887 15203 leader_election.cc:290] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:23.447853 15171 leader_election.cc:290] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:23.365698 15153 raft_consensus.cc:515] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:23.361686 15214 raft_consensus.cc:515] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:23.450829 10920 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50036 (request call id 828) took 1432 ms (client timeout 1887 ms). Trace:
W20260709 12:26:23.451289 10920 rpcz_store.cc:269] 0709 12:26:22.018223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:22.077880 (+ 59657us) service_pool.cc:224] Handling call
0709 12:26:23.450652 (+1372772us) spinlock_profiling.cc:243] Waited 494 ms on lock 0x7b54001473d4. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e8c2fa 00007f7599e4db17 00007f75933c86d4 00007f75933c8662 00007f75933c8591 00007f75933c850c 00007f75933c77c2 00007f75931c348c 00007f75931c28c6 00007f75931c226f
0709 12:26:23.450762 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1137209088}
I20260709 12:26:23.464162 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d9a61ecaf84695b70f8519ee57706f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:23.465745 10820 leader_election.cc:304] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:23.466137 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:23.400076 11588 leader_election.cc:304] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:26:23.468000 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 68549.1us
I20260709 12:26:23.468252 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:23.471014 15196 leader_election.cc:290] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:23.471323 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:23.472640 15160 leader_election.cc:290] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:23.477626 15207 raft_consensus.cc:515] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:23.478960 10994 raft_consensus.cc:1240] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 10. Current term is 11. Ops: []
I20260709 12:26:23.479538 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:23.480361 10929 raft_consensus.cc:2468] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 4.
I20260709 12:26:23.481240 15101 raft_consensus.cc:2804] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:26:23.481716 15101 raft_consensus.cc:493] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:23.481940 15214 leader_election.cc:290] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:23.483170 11620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:23.469002 11588 leader_election.cc:304] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:23.480391 10994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37500 (request call id 3803) took 1693 ms. Trace:
I20260709 12:26:23.484197 10994 rpcz_store.cc:276] 0709 12:26:21.789244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:22.912904 (+1123660us) service_pool.cc:224] Handling call
0709 12:26:22.913228 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:23.479457 (+566229us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:23.480095 (+   638us) spinlock_profiling.cc:243] Waited 565 ms on lock 0x7b54001810d4. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e88e01 00007f7594e8783e 00007f7599e4c419 00007f75933c3bd4 00007f75933c3b62 00007f75933c3a91 00007f75933c3a0c 00007f75933c2cc2 00007f75931c348c 00007f75931c28c6
0709 12:26:23.480313 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1300414336}
I20260709 12:26:23.486353 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:23.430989 15220 leader_election.cc:290] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:23.489794 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:23.492607 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:23.482676 10820 leader_election.cc:304] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:23.494166 10924 raft_consensus.cc:2468] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 4.
I20260709 12:26:23.493057 11617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d9a61ecaf84695b70f8519ee57706f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:23.497860 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:23.499140 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:23.499325 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:23.404662 15223 raft_consensus.cc:515] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:23.503031 15223 leader_election.cc:290] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:23.507011 14954 raft_consensus.cc:2804] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:26:23.507133 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:23.507532 14954 raft_consensus.cc:493] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:23.507681 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:23.507973 14954 raft_consensus.cc:3060] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:23.508827 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:23.485213 15101 raft_consensus.cc:3060] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:23.509366 10994 raft_consensus.cc:3060] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:23.511924 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:23.512566 10997 raft_consensus.cc:2468] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 11.
I20260709 12:26:23.512353 15220 raft_consensus.cc:493] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:23.513602 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:23.487397 15216 raft_consensus.cc:2804] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:26:23.515749 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:23.515923 15216 raft_consensus.cc:493] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:23.516084 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:23.516391 15216 raft_consensus.cc:3060] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:23.515407 11616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:23.517011 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:23.515429 10926 raft_consensus.cc:1275] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:26:23.493672 11589 leader_election.cc:304] T 435d66c6d38c4d8a90a81975a6a0cb13 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:23.436115 15219 raft_consensus.cc:493] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:23.538347 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:23.539121 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:23.541363 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:23.544881 10998 raft_consensus.cc:2468] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 10.
I20260709 12:26:23.544312 10929 raft_consensus.cc:2468] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 9.
I20260709 12:26:23.548202 14954 raft_consensus.cc:515] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:23.548552 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 57884.8us
I20260709 12:26:23.550473 14954 leader_election.cc:290] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:23.555356 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:23.498490 15183 raft_consensus.cc:2804] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:23.556434 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c913e527ff46578e084c41eab7bb9d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:23.556834 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:23.560768 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c913e527ff46578e084c41eab7bb9d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:26:23.558305 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 245105us
I20260709 12:26:23.557564 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:23.513329 15220 raft_consensus.cc:515] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:23.564184 10927 raft_consensus.cc:2393] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3c52e0825c02476e89d84da9bb849f5d in current term 5: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:26:23.559736 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:23.565696 11001 raft_consensus.cc:2468] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 11.
I20260709 12:26:23.557555 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:23.569136 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:23.569967 10995 raft_consensus.cc:2393] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 11: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
W20260709 12:26:23.573661 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 79887us
I20260709 12:26:23.579293 14962 leader_election.cc:290] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:23.579815 10895 leader_election.cc:304] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:23.573573 15146 raft_consensus.cc:493] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:23.581192 15146 raft_consensus.cc:515] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:23.581825 15153 leader_election.cc:290] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:26:23.573628 10820 connection.cc:256] RPC call timeout handler was delayed by -1.0541001120000146s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2227s for a response
I20260709 12:26:23.584824 15223 raft_consensus.cc:2749] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:26:23.587037 10895 leader_election.cc:304] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:23.557663 15159 raft_consensus.cc:2804] T 435d66c6d38c4d8a90a81975a6a0cb13 P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:26:23.592820 10895 leader_election.cc:304] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:23.560083 15183 raft_consensus.cc:493] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:23.621079 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:23.619413 10895 leader_election.cc:304] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:23.587961 15146 leader_election.cc:290] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:23.631302 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:23.632345 10847 raft_consensus.cc:2468] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 3.
I20260709 12:26:23.637125 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef3220c51df47db8859f07ab745fad5" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:23.637511 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:23.589713 15218 raft_consensus.cc:493] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:23.637893 10851 raft_consensus.cc:2468] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 5.
I20260709 12:26:23.641510 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:23.594599 15171 raft_consensus.cc:2749] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:23.598476 15183 raft_consensus.cc:3060] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:23.553421 15219 raft_consensus.cc:515] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:23.662357 15218 raft_consensus.cc:515] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:23.592505 15159 raft_consensus.cc:493] T 435d66c6d38c4d8a90a81975a6a0cb13 P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:23.624298 10895 leader_election.cc:304] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:23.645689 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:23.645809 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:23.663384 15219 leader_election.cc:290] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:23.647117 15207 leader_election.cc:290] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:23.633003 15214 raft_consensus.cc:2804] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:23.633193 15053 raft_consensus.cc:515] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:23.668987 15218 leader_election.cc:290] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:23.660163 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:23.622606 15160 raft_consensus.cc:2749] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:26:23.671736 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 47689.2us
I20260709 12:26:23.664371 10994 raft_consensus.cc:2468] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 8.
I20260709 12:26:23.642501 10846 raft_consensus.cc:2468] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 4.
I20260709 12:26:23.667279 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9331e5342644ca2bae19187b083a7d5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
W20260709 12:26:23.675344 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 95872.1us
I20260709 12:26:23.764640 10895 leader_election.cc:304] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:26:23.689674 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 103487us
I20260709 12:26:23.769529 10854 raft_consensus.cc:1240] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 8. Current term is 9. Ops: []
I20260709 12:26:23.766981 10820 leader_election.cc:304] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:23.770910 10895 leader_election.cc:304] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:23.727412 15101 raft_consensus.cc:515] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:23.774034 11618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
W20260709 12:26:23.774500 10817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:23.758430 15220 leader_election.cc:290] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:23.772761 14962 raft_consensus.cc:2749] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:23.775640 11615 raft_consensus.cc:2955] T 4ef3220c51df47db8859f07ab745fad5 P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 6 to 7, VOTER 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:23.774415 15223 raft_consensus.cc:2749] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:23.675071 15159 raft_consensus.cc:3060] T 435d66c6d38c4d8a90a81975a6a0cb13 P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:23.781955 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:23.782691 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:23.671922 15214 raft_consensus.cc:493] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:23.789479 15214 raft_consensus.cc:3060] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:23.791499 15216 raft_consensus.cc:515] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:23.788964 15218 raft_consensus.cc:2749] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:23.789645 10850 raft_consensus.cc:1240] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 9. Current term is 10. Ops: []
I20260709 12:26:23.794710 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:23.795374 10852 raft_consensus.cc:2468] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 9.
I20260709 12:26:23.796151 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac8522e549a46e09593fa4c2e175557" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:23.787772 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:23.796648 15216 leader_election.cc:290] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 9 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:23.790294 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad766f48812a4ddeb383179b1d84907b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:23.797678 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:23.798334 15101 leader_election.cc:290] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 10 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:23.798418 10851 raft_consensus.cc:2468] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 5.
I20260709 12:26:23.772590 10820 leader_election.cc:304] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:23.800990 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:23.802024 10820 leader_election.cc:304] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:23.804504 15218 raft_consensus.cc:2804] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:26:23.804958 15218 raft_consensus.cc:493] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:23.805351 15218 raft_consensus.cc:3060] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:23.788584 15053 leader_election.cc:290] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:23.807682 15101 raft_consensus.cc:2749] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:23.808291 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:23.806850 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:23.809656 15217 raft_consensus.cc:515] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:23.816293 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:23.816612 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:23.817734 10849 raft_consensus.cc:2393] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 9: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:26:23.816663 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac83709373b4efd9c3aa1472a9f9022" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:23.818729 10845 raft_consensus.cc:2468] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 4.
I20260709 12:26:23.829830 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:23.830106 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:23.830471 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:23.831110 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:23.816293 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:23.834412 10895 leader_election.cc:304] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:23.831633 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:23.842329 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:23.831753 10846 raft_consensus.cc:2468] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 4.
I20260709 12:26:23.830161 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:23.829829 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6a1da21304fcfacab384a6afc4101" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:23.843528 10853 raft_consensus.cc:2468] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 3.
I20260709 12:26:23.845741 15053 raft_consensus.cc:2804] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:23.846032 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:23.846251 15053 raft_consensus.cc:493] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:23.849154 15053 raft_consensus.cc:3060] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:23.849362 15159 raft_consensus.cc:515] T 435d66c6d38c4d8a90a81975a6a0cb13 P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:23.851950 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:23.853631 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c6d38c4d8a90a81975a6a0cb13" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:23.860944 10994 raft_consensus.cc:3060] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:23.853814 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:23.862452 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:23.699307 15171 raft_consensus.cc:2804] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:26:23.855329 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:23.729231 15089 raft_consensus.cc:2955] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 LEADER]: Committing config change with OpId 5.7: config changed from index 6 to 7, VOTER 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:23.857375 15217 leader_election.cc:290] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 10 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:23.863751 10849 raft_consensus.cc:2468] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 10.
I20260709 12:26:23.864732 10895 leader_election.cc:304] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d
I20260709 12:26:23.871074 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:23.872112 10895 leader_election.cc:304] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:23.873893 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:23.874616 10925 raft_consensus.cc:2468] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 3.
I20260709 12:26:23.864188 15171 raft_consensus.cc:493] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:23.878484 15171 raft_consensus.cc:3060] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:23.882360 15183 raft_consensus.cc:515] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:23.883375 15188 raft_consensus.cc:2804] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:23.883850 15188 raft_consensus.cc:493] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:23.884321 15188 raft_consensus.cc:3060] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:23.865880 15159 leader_election.cc:290] T 435d66c6d38c4d8a90a81975a6a0cb13 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 8 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:23.887090 15174 raft_consensus.cc:515] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:23.888744 15214 raft_consensus.cc:515] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:23.889751 15174 leader_election.cc:290] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 10 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:23.891800 10848 raft_consensus.cc:1240] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 9. Current term is 10. Ops: []
I20260709 12:26:23.868927 10851 raft_consensus.cc:2393] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 10: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:26:23.898839 15223 raft_consensus.cc:2804] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:26:23.899552 15223 raft_consensus.cc:493] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:23.900238 15223 raft_consensus.cc:3060] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:23.905647 10895 leader_election.cc:304] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:23.914480 14962 raft_consensus.cc:2804] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:26:23.914969 14962 raft_consensus.cc:493] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:23.915742 14962 raft_consensus.cc:3060] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:23.916307 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:23.916281 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:23.891315 15214 leader_election.cc:290] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:23.918666 10895 leader_election.cc:304] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:23.920531 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:23.921486 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:23.923337 10850 raft_consensus.cc:2468] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 5.
I20260709 12:26:23.926151 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:23.927368 10750 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60730 (request call id 349) took 4680 ms. Trace:
I20260709 12:26:23.930814 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c913e527ff46578e084c41eab7bb9d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:23.932974 15160 consensus_queue.cc:1059] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:26:23.933315 10927 raft_consensus.cc:1240] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:23.938241 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac8522e549a46e09593fa4c2e175557" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:23.934123 15200 consensus_queue.cc:1059] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 12:26:23.942797 15200 raft_consensus.cc:3055] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:26:23.943259 15200 raft_consensus.cc:740] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:23.942890 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:23.945930 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:23.946785 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:23.947554 11000 raft_consensus.cc:2468] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 7.
I20260709 12:26:23.949292 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac83709373b4efd9c3aa1472a9f9022" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:23.930658 15203 raft_consensus.cc:2804] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:23.951128 15203 raft_consensus.cc:493] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:23.951550 15203 raft_consensus.cc:3060] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:23.952292 15218 raft_consensus.cc:515] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:23.954270 10854 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
mode: GRACEFUL
new_leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
 from {username='slave'} at 127.0.0.1:47358
I20260709 12:26:23.954890 10854 raft_consensus.cc:606] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Received request to transfer leadership to TS edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:23.955281 10854 raft_consensus.cc:614] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:23.955657 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:23.934175 15160 raft_consensus.cc:3055] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:26:23.956024 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9331e5342644ca2bae19187b083a7d5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:23.956791 15160 raft_consensus.cc:740] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:23.957263 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:23.958393 15160 consensus_queue.cc:260] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:23.952358 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:23.959970 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:23.955278 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:23.966107 10994 raft_consensus.cc:2468] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 8.
I20260709 12:26:23.968111 11621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6a1da21304fcfacab384a6afc4101" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:23.968845 11621 raft_consensus.cc:2468] T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 4.
I20260709 12:26:23.969806 15188 raft_consensus.cc:515] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:23.969996 15171 raft_consensus.cc:515] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:23.954905 15218 leader_election.cc:290] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:23.972483 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:23.973301 10846 raft_consensus.cc:2393] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 10: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:26:23.974457 15188 leader_election.cc:290] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 election: Requested vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:23.975906 10968 leader_election.cc:304] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:23.975795 15219 consensus_queue.cc:1048] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:26:23.977114 15073 raft_consensus.cc:2804] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:26:23.977843 15073 raft_consensus.cc:493] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:23.978320 15073 raft_consensus.cc:3060] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:23.929790 10750 rpcz_store.cc:276] 0709 12:26:19.246786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:19.247136 (+   350us) service_pool.cc:224] Handling call
0709 12:26:19.394846 (+147710us) spinlock_profiling.cc:243] Waited 66.2 ms on lock 0x7b540007b554. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df2090 00007f7594e90f3a 00007f759ac46e9c 00007f759ad4504e 00007f75992062a4 00007f7599206232 00007f7599206161 00007f75992060dc 00007f7599205392 00007f75931c348c 00007f75931c28c6
0709 12:26:23.927294 (+4532448us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:23.517144 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:23.517915 (+   771us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:23.517960 (+    45us) write_op.cc:435] Acquired schema lock
0709 12:26:23.517975 (+    15us) tablet.cc:662] Decoding operations
0709 12:26:23.534412 (+ 16437us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:23.534475 (+    63us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:23.534503 (+    28us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:26:23.534768 (+   265us) tablet.cc:701] Row locks acquired
0709 12:26:23.534787 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:26:23.534962 (+   175us) write_op.cc:270] Start()
0709 12:26:23.535137 (+   175us) write_op.cc:276] Timestamp: P: 1783599983534899 usec, L: 0
0709 12:26:23.535165 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 12:26:23.536035 (+   870us) log.cc:844] Serialized 538 byte log entry
0709 12:26:23.597664 (+ 61629us) op_driver.cc:464] REPLICATION: finished
0709 12:26:23.895176 (+297512us) write_op.cc:301] APPLY: starting
0709 12:26:23.895403 (+   227us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:23.910887 (+ 15484us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:23.910998 (+   111us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:23.911805 (+   807us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:23.912012 (+   207us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 12:26:23.912075 (+    63us) write_op.cc:312] APPLY: finished
0709 12:26:23.912284 (+   209us) log.cc:844] Serialized 25 byte log entry
0709 12:26:23.912467 (+   183us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:23.912553 (+    86us) write_op.cc:454] Released schema lock
0709 12:26:23.912594 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:23.913022 (+   428us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:23.913060 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":9,"spinlock_wait_cycles":152295168,"child_traces":[["op",{"apply.queue_time_us":277559,"apply.run_cpu_time_us":3820,"apply.run_wall_time_us":17814,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8307,"num_ops":1,"prepare.queue_time_us":415583,"prepare.run_cpu_time_us":3341,"prepare.run_wall_time_us":33066,"replication_time_us":37780,"thread_start_us":415803,"threads_started":2}]]}
I20260709 12:26:23.981498 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:23.982120 11000 raft_consensus.cc:2468] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 6.
I20260709 12:26:23.983780 15160 raft_consensus.cc:3060] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:23.984222 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:23.985152 11000 raft_consensus.cc:2410] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:26:23.987325 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:26:23.989380 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 414393us
I20260709 12:26:23.990231 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:23.995064 10994 raft_consensus.cc:1240] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 9. Current term is 10. Ops: []
I20260709 12:26:24.000006 15200 consensus_queue.cc:260] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:24.001443 15200 raft_consensus.cc:3060] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:24.003456 15053 raft_consensus.cc:515] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:24.004631 10923 raft_consensus.cc:1240] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:24.005509 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:24.006167 10998 raft_consensus.cc:3060] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:24.008268 15183 leader_election.cc:290] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 4 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:24.010833 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:24.011337 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:24.012116 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:24.013156 10995 raft_consensus.cc:1240] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 7. Current term is 8. Ops: []
I20260709 12:26:24.014115 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:24.016299 11623 raft_consensus.cc:1240] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 8. Current term is 9. Ops: []
I20260709 12:26:24.018949 10998 raft_consensus.cc:2468] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 5.
I20260709 12:26:24.020694 10968 leader_election.cc:304] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:24.024683 10820 leader_election.cc:304] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:24.040144 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:24.041301 10998 raft_consensus.cc:3060] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:24.042258 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:24.044458 10820 leader_election.cc:304] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:24.045601 11589 leader_election.cc:304] T 435d66c6d38c4d8a90a81975a6a0cb13 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:24.046954 11003 raft_consensus.cc:1240] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 7. Current term is 8. Ops: []
I20260709 12:26:24.045907 11588 leader_election.cc:304] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:24.048614 10968 leader_election.cc:304] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
W20260709 12:26:24.051472 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 121990us
I20260709 12:26:24.052258 10968 leader_election.cc:304] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:23.973811 15171 leader_election.cc:290] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:24.056694 15220 raft_consensus.cc:2749] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:24.061373 15223 raft_consensus.cc:515] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:24.063788 10925 raft_consensus.cc:1240] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 9. Current term is 10. Ops: []
I20260709 12:26:24.064599 15053 leader_election.cc:290] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:24.052522 15222 raft_consensus.cc:3060] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:24.043045 15219 consensus_queue.cc:1059] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 12:26:24.066216 15073 raft_consensus.cc:515] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:24.066674 15219 raft_consensus.cc:3055] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:26:24.051683 15101 raft_consensus.cc:2804] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:24.069448 15101 raft_consensus.cc:493] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:24.069267 15203 raft_consensus.cc:515] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:24.069947 15101 raft_consensus.cc:3060] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:24.051492 15174 raft_consensus.cc:2804] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:24.070889 15174 raft_consensus.cc:493] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:24.071285 15174 raft_consensus.cc:3060] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:24.042615 15217 raft_consensus.cc:2749] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:26:24.072119 15073 leader_election.cc:290] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 10 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:24.077518 10750 catalog_manager.cc:5697] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: config changed from index 5 to 6, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:24.054509 15231 raft_consensus.cc:2804] T 435d66c6d38c4d8a90a81975a6a0cb13 P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:26:24.081082 15231 raft_consensus.cc:697] T 435d66c6d38c4d8a90a81975a6a0cb13 P 3c52e0825c02476e89d84da9bb849f5d [term 8 LEADER]: Becoming Leader. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
I20260709 12:26:24.067327 15219 raft_consensus.cc:740] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:26:24.082074 15231 consensus_queue.cc:237] T 435d66c6d38c4d8a90a81975a6a0cb13 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:24.082420 15219 consensus_queue.cc:260] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:24.084270 15219 raft_consensus.cc:3060] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:24.071491 15203 leader_election.cc:290] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:24.095695 10820 leader_election.cc:304] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:24.097705 15236 raft_consensus.cc:2804] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:24.098310 15236 raft_consensus.cc:493] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:24.098714 15236 raft_consensus.cc:3060] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:24.093477 10894 leader_election.cc:304] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:24.079404 10750 catalog_manager.cc:5697] T 4ef3220c51df47db8859f07ab745fad5 P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: config changed from index 6 to 7, VOTER 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) evicted. New cstate: current_term: 5 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:24.100788 10820 leader_election.cc:304] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
W20260709 12:26:24.102092 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 56292.3us
I20260709 12:26:24.105068 15237 raft_consensus.cc:2804] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:26:24.109006 15203 raft_consensus.cc:2749] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:24.109282 15237 raft_consensus.cc:493] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:24.109756 15237 raft_consensus.cc:3060] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:24.096946 15223 leader_election.cc:290] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 10 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:24.120447 15089 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:37496 (request call id 81) took 3421 ms. Trace:
I20260709 12:26:24.122233 11588 leader_election.cc:304] T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:24.059460 14962 raft_consensus.cc:515] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:24.127297 15082 raft_consensus.cc:2804] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:26:24.121100 15089 rpcz_store.cc:276] 0709 12:26:20.676031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:20.676205 (+   174us) service_pool.cc:224] Handling call
0709 12:26:20.722103 (+ 45898us) log.cc:844] Serialized 494 byte log entry
0709 12:26:21.524693 (+802590us) spinlock_profiling.cc:243] Waited 3.25 ms on lock 0x7b2c0010cc78. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7593781a11 00007f7593790a0a 00007f7593790693 00007f7593790631 00007f7594ec4b52 00007f7594ec4cf5 00007f7594e01691 00007f7594de1eaa 00007f7594de8d53 00007f7594de8cd9 00007f7594de8c69
0709 12:26:21.634812 (+110119us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b1800175e60. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594ec4d01 00007f7594e01691 00007f7594de1eaa 00007f7594de8d53 00007f7594de8cd9 00007f7594de8c69 00007f7594de8c31 00007f7594de7dfd 0000000000388634 0000000000388479
0709 12:26:24.097480 (+2462668us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53108,"raft.queue_time_us":565316,"raft.run_cpu_time_us":7835,"raft.run_wall_time_us":689096,"spinlock_wait_cycles":336344832,"thread_start_us":326178,"threads_started":2,"wal-append.queue_time_us":194334,"wal-append.run_cpu_time_us":3087,"wal-append.run_wall_time_us":1118067}
W20260709 12:26:24.140766 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 201298us
W20260709 12:26:24.145745 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 90771.2us
I20260709 12:26:24.147699 10998 raft_consensus.cc:2468] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 10.
I20260709 12:26:24.157678 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:24.148422 15059 raft_consensus.cc:2804] T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:24.171514 15059 raft_consensus.cc:493] T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:24.172056 15223 consensus_queue.cc:1059] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 12:26:24.173229 15200 raft_consensus.cc:3055] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:26:24.173659 15200 raft_consensus.cc:740] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:24.174642 15200 consensus_queue.cc:260] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:24.158748 10739 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4ef3220c51df47db8859f07ab745fad5 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:24.176404 15174 raft_consensus.cc:515] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:24.182747 15174 leader_election.cc:290] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 11 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:24.159039 10925 raft_consensus.cc:2468] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 9.
I20260709 12:26:24.186530 10820 leader_election.cc:304] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:24.183779 15200 raft_consensus.cc:3060] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:24.189109 15218 raft_consensus.cc:2804] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:26:24.189677 15218 raft_consensus.cc:697] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 10 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:24.192288 15218 consensus_queue.cc:237] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:24.196013 15171 consensus_queue.cc:1059] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:26:24.186148 15024 consensus_queue.cc:1059] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 12:26:24.172076 15059 raft_consensus.cc:3060] T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:24.198645 15024 raft_consensus.cc:3055] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:26:24.199088 15024 raft_consensus.cc:740] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:24.197480 15214 raft_consensus.cc:3055] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:26:24.148074 15082 raft_consensus.cc:697] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 8 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
W20260709 12:26:24.184170 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 135225us
I20260709 12:26:24.206240 10968 leader_election.cc:304] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:24.207293 10894 leader_election.cc:304] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:24.209514 10819 leader_election.cc:304] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:24.210528 10968 leader_election.cc:304] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:24.211424 15207 raft_consensus.cc:2749] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:24.211337 10923 raft_consensus.cc:1240] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Rejecting Update request from peer 3c52e0825c02476e89d84da9bb849f5d for earlier term 10. Current term is 11. Ops: []
I20260709 12:26:24.215227 10968 leader_election.cc:304] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:24.216734 10895 leader_election.cc:304] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:24.219367 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:24.214246 15073 raft_consensus.cc:2749] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:26:24.221582 14962 leader_election.cc:290] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 10 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:24.223984 15073 raft_consensus.cc:2749] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:26:24.207217 15214 raft_consensus.cc:740] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:24.228467 15214 consensus_queue.cc:260] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:24.229538 15214 raft_consensus.cc:3060] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:24.228473 15024 consensus_queue.cc:260] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:24.230868 15024 raft_consensus.cc:3060] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:24.231549 10968 leader_election.cc:304] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:24.232785 10968 leader_election.cc:304] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:24.234701 15082 consensus_queue.cc:237] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:24.236570 15073 raft_consensus.cc:2749] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:24.236891 15089 raft_consensus.cc:2749] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:24.241685 15222 raft_consensus.cc:2749] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:24.249117 15236 raft_consensus.cc:515] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:24.253839 10817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:24.255271 10750 catalog_manager.cc:5697] T 435d66c6d38c4d8a90a81975a6a0cb13 P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: term changed from 7 to 8, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68). New cstate: current_term: 8 leader_uuid: "3c52e0825c02476e89d84da9bb849f5d" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:26:24.257740 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 50549us
W20260709 12:26:24.258955 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 49514.5us
I20260709 12:26:24.260226 10819 leader_election.cc:304] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:24.262799 10819 leader_election.cc:304] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:24.263757 15241 raft_consensus.cc:2804] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:26:24.264308 15241 raft_consensus.cc:493] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:24.264362 15163 raft_consensus.cc:2749] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:24.264910 15241 raft_consensus.cc:3060] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:24.265384 15171 raft_consensus.cc:2804] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:24.265868 15171 raft_consensus.cc:493] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:24.266263 15171 raft_consensus.cc:3060] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:24.268245 10998 raft_consensus.cc:1240] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:24.158485 15237 raft_consensus.cc:515] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:24.270588 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:24.270816 15222 raft_consensus.cc:493] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:24.271400 15222 raft_consensus.cc:515] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:24.273744 15222 leader_election.cc:290] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:24.274295 15222 raft_consensus.cc:493] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:24.274519 15237 leader_election.cc:290] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 8 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:24.276194 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:24.278275 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:24.260471 15101 raft_consensus.cc:515] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:24.274802 15222 raft_consensus.cc:515] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:24.282691 15101 leader_election.cc:290] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:24.259562 10894 leader_election.cc:304] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:24.284066 15222 leader_election.cc:290] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:24.251338 15236 leader_election.cc:290] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 election: Requested vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:24.290079 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:24.291052 11623 raft_consensus.cc:2468] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 6.
I20260709 12:26:24.292470 10969 leader_election.cc:304] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:24.274111 10751 catalog_manager.cc:5697] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 5 to 6, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 6 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } }
I20260709 12:26:24.270172 15196 raft_consensus.cc:2749] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:26:24.293602 15163 raft_consensus.cc:2749] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:26:24.295336 15200 raft_consensus.cc:2804] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:24.299834 15200 raft_consensus.cc:493] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:24.300467 15200 raft_consensus.cc:3060] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:24.307123 15242 raft_consensus.cc:2804] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:26:24.307619 15242 raft_consensus.cc:493] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:24.308187 15242 raft_consensus.cc:3060] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:24.296659 15059 raft_consensus.cc:515] T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:24.313850 15059 leader_election.cc:290] T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 5 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:24.318429 10819 leader_election.cc:304] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:24.319504 15218 raft_consensus.cc:3060] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:26:24.320523 10893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:24.263306 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 46713.4us
I20260709 12:26:24.330600 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:24.330574 10819 leader_election.cc:304] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:24.332499 15236 raft_consensus.cc:2804] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:24.332952 15236 raft_consensus.cc:493] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:24.333325 15236 raft_consensus.cc:3060] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:24.334288 10819 leader_election.cc:304] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:24.334496 10895 leader_election.cc:304] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:24.340546 15212 raft_consensus.cc:2749] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:26:24.349970 15174 consensus_queue.cc:1059] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:24.351770 15163 consensus_queue.cc:1059] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:24.373121 14962 raft_consensus.cc:2749] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:24.369551 10895 leader_election.cc:304] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:24.370491 10894 leader_election.cc:304] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:24.375751 10895 leader_election.cc:304] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:24.376368 10894 leader_election.cc:304] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:24.356910 15200 raft_consensus.cc:515] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:24.357924 15024 consensus_queue.cc:1059] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:26:24.359532 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6a1da21304fcfacab384a6afc4101" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
W20260709 12:26:24.381808 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 164855us
I20260709 12:26:24.361302 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:24.377741 10895 leader_election.cc:304] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:24.361230 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:24.362123 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:24.383612 10895 leader_election.cc:304] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:24.362361 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:24.363760 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:24.367265 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c6d38c4d8a90a81975a6a0cb13" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:24.383913 10894 leader_election.cc:304] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:24.386325 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:24.359804 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c6d38c4d8a90a81975a6a0cb13" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:24.365695 15236 raft_consensus.cc:515] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:24.383853 10853 raft_consensus.cc:2468] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 5.
I20260709 12:26:24.389249 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fd8fdac2fa449e9e184f3d668ea1a7" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:24.306828 15241 raft_consensus.cc:515] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:24.442052 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:24.446470 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:24.446825 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:24.381620 15160 raft_consensus.cc:2749] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:24.424192 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:24.389925 10895 leader_election.cc:304] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:24.452392 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef3220c51df47db8859f07ab745fad5" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:24.385130 15238 raft_consensus.cc:2804] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:24.384790 15053 raft_consensus.cc:2749] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:24.386268 15188 raft_consensus.cc:2804] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:24.440456 10927 raft_consensus.cc:1240] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 9. Current term is 10. Ops: []
I20260709 12:26:24.440197 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:24.393756 14962 raft_consensus.cc:2804] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:24.442489 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:24.442202 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:24.473757 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:24.442096 10928 raft_consensus.cc:1240] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 6. Current term is 7. Ops: []
I20260709 12:26:24.381956 15223 raft_consensus.cc:2749] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:26:24.394389 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:24.484653 15200 leader_election.cc:290] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:24.471123 15188 raft_consensus.cc:493] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:24.409587 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:24.452062 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:24.395045 11002 raft_consensus.cc:1240] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 9. Current term is 10. Ops: []
I20260709 12:26:24.487076 10852 raft_consensus.cc:2468] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 8.
I20260709 12:26:24.465715 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:24.466513 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad766f48812a4ddeb383179b1d84907b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:24.439406 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad766f48812a4ddeb383179b1d84907b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:24.501154 15171 raft_consensus.cc:515] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:24.504289 15160 raft_consensus.cc:2804] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:24.504815 15160 raft_consensus.cc:493] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:24.505270 15160 raft_consensus.cc:3060] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:24.505384 15173 raft_consensus.cc:3055] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:26:24.505870 15173 raft_consensus.cc:740] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:24.506837 15173 consensus_queue.cc:260] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:24.509325 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:24.509747 15173 raft_consensus.cc:3060] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:24.489370 15082 raft_consensus.cc:3055] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:24.512085 15082 raft_consensus.cc:740] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:24.513556 15082 consensus_queue.cc:260] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:24.515072 15082 raft_consensus.cc:3060] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:24.490854 15188 raft_consensus.cc:3060] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:24.516404 15212 raft_consensus.cc:3055] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:24.516932 15212 raft_consensus.cc:740] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:24.517854 15212 consensus_queue.cc:260] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:24.519431 15212 raft_consensus.cc:3060] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:24.492213 10997 consensus_queue.cc:237] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:24.488190 15241 leader_election.cc:290] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 10 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:24.494484 10994 raft_consensus.cc:3060] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:26:24.469076 10893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:24.453461 11588 leader_election.cc:304] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:24.457540 10998 consensus_queue.cc:237] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:24.527948 15216 raft_consensus.cc:2804] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:26:24.528398 15216 raft_consensus.cc:493] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:24.528743 15216 raft_consensus.cc:3060] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:24.391492 15224 raft_consensus.cc:2749] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:24.472353 10850 raft_consensus.cc:1240] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 11. Current term is 12. Ops: []
I20260709 12:26:24.441067 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:24.471977 15214 consensus_queue.cc:1059] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:26:24.476083 10846 raft_consensus.cc:1240] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 6. Current term is 7. Ops: []
I20260709 12:26:24.477972 15236 leader_election.cc:290] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:24.455670 15238 raft_consensus.cc:493] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:24.532939 15224 raft_consensus.cc:3055] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:26:24.533150 15238 raft_consensus.cc:3060] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:24.533481 15224 raft_consensus.cc:740] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:24.534623 15224 consensus_queue.cc:260] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:24.536042 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:24.473551 14962 raft_consensus.cc:493] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:24.536913 14962 raft_consensus.cc:3060] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:24.454353 10853 raft_consensus.cc:2468] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 5.
W20260709 12:26:24.552289 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 162449us
I20260709 12:26:24.553419 10895 leader_election.cc:304] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:24.554291 15250 raft_consensus.cc:2749] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:26:24.558786 10994 raft_consensus.cc:2468] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 12.
W20260709 12:26:24.572570 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 119231us
I20260709 12:26:24.574987 11588 leader_election.cc:304] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:24.582433 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:24.582953 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:24.583287 10819 leader_election.cc:304] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:24.583792 10929 raft_consensus.cc:2393] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 10: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:26:24.584076 10923 raft_consensus.cc:2468] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 5.
I20260709 12:26:24.587530 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:26:24.585269 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 194421us
I20260709 12:26:24.591620 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:24.587874 11588 leader_election.cc:304] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:24.594515 11588 leader_election.cc:304] T 4ef3220c51df47db8859f07ab745fad5 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:24.596454 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:24.489581 15218 raft_consensus.cc:2749] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:24.600431 10926 raft_consensus.cc:1240] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:24.604089 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:24.593338 15024 raft_consensus.cc:2749] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:26:24.611519 10929 raft_consensus.cc:1240] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 9. Current term is 10. Ops: []
I20260709 12:26:24.598120 15237 raft_consensus.cc:2804] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:24.613444 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d9a61ecaf84695b70f8519ee57706f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:24.616864 11621 raft_consensus.cc:1275] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:24.599781 15183 raft_consensus.cc:2804] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:26:24.619845 15183 raft_consensus.cc:493] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:24.620500 15183 raft_consensus.cc:3060] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:24.623914 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:24.624855 15073 consensus_queue.cc:1048] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:26:24.625583 15238 raft_consensus.cc:515] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:24.628203 15238 leader_election.cc:290] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:24.631078 10929 raft_consensus.cc:1240] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 5. Current term is 6. Ops: []
I20260709 12:26:24.632292 15251 consensus_queue.cc:1059] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:26:24.634647 15251 raft_consensus.cc:3055] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:26:24.636251 10928 raft_consensus.cc:2393] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 4: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:26:24.637912 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:24.638332 10929 raft_consensus.cc:1240] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:24.638989 10922 raft_consensus.cc:2393] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 10: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:26:24.640021 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:24.611899 10894 leader_election.cc:304] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:24.635093 15251 raft_consensus.cc:740] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:24.644707 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:24.651526 10994 raft_consensus.cc:1240] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 9. Current term is 10. Ops: []
I20260709 12:26:24.653367 10994 raft_consensus.cc:1240] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 11. Current term is 12. Ops: []
I20260709 12:26:24.654191 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:24.655426 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:24.656766 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:24.657660 11002 raft_consensus.cc:2393] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 10: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:26:24.657447 10968 leader_election.cc:304] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d
I20260709 12:26:24.653635 11615 raft_consensus.cc:1275] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:26:24.659492 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:24.661967 15219 raft_consensus.cc:2804] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:24.662467 15219 raft_consensus.cc:493] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:24.662448 15222 consensus_queue.cc:1048] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:26:24.657686 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad766f48812a4ddeb383179b1d84907b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:24.663075 15219 raft_consensus.cc:3060] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:24.659457 10968 leader_election.cc:304] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:24.665948 10968 leader_election.cc:304] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:24.667199 11621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:24.669520 14962 raft_consensus.cc:515] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:24.670600 10844 tablet_service.cc:1558] Processing DeleteTablet for tablet 4ef3220c51df47db8859f07ab745fad5 with delete_type TABLET_DATA_TOMBSTONED (TS 80cd7d227db44f34a6108591dad9c040 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:56372
I20260709 12:26:24.673056 15176 raft_consensus.cc:3060] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:24.675477 10819 leader_election.cc:304] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:24.675848 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:24.677323 10922 raft_consensus.cc:1240] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 10. Current term is 11. Ops: []
I20260709 12:26:24.677966 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:24.685427 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:24.676966 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:24.614569 15059 raft_consensus.cc:2804] T 4ef3220c51df47db8859f07ab745fad5 P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:24.696513 11001 raft_consensus.cc:1275] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:26:24.642581 15237 raft_consensus.cc:493] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:24.704159 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac83709373b4efd9c3aa1472a9f9022" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:24.706028 10849 raft_consensus.cc:1240] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:24.647308 15171 leader_election.cc:290] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:24.698630 15237 raft_consensus.cc:3060] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:24.698597 15248 raft_consensus.cc:2749] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:24.693959 15217 raft_consensus.cc:2749] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:26:24.723618 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 48196us
W20260709 12:26:24.724400 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 58512.6us
W20260709 12:26:24.726405 15253 log.cc:927] Time spent T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:26:24.709740 15231 consensus_queue.cc:1048] T 435d66c6d38c4d8a90a81975a6a0cb13 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 12:26:24.729691 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:24.730299 15251 consensus_queue.cc:260] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:24.715747 11621 raft_consensus.cc:1240] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 7. Current term is 8. Ops: []
I20260709 12:26:24.731670 15251 raft_consensus.cc:3060] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:24.699309 15218 consensus_queue.cc:1059] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:26:24.733615 15218 raft_consensus.cc:3055] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:26:24.734023 15218 raft_consensus.cc:740] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:24.736716 15237 raft_consensus.cc:515] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:24.701308 15059 raft_consensus.cc:493] T 4ef3220c51df47db8859f07ab745fad5 P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
W20260709 12:26:24.737687 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 125884us
I20260709 12:26:24.739897 10920 raft_consensus.cc:1240] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:24.698680 15196 raft_consensus.cc:2749] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:24.713567 10895 leader_election.cc:304] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:24.742229 10895 leader_election.cc:304] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:24.725230 10968 leader_election.cc:304] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:24.745344 15248 raft_consensus.cc:2804] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:26:24.745850 15248 raft_consensus.cc:493] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:24.746237 15248 raft_consensus.cc:3060] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:24.750958 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac83709373b4efd9c3aa1472a9f9022" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:24.765920 10895 leader_election.cc:304] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:24.739298 10921 raft_consensus.cc:2955] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 6 to 7, VOTER 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:24.734968 15218 consensus_queue.cc:260] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:24.777153 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
W20260709 12:26:24.778292 10969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:24.778249 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:24.778636 10849 raft_consensus.cc:1275] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:26:24.742488 15059 raft_consensus.cc:3060] T 4ef3220c51df47db8859f07ab745fad5 P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:26:24.781363 10969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:24.770862 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 45738.2us
I20260709 12:26:24.782896 10968 leader_election.cc:304] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
W20260709 12:26:24.782924 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 188482us
I20260709 12:26:24.770880 15200 raft_consensus.cc:2749] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:26:24.785964 10895 leader_election.cc:304] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:26:24.775553 10819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:24.783995 11588 leader_election.cc:304] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:24.790675 11588 leader_election.cc:304] T e9331e5342644ca2bae19187b083a7d5 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:24.780572 14962 leader_election.cc:290] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:24.785014 15238 raft_consensus.cc:2804] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:26:24.777555 15174 consensus_queue.cc:1059] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 12:26:24.795835 15101 raft_consensus.cc:3055] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:24.796263 15101 raft_consensus.cc:740] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
W20260709 12:26:24.797196 10894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:24.798439 15223 consensus_queue.cc:1059] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:26:24.800195 15159 raft_consensus.cc:2749] T e9331e5342644ca2bae19187b083a7d5 P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:24.781948 15089 raft_consensus.cc:2749] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:26:24.804459 15219 raft_consensus.cc:515] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:24.770267 15217 consensus_queue.cc:1059] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 12:26:24.816793 10820 leader_election.cc:304] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:24.789814 15215 raft_consensus.cc:2749] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:26:24.824028 14954 raft_consensus.cc:2749] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:26:24.794090 11588 leader_election.cc:304] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:24.795332 15238 raft_consensus.cc:493] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:24.800427 15241 raft_consensus.cc:3055] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:26:24.852654 10924 raft_consensus.cc:2468] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 11.
I20260709 12:26:24.835963 15219 leader_election.cc:290] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:24.823740 15223 raft_consensus.cc:2749] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:26:24.840807 15188 raft_consensus.cc:515] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:24.862272 15188 leader_election.cc:290] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:24.863001 10923 raft_consensus.cc:1240] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:24.842494 15237 leader_election.cc:290] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 12 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:24.788429 15242 raft_consensus.cc:515] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:24.844815 15183 raft_consensus.cc:515] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:24.865834 15242 leader_election.cc:290] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:24.866125 11623 raft_consensus.cc:1240] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 7. Current term is 8. Ops: []
I20260709 12:26:24.866652 11003 raft_consensus.cc:1240] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 6. Current term is 7. Ops: []
I20260709 12:26:24.806892 15220 consensus_queue.cc:1059] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:26:24.868556 15220 raft_consensus.cc:3055] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:26:24.849133 15217 raft_consensus.cc:3055] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:26:24.849776 15256 raft_consensus.cc:2804] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:26:24.850976 10892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:24.831194 15238 raft_consensus.cc:3060] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:24.793713 15218 raft_consensus.cc:3060] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:24.853684 11588 leader_election.cc:304] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:24.857431 15176 raft_consensus.cc:2749] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:26:24.852777 15241 raft_consensus.cc:740] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:24.792768 15259 raft_consensus.cc:2749] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:24.848613 15160 raft_consensus.cc:515] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:24.854831 10820 leader_election.cc:304] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:24.872677 10895 leader_election.cc:304] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:24.793525 15053 consensus_queue.cc:1059] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
W20260709 12:26:24.876096 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 44719.2us
I20260709 12:26:24.843389 15216 raft_consensus.cc:515] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:24.882962 10895 leader_election.cc:304] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:24.880108 11615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:24.873317 15217 raft_consensus.cc:740] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:26:24.885500 11588 leader_election.cc:304] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:24.896546 15224 raft_consensus.cc:3060] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:24.897254 15255 tablet_replica.cc:333] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040: stopping tablet replica
I20260709 12:26:24.897897 15237 raft_consensus.cc:2749] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:24.876701 15215 raft_consensus.cc:2749] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:24.896584 15217 consensus_queue.cc:260] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:24.899530 15217 raft_consensus.cc:3060] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:24.887041 11615 raft_consensus.cc:3060] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:24.883481 11618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:24.905573 11618 raft_consensus.cc:3060] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:26:24.885913 15196 raft_consensus.cc:2804] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:26:24.871865 15220 raft_consensus.cc:740] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:26:24.874755 15256 raft_consensus.cc:493] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:24.908046 15256 raft_consensus.cc:3060] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:24.897146 11588 leader_election.cc:304] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:24.910307 15231 raft_consensus.cc:2749] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:26:24.910719 11588 leader_election.cc:304] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:24.865859 15183 leader_election.cc:290] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 8 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:24.907353 15196 raft_consensus.cc:697] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 12 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:24.889706 15241 consensus_queue.cc:260] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:24.912465 10893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:24.912571 15196 consensus_queue.cc:237] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:24.908453 15220 consensus_queue.cc:260] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:24.914656 11588 leader_election.cc:304] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:24.923420 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:24.923503 15241 raft_consensus.cc:3060] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:24.928437 10848 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a6a28416571247df878823d464c05f1e"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
mode: GRACEFUL
new_leader_uuid: "3c52e0825c02476e89d84da9bb849f5d"
 from {username='slave'} at 127.0.0.1:47358
I20260709 12:26:24.938973 10848 raft_consensus.cc:606] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [term 2 LEADER]: Received request to transfer leadership to TS 3c52e0825c02476e89d84da9bb849f5d
I20260709 12:26:24.941381 10968 leader_election.cc:304] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:24.947844 15073 raft_consensus.cc:2749] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:24.948096 11619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:24.949211 11619 raft_consensus.cc:2393] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 8: Already voted for candidate 3c52e0825c02476e89d84da9bb849f5d in this term.
I20260709 12:26:24.951292 15073 consensus_queue.cc:1059] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:24.952656 15223 raft_consensus.cc:3055] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:26:24.953100 15223 raft_consensus.cc:740] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:24.953649 15176 raft_consensus.cc:3055] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:24.954098 15176 raft_consensus.cc:740] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:26:24.954792 15220 raft_consensus.cc:3060] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:24.954035 15223 consensus_queue.cc:260] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:24.955253 15176 consensus_queue.cc:260] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:24.959280 15176 raft_consensus.cc:3060] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:24.959661 10925 raft_consensus.cc:1240] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 4. Current term is 5. Ops: []
W20260709 12:26:24.928475 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 45572.6us
I20260709 12:26:24.797210 15101 consensus_queue.cc:260] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:24.931525 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:24.932188 11617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:24.932309 11620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:24.931723 11616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac8522e549a46e09593fa4c2e175557" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:24.933373 15203 raft_consensus.cc:2749] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:24.886566 15188 raft_consensus.cc:2804] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:24.976300 11620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5794ba618e514e28a7542ab6af39d8c9" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:24.971760 11616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:24.977083 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:24.978255 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:24.968024 10895 leader_election.cc:304] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:26:24.987118 10819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:24.991830 10920 raft_consensus.cc:1240] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 10. Current term is 11. Ops: []
I20260709 12:26:24.992259 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:24.997264 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:25.004357 11617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab816bcc6183447994a2cc013e46c5f8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:25.009824 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fd8fdac2fa449e9e184f3d668ea1a7" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:25.018060 11619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:25.019130 15255 raft_consensus.cc:2243] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:25.018153 11620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:25.023833 11620 raft_consensus.cc:2393] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 12: Already voted for candidate 3c52e0825c02476e89d84da9bb849f5d in this term.
I20260709 12:26:25.023298 15238 raft_consensus.cc:515] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:25.025740 11618 raft_consensus.cc:2468] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 6.
I20260709 12:26:25.026443 15231 raft_consensus.cc:2764] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:26:24.976668 15242 consensus_queue.cc:1048] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 12:26:25.028488 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:24.964110 15257 raft_consensus.cc:493] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:25.038859 10920 raft_consensus.cc:1240] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 6. Current term is 7. Ops: []
I20260709 12:26:25.043027 11617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:25.046216 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:25.047066 10849 raft_consensus.cc:3060] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:25.009819 15188 raft_consensus.cc:697] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 5 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:25.052007 11622 raft_consensus.cc:1240] T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:25.054418 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:25.010176 15053 raft_consensus.cc:2749] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:26:25.056577 10820 leader_election.cc:304] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:25.062379 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:25.031605 11619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352aa49c65194abbb863d7553a091f11" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:25.035115 15223 raft_consensus.cc:3060] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:25.066289 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:25.042093 15219 raft_consensus.cc:493] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:25.084642 14954 consensus_queue.cc:1059] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:26:25.058223 15101 raft_consensus.cc:3060] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:25.091053 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6a1da21304fcfacab384a6afc4101" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
W20260709 12:26:25.097940 10818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:25.107741 10895 leader_election.cc:304] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:25.079618 11618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef3220c51df47db8859f07ab745fad5" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:25.083933 15173 consensus_queue.cc:1059] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 12:26:25.076388 15024 consensus_queue.cc:1059] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 12:26:25.110809 10849 raft_consensus.cc:2468] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 6.
I20260709 12:26:25.092298 15255 raft_consensus.cc:2272] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:25.136205 15250 raft_consensus.cc:2749] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:26:25.050674 15257 raft_consensus.cc:515] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:25.140090 10895 leader_election.cc:304] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:25.094029 15238 leader_election.cc:290] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:26:25.145432 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:25.156606 10895 leader_election.cc:304] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:25.093726 15219 raft_consensus.cc:515] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:25.150777 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 94305.2us
I20260709 12:26:25.150259 15183 raft_consensus.cc:2749] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:26:25.154486 15200 raft_consensus.cc:2749] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:26:25.175711 10895 leader_election.cc:304] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:26:25.176537 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 69621.6us
I20260709 12:26:25.161957 15174 raft_consensus.cc:3055] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:26:25.179530 15174 raft_consensus.cc:740] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:25.154835 15188 consensus_queue.cc:237] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:25.180426 15174 consensus_queue.cc:260] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:25.181808 15174 raft_consensus.cc:3060] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:25.183934 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:25.177687 15160 leader_election.cc:290] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:25.152220 15218 raft_consensus.cc:2749] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:26:25.151988 15248 raft_consensus.cc:515] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:25.193415 10926 raft_consensus.cc:1240] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 7. Current term is 8. Ops: []
I20260709 12:26:25.195020 15200 raft_consensus.cc:2749] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:26:25.195856 15224 raft_consensus.cc:2749] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:26:25.197458 15024 raft_consensus.cc:3055] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:25.197887 15024 raft_consensus.cc:740] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:25.198835 15024 consensus_queue.cc:260] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:25.200999 15260 log.cc:927] Time spent T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:26:25.206216 15216 leader_election.cc:290] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 9 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:25.154809 15212 consensus_queue.cc:1059] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 12:26:25.225908 15163 raft_consensus.cc:3055] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:26:25.229707 15163 raft_consensus.cc:740] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:25.229894 15258 raft_consensus.cc:493] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:25.230471 15258 raft_consensus.cc:515] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:25.230719 15163 consensus_queue.cc:260] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:25.239840 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:25.235517 11624 raft_consensus.cc:2955] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Committing config change with OpId 9.10: config changed from index 9 to 10, VOTER e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:25.240264 15163 raft_consensus.cc:3060] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:25.248219 11615 raft_consensus.cc:2468] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 7.
I20260709 12:26:25.250166 15059 raft_consensus.cc:515] T 4ef3220c51df47db8859f07ab745fad5 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:25.251310 11621 raft_consensus.cc:1240] T 4ef3220c51df47db8859f07ab745fad5 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 5. Current term is 6. Ops: []
I20260709 12:26:25.251806 10925 raft_consensus.cc:1275] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:26:25.252648 15059 leader_election.cc:290] T 4ef3220c51df47db8859f07ab745fad5 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 6 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:25.252907 11616 raft_consensus.cc:1240] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 6. Current term is 7. Ops: []
I20260709 12:26:25.252992 10969 leader_election.cc:304] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:25.253938 15207 raft_consensus.cc:2804] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:26:25.254460 15207 raft_consensus.cc:697] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 7 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:26:25.255102 15258 leader_election.cc:290] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:25.255486 15207 consensus_queue.cc:237] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:25.203600 15073 raft_consensus.cc:2955] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:25.260703 15248 leader_election.cc:290] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:25.263141 15219 leader_election.cc:290] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:25.264637 15255 ts_tablet_manager.cc:1916] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:25.241262 11622 raft_consensus.cc:2955] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
W20260709 12:26:25.242139 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 66553.1us
I20260709 12:26:25.201238 11620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:25.245951 10926 raft_consensus.cc:1275] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:26:25.268234 11621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:25.266343 11616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b17195a94142039c40f598ed006c94" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:25.207202 15242 raft_consensus.cc:2955] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 LEADER]: Committing config change with OpId 9.10: config changed from index 9 to 10, VOTER e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:25.272997 15219 consensus_queue.cc:1059] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:26:25.243295 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 66280.9us
W20260709 12:26:25.279065 10969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:25.279853 10895 leader_election.cc:304] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:25.280575 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6a1da21304fcfacab384a6afc4101" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:25.284673 10847 raft_consensus.cc:1240] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Rejecting Update request from peer 3c52e0825c02476e89d84da9bb849f5d for earlier term 11. Current term is 12. Ops: []
I20260709 12:26:25.288586 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
W20260709 12:26:25.289307 10969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:25.289274 10968 leader_election.cc:304] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:25.291292 10895 leader_election.cc:304] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:25.294664 11002 raft_consensus.cc:1275] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:26:25.301844 10820 leader_election.cc:304] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:25.309358 11002 raft_consensus.cc:1275] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:26:25.310560 10853 raft_consensus.cc:1275] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:26:25.308540 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fd8fdac2fa449e9e184f3d668ea1a7" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:25.310779 10820 leader_election.cc:304] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:25.313002 10848 raft_consensus.cc:2393] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3c52e0825c02476e89d84da9bb849f5d in current term 7: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:26:25.281948 15024 raft_consensus.cc:3060] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:25.308461  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:26:25.316857 10895 leader_election.cc:304] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:25.318642 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:25.319202 10820 leader_election.cc:304] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:25.322623 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:25.321879 10820 leader_election.cc:304] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:25.317143  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:25.283622 15219 raft_consensus.cc:3055] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:26:25.334832 10968 leader_election.cc:304] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:25.331663 15173 raft_consensus.cc:2749] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:25.312435 15241 raft_consensus.cc:2749] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:26:25.314369 15217 raft_consensus.cc:2804] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:25.332386 15219 raft_consensus.cc:740] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:26:25.331995 15203 raft_consensus.cc:2749] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:26:25.344341 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6a1da21304fcfacab384a6afc4101" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:25.344717 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:25.312040 15251 raft_consensus.cc:2749] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:25.314122 15236 raft_consensus.cc:3060] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:25.346633 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
W20260709 12:26:25.347043 10818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:25.353032 10818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:25.349264 11622 raft_consensus.cc:1240] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [term 12 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 11. Current term is 12. Ops: []
I20260709 12:26:25.350072 10820 leader_election.cc:304] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:25.350440 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:25.356513 10820 leader_election.cc:304] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:25.357890 10820 leader_election.cc:304] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:25.328197 15053 raft_consensus.cc:2749] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:26:25.351146 11588 leader_election.cc:304] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:25.360168 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:25.360241 10820 leader_election.cc:304] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:26:25.361083 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 195048us
I20260709 12:26:25.365111 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:25.366218 14954 raft_consensus.cc:2749] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:25.346642 15217 raft_consensus.cc:697] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 6 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
W20260709 12:26:25.375025 10892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:25.366681 10820 leader_election.cc:304] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:25.393652 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:25.346463 15089 raft_consensus.cc:2749] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:26:25.392402 11588 leader_election.cc:304] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:25.412228 11620 raft_consensus.cc:1240] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 8. Current term is 9. Ops: []
W20260709 12:26:25.414945 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 70385.7us
I20260709 12:26:25.416821 10968 leader_election.cc:304] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:25.353469 15173 raft_consensus.cc:2749] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:25.418128 15258 raft_consensus.cc:2749] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:25.418813 14954 raft_consensus.cc:2749] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:25.366009 15265 raft_consensus.cc:2749] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:25.429153 11620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6a1da21304fcfacab384a6afc4101" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:25.429986 11620 raft_consensus.cc:2393] T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 5: Already voted for candidate 3c52e0825c02476e89d84da9bb849f5d in this term.
I20260709 12:26:25.364856 15218 raft_consensus.cc:2749] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:26:25.366514 15159 raft_consensus.cc:2749] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:26:25.443059  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:25.406574 11615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:25.442556 15224 raft_consensus.cc:493] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:25.453851 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:25.454640 10923 raft_consensus.cc:3060] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:25.454434 15224 raft_consensus.cc:515] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:25.456835 10926 raft_consensus.cc:1240] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:25.426780 15269 consensus_queue.cc:1059] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 12:26:25.458385 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b17195a94142039c40f598ed006c94" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:25.431988 11616 raft_consensus.cc:1240] T 4ef3220c51df47db8859f07ab745fad5 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 5. Current term is 6. Ops: []
I20260709 12:26:25.346150 15259 consensus_queue.cc:1059] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 12:26:25.461089 15259 raft_consensus.cc:3055] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:25.461612 15259 raft_consensus.cc:740] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:26:25.462047 15200 raft_consensus.cc:493] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:25.466138 15159 raft_consensus.cc:2749] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:26:25.406693 15251 consensus_queue.cc:1059] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:26:25.469444 15251 raft_consensus.cc:3055] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:26:25.469973 15251 raft_consensus.cc:740] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:25.473891 15219 consensus_queue.cc:260] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:25.475245 15219 raft_consensus.cc:3060] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:25.476254 15268 raft_consensus.cc:3055] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:26:25.476738 15268 raft_consensus.cc:740] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:25.477682 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:25.470896 15251 consensus_queue.cc:260] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:25.421875 10968 leader_election.cc:304] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
W20260709 12:26:25.431013 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 63376.3us
I20260709 12:26:25.408420 15257 leader_election.cc:290] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:25.391712 15267 raft_consensus.cc:2749] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:26:25.452600 15217 consensus_queue.cc:237] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:25.442121 15248 raft_consensus.cc:493] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:25.486552 15248 raft_consensus.cc:515] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:25.489399 15248 leader_election.cc:290] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:25.481150 10895 leader_election.cc:304] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:26:25.476306 15256 consensus_meta.cc:287] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d: Time spent flushing consensus metadata: real 0.568s	user 0.011s	sys 0.005s
I20260709 12:26:25.495796 15101 consensus_queue.cc:1048] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:26:25.495954 15256 raft_consensus.cc:515] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:25.498585 15256 leader_election.cc:290] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 8 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:25.499025 15251 raft_consensus.cc:3060] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:25.499287 11622 raft_consensus.cc:1240] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 7. Current term is 8. Ops: []
W20260709 12:26:25.446060 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 79462.9us
I20260709 12:26:25.505471 10820 leader_election.cc:304] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:25.506613 15163 raft_consensus.cc:3060] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:25.507257 10820 leader_election.cc:304] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:25.509922 15236 raft_consensus.cc:2749] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:26:25.511200 15082 raft_consensus.cc:2749] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:26:25.514609 10820 leader_election.cc:304] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
W20260709 12:26:25.515098 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 93329.7us
I20260709 12:26:25.515829 11002 raft_consensus.cc:2468] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 6.
I20260709 12:26:25.520025 10923 raft_consensus.cc:2468] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 6.
I20260709 12:26:25.444671 10927 raft_consensus.cc:2468] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 10.
W20260709 12:26:25.523566 10819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:25.529148 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:25.529884 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:25.462716 15259 consensus_queue.cc:260] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:25.530592 10853 raft_consensus.cc:2468] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 9.
I20260709 12:26:25.531213 10847 raft_consensus.cc:1240] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 7. Current term is 8. Ops: []
I20260709 12:26:25.530023 10848 raft_consensus.cc:1240] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 10. Current term is 11. Ops: []
I20260709 12:26:25.531922 15242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:37496 (request call id 83) took 1083 ms. Trace:
I20260709 12:26:25.535180 10922 raft_consensus.cc:1240] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 10. Current term is 11. Ops: []
W20260709 12:26:25.535210 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 141799us
I20260709 12:26:25.520242 15248 raft_consensus.cc:2749] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:26:25.537695 10895 leader_election.cc:304] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:25.538985 10895 leader_election.cc:304] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040
W20260709 12:26:25.540362 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 148092us
I20260709 12:26:25.547837 10926 raft_consensus.cc:1275] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:26:25.530434 15174 raft_consensus.cc:2749] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:25.462724 15200 raft_consensus.cc:515] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:25.549705 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef3220c51df47db8859f07ab745fad5" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:25.538513 10894 leader_election.cc:304] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:25.530611 15220 raft_consensus.cc:2804] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:26:25.560791 10968 leader_election.cc:304] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:25.553753 11588 leader_election.cc:304] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:25.526625 15203 consensus_queue.cc:1059] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 12:26:25.545827 15073 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:37496 (request call id 82) took 1144 ms. Trace:
I20260709 12:26:25.532475 15223 consensus_queue.cc:1059] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 12:26:25.531030 15101 consensus_queue.cc:1048] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:26:25.551313 15160 raft_consensus.cc:2749] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:26:25.546823 14962 raft_consensus.cc:2749] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:26:25.569304 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:25.576993 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:25.578034 11003 raft_consensus.cc:2468] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 8.
I20260709 12:26:25.578292 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:25.578452 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef3220c51df47db8859f07ab745fad5" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:25.579391 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:25.581840 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:25.567329 15271 raft_consensus.cc:2749] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:26:25.534725 15188 consensus_queue.cc:1059] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 12:26:25.562300 15238 raft_consensus.cc:2804] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:26:25.561697 15224 leader_election.cc:290] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:25.585222 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:25.565477 15259 raft_consensus.cc:3060] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:25.555898 15250 consensus_queue.cc:1059] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 12:26:25.573982 15264 consensus_queue.cc:1059] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 12:26:25.591872 15278 consensus_queue.cc:1059] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:26:25.571916 15263 raft_consensus.cc:2749] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:25.593130 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:25.566088 15258 consensus_queue.cc:1059] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:26:25.553972 15268 consensus_queue.cc:260] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:25.586994 15238 raft_consensus.cc:493] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:25.599946 15238 raft_consensus.cc:3060] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:25.600274 15250 raft_consensus.cc:3055] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:26:25.600759 15250 raft_consensus.cc:740] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:25.601666 15250 consensus_queue.cc:260] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:25.603048 15250 raft_consensus.cc:3060] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:25.589684 15218 consensus_queue.cc:1048] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:26:25.559453 15276 consensus_queue.cc:1059] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:26:25.606874 15200 leader_election.cc:290] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:25.608443 15264 raft_consensus.cc:3055] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:26:25.608788 15183 raft_consensus.cc:3055] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:26:25.609344 15183 raft_consensus.cc:740] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
I20260709 12:26:25.533514 15242 rpcz_store.cc:276] 0709 12:26:24.448184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:24.449526 (+  1342us) service_pool.cc:224] Handling call
0709 12:26:24.467059 (+ 17533us) spinlock_profiling.cc:243] Waited 1.67 ms on lock 0x7b2c0010cc78. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7593781a11 00007f7593790a0a 00007f7593790693 00007f7593790631 00007f7594ec3902 00007f7594ec36dd 00007f7594e8ef3f 00007f7594e8e6b3 00007f7594e869fa 00007f7599e4e4c9 00007f75933cac54
0709 12:26:24.523715 (+ 56656us) log.cc:844] Serialized 494 byte log entry
0709 12:26:25.531817 (+1008102us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1952,"raft.queue_time_us":4524,"raft.run_cpu_time_us":1509,"raft.run_wall_time_us":1508,"spinlock_wait_cycles":3831680,"thread_start_us":126351,"threads_started":1,"wal-append.queue_time_us":126718}
I20260709 12:26:25.615957 15212 consensus_queue.cc:1059] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:26:25.608888 15264 raft_consensus.cc:740] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:25.621568 10739 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 87cb7b380c8446e6ab1355c203218967 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:25.622304 15268 raft_consensus.cc:3060] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:25.586290 15174 consensus_queue.cc:1048] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:26:25.610771 15183 consensus_queue.cc:260] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:25.614456 10750 catalog_manager.cc:5697] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 6 to 7, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 7 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:25.660090 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 99364.6us
I20260709 12:26:25.624965 11588 leader_election.cc:304] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:25.650070 10820 leader_election.cc:304] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:25.569612 15073 rpcz_store.cc:276] 0709 12:26:24.392521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:24.392642 (+   121us) service_pool.cc:224] Handling call
0709 12:26:24.529791 (+137149us) log.cc:844] Serialized 494 byte log entry
0709 12:26:24.924005 (+394214us) spinlock_profiling.cc:243] Waited 1.05 ms on lock 0x7b54000e81a0. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e08b26 00007f7594e0249a 00007f7594e01714 00007f7594de1eaa 00007f7594de8d53 00007f7594de8cd9 00007f7594de8c69 00007f7594de8c31 00007f7594de7dfd 0000000000388634
0709 12:26:25.536508 (+612503us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15552,"raft.queue_time_us":395,"raft.run_cpu_time_us":3321,"raft.run_wall_time_us":316375,"spinlock_wait_cycles":2414976,"thread_start_us":78915,"threads_started":1,"wal-append.queue_time_us":135330}
I20260709 12:26:25.664381 10739 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3357adbb6a514faf958aff009c4e4af8 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:25.667245 15220 raft_consensus.cc:697] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:26:25.663849 15196 raft_consensus.cc:2749] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:25.670198 11588 leader_election.cc:304] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:25.675802 11588 leader_election.cc:304] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:25.677217 11588 leader_election.cc:304] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:25.681150 15163 raft_consensus.cc:2749] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:25.682200 15269 raft_consensus.cc:2749] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:26:25.684429 15059 raft_consensus.cc:3060] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:25.687536 11588 leader_election.cc:304] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:25.677351 10820 leader_election.cc:304] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:25.693732 10849 raft_consensus.cc:2468] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 5.
I20260709 12:26:25.670248 15271 raft_consensus.cc:2749] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:26:25.673512 15255 ts_tablet_manager.cc:1929] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 5.6
I20260709 12:26:25.695289 11588 leader_election.cc:304] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
W20260709 12:26:25.701344 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 131054us
I20260709 12:26:25.688665 15269 raft_consensus.cc:2749] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:26:25.704406 10895 leader_election.cc:304] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:25.668349 15220 consensus_queue.cc:237] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:25.706229 10820 raft_consensus.cc:2686] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:26:25.689491 15278 raft_consensus.cc:2749] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:25.703754 15264 consensus_queue.cc:260] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:25.712927 15237 raft_consensus.cc:2749] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:25.719452 10895 leader_election.cc:304] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:25.714607 15255 log.cc:1199] T 4ef3220c51df47db8859f07ab745fad5 P 80cd7d227db44f34a6108591dad9c040: Deleting WAL directory at /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599781984018-9681-0/minicluster-data/ts-0-root/wals/4ef3220c51df47db8859f07ab745fad5
I20260709 12:26:25.754205 10895 leader_election.cc:304] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:25.713636 15214 raft_consensus.cc:2749] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:26:25.668608 15288 consensus_queue.cc:1048] T 435d66c6d38c4d8a90a81975a6a0cb13 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:26:25.756341 10895 leader_election.cc:304] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
W20260709 12:26:25.757896 10818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:25.760087 10820 leader_election.cc:304] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:25.777040 10968 leader_election.cc:304] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:25.778340 11002 raft_consensus.cc:1275] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:26:25.761039 10895 leader_election.cc:304] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
W20260709 12:26:25.766069 10818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:25.785308 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:25.786203 10997 raft_consensus.cc:2468] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 9.
I20260709 12:26:25.787429 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:25.788462 10994 raft_consensus.cc:1275] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:26:25.792011 15255 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56372 (request call id 84) took 1126 ms. Trace:
I20260709 12:26:25.792722 15255 rpcz_store.cc:276] 0709 12:26:24.667069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:24.670298 (+  3229us) service_pool.cc:224] Handling call
0709 12:26:24.887894 (+217596us) ts_tablet_manager.cc:1151] Deleting tablet 4ef3220c51df47db8859f07ab745fad5
0709 12:26:24.896820 (+  8926us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:26:25.485936 (+589116us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:25.673368 (+187432us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:25.791883 (+118515us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":117185,"tablet-delete.queue_time_us":207040,"thread_start_us":136493,"threads_started":1}
I20260709 12:26:25.760533 15174 raft_consensus.cc:493] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:25.798082 15174 raft_consensus.cc:515] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:25.774848 15082 raft_consensus.cc:2749] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:26:25.801283 15264 raft_consensus.cc:3060] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:25.789417 15214 raft_consensus.cc:2804] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:26:25.759150 15283 raft_consensus.cc:2749] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:26:25.828262 15285 raft_consensus.cc:493] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
W20260709 12:26:25.838490 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 143288us
I20260709 12:26:25.759665 15223 raft_consensus.cc:2749] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:26:25.843883 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 66908.1us
I20260709 12:26:25.767906 15284 raft_consensus.cc:2804] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:25.852715 10968 leader_election.cc:304] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:25.854818 15259 raft_consensus.cc:2749] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:25.844740 15059 raft_consensus.cc:2749] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:26:25.845490 15236 raft_consensus.cc:493] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:25.843029 15082 raft_consensus.cc:493] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:25.856740 11588 leader_election.cc:304] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:25.840728 15214 raft_consensus.cc:493] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:25.874222 15059 raft_consensus.cc:2749] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:26:25.875435 10998 raft_consensus.cc:2468] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 6.
I20260709 12:26:25.880717 15236 raft_consensus.cc:515] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:25.840308 15251 consensus_queue.cc:1048] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 12:26:25.892468 10738 catalog_manager.cc:5028] TS 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): tablet 4ef3220c51df47db8859f07ab745fad5 (table test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]) successfully deleted
W20260709 12:26:25.893309 10738 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 55213us
I20260709 12:26:25.882812 15214 raft_consensus.cc:3060] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:25.867081 15284 raft_consensus.cc:697] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:25.878062 15082 raft_consensus.cc:515] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:25.857538 15285 raft_consensus.cc:515] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:25.932545 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 79952.5us
I20260709 12:26:25.932696 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:25.935161 10924 raft_consensus.cc:1240] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:26:25.940558 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:25.941798 11003 raft_consensus.cc:2468] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 5.
I20260709 12:26:25.922542 15287 raft_consensus.cc:3055] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:25.944336 10820 leader_election.cc:304] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:25.921562 15238 raft_consensus.cc:515] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:25.938520 15174 leader_election.cc:290] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:25.952268 15196 raft_consensus.cc:2804] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:25.958141 15196 raft_consensus.cc:493] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:25.958559 15196 raft_consensus.cc:3060] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:25.953863 15296 raft_consensus.cc:2804] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:26:25.954275 15176 consensus_queue.cc:1059] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:25.954439 15284 consensus_queue.cc:237] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:25.955199 15285 leader_election.cc:290] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:25.956349 15082 leader_election.cc:290] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:25.960041 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad766f48812a4ddeb383179b1d84907b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:25.962513 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad766f48812a4ddeb383179b1d84907b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:25.964272 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad766f48812a4ddeb383179b1d84907b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:25.964766 10924 raft_consensus.cc:2393] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 4: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:26:25.961915 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad766f48812a4ddeb383179b1d84907b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:25.965085 10850 raft_consensus.cc:2468] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 4.
I20260709 12:26:25.964073 11003 raft_consensus.cc:2468] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 3.
I20260709 12:26:25.969602 10820 leader_election.cc:304] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:25.967816 10968 leader_election.cc:304] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:25.969386 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:25.969442 10848 raft_consensus.cc:2955] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Committing config change with OpId 9.10: config changed from index 9 to 10, VOTER e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:25.951977 15287 raft_consensus.cc:740] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:26:25.970741 10924 raft_consensus.cc:2468] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 10.
I20260709 12:26:25.985477 10921 raft_consensus.cc:1240] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 10. Current term is 11. Ops: []
I20260709 12:26:25.979372 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:25.974179 15296 raft_consensus.cc:697] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:26:25.989992 11003 raft_consensus.cc:2468] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 10.
I20260709 12:26:25.990489 15296 consensus_queue.cc:237] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:25.978997 15294 log.cc:927] Time spent T 00000000000000000000000000000000 P 9619ad7a9e7f4d9b8039487e3ee77243: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 12:26:25.975740 15082 raft_consensus.cc:2804] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:25.994568 15082 raft_consensus.cc:493] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:25.987110 15207 raft_consensus.cc:2804] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:25.971920 15272 raft_consensus.cc:993] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040: : Instructing follower 3c52e0825c02476e89d84da9bb849f5d to start an election
I20260709 12:26:25.995021 15082 raft_consensus.cc:3060] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:26.017380 15238 leader_election.cc:290] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 10 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:25.974716 15236 leader_election.cc:290] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:26.019276 15224 raft_consensus.cc:3055] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:26:26.019795 15224 raft_consensus.cc:740] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:26.002619 15207 raft_consensus.cc:493] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:26.020917 15207 raft_consensus.cc:3060] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:26.020738 15224 consensus_queue.cc:260] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:26.022742 15224 raft_consensus.cc:3060] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:26.007371 15285 consensus_queue.cc:1059] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 12:26:26.026419 15214 raft_consensus.cc:515] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:26.027029 15196 raft_consensus.cc:515] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:26.031186 15196 leader_election.cc:290] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:26.033929 15171 raft_consensus.cc:3055] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:26:26.034556 15171 raft_consensus.cc:740] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:26.032861 15287 consensus_queue.cc:260] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:26.042647 15299 log.cc:927] Time spent T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.114s	user 0.000s	sys 0.002s
I20260709 12:26:26.036069 15089 raft_consensus.cc:3055] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:26:26.044847 15089 raft_consensus.cc:740] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:26:26.045802 15089 consensus_queue.cc:260] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:26.046989 15089 raft_consensus.cc:3060] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:26.032971 15256 raft_consensus.cc:3055] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:26:26.048373 15256 raft_consensus.cc:740] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
I20260709 12:26:26.049505 15256 consensus_queue.cc:260] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:26.037108 15171 consensus_queue.cc:260] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:26.053296 15171 raft_consensus.cc:3060] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:26.058898 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:26.038727 10819 leader_election.cc:304] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:26.059854 11001 raft_consensus.cc:3060] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:26:26.060765 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 204148us
I20260709 12:26:25.969655 15298 raft_consensus.cc:493] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:26.068835 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:26.070510 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:26.071120 11000 raft_consensus.cc:3060] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:26.065485 10926 raft_consensus.cc:1240] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:26:26.051295 15256 raft_consensus.cc:3060] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:26.056197 15272 consensus_queue.cc:1048] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:26:26.079928 15267 raft_consensus.cc:2804] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:26.080410 15267 raft_consensus.cc:493] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:26.080560 15196 raft_consensus.cc:493] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:26.080824 15267 raft_consensus.cc:3060] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:26.083665 10847 raft_consensus.cc:1240] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Rejecting Update request from peer 3c52e0825c02476e89d84da9bb849f5d for earlier term 11. Current term is 12. Ops: []
I20260709 12:26:26.061715 15101 raft_consensus.cc:1081] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [term 2 LEADER]: Signalling peer 3c52e0825c02476e89d84da9bb849f5d to start an election
I20260709 12:26:26.092794 10751 catalog_manager.cc:5697] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: config changed from index 5 to 6, VOTER 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) evicted. New cstate: current_term: 4 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:26.077097 15238 consensus_queue.cc:1048] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:26:26.089030 11000 raft_consensus.cc:2468] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 10.
I20260709 12:26:26.081295 15196 raft_consensus.cc:515] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:26.061931 15287 raft_consensus.cc:3060] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:26.098074 10895 leader_election.cc:304] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
W20260709 12:26:26.119956 10894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:26.124272 10850 raft_consensus.cc:1275] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 7 index: 10. (index mismatch)
I20260709 12:26:26.096244 10752 catalog_manager.cc:5697] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 4 to 5, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 5 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:26.127480 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:26.129173 10847 raft_consensus.cc:1240] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 5. Current term is 6. Ops: []
I20260709 12:26:26.131824 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:26.134537 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:26.136615 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:26.137284 10854 raft_consensus.cc:3060] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:26:26.143358 10894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:26.145361 11588 leader_election.cc:304] T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:26.150677 10926 raft_consensus.cc:1275] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:26:26.151634 15174 consensus_queue.cc:1059] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 12:26:26.153144 15160 raft_consensus.cc:493] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:26.153854 15160 raft_consensus.cc:515] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:26.149236 15250 raft_consensus.cc:493] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:26.156392 15160 leader_election.cc:290] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:26.157472 10846 raft_consensus.cc:1240] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 11. Current term is 12. Ops: []
I20260709 12:26:26.155719 15196 leader_election.cc:290] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:26.163800 15216 raft_consensus.cc:2804] T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:26.139153 15183 raft_consensus.cc:3060] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:26.118739 15284 raft_consensus.cc:2804] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:26:26.173415 15217 consensus_queue.cc:1048] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:26:26.174695 15082 raft_consensus.cc:515] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:26.175103 15216 raft_consensus.cc:697] T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d [term 5 LEADER]: Becoming Leader. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
I20260709 12:26:26.176285 15207 raft_consensus.cc:515] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:26.177265 15082 leader_election.cc:290] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:26.178695 15207 leader_election.cc:290] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:26.078531 15298 raft_consensus.cc:515] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:26.176224 15216 consensus_queue.cc:237] T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:26.200031 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:26.201062 10921 raft_consensus.cc:2468] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 8.
I20260709 12:26:26.183084 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c6d38c4d8a90a81975a6a0cb13" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:26.182950 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad766f48812a4ddeb383179b1d84907b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:26.188191 15298 leader_election.cc:290] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:26.189956 11624 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a6a28416571247df878823d464c05f1e"
dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
 from {username='slave'} at 127.0.0.1:45890
I20260709 12:26:26.158711 15101 raft_consensus.cc:493] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:26.147441 15219 consensus_queue.cc:1048] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 12:26:26.180374 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c6d38c4d8a90a81975a6a0cb13" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:26.181372 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:26.191977 15188 consensus_queue.cc:1059] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:26.205806 10968 leader_election.cc:304] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:26.156610 15250 raft_consensus.cc:515] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:26.203294 11624 raft_consensus.cc:493] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:26.216924 11624 raft_consensus.cc:3060] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:26.203435 10923 raft_consensus.cc:2393] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 4: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:26:26.206022 10995 raft_consensus.cc:2468] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 9.
I20260709 12:26:26.206697 11001 raft_consensus.cc:2468] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 6.
I20260709 12:26:26.205967 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad766f48812a4ddeb383179b1d84907b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:26.220846 10921 raft_consensus.cc:3060] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:26.211624 15101 raft_consensus.cc:515] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:26.214236 15188 raft_consensus.cc:3055] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:26:26.215029 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad766f48812a4ddeb383179b1d84907b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:26.228003 10994 raft_consensus.cc:3060] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:26.207257 10894 leader_election.cc:304] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:26.223711 11000 raft_consensus.cc:1240] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 12:26:26.225454 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad766f48812a4ddeb383179b1d84907b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:26.230950 10846 raft_consensus.cc:2368] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for earlier term 4. Current term is 5.
I20260709 12:26:26.231174 11620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:26.235314 11620 raft_consensus.cc:2393] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 9: Already voted for candidate 3c52e0825c02476e89d84da9bb849f5d in this term.
I20260709 12:26:26.235961 10895 leader_election.cc:304] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:26.243753 10894 leader_election.cc:304] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:26.210422 15284 raft_consensus.cc:697] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 10 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:26.227456 15188 raft_consensus.cc:740] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:26.238590 15222 raft_consensus.cc:2804] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:26:26.254035 15222 raft_consensus.cc:493] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:26.252058 11624 raft_consensus.cc:515] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:26.255347 10921 raft_consensus.cc:2468] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 5.
I20260709 12:26:26.254534 15222 raft_consensus.cc:3060] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:26.245836 15241 raft_consensus.cc:2749] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:26:26.267107 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef3220c51df47db8859f07ab745fad5" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:26.270079 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:26.247793 15160 raft_consensus.cc:2804] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:26:26.263402 15250 leader_election.cc:290] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:26.265614 15101 leader_election.cc:290] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:26.256950 10819 leader_election.cc:304] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:26.271715 10968 leader_election.cc:400] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 election: Vote denied by peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265) with higher term. Message: Invalid argument: T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for earlier term 4. Current term is 5.
I20260709 12:26:26.278879 10968 leader_election.cc:403] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:26:26.272927 11624 leader_election.cc:290] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 3 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:26.279933 10854 raft_consensus.cc:2468] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 10.
I20260709 12:26:26.252317 15238 raft_consensus.cc:2749] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:26.281973 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:26.292775 10921 raft_consensus.cc:2468] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 7.
I20260709 12:26:26.289892 10994 raft_consensus.cc:2468] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 5.
I20260709 12:26:26.295344 10819 leader_election.cc:304] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:26.254096 15188 consensus_queue.cc:260] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:26.271947 15160 raft_consensus.cc:493] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:26.292112 15236 raft_consensus.cc:2804] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:26.310806 11620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:26.314039 11620 raft_consensus.cc:2468] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 9.
I20260709 12:26:26.272100 15224 consensus_queue.cc:1059] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 12:26:26.296434 15220 raft_consensus.cc:2749] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265) with higher term. Message: Invalid argument: T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for earlier term 4. Current term is 5.
I20260709 12:26:26.300659 15101 raft_consensus.cc:2804] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:26:26.309424 15160 raft_consensus.cc:3060] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:26.328061 15188 raft_consensus.cc:3060] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:26.320039 15236 raft_consensus.cc:697] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [term 5 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:26.337273 11615 raft_consensus.cc:1275] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 7 index: 10. (index mismatch)
I20260709 12:26:26.328298 15101 raft_consensus.cc:493] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:26.348374 15101 raft_consensus.cc:3060] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:26.357476 15297 consensus_queue.cc:1048] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:26:26.363276 14962 raft_consensus.cc:3055] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:26:26.364007 14962 raft_consensus.cc:740] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:26.365391 15214 leader_election.cc:290] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:26.365187 14962 consensus_queue.cc:260] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:26.367048 14962 raft_consensus.cc:3060] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:26.370489 15196 raft_consensus.cc:493] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:26.316470 15284 consensus_queue.cc:237] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:26.385527 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef3220c51df47db8859f07ab745fad5" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:26.467700 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:26.468708 10845 raft_consensus.cc:3055] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:26.469084 10845 raft_consensus.cc:740] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:26.467729 11624 raft_consensus.cc:2393] T 4ef3220c51df47db8859f07ab745fad5 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 6: Already voted for candidate 3c52e0825c02476e89d84da9bb849f5d in this term.
I20260709 12:26:26.481356 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:26.482208 10923 raft_consensus.cc:3060] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:26.469857 10845 consensus_queue.cc:260] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:26.493989 15089 raft_consensus.cc:493] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:26.494665 15089 raft_consensus.cc:515] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:26.495754 15236 consensus_queue.cc:237] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:26.496912 15089 leader_election.cc:290] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:26.497479 15089 raft_consensus.cc:493] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:26.497959 15089 raft_consensus.cc:515] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:26.506275 10895 leader_election.cc:304] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:26.508525 15214 raft_consensus.cc:3060] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:26.508852 15224 raft_consensus.cc:493] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:26.509449 15224 raft_consensus.cc:515] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:26.511860 15224 leader_election.cc:290] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
W20260709 12:26:26.515134 15294 log.cc:927] Time spent T 00000000000000000000000000000000 P 9619ad7a9e7f4d9b8039487e3ee77243: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 12:26:26.523983 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:26.519840 15268 raft_consensus.cc:493] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:26.526430 10924 raft_consensus.cc:1275] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:26:26.524850 10921 raft_consensus.cc:2393] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 7: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:26:26.529018 11616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fd8fdac2fa449e9e184f3d668ea1a7" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:26.468743 15258 raft_consensus.cc:493] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
W20260709 12:26:26.542009 10817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:26.542444 10854 raft_consensus.cc:1275] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:26:26.379367 15196 raft_consensus.cc:515] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:26.573383 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:26.511423 15188 raft_consensus.cc:493] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:26.539811 15297 consensus_queue.cc:1048] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 12:26:26.589426 15272 raft_consensus.cc:493] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:26.540310 15268 raft_consensus.cc:515] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:26.600993 15300 log.cc:927] Time spent T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 12:26:26.631762 15285 raft_consensus.cc:493] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:26.635141 15256 consensus_meta.cc:287] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d: Time spent flushing consensus metadata: real 0.550s	user 0.010s	sys 0.004s
I20260709 12:26:26.591130 15207 consensus_queue.cc:1048] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:26:26.635310 15285 raft_consensus.cc:515] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:26.632287 15242 raft_consensus.cc:493] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:26.637631 15242 raft_consensus.cc:515] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:26.639588 15272 raft_consensus.cc:515] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:26.640756 15251 raft_consensus.cc:493] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:26.641306 15251 raft_consensus.cc:515] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:26.641855 15272 leader_election.cc:290] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:26.642463 15272 raft_consensus.cc:493] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:26.633011 15196 leader_election.cc:290] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:26:26.669531 10893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:26.551288 15258 raft_consensus.cc:515] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:26.560067 15267 raft_consensus.cc:515] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:26.697969 10923 raft_consensus.cc:2468] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 3.
I20260709 12:26:26.643419 15251 leader_election.cc:290] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:26.704636 11588 leader_election.cc:304] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
W20260709 12:26:26.693229 15287 consensus_meta.cc:287] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08: Time spent flushing consensus metadata: real 0.562s	user 0.005s	sys 0.011s
I20260709 12:26:26.642886 15272 raft_consensus.cc:515] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:26.670701 15248 raft_consensus.cc:493] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:26.734879 15257 raft_consensus.cc:2804] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:26.608278 15188 raft_consensus.cc:515] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:26.734634 15089 leader_election.cc:290] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:26.735534 15248 raft_consensus.cc:515] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:26.758780 15283 raft_consensus.cc:493] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:26.783681 15188 leader_election.cc:290] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:26.784391 15268 leader_election.cc:290] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:26.784127 15283 raft_consensus.cc:515] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:26.786742 15248 leader_election.cc:290] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
W20260709 12:26:26.790084 15222 consensus_meta.cc:287] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08: Time spent flushing consensus metadata: real 0.523s	user 0.007s	sys 0.004s
I20260709 12:26:26.770496 10925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59626 (request call id 3496) took 1245 ms. Trace:
I20260709 12:26:26.790721 15222 raft_consensus.cc:515] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:26.764581 15257 raft_consensus.cc:697] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [term 3 LEADER]: Becoming Leader. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
I20260709 12:26:26.792945 15257 consensus_queue.cc:237] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:26.791337 10925 rpcz_store.cc:276] 0709 12:26:25.524755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:25.525405 (+   650us) service_pool.cc:224] Handling call
0709 12:26:25.526939 (+  1534us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:25.697439 (+170500us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:25.697493 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:25.699031 (+  1538us) log.cc:844] Serialized 26 byte log entry
0709 12:26:25.900009 (+200978us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:26:25.900050 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:26.701758 (+801708us) spinlock_profiling.cc:243] Waited 40.8 ms on lock 0x7b54003cd7d4. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e88e01 00007f7594e8783e 00007f7599e4c419 00007f75933c3bd4 00007f75933c3b62 00007f75933c3a91 00007f75933c3a0c 00007f75933c2cc2 00007f75931c348c 00007f75931c28c6
0709 12:26:26.701828 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:26.701934 (+   106us) raft_consensus.cc:1685] finished
0709 12:26:26.702241 (+   307us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:26.770418 (+ 68177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20002,"raft.queue_time_us":19163,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":5688,"spinlock_wait_cycles":93922048,"thread_start_us":266933,"threads_started":2,"wal-append.queue_time_us":206075}
I20260709 12:26:26.795974 15317 raft_consensus.cc:493] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:26.796569 15317 raft_consensus.cc:515] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:26.799341 15317 leader_election.cc:290] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:26.803735 15222 leader_election.cc:290] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 10 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:26.773320 15267 leader_election.cc:290] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 11 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:26.776628 15101 raft_consensus.cc:515] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:26.806123 10846 raft_consensus.cc:2368] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for earlier term 7. Current term is 8.
I20260709 12:26:26.781014 15272 leader_election.cc:290] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:26.745492 15160 raft_consensus.cc:515] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:26.782660 15258 leader_election.cc:290] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:26.809449 10750 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60736 (request call id 388) took 1282 ms. Trace:
W20260709 12:26:26.816107 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 329939us
W20260709 12:26:26.817127 10926 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.061s	sys 0.132s
I20260709 12:26:26.826804 11616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
W20260709 12:26:26.832531 10926 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.061s	sys 0.132s
I20260709 12:26:26.832906 11616 raft_consensus.cc:2468] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 4.
I20260709 12:26:26.834123 10895 leader_election.cc:304] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:26.835093 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:26.837761 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:26.842845 10926 raft_consensus.cc:2468] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 11.
I20260709 12:26:26.849404 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:26.831010 10750 rpcz_store.cc:276] 0709 12:26:25.527185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:25.527310 (+   125us) service_pool.cc:224] Handling call
0709 12:26:26.809343 (+1282033us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:25.761509 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:25.762339 (+   830us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:25.762392 (+    53us) write_op.cc:435] Acquired schema lock
0709 12:26:25.762420 (+    28us) tablet.cc:662] Decoding operations
0709 12:26:25.762859 (+   439us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:25.762948 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:25.762995 (+    47us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:26:25.763219 (+   224us) tablet.cc:701] Row locks acquired
0709 12:26:25.763243 (+    24us) write_op.cc:260] PREPARE: finished
0709 12:26:25.763439 (+   196us) write_op.cc:270] Start()
0709 12:26:25.763748 (+   309us) write_op.cc:276] Timestamp: P: 1783599985763376 usec, L: 0
0709 12:26:25.763784 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 12:26:25.764831 (+  1047us) log.cc:844] Serialized 533 byte log entry
0709 12:26:26.092219 (+327388us) op_driver.cc:464] REPLICATION: finished
0709 12:26:26.295961 (+203742us) write_op.cc:301] APPLY: starting
0709 12:26:26.301914 (+  5953us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:26.346527 (+ 44613us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:26.346662 (+   135us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:26.347700 (+  1038us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:26.347931 (+   231us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 12:26:26.347987 (+    56us) write_op.cc:312] APPLY: finished
0709 12:26:26.348201 (+   214us) log.cc:844] Serialized 25 byte log entry
0709 12:26:26.348391 (+   190us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:26.348491 (+   100us) write_op.cc:454] Released schema lock
0709 12:26:26.348548 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:26.348995 (+   447us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:26.349022 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":1920,"child_traces":[["op",{"apply.queue_time_us":187300,"apply.run_cpu_time_us":4550,"apply.run_wall_time_us":55678,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8307,"num_ops":1,"prepare.queue_time_us":94787,"prepare.run_cpu_time_us":10126,"prepare.run_wall_time_us":80154,"raft.queue_time_us":99949,"raft.run_cpu_time_us":41474,"raft.run_wall_time_us":174621,"replication_time_us":328277,"thread_start_us":253740,"threads_started":4,"wal-append.queue_time_us":20603}]]}
I20260709 12:26:26.799129 15089 raft_consensus.cc:493] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:26.853324 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:26.855530 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:26.856642 10923 raft_consensus.cc:3060] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:26.851032 10926 raft_consensus.cc:2468] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 7.
I20260709 12:26:26.840808 15248 raft_consensus.cc:493] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:26.864986 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:26.865785 10851 raft_consensus.cc:2468] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 4.
I20260709 12:26:26.859184 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fd8fdac2fa449e9e184f3d668ea1a7" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:26.866487 10847 raft_consensus.cc:2468] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 7.
I20260709 12:26:26.863726 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:26.866219 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:26.820581 15283 leader_election.cc:290] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:26.870456 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:26.873063 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:26.876190 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:26.867754 10926 raft_consensus.cc:2468] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 11.
I20260709 12:26:26.847903 15272 raft_consensus.cc:493] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:26.851428 15224 raft_consensus.cc:2804] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:26.879534 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:26.887269 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:26.888276 11001 raft_consensus.cc:2468] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 10.
I20260709 12:26:26.888581 10926 raft_consensus.cc:2468] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 7.
I20260709 12:26:26.862397 15317 raft_consensus.cc:493] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:26.881899 11003 raft_consensus.cc:2393] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 6: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
W20260709 12:26:26.884035 10969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 102930us
I20260709 12:26:26.885418 10854 raft_consensus.cc:3060] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:26.877341 11002 raft_consensus.cc:2468] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 8.
I20260709 12:26:26.887236 10924 raft_consensus.cc:1275] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:26:26.888794 15272 raft_consensus.cc:515] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:26.887307 15258 raft_consensus.cc:493] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:26.888047 15224 raft_consensus.cc:493] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:26.894491 15272 leader_election.cc:290] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:26.894706 10847 raft_consensus.cc:2468] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 11.
I20260709 12:26:26.895915 15101 leader_election.cc:290] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:26.895290 15317 raft_consensus.cc:515] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:26.897195 10994 raft_consensus.cc:1275] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:26:26.897759 15224 raft_consensus.cc:3060] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:26.885311 11615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:26.903815 15258 raft_consensus.cc:515] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:26.904824 11615 raft_consensus.cc:2393] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 8: Already voted for candidate 3c52e0825c02476e89d84da9bb849f5d in this term.
I20260709 12:26:26.879544 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:26.908766 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:26.909547 10851 raft_consensus.cc:2468] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 7.
I20260709 12:26:26.910488 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac83709373b4efd9c3aa1472a9f9022" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:26.854404 15279 raft_consensus.cc:493] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:26.911892 15279 raft_consensus.cc:515] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:26.914201 15279 leader_election.cc:290] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:26.890053 10895 leader_election.cc:304] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:26.915716 14962 raft_consensus.cc:2804] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:26.916117 14962 raft_consensus.cc:493] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:26.916474 14962 raft_consensus.cc:3060] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:26.917162 15160 leader_election.cc:290] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 election: Requested vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:26.918367 15214 raft_consensus.cc:2749] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:26:26.918805 10818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:26.863548 15089 raft_consensus.cc:515] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:26.883951 10923 raft_consensus.cc:2468] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 11.
I20260709 12:26:26.899247 15317 leader_election.cc:290] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:26.920569 10895 leader_election.cc:304] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:26.929265 11616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:26.929878 11616 raft_consensus.cc:3060] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:26.930383 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:26.931082 11001 raft_consensus.cc:2368] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for earlier term 9. Current term is 10.
I20260709 12:26:26.931493 10819 leader_election.cc:304] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:26.932228 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:26.932291 10895 leader_election.cc:400] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 election: Vote denied by peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945) with higher term. Message: Invalid argument: T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for earlier term 9. Current term is 10.
I20260709 12:26:26.932713 15279 raft_consensus.cc:2804] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:26.933156 10928 raft_consensus.cc:3060] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:26.933161 10895 leader_election.cc:403] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:26:26.933483 15279 raft_consensus.cc:493] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:26.934239 10819 leader_election.cc:304] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:26.933431 11621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:26.939198 10854 raft_consensus.cc:1275] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:26:26.944145 10819 leader_election.cc:304] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:26.934103 15279 raft_consensus.cc:3060] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:26:27.028867 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 84849.7us
I20260709 12:26:27.030344 10819 leader_election.cc:304] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:27.048532 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:26:27.049515 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 117390us
I20260709 12:26:27.060719 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:27.061661 10923 raft_consensus.cc:2393] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 7: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:26:27.079064 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:27.080554 10923 raft_consensus.cc:2468] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 6.
I20260709 12:26:27.059543 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:27.069358 10968 leader_election.cc:304] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:27.086467 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:26.872543 15248 raft_consensus.cc:515] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:27.112972 10921 raft_consensus.cc:2468] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 10.
I20260709 12:26:27.113961 15248 leader_election.cc:290] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:27.114202 15089 leader_election.cc:290] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:27.060844 15316 raft_consensus.cc:2804] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:27.115754 15316 raft_consensus.cc:493] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:27.116166 15316 raft_consensus.cc:3060] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:27.116971 15251 raft_consensus.cc:2804] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:26:27.095197 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 98628.1us
I20260709 12:26:27.117766 15251 raft_consensus.cc:697] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 11 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:27.118729 15251 consensus_queue.cc:237] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:27.087430 10929 raft_consensus.cc:2468] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 10.
W20260709 12:26:27.167196 10817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:27.168934 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 99674.5us
I20260709 12:26:27.099670 15317 raft_consensus.cc:493] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:27.164352 10819 leader_election.cc:304] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:26.928596 15323 raft_consensus.cc:493] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:27.052196 15267 raft_consensus.cc:2804] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:26:27.029062 15160 raft_consensus.cc:2804] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:26:27.098006 15297 raft_consensus.cc:493] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:27.124253 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:27.124750 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:27.126819 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:27.125680 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:27.028357 15256 raft_consensus.cc:493] T 4ef3220c51df47db8859f07ab745fad5 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:27.121912 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:27.123412 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:27.168880 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:27.098927 10928 raft_consensus.cc:2468] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 10.
I20260709 12:26:27.224403 11003 raft_consensus.cc:3060] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:26:27.223187 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 46253.9us
I20260709 12:26:27.223771 10996 raft_consensus.cc:2468] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 10.
I20260709 12:26:27.226032 10926 raft_consensus.cc:3060] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:27.226085 11624 raft_consensus.cc:2468] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 4.
W20260709 12:26:27.196861 10893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:27.234982 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:27.235988 11001 raft_consensus.cc:2468] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 10.
I20260709 12:26:27.222931 10999 raft_consensus.cc:2468] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 10.
I20260709 12:26:27.225414 10968 leader_election.cc:304] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:27.170460 15280 raft_consensus.cc:493] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:27.179315 15322 log.cc:927] Time spent T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.064s	user 0.001s	sys 0.003s
I20260709 12:26:27.249608 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:26:27.227679 15325 log.cc:927] Time spent T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.358s	user 0.000s	sys 0.005s
I20260709 12:26:27.175304 15267 raft_consensus.cc:493] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:27.171667 15283 raft_consensus.cc:493] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:27.240867 15324 raft_consensus.cc:2804] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:26:27.259907 10995 raft_consensus.cc:2468] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 6.
I20260709 12:26:27.171373 15250 raft_consensus.cc:493] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:27.178802 15160 raft_consensus.cc:493] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:27.169874 15317 raft_consensus.cc:515] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:27.267035 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:27.241876 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
W20260709 12:26:27.262514 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 209882us
I20260709 12:26:27.232673 15188 raft_consensus.cc:2749] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945) with higher term. Message: Invalid argument: T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for earlier term 9. Current term is 10.
I20260709 12:26:27.269541 11002 raft_consensus.cc:3060] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:26:27.252550 11618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:27.283066 11616 raft_consensus.cc:2468] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 10.
I20260709 12:26:27.252744 15327 raft_consensus.cc:2804] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:26:27.261081 15267 raft_consensus.cc:3060] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:27.180035 15323 raft_consensus.cc:515] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:27.271698 15160 raft_consensus.cc:3060] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:27.265548 15324 raft_consensus.cc:493] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:27.257140 15319 consensus_queue.cc:1048] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:26:27.248512 14962 raft_consensus.cc:515] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:27.308488 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:27.313455 11001 raft_consensus.cc:2468] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 10.
W20260709 12:26:27.272722 15236 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.774s	user 0.026s	sys 0.036s
I20260709 12:26:27.242599 15256 raft_consensus.cc:515] T 4ef3220c51df47db8859f07ab745fad5 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:27.293154 15327 raft_consensus.cc:493] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:27.264340 15283 raft_consensus.cc:515] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:27.335464 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 171232us
I20260709 12:26:27.276926 15250 raft_consensus.cc:515] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:27.317397 15236 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.818s	user 0.026s	sys 0.036s
I20260709 12:26:27.340942 10922 raft_consensus.cc:2368] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for earlier term 11. Current term is 12.
I20260709 12:26:27.300216 15324 raft_consensus.cc:3060] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:27.399072 11002 raft_consensus.cc:2468] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 8.
I20260709 12:26:27.337503 15327 raft_consensus.cc:3060] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:27.328873 15333 raft_consensus.cc:493] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:27.405102 10818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:27.400312 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 99258.3us
I20260709 12:26:27.345196 15196 raft_consensus.cc:2804] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:27.433903 10926 raft_consensus.cc:2468] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 8.
I20260709 12:26:27.436292 15339 raft_consensus.cc:493] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:27.447191 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 200628us
I20260709 12:26:27.412603 15263 raft_consensus.cc:493] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:27.406288 15236 raft_consensus.cc:493] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:27.459959 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef3220c51df47db8859f07ab745fad5" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:27.412750 15323 leader_election.cc:290] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:27.242831 15297 raft_consensus.cc:515] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:27.436990 15339 raft_consensus.cc:515] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:27.269081 15280 raft_consensus.cc:515] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:27.406497 15336 raft_consensus.cc:493] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:27.462999 10924 raft_consensus.cc:2468] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 6.
I20260709 12:26:27.466400 15339 leader_election.cc:290] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:27.466426 15297 leader_election.cc:290] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:27.522161 15343 raft_consensus.cc:493] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:27.474120 15256 leader_election.cc:290] T 4ef3220c51df47db8859f07ab745fad5 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:27.520395 11618 raft_consensus.cc:2468] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 6.
I20260709 12:26:27.531493 15338 raft_consensus.cc:493] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:27.531073 15224 consensus_meta.cc:287] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent flushing consensus metadata: real 0.633s	user 0.011s	sys 0.002s
I20260709 12:26:27.476509 15323 raft_consensus.cc:493] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:27.538694 10968 leader_election.cc:304] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:27.471119 15263 raft_consensus.cc:515] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:27.547049 11003 raft_consensus.cc:2468] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 11.
I20260709 12:26:27.471271 15236 raft_consensus.cc:515] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:27.445686 15333 raft_consensus.cc:515] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:27.552809 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 138938us
I20260709 12:26:27.497773 15339 raft_consensus.cc:493] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:27.584384 15345 raft_consensus.cc:493] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
W20260709 12:26:27.585795 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 118322us
I20260709 12:26:27.586529 15339 raft_consensus.cc:515] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:27.588786 15346 raft_consensus.cc:2804] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:26:27.567901 15297 raft_consensus.cc:493] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:27.599411 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18294423a68a4671bf6c5a0f98645e4c" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:27.598488 15348 raft_consensus.cc:493] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:27.602666 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:27.600929 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:27.604070 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:27.606596 10929 raft_consensus.cc:2393] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 11: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:26:27.607748 10923 raft_consensus.cc:2393] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 8: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:26:27.560799 15323 raft_consensus.cc:515] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:27.609417 11588 leader_election.cc:304] T 4ef3220c51df47db8859f07ab745fad5 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:27.590020 15317 leader_election.cc:290] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:27.560293 15224 raft_consensus.cc:515] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:27.593731 15222 raft_consensus.cc:493] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:27.532087 15338 raft_consensus.cc:515] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:27.478345 15336 raft_consensus.cc:515] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:27.599857 14962 leader_election.cc:290] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 12 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:27.601953 15250 leader_election.cc:290] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:27.523180 15343 raft_consensus.cc:515] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:27.647264 15251 raft_consensus.cc:493] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
W20260709 12:26:27.648759 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 46856us
I20260709 12:26:27.648371 15251 raft_consensus.cc:515] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:27.651117 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:27.651846 10851 raft_consensus.cc:2468] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 10.
W20260709 12:26:27.652040 15309 log.cc:927] Time spent T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 1.139s	user 0.009s	sys 0.016s
I20260709 12:26:27.652719 15251 leader_election.cc:290] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:27.657002 15277 raft_consensus.cc:493] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:27.657858 15277 raft_consensus.cc:515] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:27.660343 15358 raft_consensus.cc:493] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:27.660960 15358 raft_consensus.cc:515] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:27.661828 15277 leader_election.cc:290] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:27.657750 15251 raft_consensus.cc:493] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:27.653620 10819 leader_election.cc:304] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:27.663455 15251 raft_consensus.cc:515] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:27.669937 15251 leader_election.cc:290] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:27.666815 15277 raft_consensus.cc:2804] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:26:27.671267 15277 raft_consensus.cc:697] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 8 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:27.672458 15277 consensus_queue.cc:237] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:27.684854 10849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56388 (request call id 3103) took 1463 ms. Trace:
I20260709 12:26:27.706925 10845 raft_consensus.cc:3060] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:27.714907 10925 raft_consensus.cc:2393] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 5: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:26:27.685750 10849 rpcz_store.cc:276] 0709 12:26:26.226997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:26.227167 (+   170us) service_pool.cc:224] Handling call
0709 12:26:26.227547 (+   380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:26.227973 (+   426us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:26.228001 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:26.237063 (+  9062us) log.cc:844] Serialized 26 byte log entry
0709 12:26:26.337800 (+100737us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:26:26.337838 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:26.337898 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:27.651110 (+1313212us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b4400022b4c. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7591c23db1 00007f7591cc1c85 00007f7591cc26a2 00007f7594a341db 00007f7594a2faaf 00007f7594a2386e 00007f7594a22bb6 00007f7594a227d8 00007f7594a2c221 00007f7594a2c1d9 00007f7594a2c169
0709 12:26:27.684380 (+ 33270us) raft_consensus.cc:1685] finished
0709 12:26:27.684416 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:27.684764 (+   348us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4007,"raft.run_cpu_time_us":321,"raft.run_wall_time_us":11312,"spinlock_wait_cycles":23951104,"thread_start_us":65988,"threads_started":1,"wal-append.queue_time_us":262169}
I20260709 12:26:27.719089 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:27.721102 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:27.743611 10924 raft_consensus.cc:2468] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 8.
I20260709 12:26:27.746456 15333 leader_election.cc:290] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:27.585249 15345 raft_consensus.cc:515] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:27.720372 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac83709373b4efd9c3aa1472a9f9022" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:27.722436 15264 raft_consensus.cc:493] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:27.748500 15264 raft_consensus.cc:515] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:27.750172 15345 leader_election.cc:290] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:27.750665 15264 leader_election.cc:290] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:27.722499 15341 raft_consensus.cc:493] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:27.751550 10923 raft_consensus.cc:2393] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 5: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:26:27.752015 15341 raft_consensus.cc:515] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:27.723116 15342 raft_consensus.cc:493] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:27.755357 15342 raft_consensus.cc:515] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:27.757001 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac83709373b4efd9c3aa1472a9f9022" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:27.758452 10994 raft_consensus.cc:2468] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 5.
I20260709 12:26:27.760564 15341 leader_election.cc:290] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:27.632601 15317 raft_consensus.cc:493] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:27.760958 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:27.762068 10997 raft_consensus.cc:2468] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 7.
I20260709 12:26:27.761756 15317 raft_consensus.cc:515] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:27.764062 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 197879us
I20260709 12:26:27.732074 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:27.606532 15297 raft_consensus.cc:515] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:27.741989 10920 raft_consensus.cc:1275] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:26:27.642971 15256 raft_consensus.cc:2804] T 4ef3220c51df47db8859f07ab745fad5 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:26:27.765033 10926 raft_consensus.cc:2468] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 9.
I20260709 12:26:27.635912 15339 leader_election.cc:290] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:27.765753 10894 leader_election.cc:304] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d
I20260709 12:26:27.766865 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:27.771463 15347 raft_consensus.cc:493] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:27.781438 10924 raft_consensus.cc:2468] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 12.
W20260709 12:26:27.779217 10893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:27.737634 15242 leader_election.cc:290] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:27.788815 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:27.789718 10924 raft_consensus.cc:2468] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 8.
I20260709 12:26:27.636451 15222 raft_consensus.cc:515] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:27.759243 15342 leader_election.cc:290] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:27.773869 15256 raft_consensus.cc:493] T 4ef3220c51df47db8859f07ab745fad5 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:27.804077 10998 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57514 (request call id 1112) took 2242 ms (client timeout 2075 ms). Trace:
W20260709 12:26:27.816535 10998 rpcz_store.cc:269] 0709 12:26:25.549341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:25.549460 (+   119us) service_pool.cc:224] Handling call
0709 12:26:27.791813 (+2242353us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b54002d3f54. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e8c2fa 00007f7599e4db17 00007f75933c86d4 00007f75933c8662 00007f75933c8591 00007f75933c850c 00007f75933c77c2 00007f75931c348c 00007f75931c28c6 00007f75931c226f
0709 12:26:27.791984 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":463483136}
I20260709 12:26:27.823755 10819 leader_election.cc:304] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:27.823997 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:27.825557 10924 raft_consensus.cc:2393] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 11: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:26:27.825625 10819 leader_election.cc:304] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:27.812280 10894 leader_election.cc:304] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:27.843932 10820 leader_election.cc:304] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040; no voters: 
I20260709 12:26:27.810410 15280 leader_election.cc:290] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:27.819787 15256 raft_consensus.cc:3060] T 4ef3220c51df47db8859f07ab745fad5 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:27.811400 15343 leader_election.cc:290] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:27.865275 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:27.862193 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:27.803926 15359 raft_consensus.cc:493] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:27.833563 15332 raft_consensus.cc:493] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:27.836067 15264 raft_consensus.cc:2804] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:27.867483 10850 raft_consensus.cc:2468] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 8.
I20260709 12:26:27.834335 15251 raft_consensus.cc:493] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:27.631867 15348 raft_consensus.cc:515] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:27.832732 15355 raft_consensus.cc:2804] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:26:27.878587 15357 raft_consensus.cc:493] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:27.879438 15331 log.cc:927] Time spent T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.332s	user 0.000s	sys 0.002s
I20260709 12:26:27.820683 15341 consensus_queue.cc:1048] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:26:27.855770 15339 raft_consensus.cc:2804] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:26:27.836975 15346 raft_consensus.cc:697] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 10 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:26:27.836000 15342 raft_consensus.cc:493] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:27.870189 15268 raft_consensus.cc:493] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:27.884999 15356 raft_consensus.cc:493] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:27.804574 15340 raft_consensus.cc:493] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:27.887611 10819 leader_election.cc:304] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:27.890054 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:27.891625 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac83709373b4efd9c3aa1472a9f9022" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:27.863329 15333 raft_consensus.cc:493] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:27.868002 15163 raft_consensus.cc:2804] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:27.870411 15236 leader_election.cc:290] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:27.875900 15264 raft_consensus.cc:493] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:27.882625 15174 consensus_queue.cc:1048] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.109s
W20260709 12:26:27.988725 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 130499us
I20260709 12:26:28.024652 11616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:28.025799 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:28.035588 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6a1da21304fcfacab384a6afc4101" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:28.042903 11616 raft_consensus.cc:2468] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 8.
I20260709 12:26:28.043056 10820 leader_election.cc:304] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:28.045256 10820 leader_election.cc:304] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:28.043120 11623 raft_consensus.cc:2468] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 9.
W20260709 12:26:28.044775 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 160242us
I20260709 12:26:28.047119 10819 leader_election.cc:304] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:27.882393 15359 raft_consensus.cc:515] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:28.052094 15340 raft_consensus.cc:515] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:28.005815 15366 raft_consensus.cc:493] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:27.988098 15352 raft_consensus.cc:493] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:27.979214 15338 leader_election.cc:290] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:28.019800 15339 raft_consensus.cc:493] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:28.007279 15317 leader_election.cc:290] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:28.071290 15372 raft_consensus.cc:493] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:27.980697 15355 raft_consensus.cc:493] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:28.028898 15323 leader_election.cc:290] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:28.041815 15082 raft_consensus.cc:493] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:28.035707 15163 raft_consensus.cc:493] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:28.036978 15224 leader_election.cc:290] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:28.050909 15264 raft_consensus.cc:3060] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:28.004938 15364 raft_consensus.cc:493] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:27.812325 15347 raft_consensus.cc:515] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:28.059691 15329 log.cc:927] Time spent T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d: Append to log took a long time: real 0.333s	user 0.002s	sys 0.000s
I20260709 12:26:28.057379 15277 raft_consensus.cc:2804] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:28.078514 15362 raft_consensus.cc:493] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:28.041709 15268 raft_consensus.cc:515] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:27.892729 15251 raft_consensus.cc:515] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:28.085561 15339 raft_consensus.cc:3060] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:28.048266 15342 raft_consensus.cc:515] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:28.042548 15333 raft_consensus.cc:515] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:28.111019 15317 raft_consensus.cc:2804] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:26:28.100340 15355 raft_consensus.cc:3060] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:28.060859 15236 raft_consensus.cc:2804] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:28.112246 15163 raft_consensus.cc:3060] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:28.108863 15296 raft_consensus.cc:493] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:28.109021 15336 leader_election.cc:290] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:27.886454 15332 raft_consensus.cc:515] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:28.112105 15082 raft_consensus.cc:515] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:28.159847 10893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:28.136428 15307 log.cc:927] Time spent T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 1.475s	user 0.008s	sys 0.023s
I20260709 12:26:28.085100 15335 raft_consensus.cc:493] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:28.114388 15346 consensus_queue.cc:237] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:28.125546 15361 raft_consensus.cc:2804] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:26:28.128331 15277 raft_consensus.cc:493] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:28.131516 10924 raft_consensus.cc:2955] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:28.055267 15356 raft_consensus.cc:515] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:28.117935 15349 raft_consensus.cc:493] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:28.072253 15366 raft_consensus.cc:515] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:28.054543 15357 raft_consensus.cc:515] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:28.141697 15371 raft_consensus.cc:2749] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:28.173115 15347 leader_election.cc:290] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:28.145387 15250 raft_consensus.cc:493] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:28.158530 15317 raft_consensus.cc:493] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:28.158357 15297 leader_election.cc:290] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:28.164994 15323 raft_consensus.cc:493] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:28.167233 15236 raft_consensus.cc:697] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [term 6 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:28.179270 15277 raft_consensus.cc:3060] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:28.167534 15359 leader_election.cc:290] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:28.174603 15251 leader_election.cc:290] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:28.200914 10927 raft_consensus.cc:2468] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 5.
I20260709 12:26:28.184372 15222 leader_election.cc:290] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:28.184760 15361 raft_consensus.cc:493] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:28.170264 15296 raft_consensus.cc:515] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:28.193264 15317 raft_consensus.cc:3060] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:28.138597 15364 raft_consensus.cc:515] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:28.213752 15332 leader_election.cc:290] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
W20260709 12:26:28.220865 11588 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.007s	sys 0.007s
W20260709 12:26:28.243327 11588 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.007s	sys 0.007s
W20260709 12:26:28.243119 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 187799us
W20260709 12:26:28.244129 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 634758us
W20260709 12:26:28.248411 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 192491us
I20260709 12:26:28.248879 10926 raft_consensus.cc:1275] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:26:28.250588 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:28.251032 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:28.252015 10920 raft_consensus.cc:2468] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 11.
W20260709 12:26:28.252113 10967 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.013s	sys 0.021s
W20260709 12:26:28.252799 10967 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.013s	sys 0.021s
I20260709 12:26:28.240625 15256 raft_consensus.cc:515] T 4ef3220c51df47db8859f07ab745fad5 P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:28.157573 15362 raft_consensus.cc:515] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:28.257280 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:28.260555 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:28.191543 15250 raft_consensus.cc:515] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:28.209223 15361 raft_consensus.cc:3060] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:26:28.266525 10845 consensus_meta.cc:287] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040: Time spent flushing consensus metadata: real 0.557s	user 0.012s	sys 0.000s
I20260709 12:26:28.267565 10849 raft_consensus.cc:1275] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:26:28.129477 15372 raft_consensus.cc:515] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:28.101104 15352 raft_consensus.cc:515] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:28.271898 10845 raft_consensus.cc:2468] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 3.
I20260709 12:26:28.273162 11003 raft_consensus.cc:1275] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:26:28.273782 15251 raft_consensus.cc:493] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:28.199086 15323 raft_consensus.cc:515] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:28.270628 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:28.278929 10851 raft_consensus.cc:1275] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:26:28.274487 15345 raft_consensus.cc:493] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:28.290347 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
W20260709 12:26:28.285221 10845 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46480 (request call id 727) took 1811 ms (client timeout 1721 ms). Trace:
I20260709 12:26:28.285281 10926 raft_consensus.cc:1275] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:26:28.285699 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6a1da21304fcfacab384a6afc4101" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:28.285166 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:28.295421 10997 raft_consensus.cc:3060] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Advancing to term 12
W20260709 12:26:28.291544 10845 rpcz_store.cc:269] 0709 12:26:26.466933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:26.467135 (+   202us) service_pool.cc:224] Handling call
0709 12:26:27.706145 (+1239010us) spinlock_profiling.cc:243] Waited 326 ms on lock 0x7b58003812d0. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594de40aa 00007f7594e66447 00007f7594e7efe7 00007f7594e807de 00007f7594e8c27c 00007f7599e4db17 00007f75933c86d4 00007f75933c8662 00007f75933c8591 00007f75933c850c
0709 12:26:28.278445 (+572300us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":749307776}
I20260709 12:26:28.296994 10848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46480 (request call id 721) took 2204 ms. Trace:
I20260709 12:26:28.258904 15297 raft_consensus.cc:493] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:28.258682 15222 raft_consensus.cc:493] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:28.302435 10929 raft_consensus.cc:2468] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 8.
I20260709 12:26:28.270294 15343 raft_consensus.cc:493] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:28.297374 10848 rpcz_store.cc:276] 0709 12:26:26.082512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:26.082657 (+   145us) service_pool.cc:224] Handling call
0709 12:26:26.082991 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:26.126904 (+ 43913us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:26.126933 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:26.198149 (+ 71216us) spinlock_profiling.cc:243] Waited 14.3 ms on lock 0x7b2c000328a8. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7593781a11 00007f7593791372 00007f7594ec3a01 00007f7594e8843a 00007f7594e8783e 00007f7599e4c419 00007f75933c3bd4 00007f75933c3b62 00007f75933c3a91 00007f75933c3a0c 00007f75933c2cc2
0709 12:26:26.198744 (+   595us) log.cc:844] Serialized 26 byte log entry
0709 12:26:26.294437 (+ 95693us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:26:26.370620 (+ 76183us) log.cc:844] Serialized 14 byte log entry
0709 12:26:26.371802 (+  1182us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:26.841934 (+470132us) spinlock_profiling.cc:243] Waited 43.2 ms on lock 0x7b54003e71d4. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e88e01 00007f7594e8783e 00007f7599e4c419 00007f75933c3bd4 00007f75933c3b62 00007f75933c3a91 00007f75933c3a0c 00007f75933c2cc2 00007f75931c348c 00007f75931c28c6
0709 12:26:26.842000 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:27.798506 (+956506us) spinlock_profiling.cc:243] Waited 19.1 ms on lock 0x7b4400022b4c. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7591c23db1 00007f7591cc1c85 00007f7591cc26a2 00007f7594a341db 00007f7594a2faaf 00007f7594a2386e 00007f7594a22bb6 00007f7594a227d8 00007f7594a2c221 00007f7594a2c1d9 00007f7594a2c169
0709 12:26:28.286975 (+488469us) raft_consensus.cc:1685] finished
0709 12:26:28.286996 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:28.287151 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":374,"prepare.queue_time_us":76116,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":13605,"raft.run_cpu_time_us":295,"raft.run_wall_time_us":303,"spinlock_wait_cycles":176188288,"thread_start_us":162342,"threads_started":2,"wal-append.queue_time_us":191248}
I20260709 12:26:28.243422 15340 leader_election.cc:290] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:28.277635 15268 leader_election.cc:290] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:28.311736 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac83709373b4efd9c3aa1472a9f9022" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:28.314733 10994 raft_consensus.cc:2468] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 5.
I20260709 12:26:28.273830 15332 consensus_queue.cc:1048] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:26:28.197151 15349 raft_consensus.cc:515] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:28.330385 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 81216.1us
I20260709 12:26:28.334118 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:28.335659 10854 raft_consensus.cc:2468] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 6.
I20260709 12:26:28.187608 15335 raft_consensus.cc:515] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:28.301113 15348 leader_election.cc:290] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:28.350031 10820 leader_election.cc:304] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:28.289922 15251 raft_consensus.cc:515] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:28.280025 15355 raft_consensus.cc:515] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:28.303186 15345 raft_consensus.cc:515] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:28.308270 15297 raft_consensus.cc:515] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:28.312289 15222 raft_consensus.cc:515] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:28.372821 15349 leader_election.cc:290] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:28.312482 15343 raft_consensus.cc:515] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:28.280750 15236 consensus_queue.cc:237] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:28.339846 15368 log.cc:927] Time spent T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.350s	user 0.002s	sys 0.000s
I20260709 12:26:28.326474 15378 raft_consensus.cc:493] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:28.338109 15280 raft_consensus.cc:493] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
W20260709 12:26:28.370776 15267 consensus_meta.cc:287] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040: Time spent flushing consensus metadata: real 1.071s	user 0.008s	sys 0.008s
I20260709 12:26:28.388015 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:28.339777 15082 leader_election.cc:290] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
W20260709 12:26:28.406422 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 381135us
I20260709 12:26:28.399098 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:28.403120 10997 raft_consensus.cc:2468] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 12.
I20260709 12:26:28.408982 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:28.409140 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:28.409682 11623 raft_consensus.cc:3060] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:28.414230 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:28.415293 10920 raft_consensus.cc:2468] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 4.
I20260709 12:26:28.429883 15335 leader_election.cc:290] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:28.430531 15366 leader_election.cc:290] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:28.431533 11616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:28.432282 11616 raft_consensus.cc:1813] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Handling vote request from an unknown peer e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:28.432042 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:28.432652 15364 leader_election.cc:290] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:28.433048 11616 raft_consensus.cc:2410] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:26:28.433187 11624 raft_consensus.cc:2468] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 11.
W20260709 12:26:28.436055 15363 log.cc:927] Time spent T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 12:26:28.442541 11623 raft_consensus.cc:2468] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 5.
I20260709 12:26:28.401999 15256 leader_election.cc:290] T 4ef3220c51df47db8859f07ab745fad5 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 7 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:26:28.444074 15160 consensus_meta.cc:287] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea: Time spent flushing consensus metadata: real 1.132s	user 0.017s	sys 0.000s
I20260709 12:26:28.444871 15160 raft_consensus.cc:515] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:28.408694 15267 raft_consensus.cc:515] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:28.449951 15267 leader_election.cc:290] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:26:28.450688 15279 consensus_meta.cc:287] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040: Time spent flushing consensus metadata: real 1.338s	user 0.006s	sys 0.011s
I20260709 12:26:28.411326 15268 raft_consensus.cc:493] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:28.418691 15082 raft_consensus.cc:2749] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:28.476392 15347 raft_consensus.cc:493] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:28.477676 15347 raft_consensus.cc:515] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:28.477905 10895 leader_election.cc:304] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:28.478853 15285 leader_election.cc:290] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:28.401688 15357 leader_election.cc:290] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
W20260709 12:26:28.467048 15316 consensus_meta.cc:287] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040: Time spent flushing consensus metadata: real 1.350s	user 0.013s	sys 0.003s
I20260709 12:26:28.487552 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:28.479382 10895 leader_election.cc:304] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:28.427933 15296 leader_election.cc:290] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:28.491690 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:28.408807 15280 raft_consensus.cc:515] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:28.494822 11000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37500 (request call id 3869) took 2365 ms. Trace:
I20260709 12:26:28.497714 15082 raft_consensus.cc:493] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:28.451442 15372 leader_election.cc:290] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:28.505874 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c913e527ff46578e084c41eab7bb9d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:28.507220 15382 raft_consensus.cc:2804] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:26:28.507459 15332 raft_consensus.cc:493] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:28.507936 15382 raft_consensus.cc:493] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:28.508510 15382 raft_consensus.cc:3060] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:28.508252 15332 raft_consensus.cc:515] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:28.497270 11000 rpcz_store.cc:276] 0709 12:26:26.122085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:26.122255 (+   170us) service_pool.cc:224] Handling call
0709 12:26:26.223438 (+101183us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:26.230653 (+  7215us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:28.487423 (+2256770us) spinlock_profiling.cc:243] Waited 97.9 ms on lock 0x7b54002d2650. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e878ad 00007f7599e4c419 00007f75933c3bd4 00007f75933c3b62 00007f75933c3a91 00007f75933c3a0c 00007f75933c2cc2 00007f75931c348c 00007f75931c28c6 00007f75931c226f
0709 12:26:28.487664 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":225097088}
I20260709 12:26:28.503237 10895 leader_election.cc:304] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:28.513577 15355 leader_election.cc:290] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:28.516474 15362 leader_election.cc:290] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:28.518127 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac83709373b4efd9c3aa1472a9f9022" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:28.519007 10854 raft_consensus.cc:2468] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 4.
I20260709 12:26:28.487812 15160 leader_election.cc:290] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 election: Requested vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:28.518786 10895 leader_election.cc:304] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:28.493141 15250 leader_election.cc:290] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:28.472373 15279 raft_consensus.cc:515] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:28.494169 15347 leader_election.cc:290] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:28.485735 15377 raft_consensus.cc:493] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:28.498453 15297 leader_election.cc:290] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:28.480125 15381 consensus_queue.cc:1048] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:26:28.547621 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:28.547930 15343 leader_election.cc:290] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:28.548592 11624 raft_consensus.cc:2393] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 8: Already voted for candidate 3c52e0825c02476e89d84da9bb849f5d in this term.
I20260709 12:26:28.549137 15279 leader_election.cc:290] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:28.549438 11616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fd8fdac2fa449e9e184f3d668ea1a7" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:28.550518 11616 raft_consensus.cc:3060] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:28.535485 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:28.511770 15357 raft_consensus.cc:2804] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:26:28.537817 15345 leader_election.cc:290] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:28.481447 15268 raft_consensus.cc:515] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:28.543972 15280 leader_election.cc:290] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:28.551868 11623 raft_consensus.cc:2410] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:26:28.496312 15316 raft_consensus.cc:515] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:28.559451 15251 leader_election.cc:290] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:28.524487 15323 leader_election.cc:290] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:28.423074 15378 raft_consensus.cc:515] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:28.552896 15332 leader_election.cc:290] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:28.525054 15355 raft_consensus.cc:2804] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:28.550915 15250 raft_consensus.cc:2804] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:28.511034 15082 raft_consensus.cc:515] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:28.557111 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
W20260709 12:26:28.572986 10893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:28.558174 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:28.574981 10854 raft_consensus.cc:1813] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Handling vote request from an unknown peer e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:28.575989 10854 raft_consensus.cc:2410] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:26:28.576673 15355 raft_consensus.cc:493] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:28.586926 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:28.588038 11622 raft_consensus.cc:2393] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 9: Already voted for candidate 3c52e0825c02476e89d84da9bb849f5d in this term.
I20260709 12:26:28.588183 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:28.555873 15357 raft_consensus.cc:493] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:28.556981 15381 raft_consensus.cc:493] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:28.567022 15342 leader_election.cc:290] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:28.596746 15332 raft_consensus.cc:493] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:28.596746 15323 raft_consensus.cc:493] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:28.582257 15355 raft_consensus.cc:3060] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:28.576854 15269 raft_consensus.cc:493] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:28.601540 11617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:28.580263 15343 raft_consensus.cc:493] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:28.607272 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:28.582929 15250 raft_consensus.cc:697] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:28.614200 11617 raft_consensus.cc:2393] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 8: Already voted for candidate 3c52e0825c02476e89d84da9bb849f5d in this term.
I20260709 12:26:28.614804 15385 raft_consensus.cc:493] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:28.608795 15269 raft_consensus.cc:515] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:28.554527 15377 raft_consensus.cc:515] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:28.595409 15357 raft_consensus.cc:3060] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:28.668051 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
W20260709 12:26:28.614158 10968 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.022s	sys 0.034s
W20260709 12:26:28.778981 10968 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.023s	sys 0.035s
I20260709 12:26:28.782853 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:28.783407 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:28.786036 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef3220c51df47db8859f07ab745fad5" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:28.786890 10928 raft_consensus.cc:3060] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:28.836112 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:28.836843 10924 raft_consensus.cc:2468] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 4.
I20260709 12:26:28.837893 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:28.838449 10924 raft_consensus.cc:2468] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 12.
I20260709 12:26:28.839233 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef3220c51df47db8859f07ab745fad5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:28.611552 15323 raft_consensus.cc:515] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } }
I20260709 12:26:28.846778 15323 leader_election.cc:290] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265)
W20260709 12:26:28.847085 15339 consensus_meta.cc:287] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040: Time spent flushing consensus metadata: real 0.690s	user 0.000s	sys 0.013s
W20260709 12:26:28.851195 15324 consensus_meta.cc:287] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08: Time spent flushing consensus metadata: real 1.408s	user 0.011s	sys 0.003s
W20260709 12:26:28.853088 15327 consensus_meta.cc:287] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08: Time spent flushing consensus metadata: real 1.407s	user 0.017s	sys 0.000s
I20260709 12:26:28.852895 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:28.580014 15356 leader_election.cc:290] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:28.865244 11616 raft_consensus.cc:2468] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 8.
I20260709 12:26:28.604543 11619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:28.877539 10895 leader_election.cc:304] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:28.869071 10924 raft_consensus.cc:2410] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:26:28.879143 11624 raft_consensus.cc:2468] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 8.
I20260709 12:26:28.667171 15268 leader_election.cc:290] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:28.884063 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b17195a94142039c40f598ed006c94" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:28.723354 15316 leader_election.cc:290] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:28.604360 15332 raft_consensus.cc:515] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:28.866777 15220 raft_consensus.cc:493] T d0aed74af73a488f8b691578ca370226 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
W20260709 12:26:28.689889 15264 consensus_meta.cc:287] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea: Time spent flushing consensus metadata: real 0.569s	user 0.008s	sys 0.005s
I20260709 12:26:28.670444 11615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45920 (request call id 813) took 1742 ms. Trace:
I20260709 12:26:28.876772 15323 raft_consensus.cc:493] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:28.718251 15378 leader_election.cc:290] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:28.617009 15263 leader_election.cc:290] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:28.899731 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:28.883898 15188 raft_consensus.cc:2804] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:26:28.916316 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:28.628713 15343 raft_consensus.cc:515] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:28.868669 15339 raft_consensus.cc:515] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:28.853840 15385 raft_consensus.cc:515] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:28.668823 15352 leader_election.cc:290] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:28.918044 10924 raft_consensus.cc:3060] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:26:28.921075 15317 consensus_meta.cc:287] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040: Time spent flushing consensus metadata: real 0.675s	user 0.006s	sys 0.010s
I20260709 12:26:28.878405 15327 raft_consensus.cc:515] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:28.872233 10928 raft_consensus.cc:2468] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 7.
I20260709 12:26:28.873488 10968 leader_election.cc:304] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:28.644556 15381 raft_consensus.cc:515] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:28.889132 11619 raft_consensus.cc:2468] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 12.
I20260709 12:26:29.230365 11620 raft_consensus.cc:1275] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:26:28.995213 11621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:28.916113 15324 raft_consensus.cc:515] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:28.993571 15330 log.cc:927] Time spent T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 1.681s	user 0.002s	sys 0.005s
I20260709 12:26:29.397996 11588 leader_election.cc:304] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:28.954131 15338 raft_consensus.cc:493] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:28.932353 15188 raft_consensus.cc:697] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
W20260709 12:26:28.923770 15212 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.058s	sys 0.055s
I20260709 12:26:29.005379 15387 raft_consensus.cc:493] T ab816bcc6183447994a2cc013e46c5f8 P 3c52e0825c02476e89d84da9bb849f5d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:29.148391 15343 leader_election.cc:290] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:26:29.280596 15277 consensus_meta.cc:287] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040: Time spent flushing consensus metadata: real 1.073s	user 0.016s	sys 0.000s
I20260709 12:26:29.404937 15317 raft_consensus.cc:515] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:28.924427 15377 leader_election.cc:290] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:29.437904 15381 leader_election.cc:290] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:28.909914 15264 raft_consensus.cc:515] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:29.441442 15222 leader_election.cc:290] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:29.442059 15333 leader_election.cc:290] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:29.442363 15264 leader_election.cc:290] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:29.443555 15385 leader_election.cc:290] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:29.444948 15317 leader_election.cc:290] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:29.446554 15283 leader_election.cc:290] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:29.447239 15277 raft_consensus.cc:515] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:29.450086 15387 raft_consensus.cc:515] T ab816bcc6183447994a2cc013e46c5f8 P 3c52e0825c02476e89d84da9bb849f5d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:29.453747 15387 leader_election.cc:290] T ab816bcc6183447994a2cc013e46c5f8 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:28.995985 15358 leader_election.cc:290] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:26:29.145619 15361 consensus_meta.cc:287] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040: Time spent flushing consensus metadata: real 0.866s	user 0.005s	sys 0.009s
W20260709 12:26:29.345444 15382 consensus_meta.cc:287] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea: Time spent flushing consensus metadata: real 0.836s	user 0.008s	sys 0.008s
W20260709 12:26:29.398224 15355 consensus_meta.cc:287] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent flushing consensus metadata: real 0.782s	user 0.008s	sys 0.007s
I20260709 12:26:29.433274 15338 raft_consensus.cc:515] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:29.469219 15355 raft_consensus.cc:515] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:29.471189 15338 leader_election.cc:290] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:29.053345 15332 leader_election.cc:290] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:29.474272 15355 leader_election.cc:290] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 12 election: Requested vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:28.967682 15386 consensus_queue.cc:1048] T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.502s
I20260709 12:26:29.467999 15361 raft_consensus.cc:515] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:29.479395 15361 leader_election.cc:290] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:29.352268 15357 raft_consensus.cc:515] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:29.483799 15382 raft_consensus.cc:515] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:28.923362 10817 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.013s	sys 0.032s
W20260709 12:26:29.528086 10817 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.167s	user 0.013s	sys 0.032s
W20260709 12:26:29.020689 10820 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.003s	sys 0.008s
W20260709 12:26:29.540637 10820 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.173s	user 0.005s	sys 0.008s
W20260709 12:26:29.544476 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 1.19441e+06us
W20260709 12:26:29.548636 10846 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56388 (request call id 3104) took 2540 ms (client timeout 2151 ms). Trace:
W20260709 12:26:29.549561 10846 rpcz_store.cc:269] 0709 12:26:26.525226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:26.525414 (+   188us) service_pool.cc:224] Handling call
0709 12:26:29.065425 (+2540011us) spinlock_profiling.cc:243] Waited 232 ms on lock 0x7b54002bbe54. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e8c2fa 00007f7599e4db17 00007f75933c86d4 00007f75933c8662 00007f75933c8591 00007f75933c850c 00007f75933c77c2 00007f75931c348c 00007f75931c28c6 00007f75931c226f
0709 12:26:29.065593 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":532718976}
I20260709 12:26:29.551270 10851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46480 (request call id 732) took 1897 ms. Trace:
W20260709 12:26:29.552510 10847 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56394 (request call id 3999) took 2684 ms (client timeout 3092 ms). Trace:
I20260709 12:26:29.551680 10853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56394 (request call id 4011) took 1278 ms. Trace:
W20260709 12:26:29.086625 10893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:29.005419 10921 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59626 (request call id 3517) took 2124 ms (client timeout 1963 ms). Trace:
I20260709 12:26:29.555300 10920 raft_consensus.cc:2393] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3c52e0825c02476e89d84da9bb849f5d in current term 10: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
W20260709 12:26:29.091001 10926 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.019s	sys 0.018s
W20260709 12:26:29.616688 10926 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.130s	user 0.021s	sys 0.027s
I20260709 12:26:29.617905 10920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50036 (request call id 882) took 1011 ms. Trace:
I20260709 12:26:29.566772 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:29.618558 10926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59626 (request call id 3534) took 1231 ms. Trace:
I20260709 12:26:29.064927 10929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59626 (request call id 3525) took 1344 ms. Trace:
I20260709 12:26:29.619113 10894 leader_election.cc:304] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:29.556505 10849 raft_consensus.cc:2468] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 9.
W20260709 12:26:29.553333 10847 rpcz_store.cc:269] 0709 12:26:26.868851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:26.870151 (+  1300us) service_pool.cc:224] Handling call
0709 12:26:29.552022 (+2681871us) spinlock_profiling.cc:243] Waited 23.4 ms on lock 0x7b54000eb354. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e8c2fa 00007f7599e4db17 00007f75933c86d4 00007f75933c8662 00007f75933c8591 00007f75933c850c 00007f75933c77c2 00007f75931c348c 00007f75931c28c6 00007f75931c226f
0709 12:26:29.552306 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":53742976}
I20260709 12:26:29.571655 10853 rpcz_store.cc:276] 0709 12:26:28.272563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:29.549377 (+1276814us) service_pool.cc:224] Handling call
0709 12:26:29.550330 (+   953us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:29.550891 (+   561us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:29.550982 (+    91us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:29.551091 (+   109us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:26:29.551153 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:29.551263 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:29.551416 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:29.619431 10926 rpcz_store.cc:276] 0709 12:26:28.386985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:28.387134 (+   149us) service_pool.cc:224] Handling call
0709 12:26:28.413054 (+ 25920us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:28.413530 (+   476us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:28.413574 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:28.424959 (+ 11385us) log.cc:844] Serialized 26 byte log entry
0709 12:26:29.617799 (+1192840us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:26:29.617915 (+   116us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:29.618092 (+   177us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:29.618169 (+    77us) raft_consensus.cc:1685] finished
0709 12:26:29.618180 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:29.618432 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32580,"raft.queue_time_us":133,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":7605,"thread_start_us":1130663,"threads_started":1,"wal-append.queue_time_us":929551}
I20260709 12:26:29.621269 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:29.552277 10851 rpcz_store.cc:276] 0709 12:26:27.653367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:27.653793 (+   426us) service_pool.cc:224] Handling call
0709 12:26:28.278523 (+624730us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:28.287416 (+  8893us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:29.550409 (+1262993us) spinlock_profiling.cc:243] Waited 624 ms on lock 0x7b540026a050. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e878ad 00007f7599e4c419 00007f75933c3bd4 00007f75933c3b62 00007f75933c3a91 00007f75933c3a0c 00007f75933c2cc2 00007f75931c348c 00007f75931c28c6 00007f75931c226f
0709 12:26:29.550889 (+   480us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1435929344}
I20260709 12:26:29.574714 10846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56394 (request call id 4012) took 1301 ms. Trace:
I20260709 12:26:29.622378 10928 raft_consensus.cc:3060] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:26:29.581712 10923 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59626 (request call id 3524) took 1861 ms (client timeout 1909 ms). Trace:
W20260709 12:26:29.583523 10925 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59626 (request call id 3514) took 2730 ms (client timeout 2217 ms). Trace:
W20260709 12:26:29.626497 10925 rpcz_store.cc:269] 0709 12:26:26.852826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:26.852979 (+   153us) service_pool.cc:224] Handling call
0709 12:26:29.582944 (+2729965us) spinlock_profiling.cc:243] Waited 855 ms on lock 0x7b540039d354. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e8c2fa 00007f7599e4db17 00007f75933c86d4 00007f75933c8662 00007f75933c8591 00007f75933c850c 00007f75933c77c2 00007f75931c348c 00007f75931c28c6 00007f75931c226f
0709 12:26:29.583243 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1967503744}
W20260709 12:26:29.588102 10927 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59622 (request call id 3076) took 1698 ms (client timeout 1746 ms). Trace:
W20260709 12:26:29.229592 11618 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45890 (request call id 802) took 2110 ms (client timeout 2149 ms). Trace:
W20260709 12:26:29.143639 10995 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37512 (request call id 3438) took 2021 ms (client timeout 2249 ms). Trace:
W20260709 12:26:29.632529 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 234452us
I20260709 12:26:29.632992 11616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:29.634054 11616 raft_consensus.cc:3060] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:26:29.417906 11621 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45904 (request call id 908) took 1395 ms (client timeout 1556 ms). Trace:
I20260709 12:26:29.636127 15238 raft_consensus.cc:493] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:29.636068 11621 rpcz_store.cc:269] 0709 12:26:28.022738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:28.994899 (+972161us) service_pool.cc:224] Handling call
0709 12:26:29.417780 (+422881us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:29.636427 11617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:29.637784 11617 raft_consensus.cc:3060] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:29.637182 15238 raft_consensus.cc:515] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:29.641242 11589 connection.cc:256] RPC call timeout handler was delayed by -1.5501881160002995s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20750000000000002s for a response
I20260709 12:26:29.641714 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:29.641882 15238 leader_election.cc:290] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:29.642622 11623 raft_consensus.cc:2468] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 8.
I20260709 12:26:29.597251 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:29.642237 15188 consensus_queue.cc:237] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:29.642863 15238 consensus_queue.cc:1048] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:26:29.428498 15212 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.170s	user 0.060s	sys 0.074s
I20260709 12:26:29.643601 11002 raft_consensus.cc:2468] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 10.
I20260709 12:26:29.644001 15214 raft_consensus.cc:493] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
W20260709 12:26:29.016438 15163 consensus_meta.cc:287] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040: Time spent flushing consensus metadata: real 0.846s	user 0.009s	sys 0.006s
I20260709 12:26:29.644798 15214 raft_consensus.cc:515] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:29.645416 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:29.645706 15238 raft_consensus.cc:493] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
W20260709 12:26:29.633064 11618 rpcz_store.cc:269] 0709 12:26:27.119549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:27.170171 (+ 50622us) service_pool.cc:224] Handling call
0709 12:26:29.229246 (+2059075us) spinlock_profiling.cc:243] Waited 213 ms on lock 0x7b5400860954. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e8c2fa 00007f7599e4db17 00007f75933c86d4 00007f75933c8662 00007f75933c8591 00007f75933c850c 00007f75933c77c2 00007f75931c348c 00007f75931c28c6 00007f75931c226f
0709 12:26:29.229467 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":489566976}
I20260709 12:26:29.646553 15238 raft_consensus.cc:515] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:29.646843 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:29.558473 10852 raft_consensus.cc:2468] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 8.
I20260709 12:26:29.647707 11618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:29.648111 15264 raft_consensus.cc:493] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:29.648185 11588 leader_election.cc:304] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:29.649479 15264 raft_consensus.cc:515] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:29.650380 11588 leader_election.cc:304] T 4ef3220c51df47db8859f07ab745fad5 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:29.650552 15059 consensus_queue.cc:1048] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:26:29.651161 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18294423a68a4671bf6c5a0f98645e4c" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:29.647390 15214 leader_election.cc:290] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:29.651927 15248 raft_consensus.cc:493] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:29.652189 15214 raft_consensus.cc:493] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:29.652634 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:29.652716 15248 raft_consensus.cc:515] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:28.932454 15082 leader_election.cc:290] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:28.994544 15196 raft_consensus.cc:493] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:29.654955 15196 raft_consensus.cc:3060] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:29.602531 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:29.656584 11001 raft_consensus.cc:2368] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for earlier term 8. Current term is 9.
I20260709 12:26:29.657611 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:29.657837 15280 raft_consensus.cc:493] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:29.658245 11001 raft_consensus.cc:3060] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:26:29.598661 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:29.660012 15283 raft_consensus.cc:493] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:29.660143 15335 raft_consensus.cc:493] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:29.660724 15257 raft_consensus.cc:493] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:29.660953 15283 raft_consensus.cc:515] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:29.661468 15335 raft_consensus.cc:515] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:29.661942 15257 raft_consensus.cc:515] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:29.600821 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:29.203169 15258 leader_election.cc:290] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:29.664049 15332 raft_consensus.cc:493] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:29.653457 11622 raft_consensus.cc:2468] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 12.
I20260709 12:26:29.664805 15258 raft_consensus.cc:493] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:29.624159 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:29.665732 15324 leader_election.cc:290] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:29.665288 15332 raft_consensus.cc:515] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } }
I20260709 12:26:29.666157 15258 raft_consensus.cc:515] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:29.076701 10922 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59622 (request call id 3064) took 2156 ms (client timeout 1895 ms). Trace:
I20260709 12:26:29.600353 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:28.906301 11615 rpcz_store.cc:276] 0709 12:26:26.928542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:26.934900 (+  6358us) service_pool.cc:224] Handling call
0709 12:26:28.669488 (+1734588us) spinlock_profiling.cc:243] Waited 5.37 ms on lock 0x7b5800160898. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7591c23db1 00007f7591d63b71 00007f7591d63a22 00007f759ac7c8d9 00007f7599dd6ee0 00007f7599ea00ab 00007f7599ea0131 00007f7599e61fc0 00007f7599e4c929 00007f7599e4c3d2 00007f75933c3bd4
0709 12:26:28.669753 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:28.669991 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:28.670024 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:28.670081 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:26:28.670138 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:28.670209 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:28.670368 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12342144}
W20260709 12:26:29.667923 10922 rpcz_store.cc:269] 0709 12:26:26.920115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:26.920752 (+   637us) service_pool.cc:224] Handling call
0709 12:26:29.064048 (+2143296us) spinlock_profiling.cc:243] Waited 291 ms on lock 0x7b540039ec54. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e8c2fa 00007f7599e4db17 00007f75933c86d4 00007f75933c8662 00007f75933c8591 00007f75933c850c 00007f75933c77c2 00007f75931c348c 00007f75931c28c6 00007f75931c226f
0709 12:26:29.076558 (+ 12510us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":669470464}
I20260709 12:26:29.668545 15326 raft_consensus.cc:2804] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:29.669099 15326 raft_consensus.cc:493] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:29.669365 11615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5794ba618e514e28a7542ab6af39d8c9" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:29.670334 15333 raft_consensus.cc:2749] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:29.604943 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:29.635169 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:29.671598 10999 raft_consensus.cc:2468] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 10.
W20260709 12:26:29.633181 10995 rpcz_store.cc:269] 0709 12:26:27.122454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:27.124351 (+  1897us) service_pool.cc:224] Handling call
0709 12:26:29.143263 (+2018912us) spinlock_profiling.cc:243] Waited 37.3 ms on lock 0x7b54001829d4. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e8c2fa 00007f7599e4db17 00007f75933c86d4 00007f75933c8662 00007f75933c8591 00007f75933c850c 00007f75933c77c2 00007f75931c348c 00007f75931c28c6 00007f75931c226f
0709 12:26:29.143471 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":85699968}
I20260709 12:26:29.672011 11624 raft_consensus.cc:2468] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 7.
I20260709 12:26:29.672668 15059 raft_consensus.cc:2804] T 4ef3220c51df47db8859f07ab745fad5 P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:26:29.672817 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:29.666059 10926 raft_consensus.cc:3060] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:29.602989 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:29.673244 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c6d38c4d8a90a81975a6a0cb13" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:29.673985 10996 raft_consensus.cc:2468] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 10.
I20260709 12:26:29.674574 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:29.675030 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:29.407276 15327 leader_election.cc:290] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:29.668337 10994 raft_consensus.cc:2468] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 6.
W20260709 12:26:29.578265 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 704747us
I20260709 12:26:29.664460 10997 raft_consensus.cc:2410] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:26:29.660099 15222 raft_consensus.cc:2749] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:29.676743 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:29.652997 15214 raft_consensus.cc:515] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:29.677902 10994 raft_consensus.cc:2468] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 4.
I20260709 12:26:29.669538 15326 raft_consensus.cc:3060] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:29.667428 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:29.680325 15214 leader_election.cc:290] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:29.676131 10996 raft_consensus.cc:2468] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 11.
I20260709 12:26:29.618469 10920 rpcz_store.cc:276] 0709 12:26:28.606712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:28.606916 (+   204us) service_pool.cc:224] Handling call
0709 12:26:29.617519 (+1010603us) spinlock_profiling.cc:243] Waited 941 ms on lock 0x7b54001478d4. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e8c2fa 00007f7599e4db17 00007f75933c86d4 00007f75933c8662 00007f75933c8591 00007f75933c850c 00007f75933c77c2 00007f75931c348c 00007f75931c28c6 00007f75931c226f
0709 12:26:29.617790 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2164740480}
I20260709 12:26:29.600312 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:29.619766 10929 rpcz_store.cc:276] 0709 12:26:27.720373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:27.720840 (+   467us) service_pool.cc:224] Handling call
0709 12:26:29.064647 (+1343807us) spinlock_profiling.cc:243] Waited 559 ms on lock 0x7b5400207bd4. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e8c2fa 00007f7599e4db17 00007f75933c86d4 00007f75933c8662 00007f75933c8591 00007f75933c850c 00007f75933c77c2 00007f75931c348c 00007f75931c28c6 00007f75931c226f
0709 12:26:29.064815 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1285379328}
I20260709 12:26:28.944763 15250 consensus_queue.cc:237] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:29.057569 15269 leader_election.cc:290] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:29.671396 10922 raft_consensus.cc:1275] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:26:29.624481 10849 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56394 (request call id 4007) took 1354 ms (client timeout 1568 ms). Trace:
W20260709 12:26:29.785029 10849 rpcz_store.cc:269] 0709 12:26:28.271460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:28.290002 (+ 18542us) service_pool.cc:224] Handling call
0709 12:26:29.623551 (+1333549us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b5400192154. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e8c2fa 00007f7599e4db17 00007f75933c86d4 00007f75933c8662 00007f75933c8591 00007f75933c850c 00007f75933c77c2 00007f75931c348c 00007f75931c28c6 00007f75931c226f
0709 12:26:29.624400 (+   849us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2908259072}
I20260709 12:26:29.789539 11618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d9a61ecaf84695b70f8519ee57706f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:29.666642 15324 raft_consensus.cc:493] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:29.622905 10846 rpcz_store.cc:276] 0709 12:26:28.272793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:29.551508 (+1278715us) service_pool.cc:224] Handling call
0709 12:26:29.573600 (+ 22092us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:29.574165 (+   565us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:29.574205 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:29.574292 (+    87us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:26:29.574356 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:29.574435 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:29.574598 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:26:29.624408 10921 rpcz_store.cc:269] 0709 12:26:26.872435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:26.872673 (+   238us) service_pool.cc:224] Handling call
0709 12:26:28.996966 (+2124293us) spinlock_profiling.cc:243] Waited 239 ms on lock 0x7b54003cd2d4. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e8c2fa 00007f7599e4db17 00007f75933c86d4 00007f75933c8662 00007f75933c8591 00007f75933c850c 00007f75933c77c2 00007f75931c348c 00007f75931c28c6 00007f75931c226f
0709 12:26:28.997096 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":549412736}
I20260709 12:26:29.671090 11615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef3220c51df47db8859f07ab745fad5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:29.608410 10895 leader_election.cc:304] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:29.653213 15264 leader_election.cc:290] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:29.665736 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:29.615298 10924 raft_consensus.cc:2468] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 8.
I20260709 12:26:29.673187 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:29.638430 11621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352aa49c65194abbb863d7553a091f11" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:29.650507 11619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:29.642980 11589 leader_election.cc:304] T 4ef3220c51df47db8859f07ab745fad5 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:29.698253 15335 leader_election.cc:290] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:28.910264 15220 raft_consensus.cc:515] T d0aed74af73a488f8b691578ca370226 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:29.699404 15332 leader_election.cc:290] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265)
W20260709 12:26:29.626497 10923 rpcz_store.cc:269] 0709 12:26:27.719932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:27.720091 (+   159us) service_pool.cc:224] Handling call
0709 12:26:29.581050 (+1860959us) spinlock_profiling.cc:243] Waited 3.15 ms on lock 0x7b540012bbd4. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e8c2fa 00007f7599e4db17 00007f75933c86d4 00007f75933c8662 00007f75933c8591 00007f75933c850c 00007f75933c77c2 00007f75931c348c 00007f75931c28c6 00007f75931c226f
0709 12:26:29.581438 (+   388us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7244160}
I20260709 12:26:29.703063 15257 leader_election.cc:290] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:29.704214 15283 leader_election.cc:290] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:29.705448 11002 raft_consensus.cc:2468] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 7.
I20260709 12:26:29.706115 11003 raft_consensus.cc:2468] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 12.
I20260709 12:26:29.706385 11620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45920 (request call id 809) took 3385 ms. Trace:
W20260709 12:26:29.632048 10927 rpcz_store.cc:269] 0709 12:26:27.889690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:27.889823 (+   133us) service_pool.cc:224] Handling call
0709 12:26:29.587672 (+1697849us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b54002878d4. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e8c2fa 00007f7599e4db17 00007f75933c86d4 00007f75933c8662 00007f75933c8591 00007f75933c850c 00007f75933c77c2 00007f75931c348c 00007f75931c28c6 00007f75931c226f
0709 12:26:29.587902 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":416870272}
W20260709 12:26:29.711079 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 164760us
I20260709 12:26:29.711201 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b17195a94142039c40f598ed006c94" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
W20260709 12:26:29.709635 10852 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56394 (request call id 4001) took 1452 ms (client timeout 1733 ms). Trace:
I20260709 12:26:29.714958 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:29.716150 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:29.720163 10819 leader_election.cc:304] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:29.645844 15163 raft_consensus.cc:515] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:29.721546 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63ecfc9bd3945818cfe15c03f001315" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:29.728533 11616 raft_consensus.cc:2468] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 10.
I20260709 12:26:29.671103 15258 leader_election.cc:290] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:29.750074 10748 catalog_manager.cc:5697] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 7 to 8, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 8 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:29.779151 10751 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36188 (request call id 228) took 4185 ms. Trace:
I20260709 12:26:29.686110 15059 raft_consensus.cc:697] T 4ef3220c51df47db8859f07ab745fad5 P 3c52e0825c02476e89d84da9bb849f5d [term 7 LEADER]: Becoming Leader. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
I20260709 12:26:29.658994 15280 raft_consensus.cc:515] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:29.483551 15357 leader_election.cc:290] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 10 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:29.809626 10995 raft_consensus.cc:3060] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:28.915903 15323 raft_consensus.cc:515] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:29.796680 15324 raft_consensus.cc:515] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:29.811530 15283 raft_consensus.cc:493] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:29.817203 11619 raft_consensus.cc:2468] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 4.
W20260709 12:26:29.821098 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 213091us
I20260709 12:26:29.820657 10748 catalog_manager.cc:5697] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 9 to 10, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 10 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:29.823237 15238 leader_election.cc:290] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:29.818849 15101 raft_consensus.cc:493] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
W20260709 12:26:29.812947 10852 rpcz_store.cc:269] 0709 12:26:28.256892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:28.257016 (+   124us) service_pool.cc:224] Handling call
0709 12:26:29.709364 (+1452348us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b5400388954. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e8c2fa 00007f7599e4db17 00007f75933c86d4 00007f75933c8662 00007f75933c8591 00007f75933c850c 00007f75933c77c2 00007f75931c348c 00007f75931c28c6 00007f75931c226f
0709 12:26:29.709536 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2981243264}
I20260709 12:26:29.812080 11620 rpcz_store.cc:276] 0709 12:26:26.320423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:26.320605 (+   182us) service_pool.cc:224] Handling call
0709 12:26:27.525293 (+1204688us) spinlock_profiling.cc:243] Waited 5.03 ms on lock 0x7b5800160898. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7591c23db1 00007f7591d63b71 00007f7591d63a22 00007f759ac7c8d9 00007f7599dd6ee0 00007f7599ea00ab 00007f7599ea0131 00007f7599e61fc0 00007f7599e4c929 00007f7599e4c3d2 00007f75933c3bd4
0709 12:26:29.229840 (+1704547us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:29.411532 (+181692us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:29.705996 (+294464us) spinlock_profiling.cc:243] Waited 1.7 s on lock 0x7b5400860950. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e878ad 00007f7599e4c419 00007f75933c3bd4 00007f75933c3b62 00007f75933c3a91 00007f75933c3a0c 00007f75933c2cc2 00007f75931c348c 00007f75931c28c6 00007f75931c226f
0709 12:26:29.706192 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3931152896}
I20260709 12:26:29.821106 10969 leader_election.cc:304] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:29.814823 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:29.848627 11001 raft_consensus.cc:2468] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 12.
W20260709 12:26:29.852602 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 123191us
W20260709 12:26:29.853191 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 234601us
I20260709 12:26:29.795397 15196 raft_consensus.cc:515] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:29.871762 10928 raft_consensus.cc:2468] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 12.
I20260709 12:26:29.890681 10851 raft_consensus.cc:2393] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3c52e0825c02476e89d84da9bb849f5d in current term 13: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:26:29.908191 10847 raft_consensus.cc:2468] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 5.
I20260709 12:26:29.914713 10895 leader_election.cc:304] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:29.915148 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:29.909968 10853 raft_consensus.cc:2468] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 7.
I20260709 12:26:29.915854 10924 raft_consensus.cc:2468] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 8.
I20260709 12:26:29.920107 10999 raft_consensus.cc:2410] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:26:29.908191 11618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:29.911029 15214 raft_consensus.cc:2804] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:29.922745 10848 raft_consensus.cc:2468] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 12.
I20260709 12:26:29.899976 15238 raft_consensus.cc:493] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:29.912734 15248 leader_election.cc:290] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:29.938043 15218 raft_consensus.cc:493] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:29.938731 15319 raft_consensus.cc:2749] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:29.939270 15381 raft_consensus.cc:493] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:29.943732 15279 raft_consensus.cc:493] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
W20260709 12:26:29.944324 15217 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.017s	sys 0.056s
I20260709 12:26:29.957574 15218 raft_consensus.cc:515] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:29.977216 15339 leader_election.cc:290] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
W20260709 12:26:29.978828 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 336086us
I20260709 12:26:29.979131 15218 leader_election.cc:290] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:29.968837 15323 leader_election.cc:290] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:26:29.969895 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 260293us
I20260709 12:26:29.999097 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef3220c51df47db8859f07ab745fad5" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:29.999639 15382 leader_election.cc:290] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:29.922546 15101 raft_consensus.cc:515] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:30.000705 10997 raft_consensus.cc:2468] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 6.
I20260709 12:26:30.001507 10819 leader_election.cc:304] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:29.970670 15317 raft_consensus.cc:2804] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:29.973042 15280 leader_election.cc:290] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:29.975024 15238 raft_consensus.cc:515] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:29.975893 10968 leader_election.cc:304] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:29.976739 15212 raft_consensus.cc:3055] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:26:29.959805 10969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 139240us
W20260709 12:26:29.981618 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 86627.4us
I20260709 12:26:30.004060 15317 raft_consensus.cc:493] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:30.012109 15317 raft_consensus.cc:3060] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:30.012187 15323 raft_consensus.cc:2804] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:30.012758 15323 raft_consensus.cc:493] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:30.013131 15323 raft_consensus.cc:3060] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:30.003517 10819 leader_election.cc:304] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:29.920133 15283 raft_consensus.cc:515] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:29.988085 10850 raft_consensus.cc:2393] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 5: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:26:29.988766 10926 raft_consensus.cc:2410] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:26:29.989420 15277 leader_election.cc:290] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 13 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:29.989990 15220 leader_election.cc:290] T d0aed74af73a488f8b691578ca370226 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
W20260709 12:26:29.990105 15388 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.002s	sys 0.013s
I20260709 12:26:29.935182 15214 raft_consensus.cc:493] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:29.990952 15396 log.cc:927] Time spent T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 12:26:29.988150 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:29.993017 15059 consensus_queue.cc:237] T 4ef3220c51df47db8859f07ab745fad5 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:30.007293 15238 leader_election.cc:290] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:29.997816 15346 raft_consensus.cc:493] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:30.064567 15346 raft_consensus.cc:515] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:30.069453 15280 raft_consensus.cc:493] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:30.069793 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 175349us
I20260709 12:26:30.070418 15280 raft_consensus.cc:515] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:30.072599 11617 raft_consensus.cc:2468] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 12.
I20260709 12:26:30.073328 15216 raft_consensus.cc:2764] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:26:30.073642 15280 leader_election.cc:290] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:30.010280 10748 catalog_manager.cc:5697] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 11 to 12, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 12 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:29.984999 10998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57514 (request call id 1125) took 1027 ms. Trace:
I20260709 12:26:30.079896 10998 rpcz_store.cc:276] 0709 12:26:28.957163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:28.958155 (+   992us) service_pool.cc:224] Handling call
0709 12:26:28.958502 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:29.938110 (+979608us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:29.938178 (+    68us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:29.938249 (+    71us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:26:29.938292 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:29.984534 (+ 46242us) spinlock_profiling.cc:243] Waited 956 ms on lock 0x7b5400229cd4. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e88e01 00007f7594e8783e 00007f7599e4c419 00007f75933c3bd4 00007f75933c3b62 00007f75933c3a91 00007f75933c3a0c 00007f75933c2cc2 00007f75931c348c 00007f75931c28c6
0709 12:26:29.984575 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:29.984826 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2198371712}
I20260709 12:26:30.008525 10969 leader_election.cc:304] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:30.082141 15381 raft_consensus.cc:515] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:30.083169 10969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 74772.2us
W20260709 12:26:30.084794 10893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:30.086352 15381 leader_election.cc:290] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:30.086570 10969 leader_election.cc:304] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:30.088019 15258 raft_consensus.cc:2804] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:30.088683 15258 raft_consensus.cc:493] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:30.089262 15258 raft_consensus.cc:3060] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:29.815935 10751 rpcz_store.cc:276] 0709 12:26:25.552099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:25.552252 (+   153us) service_pool.cc:224] Handling call
0709 12:26:29.737481 (+4185229us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:26.110480 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:26.111342 (+   862us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:26.111407 (+    65us) write_op.cc:435] Acquired schema lock
0709 12:26:26.111427 (+    20us) tablet.cc:662] Decoding operations
0709 12:26:26.111868 (+   441us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:26.111919 (+    51us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:26.111948 (+    29us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:26:26.112163 (+   215us) tablet.cc:701] Row locks acquired
0709 12:26:26.112182 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:26:26.112359 (+   177us) write_op.cc:270] Start()
0709 12:26:26.112495 (+   136us) write_op.cc:276] Timestamp: P: 1783599986112300 usec, L: 0
0709 12:26:26.112519 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:26:26.261013 (+148494us) log.cc:844] Serialized 533 byte log entry
0709 12:26:26.266636 (+  5623us) op_driver.cc:464] REPLICATION: finished
0709 12:26:26.338070 (+ 71434us) write_op.cc:301] APPLY: starting
0709 12:26:26.338192 (+   122us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:26.360385 (+ 22193us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b540007b554. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e83e28 00007f75988be581 00007f75988bdd58 00007f75988c29f1 00007f75988c29a9 00007f75988c2939 00007f75988c2901 00007f75988c1b2d 0000000000388634 0000000000388479
0709 12:26:26.606059 (+245674us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:26.608895 (+  2836us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:26.756559 (+147664us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:26.770223 (+ 13664us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 12:26:26.771107 (+   884us) write_op.cc:312] APPLY: finished
0709 12:26:26.771342 (+   235us) log.cc:844] Serialized 25 byte log entry
0709 12:26:26.771541 (+   199us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:26.796488 (+ 24947us) write_op.cc:454] Released schema lock
0709 12:26:26.796550 (+    62us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:26.797013 (+   463us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:26.797045 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":64605,"apply.run_cpu_time_us":6599,"apply.run_wall_time_us":458958,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8307,"mutex_wait_us":12922,"num_ops":1,"prepare.queue_time_us":191,"prepare.run_cpu_time_us":10145,"prepare.run_wall_time_us":253449,"replication_time_us":153958,"spinlock_wait_cycles":240872832,"thread_start_us":18848,"threads_started":1}]]}
I20260709 12:26:30.092444 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:30.006585 15267 consensus_queue.cc:1048] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.087s
I20260709 12:26:30.100555 15283 leader_election.cc:290] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:30.010142 15163 leader_election.cc:290] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
W20260709 12:26:30.018260 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 128592us
I20260709 12:26:30.010121 10820 leader_election.cc:304] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:29.997010 15196 leader_election.cc:290] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 11 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:26:30.103477 10850 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56394 (request call id 4009) took 1831 ms (client timeout 2396 ms). Trace:
I20260709 12:26:29.934553 11618 raft_consensus.cc:3060] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:26:30.062672 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 59286.7us
I20260709 12:26:30.073828 15324 leader_election.cc:290] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:30.006186 15268 raft_consensus.cc:2804] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:26:30.007828 15212 raft_consensus.cc:740] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
W20260709 12:26:30.108841 10850 rpcz_store.cc:269] 0709 12:26:28.272091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:28.489425 (+217334us) service_pool.cc:224] Handling call
0709 12:26:30.103122 (+1613697us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b540040f6d4. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e8c2fa 00007f7599e4db17 00007f75933c86d4 00007f75933c8662 00007f75933c8591 00007f75933c850c 00007f75933c77c2 00007f75931c348c 00007f75931c28c6 00007f75931c226f
0709 12:26:30.103383 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3163046656}
I20260709 12:26:30.034492 15214 raft_consensus.cc:3060] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:30.067435 15346 leader_election.cc:290] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:30.126632 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:30.100630 15357 raft_consensus.cc:2804] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:26:30.033169 15101 leader_election.cc:290] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:30.137593 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:30.139815 10924 raft_consensus.cc:2393] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3c52e0825c02476e89d84da9bb849f5d in current term 5: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:26:30.113286 15268 raft_consensus.cc:493] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:30.032586 15248 raft_consensus.cc:493] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:30.147603 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:30.148610 11000 raft_consensus.cc:2393] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3c52e0825c02476e89d84da9bb849f5d in current term 12: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:26:30.150300 11588 leader_election.cc:304] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:30.160064 15321 raft_consensus.cc:2804] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:30.160929 15321 raft_consensus.cc:493] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:30.161140 15216 raft_consensus.cc:2749] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:26:30.161345 15321 raft_consensus.cc:3060] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:30.163987 15196 raft_consensus.cc:493] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:30.165194 15196 raft_consensus.cc:515] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:30.168049 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 158027us
I20260709 12:26:30.176560 15357 raft_consensus.cc:697] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 12 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:30.177829 15357 consensus_queue.cc:237] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:30.179174 15101 raft_consensus.cc:493] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:30.180054 15101 raft_consensus.cc:515] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:30.175233 15196 leader_election.cc:290] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:30.182538 11588 leader_election.cc:304] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:30.185839 15387 raft_consensus.cc:2804] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:26:30.186380 15387 raft_consensus.cc:493] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:30.186940 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:30.185322 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:30.188050 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63ecfc9bd3945818cfe15c03f001315" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:30.188875 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:30.189641 11002 raft_consensus.cc:2468] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 5.
I20260709 12:26:30.192031 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:30.192925 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:30.193161 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef3220c51df47db8859f07ab745fad5" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:30.193840 11000 raft_consensus.cc:3060] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:30.194429 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:26:30.143410 10968 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.116.66:39339 timed out after 1.895s (SENT) [suppressed 26 similar messages]
I20260709 12:26:30.192188 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab816bcc6183447994a2cc013e46c5f8" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:30.113022 15220 raft_consensus.cc:2749] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:30.186772 15387 raft_consensus.cc:3060] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:26:30.200574 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 78709.1us
W20260709 12:26:30.223668 10969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 137196us
I20260709 12:26:30.109481 15280 raft_consensus.cc:493] T e9331e5342644ca2bae19187b083a7d5 P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:30.178485 10752 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60734 (request call id 361) took 4604 ms. Trace:
I20260709 12:26:30.193851 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:30.202459 10995 raft_consensus.cc:2468] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 11.
I20260709 12:26:30.199447 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:30.208417 10926 raft_consensus.cc:2468] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 7.
I20260709 12:26:30.201321 10894 leader_election.cc:304] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:30.010492 15279 raft_consensus.cc:515] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:30.230321 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 59209.7us
I20260709 12:26:30.234469 15323 raft_consensus.cc:515] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:30.237367 11618 raft_consensus.cc:2468] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 9.
I20260709 12:26:30.241226 15101 leader_election.cc:290] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:30.245875 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:30.145891 15268 raft_consensus.cc:3060] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:30.263521 10927 raft_consensus.cc:2468] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 8.
I20260709 12:26:30.266227 10998 raft_consensus.cc:2393] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3c52e0825c02476e89d84da9bb849f5d in current term 9: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:26:30.266425 15215 raft_consensus.cc:2764] T 4ef3220c51df47db8859f07ab745fad5 P 3c52e0825c02476e89d84da9bb849f5d [term 7 LEADER]: Leader election decision vote started in defunct term 6: won
I20260709 12:26:30.267302 10969 leader_election.cc:304] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
W20260709 12:26:30.275328 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 152935us
I20260709 12:26:30.277218 10999 raft_consensus.cc:2468] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 10.
I20260709 12:26:30.277325 10819 leader_election.cc:304] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:30.245194 15323 leader_election.cc:290] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:30.234752 15258 raft_consensus.cc:515] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:30.287693 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 87718.1us
I20260709 12:26:30.287878 15284 raft_consensus.cc:2749] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:30.288332 15251 raft_consensus.cc:2804] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:30.224543 10752 rpcz_store.cc:276] 0709 12:26:25.573402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:25.573558 (+   156us) service_pool.cc:224] Handling call
0709 12:26:30.178096 (+4604538us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:26.360920 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:26.361603 (+   683us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:26.361643 (+    40us) write_op.cc:435] Acquired schema lock
0709 12:26:26.361665 (+    22us) tablet.cc:662] Decoding operations
0709 12:26:26.362122 (+   457us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:26.362179 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:26.362212 (+    33us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:26:26.362592 (+   380us) tablet.cc:701] Row locks acquired
0709 12:26:26.362621 (+    29us) write_op.cc:260] PREPARE: finished
0709 12:26:26.464329 (+101708us) write_op.cc:270] Start()
0709 12:26:26.491302 (+ 26973us) write_op.cc:276] Timestamp: P: 1783599986390469 usec, L: 0
0709 12:26:26.491352 (+    50us) op_driver.cc:348] REPLICATION: starting
0709 12:26:26.605752 (+114400us) log.cc:844] Serialized 538 byte log entry
0709 12:26:28.447293 (+1841541us) spinlock_profiling.cc:243] Waited 5.05 ms on lock 0x7b180027b5c0. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f759ac63ab1 00007f759ac70281 00007f75988bf41d 00007f75988c171a 00007f75988c16a8 00007f75988c1628 00007f75988c15e3 00007f75988c07fc 00007f759acf32f6 00007f759acedaa8 00007f7594e94310
0709 12:26:28.447384 (+    91us) op_driver.cc:464] REPLICATION: finished
0709 12:26:29.442935 (+995551us) write_op.cc:301] APPLY: starting
0709 12:26:29.443050 (+   115us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:29.444748 (+  1698us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:29.444792 (+    44us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:29.445907 (+  1115us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:29.446216 (+   309us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 12:26:29.446295 (+    79us) write_op.cc:312] APPLY: finished
0709 12:26:29.446633 (+   338us) log.cc:844] Serialized 25 byte log entry
0709 12:26:30.101813 (+655180us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:30.101968 (+   155us) write_op.cc:454] Released schema lock
0709 12:26:30.102173 (+   205us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:30.103283 (+  1110us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:30.103315 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":995109,"apply.run_cpu_time_us":18080,"apply.run_wall_time_us":660269,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8307,"num_ops":1,"prepare.queue_time_us":212276,"prepare.run_cpu_time_us":4484,"prepare.run_wall_time_us":309503,"replication_time_us":149015,"spinlock_wait_cycles":11614976,"thread_start_us":1056338,"threads_started":2,"wal-append.queue_time_us":533806}]]}
W20260709 12:26:30.292142 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 46664.4us
I20260709 12:26:30.292580 11000 raft_consensus.cc:2468] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 7.
I20260709 12:26:30.298177 15251 raft_consensus.cc:493] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:30.300123 15251 raft_consensus.cc:3060] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:26:30.292790 15405 log.cc:927] Time spent T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
W20260709 12:26:30.307924 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 43910us
I20260709 12:26:30.283983 15220 raft_consensus.cc:2749] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:26:30.297338 15326 consensus_meta.cc:287] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d: Time spent flushing consensus metadata: real 0.615s	user 0.011s	sys 0.005s
I20260709 12:26:30.268651 15280 raft_consensus.cc:515] T e9331e5342644ca2bae19187b083a7d5 P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:30.321713 11001 raft_consensus.cc:2468] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 12.
I20260709 12:26:30.323522 10819 leader_election.cc:304] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:30.326781 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:30.280252 15248 raft_consensus.cc:515] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:30.335278 10923 raft_consensus.cc:2468] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 10.
W20260709 12:26:30.356086 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 47439.2us
I20260709 12:26:30.340893 11588 leader_election.cc:304] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
W20260709 12:26:30.355279 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 59829.7us
W20260709 12:26:30.360575 10969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 93460.5us
I20260709 12:26:30.342159 15101 raft_consensus.cc:2804] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:26:30.367673 10895 leader_election.cc:400] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 election: Vote denied by peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945) with higher term. Message: Invalid argument: T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for earlier term 8. Current term is 9.
I20260709 12:26:30.368206 10895 leader_election.cc:403] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:26:30.322930 15326 raft_consensus.cc:515] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:30.372555 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 229178us
I20260709 12:26:30.372881 11588 leader_election.cc:304] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:30.377947 11588 leader_election.cc:304] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:30.364921 15196 raft_consensus.cc:2804] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:26:30.379892 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 49331.1us
I20260709 12:26:30.221632 15212 consensus_queue.cc:260] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:30.389972 11589 leader_election.cc:304] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:30.379052 15059 raft_consensus.cc:2804] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:26:30.386068 15279 leader_election.cc:290] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:30.407925 10820 leader_election.cc:304] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:30.381209 15101 raft_consensus.cc:697] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [term 8 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:30.384555 15215 raft_consensus.cc:2804] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:30.422899 15269 raft_consensus.cc:2764] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:26:30.425873 15248 leader_election.cc:290] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:30.428294 15344 raft_consensus.cc:2749] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:26:30.388643 15284 raft_consensus.cc:3060] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:26:30.407164 15407 log.cc:927] Time spent T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:26:30.433220 10969 leader_election.cc:304] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:30.389643 15196 raft_consensus.cc:697] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 12 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:30.447701 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:30.448655 10927 raft_consensus.cc:2368] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 8. Current term is 9.
W20260709 12:26:30.453167 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 139771us
I20260709 12:26:30.421200 15215 raft_consensus.cc:493] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:30.457841 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 57157.1us
W20260709 12:26:30.463181 15409 log.cc:927] Time spent T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 12:26:30.452349 15212 raft_consensus.cc:3060] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:30.472514 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:30.473630 11000 raft_consensus.cc:2468] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 11.
I20260709 12:26:30.476735 10854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56394 (request call id 4010) took 2204 ms. Trace:
I20260709 12:26:30.477375 10854 rpcz_store.cc:276] 0709 12:26:28.272335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:28.902509 (+630174us) service_pool.cc:224] Handling call
0709 12:26:28.915476 (+ 12967us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:29.896521 (+981045us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:29.903269 (+  6748us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:29.979714 (+ 76445us) log.cc:844] Serialized 26 byte log entry
0709 12:26:30.133699 (+153985us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:26:30.133738 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:30.133861 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:30.476187 (+342326us) raft_consensus.cc:1685] finished
0709 12:26:30.476215 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:30.476435 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":811049,"raft.queue_time_us":1020790,"raft.run_cpu_time_us":335,"raft.run_wall_time_us":10062,"thread_start_us":153493,"threads_started":1,"wal-append.queue_time_us":294840}
I20260709 12:26:30.452889 15323 raft_consensus.cc:2749] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:26:30.489231 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 101913us
I20260709 12:26:30.492386 15101 consensus_queue.cc:237] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:30.495977 15163 raft_consensus.cc:2804] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:30.496528 15163 raft_consensus.cc:493] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:30.496948 15163 raft_consensus.cc:3060] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:30.499814 15258 leader_election.cc:290] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:30.505247 15215 raft_consensus.cc:3060] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:30.513630 10895 leader_election.cc:304] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:30.515216 15355 raft_consensus.cc:2804] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:30.515892 15355 raft_consensus.cc:493] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:30.516355 15355 raft_consensus.cc:3060] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:30.517508 15280 leader_election.cc:290] T e9331e5342644ca2bae19187b083a7d5 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:30.520211 10895 leader_election.cc:304] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:30.502120 15196 consensus_queue.cc:237] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:30.527172 15326 leader_election.cc:290] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 13 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:30.529434 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:30.530773 11000 raft_consensus.cc:2393] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 5: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:26:30.532285 15321 raft_consensus.cc:515] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:30.537343 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 185914us
W20260709 12:26:30.539256 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 141874us
I20260709 12:26:30.538029 11589 leader_election.cc:304] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:30.541194 15248 raft_consensus.cc:2764] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:26:30.565388 10928 raft_consensus.cc:1275] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:26:30.411928 15059 raft_consensus.cc:493] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
W20260709 12:26:30.555887 15317 consensus_meta.cc:287] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040: Time spent flushing consensus metadata: real 0.543s	user 0.014s	sys 0.000s
I20260709 12:26:30.533914 15251 raft_consensus.cc:515] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:30.576656 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:30.580951 15250 raft_consensus.cc:493] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:30.587992 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352aa49c65194abbb863d7553a091f11" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:30.590235 15321 leader_election.cc:290] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:30.535280 15387 raft_consensus.cc:515] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:30.608549 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 70650.2us
I20260709 12:26:30.591143 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:30.565991 15216 raft_consensus.cc:2804] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:30.613575 10895 leader_election.cc:304] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:30.616097 10925 raft_consensus.cc:2368] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 9. Current term is 10.
I20260709 12:26:30.621866 15250 raft_consensus.cc:515] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:30.624704 15250 leader_election.cc:290] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:30.577693 15059 raft_consensus.cc:3060] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:30.626124 10928 raft_consensus.cc:3060] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:26:30.628487 10969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 223812us
I20260709 12:26:30.624892 15387 leader_election.cc:290] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 9 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:30.598803 15268 raft_consensus.cc:515] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:30.638604 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 77951.6us
I20260709 12:26:30.644145 10969 leader_election.cc:304] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:30.617066 15216 raft_consensus.cc:493] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:30.608038 15317 raft_consensus.cc:515] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:30.651191 15216 raft_consensus.cc:3060] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:30.656967 11615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:30.675088 10969 leader_election.cc:304] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:30.654254 15323 raft_consensus.cc:2749] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:30.682928 11589 leader_election.cc:304] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:30.648509 15258 consensus_queue.cc:1048] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:26:30.703069 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:30.681591 15250 raft_consensus.cc:2804] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:26:30.703819 10927 raft_consensus.cc:3060] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:30.661579 15214 raft_consensus.cc:515] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:30.704201 10895 leader_election.cc:304] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:30.698547 15220 raft_consensus.cc:2804] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:30.683877 15335 consensus_queue.cc:1048] T 4ef3220c51df47db8859f07ab745fad5 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
W20260709 12:26:30.710353 15406 log.cc:927] Time spent T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:26:30.708110 15250 raft_consensus.cc:493] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:30.722539 15280 raft_consensus.cc:2804] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:30.723210 15220 raft_consensus.cc:493] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:30.736603 15250 raft_consensus.cc:3060] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:30.747416 10928 raft_consensus.cc:2468] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 13.
I20260709 12:26:30.731320 15344 consensus_queue.cc:1048] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:26:30.741915 15280 raft_consensus.cc:493] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:30.753315 15280 raft_consensus.cc:3060] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:30.741765 15220 raft_consensus.cc:3060] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:30.741631 11618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352aa49c65194abbb863d7553a091f11" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:30.760599 15283 raft_consensus.cc:2749] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:30.757355 15251 leader_election.cc:290] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 11 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:30.763867 15268 leader_election.cc:290] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:30.771008 15284 raft_consensus.cc:2749] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945) with higher term. Message: Invalid argument: T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for earlier term 8. Current term is 9.
W20260709 12:26:30.788573 10969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 92013.2us
I20260709 12:26:30.775097 15267 raft_consensus.cc:493] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:30.808769 15215 raft_consensus.cc:515] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:30.809362 15163 raft_consensus.cc:515] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:30.811519 15215 leader_election.cc:290] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 11 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:30.812235 15272 raft_consensus.cc:493] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:30.813186 15272 raft_consensus.cc:515] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:30.817277 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:30.817543 10927 raft_consensus.cc:2468] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 9.
I20260709 12:26:30.785434 15317 leader_election.cc:290] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:30.823788 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:30.827263 10850 raft_consensus.cc:2393] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 5: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:26:30.817296 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:30.829303 10849 raft_consensus.cc:2468] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 3.
I20260709 12:26:30.841346 10969 leader_election.cc:304] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:30.882354 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:30.883546 10927 raft_consensus.cc:2393] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 13: Already voted for candidate 3c52e0825c02476e89d84da9bb849f5d in this term.
I20260709 12:26:30.895148 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
W20260709 12:26:30.898259 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 231862us
I20260709 12:26:30.892413 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:30.901049 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
W20260709 12:26:30.884847 10969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 54666.5us
I20260709 12:26:30.902880 10850 raft_consensus.cc:2393] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 11: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:26:30.902782 10849 raft_consensus.cc:2393] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 11: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
W20260709 12:26:30.904853 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 166027us
I20260709 12:26:30.906185 10925 raft_consensus.cc:1240] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:26:30.906966 10969 leader_election.cc:304] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:30.912391 11624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45920 (request call id 819) took 1297 ms. Trace:
I20260709 12:26:30.841257 15267 raft_consensus.cc:515] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:30.911823 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
W20260709 12:26:30.916826 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 234078us
I20260709 12:26:30.911695 10895 leader_election.cc:304] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:30.923187 10845 raft_consensus.cc:2393] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 9: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:26:30.916891 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:30.928635 10921 raft_consensus.cc:2393] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 9: Already voted for candidate 3c52e0825c02476e89d84da9bb849f5d in this term.
I20260709 12:26:30.928479 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:30.929490 10925 raft_consensus.cc:3060] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:30.931723 15419 raft_consensus.cc:2804] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:26:30.932166 15163 leader_election.cc:290] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:30.932504 15419 raft_consensus.cc:697] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 9 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:26:30.933159 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:30.933791 10849 raft_consensus.cc:3060] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:30.933538 15419 consensus_queue.cc:237] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:30.937404 15355 raft_consensus.cc:515] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:30.939795 10928 raft_consensus.cc:1240] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 10. Current term is 11. Ops: []
I20260709 12:26:30.940819 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:30.942423 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:30.942489 11589 leader_election.cc:304] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:30.944303 15269 raft_consensus.cc:2804] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:30.944911 15269 raft_consensus.cc:493] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:30.945353 15269 raft_consensus.cc:3060] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:30.945953 15250 raft_consensus.cc:515] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:30.947088 10924 raft_consensus.cc:1240] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 6. Current term is 7. Ops: []
I20260709 12:26:30.950332 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:30.914937 11624 rpcz_store.cc:276] 0709 12:26:29.611921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:29.723446 (+111525us) service_pool.cc:224] Handling call
0709 12:26:29.760154 (+ 36708us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:29.795958 (+ 35804us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:26:29.926250 (+130292us) log.cc:844] Serialized 14 byte log entry
0709 12:26:30.452477 (+526227us) spinlock_profiling.cc:243] Waited 2.48 ms on lock 0x7b18003de820. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f759ac63ab1 00007f759ac70281 00007f7591d7de07 00007f759abd89a9 00007f7591d9a69b 00007f7591d9893f 00007f7591d9ac02 00007f7594a2220b 00007f7594a27d23 00007f7594a2823a 00007f7594e92a2a
0709 12:26:30.905097 (+452620us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:30.905194 (+    97us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:26:30.908586 (+  3392us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:30.908678 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:30.908772 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":310040,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":58,"raft.queue_time_us":34942,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":2803,"spinlock_wait_cycles":5701376,"thread_start_us":571491,"threads_started":3,"wal-append.queue_time_us":746524}
I20260709 12:26:30.951798 15258 raft_consensus.cc:2749] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:26:30.963181 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:30.955428 10925 raft_consensus.cc:2468] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 11.
I20260709 12:26:30.964360 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:30.964829 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:30.965679 10850 raft_consensus.cc:2468] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 10.
I20260709 12:26:30.966674 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:30.966972 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab816bcc6183447994a2cc013e46c5f8" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:30.967406 10845 raft_consensus.cc:2468] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 6.
I20260709 12:26:30.967732 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:30.968492 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:30.969530 10845 raft_consensus.cc:2468] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 8.
I20260709 12:26:30.968528 10925 raft_consensus.cc:2393] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 11: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:26:30.970758 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9331e5342644ca2bae19187b083a7d5" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:30.965720 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6a1da21304fcfacab384a6afc4101" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:30.972539 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:30.976696 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fd8fdac2fa449e9e184f3d668ea1a7" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:26:30.978058 15212 consensus_meta.cc:287] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040: Time spent flushing consensus metadata: real 0.510s	user 0.006s	sys 0.006s
I20260709 12:26:30.979086 10852 raft_consensus.cc:2410] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:26:30.910624 15272 leader_election.cc:290] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:30.983028 10819 leader_election.cc:400] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 election: Vote denied by peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339) with higher term. Message: Invalid argument: T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 8. Current term is 9.
I20260709 12:26:30.983371 10819 leader_election.cc:403] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:26:30.984012 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:30.984963 10922 raft_consensus.cc:3060] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:30.985222 15272 raft_consensus.cc:3060] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:30.986763 10819 leader_election.cc:400] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 election: Vote denied by peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339) with higher term. Message: Invalid argument: T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 9. Current term is 10.
I20260709 12:26:30.987111 10819 leader_election.cc:403] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:26:30.959278 15267 leader_election.cc:290] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:30.988415 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:30.989923 11615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:30.991344 15250 leader_election.cc:290] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:30.943369 15216 raft_consensus.cc:515] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:30.993305 11615 raft_consensus.cc:1813] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Handling vote request from an unknown peer 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:30.993894 11615 raft_consensus.cc:2393] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 5: Already voted for candidate 3c52e0825c02476e89d84da9bb849f5d in this term.
I20260709 12:26:30.994541 15216 leader_election.cc:290] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 5 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:30.994686 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:30.995141 10819 leader_election.cc:304] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:30.995280 15267 consensus_queue.cc:1059] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:30.996714 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:30.997838 15317 raft_consensus.cc:2804] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:26:30.998589 15317 raft_consensus.cc:697] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 11 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:30.999784 15317 consensus_queue.cc:237] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:31.007516 10849 raft_consensus.cc:2468] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 10.
W20260709 12:26:31.006585 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 104031us
I20260709 12:26:30.997862 10848 raft_consensus.cc:2468] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 7.
I20260709 12:26:31.010838 10850 raft_consensus.cc:2468] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 3.
I20260709 12:26:31.019995 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:31.021842 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63ecfc9bd3945818cfe15c03f001315" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:31.022806 10849 raft_consensus.cc:2468] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 5.
I20260709 12:26:31.025772 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac8522e549a46e09593fa4c2e175557" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:31.029356 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:31.030062 10849 raft_consensus.cc:2468] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 7.
I20260709 12:26:31.036526 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac83709373b4efd9c3aa1472a9f9022" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
W20260709 12:26:31.036887 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 71773.8us
I20260709 12:26:31.041561 10921 raft_consensus.cc:2368] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 5. Current term is 6.
I20260709 12:26:31.040884 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:31.042430 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:31.008481 15163 raft_consensus.cc:2749] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339) with higher term. Message: Invalid argument: T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 9. Current term is 10.
I20260709 12:26:31.043522 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:31.041363 10853 raft_consensus.cc:2468] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 4.
I20260709 12:26:31.046290 10895 leader_election.cc:304] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:31.042430 11620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:31.045755 11617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
W20260709 12:26:31.048508 10969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 146309us
I20260709 12:26:31.050266 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:31.056779 10850 raft_consensus.cc:2393] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 12: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:26:31.059299 10845 raft_consensus.cc:2393] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3c52e0825c02476e89d84da9bb849f5d in current term 13: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:26:31.059996 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:31.066262 11616 raft_consensus.cc:1240] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 10. Current term is 11. Ops: []
I20260709 12:26:31.036106 15267 consensus_queue.cc:1243] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer e2d5c637307a407ab688f5ccd6f0fcea log is divergent from this leader: its last log entry 5.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:26:31.071043 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:31.065115 11621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63ecfc9bd3945818cfe15c03f001315" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
W20260709 12:26:31.068439 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 49068.8us
I20260709 12:26:31.070339 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fd8fdac2fa449e9e184f3d668ea1a7" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:31.075026 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:31.076421 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9331e5342644ca2bae19187b083a7d5" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:31.077375 10999 raft_consensus.cc:2468] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 4.
I20260709 12:26:31.075022 10846 raft_consensus.cc:3060] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:31.070914 11618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5794ba618e514e28a7542ab6af39d8c9" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:31.084036 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:31.084959 10925 raft_consensus.cc:3060] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:31.087774 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:31.091856 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aed74af73a488f8b691578ca370226" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:31.092546 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:31.074203 10894 leader_election.cc:304] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d
I20260709 12:26:31.085042 10996 raft_consensus.cc:1275] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:26:31.093916 10850 raft_consensus.cc:2393] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3c52e0825c02476e89d84da9bb849f5d in current term 13: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:26:31.028551 15280 raft_consensus.cc:515] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:31.101352 10922 raft_consensus.cc:2468] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 5.
I20260709 12:26:31.103399 10848 raft_consensus.cc:2393] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 9: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:26:31.099896 11620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:31.103426 11621 raft_consensus.cc:2468] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 5.
I20260709 12:26:31.056342 15101 raft_consensus.cc:493] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:31.070209 15355 leader_election.cc:290] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:26:31.133039 10820 connection.cc:256] RPC call timeout handler was delayed by -1.6266496620000908s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2149s for a response
I20260709 12:26:31.133939 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:26:31.134241 10820 connection.cc:256] RPC call timeout handler was delayed by -1.2568877210001119s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1683s for a response
I20260709 12:26:31.054780 15059 raft_consensus.cc:515] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:31.139153 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:31.135548 11619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9331e5342644ca2bae19187b083a7d5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:31.149293 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:31.149672 11619 raft_consensus.cc:2468] T e9331e5342644ca2bae19187b083a7d5 P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 4.
I20260709 12:26:31.150892 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:31.151976 15101 raft_consensus.cc:515] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:31.154354 15101 leader_election.cc:290] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:31.155867 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:31.155993 15430 raft_consensus.cc:493] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:31.156472 15280 leader_election.cc:290] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 11 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:31.156716 10996 raft_consensus.cc:2468] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 12.
I20260709 12:26:31.156860 15430 raft_consensus.cc:515] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:31.158800 11618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:31.159842 11618 raft_consensus.cc:2393] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 8: Already voted for candidate 3c52e0825c02476e89d84da9bb849f5d in this term.
I20260709 12:26:31.160897 11618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6a1da21304fcfacab384a6afc4101" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:31.161226 11619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:31.162326 11618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:31.162292 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
W20260709 12:26:31.155860 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 81793.1us
I20260709 12:26:31.150930 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:31.164119 10924 raft_consensus.cc:2393] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3c52e0825c02476e89d84da9bb849f5d in current term 5: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:26:31.109176 15248 raft_consensus.cc:2764] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:26:31.165122 11588 leader_election.cc:304] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:31.170763 10925 raft_consensus.cc:2468] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 11.
I20260709 12:26:31.172525 11622 raft_consensus.cc:2393] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 5: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:26:31.173054 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:31.172470 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:31.173911 10852 raft_consensus.cc:2468] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 12.
I20260709 12:26:31.174543 11001 raft_consensus.cc:2468] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 10.
I20260709 12:26:31.182600 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:31.184638 11588 leader_election.cc:304] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:31.139263 15250 raft_consensus.cc:2804] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:31.176002 10894 leader_election.cc:304] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:31.186307 11588 leader_election.cc:304] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:31.187091 11622 raft_consensus.cc:2393] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 13: Already voted for candidate 3c52e0825c02476e89d84da9bb849f5d in this term.
I20260709 12:26:31.187739 11588 leader_election.cc:304] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:31.139330 15424 raft_consensus.cc:2804] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:31.177561 11003 raft_consensus.cc:2376] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 8. Re-sending same reply.
I20260709 12:26:31.191910 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad766f48812a4ddeb383179b1d84907b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:31.194535 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:31.196300 11001 raft_consensus.cc:3060] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:31.192890 15424 raft_consensus.cc:493] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:31.196895 15424 raft_consensus.cc:3060] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:31.199927 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:31.200163 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:31.200733 15212 raft_consensus.cc:3055] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:26:31.201241 15212 raft_consensus.cc:740] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:31.201598 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:31.202201 11619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c6d38c4d8a90a81975a6a0cb13" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:31.202512 10849 raft_consensus.cc:2468] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 9.
I20260709 12:26:31.204138 11618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:31.204957 11618 raft_consensus.cc:2368] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 9. Current term is 10.
I20260709 12:26:31.193596 15387 raft_consensus.cc:2804] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:26:31.206913 15424 raft_consensus.cc:515] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:31.208366 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:31.208870 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5794ba618e514e28a7542ab6af39d8c9" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:31.209723 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:31.210352 11003 raft_consensus.cc:3060] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:26:31.212288 10997 raft_consensus.cc:1275] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:26:31.213914 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:31.214068 10925 raft_consensus.cc:1240] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Rejecting Update request from peer 3c52e0825c02476e89d84da9bb849f5d for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:31.214732 15326 raft_consensus.cc:2804] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:31.215453 15326 raft_consensus.cc:493] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:31.215888 15326 raft_consensus.cc:3060] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:31.218588 11003 raft_consensus.cc:2468] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 12.
I20260709 12:26:31.221084 15424 leader_election.cc:290] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:31.224088 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:31.224766 15059 leader_election.cc:290] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 8 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:31.201368 10845 raft_consensus.cc:2393] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3c52e0825c02476e89d84da9bb849f5d in current term 9: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:26:31.225430 15214 leader_election.cc:290] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:31.225988 15326 raft_consensus.cc:515] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:31.227824 15423 raft_consensus.cc:2749] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:31.228633 15326 leader_election.cc:290] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 11 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:26:31.229137 15428 log.cc:927] Time spent T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:26:31.229841 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:31.184103 15280 raft_consensus.cc:493] T e8b17195a94142039c40f598ed006c94 P 3c52e0825c02476e89d84da9bb849f5d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:31.230460 10929 raft_consensus.cc:3060] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:31.232286 10846 raft_consensus.cc:2468] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 8.
I20260709 12:26:31.202431 15212 consensus_queue.cc:260] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:31.235119 15212 raft_consensus.cc:3060] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:31.194432 10895 leader_election.cc:304] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:31.236403 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:31.237317 10849 raft_consensus.cc:2393] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 5: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
W20260709 12:26:31.238291 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 50734.2us
I20260709 12:26:31.238471 10849 raft_consensus.cc:1275] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 12:26:31.244153 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 68268.6us
I20260709 12:26:31.239301 11588 leader_election.cc:304] T ab816bcc6183447994a2cc013e46c5f8 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:31.188894 15250 raft_consensus.cc:493] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:31.271183 10850 raft_consensus.cc:1275] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:26:31.189554 15420 raft_consensus.cc:2804] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:26:31.274611 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 104971us
I20260709 12:26:31.233815 15430 leader_election.cc:290] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:31.297601 15215 raft_consensus.cc:493] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:31.298070 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 58835.5us
I20260709 12:26:31.298368 15215 raft_consensus.cc:515] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:31.298978 11588 leader_election.cc:304] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:31.301472 15215 leader_election.cc:290] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:31.209525 15220 raft_consensus.cc:515] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:31.290642 11001 raft_consensus.cc:2468] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 8.
I20260709 12:26:31.279723 10895 leader_election.cc:304] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
W20260709 12:26:31.303043 10969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 228354us
I20260709 12:26:31.309412 11617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:31.309782 10844 tablet_service.cc:1558] Processing DeleteTablet for tablet 3357adbb6a514faf958aff009c4e4af8 with delete_type TABLET_DATA_TOMBSTONED (TS 80cd7d227db44f34a6108591dad9c040 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:56372
I20260709 12:26:31.309424 11620 raft_consensus.cc:1240] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 10. Current term is 11. Ops: []
I20260709 12:26:31.311600 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:31.307372 15387 raft_consensus.cc:697] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 3c52e0825c02476e89d84da9bb849f5d [term 9 LEADER]: Becoming Leader. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
I20260709 12:26:31.312350 10853 raft_consensus.cc:2393] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3c52e0825c02476e89d84da9bb849f5d in current term 9: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:26:31.312803 15387 consensus_queue.cc:237] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:31.316431 10845 raft_consensus.cc:1275] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:26:31.318536 10929 raft_consensus.cc:2468] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 9.
I20260709 12:26:31.272702 15429 raft_consensus.cc:2804] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:26:31.230594 15280 raft_consensus.cc:515] T e8b17195a94142039c40f598ed006c94 P 3c52e0825c02476e89d84da9bb849f5d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:31.275290 15250 raft_consensus.cc:3060] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:31.331662 10998 raft_consensus.cc:2368] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3c52e0825c02476e89d84da9bb849f5d for earlier term 5. Current term is 6.
I20260709 12:26:31.330471 10969 leader_election.cc:304] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:31.333786 11588 leader_election.cc:304] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:31.308408 15215 raft_consensus.cc:2804] T ab816bcc6183447994a2cc013e46c5f8 P 3c52e0825c02476e89d84da9bb849f5d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:31.307473 15326 raft_consensus.cc:2804] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:26:31.349706 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 70114us
I20260709 12:26:31.323235 15424 raft_consensus.cc:2764] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:26:31.357506 10922 raft_consensus.cc:1275] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:26:31.352587 10819 leader_election.cc:400] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 election: Vote denied by peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339) with higher term. Message: Invalid argument: T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 5. Current term is 6.
I20260709 12:26:31.352360 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:31.359398 10819 leader_election.cc:403] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:26:31.316504 15420 raft_consensus.cc:697] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [term 13 LEADER]: Becoming Leader. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
I20260709 12:26:31.325448 15429 raft_consensus.cc:493] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
W20260709 12:26:31.360109 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 81182.1us
W20260709 12:26:31.367763 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 65071.3us
I20260709 12:26:31.369529 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:31.370689 10894 leader_election.cc:304] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:31.363837 10819 leader_election.cc:304] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:31.372483 11588 leader_election.cc:304] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:31.355899 10895 leader_election.cc:304] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:31.345780 15423 raft_consensus.cc:2804] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:31.348564 15215 raft_consensus.cc:493] T ab816bcc6183447994a2cc013e46c5f8 P 3c52e0825c02476e89d84da9bb849f5d [term 3 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:31.345469 15059 raft_consensus.cc:2804] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:26:31.345567 15326 raft_consensus.cc:493] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:31.369163 15267 raft_consensus.cc:3060] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:31.333112 15430 consensus_queue.cc:1059] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 12:26:31.366469 15429 raft_consensus.cc:3060] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:31.393714 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:31.362087 15163 raft_consensus.cc:493] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:31.395913 10922 raft_consensus.cc:3060] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:31.387235 15251 raft_consensus.cc:2804] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:31.395033 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:31.400027 10925 raft_consensus.cc:2393] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3c52e0825c02476e89d84da9bb849f5d in current term 9: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:26:31.383991 15215 raft_consensus.cc:3060] T ab816bcc6183447994a2cc013e46c5f8 P 3c52e0825c02476e89d84da9bb849f5d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:31.388835 15326 raft_consensus.cc:3060] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:31.384161 15059 raft_consensus.cc:493] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:31.389962 15216 raft_consensus.cc:2804] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:26:31.411113 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:31.397868 15251 raft_consensus.cc:697] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 5 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:31.429191 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:26:31.429670 15438 log.cc:927] Time spent T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
W20260709 12:26:31.430115 15437 log.cc:927] Time spent T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 12:26:31.430459 15420 consensus_queue.cc:237] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:31.431412 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:31.432199 10854 raft_consensus.cc:2468] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 10.
I20260709 12:26:31.392292 15442 raft_consensus.cc:2804] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:31.434734 15442 raft_consensus.cc:493] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:31.435137 15442 raft_consensus.cc:3060] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:31.436300 15443 tablet_replica.cc:333] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040: stopping tablet replica
I20260709 12:26:31.438308 15443 raft_consensus.cc:2243] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:31.439519 15443 raft_consensus.cc:2272] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:31.445201 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 61631.3us
W20260709 12:26:31.449009 15435 log.cc:927] Time spent T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 12:26:31.449357 15443 ts_tablet_manager.cc:1916] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:31.422780 15059 raft_consensus.cc:3060] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:31.450467 15248 consensus_queue.cc:1048] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:26:31.452282 15248 consensus_queue.cc:1048] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:26:31.452978 15423 raft_consensus.cc:493] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:31.453510 15423 raft_consensus.cc:3060] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:31.410597 15335 raft_consensus.cc:493] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:31.459272 15442 raft_consensus.cc:515] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:31.473637 15258 raft_consensus.cc:3055] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:26:31.474313 15258 raft_consensus.cc:740] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:26:31.417552 15357 raft_consensus.cc:2804] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:26:31.476061 15442 leader_election.cc:290] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:31.476281 15357 raft_consensus.cc:697] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 12 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:31.478096 15357 consensus_queue.cc:237] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:31.425467 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 61751.6us
I20260709 12:26:31.429949 10996 raft_consensus.cc:2468] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 12.
W20260709 12:26:31.415853 10969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 75287.8us
W20260709 12:26:31.482023 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 103383us
I20260709 12:26:31.493194 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:31.483896 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c6d38c4d8a90a81975a6a0cb13" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:31.398284 15284 raft_consensus.cc:2804] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:26:31.429733 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63ecfc9bd3945818cfe15c03f001315" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:31.489684 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:31.415454 11588 leader_election.cc:304] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:31.492277 10995 raft_consensus.cc:1275] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:26:31.481015 15280 leader_election.cc:290] T e8b17195a94142039c40f598ed006c94 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:31.454995 15335 raft_consensus.cc:515] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:31.497187 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 81846.9us
W20260709 12:26:31.499418 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 109995us
I20260709 12:26:31.513939 10819 leader_election.cc:304] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:31.522926 10922 raft_consensus.cc:2468] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 8.
I20260709 12:26:31.526696 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:31.427405 15216 raft_consensus.cc:493] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:31.550770  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:31.418129 15163 raft_consensus.cc:515] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:31.515182 15425 raft_consensus.cc:2804] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:26:31.536417 15269 consensus_meta.cc:287] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d: Time spent flushing consensus metadata: real 0.590s	user 0.012s	sys 0.003s
I20260709 12:26:31.568306 10895 leader_election.cc:304] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:31.528530 15284 raft_consensus.cc:697] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 10 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:31.548866 15216 raft_consensus.cc:3060] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:31.578200 10748 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60730 (request call id 350) took 5397 ms. Trace:
I20260709 12:26:31.570156 11621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9331e5342644ca2bae19187b083a7d5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:31.585745 11621 raft_consensus.cc:3060] T e9331e5342644ca2bae19187b083a7d5 P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:26:31.585947 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 115464us
I20260709 12:26:31.492698 15258 consensus_queue.cc:260] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:31.598560 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 84708.5us
I20260709 12:26:31.549666 15212 consensus_queue.cc:1059] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 12:26:31.600814 10895 leader_election.cc:304] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:31.563738 15426 consensus_queue.cc:1059] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 12:26:31.584482 15220 leader_election.cc:290] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:31.584631 10748 rpcz_store.cc:276] 0709 12:26:26.180943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:26.181148 (+   205us) service_pool.cc:224] Handling call
0709 12:26:28.155139 (+1973991us) spinlock_profiling.cc:243] Waited 52.4 ms on lock 0x7b540007b554. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df2090 00007f7594e90f3a 00007f759ac46e9c 00007f759ad4504e 00007f75992062a4 00007f7599206232 00007f7599206161 00007f75992060dc 00007f7599205392 00007f75931c348c 00007f75931c28c6
0709 12:26:31.578101 (+3422962us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:30.522211 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:30.522955 (+   744us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:30.523006 (+    51us) write_op.cc:435] Acquired schema lock
0709 12:26:30.523023 (+    17us) tablet.cc:662] Decoding operations
0709 12:26:30.523694 (+   671us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:30.523787 (+    93us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:30.523820 (+    33us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:26:30.524302 (+   482us) tablet.cc:701] Row locks acquired
0709 12:26:30.524351 (+    49us) write_op.cc:260] PREPARE: finished
0709 12:26:30.524532 (+   181us) write_op.cc:270] Start()
0709 12:26:30.524714 (+   182us) write_op.cc:276] Timestamp: P: 1783599990524452 usec, L: 0
0709 12:26:30.524751 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 12:26:30.637517 (+112766us) log.cc:844] Serialized 1308 byte log entry
0709 12:26:31.002173 (+364656us) op_driver.cc:464] REPLICATION: finished
0709 12:26:31.270403 (+268230us) write_op.cc:301] APPLY: starting
0709 12:26:31.270525 (+   122us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:31.295885 (+ 25360us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:31.296144 (+   259us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:31.442145 (+146001us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:31.442608 (+   463us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=0,mrs_lookups=0
0709 12:26:31.442674 (+    66us) write_op.cc:312] APPLY: finished
0709 12:26:31.443264 (+   590us) log.cc:844] Serialized 41 byte log entry
0709 12:26:31.443639 (+   375us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:31.443859 (+   220us) write_op.cc:454] Released schema lock
0709 12:26:31.443936 (+    77us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:31.444515 (+   579us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:31.444541 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1341633,"reported_tablets":6,"spinlock_wait_cycles":120545664,"child_traces":[["op",{"apply.queue_time_us":189395,"apply.run_cpu_time_us":10807,"apply.run_wall_time_us":174064,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16667,"num_ops":3,"prepare.queue_time_us":383208,"prepare.run_cpu_time_us":4917,"prepare.run_wall_time_us":136187,"replication_time_us":477226,"thread_start_us":264951,"threads_started":2}]]}
I20260709 12:26:31.583850 15425 raft_consensus.cc:697] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [term 11 LEADER]: Becoming Leader. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
W20260709 12:26:31.646123 15272 consensus_meta.cc:287] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040: Time spent flushing consensus metadata: real 0.660s	user 0.011s	sys 0.003s
I20260709 12:26:31.596410 15317 raft_consensus.cc:2804] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:26:31.594859 15214 raft_consensus.cc:2749] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:26:31.563007 15430 consensus_queue.cc:1059] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
W20260709 12:26:31.655555 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 56270.2us
I20260709 12:26:31.577629 15269 raft_consensus.cc:515] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:31.665963 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 156701us
W20260709 12:26:31.670825 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 83914.9us
I20260709 12:26:31.663664 15323 raft_consensus.cc:493] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:31.653582 15258 raft_consensus.cc:3060] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:31.704234 11624 raft_consensus.cc:2393] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 13: Already voted for candidate 3c52e0825c02476e89d84da9bb849f5d in this term.
I20260709 12:26:31.696271 11589 leader_election.cc:304] T e9331e5342644ca2bae19187b083a7d5 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
W20260709 12:26:31.715380 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 157387us
I20260709 12:26:31.750932 10925 raft_consensus.cc:1275] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:26:31.751824 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 55782.1us
I20260709 12:26:31.756052 10922 raft_consensus.cc:1275] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:26:31.698448 15426 raft_consensus.cc:3055] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:26:31.814306 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 46263.1us
W20260709 12:26:31.814618 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 220363us
I20260709 12:26:31.667932 15272 raft_consensus.cc:2749] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339) with higher term. Message: Invalid argument: T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 8. Current term is 9.
I20260709 12:26:31.709415 15212 consensus_queue.cc:1048] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.119s
I20260709 12:26:31.674574 15251 consensus_queue.cc:237] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:31.820840 11620 raft_consensus.cc:1275] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:26:31.849684 10819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:31.694665 15449 raft_consensus.cc:2804] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:26:31.697669 15317 raft_consensus.cc:697] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 9 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:31.832551 15456 raft_consensus.cc:3055] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:26:31.833647 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 130008us
I20260709 12:26:31.869336 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:31.835832 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac83709373b4efd9c3aa1472a9f9022" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:31.870286 10852 raft_consensus.cc:2410] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:26:31.778601 15426 raft_consensus.cc:740] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
W20260709 12:26:31.867221 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 114211us
I20260709 12:26:31.757459 15248 consensus_queue.cc:1048] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.087s
I20260709 12:26:31.880766 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
W20260709 12:26:31.860534 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 151158us
I20260709 12:26:31.881626 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:31.889909 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d9a61ecaf84695b70f8519ee57706f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:31.904150 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:31.905611 10852 raft_consensus.cc:3060] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:31.868103 11615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:31.868904 15456 raft_consensus.cc:740] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:26:31.834308 15323 raft_consensus.cc:515] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:31.936964 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:31.885933 15449 raft_consensus.cc:697] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 11 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:31.939474 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:31.813884 15284 consensus_queue.cc:237] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:31.888612 15335 leader_election.cc:290] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:31.952183 15269 leader_election.cc:290] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 13 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:31.954195 15447 raft_consensus.cc:3055] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:26:31.954736 15447 raft_consensus.cc:740] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:31.968683 11621 raft_consensus.cc:2468] T e9331e5342644ca2bae19187b083a7d5 P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 5.
I20260709 12:26:31.999086 10851 raft_consensus.cc:2468] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 9.
W20260709 12:26:32.003072 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 55718.8us
W20260709 12:26:32.003093 15450 log.cc:927] Time spent T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.296s	user 0.001s	sys 0.000s
I20260709 12:26:31.934103 11619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:31.937873 15163 leader_election.cc:290] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:26:32.020921 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 475095us
I20260709 12:26:31.946317 11615 raft_consensus.cc:3060] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:32.003722 15420 raft_consensus.cc:2764] T e9331e5342644ca2bae19187b083a7d5 P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:26:31.940117 15272 consensus_queue.cc:1048] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.085s
W20260709 12:26:32.028542 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:32.048870 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:32.049817 11001 raft_consensus.cc:2468] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 8.
W20260709 12:26:32.036962 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 131133us
W20260709 12:26:32.005286 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 142048us
I20260709 12:26:32.061057 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:32.065616 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:31.884594 15425 consensus_queue.cc:237] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:31.959511 15215 raft_consensus.cc:515] T ab816bcc6183447994a2cc013e46c5f8 P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:32.159325 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:32.159303 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:32.165356 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d9a61ecaf84695b70f8519ee57706f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:32.031558 11588 leader_election.cc:304] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
W20260709 12:26:32.169675 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 138411us
I20260709 12:26:32.167069 10820 leader_election.cc:304] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:26:32.101343 15453 log.cc:927] Time spent T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d: Append to log took a long time: real 0.233s	user 0.001s	sys 0.001s
W20260709 12:26:32.180051 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 298317us
I20260709 12:26:32.183302 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad766f48812a4ddeb383179b1d84907b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:32.188280 11589 leader_election.cc:400] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 5 election: Vote denied by peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945) with higher term. Message: Invalid argument: T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3c52e0825c02476e89d84da9bb849f5d for earlier term 5. Current term is 6.
I20260709 12:26:32.188769 11589 leader_election.cc:403] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:26:32.184121 10994 raft_consensus.cc:2468] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 5.
W20260709 12:26:32.183449 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 111302us
I20260709 12:26:32.012717 15447 consensus_queue.cc:260] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:32.301760 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 232789us
I20260709 12:26:32.298112 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:32.297935 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:32.304466 11002 raft_consensus.cc:2468] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 11.
I20260709 12:26:32.026129 15426 consensus_queue.cc:260] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:32.304520 10996 raft_consensus.cc:3060] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:32.072659 15321 consensus_queue.cc:1048] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.219s
W20260709 12:26:32.263525 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 72938.2us
I20260709 12:26:32.290700 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:32.310708 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18294423a68a4671bf6c5a0f98645e4c" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:26:32.310139 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 116600us
I20260709 12:26:32.311023 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aed74af73a488f8b691578ca370226" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:32.311735 15357 raft_consensus.cc:493] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:32.290832 15473 raft_consensus.cc:493] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:32.320670 15267 consensus_meta.cc:287] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040: Time spent flushing consensus metadata: real 0.926s	user 0.012s	sys 0.001s
I20260709 12:26:32.315376 10847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56394 (request call id 4021) took 1522 ms. Trace:
I20260709 12:26:32.318099 10820 leader_election.cc:304] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:32.195410 15212 raft_consensus.cc:2804] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:26:32.037504 15317 consensus_queue.cc:237] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:32.333141 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:32.184763 15442 consensus_queue.cc:1048] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.141s
I20260709 12:26:32.290095 15472 raft_consensus.cc:2804] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:26:32.333686 10847 rpcz_store.cc:276] 0709 12:26:30.792857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:30.793015 (+   158us) service_pool.cc:224] Handling call
0709 12:26:31.273320 (+480305us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b5800004e98. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7591c23db1 00007f7591d63b71 00007f7591d63a22 00007f759ac7c8d9 00007f7599dd6ee0 00007f7599ea00ab 00007f7599ea0131 00007f7599e61fc0 00007f7599e4c929 00007f7599e4c3d2 00007f75933c3bd4
0709 12:26:31.273622 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:31.325269 (+ 51647us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:31.325300 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:31.346227 (+ 20927us) log.cc:844] Serialized 26 byte log entry
0709 12:26:31.501316 (+155089us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:26:31.501371 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:31.501459 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:32.298613 (+797154us) raft_consensus.cc:1685] finished
0709 12:26:32.298643 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:32.315296 (+ 16653us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16,"raft.queue_time_us":11279,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":10128,"spinlock_wait_cycles":31929216,"thread_start_us":119891,"threads_started":1,"wal-append.queue_time_us":211635}
I20260709 12:26:32.070737 15456 consensus_queue.cc:260] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:32.343837 11000 raft_consensus.cc:1275] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:26:32.344834 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b17195a94142039c40f598ed006c94" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:26:32.336999 15250 consensus_meta.cc:287] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea: Time spent flushing consensus metadata: real 0.982s	user 0.012s	sys 0.001s
I20260709 12:26:32.348588 15215 leader_election.cc:290] T ab816bcc6183447994a2cc013e46c5f8 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 4 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:32.348970 15163 raft_consensus.cc:2749] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:26:32.349380 15426 raft_consensus.cc:3060] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:32.394078 15387 raft_consensus.cc:493] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:32.394712 15387 raft_consensus.cc:515] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:32.338629 15267 raft_consensus.cc:2749] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339) with higher term. Message: Invalid argument: T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 5. Current term is 6.
W20260709 12:26:32.351670 15463 log.cc:927] Time spent T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.306s	user 0.000s	sys 0.001s
W20260709 12:26:32.350736 15429 consensus_meta.cc:287] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d: Time spent flushing consensus metadata: real 0.940s	user 0.009s	sys 0.002s
I20260709 12:26:32.400012 15429 raft_consensus.cc:515] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:32.404253 11622 raft_consensus.cc:1240] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 7. Current term is 8. Ops: []
I20260709 12:26:32.386643 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:32.406823 10999 raft_consensus.cc:3060] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:32.393050 11003 raft_consensus.cc:2468] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 3.
I20260709 12:26:32.341743 15447 raft_consensus.cc:3060] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:32.393967 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab816bcc6183447994a2cc013e46c5f8" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:32.404089 15485 raft_consensus.cc:493] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:32.393165 15344 raft_consensus.cc:493] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:32.332238 15464 raft_consensus.cc:493] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:32.332868 15452 log.cc:927] Time spent T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.500s	user 0.001s	sys 0.000s
W20260709 12:26:32.378947 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 60987.9us
I20260709 12:26:32.392381 10852 raft_consensus.cc:2468] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 11.
I20260709 12:26:32.468357 11616 raft_consensus.cc:1240] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [term 11 LEADER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 12:26:32.403249 15429 leader_election.cc:290] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 8 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:32.437585 15323 leader_election.cc:290] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:32.439656 15250 raft_consensus.cc:515] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:32.443790 15461 consensus_queue.cc:1048] T 4ef3220c51df47db8859f07ab745fad5 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.130s
I20260709 12:26:32.337247 15212 raft_consensus.cc:493] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:32.439690 15470 log.cc:927] Time spent T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.237s	user 0.001s	sys 0.000s
I20260709 12:26:32.332264 15357 raft_consensus.cc:515] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:32.489537 11589 leader_election.cc:304] T e8b17195a94142039c40f598ed006c94 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:32.390240 15472 raft_consensus.cc:697] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [term 8 LEADER]: Becoming Leader. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
W20260709 12:26:32.489881 10968 leader_election.cc:336] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Timed out: RequestConsensusVote RPC to 127.9.116.65:46265 timed out after 1.729s (SENT)
I20260709 12:26:32.495781 10820 leader_election.cc:304] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:32.475070 15456 raft_consensus.cc:3060] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:32.495661 10968 leader_election.cc:304] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:32.499622 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac83709373b4efd9c3aa1472a9f9022" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:32.508010 10994 raft_consensus.cc:3060] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:32.505869 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:26:32.484370 15216 consensus_meta.cc:287] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d: Time spent flushing consensus metadata: real 0.884s	user 0.005s	sys 0.008s
I20260709 12:26:32.506342 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:32.487321 15442 raft_consensus.cc:493] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:32.487546 15212 raft_consensus.cc:3060] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:32.524768 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:26:32.522959 10968 leader_election.cc:336] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Timed out: RequestConsensusVote RPC to 127.9.116.66:39339 timed out after 1.746s (SENT)
I20260709 12:26:32.525998 10929 raft_consensus.cc:2393] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 11: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:26:32.483889 15215 raft_consensus.cc:476] T 4ef3220c51df47db8859f07ab745fad5 P 3c52e0825c02476e89d84da9bb849f5d [term 7 LEADER]: Not starting pre-election -- already a leader
I20260709 12:26:32.339294 15473 raft_consensus.cc:515] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:32.538973 10968 leader_election.cc:336] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Timed out: RequestConsensusVote RPC to 127.9.116.65:46265 timed out after 1.505s (SENT)
I20260709 12:26:32.541117 10968 leader_election.cc:304] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:32.506560 15387 leader_election.cc:290] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:32.545111 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
W20260709 12:26:32.529460 15059 consensus_meta.cc:287] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d: Time spent flushing consensus metadata: real 1.079s	user 0.011s	sys 0.001s
I20260709 12:26:32.472627 15344 raft_consensus.cc:515] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:32.552585 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 56890.4us
I20260709 12:26:32.553135 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d9a61ecaf84695b70f8519ee57706f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:32.528414 15323 raft_consensus.cc:2749] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:26:32.559980 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:32.333043 15449 consensus_queue.cc:237] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:32.539824 15215 raft_consensus.cc:2804] T e8b17195a94142039c40f598ed006c94 P 3c52e0825c02476e89d84da9bb849f5d [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:26:32.558658 15423 consensus_meta.cc:287] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea: Time spent flushing consensus metadata: real 1.105s	user 0.016s	sys 0.000s
I20260709 12:26:32.519503 15216 raft_consensus.cc:515] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:32.585173 10968 leader_election.cc:336] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Timed out: RequestConsensusVote RPC to 127.9.116.65:46265 timed out after 1.814s (SENT)
W20260709 12:26:32.586382 10968 leader_election.cc:336] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Timed out: RequestConsensusVote RPC to 127.9.116.66:39339 timed out after 1.895s (SENT)
I20260709 12:26:32.536114 15442 raft_consensus.cc:515] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:32.567653 15258 consensus_meta.cc:287] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08: Time spent flushing consensus metadata: real 0.803s	user 0.012s	sys 0.000s
I20260709 12:26:32.583074 10820 leader_election.cc:304] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040; no voters: 
I20260709 12:26:32.570689 15478 raft_consensus.cc:2749] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:32.590014 15455 raft_consensus.cc:2749] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:32.596875 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:32.598420 10929 raft_consensus.cc:2468] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 9.
I20260709 12:26:32.600246 10921 raft_consensus.cc:2368] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for earlier term 7. Current term is 8.
I20260709 12:26:32.593031 15344 leader_election.cc:290] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:32.593223 15357 leader_election.cc:290] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:32.601953 10968 leader_election.cc:304] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:32.603777 15478 raft_consensus.cc:2749] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:26:32.604669 10969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:32.606379 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 45610.2us
I20260709 12:26:32.608974 10998 raft_consensus.cc:2410] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for term 11 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 10.
I20260709 12:26:32.571405 15215 raft_consensus.cc:493] T e8b17195a94142039c40f598ed006c94 P 3c52e0825c02476e89d84da9bb849f5d [term 3 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:32.581555 15323 raft_consensus.cc:493] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:32.555022 15059 raft_consensus.cc:515] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:32.627538 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:32.619556 10820 leader_election.cc:304] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:32.628499 10996 raft_consensus.cc:2468] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 7.
I20260709 12:26:32.596208 15467 raft_consensus.cc:493] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
W20260709 12:26:32.657410 10968 leader_election.cc:336] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Timed out: RequestConsensusVote RPC to 127.9.116.65:46265 timed out after 1.534s (SENT)
W20260709 12:26:32.625798 15482 log.cc:927] Time spent T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 12:26:32.659998 15455 raft_consensus.cc:2749] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:32.670825 15474 raft_consensus.cc:2804] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:32.671373 15474 raft_consensus.cc:493] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:32.671816 15474 raft_consensus.cc:3060] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:32.628962 10848 raft_consensus.cc:2468] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 6.
I20260709 12:26:32.617080 15478 raft_consensus.cc:493] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:32.630105 15215 raft_consensus.cc:3060] T e8b17195a94142039c40f598ed006c94 P 3c52e0825c02476e89d84da9bb849f5d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:32.668357 10921 raft_consensus.cc:1240] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 7. Current term is 8. Ops: []
W20260709 12:26:32.666085 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 46662.6us
I20260709 12:26:32.588270 15423 raft_consensus.cc:515] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:32.682693 10820 leader_election.cc:304] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:32.683461 15317 raft_consensus.cc:2749] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:26:32.661432 15250 leader_election.cc:290] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 12 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:32.684407 10820 leader_election.cc:304] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:32.687354 10921 raft_consensus.cc:1240] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 10. Current term is 11. Ops: []
I20260709 12:26:32.657284 15323 raft_consensus.cc:515] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:32.688102 15326 consensus_meta.cc:287] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d: Time spent flushing consensus metadata: real 1.262s	user 0.008s	sys 0.007s
I20260709 12:26:32.705695 10820 leader_election.cc:304] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:32.596653 15472 consensus_queue.cc:237] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:32.714318 15457 log.cc:927] Time spent T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.829s	user 0.000s	sys 0.011s
I20260709 12:26:32.475515 15485 raft_consensus.cc:515] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:32.718328 15321 raft_consensus.cc:2749] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:32.719547 11617 raft_consensus.cc:1240] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 9. Current term is 10. Ops: []
I20260709 12:26:32.720943 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:32.724340 10921 raft_consensus.cc:2393] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 9: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:26:32.480777 15464 raft_consensus.cc:515] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:32.726783 11617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45920 (request call id 848) took 1020 ms. Trace:
I20260709 12:26:32.703683 15455 raft_consensus.cc:2749] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:26:32.744822 15323 leader_election.cc:290] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:32.745599 15473 leader_election.cc:290] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:26:32.747131 15496 log.cc:927] Time spent T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:26:32.753779 10750 catalog_manager.cc:5697] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 4 to 6, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 6 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:32.761268 15442 leader_election.cc:290] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:26:32.765401 10819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:32.767992 15474 raft_consensus.cc:515] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:32.832024 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fd8fdac2fa449e9e184f3d668ea1a7" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:32.770643 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b17195a94142039c40f598ed006c94" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:32.773325 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:32.774899 15258 raft_consensus.cc:493] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:32.775686 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:32.776147 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:32.835692 10996 raft_consensus.cc:2468] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 12.
I20260709 12:26:32.759449 10994 raft_consensus.cc:2468] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 6.
I20260709 12:26:32.728829 10820 leader_election.cc:400] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 election: Vote denied by peer 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613) with higher term. Message: Invalid argument: T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 9. Current term is 10.
I20260709 12:26:32.830734 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:32.733399 11623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45890 (request call id 819) took 1587 ms. Trace:
W20260709 12:26:32.734931 15469 log.cc:927] Time spent T 4ef3220c51df47db8859f07ab745fad5 P 3c52e0825c02476e89d84da9bb849f5d: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:26:32.736102 15059 leader_election.cc:290] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 8 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:32.727290 11617 rpcz_store.cc:276] 0709 12:26:31.703005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:31.703512 (+   507us) service_pool.cc:224] Handling call
0709 12:26:32.719106 (+1015594us) spinlock_profiling.cc:243] Waited 1.66 ms on lock 0x7b5800160898. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7591c23db1 00007f7591d63b71 00007f7591d63a22 00007f759ac7c8d9 00007f7599dd6ee0 00007f7599ea00ab 00007f7599ea0131 00007f7599e61fc0 00007f7599e4c929 00007f7599e4c3d2 00007f75933c3bd4
0709 12:26:32.719343 (+   237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:32.722711 (+  3368us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:32.722955 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3810176}
I20260709 12:26:32.741147 15443 ts_tablet_manager.cc:1929] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.5
I20260709 12:26:32.743018 15423 leader_election.cc:290] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 13 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:32.868384 15220 raft_consensus.cc:493] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:32.869210 15220 raft_consensus.cc:515] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:32.853649 11589 leader_election.cc:304] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:32.800107 10925 raft_consensus.cc:1275] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 12:26:32.723145 15487 log.cc:927] Time spent T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.156s	user 0.001s	sys 0.004s
I20260709 12:26:32.802652 10929 raft_consensus.cc:1275] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 12:26:32.781522 10968 leader_election.cc:336] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Timed out: RequestConsensusVote RPC to 127.9.116.65:46265 timed out after 1.990s (SENT)
I20260709 12:26:32.874248 10968 leader_election.cc:304] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
W20260709 12:26:32.875265 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 93805.7us
I20260709 12:26:32.875804 15323 raft_consensus.cc:3060] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:26:32.876770 10968 leader_election.cc:336] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Timed out: RequestConsensusVote RPC to 127.9.116.65:46265 timed out after 2.151s (SENT)
I20260709 12:26:32.822408 10846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46480 (request call id 754) took 1859 ms. Trace:
I20260709 12:26:32.877801 10846 rpcz_store.cc:276] 0709 12:26:30.962807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:31.351493 (+388686us) service_pool.cc:224] Handling call
0709 12:26:31.369119 (+ 17626us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:31.418482 (+ 49363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:31.418538 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:31.512243 (+ 93705us) log.cc:844] Serialized 26 byte log entry
0709 12:26:31.668494 (+156251us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:26:32.009914 (+341420us) log.cc:844] Serialized 14 byte log entry
0709 12:26:32.010501 (+   587us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:32.010575 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:32.713693 (+703118us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b4400022b4c. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7591c23db1 00007f7591cc1c85 00007f7591cc26a2 00007f7594a341db 00007f7594a2faaf 00007f7594a2386e 00007f7594a22bb6 00007f7594a227d8 00007f7594a2c221 00007f7594a2c1d9 00007f7594a2c169
0709 12:26:32.806603 (+ 92910us) raft_consensus.cc:1685] finished
0709 12:26:32.822136 (+ 15533us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:32.822309 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":371658,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":27814,"raft.run_cpu_time_us":288,"raft.run_wall_time_us":9523,"spinlock_wait_cycles":25704704,"thread_start_us":402760,"threads_started":3,"wal-append.queue_time_us":215056}
W20260709 12:26:32.824875 10819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:32.857215 15488 log.cc:927] Time spent T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d: Append to log took a long time: real 0.181s	user 0.000s	sys 0.001s
I20260709 12:26:32.818866 10750 catalog_manager.cc:5697] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 10 to 11, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 11 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:32.883761 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:32.884384 10854 raft_consensus.cc:3060] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:32.884675 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:32.885371 10750 catalog_manager.cc:5697] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: config changed from index 9 to 10, VOTER e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) evicted. New cstate: current_term: 9 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:32.831158 10923 raft_consensus.cc:1240] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 11. Current term is 12. Ops: []
I20260709 12:26:32.888778 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:32.889547 10923 raft_consensus.cc:2468] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 9.
I20260709 12:26:32.890965 10923 raft_consensus.cc:1240] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 12. Current term is 13. Ops: []
I20260709 12:26:32.718936 15326 raft_consensus.cc:515] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:32.857405 15443 log.cc:1199] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040: Deleting WAL directory at /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599781984018-9681-0/minicluster-data/ts-0-root/wals/3357adbb6a514faf958aff009c4e4af8
I20260709 12:26:32.893263 10854 raft_consensus.cc:2468] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 13.
I20260709 12:26:32.688028 15478 raft_consensus.cc:515] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:32.838433 11623 rpcz_store.cc:276] 0709 12:26:31.145731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:31.199607 (+ 53876us) service_pool.cc:224] Handling call
0709 12:26:32.733121 (+1533514us) spinlock_profiling.cc:243] Waited 557 ms on lock 0x7b5400621e54. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e8c2fa 00007f7599e4db17 00007f75933c86d4 00007f75933c8662 00007f75933c8591 00007f75933c850c 00007f75933c77c2 00007f75931c348c 00007f75931c28c6 00007f75931c226f
0709 12:26:32.733295 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1279951104}
I20260709 12:26:32.800381 15419 raft_consensus.cc:493] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:32.848783 10999 raft_consensus.cc:2468] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 13.
I20260709 12:26:32.843750 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:32.852878 15471 raft_consensus.cc:493] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
W20260709 12:26:32.853327 11586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:32.848219 15258 raft_consensus.cc:515] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:32.744850 15464 leader_election.cc:290] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:32.877213 10968 leader_election.cc:304] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:32.685690 15467 raft_consensus.cc:515] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:32.899845 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:32.902530 10969 leader_election.cc:304] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:32.921964 10854 raft_consensus.cc:1275] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:26:32.893657 15443 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56372 (request call id 85) took 1752 ms. Trace:
W20260709 12:26:32.936020 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 82456.4us
I20260709 12:26:32.947006 15474 leader_election.cc:290] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 election: Requested vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:32.916414 15220 leader_election.cc:290] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:32.976572 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63ecfc9bd3945818cfe15c03f001315" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:32.952332 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fd8fdac2fa449e9e184f3d668ea1a7" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:32.922739 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab816bcc6183447994a2cc013e46c5f8" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:32.978612 10852 raft_consensus.cc:3060] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:32.969484 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
W20260709 12:26:32.957666 10969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 55356.9us
I20260709 12:26:32.951287 15419 raft_consensus.cc:515] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:32.967213 15457 log.cc:927] Time spent T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
W20260709 12:26:33.014779 15456 consensus_meta.cc:287] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08: Time spent flushing consensus metadata: real 0.503s	user 0.012s	sys 0.001s
I20260709 12:26:32.970788 10853 raft_consensus.cc:1275] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:26:32.927022 10750 catalog_manager.cc:5697] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 9 to 10, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 10 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:32.974128 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:32.969847 15420 raft_consensus.cc:2804] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:26:32.935374 11615 consensus_meta.cc:287] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d: Time spent flushing consensus metadata: real 0.889s	user 0.013s	sys 0.000s
W20260709 12:26:33.037134 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 186869us
I20260709 12:26:33.038206 11621 raft_consensus.cc:1240] T ab816bcc6183447994a2cc013e46c5f8 P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:33.038399 11588 leader_election.cc:304] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:32.979853 10850 raft_consensus.cc:3060] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:32.984289 15464 raft_consensus.cc:2804] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:32.984973 15442 raft_consensus.cc:2749] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:26:32.985345 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:33.039544 10819 leader_election.cc:304] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:32.967921 15258 leader_election.cc:290] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:33.022833 11589 leader_election.cc:304] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:33.025202 15216 leader_election.cc:290] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 10 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:33.025696 15419 leader_election.cc:290] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:33.025825 15220 raft_consensus.cc:493] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:33.026458 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:26:33.027189 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:33.028317 10920 raft_consensus.cc:1240] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 10. Current term is 11. Ops: []
I20260709 12:26:32.936968 15471 raft_consensus.cc:515] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:33.041070 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 321336us
W20260709 12:26:33.048254 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 171519us
I20260709 12:26:33.016875 15323 raft_consensus.cc:2749] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:26:33.075809 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:33.076740 10853 raft_consensus.cc:3060] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:26:33.079623 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 56877.6us
I20260709 12:26:33.072542 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:33.080895 10845 raft_consensus.cc:3060] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:33.054610 11588 leader_election.cc:304] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:33.058441 11624 raft_consensus.cc:1240] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 7. Current term is 8. Ops: []
I20260709 12:26:33.059760 11621 raft_consensus.cc:1240] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 5. Current term is 6. Ops: []
I20260709 12:26:33.087945 15478 leader_election.cc:290] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:33.089098 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:33.090824 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d9a61ecaf84695b70f8519ee57706f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:33.088042 15215 raft_consensus.cc:515] T e8b17195a94142039c40f598ed006c94 P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:33.093385 15215 leader_election.cc:290] T e8b17195a94142039c40f598ed006c94 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 4 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:33.044538 15475 consensus_queue.cc:1059] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.062s
I20260709 12:26:33.043990 15280 raft_consensus.cc:493] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:33.044701 11615 raft_consensus.cc:2468] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 6.
I20260709 12:26:33.097687 15280 raft_consensus.cc:515] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:33.099207 11615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45920 (request call id 845) took 1397 ms. Trace:
I20260709 12:26:33.099726 11618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:33.037434 15420 raft_consensus.cc:493] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:33.071686 10968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:33.102283 11622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45920 (request call id 846) took 1399 ms. Trace:
I20260709 12:26:33.029081 15250 raft_consensus.cc:493] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:33.104993 10820 leader_election.cc:304] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:33.119397 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b17195a94142039c40f598ed006c94" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:33.120384 10996 raft_consensus.cc:3060] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:26:33.106524 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 52067.8us
I20260709 12:26:33.109000 15458 raft_consensus.cc:2749] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945) with higher term. Message: Invalid argument: T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3c52e0825c02476e89d84da9bb849f5d for earlier term 5. Current term is 6.
W20260709 12:26:33.111344 10968 leader_election.cc:336] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Timed out: RequestConsensusVote RPC to 127.9.116.65:46265 timed out after 1.882s (SENT)
I20260709 12:26:33.110880 11622 rpcz_store.cc:276] 0709 12:26:31.702427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:31.750121 (+ 47694us) service_pool.cc:224] Handling call
0709 12:26:32.165597 (+415476us) spinlock_profiling.cc:243] Waited 1.64 ms on lock 0x7b5800160898. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7591c23db1 00007f7591d63b71 00007f7591d63a22 00007f759ac7c8d9 00007f7599dd6ee0 00007f7599ea00ab 00007f7599ea0131 00007f7599e61fc0 00007f7599e4c929 00007f7599e4c3d2 00007f75933c3bd4
0709 12:26:32.165832 (+   235us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:32.405119 (+239287us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:33.101962 (+696843us) spinlock_profiling.cc:243] Waited 238 ms on lock 0x7b540067cd54. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e88e01 00007f7594e8783e 00007f7599e4c419 00007f75933c3bd4 00007f75933c3b62 00007f75933c3a91 00007f75933c3a0c 00007f75933c2cc2 00007f75931c348c 00007f75931c28c6
0709 12:26:33.102206 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":551450240}
I20260709 12:26:33.116806 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:33.064893 15474 raft_consensus.cc:2804] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:26:33.067974 15472 raft_consensus.cc:2749] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:26:33.131752 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:33.134588 10968 leader_election.cc:304] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:33.134858 10926 raft_consensus.cc:2393] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 5: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:26:33.129242 10852 raft_consensus.cc:2468] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 4.
W20260709 12:26:33.133575 10820 raft_consensus.cc:2686] T 3357adbb6a514faf958aff009c4e4af8 P 80cd7d227db44f34a6108591dad9c040: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 12:26:33.163558 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 93501.2us
I20260709 12:26:33.065603 15464 raft_consensus.cc:697] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:26:33.156405 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:33.174495 10920 raft_consensus.cc:2468] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 5.
W20260709 12:26:33.167824 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 45927.5us
W20260709 12:26:33.172447 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 143672us
I20260709 12:26:33.115985 15420 raft_consensus.cc:3060] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:33.177402 11588 leader_election.cc:304] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040; no voters: edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:26:33.181881 10969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:33.121451 15429 raft_consensus.cc:3060] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:33.171634 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac8522e549a46e09593fa4c2e175557" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:33.183100 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:33.188253 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:33.191460 11588 leader_election.cc:304] T ab816bcc6183447994a2cc013e46c5f8 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:33.141794 15455 raft_consensus.cc:493] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:33.103279 15220 raft_consensus.cc:515] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:33.212366 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 101063us
I20260709 12:26:33.141024 15474 raft_consensus.cc:493] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:33.222709 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
W20260709 12:26:33.215736 10968 leader_election.cc:336] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Timed out: RequestConsensusVote RPC to 127.9.116.65:46265 timed out after 1.926s (SENT)
I20260709 12:26:33.099727 11615 rpcz_store.cc:276] 0709 12:26:31.702109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:31.756100 (+ 53991us) service_pool.cc:224] Handling call
0709 12:26:33.098833 (+1342733us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:33.219686 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:33.181686 15442 raft_consensus.cc:2749] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:26:33.181372 15478 raft_consensus.cc:493] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:33.251519 10968 leader_election.cc:304] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:33.248759 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:33.255847 10920 raft_consensus.cc:2393] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 5: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:26:33.142560 15317 consensus_queue.cc:1059] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.077s
I20260709 12:26:33.260946 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:26:33.261934 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 78319.4us
I20260709 12:26:33.171149 15250 raft_consensus.cc:515] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:32.973263 15443 rpcz_store.cc:276] 0709 12:26:31.192688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:31.309462 (+116774us) service_pool.cc:224] Handling call
0709 12:26:31.429505 (+120043us) ts_tablet_manager.cc:1151] Deleting tablet 3357adbb6a514faf958aff009c4e4af8
0709 12:26:31.435806 (+  6301us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:26:31.475382 (+ 39576us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:32.740995 (+1265613us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:32.893551 (+152556us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":118848,"thread_start_us":79442,"threads_started":1}
I20260709 12:26:33.288453 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18294423a68a4671bf6c5a0f98645e4c" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:33.290891 10996 raft_consensus.cc:2468] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 4.
I20260709 12:26:33.195463 15426 consensus_queue.cc:1048] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 12:26:33.291872 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63ecfc9bd3945818cfe15c03f001315" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:33.300486 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:33.301074 10852 raft_consensus.cc:2393] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3c52e0825c02476e89d84da9bb849f5d in current term 6: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:26:33.301625 10920 raft_consensus.cc:2393] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 12: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:26:33.291764 10926 raft_consensus.cc:2393] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 13: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:26:33.223955 15474 raft_consensus.cc:3060] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:26:33.321481 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 105757us
I20260709 12:26:33.221076 15461 raft_consensus.cc:2804] T ab816bcc6183447994a2cc013e46c5f8 P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:26:33.307252 10969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 46366.9us
I20260709 12:26:33.283834 15481 raft_consensus.cc:2804] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:26:33.400285 10968 leader_election.cc:336] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Timed out: RequestConsensusVote RPC to 127.9.116.65:46265 timed out after 2.104s (SENT)
I20260709 12:26:33.214836 15215 consensus_queue.cc:1048] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.087s
I20260709 12:26:33.268405 15478 raft_consensus.cc:515] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:33.260100 15475 consensus_queue.cc:1059] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.106s
W20260709 12:26:33.441563 10968 leader_election.cc:336] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Timed out: RequestConsensusVote RPC to 127.9.116.65:46265 timed out after 1.969s (SENT)
W20260709 12:26:33.448172 10969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 43955.7us
I20260709 12:26:33.399909 15500 raft_consensus.cc:493] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:33.472230 15467 leader_election.cc:290] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:33.448889 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:33.464183 15442 consensus_queue.cc:1059] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 12:26:33.477595 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:33.478848 10926 raft_consensus.cc:2393] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 11: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:26:33.478384 15500 raft_consensus.cc:515] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:33.450467 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:33.453572 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:33.453716 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
W20260709 12:26:33.462456 10851 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56394 (request call id 4034) took 2526 ms (client timeout 1940 ms). Trace:
W20260709 12:26:33.485379 10851 rpcz_store.cc:269] 0709 12:26:30.935795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:31.062118 (+126323us) service_pool.cc:224] Handling call
0709 12:26:33.462171 (+2400053us) spinlock_profiling.cc:243] Waited 794 ms on lock 0x7b5400388954. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e8c2fa 00007f7599e4db17 00007f75933c86d4 00007f75933c8662 00007f75933c8591 00007f75933c850c 00007f75933c77c2 00007f75931c348c 00007f75931c28c6 00007f75931c226f
0709 12:26:33.462341 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1827148160}
I20260709 12:26:33.484377 10852 raft_consensus.cc:2368] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for earlier term 12. Current term is 13.
I20260709 12:26:33.487262 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:33.488111 10851 raft_consensus.cc:2376] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 9. Re-sending same reply.
I20260709 12:26:33.453163 15461 raft_consensus.cc:697] T ab816bcc6183447994a2cc013e46c5f8 P 3c52e0825c02476e89d84da9bb849f5d [term 4 LEADER]: Becoming Leader. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
I20260709 12:26:33.463950 15505 consensus_queue.cc:1059] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:26:33.448989 11615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
W20260709 12:26:33.510674 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:33.475772 10968 leader_election.cc:304] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:33.489557 10920 raft_consensus.cc:3060] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:33.437708 15456 raft_consensus.cc:2749] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:33.223762 15455 raft_consensus.cc:515] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:33.480329 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aed74af73a488f8b691578ca370226" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:33.513218 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:33.513465 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c913e527ff46578e084c41eab7bb9d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:33.516074 10851 raft_consensus.cc:3060] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:26:33.521728 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aed74af73a488f8b691578ca370226" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:33.523152 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad766f48812a4ddeb383179b1d84907b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:33.524405 10852 raft_consensus.cc:2468] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 6.
W20260709 12:26:33.522684 15212 consensus_meta.cc:287] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040: Time spent flushing consensus metadata: real 0.986s	user 0.006s	sys 0.010s
I20260709 12:26:33.543334 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:33.547374 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:33.402096 15464 consensus_queue.cc:237] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:33.542394 10895 leader_election.cc:304] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:33.521190 15472 raft_consensus.cc:493] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:33.589260 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:33.594190 15497 log.cc:927] Time spent T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.302s	user 0.000s	sys 0.001s
W20260709 12:26:33.594238 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 152752us
I20260709 12:26:33.587957 15280 leader_election.cc:290] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:33.601478 10852 raft_consensus.cc:2468] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 11.
I20260709 12:26:33.604189 15220 leader_election.cc:290] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:33.604305 10926 raft_consensus.cc:2393] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 9: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:26:33.606319 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18294423a68a4671bf6c5a0f98645e4c" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:33.533229 15465 raft_consensus.cc:2804] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:26:33.611600 15465 raft_consensus.cc:697] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d [term 11 LEADER]: Becoming Leader. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
I20260709 12:26:33.612092 15471 leader_election.cc:290] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:33.612762 15465 consensus_queue.cc:237] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:33.613348 15471 raft_consensus.cc:2749] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:26:33.603008 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:33.592729 15456 consensus_queue.cc:1059] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 12:26:33.613401 10926 raft_consensus.cc:2468] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 4.
W20260709 12:26:33.615346 15498 log.cc:927] Time spent T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.325s	user 0.000s	sys 0.000s
I20260709 12:26:33.616768 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:33.592131 15212 raft_consensus.cc:515] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:33.631222 15212 leader_election.cc:290] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:33.620229 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352aa49c65194abbb863d7553a091f11" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:33.632679 10852 raft_consensus.cc:2468] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 3.
I20260709 12:26:33.633776 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
W20260709 12:26:33.624112 15506 log.cc:927] Time spent T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
I20260709 12:26:33.635696 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:33.635838 15471 raft_consensus.cc:3055] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:26:33.636152 15495 log.cc:927] Time spent T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.797s	user 0.000s	sys 0.006s
I20260709 12:26:33.637068 10849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56394 (request call id 4051) took 1793 ms. Trace:
I20260709 12:26:33.705869 10849 rpcz_store.cc:276] 0709 12:26:31.844164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:31.844346 (+   182us) service_pool.cc:224] Handling call
0709 12:26:31.844752 (+   406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:32.672081 (+827329us) spinlock_profiling.cc:243] Waited 9.94 ms on lock 0x7b1800426640. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f759ac63ab1 00007f759ac70281 00007f7594a304bc 00007f7591d7e48b 00007f759abd89a9 00007f7591d9a69b 00007f7591d9893f 00007f7591d98455 00007f7594e80060 00007f7594e80bfb 00007f7594e8b64b
0709 12:26:32.672238 (+   157us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:32.672283 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:32.672828 (+   545us) log.cc:844] Serialized 26 byte log entry
0709 12:26:33.046435 (+373607us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:26:33.046506 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:33.046619 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:33.636652 (+590033us) raft_consensus.cc:1685] finished
0709 12:26:33.636686 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:33.636984 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":30369,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":24945,"spinlock_wait_cycles":22865664,"thread_start_us":395699,"threads_started":2,"wal-append.queue_time_us":496463}
I20260709 12:26:33.708226 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:33.625866 15461 consensus_queue.cc:237] T ab816bcc6183447994a2cc013e46c5f8 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:33.642632 10851 raft_consensus.cc:2468] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 12.
W20260709 12:26:33.648869 10850 consensus_meta.cc:287] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040: Time spent flushing consensus metadata: real 0.609s	user 0.005s	sys 0.009s
I20260709 12:26:33.712491 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9331e5342644ca2bae19187b083a7d5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:33.713034 10850 raft_consensus.cc:2468] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 8.
I20260709 12:26:33.714509 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
W20260709 12:26:33.714746 10924 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.017s	sys 0.022s
W20260709 12:26:33.650075 10968 leader_election.cc:336] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Timed out: RequestConsensusVote RPC to 127.9.116.65:46265 timed out after 1.976s (SENT)
I20260709 12:26:33.715726 10968 leader_election.cc:304] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:33.696077 15250 leader_election.cc:290] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:33.657723 10926 raft_consensus.cc:2376] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 9. Re-sending same reply.
I20260709 12:26:33.718958 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad766f48812a4ddeb383179b1d84907b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:33.701342 11622 raft_consensus.cc:2468] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 4.
I20260709 12:26:33.704322 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
W20260709 12:26:33.715333 10924 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.018s	sys 0.022s
I20260709 12:26:33.726279 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:33.727823 10852 raft_consensus.cc:2410] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:26:33.728286 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:33.730026 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:33.732386 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:33.740348 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5794ba618e514e28a7542ab6af39d8c9" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:33.773365 10852 raft_consensus.cc:2468] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 4.
I20260709 12:26:33.697784 15471 raft_consensus.cc:740] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:26:33.786854 15471 consensus_queue.cc:260] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:33.789387 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 247111us
I20260709 12:26:33.790874 11620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:33.792145 11620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:33.698060 15481 raft_consensus.cc:697] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [term 13 LEADER]: Becoming Leader. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
W20260709 12:26:33.795287 15429 consensus_meta.cc:287] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d: Time spent flushing consensus metadata: real 0.598s	user 0.009s	sys 0.000s
I20260709 12:26:33.797379 15429 raft_consensus.cc:2749] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:33.780226 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:33.774691 11615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:33.803112 15455 leader_election.cc:290] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:33.783382 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c913e527ff46578e084c41eab7bb9d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:33.795117 15481 consensus_queue.cc:237] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:33.800681 10845 consensus_meta.cc:287] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040: Time spent flushing consensus metadata: real 0.683s	user 0.013s	sys 0.000s
I20260709 12:26:33.803735 15523 raft_consensus.cc:2749] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:26:33.805661 15478 leader_election.cc:290] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
W20260709 12:26:33.808478 15507 log.cc:927] Time spent T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.260s	user 0.000s	sys 0.000s
I20260709 12:26:33.782672 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac83709373b4efd9c3aa1472a9f9022" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:33.803233 10849 raft_consensus.cc:2410] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:26:33.830377 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352aa49c65194abbb863d7553a091f11" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:33.776983 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:33.832001 10852 raft_consensus.cc:2468] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 3.
I20260709 12:26:33.840893 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:33.844328 10850 raft_consensus.cc:2410] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:26:33.777880 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:33.809881 10895 leader_election.cc:304] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040
W20260709 12:26:33.812471 10969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 336866us
I20260709 12:26:33.845954 10926 raft_consensus.cc:2468] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 8.
I20260709 12:26:33.846690 10969 leader_election.cc:304] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
W20260709 12:26:33.813925 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 163876us
I20260709 12:26:33.698266 15472 raft_consensus.cc:515] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:33.815941 10851 raft_consensus.cc:2468] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 6.
I20260709 12:26:33.816200 10845 raft_consensus.cc:2468] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 10.
I20260709 12:26:33.856232 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:33.847496 10926 raft_consensus.cc:1275] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:26:33.853753 10924 raft_consensus.cc:2393] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 6: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
W20260709 12:26:33.862059 10969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:33.865031 10894 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.007s	sys 0.017s
W20260709 12:26:33.865520 10894 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.007s	sys 0.017s
W20260709 12:26:33.865819 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 572394us
I20260709 12:26:33.874207 10920 raft_consensus.cc:2468] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 6.
I20260709 12:26:33.874673 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5794ba618e514e28a7542ab6af39d8c9" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:33.875949 10849 raft_consensus.cc:2468] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 4.
I20260709 12:26:33.876959 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:33.878793 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:33.887650 10849 raft_consensus.cc:2410] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:26:33.889835 10852 raft_consensus.cc:2368] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for earlier term 12. Current term is 13.
I20260709 12:26:33.890523 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9331e5342644ca2bae19187b083a7d5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:33.896747 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:33.898316 10851 raft_consensus.cc:2368] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for earlier term 12. Current term is 13.
I20260709 12:26:33.827010 15250 raft_consensus.cc:2764] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:26:33.915108 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c6d38c4d8a90a81975a6a0cb13" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:33.914139 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:33.915999 10845 raft_consensus.cc:2468] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 8.
I20260709 12:26:33.873227 15478 raft_consensus.cc:2804] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:33.917570 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:33.920121 10924 raft_consensus.cc:1275] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:26:33.925195 10850 raft_consensus.cc:2410] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:26:33.927107 11624 raft_consensus.cc:2468] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 9.
W20260709 12:26:33.928581 10853 consensus_meta.cc:287] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040: Time spent flushing consensus metadata: real 0.811s	user 0.010s	sys 0.003s
I20260709 12:26:33.929224 10853 raft_consensus.cc:2468] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 8.
I20260709 12:26:33.929983 10853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46480 (request call id 772) took 1004 ms. Trace:
I20260709 12:26:33.930459 10853 rpcz_store.cc:276] 0709 12:26:32.925758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:33.047967 (+122209us) service_pool.cc:224] Handling call
0709 12:26:33.929901 (+881934us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:26:33.938227 15420 consensus_meta.cc:287] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d: Time spent flushing consensus metadata: real 0.734s	user 0.005s	sys 0.005s
I20260709 12:26:33.918393 11615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:33.940899 11615 raft_consensus.cc:2393] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 11: Already voted for candidate 3c52e0825c02476e89d84da9bb849f5d in this term.
I20260709 12:26:33.942118 11615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
W20260709 12:26:33.945240 15511 log.cc:927] Time spent T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
I20260709 12:26:33.939378 15420 raft_consensus.cc:515] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:33.949090 15471 raft_consensus.cc:3060] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:33.950455 15420 leader_election.cc:290] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 13 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:33.954159 15485 leader_election.cc:290] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:33.960819 11618 raft_consensus.cc:2393] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 13: Already voted for candidate 3c52e0825c02476e89d84da9bb849f5d in this term.
W20260709 12:26:33.966579 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:33.967411 11589 leader_election.cc:304] T e8b17195a94142039c40f598ed006c94 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
W20260709 12:26:33.968633 15491 log.cc:927] Time spent T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 1.384s	user 0.003s	sys 0.008s
I20260709 12:26:33.969688 15522 raft_consensus.cc:2804] T e8b17195a94142039c40f598ed006c94 P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:33.970419 15522 raft_consensus.cc:697] T e8b17195a94142039c40f598ed006c94 P 3c52e0825c02476e89d84da9bb849f5d [term 4 LEADER]: Becoming Leader. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
I20260709 12:26:33.971202 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
W20260709 12:26:33.980499 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 121830us
W20260709 12:26:33.984877 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 175063us
I20260709 12:26:33.987563 10895 leader_election.cc:304] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040
W20260709 12:26:33.990653 10817 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.005s	sys 0.021s
W20260709 12:26:33.991091 10817 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.005s	sys 0.021s
I20260709 12:26:33.995430 10895 leader_election.cc:304] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:33.995615 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
W20260709 12:26:33.996958 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:34.002867 10847 raft_consensus.cc:1275] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:26:34.006505 10923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59626 (request call id 3577) took 1173 ms. Trace:
I20260709 12:26:33.992002 15478 raft_consensus.cc:697] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:26:34.039695 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac83709373b4efd9c3aa1472a9f9022" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:34.006976 10923 rpcz_store.cc:276] 0709 12:26:32.832974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:32.936762 (+103788us) service_pool.cc:224] Handling call
0709 12:26:33.018849 (+ 82087us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:33.033198 (+ 14349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:33.033237 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:33.036845 (+  3608us) log.cc:844] Serialized 26 byte log entry
0709 12:26:33.399617 (+362772us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:26:33.399663 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:33.399738 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:34.006262 (+606524us) raft_consensus.cc:1685] finished
0709 12:26:34.006284 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:34.006443 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10555,"raft.queue_time_us":17252,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":13708,"thread_start_us":197277,"threads_started":1,"wal-append.queue_time_us":423409}
I20260709 12:26:33.971395 15522 consensus_queue.cc:237] T e8b17195a94142039c40f598ed006c94 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:34.125406 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 130107us
I20260709 12:26:34.143391 10996 raft_consensus.cc:1240] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:34.150748 15517 raft_consensus.cc:493] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:34.151546 15517 raft_consensus.cc:515] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:34.152381 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:34.153180 10996 raft_consensus.cc:2468] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 9.
I20260709 12:26:34.154680 15517 leader_election.cc:290] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:34.157279 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:34.158114 10996 raft_consensus.cc:3060] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:34.163852 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef3220c51df47db8859f07ab745fad5" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:26:34.166256 15449 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.009s	sys 0.029s
I20260709 12:26:34.070693 15524 raft_consensus.cc:2749] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:34.195950 10999 raft_consensus.cc:1275] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:26:34.200102 10996 raft_consensus.cc:2468] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 12.
I20260709 12:26:34.174295 10845 raft_consensus.cc:1240] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 11. Current term is 12. Ops: []
I20260709 12:26:34.189268 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:34.201428 10994 raft_consensus.cc:3060] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:34.142220 15503 raft_consensus.cc:2804] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:34.206884 11616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45920 (request call id 843) took 2657 ms. Trace:
I20260709 12:26:34.207341 11616 rpcz_store.cc:276] 0709 12:26:31.549382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:31.549578 (+   196us) service_pool.cc:224] Handling call
0709 12:26:31.569800 (+ 20222us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:32.468849 (+899049us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:34.206614 (+1737765us) spinlock_profiling.cc:243] Waited 898 ms on lock 0x7b54008714d4. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e88e01 00007f7594e8783e 00007f7599e4c419 00007f75933c3bd4 00007f75933c3b62 00007f75933c3a91 00007f75933c3a0c 00007f75933c2cc2 00007f75931c348c 00007f75931c28c6
0709 12:26:34.206821 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2065912064}
W20260709 12:26:34.169705 15449 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.010s	sys 0.030s
I20260709 12:26:34.140242 15526 raft_consensus.cc:2749] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:34.223229 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:34.228107 10845 raft_consensus.cc:1240] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 5. Current term is 6. Ops: []
W20260709 12:26:34.207389 15423 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.899s	user 0.022s	sys 0.019s
W20260709 12:26:34.233354 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 384545us
I20260709 12:26:34.240983 11616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6a1da21304fcfacab384a6afc4101" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
W20260709 12:26:34.240113 10968 leader_election.cc:336] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Timed out: RequestConsensusVote RPC to 127.9.116.65:46265 timed out after 2.106s (SENT)
I20260709 12:26:34.261435 10854 raft_consensus.cc:1240] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 9. Current term is 10. Ops: []
I20260709 12:26:34.263793 10968 leader_election.cc:304] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040
W20260709 12:26:34.268985 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 83052.3us
I20260709 12:26:34.271226 10994 raft_consensus.cc:2468] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 13.
W20260709 12:26:34.239478 15423 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.948s	user 0.022s	sys 0.020s
I20260709 12:26:34.276885 11588 leader_election.cc:304] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:34.234139 15503 raft_consensus.cc:697] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [term 4 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:34.277864 10894 leader_election.cc:304] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:34.275488 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
W20260709 12:26:34.281878 10819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:34.282630 10923 raft_consensus.cc:1240] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 12. Current term is 13. Ops: []
I20260709 12:26:34.284314 10845 raft_consensus.cc:2410] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
W20260709 12:26:34.288364 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 48353.5us
I20260709 12:26:34.274106 11615 raft_consensus.cc:1275] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
W20260709 12:26:34.292207 10968 leader_election.cc:336] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Timed out: RequestConsensusVote RPC to 127.9.116.66:39339 timed out after 1.549s (SENT)
I20260709 12:26:34.292842 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:34.300783 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:34.323139 10924 raft_consensus.cc:2468] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 7.
W20260709 12:26:34.326769 10969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:34.336081 10894 leader_election.cc:304] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:34.337106 11616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:34.282403 15505 raft_consensus.cc:2749] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:26:34.340202 10968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:34.352303 15449 raft_consensus.cc:2804] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:26:34.352994 15449 raft_consensus.cc:697] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 12 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:34.353035 15472 leader_election.cc:290] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:34.354030 15449 consensus_queue.cc:237] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:34.354753 10968 leader_election.cc:304] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:34.355772 15323 consensus_queue.cc:1059] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:26:34.341698 11619 raft_consensus.cc:1240] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d [term 11 LEADER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 10. Current term is 11. Ops: []
I20260709 12:26:34.355962 15464 consensus_queue.cc:1059] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:26:34.356623 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:34.282653 15216 raft_consensus.cc:2749] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:26:34.355851 15520 raft_consensus.cc:493] T e9331e5342644ca2bae19187b083a7d5 P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:34.304189 15526 raft_consensus.cc:2804] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:26:34.287719 15455 raft_consensus.cc:493] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:34.356317 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:34.371600 10968 leader_election.cc:304] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:34.357045 15323 raft_consensus.cc:3055] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:26:34.356899 15464 raft_consensus.cc:2749] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:34.378248 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9331e5342644ca2bae19187b083a7d5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:34.380501 15323 raft_consensus.cc:740] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:26:34.389329 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:34.356854 11619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45920 (request call id 851) took 1320 ms. Trace:
I20260709 12:26:34.357214 15523 raft_consensus.cc:3055] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:26:34.386935 15518 raft_consensus.cc:3060] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:34.393132 10968 leader_election.cc:304] T d0aed74af73a488f8b691578ca370226 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:34.394255 10845 raft_consensus.cc:1240] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 11 LEADER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 10. Current term is 11. Ops: []
I20260709 12:26:34.395907 10845 raft_consensus.cc:1240] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 7. Current term is 8. Ops: []
W20260709 12:26:34.396167 10819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:34.396263 15526 raft_consensus.cc:697] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 9 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:34.398533 15526 consensus_queue.cc:237] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:34.408805 15518 raft_consensus.cc:2749] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:34.409829 10854 raft_consensus.cc:1240] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 6. Current term is 7. Ops: []
I20260709 12:26:34.401636 15500 leader_election.cc:290] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:34.359323 15513 consensus_queue.cc:1048] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 12:26:34.394769 11619 rpcz_store.cc:276] 0709 12:26:33.036906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:33.044231 (+  7325us) service_pool.cc:224] Handling call
0709 12:26:34.341243 (+1297012us) spinlock_profiling.cc:243] Waited 25.3 ms on lock 0x7b5800160898. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7591c23db1 00007f7591d63b71 00007f7591d63eee 000000000036eb39 00007f7599dd71e0 00007f7599ea00c4 00007f7599ea0131 00007f7599e61fc0 00007f7599e4c929 00007f7599e4c3d2 00007f75933c3bd4
0709 12:26:34.341438 (+   195us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:34.356565 (+ 15127us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:34.356785 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":58214656}
I20260709 12:26:34.411242 10854 raft_consensus.cc:1240] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 7. Current term is 8. Ops: []
I20260709 12:26:34.415686 15220 raft_consensus.cc:3055] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:26:34.416652 15503 consensus_queue.cc:237] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:34.416091 15220 raft_consensus.cc:740] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:26:34.420401 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6a1da21304fcfacab384a6afc4101" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:34.421060 10847 raft_consensus.cc:2468] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 5.
I20260709 12:26:34.421836 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:34.422664 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:34.423482 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:34.423902 15323 consensus_queue.cc:260] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:34.424618 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:34.381505 15520 raft_consensus.cc:515] T e9331e5342644ca2bae19187b083a7d5 P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:34.425555 10847 raft_consensus.cc:2393] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 12: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:26:34.426599 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:34.427286 15520 leader_election.cc:290] T e9331e5342644ca2bae19187b083a7d5 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:34.412807 15447 raft_consensus.cc:493] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:34.427848 15323 raft_consensus.cc:3060] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:34.428218 15447 raft_consensus.cc:515] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:34.429924 11616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef3220c51df47db8859f07ab745fad5" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:34.430378 15447 leader_election.cc:290] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:34.386194 15455 raft_consensus.cc:515] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:34.406082 15528 log.cc:927] Time spent T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.064s	user 0.000s	sys 0.003s
W20260709 12:26:34.432005 15529 log.cc:927] Time spent T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 12:26:34.420080 15220 consensus_queue.cc:260] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:34.427443 15541 log.cc:927] Time spent T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 12:26:34.416642 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
W20260709 12:26:34.433463 10969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:34.394955 15473 raft_consensus.cc:493] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:34.412032 11619 raft_consensus.cc:1240] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 7. Current term is 8. Ops: []
I20260709 12:26:34.427289 10847 raft_consensus.cc:2468] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 11.
I20260709 12:26:34.414423 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aed74af73a488f8b691578ca370226" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:34.469918 11622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45904 (request call id 929) took 1351 ms. Trace:
I20260709 12:26:34.470177 11622 rpcz_store.cc:276] 0709 12:26:33.118194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:33.722539 (+604345us) service_pool.cc:224] Handling call
0709 12:26:34.414262 (+691723us) spinlock_profiling.cc:243] Waited 3.28 ms on lock 0x7b5800160898. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7591c23db1 00007f7591d63b71 00007f7591d63a22 00007f759ac7c8d9 00007f7599dd6ee0 00007f7599ea00ab 00007f7599ea0131 00007f7599e4e0a0 00007f7599e4d984 00007f75933c86d4 00007f75933c8662
0709 12:26:34.469843 (+ 55581us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7545088}
I20260709 12:26:34.436187 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:34.435736 10845 raft_consensus.cc:1240] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 10. Current term is 11. Ops: []
I20260709 12:26:34.432792 15220 raft_consensus.cc:3060] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:34.438845 10920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59626 (request call id 3581) took 1407 ms. Trace:
I20260709 12:26:34.480453 10920 rpcz_store.cc:276] 0709 12:26:33.031622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:33.877977 (+846355us) service_pool.cc:224] Handling call
0709 12:26:33.878320 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:33.878572 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:26:33.878598 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:34.001503 (+122905us) log.cc:844] Serialized 26 byte log entry
0709 12:26:34.175557 (+174054us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:26:34.175624 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:34.175706 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:34.438526 (+262820us) raft_consensus.cc:1685] finished
0709 12:26:34.438563 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:34.438765 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":27311,"threads_started":1,"wal-append.queue_time_us":221466}
I20260709 12:26:34.356295 15505 consensus_queue.cc:1059] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
W20260709 12:26:34.441039 10848 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56394 (request call id 4045) took 2605 ms (client timeout 1936 ms). Trace:
I20260709 12:26:34.445843 15513 raft_consensus.cc:493] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:34.446560 11588 leader_election.cc:304] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:34.488101 10924 raft_consensus.cc:1275] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 12:26:34.483691 10848 rpcz_store.cc:269] 0709 12:26:31.835385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:31.835526 (+   141us) service_pool.cc:224] Handling call
0709 12:26:34.440609 (+2605083us) spinlock_profiling.cc:243] Waited 527 ms on lock 0x7b54001a5254. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e8c2fa 00007f7599e4db17 00007f75933c86d4 00007f75933c8662 00007f75933c8591 00007f75933c850c 00007f75933c77c2 00007f75931c348c 00007f75931c28c6 00007f75931c226f
0709 12:26:34.440910 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1212249856}
I20260709 12:26:34.447607 10738 catalog_manager.cc:5028] TS 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): tablet 3357adbb6a514faf958aff009c4e4af8 (table test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]) successfully deleted
I20260709 12:26:34.448410 15455 leader_election.cc:290] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:34.491650 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:34.448778 10895 leader_election.cc:304] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:34.288051 15478 consensus_queue.cc:237] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:34.450086 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:34.499528 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:34.500578 10854 raft_consensus.cc:2368] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for earlier term 12. Current term is 13.
I20260709 12:26:34.451495 15326 leader_election.cc:290] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 6 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:34.392268 15523 raft_consensus.cc:740] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:26:34.457271 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
W20260709 12:26:34.458976 15474 consensus_meta.cc:287] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040: Time spent flushing consensus metadata: real 1.080s	user 0.015s	sys 0.000s
I20260709 12:26:34.508478 10999 raft_consensus.cc:3060] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:34.458902 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:34.460247 11003 raft_consensus.cc:1240] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 6. Current term is 7. Ops: []
I20260709 12:26:34.460783 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:34.510059 11000 raft_consensus.cc:2393] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 11: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:26:34.461110 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac83709373b4efd9c3aa1472a9f9022" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:34.511703 11001 raft_consensus.cc:2368] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 5. Current term is 6.
I20260709 12:26:34.512750 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:34.513805 11001 raft_consensus.cc:2468] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 6.
I20260709 12:26:34.461917 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab816bcc6183447994a2cc013e46c5f8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:34.515401 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad766f48812a4ddeb383179b1d84907b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:34.515017 15474 raft_consensus.cc:515] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:34.516005 15523 consensus_queue.cc:260] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:34.516870 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63ecfc9bd3945818cfe15c03f001315" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:34.462015 10997 raft_consensus.cc:1275] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:26:34.517738 15523 raft_consensus.cc:3060] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:34.518335 15474 leader_election.cc:290] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 10 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:34.518656 10997 raft_consensus.cc:1240] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 LEADER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:34.519160 10852 raft_consensus.cc:2368] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for earlier term 9. Current term is 10.
I20260709 12:26:34.463613 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c6d38c4d8a90a81975a6a0cb13" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:34.466604 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:34.510085 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:34.520399 10929 raft_consensus.cc:2468] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 9.
I20260709 12:26:34.521011 10854 raft_consensus.cc:1275] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:26:34.519824 10849 raft_consensus.cc:2468] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 8.
W20260709 12:26:34.468209 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 75170us
I20260709 12:26:34.471295 10994 raft_consensus.cc:2393] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 12: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:26:34.481648 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b17195a94142039c40f598ed006c94" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
W20260709 12:26:34.484205 10820 connection.cc:256] RPC call timeout handler was delayed by -2.5574038169997948s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1552s for a response
I20260709 12:26:34.493908 10845 raft_consensus.cc:1240] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 3. Current term is 4. Ops: []
W20260709 12:26:34.523948 10820 connection.cc:256] RPC call timeout handler was delayed by -2.5556038169997919s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1554s for a response
W20260709 12:26:34.495136 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 48659us
W20260709 12:26:34.524479 10820 connection.cc:256] RPC call timeout handler was delayed by -2.4944038169996929s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1622s for a response
W20260709 12:26:34.524940 10820 connection.cc:256] RPC call timeout handler was delayed by -2.4872038169996813s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.163s for a response
W20260709 12:26:34.496730 10738 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 49343.1us
I20260709 12:26:34.510967 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:26:34.503360 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 54644.6us
I20260709 12:26:34.479035 15471 raft_consensus.cc:2749] T d0aed74af73a488f8b691578ca370226 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:34.528023 10895 leader_election.cc:304] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:34.523516 10968 leader_election.cc:304] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:34.469027 15284 raft_consensus.cc:493] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:34.528878 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab816bcc6183447994a2cc013e46c5f8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
W20260709 12:26:34.525457 10820 connection.cc:256] RPC call timeout handler was delayed by -2.3792038169999614s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17500000000000002s for a response
W20260709 12:26:34.550330 10820 connection.cc:256] RPC call timeout handler was delayed by -2.3450038169999061s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17880000000000001s for a response
W20260709 12:26:34.550662 10820 connection.cc:256] RPC call timeout handler was delayed by -2.2892038169998159s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18500000000000003s for a response
W20260709 12:26:34.550910 10820 connection.cc:256] RPC call timeout handler was delayed by -2.2541038169997591s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1889s for a response
W20260709 12:26:34.551177 10820 connection.cc:256] RPC call timeout handler was delayed by -2.2343038169997271s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19110000000000002s for a response
W20260709 12:26:34.551416 10820 connection.cc:256] RPC call timeout handler was delayed by -2.2019038169996747s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1947s for a response
W20260709 12:26:34.551687 10820 connection.cc:256] RPC call timeout handler was delayed by -2.1587038169996049s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1995s for a response
W20260709 12:26:34.551939 10820 connection.cc:256] RPC call timeout handler was delayed by -2.1191038169999956s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20390000000000003s for a response
W20260709 12:26:34.552186 10820 connection.cc:256] RPC call timeout handler was delayed by -2.1191038169999956s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20390000000000003s for a response
W20260709 12:26:34.552424 10820 connection.cc:256] RPC call timeout handler was delayed by -2.0273038169998472s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2141s for a response
I20260709 12:26:34.505991 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:26:34.552664 10820 connection.cc:256] RPC call timeout handler was delayed by -1.4828038169998763s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2746s for a response
W20260709 12:26:34.552959 10820 connection.cc:256] RPC call timeout handler was delayed by -1.1831038169998465s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30790000000000006s for a response
W20260709 12:26:34.553218 10820 connection.cc:256] RPC call timeout handler was delayed by -1.1543038169998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.31110000000000004s for a response
I20260709 12:26:34.515416 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:34.526747 11000 raft_consensus.cc:2468] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 7.
I20260709 12:26:34.557293 11001 raft_consensus.cc:2468] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 8.
I20260709 12:26:34.547861 10923 raft_consensus.cc:1275] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:26:34.545665 10895 leader_election.cc:304] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:34.542968 10998 raft_consensus.cc:2393] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 5: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:26:34.561636 10895 leader_election.cc:304] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:34.563275 10968 leader_election.cc:304] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:34.564704 10895 leader_election.cc:304] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:34.524945 15467 raft_consensus.cc:2804] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:26:34.506079 15257 raft_consensus.cc:2749] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:34.566967 10999 raft_consensus.cc:2468] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 9.
I20260709 12:26:34.567302 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fd8fdac2fa449e9e184f3d668ea1a7" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
W20260709 12:26:34.514549 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 115234us
I20260709 12:26:34.589460 11622 raft_consensus.cc:2393] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 8: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:26:34.584865 10895 leader_election.cc:304] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:34.585942 11003 raft_consensus.cc:1275] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:26:34.590679 15540 raft_consensus.cc:2804] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:34.591245 15540 raft_consensus.cc:493] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:34.591681 15540 raft_consensus.cc:3060] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:34.592871 10928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59626 (request call id 3578) took 1750 ms. Trace:
I20260709 12:26:34.593860 11616 raft_consensus.cc:1240] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 9. Current term is 10. Ops: []
I20260709 12:26:34.556115 15505 raft_consensus.cc:2804] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:34.568123 10968 leader_election.cc:304] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d
I20260709 12:26:34.588217 10820 leader_election.cc:304] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:34.483314 15473 raft_consensus.cc:515] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:34.593295 10928 rpcz_store.cc:276] 0709 12:26:32.842954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:33.801186 (+958232us) service_pool.cc:224] Handling call
0709 12:26:33.801622 (+   436us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:34.278512 (+476890us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:34.278551 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:34.285836 (+  7285us) log.cc:844] Serialized 26 byte log entry
0709 12:26:34.383744 (+ 97908us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:26:34.383888 (+   144us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:34.383998 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:34.592634 (+208636us) raft_consensus.cc:1685] finished
0709 12:26:34.592653 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:34.592805 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16590,"raft.queue_time_us":191108,"raft.run_cpu_time_us":281,"raft.run_wall_time_us":7621,"thread_start_us":483239,"threads_started":2,"wal-append.queue_time_us":164925}
I20260709 12:26:34.595151 10895 leader_election.cc:304] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:34.546561 15449 raft_consensus.cc:2749] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:26:34.546751 15326 consensus_queue.cc:1048] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 12:26:34.566150 15425 consensus_queue.cc:1048] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 12:26:34.566605 15532 raft_consensus.cc:2749] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:34.599704 11616 raft_consensus.cc:1240] T e9331e5342644ca2bae19187b083a7d5 P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:34.565917 15526 raft_consensus.cc:2749] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:34.565563 15423 raft_consensus.cc:2749] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:34.625130 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:34.568609 15467 raft_consensus.cc:493] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:34.524758 15513 raft_consensus.cc:515] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:34.604303 11619 raft_consensus.cc:1240] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 5. Current term is 6. Ops: []
I20260709 12:26:34.559595 15284 raft_consensus.cc:515] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:34.587116 15323 raft_consensus.cc:2749] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:34.653967 11616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63ecfc9bd3945818cfe15c03f001315" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:34.587289 15474 raft_consensus.cc:493] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:34.624686 10895 leader_election.cc:304] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:34.627974 10846 raft_consensus.cc:2393] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3c52e0825c02476e89d84da9bb849f5d in current term 7: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:26:34.625463 15518 consensus_queue.cc:1048] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 12:26:34.616822 15419 raft_consensus.cc:2804] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:26:34.628340 15257 consensus_queue.cc:1048] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:34.629385 11588 leader_election.cc:304] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:26:34.630203 10968 leader_election.cc:336] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Timed out: RequestConsensusVote RPC to 127.9.116.65:46265 timed out after 1.549s (SENT)
I20260709 12:26:34.606679 15505 raft_consensus.cc:493] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:34.657274 15546 raft_consensus.cc:2764] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:26:34.633692 10927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50036 (request call id 927) took 1812 ms. Trace:
I20260709 12:26:34.635254 15475 raft_consensus.cc:3055] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:26:34.620072 15503 raft_consensus.cc:2804] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:26:34.656206 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 68215us
I20260709 12:26:34.635399 15473 leader_election.cc:290] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:34.680569 11616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:34.631397 15467 raft_consensus.cc:3060] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:34.652019 15258 raft_consensus.cc:3055] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:26:34.618048 15446 consensus_queue.cc:1048] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 12:26:34.625294 15455 consensus_queue.cc:1059] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 12:26:34.789149 15425 raft_consensus.cc:2804] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:26:34.632772 11622 raft_consensus.cc:1240] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 10. Current term is 11. Ops: []
I20260709 12:26:34.689253 15505 raft_consensus.cc:3060] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:26:34.690524 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 61416.6us
I20260709 12:26:34.751828 10927 rpcz_store.cc:276] 0709 12:26:32.821398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:32.821598 (+   200us) service_pool.cc:224] Handling call
0709 12:26:32.847753 (+ 26155us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:33.029540 (+181787us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:26:33.180692 (+151152us) log.cc:844] Serialized 14 byte log entry
0709 12:26:33.481022 (+300330us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:33.481081 (+    59us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:26:33.481138 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:34.633438 (+1152300us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b54002b98d4. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e88e01 00007f7594e8783e 00007f7599e4c419 00007f75933c3bd4 00007f75933c3b62 00007f75933c3a91 00007f75933c3a0c 00007f75933c2cc2 00007f75931c348c 00007f75931c28c6
0709 12:26:34.633491 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:34.633628 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":334654,"prepare.run_cpu_time_us":264,"prepare.run_wall_time_us":3010,"raft.queue_time_us":224367,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"spinlock_wait_cycles":417414016,"thread_start_us":433117,"threads_started":3,"wal-append.queue_time_us":336968}
W20260709 12:26:34.776137 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 151552us
I20260709 12:26:34.687253 15419 raft_consensus.cc:493] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:34.787544 15533 raft_consensus.cc:2749] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:34.871034 15419 raft_consensus.cc:3060] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:26:34.788496 15547 log.cc:927] Time spent T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
W20260709 12:26:34.800772 15551 log.cc:927] Time spent T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 12:26:34.688555 15474 raft_consensus.cc:515] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:34.881786 15474 leader_election.cc:290] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:34.805752 15284 leader_election.cc:290] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:34.789882 15503 raft_consensus.cc:493] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:34.882795 15503 raft_consensus.cc:3060] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:34.788224 15475 raft_consensus.cc:740] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:26:34.888531 15475 consensus_queue.cc:260] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 7.10, Last appended by leader: 10, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:34.889807 15475 raft_consensus.cc:3060] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:34.813479 11616 raft_consensus.cc:3060] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:34.807488 15540 raft_consensus.cc:515] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:34.831197 10969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:34.894338 10969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:34.894987 10969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:34.687688 10968 leader_election.cc:304] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
W20260709 12:26:34.896620 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 266424us
I20260709 12:26:34.897233 10895 leader_election.cc:304] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:26:34.898069 10968 leader_election.cc:336] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Timed out: RequestConsensusVote RPC to 127.9.116.65:46265 timed out after 1.656s (SENT)
I20260709 12:26:34.792586 10820 leader_election.cc:304] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:34.898330 11616 raft_consensus.cc:2410] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:26:34.898597 10895 leader_election.cc:304] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:34.898919 10968 leader_election.cc:304] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:34.799242 15513 leader_election.cc:290] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:34.901466 10895 leader_election.cc:304] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:34.818262 15258 raft_consensus.cc:740] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:26:34.915203 10968 leader_election.cc:304] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:34.916625 10997 raft_consensus.cc:1275] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:26:34.869933 15425 raft_consensus.cc:493] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:34.903277 15284 raft_consensus.cc:2749] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:34.893635 15540 leader_election.cc:290] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:26:34.928138 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 135607us
I20260709 12:26:34.903539 15464 raft_consensus.cc:2749] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:34.904352 15533 raft_consensus.cc:2749] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:26:34.926132 10895 leader_election.cc:304] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:34.916819 15323 raft_consensus.cc:2749] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:26:34.917893 15455 raft_consensus.cc:2749] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:34.946364 10895 leader_election.cc:304] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:34.949625 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad766f48812a4ddeb383179b1d84907b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:34.952307 10853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56388 (request call id 3136) took 1341 ms. Trace:
I20260709 12:26:34.952708 10853 rpcz_store.cc:276] 0709 12:26:33.610512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:33.931402 (+320890us) service_pool.cc:224] Handling call
0709 12:26:34.949403 (+1018001us) spinlock_profiling.cc:243] Waited 58.7 ms on lock 0x7b5800004e98. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7591c23db1 00007f7591d63b71 00007f7591d63a22 00007f759ac7c8d9 00007f7599dd6ee0 00007f7599ea00ab 00007f7599ea0131 00007f7599e4e0a0 00007f7599e4d984 00007f75933c86d4 00007f75933c8662
0709 12:26:34.952237 (+  2834us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":135124864}
I20260709 12:26:34.906997 15526 consensus_queue.cc:1048] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 12:26:34.923295 15513 raft_consensus.cc:2804] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:26:34.922925 15425 raft_consensus.cc:3060] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:34.924706 15523 raft_consensus.cc:2749] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:34.957792 10895 leader_election.cc:304] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:34.962342 15284 raft_consensus.cc:2804] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:34.958346 15258 consensus_queue.cc:260] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:34.972303 15258 raft_consensus.cc:3060] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:34.971441 15532 raft_consensus.cc:2804] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:26:34.973232 15532 raft_consensus.cc:493] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:34.973681 15532 raft_consensus.cc:3060] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:34.976164 11617 raft_consensus.cc:1240] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 6. Current term is 7. Ops: []
I20260709 12:26:34.977064 11617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45920 (request call id 850) took 1941 ms. Trace:
I20260709 12:26:34.977444 11617 rpcz_store.cc:276] 0709 12:26:33.035651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:33.047439 (+ 11788us) service_pool.cc:224] Handling call
0709 12:26:34.975711 (+1928272us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b5800160898. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7591c23db1 00007f7591d63b71 00007f7591d63a22 00007f759ac7c8d9 00007f7599dd6ee0 00007f7599ea00ab 00007f7599ea0131 00007f7599e61fc0 00007f7599e4c929 00007f7599e4c3d2 00007f75933c3bd4
0709 12:26:34.975945 (+   234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:34.976816 (+   871us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:34.977008 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28985728}
I20260709 12:26:34.949244 15423 raft_consensus.cc:2749] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:34.950961 15454 raft_consensus.cc:3055] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:26:34.999053 10968 leader_election.cc:304] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:34.998893 10894 leader_election.cc:304] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:35.001917 10968 leader_election.cc:304] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
W20260709 12:26:35.002195 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 55373.2us
I20260709 12:26:35.002959 10820 leader_election.cc:304] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d
I20260709 12:26:34.977290 15513 raft_consensus.cc:697] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 7 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:34.956056 15446 consensus_queue.cc:1048] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 12:26:35.008126 10968 leader_election.cc:304] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:34.948036 15478 consensus_queue.cc:1059] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 12:26:34.960548 15533 consensus_queue.cc:1059] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:26:34.998195 15454 raft_consensus.cc:740] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:35.001457 15423 raft_consensus.cc:493] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:34.982678 15458 consensus_queue.cc:1048] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 12:26:35.010118 15523 raft_consensus.cc:2749] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:35.010453 15540 raft_consensus.cc:2804] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:35.011332 15471 raft_consensus.cc:2749] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:26:35.036808 10969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:35.038002 10820 leader_election.cc:304] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:35.016141 15258 raft_consensus.cc:3060] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:35.016736 15455 raft_consensus.cc:2764] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
W20260709 12:26:35.033728 15220 consensus_meta.cc:287] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08: Time spent flushing consensus metadata: real 0.546s	user 0.009s	sys 0.004s
I20260709 12:26:35.032058 15284 raft_consensus.cc:697] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:35.067492 15478 raft_consensus.cc:493] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:35.074179 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:35.134847 10850 raft_consensus.cc:2468] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 11.
I20260709 12:26:35.135633 10850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56388 (request call id 3144) took 1343 ms. Trace:
I20260709 12:26:35.136035 10850 rpcz_store.cc:276] 0709 12:26:33.792487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:33.948444 (+155957us) service_pool.cc:224] Handling call
0709 12:26:35.073993 (+1125549us) spinlock_profiling.cc:243] Waited 7.65 ms on lock 0x7b5800004e98. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7591c23db1 00007f7591d63b71 00007f7591d63a22 00007f759ac7c8d9 00007f7599dd6ee0 00007f7599ea00ab 00007f7599ea0131 00007f7599e4e0a0 00007f7599e4d984 00007f75933c86d4 00007f75933c8662
0709 12:26:35.135512 (+ 61519us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17586944}
I20260709 12:26:35.021111 15423 raft_consensus.cc:515] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:35.080277 11623 raft_consensus.cc:1240] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [term 8 LEADER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 7. Current term is 8. Ops: []
I20260709 12:26:35.083918 15454 consensus_queue.cc:260] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:35.085527 15527 raft_consensus.cc:3055] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:26:35.092872 15523 consensus_queue.cc:1059] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:26:35.093664 11624 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45904 (request call id 928) took 1991 ms (client timeout 1940 ms). Trace:
I20260709 12:26:35.095369 15449 raft_consensus.cc:493] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:35.095783 15516 raft_consensus.cc:3055] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:35.096688 11621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18294423a68a4671bf6c5a0f98645e4c" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:35.099004 11588 leader_election.cc:304] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
W20260709 12:26:35.101686 11618 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45920 (request call id 856) took 2060 ms (client timeout 2560 ms). Trace:
W20260709 12:26:35.102227 10819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:35.105127 10968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:35.107542 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:35.107842 15513 consensus_queue.cc:237] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:35.107939 15471 raft_consensus.cc:493] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:35.113694 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:35.113937 10925 raft_consensus.cc:1240] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 5. Current term is 6. Ops: []
I20260709 12:26:35.116168 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:35.115016 15503 raft_consensus.cc:515] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:35.116722 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:35.121485 10852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56388 (request call id 3135) took 1511 ms. Trace:
W20260709 12:26:35.039481 15248 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.696s	user 0.007s	sys 0.015s
I20260709 12:26:35.122277 15532 raft_consensus.cc:515] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:35.145001 11623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45920 (request call id 849) took 2109 ms. Trace:
W20260709 12:26:35.111300 15538 log.cc:927] Time spent T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.764s	user 0.013s	sys 0.000s
I20260709 12:26:35.037712 15540 raft_consensus.cc:493] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:35.033329 15526 consensus_queue.cc:1048] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.119s
I20260709 12:26:35.167276 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
W20260709 12:26:35.154433 11621 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45920 (request call id 857) took 2112 ms (client timeout 1710 ms). Trace:
W20260709 12:26:35.158739 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 59846.8us
I20260709 12:26:35.184067 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:35.177177 10921 raft_consensus.cc:2468] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 13.
I20260709 12:26:35.176105 10852 rpcz_store.cc:276] 0709 12:26:33.610179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:33.900212 (+290033us) service_pool.cc:224] Handling call
0709 12:26:35.121156 (+1220944us) spinlock_profiling.cc:243] Waited 603 ms on lock 0x7b5400192654. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e8c2fa 00007f7599e4db17 00007f75933c86d4 00007f75933c8662 00007f75933c8591 00007f75933c850c 00007f75933c77c2 00007f75931c348c 00007f75931c28c6 00007f75931c226f
0709 12:26:35.121390 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1386212736}
W20260709 12:26:35.148299 11624 rpcz_store.cc:269] 0709 12:26:33.102113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:33.184887 (+ 82774us) service_pool.cc:224] Handling call
0709 12:26:35.091485 (+1906598us) spinlock_profiling.cc:243] Waited 544 ms on lock 0x7b54007cc9d4. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e8c2fa 00007f7599e4db17 00007f75933c86d4 00007f75933c8662 00007f75933c8591 00007f75933c850c 00007f75933c77c2 00007f75931c348c 00007f75931c28c6 00007f75931c226f
0709 12:26:35.093584 (+  2099us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1252237184}
W20260709 12:26:35.179335 10819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:35.183794 11621 rpcz_store.cc:269] 0709 12:26:33.041922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:33.087852 (+ 45930us) service_pool.cc:224] Handling call
0709 12:26:35.096414 (+2008562us) spinlock_profiling.cc:243] Waited 15.6 ms on lock 0x7b5800160898. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7591c23db1 00007f7591d63b71 00007f7591d63a22 00007f759ac7c8d9 00007f7599dd6ee0 00007f7599ea00ab 00007f7599ea0131 00007f7599e4e0a0 00007f7599e4d984 00007f75933c86d4 00007f75933c8662
0709 12:26:35.154325 (+ 57911us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":35843328}
I20260709 12:26:35.185107 10851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56388 (request call id 3143) took 1393 ms. Trace:
I20260709 12:26:35.179986 11623 rpcz_store.cc:276] 0709 12:26:33.035304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:33.048352 (+ 13048us) service_pool.cc:224] Handling call
0709 12:26:35.079821 (+2031469us) spinlock_profiling.cc:243] Waited 12.7 ms on lock 0x7b5800160898. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7591c23db1 00007f7591d63b71 00007f7591d63a22 00007f759ac7c8d9 00007f7599dd6ee0 00007f7599ea00ab 00007f7599ea0131 00007f7599e61fc0 00007f7599e4c929 00007f7599e4c3d2 00007f75933c3bd4
0709 12:26:35.080060 (+   239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:35.144602 (+ 64542us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:35.144926 (+   324us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29190016}
I20260709 12:26:35.186523 10819 leader_election.cc:304] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:35.134079 15475 raft_consensus.cc:493] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:35.187101 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:35.142460 15533 raft_consensus.cc:3055] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:35.186538 10851 rpcz_store.cc:276] 0709 12:26:33.792158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:33.915092 (+122934us) service_pool.cc:224] Handling call
0709 12:26:35.167040 (+1251948us) spinlock_profiling.cc:243] Waited 31.1 ms on lock 0x7b5800004e98. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7591c23db1 00007f7591d63b71 00007f7591d63a22 00007f759ac7c8d9 00007f7599dd6ee0 00007f7599ea00ab 00007f7599ea0131 00007f7599e4e0a0 00007f7599e4d984 00007f75933c86d4 00007f75933c8662
0709 12:26:35.184996 (+ 17956us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":71587584}
W20260709 12:26:35.188735 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:35.195329 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac83709373b4efd9c3aa1472a9f9022" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:35.196290 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:35.196900 10849 raft_consensus.cc:1813] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Handling vote request from an unknown peer e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:35.197576 10849 raft_consensus.cc:2410] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:26:35.182696 15516 raft_consensus.cc:740] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:26:35.202594 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad766f48812a4ddeb383179b1d84907b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
W20260709 12:26:35.181239 15248 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.838s	user 0.007s	sys 0.018s
I20260709 12:26:35.145780 15527 raft_consensus.cc:740] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:26:35.200826 10927 raft_consensus.cc:1240] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 9. Current term is 10. Ops: []
I20260709 12:26:35.188138 15455 raft_consensus.cc:2804] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:26:35.196800 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
W20260709 12:26:35.168730 15542 log.cc:927] Time spent T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.820s	user 0.003s	sys 0.000s
W20260709 12:26:35.204283 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 175638us
I20260709 12:26:35.204514 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:35.207320 10926 raft_consensus.cc:1240] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 11. Current term is 12. Ops: []
I20260709 12:26:35.207805 10999 raft_consensus.cc:1275] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:26:35.208561 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 227617us
I20260709 12:26:35.170375 15423 leader_election.cc:290] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:35.158804 15485 raft_consensus.cc:2749] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:26:35.182071 15335 raft_consensus.cc:493] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:35.147876 15419 raft_consensus.cc:515] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:35.183490 15220 raft_consensus.cc:3055] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:26:35.196229 10852 raft_consensus.cc:2376] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 6. Re-sending same reply.
I20260709 12:26:35.253152 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:35.253930 10852 raft_consensus.cc:2376] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 10. Re-sending same reply.
I20260709 12:26:35.182293 15540 raft_consensus.cc:3060] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:35.190934 15523 raft_consensus.cc:493] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:35.247601 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
W20260709 12:26:35.176098 11618 rpcz_store.cc:269] 0709 12:26:33.041627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:33.043672 (+  2045us) service_pool.cc:224] Handling call
0709 12:26:35.101478 (+2057806us) spinlock_profiling.cc:243] Waited 859 ms on lock 0x7b54003755d4. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e8c2fa 00007f7599e4db17 00007f75933c86d4 00007f75933c8662 00007f75933c8591 00007f75933c850c 00007f75933c77c2 00007f75931c348c 00007f75931c28c6 00007f75931c226f
0709 12:26:35.101620 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1976720640}
I20260709 12:26:35.193267 15533 raft_consensus.cc:740] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:35.177793 15449 raft_consensus.cc:515] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:35.205080 15518 raft_consensus.cc:493] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:35.270596 15503 leader_election.cc:290] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 12 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:35.271219 15532 leader_election.cc:290] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 10 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:35.271068 15527 consensus_queue.cc:260] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:35.272064 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:35.266614 15505 raft_consensus.cc:515] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:35.272462 15527 raft_consensus.cc:3060] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:35.273290 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9331e5342644ca2bae19187b083a7d5" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:35.274102 15505 leader_election.cc:290] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:35.274395 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:35.274864 11000 raft_consensus.cc:1240] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Rejecting Update request from peer 3c52e0825c02476e89d84da9bb849f5d for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:35.275007 10853 raft_consensus.cc:2376] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 8. Re-sending same reply.
I20260709 12:26:35.263985 15523 raft_consensus.cc:515] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:35.277786 15523 leader_election.cc:290] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:35.258694 10999 raft_consensus.cc:3060] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:35.281157 15533 consensus_queue.cc:260] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:35.282692 15533 raft_consensus.cc:3060] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:35.142393 15515 raft_consensus.cc:2804] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:35.283869 15515 raft_consensus.cc:493] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:35.171113 15284 consensus_queue.cc:237] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:35.284348 15515 raft_consensus.cc:3060] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:35.285758 15215 raft_consensus.cc:493] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:35.286497 15215 raft_consensus.cc:515] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:35.255146 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:35.213867 15455 raft_consensus.cc:493] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:35.288158 15455 raft_consensus.cc:3060] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:35.288757 10996 raft_consensus.cc:1240] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Rejecting Update request from peer 3c52e0825c02476e89d84da9bb849f5d for earlier term 8. Current term is 9. Ops: []
I20260709 12:26:35.289935 15419 leader_election.cc:290] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:35.251231 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:35.256552 15335 raft_consensus.cc:515] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:35.292752 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:35.293882 15335 leader_election.cc:290] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:35.294260 10846 raft_consensus.cc:1275] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:26:35.280943 11588 leader_election.cc:304] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:35.296527 10852 raft_consensus.cc:2376] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 8. Re-sending same reply.
I20260709 12:26:35.152788 15478 raft_consensus.cc:515] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:35.297952 15258 raft_consensus.cc:2749] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:35.310527 15465 raft_consensus.cc:2804] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:26:35.311149 15465 raft_consensus.cc:697] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d [term 10 LEADER]: Becoming Leader. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
I20260709 12:26:35.311473 15567 consensus_queue.cc:1048] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:35.312167 15465 consensus_queue.cc:237] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:35.312913 15467 raft_consensus.cc:515] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:35.315088 15467 leader_election.cc:290] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:35.316087 11588 leader_election.cc:304] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:35.188715 15425 raft_consensus.cc:515] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:35.270299 15518 raft_consensus.cc:515] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:35.297467 15449 leader_election.cc:290] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:35.264128 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:35.189594 15471 raft_consensus.cc:515] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:35.300415 10846 raft_consensus.cc:1275] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 12:26:35.231998 10968 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.116.65:46265 timed out after 1.530s (SENT) [suppressed 56 similar messages]
W20260709 12:26:35.301173 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 72096.9us
W20260709 12:26:35.348649 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 116674us
I20260709 12:26:35.309427 10999 raft_consensus.cc:2468] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 13.
I20260709 12:26:35.317214 11588 leader_election.cc:304] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:35.198674 15475 raft_consensus.cc:515] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:35.258216 15220 raft_consensus.cc:740] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:26:35.334194 15215 leader_election.cc:290] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:35.334499 15540 raft_consensus.cc:515] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:35.268023 15485 consensus_queue.cc:1048] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.068s
I20260709 12:26:35.336907 10995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37500 (request call id 3905) took 3279 ms. Trace:
W20260709 12:26:35.350630 10968 leader_election.cc:336] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Timed out: RequestConsensusVote RPC to 127.9.116.65:46265 timed out after 2.109s (SENT)
I20260709 12:26:35.359942 10820 leader_election.cc:304] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:35.365257 11620 raft_consensus.cc:1240] T ab816bcc6183447994a2cc013e46c5f8 P 3c52e0825c02476e89d84da9bb849f5d [term 4 LEADER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:35.369174 10968 leader_election.cc:304] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040
W20260709 12:26:35.371237 10968 leader_election.cc:336] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Timed out: RequestConsensusVote RPC to 127.9.116.65:46265 timed out after 2.187s (SENT)
I20260709 12:26:35.371948 10968 leader_election.cc:304] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:35.375151 11618 raft_consensus.cc:1275] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:26:35.375056 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9331e5342644ca2bae19187b083a7d5" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:35.375705 15523 raft_consensus.cc:2749] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:26:35.376909 15471 leader_election.cc:290] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:35.377130 15546 raft_consensus.cc:2749] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:35.332094 15335 raft_consensus.cc:2804] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:26:35.379123 15540 leader_election.cc:290] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:35.382936 15425 leader_election.cc:290] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 10 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:35.365554 15387 raft_consensus.cc:2804] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:26:35.407495 11624 raft_consensus.cc:1240] T e8b17195a94142039c40f598ed006c94 P 3c52e0825c02476e89d84da9bb849f5d [term 4 LEADER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:35.376941 10820 leader_election.cc:304] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:35.386109 11589 leader_election.cc:304] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:35.365989 10995 rpcz_store.cc:276] 0709 12:26:32.048697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:32.049631 (+   934us) service_pool.cc:224] Handling call
0709 12:26:32.049978 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:32.175849 (+125871us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:32.175885 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:33.824703 (+1648818us) spinlock_profiling.cc:243] Waited 3.54 ms on lock 0x7b2c0010cc78. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7593781a11 00007f7593791372 00007f7594ec3a01 00007f7594e8843a 00007f7594e8783e 00007f7599e4c419 00007f75933c3bd4 00007f75933c3b62 00007f75933c3a91 00007f75933c3a0c 00007f75933c2cc2
0709 12:26:33.825683 (+   980us) log.cc:844] Serialized 26 byte log entry
0709 12:26:34.230321 (+404638us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:26:34.230375 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:34.230470 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:35.110357 (+879887us) spinlock_profiling.cc:243] Waited 49.5 ms on lock 0x7b4400022b4c. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7591c23db1 00007f7591cc1c85 00007f7591cc26a2 00007f7594a341db 00007f7594a2faaf 00007f7594a2386e 00007f7594a22bb6 00007f7594a227d8 00007f7594a2c221 00007f7594a2c1d9 00007f7594a2c169
0709 12:26:35.327860 (+217503us) raft_consensus.cc:1685] finished
0709 12:26:35.327892 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:35.328084 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":78403,"raft.queue_time_us":75223,"raft.run_cpu_time_us":284,"raft.run_wall_time_us":122880,"spinlock_wait_cycles":121980672,"thread_start_us":404070,"threads_started":1,"wal-append.queue_time_us":521380}
I20260709 12:26:35.399762 11002 raft_consensus.cc:2468] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 6.
I20260709 12:26:35.401953 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:35.410591 10853 raft_consensus.cc:2393] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 10: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:26:35.411459 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6a1da21304fcfacab384a6afc4101" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:35.413378 11621 raft_consensus.cc:1240] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [term 13 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 12. Current term is 13. Ops: []
I20260709 12:26:35.413715 11623 raft_consensus.cc:1275] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:26:35.401412 15258 raft_consensus.cc:2749] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:35.412582 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:35.428053 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:35.424543 15387 raft_consensus.cc:697] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d [term 8 LEADER]: Becoming Leader. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
I20260709 12:26:35.432540 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:35.433471 15387 consensus_queue.cc:237] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:35.434445 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:35.432641 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
W20260709 12:26:35.436866 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 50849.7us
I20260709 12:26:35.438629 11589 leader_election.cc:304] T e9331e5342644ca2bae19187b083a7d5 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:35.359391 15419 consensus_queue.cc:1059] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 12:26:35.441671 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:35.444610 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:35.409778 15335 raft_consensus.cc:697] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d [term 8 LEADER]: Becoming Leader. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
I20260709 12:26:35.447363 15335 consensus_queue.cc:237] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 7.10, Last appended by leader: 10, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:35.448975 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b17195a94142039c40f598ed006c94" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:35.449625 10922 raft_consensus.cc:2468] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 4.
I20260709 12:26:35.450515 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:35.450892 11003 raft_consensus.cc:1275] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 11. (term mismatch)
I20260709 12:26:35.451233 11003 pending_rounds.cc:85] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08: Aborting all ops after (but not including) 10
I20260709 12:26:35.451468 11003 pending_rounds.cc:107] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08: Aborting uncommitted NO_OP operation due to leader change: 10.11
I20260709 12:26:35.451689 15425 raft_consensus.cc:2804] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:26:35.452548 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:26:35.452800 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 75971.5us
I20260709 12:26:35.452986 15425 raft_consensus.cc:697] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [term 13 LEADER]: Becoming Leader. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
I20260709 12:26:35.453727 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:35.453889 10820 leader_election.cc:304] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:35.454754 15473 consensus_queue.cc:1048] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:35.455339 15446 raft_consensus.cc:2749] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:26:35.451532 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:35.457175 11621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18294423a68a4671bf6c5a0f98645e4c" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:35.457163 10922 raft_consensus.cc:2468] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 6.
W20260709 12:26:35.418249 15509 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.064s	user 0.009s	sys 0.037s
I20260709 12:26:35.451789 11003 raft_consensus.cc:2889] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:35.465901 15567 raft_consensus.cc:2749] T e9331e5342644ca2bae19187b083a7d5 P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:35.472025 10895 leader_election.cc:304] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:35.472944 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:35.474551 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:35.340627 15516 consensus_queue.cc:260] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:35.445274 10995 raft_consensus.cc:2468] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 10.
I20260709 12:26:35.427745 15523 raft_consensus.cc:493] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:35.474128 15509 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.149s	user 0.010s	sys 0.037s
I20260709 12:26:35.435950 15163 raft_consensus.cc:2749] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:35.484046 10820 leader_election.cc:304] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:35.463725 15467 raft_consensus.cc:493] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
W20260709 12:26:35.503180 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 142800us
I20260709 12:26:35.485662 15568 raft_consensus.cc:2749] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:35.490020 15516 raft_consensus.cc:3060] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:35.486243 15250 raft_consensus.cc:493] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
W20260709 12:26:35.518908 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 51809.1us
I20260709 12:26:35.522446 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:35.524636 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:35.527266 10895 leader_election.cc:304] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:26:35.580233 10819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:35.512970 15546 raft_consensus.cc:2749] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:26:35.591151 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 78500.1us
I20260709 12:26:35.453936 15425 consensus_queue.cc:237] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:35.624239 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
W20260709 12:26:35.624821 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 95262.7us
I20260709 12:26:35.626662 10929 raft_consensus.cc:2376] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 6. Re-sending same reply.
W20260709 12:26:35.630682 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 103573us
I20260709 12:26:35.489614 15523 raft_consensus.cc:515] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:35.636198 10820 leader_election.cc:304] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:35.507905 15467 raft_consensus.cc:515] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:35.648172 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:35.673703 11589 leader_election.cc:304] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:35.514927 15455 raft_consensus.cc:515] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:35.649183 11588 leader_election.cc:304] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:35.649771 15461 raft_consensus.cc:493] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:35.650823 11003 raft_consensus.cc:1275] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 13 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:26:35.647217 15456 raft_consensus.cc:493] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:35.662344 15473 raft_consensus.cc:2749] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:26:35.662567 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:26:35.670542 15530 log.cc:927] Time spent T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 1.320s	user 0.003s	sys 0.000s
I20260709 12:26:35.689610 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18294423a68a4671bf6c5a0f98645e4c" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
W20260709 12:26:35.690305 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 44611.1us
I20260709 12:26:35.647037 15510 raft_consensus.cc:2749] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:26:35.703783 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:35.723057 10895 leader_election.cc:304] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040
W20260709 12:26:35.704519 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 55456.5us
I20260709 12:26:35.726186 11588 leader_election.cc:304] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
W20260709 12:26:35.646884 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:35.707017 11003 raft_consensus.cc:1275] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:26:35.709892 10994 raft_consensus.cc:1275] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:26:35.728374 15518 leader_election.cc:290] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:35.710611 10997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37512 (request call id 3486) took 1240 ms. Trace:
I20260709 12:26:35.729957 10997 rpcz_store.cc:276] 0709 12:26:34.463242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:34.519365 (+ 56123us) service_pool.cc:224] Handling call
0709 12:26:34.534057 (+ 14692us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:34.917243 (+383186us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:35.703161 (+785918us) spinlock_profiling.cc:243] Waited 382 ms on lock 0x7b54002c33d4. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e88e01 00007f7594e8783e 00007f7599e4c419 00007f75933c3bd4 00007f75933c3b62 00007f75933c3a91 00007f75933c3a0c 00007f75933c2cc2 00007f75931c348c 00007f75931c28c6
0709 12:26:35.703319 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":877806336}
I20260709 12:26:35.711735 10921 raft_consensus.cc:2468] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 11.
I20260709 12:26:35.732033 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:35.732784 10921 raft_consensus.cc:3060] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:35.538599 15250 raft_consensus.cc:515] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:35.737645 15250 leader_election.cc:290] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:35.536868 15515 raft_consensus.cc:515] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:35.753440 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:35.754263 10994 raft_consensus.cc:1813] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Handling vote request from an unknown peer e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:35.755020 10997 raft_consensus.cc:1275] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:26:35.747808 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:35.589888 15284 consensus_queue.cc:1048] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.122s
I20260709 12:26:35.692436 15585 raft_consensus.cc:2804] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:35.760630 10994 raft_consensus.cc:2410] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:26:35.710855 15426 raft_consensus.cc:2749] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:35.756368 11003 raft_consensus.cc:2468] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 9.
I20260709 12:26:35.763409 11621 raft_consensus.cc:1275] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:26:35.768218 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:35.769287 11003 raft_consensus.cc:2410] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:26:35.770239 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad766f48812a4ddeb383179b1d84907b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:35.771363 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:35.772105 11623 raft_consensus.cc:2376] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 9. Re-sending same reply.
I20260709 12:26:35.761780 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:35.794834 10997 raft_consensus.cc:3060] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:35.691313 15567 consensus_queue.cc:1048] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.062s
I20260709 12:26:35.759086 15540 raft_consensus.cc:2749] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:35.827136 15467 leader_election.cc:290] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:35.828298 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:35.829741 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c913e527ff46578e084c41eab7bb9d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:35.751327 15513 consensus_queue.cc:1059] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.080s
I20260709 12:26:35.832098 15458 raft_consensus.cc:2749] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:35.764393 15585 raft_consensus.cc:493] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:35.833907 15585 raft_consensus.cc:3060] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:35.793181 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:35.793493 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6a1da21304fcfacab384a6afc4101" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:35.710744 15461 raft_consensus.cc:515] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:35.721091 15456 raft_consensus.cc:515] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:35.813921 15475 leader_election.cc:290] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:35.751592 15449 consensus_queue.cc:1048] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 12:26:35.814922 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:35.815961 15523 leader_election.cc:290] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
W20260709 12:26:35.818914 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:35.820837 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:35.852460 10852 raft_consensus.cc:1275] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:26:35.852846 11000 raft_consensus.cc:3060] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:35.828471 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b17195a94142039c40f598ed006c94" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:35.845341 10994 raft_consensus.cc:3060] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:35.854676 10929 raft_consensus.cc:2468] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 4.
W20260709 12:26:35.766132 15248 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.076s	sys 0.124s
W20260709 12:26:35.847352 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 211302us
I20260709 12:26:35.861799 10820 leader_election.cc:304] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:35.863883 15163 raft_consensus.cc:2804] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:35.864602 15163 raft_consensus.cc:493] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:35.865203 15163 raft_consensus.cc:3060] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:35.867401 10820 leader_election.cc:304] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:35.868981 10852 raft_consensus.cc:1240] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 10. Current term is 11. Ops: []
I20260709 12:26:35.800418 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:35.848527 10819 leader_election.cc:304] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:35.870884 11003 raft_consensus.cc:2468] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 5.
W20260709 12:26:35.848480 15575 log.cc:927] Time spent T ab816bcc6183447994a2cc013e46c5f8 P 3c52e0825c02476e89d84da9bb849f5d: Append to log took a long time: real 0.339s	user 0.001s	sys 0.001s
I20260709 12:26:35.813346 15455 leader_election.cc:290] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:35.762856 15578 consensus_queue.cc:1048] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.132s
I20260709 12:26:35.898383 10929 raft_consensus.cc:1240] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 8. Current term is 9. Ops: []
I20260709 12:26:35.891052 10820 leader_election.cc:304] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:35.889061 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:26:35.866606 15559 log.cc:927] Time spent T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.858s	user 0.010s	sys 0.000s
I20260709 12:26:35.929387 11003 raft_consensus.cc:2468] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 11.
I20260709 12:26:35.896680 11002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37512 (request call id 3489) took 1405 ms. Trace:
W20260709 12:26:35.953219 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 62237.5us
I20260709 12:26:35.954540 10820 leader_election.cc:400] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 election: Vote denied by peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945) with higher term. Message: Invalid argument: T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 5. Current term is 6.
W20260709 12:26:35.860800 15574 log.cc:927] Time spent T 00000000000000000000000000000000 P 9619ad7a9e7f4d9b8039487e3ee77243: Append to log took a long time: real 0.388s	user 0.000s	sys 0.003s
W20260709 12:26:35.860513 15581 log.cc:927] Time spent T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.158s	user 0.000s	sys 0.002s
W20260709 12:26:35.858037 15582 log.cc:927] Time spent T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 12:26:35.946291 11002 rpcz_store.cc:276] 0709 12:26:34.464028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:34.516261 (+ 52233us) service_pool.cc:224] Handling call
0709 12:26:35.869571 (+1353310us) spinlock_profiling.cc:243] Waited 625 ms on lock 0x7b540006e354. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e8c2fa 00007f7599e4db17 00007f75933c86d4 00007f75933c8662 00007f75933c8591 00007f75933c850c 00007f75933c77c2 00007f75931c348c 00007f75931c28c6 00007f75931c226f
0709 12:26:35.869686 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1438209280}
I20260709 12:26:35.972833 10994 raft_consensus.cc:2468] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 10.
I20260709 12:26:35.914053 15546 raft_consensus.cc:2749] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:35.931109 15216 raft_consensus.cc:493] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:35.859318 15473 consensus_queue.cc:1059] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.189s
I20260709 12:26:36.042071 11003 raft_consensus.cc:1240] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:35.932379 15525 raft_consensus.cc:2804] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:36.048471 10820 leader_election.cc:304] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:36.050451 11002 raft_consensus.cc:1275] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:26:36.049279 15215 consensus_queue.cc:1048] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 12:26:36.099728 10847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46480 (request call id 778) took 1481 ms. Trace:
I20260709 12:26:36.106563 11000 raft_consensus.cc:2468] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 9.
W20260709 12:26:36.112085 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 222096us
W20260709 12:26:36.114329 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 249034us
W20260709 12:26:36.114545 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 142072us
I20260709 12:26:36.155282 10853 raft_consensus.cc:1275] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:26:36.104676 10847 rpcz_store.cc:276] 0709 12:26:34.618559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:34.626513 (+  7954us) service_pool.cc:224] Handling call
0709 12:26:34.628565 (+  2052us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:34.639242 (+ 10677us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:34.639279 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:34.659133 (+ 19854us) log.cc:844] Serialized 26 byte log entry
0709 12:26:34.905491 (+246358us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:26:34.905684 (+   193us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:34.905879 (+   195us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:35.865483 (+959604us) spinlock_profiling.cc:243] Waited 1.47 ms on lock 0x7b4400022b4c. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7591c23db1 00007f7591cc1c85 00007f7591cc26a2 00007f7594a341db 00007f7594a2faaf 00007f7594a2386e 00007f7594a22bb6 00007f7594a227d8 00007f7594a2c221 00007f7594a2c1d9 00007f7594a2c169
0709 12:26:36.083136 (+217653us) raft_consensus.cc:1685] finished
0709 12:26:36.083179 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:36.099647 (+ 16468us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2585,"raft.queue_time_us":27861,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":24583,"spinlock_wait_cycles":3385088,"thread_start_us":153026,"threads_started":1,"wal-append.queue_time_us":270240}
I20260709 12:26:36.190653 10921 raft_consensus.cc:2468] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 10.
I20260709 12:26:36.097163 15594 consensus_queue.cc:1059] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.105s
I20260709 12:26:36.091358 15525 raft_consensus.cc:493] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:36.201551 10921 raft_consensus.cc:1240] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Rejecting Update request from peer 3c52e0825c02476e89d84da9bb849f5d for earlier term 5. Current term is 6. Ops: []
I20260709 12:26:36.145913 15425 consensus_queue.cc:1048] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.069s
I20260709 12:26:36.106905 15473 raft_consensus.cc:2749] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:26:36.088871 15216 raft_consensus.cc:515] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:36.223151 15525 raft_consensus.cc:3060] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:36.167285 15465 consensus_queue.cc:1048] T e8b17195a94142039c40f598ed006c94 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
W20260709 12:26:36.234246 15527 consensus_meta.cc:287] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08: Time spent flushing consensus metadata: real 0.961s	user 0.013s	sys 0.003s
I20260709 12:26:36.266099 10997 raft_consensus.cc:2468] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 12.
W20260709 12:26:36.269001 15588 log.cc:927] Time spent T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 12:26:36.269577 15591 raft_consensus.cc:2804] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:26:36.269761 15592 raft_consensus.cc:493] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:36.270139 15591 raft_consensus.cc:493] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:36.270635 15591 raft_consensus.cc:3060] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:36.270463 15592 raft_consensus.cc:515] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:36.271042 15603 consensus_queue.cc:1059] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:26:36.271798 15589 log.cc:927] Time spent T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d: Append to log took a long time: real 0.342s	user 0.000s	sys 0.002s
I20260709 12:26:36.273733 10922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50036 (request call id 946) took 1013 ms. Trace:
I20260709 12:26:36.274269 10922 rpcz_store.cc:276] 0709 12:26:35.260633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:35.459458 (+198825us) service_pool.cc:224] Handling call
0709 12:26:35.459849 (+   391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:35.460281 (+   432us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:35.460313 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:35.460815 (+   502us) log.cc:844] Serialized 26 byte log entry
0709 12:26:35.730444 (+269629us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:26:35.730505 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:35.730617 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:36.273400 (+542783us) raft_consensus.cc:1685] finished
0709 12:26:36.273445 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:36.273649 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":338,"raft.run_cpu_time_us":59,"raft.run_wall_time_us":59,"thread_start_us":269149,"threads_started":1,"wal-append.queue_time_us":470215}
I20260709 12:26:36.243474 15473 raft_consensus.cc:3055] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:26:36.288636 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 333072us
I20260709 12:26:36.277989 15603 raft_consensus.cc:493] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:36.295629 15603 raft_consensus.cc:515] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:36.296761 15595 log.cc:927] Time spent T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 12:26:36.298226 15612 consensus_queue.cc:1059] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:26:36.299033 10820 leader_election.cc:304] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:36.300024 10820 leader_election.cc:304] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:26:36.281489 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 555388us
I20260709 12:26:36.309875 10922 raft_consensus.cc:1240] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:26:36.288833 15473 raft_consensus.cc:740] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:36.339860 15456 leader_election.cc:290] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:36.340854 10922 raft_consensus.cc:1275] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:26:36.290591 15597 raft_consensus.cc:493] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:36.303333 11588 leader_election.cc:304] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
W20260709 12:26:36.349951 10969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:36.352427 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b17195a94142039c40f598ed006c94" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:36.355615 11616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:36.357002 11621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:36.359724 11621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef3220c51df47db8859f07ab745fad5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:36.359841 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18294423a68a4671bf6c5a0f98645e4c" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
W20260709 12:26:36.357088 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 53862us
I20260709 12:26:36.362629 11616 raft_consensus.cc:1240] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 9. Current term is 10. Ops: []
I20260709 12:26:36.363982 10969 leader_election.cc:304] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:36.371234 11588 leader_election.cc:304] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:36.385195 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:36.370882 15456 raft_consensus.cc:2749] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:26:36.393198 10996 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.000s	sys 0.016s
W20260709 12:26:36.404142 10996 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.000s	sys 0.016s
I20260709 12:26:36.356528 15597 raft_consensus.cc:515] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:36.387699 15612 raft_consensus.cc:2749] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:36.390132 15461 leader_election.cc:290] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:36.390628 15515 leader_election.cc:290] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 11 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:26:36.418402 10969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:36.403937 15586 log.cc:927] Time spent T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d: Append to log took a long time: real 0.288s	user 0.000s	sys 0.001s
W20260709 12:26:36.421922 15607 log.cc:927] Time spent T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
I20260709 12:26:36.410753 15326 raft_consensus.cc:2804] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:26:36.404938 15610 raft_consensus.cc:3055] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:36.408098 15620 raft_consensus.cc:3055] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:26:36.421931 11619 raft_consensus.cc:1275] T e9331e5342644ca2bae19187b083a7d5 P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:26:36.436154 15326 raft_consensus.cc:493] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:36.389441 15614 consensus_queue.cc:1059] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.149s
I20260709 12:26:36.386096 15473 consensus_queue.cc:260] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:36.439230 15610 raft_consensus.cc:740] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
I20260709 12:26:36.442150 15620 raft_consensus.cc:740] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:36.443707 15216 leader_election.cc:290] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:36.449718 15455 raft_consensus.cc:2749] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:26:36.474362 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 74957.7us
I20260709 12:26:36.456151 15326 raft_consensus.cc:3060] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:26:36.472779 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 172818us
W20260709 12:26:36.480351 10817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:36.447600 15515 consensus_queue.cc:1059] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:26:36.475370 11588 leader_election.cc:304] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:36.469348 15473 raft_consensus.cc:3060] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:26:36.496035 10818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:36.444433 15616 consensus_queue.cc:1048] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 12:26:36.474124 15594 raft_consensus.cc:2749] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:26:36.499902 10820 leader_election.cc:304] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:36.512480 15608 consensus_queue.cc:1059] T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:26:36.513983 15619 raft_consensus.cc:3055] T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:26:36.514406 15619 raft_consensus.cc:740] T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
I20260709 12:26:36.515395 15619 consensus_queue.cc:260] T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:36.516165 15455 consensus_queue.cc:1048] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:26:36.516333 15603 leader_election.cc:290] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:36.517176 15603 consensus_queue.cc:1048] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:26:36.522320 15627 raft_consensus.cc:2804] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:36.523141 15627 raft_consensus.cc:697] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 6 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:36.524319 15627 consensus_queue.cc:237] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:36.525849 10929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50036 (request call id 948) took 1202 ms. Trace:
I20260709 12:26:36.526728 10929 rpcz_store.cc:276] 0709 12:26:35.323730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:35.985929 (+662199us) service_pool.cc:224] Handling call
0709 12:26:36.050064 (+ 64135us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:36.075372 (+ 25308us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:36.075416 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:36.095625 (+ 20209us) log.cc:844] Serialized 26 byte log entry
0709 12:26:36.392703 (+297078us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:26:36.392746 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:36.392893 (+   147us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:36.525531 (+132638us) raft_consensus.cc:1685] finished
0709 12:26:36.525560 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:36.525752 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4211,"raft.queue_time_us":8934,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":13755,"thread_start_us":196397,"threads_started":1,"wal-append.queue_time_us":293456}
I20260709 12:26:36.528668 10928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50036 (request call id 947) took 1261 ms. Trace:
I20260709 12:26:36.529181 10928 rpcz_store.cc:276] 0709 12:26:35.267096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:35.830810 (+563714us) service_pool.cc:224] Handling call
0709 12:26:35.831189 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:36.358675 (+527486us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:36.358710 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:36.365625 (+  6915us) log.cc:844] Serialized 26 byte log entry
0709 12:26:36.492488 (+126863us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:26:36.492544 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:36.492647 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:36.528399 (+ 35752us) raft_consensus.cc:1685] finished
0709 12:26:36.528426 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:36.528597 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58577,"raft.queue_time_us":103193,"raft.run_cpu_time_us":293,"raft.run_wall_time_us":27333,"thread_start_us":563244,"threads_started":2,"wal-append.queue_time_us":143870}
I20260709 12:26:36.518872 15603 raft_consensus.cc:493] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:36.510066 15593 log.cc:927] Time spent T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d: Append to log took a long time: real 0.173s	user 0.003s	sys 0.000s
I20260709 12:26:36.505210 15461 raft_consensus.cc:2804] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:26:36.520682 15592 leader_election.cc:290] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:36.534085 15515 consensus_queue.cc:1243] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer edcc56ddd3264984b4da6c1db59e7f08 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 12:26:36.560827 15598 log.cc:927] Time spent T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
W20260709 12:26:36.568536 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 68996.7us
I20260709 12:26:36.569483 10820 leader_election.cc:304] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
W20260709 12:26:36.568876 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 48718.8us
I20260709 12:26:36.571038 10820 leader_election.cc:304] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:36.572474 10851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56394 (request call id 4078) took 1271 ms. Trace:
I20260709 12:26:36.572887 10851 rpcz_store.cc:276] 0709 12:26:35.301049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:35.626800 (+325751us) service_pool.cc:224] Handling call
0709 12:26:35.627780 (+   980us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:35.766388 (+138608us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:35.766409 (+    21us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:35.797429 (+ 31020us) log.cc:844] Serialized 26 byte log entry
0709 12:26:36.094188 (+296759us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:26:36.094233 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:36.094300 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:36.572251 (+477951us) raft_consensus.cc:1685] finished
0709 12:26:36.572271 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:36.572402 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":33695,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":170,"thread_start_us":329071,"threads_started":2,"wal-append.queue_time_us":548237}
I20260709 12:26:36.577230 10820 leader_election.cc:304] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:36.540804 15615 consensus_queue.cc:1048] T e8b17195a94142039c40f598ed006c94 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:26:36.551251 15603 raft_consensus.cc:515] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:36.570475 15592 raft_consensus.cc:2749] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:26:36.569504 15461 raft_consensus.cc:697] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d [term 10 LEADER]: Becoming Leader. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
I20260709 12:26:36.588069 15632 raft_consensus.cc:2749] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:36.571880 15597 leader_election.cc:290] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:36.603178 10820 leader_election.cc:304] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:36.496927 15620 consensus_queue.cc:260] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:36.616897 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 47900.2us
I20260709 12:26:36.618386 10845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46480 (request call id 795) took 1303 ms. Trace:
W20260709 12:26:36.599328 15585 consensus_meta.cc:287] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d: Time spent flushing consensus metadata: real 0.765s	user 0.007s	sys 0.006s
I20260709 12:26:36.619052 10845 rpcz_store.cc:276] 0709 12:26:35.314512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:35.825203 (+510691us) service_pool.cc:224] Handling call
0709 12:26:35.825634 (+   431us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:35.826080 (+   446us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:35.826114 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:35.826906 (+   792us) log.cc:844] Serialized 26 byte log entry
0709 12:26:36.038402 (+211496us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:26:36.038614 (+   212us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:36.038793 (+   179us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:36.617961 (+579168us) raft_consensus.cc:1685] finished
0709 12:26:36.617991 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:36.618296 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27432,"raft.queue_time_us":20425,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":20610,"thread_start_us":210955,"threads_started":1,"wal-append.queue_time_us":577300}
I20260709 12:26:36.599009 15591 raft_consensus.cc:515] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:36.612112 15634 raft_consensus.cc:2749] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:36.558851 15610 consensus_queue.cc:260] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:36.642999 10818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:36.638823 15632 raft_consensus.cc:2749] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:26:36.640131 15620 raft_consensus.cc:3060] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:36.650458 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
W20260709 12:26:36.653641 15611 log.cc:927] Time spent T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.153s	user 0.000s	sys 0.002s
I20260709 12:26:36.654017 15610 raft_consensus.cc:3060] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:36.655176 10926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59626 (request call id 3598) took 1357 ms. Trace:
I20260709 12:26:36.656504 15591 leader_election.cc:290] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:26:36.657423 15626 log.cc:927] Time spent T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.082s	user 0.000s	sys 0.002s
I20260709 12:26:36.653287 15603 leader_election.cc:290] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:36.660171 15606 consensus_queue.cc:1059] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:26:36.661978 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 546283us
I20260709 12:26:36.661574 15627 raft_consensus.cc:493] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:36.662875 15627 raft_consensus.cc:515] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:36.663743 15594 consensus_queue.cc:1059] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:26:36.664867 15594 consensus_queue.cc:1059] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:26:36.665227 15510 raft_consensus.cc:493] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:36.665825 15606 raft_consensus.cc:3055] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:26:36.665135 15627 leader_election.cc:290] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:36.666101 15515 raft_consensus.cc:3055] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:26:36.666000 15510 raft_consensus.cc:515] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:36.666710 15515 raft_consensus.cc:740] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:36.667089 15606 raft_consensus.cc:740] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:36.667675 15515 consensus_queue.cc:260] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 10.12, Last appended by leader: 12, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:36.668342 15606 consensus_queue.cc:260] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:36.669288 10923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59626 (request call id 3599) took 1371 ms. Trace:
I20260709 12:26:36.669709 15449 raft_consensus.cc:493] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:36.670238 15449 raft_consensus.cc:515] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } }
I20260709 12:26:36.674037 15248 consensus_queue.cc:1048] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:26:36.675318 10921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59622 (request call id 3128) took 1212 ms. Trace:
W20260709 12:26:36.646068 15614 consensus_queue.cc:1175] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" responder_term: 4 status { last_received { term: 4 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 4 index: 7 } }
I20260709 12:26:36.669687 10923 rpcz_store.cc:276] 0709 12:26:35.298012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:35.874317 (+576305us) service_pool.cc:224] Handling call
0709 12:26:35.874695 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:35.874995 (+   300us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:26:35.961363 (+ 86368us) log.cc:844] Serialized 14 byte log entry
0709 12:26:36.668943 (+707580us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:36.669001 (+    58us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:26:36.669048 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:36.669108 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:36.669229 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":583847,"prepare.queue_time_us":106482,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":8937,"raft.queue_time_us":554964,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":112,"thread_start_us":157771,"threads_started":1,"wal-append.queue_time_us":281017}
I20260709 12:26:36.651340 10924 raft_consensus.cc:3060] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:36.676604 15461 consensus_queue.cc:237] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:36.680022 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:36.675706 10921 rpcz_store.cc:276] 0709 12:26:35.463086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:36.218811 (+755725us) service_pool.cc:224] Handling call
0709 12:26:36.219152 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:36.219405 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:26:36.250503 (+ 31098us) log.cc:844] Serialized 14 byte log entry
0709 12:26:36.674955 (+424452us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:36.675006 (+    51us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:26:36.675063 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:36.675141 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:36.675260 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":320786,"prepare.queue_time_us":40688,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":61,"raft.queue_time_us":321392,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":113,"thread_start_us":65293,"threads_started":1,"wal-append.queue_time_us":212737}
I20260709 12:26:36.686609 15449 leader_election.cc:290] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265)
I20260709 12:26:36.687505 15510 leader_election.cc:290] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:36.687871 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac83709373b4efd9c3aa1472a9f9022" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:36.669646 15606 raft_consensus.cc:3060] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:36.688722 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:36.689307 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:26:36.661603 15516 consensus_meta.cc:287] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08: Time spent flushing consensus metadata: real 1.135s	user 0.005s	sys 0.010s
I20260709 12:26:36.690992 10923 raft_consensus.cc:1240] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 5. Current term is 6. Ops: []
I20260709 12:26:36.686123 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
W20260709 12:26:36.676111 15163 consensus_meta.cc:287] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040: Time spent flushing consensus metadata: real 0.810s	user 0.012s	sys 0.003s
I20260709 12:26:36.696210 15163 raft_consensus.cc:515] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:36.700263 15163 leader_election.cc:290] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 13 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:36.700629 15471 consensus_queue.cc:1059] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:26:36.701795 15323 consensus_queue.cc:1048] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:26:36.624763 15585 raft_consensus.cc:515] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:36.704248 15471 raft_consensus.cc:3055] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:26:36.702430 10968 connection.cc:256] RPC call timeout handler was delayed by -1.0334943389998443s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15300000000000002s for a response
W20260709 12:26:36.709352 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 45852.6us
I20260709 12:26:36.685994 10926 rpcz_store.cc:276] 0709 12:26:35.297524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:35.867639 (+570115us) service_pool.cc:224] Handling call
0709 12:26:35.867919 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:35.868114 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:26:35.909454 (+ 41340us) log.cc:844] Serialized 14 byte log entry
0709 12:26:36.103917 (+194463us) log.cc:844] Serialized 14 byte log entry
0709 12:26:36.654643 (+550726us) spinlock_profiling.cc:243] Waited 4.07 ms on lock 0x7b180034a800. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f759ac63ab1 00007f759ac70281 00007f7591d15c0a 00007f759b455219 00007f7591d9da40 00007f7591d984e4 00007f7591d98455 00007f7594e80060 00007f7594e92716 00007f7594ea3287 00007f7594ea3208
0709 12:26:36.654818 (+   175us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:36.654867 (+    49us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:26:36.654925 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:36.654993 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:36.655113 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":537291,"prepare.queue_time_us":106705,"prepare.run_cpu_time_us":147,"prepare.run_wall_time_us":10231,"raft.queue_time_us":622393,"raft.run_cpu_time_us":348,"raft.run_wall_time_us":18257,"spinlock_wait_cycles":9370880,"thread_start_us":193826,"threads_started":1,"wal-append.queue_time_us":562626}
I20260709 12:26:36.675051 15326 raft_consensus.cc:515] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:36.710409 10923 raft_consensus.cc:1240] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 9. Current term is 10. Ops: []
I20260709 12:26:36.704747 15471 raft_consensus.cc:740] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:26:36.711987 15478 leader_election.cc:290] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:36.712626 11623 raft_consensus.cc:1240] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 6. Current term is 7. Ops: []
I20260709 12:26:36.737629 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:36.713626 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:36.714021 10968 leader_election.cc:304] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:36.720345 15323 raft_consensus.cc:493] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:36.710660 10819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:36.730968 11618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aed74af73a488f8b691578ca370226" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:36.736958 10895 leader_election.cc:304] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
W20260709 12:26:36.745021 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 170590us
I20260709 12:26:36.720247 10924 raft_consensus.cc:2468] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 10.
W20260709 12:26:36.756565 10924 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59626 (request call id 3591) took 1659 ms (client timeout 1574 ms). Trace:
I20260709 12:26:36.757575 11617 raft_consensus.cc:1240] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 6. Current term is 7. Ops: []
I20260709 12:26:36.755134 10895 leader_election.cc:304] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:36.704769 15585 leader_election.cc:290] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 12 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:26:36.751631 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 87812.4us
I20260709 12:26:36.720503 15456 raft_consensus.cc:493] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:36.736740 15523 raft_consensus.cc:493] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:36.760954 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
W20260709 12:26:36.756923 10924 rpcz_store.cc:269] 0709 12:26:35.096834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:35.097481 (+   647us) service_pool.cc:224] Handling call
0709 12:26:36.650226 (+1552745us) spinlock_profiling.cc:243] Waited 19.5 ms on lock 0x7b5800002d98. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7591c23db1 00007f7591d63b71 00007f7591d63a22 00007f759ac7c8d9 00007f7599dd6ee0 00007f7599ea00ab 00007f7599ea0131 00007f7599e4e0a0 00007f7599e4d984 00007f75933c86d4 00007f75933c8662
0709 12:26:36.756493 (+106267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44755840}
I20260709 12:26:36.761984 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:36.762872 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:36.749774 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:36.764508 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:36.775477 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:36.776213 10847 raft_consensus.cc:2468] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 3.
I20260709 12:26:36.765081 15601 raft_consensus.cc:2804] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:26:36.777977 15471 consensus_queue.cc:260] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:36.758816 15467 consensus_queue.cc:1048] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 12:26:36.782104 11618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45904 (request call id 944) took 1033 ms. Trace:
I20260709 12:26:36.782624 11618 rpcz_store.cc:276] 0709 12:26:35.749090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:35.763120 (+ 14030us) service_pool.cc:224] Handling call
0709 12:26:36.730622 (+967502us) spinlock_profiling.cc:243] Waited 5.83 ms on lock 0x7b5800160898. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7591c23db1 00007f7591d63b71 00007f7591d63a22 00007f759ac7c8d9 00007f7599dd6ee0 00007f7599ea00ab 00007f7599ea0131 00007f7599e4e0a0 00007f7599e4d984 00007f75933c86d4 00007f75933c8662
0709 12:26:36.782010 (+ 51388us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13408512}
I20260709 12:26:36.785439 15605 consensus_queue.cc:1048] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:36.786305 15621 consensus_queue.cc:1048] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:26:36.755642 15323 raft_consensus.cc:515] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:36.771214 15568 raft_consensus.cc:2804] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:26:36.788008 15568 raft_consensus.cc:493] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:36.788257 15454 raft_consensus.cc:3060] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:36.788398 15568 raft_consensus.cc:3060] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:36.789490 15323 leader_election.cc:290] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:36.790750 15455 raft_consensus.cc:3055] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:36.791139 15455 raft_consensus.cc:740] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:36.772069 10853 raft_consensus.cc:2468] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 9.
I20260709 12:26:36.766640 10895 leader_election.cc:304] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:36.796222 10895 leader_election.cc:304] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:36.767361 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63ecfc9bd3945818cfe15c03f001315" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:36.767427 10854 raft_consensus.cc:1275] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:26:36.768306 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
W20260709 12:26:36.759414 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 45503.3us
I20260709 12:26:36.799439 10968 leader_election.cc:304] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d
I20260709 12:26:36.770408 10852 raft_consensus.cc:1275] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
W20260709 12:26:36.804816 10968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:36.805524 10895 leader_election.cc:304] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:36.806002 10968 leader_election.cc:304] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:36.806735 10895 leader_election.cc:304] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:36.810876 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:36.793057 15456 raft_consensus.cc:515] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } }
I20260709 12:26:36.792541 15455 consensus_queue.cc:260] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:36.822197 15456 leader_election.cc:290] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265)
I20260709 12:26:36.822683 15326 leader_election.cc:290] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 7 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:36.821333 15455 raft_consensus.cc:3060] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:36.769471 15478 raft_consensus.cc:2749] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:26:36.830287 10818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:36.824007 15323 raft_consensus.cc:2804] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:36.835191 11618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:36.839203 15323 raft_consensus.cc:493] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:36.839710 15323 raft_consensus.cc:3060] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:36.846148 11620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45920 (request call id 861) took 2987 ms. Trace:
W20260709 12:26:36.848598 11588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:36.846894 11620 rpcz_store.cc:276] 0709 12:26:33.858707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:33.858895 (+   188us) service_pool.cc:224] Handling call
0709 12:26:33.898093 (+ 39198us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:35.368736 (+1470643us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:36.845668 (+1476932us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b54005ebad4. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e88e01 00007f7594e8783e 00007f7599e4c419 00007f75933c3bd4 00007f75933c3b62 00007f75933c3a91 00007f75933c3a0c 00007f75933c2cc2 00007f75931c348c 00007f75931c28c6
0709 12:26:36.845942 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3373706624}
I20260709 12:26:36.818810 15471 raft_consensus.cc:3060] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:36.817754 15248 raft_consensus.cc:2749] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:26:36.769629 15516 consensus_queue.cc:1059] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 12:26:36.874577 11620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
W20260709 12:26:36.846897 15525 consensus_meta.cc:287] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040: Time spent flushing consensus metadata: real 0.572s	user 0.010s	sys 0.000s
W20260709 12:26:36.864929 10895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:36.875727 11620 raft_consensus.cc:2468] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 9.
I20260709 12:26:36.885103 11620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:36.803530 15523 raft_consensus.cc:515] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:36.905851 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9331e5342644ca2bae19187b083a7d5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:36.907451 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
W20260709 12:26:36.908614 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 53662.8us
I20260709 12:26:36.808661 15467 consensus_queue.cc:1059] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:26:36.837491 15456 raft_consensus.cc:2749] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:26:36.858479 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 86677.8us
W20260709 12:26:36.906019 10968 leader_election.cc:336] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Timed out: RequestConsensusVote RPC to 127.9.116.65:46265 timed out after 1.644s (SENT)
I20260709 12:26:36.834933 15643 raft_consensus.cc:2749] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:26:36.856910 15621 raft_consensus.cc:2804] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:36.923224 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:36.908957 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:36.803352 15473 consensus_queue.cc:1059] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 12:26:36.855075 15163 raft_consensus.cc:493] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:36.911517 10968 leader_election.cc:304] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:36.886080 11620 raft_consensus.cc:2393] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 4: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:26:36.917472 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:36.929507 11001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57514 (request call id 1193) took 1672 ms. Trace:
I20260709 12:26:36.931634 10852 raft_consensus.cc:2410] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:26:36.902902 11618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:36.929229 10853 raft_consensus.cc:2393] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 12: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:26:36.931813 11001 rpcz_store.cc:276] 0709 12:26:35.257497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:35.654444 (+396947us) service_pool.cc:224] Handling call
0709 12:26:35.654889 (+   445us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:35.894033 (+239144us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:35.894075 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:35.894130 (+    55us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:26:35.894188 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:36.929293 (+1035105us) spinlock_profiling.cc:243] Waited 239 ms on lock 0x7b54002d3f54. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e88e01 00007f7594e8783e 00007f7599e4c419 00007f75933c3bd4 00007f75933c3b62 00007f75933c3a91 00007f75933c3a0c 00007f75933c2cc2 00007f75931c348c 00007f75931c28c6
0709 12:26:36.929339 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:36.929447 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":549335424}
I20260709 12:26:36.934726 10845 raft_consensus.cc:1240] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
W20260709 12:26:36.934700 10968 leader_election.cc:336] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Timed out: RequestConsensusVote RPC to 127.9.116.65:46265 timed out after 1.706s (SENT)
I20260709 12:26:36.933621 11620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:36.938629 11620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
W20260709 12:26:36.941197 15576 log.cc:927] Time spent T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 1.430s	user 0.001s	sys 0.007s
I20260709 12:26:36.943683 11622 raft_consensus.cc:1240] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [term 13 LEADER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:26:36.947706 11620 raft_consensus.cc:2468] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 5.
I20260709 12:26:36.950145 10854 raft_consensus.cc:2468] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 13.
I20260709 12:26:36.950310 15515 raft_consensus.cc:3060] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:36.951732 15516 raft_consensus.cc:2749] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:36.952627 15616 raft_consensus.cc:493] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:36.953243 15616 raft_consensus.cc:515] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:36.910465 15591 raft_consensus.cc:493] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:36.937666 10968 leader_election.cc:304] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:36.973706 10850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56394 (request call id 4069) took 1778 ms. Trace:
I20260709 12:26:36.974323 10850 rpcz_store.cc:276] 0709 12:26:35.195387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:35.195530 (+   143us) service_pool.cc:224] Handling call
0709 12:26:35.197135 (+  1605us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:35.197475 (+   340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:35.197503 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:35.197944 (+   441us) log.cc:844] Serialized 26 byte log entry
0709 12:26:35.441943 (+243999us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:26:35.441981 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:35.442045 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:36.940011 (+1497966us) spinlock_profiling.cc:243] Waited 3.24 ms on lock 0x7b4400022b4c. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7591c23db1 00007f7591cc1c85 00007f7591cc26a2 00007f7594a341db 00007f7594a2faaf 00007f7594a2386e 00007f7594a22bb6 00007f7594a227d8 00007f7594a2c221 00007f7594a2c1d9 00007f7594a2c169
0709 12:26:36.967318 (+ 27307us) raft_consensus.cc:1685] finished
0709 12:26:36.967352 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:36.973612 (+  6260us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1048,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":4206,"spinlock_wait_cycles":7453952,"thread_start_us":243612,"threads_started":1,"wal-append.queue_time_us":229520}
I20260709 12:26:36.978500 10968 leader_election.cc:304] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d
I20260709 12:26:36.981685 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c913e527ff46578e084c41eab7bb9d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:36.982688 10854 raft_consensus.cc:2468] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 6.
W20260709 12:26:36.984047 10968 leader_election.cc:336] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Timed out: RequestConsensusVote RPC to 127.9.116.65:46265 timed out after 2.257s (SENT)
I20260709 12:26:36.984675 10968 leader_election.cc:304] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
W20260709 12:26:36.947750 15587 log.cc:927] Time spent T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 12:26:36.903927 15525 raft_consensus.cc:515] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:37.000958 11588 leader_election.cc:304] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040; no voters: 
I20260709 12:26:36.925597 15609 consensus_queue.cc:1048] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 12:26:37.006474 11588 leader_election.cc:304] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040; no voters: 
I20260709 12:26:36.925159 15601 raft_consensus.cc:697] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 13 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:36.995496 15478 raft_consensus.cc:2804] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:36.933933 15163 raft_consensus.cc:515] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:37.044126 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:36.989889 15456 raft_consensus.cc:2749] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:26:37.046192 15473 raft_consensus.cc:493] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:37.009199 15585 raft_consensus.cc:493] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:37.060369 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:37.062122 10854 raft_consensus.cc:2410] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 12:26:37.047636 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:36.983181 15516 consensus_queue.cc:1059] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 12:26:36.980159 15591 raft_consensus.cc:515] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:37.066150 15059 raft_consensus.cc:2804] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:26:37.049043 15478 raft_consensus.cc:493] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:37.048903 15527 raft_consensus.cc:2749] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:37.082764 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:37.083659 10929 raft_consensus.cc:3060] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:37.077926 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
W20260709 12:26:37.080092 10818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:37.095856 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:37.096226 10853 raft_consensus.cc:1240] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:26:37.106519 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:37.107616 10852 raft_consensus.cc:2468] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 8.
I20260709 12:26:37.108525 15639 raft_consensus.cc:2804] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:37.109018 15639 raft_consensus.cc:493] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:37.109390 15639 raft_consensus.cc:3060] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:37.075202 15059 raft_consensus.cc:493] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:37.082060 15478 raft_consensus.cc:3060] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:37.070376 15612 consensus_queue.cc:1048] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:26:37.084889 15516 raft_consensus.cc:3055] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:26:37.058063 15473 raft_consensus.cc:515] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:37.122211 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 138191us
I20260709 12:26:37.125705 10854 raft_consensus.cc:2410] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:26:37.073925 15585 raft_consensus.cc:515] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:37.119825 15059 raft_consensus.cc:3060] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:37.128546 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
W20260709 12:26:37.135232 10968 leader_election.cc:336] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Timed out: RequestConsensusVote RPC to 127.9.116.65:46265 timed out after 1.530s (SENT)
I20260709 12:26:37.135183 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
W20260709 12:26:37.135856 10817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:37.138054 10820 leader_election.cc:304] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:37.146586 10820 leader_election.cc:304] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:37.146610 10968 leader_election.cc:304] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:37.156684 15603 raft_consensus.cc:2804] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:26:37.157295 15603 raft_consensus.cc:493] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:37.157969 15603 raft_consensus.cc:3060] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:37.158412 10820 leader_election.cc:304] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:37.159287 15474 raft_consensus.cc:3060] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:37.160255 10820 leader_election.cc:304] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:37.165652 10929 raft_consensus.cc:2468] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 7.
I20260709 12:26:37.130455 15516 raft_consensus.cc:740] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:26:37.177367 15220 consensus_queue.cc:260] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:37.098985 15597 consensus_queue.cc:1048] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 12:26:37.187496 15525 leader_election.cc:290] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 14 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:37.143689 15527 raft_consensus.cc:493] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
W20260709 12:26:37.188897 15580 log.cc:927] Time spent T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 1.093s	user 0.005s	sys 0.001s
I20260709 12:26:37.188601 15527 raft_consensus.cc:515] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:37.190992 15527 leader_election.cc:290] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:37.192051 15619 raft_consensus.cc:3060] T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:37.192773 15516 consensus_queue.cc:260] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:37.194244 15516 raft_consensus.cc:3060] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:37.160284 15606 raft_consensus.cc:2749] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:37.199787 11616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d9a61ecaf84695b70f8519ee57706f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
W20260709 12:26:37.200300 15648 log.cc:927] Time spent T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 12:26:37.185456 10852 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
mode: GRACEFUL
new_leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:47358
I20260709 12:26:37.202930 10852 raft_consensus.cc:606] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Received request to transfer leadership to TS e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:37.203333 10852 raft_consensus.cc:614] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:37.204205 15527 raft_consensus.cc:493] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:37.204923 15527 raft_consensus.cc:515] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:37.181335 15220 raft_consensus.cc:3060] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:37.185031 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:37.185000 15446 raft_consensus.cc:2804] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:37.147524 15523 leader_election.cc:290] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:37.182135 15473 leader_election.cc:290] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:37.186128 15163 leader_election.cc:290] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
W20260709 12:26:37.220131 10818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:37.188105 15641 log.cc:927] Time spent T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
W20260709 12:26:37.210036 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 74837.5us
I20260709 12:26:37.213049 10845 raft_consensus.cc:2393] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 8: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
W20260709 12:26:37.222996 10968 leader_election.cc:336] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Timed out: RequestConsensusVote RPC to 127.9.116.65:46265 timed out after 1.851s (SENT)
I20260709 12:26:37.223857 10968 leader_election.cc:304] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:37.216033 10846 raft_consensus.cc:2468] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 5.
I20260709 12:26:37.198211 15603 raft_consensus.cc:515] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:37.128048 15601 consensus_queue.cc:237] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:37.239229 10818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:37.229413 10968 leader_election.cc:336] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Timed out: RequestConsensusVote RPC to 127.9.116.65:46265 timed out after 1.999s (SENT)
I20260709 12:26:37.147965 15323 raft_consensus.cc:515] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:37.217572 15471 raft_consensus.cc:2749] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:37.247366 15585 leader_election.cc:290] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:37.217190 15446 raft_consensus.cc:493] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:37.253206 10845 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
mode: GRACEFUL
new_leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:47358
I20260709 12:26:37.233184 15613 raft_consensus.cc:3055] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:26:37.239765 15523 raft_consensus.cc:2749] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:37.236191 15621 raft_consensus.cc:493] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:37.241567 10968 leader_election.cc:304] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
W20260709 12:26:37.264101 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 352826us
W20260709 12:26:37.267927 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 162108us
I20260709 12:26:37.273618 10929 raft_consensus.cc:1275] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:26:37.276328 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:37.254855 15446 raft_consensus.cc:3060] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:37.278523 11616 raft_consensus.cc:1275] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:26:37.280201 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5794ba618e514e28a7542ab6af39d8c9" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:37.256783 15613 raft_consensus.cc:740] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:37.285624 11588 leader_election.cc:304] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:37.288424 11621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:37.268255 15621 raft_consensus.cc:3060] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:37.288932 15059 raft_consensus.cc:515] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:37.271065 15471 raft_consensus.cc:493] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:37.293087 15617 raft_consensus.cc:3055] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:26:37.297307 15546 consensus_queue.cc:1048] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 12:26:37.291548 15591 leader_election.cc:290] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:37.272634 15568 raft_consensus.cc:515] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:37.299827 15523 raft_consensus.cc:2749] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:37.300012 15326 consensus_queue.cc:1048] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 12:26:37.298079 11615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:37.299903 15617 raft_consensus.cc:740] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
I20260709 12:26:37.300419 15425 raft_consensus.cc:2804] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:26:37.302904 15471 raft_consensus.cc:515] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:37.347513 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:37.348281 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:37.352061 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:37.352737 11000 raft_consensus.cc:3060] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:37.354633 10999 raft_consensus.cc:1275] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:26:37.337522 15425 raft_consensus.cc:697] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [term 7 LEADER]: Becoming Leader. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
I20260709 12:26:37.360059 10998 raft_consensus.cc:1240] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:26:37.365758 11001 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:37496
I20260709 12:26:37.307001 15613 consensus_queue.cc:260] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:37.367498 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5794ba618e514e28a7542ab6af39d8c9" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:37.368937 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:37.370182 10998 raft_consensus.cc:3060] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:37.372093 15425 consensus_queue.cc:237] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:37.373925 15661 raft_consensus.cc:493] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:37.375823 15523 raft_consensus.cc:493] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:37.376363 15523 raft_consensus.cc:515] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:37.379135 15523 leader_election.cc:290] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:37.374477 15661 raft_consensus.cc:515] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:37.376374 15059 leader_election.cc:290] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 10 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:37.375217 11617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:37.382035 11617 raft_consensus.cc:2393] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 10: Already voted for candidate 3c52e0825c02476e89d84da9bb849f5d in this term.
I20260709 12:26:37.380781 15471 leader_election.cc:290] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:37.353803 15478 raft_consensus.cc:515] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:37.389237 10999 raft_consensus.cc:1240] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:26:37.390173 15478 leader_election.cc:290] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:37.391613 15613 raft_consensus.cc:3060] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:37.391639 11619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b17195a94142039c40f598ed006c94" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:37.394558 15446 raft_consensus.cc:515] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:37.350374 15516 raft_consensus.cc:493] T d0aed74af73a488f8b691578ca370226 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:37.395767 15523 raft_consensus.cc:493] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:37.396281 10848 raft_consensus.cc:3060] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:37.396414 15523 raft_consensus.cc:515] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:37.396823 15323 leader_election.cc:290] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:37.395924 15516 raft_consensus.cc:515] T d0aed74af73a488f8b691578ca370226 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:37.402035 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:37.402894 10995 raft_consensus.cc:3060] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:37.406685 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac83709373b4efd9c3aa1472a9f9022" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:37.407747 11002 raft_consensus.cc:2468] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 6.
I20260709 12:26:37.365089 15603 leader_election.cc:290] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 10 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:37.410034 11619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:37.411688 15639 raft_consensus.cc:515] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:37.413998 15639 leader_election.cc:290] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 5 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:37.414180 11619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:37.370090 15527 leader_election.cc:290] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:37.414877 11619 raft_consensus.cc:3060] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:37.415177 15474 raft_consensus.cc:2749] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:37.415534 10848 raft_consensus.cc:2468] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 12.
I20260709 12:26:37.417119 11001 raft_consensus.cc:606] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Received request to transfer leadership
I20260709 12:26:37.422667 11001 raft_consensus.cc:614] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:37.426617 11000 raft_consensus.cc:2468] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 10.
I20260709 12:26:37.427886 15527 raft_consensus.cc:493] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:37.429020 10999 raft_consensus.cc:1240] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 9. Current term is 10. Ops: []
I20260709 12:26:37.429530 15323 raft_consensus.cc:493] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:37.430122 15323 raft_consensus.cc:515] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:37.431043 15478 raft_consensus.cc:493] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:37.431706 15478 raft_consensus.cc:515] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:37.428660 15527 raft_consensus.cc:515] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:37.451939 15478 leader_election.cc:290] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:37.453147 15527 leader_election.cc:290] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:37.451380 15323 leader_election.cc:290] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:37.454579 15621 raft_consensus.cc:515] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:37.415934 15446 leader_election.cc:290] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:37.461769 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:37.468535 10998 raft_consensus.cc:2468] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 8.
W20260709 12:26:37.470099 15335 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.020s	user 0.009s	sys 0.019s
W20260709 12:26:37.470640 15335 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.020s	user 0.009s	sys 0.019s
I20260709 12:26:37.472606 10923 raft_consensus.cc:1240] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 13 LEADER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 12. Current term is 13. Ops: []
I20260709 12:26:37.473034 10995 raft_consensus.cc:2468] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 11.
I20260709 12:26:37.422785 15661 leader_election.cc:290] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:37.432698 15660 raft_consensus.cc:493] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:37.504015 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:37.504045 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:37.508610 10995 raft_consensus.cc:2468] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 12.
I20260709 12:26:37.511049 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:37.513576 15456 raft_consensus.cc:493] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:37.520330 11003 raft_consensus.cc:1240] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 7. Current term is 8. Ops: []
I20260709 12:26:37.520534 11000 raft_consensus.cc:1240] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 13 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:26:37.519035 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:37.525665 10996 raft_consensus.cc:2468] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 12.
I20260709 12:26:37.515960 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:37.526942 10995 raft_consensus.cc:2468] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 10.
I20260709 12:26:37.518851 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:37.530779 10995 raft_consensus.cc:1240] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 10. Current term is 11. Ops: []
I20260709 12:26:37.517323 15527 raft_consensus.cc:493] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:37.521394 15669 raft_consensus.cc:493] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:37.518590 15568 leader_election.cc:290] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 10 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:37.491791 15660 raft_consensus.cc:515] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:37.535823 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5794ba618e514e28a7542ab6af39d8c9" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:37.541769 10995 raft_consensus.cc:2468] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 4.
I20260709 12:26:37.542723 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:37.543694 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:37.545603 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aed74af73a488f8b691578ca370226" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:37.549503 11003 raft_consensus.cc:2468] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 11.
I20260709 12:26:37.541381 15446 raft_consensus.cc:493] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:37.551487 15446 raft_consensus.cc:515] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:37.555475 15446 leader_election.cc:290] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:37.556428 15621 leader_election.cc:290] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:37.557469 15323 raft_consensus.cc:493] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:37.559504 15323 raft_consensus.cc:515] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:37.565897 11003 raft_consensus.cc:1240] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Rejecting Update request from peer 3c52e0825c02476e89d84da9bb849f5d for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 12:26:37.569327 10845 raft_consensus.cc:606] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Received request to transfer leadership to TS e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:37.569859 10845 raft_consensus.cc:614] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:37.576745 10994 raft_consensus.cc:1275] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:26:37.579136 10994 raft_consensus.cc:1275] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 13 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:26:37.521890 15456 raft_consensus.cc:515] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:37.535669 11619 raft_consensus.cc:2468] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 6.
I20260709 12:26:37.583329 15456 leader_election.cc:290] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
W20260709 12:26:37.584905 15676 log.cc:927] Time spent T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:26:37.538650 15527 raft_consensus.cc:515] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:37.588407 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:37.543704 15516 leader_election.cc:290] T d0aed74af73a488f8b691578ca370226 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:37.590222 11619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:37.542311 15669 raft_consensus.cc:515] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:37.593715 10996 raft_consensus.cc:1275] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:26:37.594931 10998 raft_consensus.cc:2468] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 10.
I20260709 12:26:37.596235 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63ecfc9bd3945818cfe15c03f001315" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:37.599337 11003 raft_consensus.cc:1275] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 12:26:37.559522 15600 log.cc:927] Time spent T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 1.166s	user 0.000s	sys 0.004s
I20260709 12:26:37.601999 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
W20260709 12:26:37.604894 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 375498us
I20260709 12:26:37.609133 15669 leader_election.cc:290] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
W20260709 12:26:37.612990 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:37.612892 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:37.616910 10968 leader_election.cc:304] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:37.617692 11003 raft_consensus.cc:2410] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3c52e0825c02476e89d84da9bb849f5d for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:26:37.617951 15616 leader_election.cc:290] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:37.618854 15669 raft_consensus.cc:2804] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:26:37.619287 15669 raft_consensus.cc:493] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:37.619728 15669 raft_consensus.cc:3060] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:37.621301 10920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59626 (request call id 3595) took 2500 ms. Trace:
I20260709 12:26:37.623307 10968 leader_election.cc:304] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:37.621997 10920 rpcz_store.cc:276] 0709 12:26:35.120630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:35.200830 (+ 80200us) service_pool.cc:224] Handling call
0709 12:26:35.212590 (+ 11760us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:35.238451 (+ 25861us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:35.238483 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:35.239063 (+   580us) log.cc:844] Serialized 26 byte log entry
0709 12:26:35.835156 (+596093us) spinlock_profiling.cc:243] Waited 7.47 ms on lock 0x7b18002996e0. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f759ac63ab1 00007f759ac70281 00007f7591d7de07 00007f759abd89a9 00007f7591d9a69b 00007f7591d9893f 00007f7591d9ac02 00007f7594a2220b 00007f7594a27d23 00007f7594a280d1 00007f7594e43a0f
0709 12:26:36.101408 (+266252us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:26:36.101451 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:36.101537 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:37.558707 (+1457170us) spinlock_profiling.cc:243] Waited 3.61 ms on lock 0x7b4400022b4c. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7591c23db1 00007f7591cc1c85 00007f7591cc26a2 00007f7594a341db 00007f7594a2faaf 00007f7594a2386e 00007f7594a22bb6 00007f7594a227d8 00007f7594a2c221 00007f7594a2c1d9 00007f7594a2c169
0709 12:26:37.621070 (+ 62363us) raft_consensus.cc:1685] finished
0709 12:26:37.621097 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:37.621221 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8719,"raft.queue_time_us":8861,"raft.run_cpu_time_us":266,"raft.run_wall_time_us":4368,"spinlock_wait_cycles":25494144,"thread_start_us":266045,"threads_started":1,"wal-append.queue_time_us":1104823}
W20260709 12:26:37.624430 10817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:37.606608 15613 raft_consensus.cc:493] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:37.626600 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab816bcc6183447994a2cc013e46c5f8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:37.626809 10968 leader_election.cc:304] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:37.612371 15516 raft_consensus.cc:493] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:37.630971 10968 leader_election.cc:304] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d
I20260709 12:26:37.627615 15456 raft_consensus.cc:3060] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:37.634027 10968 leader_election.cc:304] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:37.626878 15523 leader_election.cc:290] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:37.628512 15323 leader_election.cc:290] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:26:37.641333 10818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:37.648137 10818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:37.648720 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5794ba618e514e28a7542ab6af39d8c9" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:37.649495 10854 raft_consensus.cc:2468] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 4.
I20260709 12:26:37.650172 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:37.651083 10849 raft_consensus.cc:2468] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 12.
I20260709 12:26:37.630733 15671 raft_consensus.cc:2749] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:26:37.653905 10818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:37.654979 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad766f48812a4ddeb383179b1d84907b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:37.655716 10854 raft_consensus.cc:2468] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 6.
I20260709 12:26:37.656754 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:37.658394 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab816bcc6183447994a2cc013e46c5f8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:37.631876 11619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:37.656121 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:37.634757 15478 raft_consensus.cc:2804] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:26:37.662364 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63ecfc9bd3945818cfe15c03f001315" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:37.657284 10854 raft_consensus.cc:2468] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 10.
I20260709 12:26:37.664294 10853 raft_consensus.cc:2468] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 13.
I20260709 12:26:37.661882 15616 raft_consensus.cc:493] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:37.667198 15616 raft_consensus.cc:515] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:37.669494 15616 leader_election.cc:290] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:37.670691 15220 raft_consensus.cc:493] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:37.671293 15220 raft_consensus.cc:515] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:37.672215 10819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:37.653376 15471 raft_consensus.cc:2749] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:37.674906 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:37.675874 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:37.676683 10847 raft_consensus.cc:2393] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 7: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:26:37.684703 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:37.689622 10968 leader_election.cc:304] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d
I20260709 12:26:37.690354 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac8522e549a46e09593fa4c2e175557" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:37.694698 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:37.685956 15478 raft_consensus.cc:493] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:37.695830 15478 raft_consensus.cc:3060] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:37.696908 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac8522e549a46e09593fa4c2e175557" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:37.697332 10853 raft_consensus.cc:1240] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 9. Current term is 10. Ops: []
I20260709 12:26:37.699018 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:37.699654 15471 raft_consensus.cc:2804] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:37.699738 10849 raft_consensus.cc:2468] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 11.
I20260709 12:26:37.700286 15471 raft_consensus.cc:493] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:37.700817 15471 raft_consensus.cc:3060] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:37.701092 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:37.702096 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:37.702914 10851 raft_consensus.cc:2468] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 12.
I20260709 12:26:37.704154 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:37.704782 10922 raft_consensus.cc:3055] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:26:37.705150 10922 raft_consensus.cc:740] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:37.705057 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:37.691344 10968 leader_election.cc:304] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:37.631343 15613 raft_consensus.cc:515] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:37.706969 10853 raft_consensus.cc:1275] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:26:37.708675 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:37.693574 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:37.705996 10922 consensus_queue.cc:260] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:37.711835 11001 raft_consensus.cc:1240] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Rejecting Update request from peer 3c52e0825c02476e89d84da9bb849f5d for earlier term 8. Current term is 9. Ops: []
I20260709 12:26:37.714789 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:37.721798 10922 raft_consensus.cc:3060] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:37.661680 15323 raft_consensus.cc:493] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:37.716466 10997 raft_consensus.cc:1275] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:26:37.718662 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:37.638926 15516 raft_consensus.cc:515] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:37.721771 10968 leader_election.cc:304] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:37.724660 10923 raft_consensus.cc:2468] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 11.
I20260709 12:26:37.729626 10968 leader_election.cc:304] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:37.729833 10997 raft_consensus.cc:1240] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Rejecting Update request from peer 3c52e0825c02476e89d84da9bb849f5d for earlier term 11. Current term is 12. Ops: []
I20260709 12:26:37.726084 15671 raft_consensus.cc:2804] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:37.731452 15523 raft_consensus.cc:2804] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:37.731609 15671 raft_consensus.cc:493] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:37.731923 15523 raft_consensus.cc:493] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:37.732138 15671 raft_consensus.cc:3060] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:37.732508 15523 raft_consensus.cc:3060] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:37.732705 15613 leader_election.cc:290] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:37.728456 11000 raft_consensus.cc:2468] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 7.
I20260709 12:26:37.736065 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352aa49c65194abbb863d7553a091f11" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:37.738906 15323 raft_consensus.cc:515] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:37.742219 15516 leader_election.cc:290] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:37.747134 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c6d38c4d8a90a81975a6a0cb13" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:37.755487 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:37.755686 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:37.756719 10997 raft_consensus.cc:2468] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 13.
I20260709 12:26:37.763139 15613 consensus_queue.cc:1048] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:37.771822 10820 leader_election.cc:304] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:37.742908 15516 raft_consensus.cc:2749] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:37.780262 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d9a61ecaf84695b70f8519ee57706f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:37.781984 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:37.773437 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352aa49c65194abbb863d7553a091f11" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:37.757088 15643 raft_consensus.cc:2804] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:37.785120 10820 leader_election.cc:304] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:37.777606 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:37.784044 11000 raft_consensus.cc:2468] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 3.
I20260709 12:26:37.783072 10927 raft_consensus.cc:2468] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 12.
I20260709 12:26:37.773135 11589 leader_election.cc:304] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:37.796514 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aed74af73a488f8b691578ca370226" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:37.785830 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:37.800145 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:37.790463 10929 raft_consensus.cc:1240] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 6. Current term is 7. Ops: []
I20260709 12:26:37.775919 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:37.804055 10922 raft_consensus.cc:1275] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 12:26:37.804543 10922 pending_rounds.cc:85] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea: Aborting all ops after (but not including) 10
I20260709 12:26:37.804826 10922 pending_rounds.cc:107] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 12:26:37.805110 10922 raft_consensus.cc:2889] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:37.805315 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef3220c51df47db8859f07ab745fad5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:37.805959 10922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50036 (request call id 962) took 1043 ms. Trace:
I20260709 12:26:37.807021 10922 rpcz_store.cc:276] 0709 12:26:36.762606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:36.762726 (+   120us) service_pool.cc:224] Handling call
0709 12:26:36.777542 (+ 14816us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:37.704685 (+927143us) spinlock_profiling.cc:243] Waited 5.3 ms on lock 0x7b540015b920. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594dffdc0 00007f7594e8a1c0 00007f7594e8b231 00007f7594e87d8f 00007f7594e8783e 00007f7599e4c419 00007f75933c3bd4 00007f75933c3b62 00007f75933c3a91 00007f75933c3a0c
0709 12:26:37.805676 (+100991us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:37.805902 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12197632}
I20260709 12:26:37.759488 15612 consensus_queue.cc:1048] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 12:26:37.759934 15500 consensus_queue.cc:1059] T e8b17195a94142039c40f598ed006c94 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:26:37.772096 15608 consensus_queue.cc:1048] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
W20260709 12:26:37.893862 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 164315us
I20260709 12:26:37.842972 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:26:37.842466 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 48478.5us
I20260709 12:26:37.849828 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad766f48812a4ddeb383179b1d84907b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:37.896430 10925 raft_consensus.cc:2468] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 11.
I20260709 12:26:37.896574 10820 leader_election.cc:304] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:37.870500 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:37.890635 10924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50036 (request call id 963) took 1127 ms. Trace:
I20260709 12:26:37.816717 10921 raft_consensus.cc:2393] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 9: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:26:37.895268 10968 leader_election.cc:304] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d
I20260709 12:26:37.808357 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:37.845194 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:37.871974 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:37.785183 15515 raft_consensus.cc:2804] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:26:37.898162 10853 raft_consensus.cc:2468] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 7.
I20260709 12:26:37.838817 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:37.898643 10928 raft_consensus.cc:2393] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 6: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:26:37.898517 10820 leader_election.cc:304] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:37.908066 11588 leader_election.cc:304] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:37.899509 10924 rpcz_store.cc:276] 0709 12:26:36.762987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:36.773249 (+ 10262us) service_pool.cc:224] Handling call
0709 12:26:36.824939 (+ 51690us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:36.825213 (+   274us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:26:36.916377 (+ 91164us) log.cc:844] Serialized 14 byte log entry
0709 12:26:37.752790 (+836413us) spinlock_profiling.cc:243] Waited 5.47 ms on lock 0x7b1800394000. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f759ac63ab1 00007f759ac70281 00007f7591d15c0a 00007f759b455219 00007f7591d9da40 00007f7591d984e4 00007f7591d98455 00007f7594e80060 00007f7594e92716 00007f7594ea3287 00007f7594ea3208
0709 12:26:37.890082 (+137292us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:37.890166 (+    84us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:26:37.890237 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:37.890339 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:37.890543 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5830,"prepare.queue_time_us":93425,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":29234,"raft.queue_time_us":926520,"spinlock_wait_cycles":27578624,"thread_start_us":200125,"threads_started":2}
W20260709 12:26:37.869951 15681 log.cc:927] Time spent T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
W20260709 12:26:37.848341 15540 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
W20260709 12:26:37.937811 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 147997us
I20260709 12:26:37.915961 10968 leader_election.cc:304] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d
I20260709 12:26:37.808424 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b17195a94142039c40f598ed006c94" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:37.790376 15643 raft_consensus.cc:493] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:37.797753 15647 raft_consensus.cc:3055] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:26:37.799062 15059 raft_consensus.cc:2749] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:26:37.811326 15603 raft_consensus.cc:2804] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:26:37.950675 10894 leader_election.cc:304] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:37.968775 10895 leader_election.cc:304] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:37.909907 15613 raft_consensus.cc:2804] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:26:37.976876 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 61044.4us
I20260709 12:26:37.810883 15639 consensus_queue.cc:1048] T ab816bcc6183447994a2cc013e46c5f8 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.137s
I20260709 12:26:37.860113 15458 consensus_queue.cc:1059] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.109s
I20260709 12:26:37.983054 10968 leader_election.cc:304] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:37.924762 15515 raft_consensus.cc:493] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:37.850132 15215 consensus_queue.cc:1059] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.118s
I20260709 12:26:37.853945 15387 consensus_queue.cc:1048] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.110s
I20260709 12:26:37.969780 15619 raft_consensus.cc:2804] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:26:37.968021 15647 raft_consensus.cc:740] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:37.967675 15643 raft_consensus.cc:3060] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:37.937207 15216 consensus_queue.cc:1048] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 12:26:37.989147 15620 raft_consensus.cc:2804] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:26:37.993287 15603 raft_consensus.cc:697] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 10 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:37.967918 15568 consensus_queue.cc:1048] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 12:26:37.998801 15515 raft_consensus.cc:3060] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:37.998350 15613 raft_consensus.cc:697] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [term 8 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:38.005226 15619 raft_consensus.cc:493] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:38.052013 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:38.017035 15687 raft_consensus.cc:2804] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:26:38.062091 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 86993.7us
I20260709 12:26:38.016713 15323 leader_election.cc:290] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:38.064455 15687 raft_consensus.cc:493] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:38.065227 15687 raft_consensus.cc:3060] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:38.058909 15619 raft_consensus.cc:3060] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:38.071385 15621 consensus_queue.cc:1059] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:26:38.072038 15323 raft_consensus.cc:2804] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:38.075973 10854 raft_consensus.cc:1240] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 14 FOLLOWER]: Rejecting Update request from peer 3c52e0825c02476e89d84da9bb849f5d for earlier term 13. Current term is 14. Ops: []
W20260709 12:26:38.119098 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:38.120772 10817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:38.048324 15658 raft_consensus.cc:2804] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:38.053977 15516 raft_consensus.cc:2804] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:26:38.126220 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 227815us
I20260709 12:26:38.044127 15697 raft_consensus.cc:493] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:38.041149 15689 raft_consensus.cc:493] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:38.055364 15467 raft_consensus.cc:2749] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:26:38.153631 15697 raft_consensus.cc:515] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:38.156318 15697 leader_election.cc:290] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:38.159405 10848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46480 (request call id 806) took 1391 ms. Trace:
I20260709 12:26:38.160189 10848 rpcz_store.cc:276] 0709 12:26:36.767831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:36.768018 (+   187us) service_pool.cc:224] Handling call
0709 12:26:38.159072 (+1391054us) spinlock_profiling.cc:243] Waited 598 ms on lock 0x7b5400191c54. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e8c2fa 00007f7599e4db17 00007f75933c86d4 00007f75933c8662 00007f75933c8591 00007f75933c850c 00007f75933c77c2 00007f75931c348c 00007f75931c28c6 00007f75931c226f
0709 12:26:38.159289 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1375129856}
I20260709 12:26:38.143208 15695 raft_consensus.cc:493] T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:38.131029 10820 leader_election.cc:304] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:38.164076 15695 raft_consensus.cc:515] T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:38.165921 10820 leader_election.cc:304] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:38.166741 15695 leader_election.cc:290] T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:26:38.167245 15669 consensus_meta.cc:287] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08: Time spent flushing consensus metadata: real 0.547s	user 0.008s	sys 0.001s
I20260709 12:26:38.110316 15568 raft_consensus.cc:3055] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:26:38.167822 15568 raft_consensus.cc:740] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:38.128222 15658 raft_consensus.cc:493] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:38.168706 15658 raft_consensus.cc:3060] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:38.106807 15215 raft_consensus.cc:493] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:38.143347 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:38.123687 15323 raft_consensus.cc:493] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:38.147119 10847 raft_consensus.cc:1240] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 12. Current term is 13. Ops: []
I20260709 12:26:38.178856 10820 leader_election.cc:304] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:38.143832 15540 consensus_queue.cc:1048] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:26:38.123646 15639 raft_consensus.cc:3055] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:26:38.172897 11624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45890 (request call id 834) took 1322 ms. Trace:
I20260709 12:26:38.123222 15620 raft_consensus.cc:697] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 11 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:38.129782 15516 raft_consensus.cc:493] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:38.185654 11624 rpcz_store.cc:276] 0709 12:26:36.849980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:36.850150 (+   170us) service_pool.cc:224] Handling call
0709 12:26:38.143176 (+1293026us) spinlock_profiling.cc:243] Waited 6.33 ms on lock 0x7b5800160898. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7591c23db1 00007f7591d63b71 00007f7591d63a22 00007f759ac7c8d9 00007f7599dd6ee0 00007f7599ea00ab 00007f7599ea0131 00007f7599e4e0a0 00007f7599e4d984 00007f75933c86d4 00007f75933c8662
0709 12:26:38.172813 (+ 29637us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14555392}
I20260709 12:26:38.067349 15613 consensus_queue.cc:237] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:38.182685 15323 raft_consensus.cc:3060] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:38.181331 15215 raft_consensus.cc:515] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:38.219651 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 250934us
I20260709 12:26:38.185325 15639 raft_consensus.cc:740] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
I20260709 12:26:38.208062 15516 raft_consensus.cc:3060] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:38.169046 15568 consensus_queue.cc:260] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:38.170684 15471 raft_consensus.cc:515] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:38.177723 15669 raft_consensus.cc:515] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:38.242632 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 251232us
I20260709 12:26:38.241057 10895 leader_election.cc:304] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:38.219776 11619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
W20260709 12:26:38.250432 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 71726.4us
I20260709 12:26:38.252173 10820 leader_election.cc:304] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d
I20260709 12:26:38.205304 15523 raft_consensus.cc:515] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:38.172569 15689 raft_consensus.cc:515] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:38.262267 10820 leader_election.cc:304] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:38.201714 15603 consensus_queue.cc:237] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:38.224196 15515 raft_consensus.cc:515] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:38.254704 15568 raft_consensus.cc:3060] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:38.276327 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:38.274209 15471 leader_election.cc:290] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
W20260709 12:26:38.280575 10895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:38.282744 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:38.178859 15647 consensus_queue.cc:260] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:38.282821 15467 raft_consensus.cc:493] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:38.284848 15646 raft_consensus.cc:493] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
W20260709 12:26:38.286063 10895 connection.cc:256] RPC call timeout handler was delayed by -1.03191023699992s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1663s for a response
W20260709 12:26:38.415355 10846 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56388 (request call id 3170) took 1510 ms (client timeout 1706 ms). Trace:
W20260709 12:26:38.416496 10846 rpcz_store.cc:269] 0709 12:26:36.905113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:36.905367 (+   254us) service_pool.cc:224] Handling call
0709 12:26:38.415176 (+1509809us) spinlock_profiling.cc:243] Waited 276 ms on lock 0x7b54000eae54. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e8c2fa 00007f7599e4db17 00007f75933c86d4 00007f75933c8662 00007f75933c8591 00007f75933c850c 00007f75933c77c2 00007f75931c348c 00007f75931c28c6 00007f75931c226f
0709 12:26:38.415292 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":635932544}
W20260709 12:26:38.288332 15690 log.cc:927] Time spent T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
W20260709 12:26:38.289618 15684 log.cc:927] Time spent T ab816bcc6183447994a2cc013e46c5f8 P 3c52e0825c02476e89d84da9bb849f5d: Append to log took a long time: real 0.298s	user 0.003s	sys 0.000s
I20260709 12:26:38.416100 10895 leader_election.cc:304] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:38.297271 15649 raft_consensus.cc:493] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:38.264341 15702 raft_consensus.cc:2749] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:38.309209 15689 leader_election.cc:290] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:38.272776 15639 consensus_queue.cc:260] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:38.272539 15688 log.cc:927] Time spent T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.237s	user 0.000s	sys 0.001s
I20260709 12:26:38.312583 15617 consensus_queue.cc:260] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:38.317251 15215 leader_election.cc:290] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:26:38.318605 15478 consensus_meta.cc:287] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08: Time spent flushing consensus metadata: real 0.622s	user 0.013s	sys 0.000s
I20260709 12:26:38.326411 15523 leader_election.cc:290] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:38.268941 15709 raft_consensus.cc:493] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:38.336561 15685 log.cc:927] Time spent T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:26:38.480592 15471 raft_consensus.cc:493] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:38.496383 15471 raft_consensus.cc:515] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:38.473668 15629 consensus_queue.cc:1059] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 12:26:38.500732 15387 raft_consensus.cc:3055] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:26:38.455937 15699 consensus_queue.cc:1059] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 12:26:38.501353 15387 raft_consensus.cc:740] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
I20260709 12:26:38.502573 15387 consensus_queue.cc:260] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:38.504470 15660 leader_election.cc:290] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:38.505259 15387 raft_consensus.cc:3060] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:38.505420 15709 raft_consensus.cc:515] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:38.349042 10892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:38.514488 10921 raft_consensus.cc:1240] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 9. Current term is 10. Ops: []
W20260709 12:26:38.515353 10968 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.009s	sys 0.009s
I20260709 12:26:38.323235 15220 leader_election.cc:290] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:38.360375 11003 raft_consensus.cc:1275] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:26:38.270264 15620 consensus_queue.cc:237] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:38.312623 15515 leader_election.cc:290] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:38.408754 10847 raft_consensus.cc:1240] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:26:38.409415 10848 raft_consensus.cc:1240] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 5. Current term is 6. Ops: []
I20260709 12:26:38.420477 10850 raft_consensus.cc:1275] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:26:38.411463 15675 raft_consensus.cc:493] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:38.424742 11619 raft_consensus.cc:1240] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:26:38.425035 15646 raft_consensus.cc:515] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:38.426012 15715 raft_consensus.cc:2749] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:26:38.425721 15467 raft_consensus.cc:515] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:38.420528 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:38.436712 15594 raft_consensus.cc:2804] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:38.438040 15510 raft_consensus.cc:493] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:38.409197 15706 raft_consensus.cc:493] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:38.450152 11615 raft_consensus.cc:1240] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 12:26:38.450809 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5794ba618e514e28a7542ab6af39d8c9" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:38.451402 15694 raft_consensus.cc:2804] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:26:38.456473 15619 raft_consensus.cc:515] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:38.612016 15694 raft_consensus.cc:697] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 10 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:38.613077 15694 consensus_queue.cc:237] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:38.614149 15619 leader_election.cc:290] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 8 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:38.614830 15516 raft_consensus.cc:515] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:38.440007 15456 consensus_meta.cc:287] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08: Time spent flushing consensus metadata: real 0.800s	user 0.014s	sys 0.000s
I20260709 12:26:38.615954 15456 raft_consensus.cc:2749] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:38.616235 15709 leader_election.cc:290] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:38.477603 15658 raft_consensus.cc:515] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:38.618417 15516 leader_election.cc:290] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
W20260709 12:26:38.462096 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 199911us
W20260709 12:26:38.620765 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:38.411609 15716 raft_consensus.cc:2749] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:26:38.474063 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352aa49c65194abbb863d7553a091f11" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:38.477603 15703 raft_consensus.cc:2804] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:38.445456 15446 raft_consensus.cc:2804] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:38.488446 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6a1da21304fcfacab384a6afc4101" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:26:38.516225 10968 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.009s	sys 0.009s
I20260709 12:26:38.661556 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18294423a68a4671bf6c5a0f98645e4c" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:26:38.661890 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 678908us
I20260709 12:26:38.525084 15717 raft_consensus.cc:493] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:38.661815 10929 raft_consensus.cc:2468] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 6.
I20260709 12:26:38.517920 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac83709373b4efd9c3aa1472a9f9022" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
W20260709 12:26:38.533129 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 69530.5us
I20260709 12:26:38.665395 11588 leader_election.cc:304] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:38.666301 10820 leader_election.cc:304] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:38.667441 10924 raft_consensus.cc:2468] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 4.
I20260709 12:26:38.667732 10820 leader_election.cc:304] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:38.481583 15669 leader_election.cc:290] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:38.561215 15715 raft_consensus.cc:493] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:38.513298 15617 raft_consensus.cc:3060] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:38.518321 15639 raft_consensus.cc:3060] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:38.559367 15719 raft_consensus.cc:493] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:38.494105 15478 raft_consensus.cc:515] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:38.452363 15643 raft_consensus.cc:515] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:38.567162 15687 consensus_meta.cc:287] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08: Time spent flushing consensus metadata: real 0.501s	user 0.012s	sys 0.000s
I20260709 12:26:38.574826 11621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:38.587139 15594 raft_consensus.cc:493] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
W20260709 12:26:38.605926 15714 log.cc:927] Time spent T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.082s	user 0.000s	sys 0.002s
I20260709 12:26:38.492749 15702 consensus_queue.cc:1048] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
W20260709 12:26:38.645797 10893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:38.600725 15510 raft_consensus.cc:515] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:38.462783 15649 raft_consensus.cc:515] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:38.612035 15471 leader_election.cc:290] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:38.678881 15619 raft_consensus.cc:2804] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:26:38.696645 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 226275us
I20260709 12:26:38.715415 10854 raft_consensus.cc:1240] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 6. Current term is 7. Ops: []
I20260709 12:26:38.717222 11621 raft_consensus.cc:2393] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 8: Already voted for candidate 3c52e0825c02476e89d84da9bb849f5d in this term.
I20260709 12:26:38.575853 15323 raft_consensus.cc:515] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:38.695456 10968 leader_election.cc:304] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:38.673877 15703 raft_consensus.cc:493] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:38.661402 15446 raft_consensus.cc:493] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:38.678911 15658 leader_election.cc:290] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 13 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:38.720300 11615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:38.738075 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:38.752527 10929 raft_consensus.cc:3060] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:26:38.683465 15216 raft_consensus.cc:493] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
W20260709 12:26:38.743745 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 48463.6us
I20260709 12:26:38.721777 15594 raft_consensus.cc:3060] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:38.755923 10851 raft_consensus.cc:1240] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [term 8 LEADER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 7. Current term is 8. Ops: []
I20260709 12:26:38.577081 15675 raft_consensus.cc:515] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:38.715395 15669 raft_consensus.cc:493] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:38.743817 10895 leader_election.cc:304] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:38.746317 15510 leader_election.cc:290] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:38.673287 15717 raft_consensus.cc:515] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:38.750319 10922 raft_consensus.cc:1275] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:26:38.717514 15709 raft_consensus.cc:2804] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:38.718873 15516 raft_consensus.cc:493] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:38.754529 10968 leader_election.cc:304] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:38.758965 10895 leader_election.cc:304] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
W20260709 12:26:38.746323 15711 log.cc:927] Time spent T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 12:26:38.772179 10921 raft_consensus.cc:1240] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 11. Current term is 12. Ops: []
W20260709 12:26:38.756800 15671 consensus_meta.cc:287] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08: Time spent flushing consensus metadata: real 1.024s	user 0.014s	sys 0.001s
I20260709 12:26:38.620995 15706 raft_consensus.cc:515] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:38.740295 15721 raft_consensus.cc:2804] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:38.747072 15703 raft_consensus.cc:3060] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:38.773854 10968 leader_election.cc:304] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:38.788733 10968 leader_election.cc:304] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:38.790453 10968 leader_election.cc:304] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:38.750455 15619 raft_consensus.cc:697] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [term 12 LEADER]: Becoming Leader. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
I20260709 12:26:38.752084 15456 raft_consensus.cc:493] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:38.779320 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:38.792551 10845 raft_consensus.cc:2393] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3c52e0825c02476e89d84da9bb849f5d in current term 10: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:26:38.780160 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:38.747201 15471 raft_consensus.cc:2749] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:38.752477 15446 raft_consensus.cc:3060] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:38.736367 15716 consensus_queue.cc:1048] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:26:38.769326 15709 raft_consensus.cc:493] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:38.796334 10968 leader_election.cc:304] T d0aed74af73a488f8b691578ca370226 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:38.765322 15658 raft_consensus.cc:2804] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:26:38.687892 15715 raft_consensus.cc:515] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:38.845062 15706 leader_election.cc:290] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:38.845330 15715 leader_election.cc:290] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:38.847381 15649 leader_election.cc:290] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:38.731495 15687 raft_consensus.cc:515] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:38.849292 15478 leader_election.cc:290] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:38.849804 15687 leader_election.cc:290] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 14 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:38.853516 15323 leader_election.cc:290] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:38.768755 15669 raft_consensus.cc:515] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:38.762151 15719 raft_consensus.cc:515] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:38.796067 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:38.830920 15720 raft_consensus.cc:2749] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:26:38.795398 15220 raft_consensus.cc:2749] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:38.795377 15660 raft_consensus.cc:2749] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:38.836844 15702 raft_consensus.cc:493] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:38.759996 15216 raft_consensus.cc:515] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:38.845199 15643 leader_election.cc:290] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 12 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:38.830435 15467 leader_election.cc:290] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
W20260709 12:26:38.861021 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 66010.5us
I20260709 12:26:38.874768 10968 leader_election.cc:304] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
W20260709 12:26:38.862512 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 84831.5us
I20260709 12:26:38.875439 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6a1da21304fcfacab384a6afc4101" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:38.876181 10847 raft_consensus.cc:2468] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 5.
I20260709 12:26:38.877417 10929 raft_consensus.cc:2468] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 8.
I20260709 12:26:38.879053 10998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37512 (request call id 3511) took 1339 ms. Trace:
I20260709 12:26:38.879683 10998 rpcz_store.cc:276] 0709 12:26:37.539409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:37.542475 (+  3066us) service_pool.cc:224] Handling call
0709 12:26:38.878739 (+1336264us) spinlock_profiling.cc:243] Waited 38.5 ms on lock 0x7b54002297d4. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e8c2fa 00007f7599e4db17 00007f75933c86d4 00007f75933c8662 00007f75933c8591 00007f75933c850c 00007f75933c77c2 00007f75931c348c 00007f75931c28c6 00007f75931c226f
0709 12:26:38.878957 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":88612736}
I20260709 12:26:38.857859 15669 leader_election.cc:290] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:38.787662 15721 raft_consensus.cc:493] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:38.775701 15516 raft_consensus.cc:515] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:38.897588 15660 raft_consensus.cc:2749] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:38.799129 15523 raft_consensus.cc:2749] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:26:38.859439 15709 raft_consensus.cc:3060] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:38.828182 15456 raft_consensus.cc:515] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:38.837194 15675 leader_election.cc:290] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:38.878091 10895 leader_election.cc:304] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d
I20260709 12:26:38.857859 15719 leader_election.cc:290] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:38.861790 15323 raft_consensus.cc:2749] T d0aed74af73a488f8b691578ca370226 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:38.871757 15702 raft_consensus.cc:515] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:38.797850 15655 raft_consensus.cc:2804] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:26:38.895239 10968 leader_election.cc:304] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:38.920317 10968 leader_election.cc:304] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:38.921588 10968 leader_election.cc:304] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:38.922537 10851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56394 (request call id 4098) took 1046 ms. Trace:
I20260709 12:26:38.923235 10968 leader_election.cc:304] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:38.924185 15720 raft_consensus.cc:3060] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:38.917781 15594 raft_consensus.cc:515] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:38.924638 15527 leader_election.cc:290] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:38.925206 15527 raft_consensus.cc:2749] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:38.926188 15527 raft_consensus.cc:2749] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:38.923883 15471 raft_consensus.cc:2749] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:26:38.864907 15658 raft_consensus.cc:697] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:38.929600 15658 consensus_queue.cc:237] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:38.930097 15594 leader_election.cc:290] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 election: Requested vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:38.922984 10851 rpcz_store.cc:276] 0709 12:26:37.876247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:38.122137 (+245890us) service_pool.cc:224] Handling call
0709 12:26:38.122769 (+   632us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:38.759750 (+636981us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:38.922279 (+162529us) spinlock_profiling.cc:243] Waited 633 ms on lock 0x7b5400191254. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e88e01 00007f7594e8783e 00007f7599e4c419 00007f75933c3bd4 00007f75933c3b62 00007f75933c3a91 00007f75933c3a0c 00007f75933c2cc2 00007f75931c348c 00007f75931c28c6
0709 12:26:38.922471 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1455652608}
I20260709 12:26:38.898425 15516 leader_election.cc:290] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:38.881626 11002 raft_consensus.cc:1240] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Rejecting Update request from peer 3c52e0825c02476e89d84da9bb849f5d for earlier term 10. Current term is 11. Ops: []
I20260709 12:26:38.935725 15720 raft_consensus.cc:2749] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:26:38.785319 15671 raft_consensus.cc:515] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:38.899832 15721 raft_consensus.cc:3060] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:38.917778 15662 raft_consensus.cc:3055] T e8b17195a94142039c40f598ed006c94 P 3c52e0825c02476e89d84da9bb849f5d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:38.911695 15669 raft_consensus.cc:493] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:38.932281 10968 leader_election.cc:304] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
W20260709 12:26:38.944690 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 275122us
W20260709 12:26:38.947217 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 69251.2us
I20260709 12:26:38.947521 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac83709373b4efd9c3aa1472a9f9022" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:38.948117 11000 raft_consensus.cc:3060] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:38.951182 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:38.952205 11003 raft_consensus.cc:2468] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 9.
I20260709 12:26:38.948042 10895 leader_election.cc:304] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:38.955272 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:38.969956 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:38.970876 10846 raft_consensus.cc:3060] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:38.901111 15726 raft_consensus.cc:493] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:38.973155 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:38.991699 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5794ba618e514e28a7542ab6af39d8c9" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
W20260709 12:26:38.993649 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 45690.2us
I20260709 12:26:38.899746 15643 consensus_queue.cc:1059] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.066s
W20260709 12:26:39.000579 11587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:38.912617 15646 leader_election.cc:290] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:38.995316 10895 leader_election.cc:304] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:39.000495 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fd8fdac2fa449e9e184f3d668ea1a7" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:38.943434 15662 raft_consensus.cc:740] T e8b17195a94142039c40f598ed006c94 P 3c52e0825c02476e89d84da9bb849f5d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
I20260709 12:26:38.972424 15523 raft_consensus.cc:2749] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:26:39.014570 11621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:38.980754 15649 raft_consensus.cc:2804] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:38.990358 15516 raft_consensus.cc:493] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:38.979398 15702 leader_election.cc:290] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:38.990720 15594 raft_consensus.cc:493] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:38.968640 15655 raft_consensus.cc:697] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 12 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:39.016673 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:39.027721 10895 leader_election.cc:304] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:39.033109 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352aa49c65194abbb863d7553a091f11" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:39.069749 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:39.071862 15702 raft_consensus.cc:2749] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:26:39.072886 15702 consensus_queue.cc:1048] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:39.073834 15216 leader_election.cc:290] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:39.034104 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c6d38c4d8a90a81975a6a0cb13" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:39.075868 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c913e527ff46578e084c41eab7bb9d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:39.077670 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:39.077888 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:39.008945 15540 raft_consensus.cc:2749] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:39.071245 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5794ba618e514e28a7542ab6af39d8c9" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:39.036753 10846 raft_consensus.cc:2468] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 8.
I20260709 12:26:39.089666 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad766f48812a4ddeb383179b1d84907b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:38.972024 15669 raft_consensus.cc:515] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:38.997514 15726 raft_consensus.cc:515] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:39.040277 15594 raft_consensus.cc:515] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:39.040920 10800 auto_rebalancer.cc:893] Removing replace marker failed: Replica edcc56ddd3264984b4da6c1db59e7f08 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
W20260709 12:26:39.094612 10800 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 12:26:39.034770 15646 raft_consensus.cc:2749] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:26:39.026014 15730 log.cc:927] Time spent T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.086s	user 0.001s	sys 0.001s
I20260709 12:26:39.095969 11617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
W20260709 12:26:39.094933 10800 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
W20260709 12:26:39.097822 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 77372.1us
I20260709 12:26:39.098155 11616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac8522e549a46e09593fa4c2e175557" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:39.063709 15655 consensus_queue.cc:237] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:39.078984 10928 raft_consensus.cc:2410] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3c52e0825c02476e89d84da9bb849f5d for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 12:26:39.037846 15516 raft_consensus.cc:515] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:39.034233 15715 raft_consensus.cc:493] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:39.033819 11615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:39.039379 15708 consensus_queue.cc:1059] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 12:26:39.091784 11621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18294423a68a4671bf6c5a0f98645e4c" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:38.943885 15619 consensus_queue.cc:237] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 10.12, Last appended by leader: 12, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:39.096354 11624 raft_consensus.cc:1240] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:39.113238 11621 raft_consensus.cc:2468] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 5.
I20260709 12:26:39.023790 15649 raft_consensus.cc:493] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:39.099931 11620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:39.078990 10849 raft_consensus.cc:2468] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 10.
I20260709 12:26:39.120373 11620 raft_consensus.cc:2368] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for earlier term 7. Current term is 8.
I20260709 12:26:39.121351 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
W20260709 12:26:39.103988 10895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:39.124123 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:39.125833 15594 leader_election.cc:290] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
W20260709 12:26:39.109557 15603 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.799s	user 0.021s	sys 0.025s
I20260709 12:26:39.107813 10846 raft_consensus.cc:2468] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 6.
I20260709 12:26:39.086033 11619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:39.128252 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:39.130189 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:39.134107 10845 raft_consensus.cc:2393] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 13: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:26:39.036887 11000 raft_consensus.cc:2468] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 7.
I20260709 12:26:39.130430 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:39.130817 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:39.109633 15722 consensus_queue.cc:1059] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 12:26:39.120890 15649 raft_consensus.cc:3060] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:39.141400 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:26:39.129678 15603 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.819s	user 0.021s	sys 0.025s
I20260709 12:26:39.142681 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:39.164244 10923 raft_consensus.cc:2468] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 10.
I20260709 12:26:39.130405 10820 leader_election.cc:304] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:39.165748 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad766f48812a4ddeb383179b1d84907b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:39.166850 10928 raft_consensus.cc:2393] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 6: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:26:39.102219 15703 raft_consensus.cc:515] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:39.172022 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c913e527ff46578e084c41eab7bb9d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:39.177102 15456 leader_election.cc:290] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:39.101436 15662 consensus_queue.cc:260] T e8b17195a94142039c40f598ed006c94 P 3c52e0825c02476e89d84da9bb849f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:39.183946 15662 raft_consensus.cc:3060] T e8b17195a94142039c40f598ed006c94 P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:39.185102 10850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56388 (request call id 3181) took 2094 ms. Trace:
I20260709 12:26:39.135016 15594 raft_consensus.cc:493] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:39.169248 10820 leader_election.cc:304] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:39.112404 15715 raft_consensus.cc:515] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:39.189476 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:39.194816 10928 raft_consensus.cc:2393] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 8: Already voted for candidate 3c52e0825c02476e89d84da9bb849f5d in this term.
I20260709 12:26:39.185782 10850 rpcz_store.cc:276] 0709 12:26:37.090461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:37.091227 (+   766us) service_pool.cc:224] Handling call
0709 12:26:38.415705 (+1324478us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:38.557277 (+141572us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:39.184640 (+627363us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b54000eae50. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e878ad 00007f7599e4c419 00007f75933c3bd4 00007f75933c3b62 00007f75933c3a91 00007f75933c3a0c 00007f75933c2cc2 00007f75931c348c 00007f75931c28c6 00007f75931c226f
0709 12:26:39.185003 (+   363us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2984331520}
I20260709 12:26:39.196761 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:39.163051 15722 raft_consensus.cc:3055] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:26:39.188311 15719 raft_consensus.cc:2749] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:26:39.215684 10849 raft_consensus.cc:2393] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 12: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:26:39.216234 15620 raft_consensus.cc:493] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:39.204833 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:39.219796 10846 raft_consensus.cc:2410] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:26:39.220253 10922 raft_consensus.cc:3060] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:39.200163 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:39.186112 15726 leader_election.cc:290] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:39.225617 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:39.225947 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:39.227491 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:39.207098 15603 raft_consensus.cc:2749] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:26:39.230491 10921 raft_consensus.cc:2468] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 7.
I20260709 12:26:39.206408 15722 raft_consensus.cc:740] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:39.232769 10968 leader_election.cc:304] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:39.188299 15446 raft_consensus.cc:515] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:39.214407 15671 leader_election.cc:290] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:39.226039 15708 raft_consensus.cc:493] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:39.253422 11002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57514 (request call id 1212) took 1639 ms. Trace:
I20260709 12:26:39.253901 11002 rpcz_store.cc:276] 0709 12:26:37.614477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:37.614716 (+   239us) service_pool.cc:224] Handling call
0709 12:26:38.881336 (+1266620us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:38.934310 (+ 52974us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:39.253179 (+318869us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b54002297d0. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e878ad 00007f7599e4c419 00007f75933c3bd4 00007f75933c3b62 00007f75933c3a91 00007f75933c3a0c 00007f75933c2cc2 00007f75931c348c 00007f75931c28c6 00007f75931c226f
0709 12:26:39.253350 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2912048512}
I20260709 12:26:39.234078 15721 raft_consensus.cc:515] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:39.257233 15721 leader_election.cc:290] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 election: Requested vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:39.258298 10847 raft_consensus.cc:1240] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Rejecting Update request from peer 3c52e0825c02476e89d84da9bb849f5d for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:39.253918 15708 raft_consensus.cc:515] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:39.261183 15715 leader_election.cc:290] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:26:39.262389 15729 log.cc:927] Time spent T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.303s	user 0.003s	sys 0.000s
I20260709 12:26:39.238023 15456 raft_consensus.cc:2749] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:39.201144 15594 raft_consensus.cc:515] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:39.265703 10928 raft_consensus.cc:1240] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 5. Current term is 6. Ops: []
I20260709 12:26:39.267119 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:39.268507 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:39.228946 15523 raft_consensus.cc:493] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:39.242033 15516 leader_election.cc:290] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:39.292598 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:39.293334 11003 raft_consensus.cc:1240] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Rejecting Update request from peer 3c52e0825c02476e89d84da9bb849f5d for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:26:39.293483 10995 raft_consensus.cc:2468] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 8.
I20260709 12:26:39.294481 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18294423a68a4671bf6c5a0f98645e4c" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:39.294661 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:39.295094 11003 raft_consensus.cc:2468] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 5.
I20260709 12:26:39.244650 15649 raft_consensus.cc:515] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:39.251245 15639 consensus_meta.cc:287] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d: Time spent flushing consensus metadata: real 0.562s	user 0.010s	sys 0.003s
I20260709 12:26:39.262250 15708 leader_election.cc:290] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:39.303545 15717 leader_election.cc:290] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:39.303838 15446 leader_election.cc:290] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 13 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:39.307394 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:39.267036 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:39.241425 10922 raft_consensus.cc:2468] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 12.
I20260709 12:26:39.309703 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:39.268688 10921 raft_consensus.cc:1240] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 11. Current term is 12. Ops: []
I20260709 12:26:39.237368 10968 leader_election.cc:304] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d
I20260709 12:26:39.228338 15620 raft_consensus.cc:515] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:39.272790 15523 raft_consensus.cc:515] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:39.272982 15591 consensus_queue.cc:1059] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:39.273411 15722 consensus_queue.cc:260] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:39.266997 15594 leader_election.cc:290] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
W20260709 12:26:39.283154 15724 log.cc:927] Time spent T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.720s	user 0.001s	sys 0.002s
I20260709 12:26:39.288192 15655 raft_consensus.cc:493] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:39.235997 15646 consensus_queue.cc:1059] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 12:26:39.322870 15467 raft_consensus.cc:3055] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:26:39.323357 15467 raft_consensus.cc:740] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:39.324122 15523 leader_election.cc:290] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:39.324378 15467 consensus_queue.cc:260] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:39.326346 15467 raft_consensus.cc:3060] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:39.330070 15708 raft_consensus.cc:3055] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:26:39.330586 15708 raft_consensus.cc:740] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:39.331434 15708 consensus_queue.cc:260] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:39.332492 15708 raft_consensus.cc:3060] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:39.288828 15456 raft_consensus.cc:493] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:39.289321 15323 raft_consensus.cc:493] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:39.290011 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18294423a68a4671bf6c5a0f98645e4c" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:39.338121 11002 raft_consensus.cc:2393] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 5: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:26:39.291004 10996 raft_consensus.cc:1240] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 6. Current term is 7. Ops: []
I20260709 12:26:39.291595 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:39.296604 10997 raft_consensus.cc:1240] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Rejecting Update request from peer 3c52e0825c02476e89d84da9bb849f5d for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:39.295460 10995 raft_consensus.cc:3060] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:39.339143 11000 raft_consensus.cc:2393] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 13: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:26:39.340566 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:26:39.317348 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 80068.7us
I20260709 12:26:39.341684 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:39.342531 11000 raft_consensus.cc:3060] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:39.343112 10968 leader_election.cc:304] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:39.344455 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:39.344971 10968 leader_election.cc:304] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:39.345710 11002 raft_consensus.cc:2410] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for term 11 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:26:39.351395 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:39.354712 10968 leader_election.cc:304] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:39.359107 10997 raft_consensus.cc:1240] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Rejecting Update request from peer 3c52e0825c02476e89d84da9bb849f5d for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 12:26:39.365845 11000 raft_consensus.cc:2468] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 12.
I20260709 12:26:39.358974 15520 consensus_queue.cc:1059] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 12:26:39.370266 15520 raft_consensus.cc:3055] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:26:39.373797 15520 raft_consensus.cc:740] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
I20260709 12:26:39.361868 15478 raft_consensus.cc:2804] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:26:39.387207 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:39.370486 15516 raft_consensus.cc:2804] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:26:39.393741 10998 raft_consensus.cc:2393] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 12: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:26:39.351562 15591 consensus_queue.cc:1059] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
W20260709 12:26:39.397495 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 46770.2us
I20260709 12:26:39.402312 11589 leader_election.cc:304] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:39.403187 10998 raft_consensus.cc:1240] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 6. Current term is 7. Ops: []
I20260709 12:26:39.405445 10995 raft_consensus.cc:2468] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 8.
I20260709 12:26:39.398835 10895 leader_election.cc:304] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:39.407800 10995 raft_consensus.cc:1240] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:26:39.353600 15456 raft_consensus.cc:515] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:39.351785 15323 raft_consensus.cc:515] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:39.393141 15478 raft_consensus.cc:493] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:39.351845 15655 raft_consensus.cc:515] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:39.411002 10895 leader_election.cc:304] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:39.374941 15520 consensus_queue.cc:260] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:39.415068 15216 raft_consensus.cc:2804] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:39.410362 15523 raft_consensus.cc:2749] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:26:39.432385 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:39.413609 15646 raft_consensus.cc:2804] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:26:39.430509 10996 raft_consensus.cc:1240] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Rejecting Update request from peer 3c52e0825c02476e89d84da9bb849f5d for earlier term 8. Current term is 9. Ops: []
I20260709 12:26:39.414883 15516 raft_consensus.cc:697] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:26:39.446071 10995 raft_consensus.cc:1275] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 13 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 12:26:39.447034 15709 consensus_meta.cc:287] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040: Time spent flushing consensus metadata: real 0.533s	user 0.014s	sys 0.000s
I20260709 12:26:39.414430 15621 consensus_queue.cc:1059] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:26:39.463044 15520 raft_consensus.cc:3060] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:39.485101 15449 consensus_queue.cc:1059] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:26:39.485750 15658 raft_consensus.cc:3055] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:26:39.486346 15658 raft_consensus.cc:740] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:39.486711 15621 raft_consensus.cc:3055] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:26:39.487018 15747 log.cc:927] Time spent T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
W20260709 12:26:39.491026 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 322007us
I20260709 12:26:39.409523 15426 consensus_queue.cc:1059] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 12:26:39.476675 10995 raft_consensus.cc:1240] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 14 FOLLOWER]: Rejecting Update request from peer 3c52e0825c02476e89d84da9bb849f5d for earlier term 13. Current term is 14. Ops: []
I20260709 12:26:39.429909 15720 raft_consensus.cc:2804] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:26:39.481081 10819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:39.414810 15458 consensus_queue.cc:1059] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 12:26:39.424325 15478 raft_consensus.cc:3060] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:39.448242 15216 raft_consensus.cc:493] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:39.465636 15649 leader_election.cc:290] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 election: Requested vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:39.492494 10820 leader_election.cc:304] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:39.493067 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
W20260709 12:26:39.486276 15750 log.cc:927] Time spent T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 12:26:39.469497 15467 raft_consensus.cc:2804] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:26:39.533272 10995 raft_consensus.cc:3060] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:39.534075 10820 leader_election.cc:304] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:39.487231 15621 raft_consensus.cc:740] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:39.521171 15662 consensus_queue.cc:1059] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 12:26:39.490170 15671 raft_consensus.cc:493] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:39.536916 10820 leader_election.cc:304] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:39.533500 15216 raft_consensus.cc:3060] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:39.474220 15646 raft_consensus.cc:493] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:39.544282 10820 leader_election.cc:304] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:39.546155 10820 leader_election.cc:304] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d
I20260709 12:26:39.489128 15709 raft_consensus.cc:515] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:39.550674 15719 raft_consensus.cc:2804] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:39.551105 15719 raft_consensus.cc:493] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:39.551501 15719 raft_consensus.cc:3060] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:39.554560 15456 leader_election.cc:290] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:39.555060 15640 raft_consensus.cc:3055] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:26:39.555469 15640 raft_consensus.cc:740] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
I20260709 12:26:39.518296 15726 consensus_queue.cc:1059] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 12:26:39.536154 15446 raft_consensus.cc:2804] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:39.535944 15717 raft_consensus.cc:2749] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:39.536388 15620 leader_election.cc:290] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:39.560614 10820 leader_election.cc:304] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:39.527810 15702 consensus_queue.cc:1048] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 12:26:39.542518 15467 raft_consensus.cc:697] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 12 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:39.561574 10995 raft_consensus.cc:2468] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 11.
I20260709 12:26:39.568674 10895 leader_election.cc:304] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:39.570295 15726 raft_consensus.cc:3055] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:26:39.570896 15726 raft_consensus.cc:740] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:39.572605 15510 raft_consensus.cc:2804] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:26:39.571839 15621 consensus_queue.cc:260] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:39.573765 15621 raft_consensus.cc:3060] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:39.547420 15721 raft_consensus.cc:2749] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:39.548756 15715 raft_consensus.cc:2749] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:39.548579 15646 raft_consensus.cc:3060] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:39.556252 15540 raft_consensus.cc:493] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:39.524252 15658 consensus_queue.cc:260] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:39.545414 15671 raft_consensus.cc:515] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:39.579180 10820 leader_election.cc:304] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:39.595503 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fd8fdac2fa449e9e184f3d668ea1a7" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:39.578951 15616 raft_consensus.cc:2804] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:26:39.676729 10848 raft_consensus.cc:2468] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 8.
I20260709 12:26:39.676990 15616 raft_consensus.cc:493] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:39.587814 10853 raft_consensus.cc:1240] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Rejecting Update request from peer 3c52e0825c02476e89d84da9bb849f5d for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:39.594748 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
W20260709 12:26:39.679889 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 100786us
I20260709 12:26:39.682757 10968 leader_election.cc:304] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:39.655155 15456 raft_consensus.cc:493] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:39.558887 15516 consensus_queue.cc:237] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:39.604024 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fd8fdac2fa449e9e184f3d668ea1a7" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:39.628119 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:39.649982 11588 leader_election.cc:304] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
W20260709 12:26:39.699698 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 49844.6us
I20260709 12:26:39.710776 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:39.718034 11588 leader_election.cc:304] T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040; no voters: 
W20260709 12:26:39.755697 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 187135us
I20260709 12:26:39.723935 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:39.724303 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
W20260709 12:26:39.720098 10818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:39.695473 15717 raft_consensus.cc:2804] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:26:39.573215 15510 raft_consensus.cc:697] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:39.777896 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:39.774072 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:39.784400 10850 raft_consensus.cc:3060] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:26:39.632265 15751 log.cc:927] Time spent T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:26:39.573827 15700 raft_consensus.cc:3055] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:26:39.672050 15754 log.cc:927] Time spent T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 12:26:39.577976 15446 raft_consensus.cc:697] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 6 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:39.782419 10853 raft_consensus.cc:1240] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 14 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 13. Current term is 14. Ops: []
I20260709 12:26:39.677489 15616 raft_consensus.cc:3060] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:39.602921 15323 leader_election.cc:290] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:39.629196 15458 raft_consensus.cc:493] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:39.790484 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac8522e549a46e09593fa4c2e175557" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:39.811280 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:39.666224 15669 leader_election.cc:290] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:26:39.771894 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 53999.1us
I20260709 12:26:39.703265 15456 raft_consensus.cc:515] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:39.813962 15671 leader_election.cc:290] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:39.814371 11588 leader_election.cc:304] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:39.815126 15323 raft_consensus.cc:2749] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:39.794651 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:39.816193 15458 raft_consensus.cc:515] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:39.816691 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:39.817574 10848 raft_consensus.cc:2368] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for earlier term 7. Current term is 8.
I20260709 12:26:39.818555 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:39.818648 15458 leader_election.cc:290] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:39.727312 10845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:39.633642 15655 leader_election.cc:290] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:39.820809 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:39.821696 15655 raft_consensus.cc:493] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:39.822322 10994 raft_consensus.cc:2468] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 12.
I20260709 12:26:39.760567 15485 raft_consensus.cc:2749] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:26:39.814543 15456 leader_election.cc:290] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:39.821134 10845 raft_consensus.cc:1240] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 12. Current term is 13. Ops: []
I20260709 12:26:39.802037 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:39.689716 15703 leader_election.cc:290] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:39.824935 10820 leader_election.cc:304] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:39.777545 15612 raft_consensus.cc:2804] T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:26:39.833031 15617 raft_consensus.cc:2804] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:26:39.816957 15446 consensus_queue.cc:237] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:39.834143 15612 raft_consensus.cc:493] T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:39.834666 15612 raft_consensus.cc:3060] T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:39.835832 15594 raft_consensus.cc:2804] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:39.836076 15617 raft_consensus.cc:697] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d [term 8 LEADER]: Becoming Leader. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
I20260709 12:26:39.836374 15594 raft_consensus.cc:493] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:39.836795 15594 raft_consensus.cc:3060] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:39.837270 15617 consensus_queue.cc:237] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:39.797497 15478 raft_consensus.cc:515] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:39.823462 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 13 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:39.841122 10994 raft_consensus.cc:2468] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 11.
I20260709 12:26:39.842314 15478 leader_election.cc:290] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:39.842607 10820 leader_election.cc:304] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:39.843088 10997 raft_consensus.cc:1240] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Rejecting Update request from peer 3c52e0825c02476e89d84da9bb849f5d for earlier term 7. Current term is 8. Ops: []
I20260709 12:26:39.843879 15715 raft_consensus.cc:2804] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:39.844395 15715 raft_consensus.cc:493] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:39.844553 15756 log.cc:927] Time spent T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:26:39.844875 15715 raft_consensus.cc:3060] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:39.846911 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
W20260709 12:26:39.786471 10895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:39.853391 10851 raft_consensus.cc:2393] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 14: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:26:39.854298 10853 raft_consensus.cc:1275] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:26:39.800052 15700 raft_consensus.cc:740] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:39.773525 15717 raft_consensus.cc:697] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [term 7 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:39.860739 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:39.600858 15467 consensus_queue.cc:237] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:39.862805 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:39.854907 10850 raft_consensus.cc:2468] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 13.
I20260709 12:26:39.740093 15540 raft_consensus.cc:515] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:39.872059 15760 log.cc:927] Time spent T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 12:26:39.876032 15647 raft_consensus.cc:3060] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:39.877677 15762 raft_consensus.cc:493] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:39.883522 10924 raft_consensus.cc:3055] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:26:39.909771 10924 raft_consensus.cc:740] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:39.883865 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:39.884841 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
W20260709 12:26:39.856149 15755 log.cc:927] Time spent T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.321s	user 0.000s	sys 0.002s
W20260709 12:26:39.886062 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 203418us
W20260709 12:26:39.926357 10892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:39.900390 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:39.825316 15655 raft_consensus.cc:515] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:39.905539 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:39.913031 10929 raft_consensus.cc:2393] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 13: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:26:39.909691 15757 raft_consensus.cc:493] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
W20260709 12:26:39.935555 15758 log.cc:927] Time spent T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 12:26:39.936178 15722 raft_consensus.cc:3060] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:39.935707 15757 raft_consensus.cc:515] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:39.937567 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9331e5342644ca2bae19187b083a7d5" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:39.938740 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352aa49c65194abbb863d7553a091f11" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:39.939275 11002 raft_consensus.cc:3060] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:39.910804 10924 consensus_queue.cc:260] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:39.918434 15612 raft_consensus.cc:515] T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:39.922019 15216 raft_consensus.cc:515] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:39.599895 15640 consensus_queue.cc:260] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:39.852566 15709 leader_election.cc:290] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 14 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:39.926927 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:39.927847 10995 raft_consensus.cc:2468] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 12.
I20260709 12:26:39.956058 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:39.956331 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:39.929432 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:39.932571 10968 leader_election.cc:304] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:39.945250 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:39.960153 10928 raft_consensus.cc:2393] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 10: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:26:39.960289 10850 raft_consensus.cc:2393] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 14: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:26:39.960214 11001 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8"
dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
mode: GRACEFUL
new_leader_uuid: "80cd7d227db44f34a6108591dad9c040"
 from {username='slave'} at 127.0.0.1:32960
I20260709 12:26:39.935631 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:39.961966 10929 raft_consensus.cc:3060] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:39.963663 10968 leader_election.cc:304] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:39.940218 10924 raft_consensus.cc:3060] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:39.943651 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:39.946934 10820 leader_election.cc:304] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:26:39.966135 10927 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50036 (request call id 982) took 1639 ms (client timeout 1809 ms). Trace:
W20260709 12:26:39.966519 10927 rpcz_store.cc:269] 0709 12:26:38.326696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:38.327827 (+  1131us) service_pool.cc:224] Handling call
0709 12:26:39.943437 (+1615610us) spinlock_profiling.cc:243] Waited 4.52 ms on lock 0x7b5800002d98. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7591c23db1 00007f7591d63b71 00007f7591d63a22 00007f759ac7c8d9 00007f7599dd6ee0 00007f7599ea00ab 00007f7599ea0131 00007f7599e4e0a0 00007f7599e4d984 00007f75933c86d4 00007f75933c8662
0709 12:26:39.966072 (+ 22635us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10400128}
I20260709 12:26:39.966912 10820 leader_election.cc:304] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:39.968089 10820 leader_election.cc:304] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:39.912137 15712 raft_consensus.cc:3055] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:26:39.951200 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 127418us
I20260709 12:26:39.939523 15757 leader_election.cc:290] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:39.961175 11001 raft_consensus.cc:606] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Received request to transfer leadership to TS 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:39.974424 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:39.974967 11001 raft_consensus.cc:614] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:39.969873 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:39.975361 10927 raft_consensus.cc:2468] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 10.
I20260709 12:26:39.975785 10995 raft_consensus.cc:3060] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:39.970137 10820 leader_election.cc:304] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:39.961398 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:39.976540 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:39.977394 10927 raft_consensus.cc:2468] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 8.
I20260709 12:26:39.975932 11588 leader_election.cc:304] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040; no voters: 
I20260709 12:26:39.991776 10968 leader_election.cc:304] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:39.993527 11002 raft_consensus.cc:2468] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 4.
I20260709 12:26:39.993582 11620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352aa49c65194abbb863d7553a091f11" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:39.992915 11616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:39.991771 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fd8fdac2fa449e9e184f3d668ea1a7" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:39.997089 11621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:40.002200 10968 leader_election.cc:304] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:40.003091 10995 raft_consensus.cc:2468] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 14.
I20260709 12:26:39.904390 15510 consensus_queue.cc:237] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:39.970738 15703 raft_consensus.cc:2749] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:26:39.969579 15523 raft_consensus.cc:2749] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:39.926237 15762 raft_consensus.cc:515] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:39.992784 15640 raft_consensus.cc:3060] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:40.013252 11001 raft_consensus.cc:1275] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:26:40.011109 10929 raft_consensus.cc:2468] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 8.
I20260709 12:26:40.043238 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad766f48812a4ddeb383179b1d84907b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:39.997942 15757 raft_consensus.cc:2749] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:26:40.043983 11001 raft_consensus.cc:2468] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 6.
I20260709 12:26:40.016853 15766 raft_consensus.cc:2749] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:26:40.018913 10968 leader_election.cc:304] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:40.020239 15478 raft_consensus.cc:2804] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:26:40.022753 15708 consensus_meta.cc:287] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040: Time spent flushing consensus metadata: real 0.690s	user 0.010s	sys 0.005s
I20260709 12:26:40.023841 11619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5794ba618e514e28a7542ab6af39d8c9" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:40.024724 15646 raft_consensus.cc:515] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:40.016016 10924 raft_consensus.cc:1275] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 12:26:40.029659 15540 leader_election.cc:290] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:40.030727 15655 leader_election.cc:290] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:40.000608 15617 consensus_queue.cc:1059] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:26:40.035993 15216 leader_election.cc:290] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 6 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:39.982410 15716 raft_consensus.cc:2804] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:40.036751 15767 raft_consensus.cc:2749] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:26:39.972664 15712 raft_consensus.cc:740] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:39.980870 15620 raft_consensus.cc:2749] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:40.051790 15621 consensus_queue.cc:1048] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 12:26:40.062270 15716 raft_consensus.cc:493] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:40.065026 15716 raft_consensus.cc:3060] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:40.065891 15646 leader_election.cc:290] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 election: Requested vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:40.000979 15614 raft_consensus.cc:2804] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:26:40.067804 15614 raft_consensus.cc:493] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:40.068267 15614 raft_consensus.cc:3060] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:40.044955 15520 consensus_queue.cc:1048] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:26:39.980230 15717 consensus_queue.cc:237] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:40.071224 15712 consensus_queue.cc:260] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:40.072461 15712 raft_consensus.cc:3060] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:40.058110 15516 raft_consensus.cc:2749] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:26:40.074793 15726 consensus_queue.cc:260] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:40.053229 15478 raft_consensus.cc:493] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:40.052110 15719 raft_consensus.cc:515] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:40.083539 15726 raft_consensus.cc:3060] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:40.089411 15762 leader_election.cc:290] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:40.090175 15767 raft_consensus.cc:493] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:40.090684 15767 raft_consensus.cc:515] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:40.084451 15478 raft_consensus.cc:3060] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:40.086695 15719 leader_election.cc:290] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 11 election: Requested vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:40.096856 15767 leader_election.cc:290] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:40.053948 11588 leader_election.cc:304] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
W20260709 12:26:40.098034 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 44366.6us
I20260709 12:26:40.054289 10968 leader_election.cc:304] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:40.056963 10924 pending_rounds.cc:85] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea: Aborting all ops after (but not including) 5
I20260709 12:26:40.293370 10924 pending_rounds.cc:107] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 12:26:40.294062 10924 raft_consensus.cc:2889] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:40.150991 10995 raft_consensus.cc:1275] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:26:40.272970 10847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46480 (request call id 823) took 1372 ms. Trace:
I20260709 12:26:40.274483 10920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50036 (request call id 983) took 1947 ms. Trace:
I20260709 12:26:40.107163 15478 raft_consensus.cc:515] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:40.076458 15612 leader_election.cc:290] T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 7 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:40.100521 15616 raft_consensus.cc:515] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:40.145839 10999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37512 (request call id 3521) took 1185 ms. Trace:
I20260709 12:26:40.202206 15458 raft_consensus.cc:493] T e9331e5342644ca2bae19187b083a7d5 P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:40.151153 15614 raft_consensus.cc:515] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:40.121690 15516 raft_consensus.cc:2749] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:26:40.108903 15522 raft_consensus.cc:3055] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:40.071511 15715 raft_consensus.cc:515] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:40.120920 10998 raft_consensus.cc:1275] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:26:40.113001 10997 raft_consensus.cc:1240] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Rejecting Update request from peer 3c52e0825c02476e89d84da9bb849f5d for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:40.060511 11003 raft_consensus.cc:1240] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Rejecting Update request from peer 3c52e0825c02476e89d84da9bb849f5d for earlier term 10. Current term is 11. Ops: []
I20260709 12:26:40.271759 10849 raft_consensus.cc:2468] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 12.
W20260709 12:26:40.291458 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 96209.4us
I20260709 12:26:40.108114 11002 raft_consensus.cc:1240] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 11. Current term is 12. Ops: []
I20260709 12:26:40.105651 15594 raft_consensus.cc:515] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:40.109644 15636 raft_consensus.cc:3055] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:26:40.117951 10969 leader_election.cc:304] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:40.049001 10895 leader_election.cc:304] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:40.099426 15619 raft_consensus.cc:2749] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:26:40.157641 10994 raft_consensus.cc:1240] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 14 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:26:40.046631 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:40.348120 11001 raft_consensus.cc:1813] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Handling vote request from an unknown peer e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:40.310508 10999 rpcz_store.cc:276] 0709 12:26:38.960847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:38.962982 (+  2135us) service_pool.cc:224] Handling call
0709 12:26:38.963290 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:39.108035 (+144745us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:26:39.194764 (+ 86729us) log.cc:844] Serialized 14 byte log entry
0709 12:26:39.300519 (+105755us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:39.300570 (+    51us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:26:39.300608 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:40.145519 (+844911us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b54002d3054. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e88e01 00007f7594e8783e 00007f7599e4c419 00007f75933c3bd4 00007f75933c3b62 00007f75933c3a91 00007f75933c3a0c 00007f75933c2cc2 00007f75931c348c 00007f75931c28c6
0709 12:26:40.145581 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:40.145765 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":164782,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":4438,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":100,"spinlock_wait_cycles":332157312,"thread_start_us":179827,"threads_started":2,"wal-append.queue_time_us":166316}
I20260709 12:26:40.349310 11001 raft_consensus.cc:2393] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 11: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
W20260709 12:26:40.351465 10969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 233549us
I20260709 12:26:40.324167 15594 leader_election.cc:290] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 13 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:26:40.099764 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 45536.2us
I20260709 12:26:40.359793 15663 raft_consensus.cc:2804] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:26:40.360848 15663 raft_consensus.cc:493] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:40.361456 10894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:40.362007 15663 raft_consensus.cc:3060] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:40.142097 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9331e5342644ca2bae19187b083a7d5" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:40.145453 11615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 13 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:40.081427 15658 raft_consensus.cc:3060] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:40.125794 15700 consensus_queue.cc:260] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:40.292326 10921 raft_consensus.cc:1240] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 LEADER]: Rejecting Update request from peer 3c52e0825c02476e89d84da9bb849f5d for earlier term 10. Current term is 11. Ops: []
W20260709 12:26:40.105434 11587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:40.110643 15716 raft_consensus.cc:515] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:40.076601 15720 raft_consensus.cc:493] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
W20260709 12:26:40.231272 15759 log.cc:927] Time spent T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.458s	user 0.004s	sys 0.002s
I20260709 12:26:40.316231 10845 raft_consensus.cc:1240] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 9. Current term is 10. Ops: []
W20260709 12:26:40.286816 10819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:40.296994 10926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59626 (request call id 3625) took 1781 ms. Trace:
I20260709 12:26:40.319133 10998 raft_consensus.cc:1240] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 6. Current term is 7. Ops: [6.5-6.5]
W20260709 12:26:40.362540 10894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:40.319439 10997 raft_consensus.cc:1275] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:26:40.295562 10924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59626 (request call id 3631) took 1319 ms. Trace:
W20260709 12:26:40.324782 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 275762us
W20260709 12:26:40.305305 11588 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.116.66:39339 timed out after 1.809s (SENT) [suppressed 4 similar messages]
I20260709 12:26:40.343803 11623 raft_consensus.cc:2393] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 9: Already voted for candidate 3c52e0825c02476e89d84da9bb849f5d in this term.
W20260709 12:26:40.308789 15601 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 12:26:40.308077 10847 rpcz_store.cc:276] 0709 12:26:38.900540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:38.900749 (+   209us) service_pool.cc:224] Handling call
0709 12:26:38.901275 (+   526us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:39.258758 (+357483us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:40.271958 (+1013200us) spinlock_profiling.cc:243] Waited 357 ms on lock 0x7b54002120d4. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e88e01 00007f7594e8783e 00007f7599e4c419 00007f75933c3bd4 00007f75933c3b62 00007f75933c3a91 00007f75933c3a0c 00007f75933c2cc2 00007f75931c348c 00007f75931c28c6
0709 12:26:40.272552 (+   594us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":820620544}
I20260709 12:26:40.398176 15613 raft_consensus.cc:493] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:40.400668 15458 raft_consensus.cc:515] T e9331e5342644ca2bae19187b083a7d5 P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:40.407394 11586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:40.409672 15510 raft_consensus.cc:493] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:40.410624 15510 raft_consensus.cc:515] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:40.411873 10820 leader_election.cc:304] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:40.412118 10851 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a"
dest_uuid: "80cd7d227db44f34a6108591dad9c040"
mode: GRACEFUL
new_leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
 from {username='slave'} at 127.0.0.1:47358
I20260709 12:26:40.413259 10851 raft_consensus.cc:606] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Received request to transfer leadership to TS e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:40.413787 10851 raft_consensus.cc:614] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:26:40.413959 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 54598.3us
I20260709 12:26:40.414258 15594 raft_consensus.cc:2804] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:26:40.415082 15594 raft_consensus.cc:697] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 14 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:40.417709 15520 raft_consensus.cc:493] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:40.417204 15594 consensus_queue.cc:237] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:40.394654 10924 rpcz_store.cc:276] 0709 12:26:38.976211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:38.976388 (+   177us) service_pool.cc:224] Handling call
0709 12:26:39.007896 (+ 31508us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:39.883320 (+875424us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x7b540015a520. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594dffdc0 00007f7594e8a1c0 00007f7594e8b231 00007f7594e87d8f 00007f7594e8783e 00007f7599e4c419 00007f75933c3bd4 00007f75933c3b62 00007f75933c3a91 00007f75933c3a0c
0709 12:26:40.295040 (+411720us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:40.295484 (+   444us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36167936}
I20260709 12:26:40.415274 10820 leader_election.cc:304] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:40.316327 15715 leader_election.cc:290] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 13 election: Requested vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:40.421972 15510 leader_election.cc:290] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:40.428289 11619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:40.428975 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:40.429709 11619 raft_consensus.cc:2468] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 9.
I20260709 12:26:40.429973 10923 raft_consensus.cc:2468] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 8.
I20260709 12:26:40.431927 11000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37500 (request call id 3959) took 1134 ms. Trace:
I20260709 12:26:40.432221 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6a1da21304fcfacab384a6afc4101" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:40.433857 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18294423a68a4671bf6c5a0f98645e4c" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:40.434547 10927 raft_consensus.cc:3060] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:40.435057 10925 raft_consensus.cc:3060] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:26:40.435971 15669 raft_consensus.cc:2749] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:40.436235 11620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:40.313215 15522 raft_consensus.cc:740] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
I20260709 12:26:40.438814 15613 raft_consensus.cc:515] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:40.310012 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:40.441690 10995 raft_consensus.cc:2393] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 9: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:26:40.441951 15613 leader_election.cc:290] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:40.366820 10968 leader_election.cc:304] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:40.321962 15636 raft_consensus.cc:740] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
W20260709 12:26:40.444715 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 78379us
I20260709 12:26:40.445319 15636 consensus_queue.cc:260] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:40.446110 10968 leader_election.cc:304] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:40.447067 15636 raft_consensus.cc:3060] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:40.311973 15515 raft_consensus.cc:493] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:40.446794 11621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63ecfc9bd3945818cfe15c03f001315" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:40.325407 15614 leader_election.cc:290] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 9 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:40.312813 15616 leader_election.cc:290] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 10 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:40.315268 15605 raft_consensus.cc:493] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:40.311328 15446 raft_consensus.cc:493] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:40.391484 10926 rpcz_store.cc:276] 0709 12:26:38.515272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:38.515412 (+   140us) service_pool.cc:224] Handling call
0709 12:26:38.515711 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:38.622513 (+106802us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:38.622561 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:38.622622 (+    61us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:26:38.622677 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:40.296075 (+1673398us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b5400287dd4. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e88e01 00007f7594e8783e 00007f7599e4c419 00007f75933c3bd4 00007f75933c3b62 00007f75933c3a91 00007f75933c3a0c 00007f75933c2cc2 00007f75931c348c 00007f75931c28c6
0709 12:26:40.296182 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:40.296648 (+   466us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":244838144}
W20260709 12:26:40.452279 10895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:40.438670 15522 consensus_queue.cc:260] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:40.464224 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 49221.9us
I20260709 12:26:40.464489 15719 raft_consensus.cc:493] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:40.465771 15719 raft_consensus.cc:515] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:40.467877 15720 raft_consensus.cc:3060] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:40.468151 15718 raft_consensus.cc:2804] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:40.469404 15718 raft_consensus.cc:697] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:40.471621 15701 consensus_queue.cc:1048] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:26:40.471962 15605 raft_consensus.cc:515] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:40.474325 15717 raft_consensus.cc:493] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:40.475940 15446 raft_consensus.cc:515] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:40.472040 15722 consensus_queue.cc:1048] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:40.481657 10851 raft_consensus.cc:1240] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Rejecting Update request from peer 3c52e0825c02476e89d84da9bb849f5d for earlier term 12. Current term is 13. Ops: []
I20260709 12:26:40.478639 15216 consensus_queue.cc:1059] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:26:40.482884 15216 consensus_queue.cc:1243] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Peer edcc56ddd3264984b4da6c1db59e7f08 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:26:40.475200 15717 raft_consensus.cc:515] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:40.483610 15612 raft_consensus.cc:3055] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:26:40.484018 15612 raft_consensus.cc:740] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
I20260709 12:26:40.484426 10929 raft_consensus.cc:1240] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Rejecting Update request from peer 3c52e0825c02476e89d84da9bb849f5d for earlier term 7. Current term is 8. Ops: [4.6-7.7]
I20260709 12:26:40.485626 15767 raft_consensus.cc:2804] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:40.485387 15612 consensus_queue.cc:260] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:40.471347 15718 consensus_queue.cc:237] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:40.486778 15767 raft_consensus.cc:697] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [term 6 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:26:40.487705 15516 raft_consensus.cc:2749] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:26:40.488642 15612 raft_consensus.cc:3060] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:40.489317 15515 raft_consensus.cc:515] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:40.489349 15767 consensus_queue.cc:237] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:40.493822 10922 raft_consensus.cc:1275] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:26:40.501796 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:40.503062 11622 raft_consensus.cc:2468] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 12.
I20260709 12:26:40.505216 15700 raft_consensus.cc:3060] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:40.433207 11000 rpcz_store.cc:276] 0709 12:26:39.298307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:39.368341 (+ 70034us) service_pool.cc:224] Handling call
0709 12:26:39.368756 (+   415us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:39.371986 (+  3230us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:39.372041 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:39.372638 (+   597us) log.cc:844] Serialized 26 byte log entry
0709 12:26:39.521108 (+148470us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:26:39.521181 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:39.521290 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:40.230390 (+709100us) spinlock_profiling.cc:243] Waited 5.34 ms on lock 0x7b4400022b4c. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7591c23db1 00007f7591cc1c85 00007f7591cc26a2 00007f7594a341db 00007f7594a2faaf 00007f7594a2386e 00007f7594a22bb6 00007f7594a227d8 00007f7594a2c221 00007f7594a2c1d9 00007f7594a2c169
0709 12:26:40.431017 (+200627us) raft_consensus.cc:1685] finished
0709 12:26:40.431074 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:40.431552 (+   478us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2752,"raft.queue_time_us":2942,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":10509,"spinlock_wait_cycles":12275456,"thread_start_us":106563,"threads_started":1,"wal-append.queue_time_us":236296}
I20260709 12:26:40.521611 15716 leader_election.cc:290] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 13 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:40.527428 15614 consensus_queue.cc:1059] T b289bc89d592435fb63c7fcf580d95a4 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:26:40.527544 15639 consensus_queue.cc:1059] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:26:40.528602 11624 raft_consensus.cc:2410] T e9331e5342644ca2bae19187b083a7d5 P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:26:40.529423 15585 raft_consensus.cc:3055] T b289bc89d592435fb63c7fcf580d95a4 P 3c52e0825c02476e89d84da9bb849f5d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:26:40.529840 15605 leader_election.cc:290] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:40.530094 15585 raft_consensus.cc:740] T b289bc89d592435fb63c7fcf580d95a4 P 3c52e0825c02476e89d84da9bb849f5d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
I20260709 12:26:40.532012 15585 consensus_queue.cc:260] T b289bc89d592435fb63c7fcf580d95a4 P 3c52e0825c02476e89d84da9bb849f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:40.534372 15639 raft_consensus.cc:3055] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:40.535100 15639 raft_consensus.cc:740] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
I20260709 12:26:40.539850 15639 consensus_queue.cc:260] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:40.543303 15478 leader_election.cc:290] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:40.419081 15520 raft_consensus.cc:515] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:40.554384 10895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:40.558261 11586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:40.568408 10895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:40.570781 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 265779us
I20260709 12:26:40.579784 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:40.580936 10998 raft_consensus.cc:2393] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 11: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
W20260709 12:26:40.582204 10892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:40.580058 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 93145.4us
I20260709 12:26:40.587985 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6a1da21304fcfacab384a6afc4101" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:40.588967 10851 raft_consensus.cc:3060] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:26:40.593422 10846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56388 (request call id 3210) took 1463 ms. Trace:
I20260709 12:26:40.594144 10846 rpcz_store.cc:276] 0709 12:26:39.130081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:39.130569 (+   488us) service_pool.cc:224] Handling call
0709 12:26:40.592695 (+1462126us) spinlock_profiling.cc:243] Waited 81.6 ms on lock 0x7b5400212fd4. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e8c2fa 00007f7599e4db17 00007f75933c86d4 00007f75933c8662 00007f75933c8591 00007f75933c850c 00007f75933c77c2 00007f75931c348c 00007f75931c28c6 00007f75931c226f
0709 12:26:40.593103 (+   408us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":187689728}
I20260709 12:26:40.604851 15458 leader_election.cc:290] T e9331e5342644ca2bae19187b083a7d5 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:40.609169 10921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50036 (request call id 1000) took 1004 ms. Trace:
I20260709 12:26:40.609717 10921 rpcz_store.cc:276] 0709 12:26:39.604450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:39.607765 (+  3315us) service_pool.cc:224] Handling call
0709 12:26:39.608233 (+   468us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:40.408937 (+800704us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:40.608769 (+199832us) spinlock_profiling.cc:243] Waited 683 ms on lock 0x7b540012c5d4. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e88e01 00007f7594e8783e 00007f7599e4c419 00007f75933c3bd4 00007f75933c3b62 00007f75933c3a91 00007f75933c3a0c 00007f75933c2cc2 00007f75931c348c 00007f75931c28c6
0709 12:26:40.609074 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1571662720}
I20260709 12:26:40.308229 10920 rpcz_store.cc:276] 0709 12:26:38.327077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:38.328068 (+   991us) service_pool.cc:224] Handling call
0709 12:26:39.674068 (+1346000us) spinlock_profiling.cc:243] Waited 4.06 ms on lock 0x7b5800002d98. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7591c23db1 00007f7591d63b71 00007f7591d63a22 00007f759ac7c8d9 00007f7599dd6ee0 00007f7599ea00ab 00007f7599ea0131 00007f7599e61fc0 00007f7599e4c929 00007f7599e4c3d2 00007f75933c3bd4
0709 12:26:39.674363 (+   295us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:26:39.674857 (+   494us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:39.674895 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:26:39.698098 (+ 23203us) log.cc:844] Serialized 52 byte log entry
0709 12:26:39.976399 (+278301us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:26:40.272509 (+296110us) log.cc:844] Serialized 14 byte log entry
0709 12:26:40.273321 (+   812us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:40.273511 (+   190us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:40.273624 (+   113us) raft_consensus.cc:1685] finished
0709 12:26:40.273764 (+   140us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:40.274122 (+   358us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":175623,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"raft.queue_time_us":123055,"raft.run_cpu_time_us":430,"raft.run_wall_time_us":430,"spinlock_wait_cycles":9345792,"thread_start_us":435073,"threads_started":2,"wal-append.queue_time_us":302680}
W20260709 12:26:40.618328 10895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:40.557405 15515 leader_election.cc:290] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:40.631438 11615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:40.631853 11618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:40.632771 11618 raft_consensus.cc:2468] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 10.
I20260709 12:26:40.633149 11621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:40.634140 11621 raft_consensus.cc:2468] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 14.
I20260709 12:26:40.634968 10969 leader_election.cc:304] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
W20260709 12:26:40.644897 11589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:40.646773 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18294423a68a4671bf6c5a0f98645e4c" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:40.644440 10820 leader_election.cc:304] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
W20260709 12:26:40.654065 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 208134us
W20260709 12:26:40.658151 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 48314.4us
I20260709 12:26:40.640079 15446 leader_election.cc:290] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:26:40.661375 11589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:40.661634 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:40.665951 10997 raft_consensus.cc:1240] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Rejecting Update request from peer 3c52e0825c02476e89d84da9bb849f5d for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:26:40.666200 10925 raft_consensus.cc:2468] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 6.
I20260709 12:26:40.672412 15516 raft_consensus.cc:493] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:40.673166 15516 raft_consensus.cc:515] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:40.673570 10969 leader_election.cc:304] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:40.675333 15520 leader_election.cc:290] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:40.676409 15766 raft_consensus.cc:2749] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:26:40.679991 15716 raft_consensus.cc:2749] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:26:40.677295 10968 leader_election.cc:304] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:40.670729 15478 raft_consensus.cc:2804] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:26:40.684504 10999 raft_consensus.cc:3060] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:40.685200 11620 raft_consensus.cc:1240] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 8. Current term is 9. Ops: []
I20260709 12:26:40.657258 15669 raft_consensus.cc:493] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:40.689530 15478 raft_consensus.cc:493] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:40.694475 15478 raft_consensus.cc:3060] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:40.694541 15669 raft_consensus.cc:515] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:40.696154 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:40.697789 15669 leader_election.cc:290] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:40.684504 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
W20260709 12:26:40.702071 11586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:40.687315 15639 raft_consensus.cc:3060] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:40.686805 15059 raft_consensus.cc:493] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:40.671559 11619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:40.691196 15719 leader_election.cc:290] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:40.721799 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fd8fdac2fa449e9e184f3d668ea1a7" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:40.724038 15712 raft_consensus.cc:493] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:40.726353 10996 raft_consensus.cc:1240] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 10. Current term is 11. Ops: []
I20260709 12:26:40.733032 15585 raft_consensus.cc:3060] T b289bc89d592435fb63c7fcf580d95a4 P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:40.709337 15717 leader_election.cc:290] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:40.742394 10927 raft_consensus.cc:2468] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 7.
I20260709 12:26:40.702157 15516 leader_election.cc:290] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:26:40.755309 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 138253us
I20260709 12:26:40.762351 11001 raft_consensus.cc:1240] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Rejecting Update request from peer 3c52e0825c02476e89d84da9bb849f5d for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:40.764227 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9331e5342644ca2bae19187b083a7d5" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:40.733198 15712 raft_consensus.cc:515] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:40.741956 15059 raft_consensus.cc:515] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:40.750052 15766 raft_consensus.cc:3060] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:40.760113 11619 raft_consensus.cc:1813] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Handling vote request from an unknown peer e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:40.780588 11619 raft_consensus.cc:2410] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for term 11 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:26:40.755482 15669 raft_consensus.cc:493] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:40.792392 10820 leader_election.cc:304] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:26:40.821854 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 146592us
W20260709 12:26:40.814160 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 76186.2us
W20260709 12:26:40.833725 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 144948us
I20260709 12:26:40.823124 15522 raft_consensus.cc:3060] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:40.842581 10994 raft_consensus.cc:3060] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:40.842221 15594 raft_consensus.cc:2749] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:26:40.881590 11586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:40.860742 15712 leader_election.cc:290] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:40.842368 15669 raft_consensus.cc:515] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:40.891274 10895 leader_election.cc:304] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:40.889272 10921 raft_consensus.cc:1240] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Rejecting Update request from peer 3c52e0825c02476e89d84da9bb849f5d for earlier term 8. Current term is 9. Ops: []
W20260709 12:26:40.903815 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 134885us
I20260709 12:26:40.905242 10820 leader_election.cc:304] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:26:40.894029 10969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 64040.7us
W20260709 12:26:40.906131 15785 log.cc:927] Time spent T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d: Append to log took a long time: real 0.274s	user 0.005s	sys 0.000s
I20260709 12:26:40.890460 15762 raft_consensus.cc:493] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:40.910049 10968 leader_election.cc:304] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
W20260709 12:26:40.921916 11586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:40.911129 15712 raft_consensus.cc:2764] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:26:40.883265 15767 raft_consensus.cc:493] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:40.890405 15449 raft_consensus.cc:493] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:40.932145 15449 raft_consensus.cc:515] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:40.934470 15449 leader_election.cc:290] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:40.935143 15762 raft_consensus.cc:515] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } }
I20260709 12:26:40.936385 15516 raft_consensus.cc:2749] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:40.937803 15762 leader_election.cc:290] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265)
I20260709 12:26:40.897981 15059 leader_election.cc:290] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:40.940066 11588 leader_election.cc:304] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:40.940323 15795 consensus_queue.cc:1048] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:26:40.892379 15605 consensus_queue.cc:1059] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:26:40.943884 15767 raft_consensus.cc:515] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:40.944681 15786 log.cc:927] Time spent T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:26:40.889572 15717 raft_consensus.cc:493] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:40.946378 15717 raft_consensus.cc:515] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:40.949075 15767 leader_election.cc:290] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:40.930929 15478 raft_consensus.cc:515] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:40.950349 11619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab816bcc6183447994a2cc013e46c5f8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:40.951256 11003 raft_consensus.cc:2393] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3c52e0825c02476e89d84da9bb849f5d in current term 10: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:26:40.954917 10999 raft_consensus.cc:2468] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 6.
I20260709 12:26:40.889979 15663 raft_consensus.cc:515] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:40.962893 15636 consensus_meta.cc:287] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d: Time spent flushing consensus metadata: real 0.505s	user 0.010s	sys 0.010s
I20260709 12:26:40.971426 10994 raft_consensus.cc:1275] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 10 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260709 12:26:40.953555 15718 raft_consensus.cc:2749] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:26:40.952131 15478 leader_election.cc:290] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 10 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
W20260709 12:26:40.977068 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 67135.3us
I20260709 12:26:40.985971 11589 leader_election.cc:304] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:40.968245 15601 raft_consensus.cc:493] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:40.992964 11619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:40.978434 15717 leader_election.cc:290] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:41.000349 11619 raft_consensus.cc:3060] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:40.980646 15059 raft_consensus.cc:2749] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:40.971776 15720 raft_consensus.cc:515] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:41.004797 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:41.009045 10851 raft_consensus.cc:2468] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 7.
W20260709 12:26:41.011310 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 120224us
I20260709 12:26:41.005316 10820 leader_election.cc:304] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:41.017407 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:41.021948 10998 raft_consensus.cc:1240] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Rejecting Update request from peer 3c52e0825c02476e89d84da9bb849f5d for earlier term 10. Current term is 11. Ops: []
W20260709 12:26:41.024379 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 84592.3us
I20260709 12:26:41.026183 11002 raft_consensus.cc:1275] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:26:41.028535 15658 consensus_meta.cc:287] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent flushing consensus metadata: real 0.531s	user 0.010s	sys 0.016s
W20260709 12:26:41.029664 15793 log.cc:927] Time spent T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 12:26:41.024102 15717 raft_consensus.cc:3060] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:41.023504 10894 leader_election.cc:304] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:41.039333 15658 raft_consensus.cc:2749] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:41.040146 10894 leader_election.cc:304] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:41.045482 11619 raft_consensus.cc:2468] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 10.
I20260709 12:26:41.047190 10969 leader_election.cc:304] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:41.054131 15619 consensus_queue.cc:1048] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 12:26:41.050140 15216 consensus_queue.cc:1048] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 12:26:41.023152 15712 consensus_queue.cc:1059] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 12:26:41.057394 15636 raft_consensus.cc:2804] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:41.058084 15636 raft_consensus.cc:697] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d [term 6 LEADER]: Becoming Leader. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
I20260709 12:26:41.060379 15663 leader_election.cc:290] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:26:41.063789 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 171824us
I20260709 12:26:41.053333 15797 raft_consensus.cc:2804] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:26:41.068251 15797 raft_consensus.cc:697] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
W20260709 12:26:41.068521 15791 log.cc:927] Time spent T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:26:41.069461 15797 consensus_queue.cc:237] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:41.072147 15712 raft_consensus.cc:2749] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:26:41.073218 11588 leader_election.cc:304] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:41.074837 15594 raft_consensus.cc:493] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:41.075474 15594 raft_consensus.cc:515] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:41.076798 15720 leader_election.cc:290] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:41.077831 15594 leader_election.cc:290] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:41.078521 15594 consensus_queue.cc:1048] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:41.079162 15594 consensus_queue.cc:1243] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer e2d5c637307a407ab688f5ccd6f0fcea log is divergent from this leader: its last log entry 5.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:26:41.074849 15669 leader_election.cc:290] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:41.084484 10895 leader_election.cc:400] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 pre-election: Vote denied by peer 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613) with higher term. Message: Invalid argument: T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for earlier term 7. Current term is 8.
I20260709 12:26:41.084895 10895 leader_election.cc:403] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:26:41.085335 11586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:41.088487 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:41.089725 10894 leader_election.cc:400] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 pre-election: Vote denied by peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265) with higher term. Message: Invalid argument: T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for earlier term 7. Current term is 8.
I20260709 12:26:41.090517 11616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:41.090731 15719 consensus_queue.cc:1048] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:26:41.092017 15700 consensus_meta.cc:287] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040: Time spent flushing consensus metadata: real 0.586s	user 0.017s	sys 0.002s
I20260709 12:26:41.093472 15059 raft_consensus.cc:2764] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
W20260709 12:26:41.088979 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 88581.4us
I20260709 12:26:41.096318 11619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:41.097231 15707 consensus_queue.cc:1059] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:26:41.098186 15707 raft_consensus.cc:3055] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:26:41.098554 15707 raft_consensus.cc:740] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
I20260709 12:26:41.098613 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:41.099345 10925 raft_consensus.cc:2468] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 7.
I20260709 12:26:41.099987 15707 consensus_queue.cc:260] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:41.101997 15707 raft_consensus.cc:3060] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:41.108047 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:41.108903 10927 raft_consensus.cc:2468] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 13.
I20260709 12:26:41.110592 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c913e527ff46578e084c41eab7bb9d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:41.110783 11588 leader_election.cc:304] T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:41.111224 10927 raft_consensus.cc:2468] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 7.
I20260709 12:26:41.023226 15601 raft_consensus.cc:515] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:41.112162 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 87217.8us
W20260709 12:26:41.114410 11589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:41.114854 11589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:41.115193 11619 raft_consensus.cc:2468] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 12.
I20260709 12:26:41.117158 15799 raft_consensus.cc:2749] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613) with higher term. Message: Invalid argument: T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for earlier term 7. Current term is 8.
I20260709 12:26:41.116462 15766 raft_consensus.cc:2749] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:41.142997 10969 leader_election.cc:304] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:41.147503 15669 raft_consensus.cc:2804] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:41.148308 15669 raft_consensus.cc:493] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:41.148772 15669 raft_consensus.cc:3060] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:41.151903 15619 consensus_queue.cc:1059] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:26:41.152565 11616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:41.153096 15619 raft_consensus.cc:3055] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:26:41.153311 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:41.153548 15619 raft_consensus.cc:740] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
I20260709 12:26:41.154181 10927 raft_consensus.cc:2468] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 13.
I20260709 12:26:41.154721 15619 consensus_queue.cc:260] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:41.153407 11619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:41.157020 11619 raft_consensus.cc:2468] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 9.
I20260709 12:26:41.142746 15520 raft_consensus.cc:2804] T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:26:41.095394 15636 consensus_queue.cc:237] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:41.170463 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 13 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:41.171839 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:41.170670 10895 leader_election.cc:304] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:41.174265 10968 leader_election.cc:304] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:41.175434 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fd8fdac2fa449e9e184f3d668ea1a7" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:41.184288 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:41.184492 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:41.185968 10923 raft_consensus.cc:2410] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3c52e0825c02476e89d84da9bb849f5d for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:26:41.186877 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad766f48812a4ddeb383179b1d84907b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:41.188613 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:41.189767 10926 raft_consensus.cc:2410] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 12:26:41.173424 15446 raft_consensus.cc:493] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:41.191964 10928 raft_consensus.cc:2393] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 7: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:26:41.192200 15446 raft_consensus.cc:515] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:41.186942  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:26:41.196266 10920 raft_consensus.cc:1275] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:26:41.184490 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9331e5342644ca2bae19187b083a7d5" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:41.188876 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:41.197286 10847 raft_consensus.cc:2468] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 5.
I20260709 12:26:41.197170 15639 raft_consensus.cc:493] T e8b17195a94142039c40f598ed006c94 P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:41.198490 15639 raft_consensus.cc:515] T e8b17195a94142039c40f598ed006c94 P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:41.200745 15510 raft_consensus.cc:3055] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:41.201328 15639 leader_election.cc:290] T e8b17195a94142039c40f598ed006c94 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:41.201596 15510 raft_consensus.cc:740] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:41.169509 15700 raft_consensus.cc:493] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:41.202765 15700 raft_consensus.cc:515] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:41.205834 15712 raft_consensus.cc:3055] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:26:41.206391 15712 raft_consensus.cc:740] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:41.207443 15712 consensus_queue.cc:260] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:41.205435 15700 leader_election.cc:290] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
W20260709 12:26:41.219831 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 59387.2us
I20260709 12:26:41.226321 15799 raft_consensus.cc:2804] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:41.226708 15446 leader_election.cc:290] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:41.226823 15799 raft_consensus.cc:493] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:41.227311 15799 raft_consensus.cc:3060] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:41.227492 15797 raft_consensus.cc:2804] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:26:41.224926 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 13 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:41.228125 15797 raft_consensus.cc:697] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 13 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:26:41.229172 15797 consensus_queue.cc:237] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:41.229480 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:41.229559 15639 raft_consensus.cc:493] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:41.230459 15639 raft_consensus.cc:515] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:41.231724 10853 raft_consensus.cc:1275] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:26:41.202869 15510 consensus_queue.cc:260] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:41.234058 15510 raft_consensus.cc:3060] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:41.175467 15520 raft_consensus.cc:697] T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d [term 7 LEADER]: Becoming Leader. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
I20260709 12:26:41.170286 10748 catalog_manager.cc:5697] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: term changed from 7 to 8, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68). New cstate: current_term: 8 leader_uuid: "3c52e0825c02476e89d84da9bb849f5d" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:41.244921 11622 raft_consensus.cc:2468] T b289bc89d592435fb63c7fcf580d95a4 P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 11.
I20260709 12:26:41.230577 15801 raft_consensus.cc:493] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:41.221719 15712 raft_consensus.cc:3060] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:41.245962 10748 catalog_manager.cc:5697] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: term changed from 7 to 8, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68). New cstate: current_term: 8 leader_uuid: "3c52e0825c02476e89d84da9bb849f5d" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:41.256075 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:41.257980  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:41.259370  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:41.260006 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:41.260987 10997 raft_consensus.cc:2468] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 7.
I20260709 12:26:41.262439 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:41.263509 11000 raft_consensus.cc:3060] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:41.267765 15594 raft_consensus.cc:493] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:41.267939 15700 consensus_queue.cc:1048] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:26:41.268409 15594 raft_consensus.cc:515] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:41.269258 15612 consensus_meta.cc:287] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d: Time spent flushing consensus metadata: real 0.780s	user 0.017s	sys 0.005s
I20260709 12:26:41.269847 15801 raft_consensus.cc:515] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:41.270828 10820 leader_election.cc:304] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:41.271046 15594 leader_election.cc:290] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:41.271706 15716 raft_consensus.cc:2749] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:26:41.274531 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 201465us
I20260709 12:26:41.275457 10894 leader_election.cc:304] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:41.276394 15663 raft_consensus.cc:2749] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:41.280117 10894 leader_election.cc:304] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:41.272612 15639 leader_election.cc:290] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:41.273631 15601 leader_election.cc:290] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:41.243525 15619 raft_consensus.cc:3060] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:26:41.284255 10750 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60736 (request call id 389) took 11699 ms (client timeout 15000 ms). Trace:
I20260709 12:26:41.285329 15520 consensus_queue.cc:237] T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:41.288743 10912 tablet_service.cc:1558] Processing DeleteTablet for tablet 87cb7b380c8446e6ab1355c203218967 with delete_type TABLET_DATA_TOMBSTONED (TS e2d5c637307a407ab688f5ccd6f0fcea not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:59610
I20260709 12:26:41.292073 10926 raft_consensus.cc:1275] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:26:41.272073 15801 leader_election.cc:290] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
W20260709 12:26:41.297576 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 154360us
I20260709 12:26:41.299263 15522 consensus_queue.cc:1059] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:26:41.304407 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b17195a94142039c40f598ed006c94" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:41.304822 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:41.305097 11619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:41.330735 10925 raft_consensus.cc:2468] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 4.
I20260709 12:26:41.330890 11619 raft_consensus.cc:2468] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 10.
I20260709 12:26:41.305977 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:41.309520 15669 raft_consensus.cc:515] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:41.251156 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
W20260709 12:26:41.312417 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 57958.6us
I20260709 12:26:41.313370 10820 leader_election.cc:304] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:41.266677 10748 catalog_manager.cc:5697] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: term changed from 11 to 13, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68). New cstate: current_term: 13 leader_uuid: "3c52e0825c02476e89d84da9bb849f5d" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:41.321869 10920 raft_consensus.cc:1275] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:26:41.322157 10928 pending_rounds.cc:85] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea: Aborting all ops after (but not including) 4
I20260709 12:26:41.333763 10928 pending_rounds.cc:107] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 12:26:41.323279 11588 leader_election.cc:304] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:41.323421 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:41.323709 11621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:41.334161 10928 raft_consensus.cc:2889] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:41.323305 11617 raft_consensus.cc:1275] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:26:41.321707 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:41.336043 10748 catalog_manager.cc:5697] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: term changed from 7 to 8, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68). New cstate: current_term: 8 leader_uuid: "3c52e0825c02476e89d84da9bb849f5d" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:41.333417 10920 pending_rounds.cc:85] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea: Aborting all ops after (but not including) 4
I20260709 12:26:41.338832 10920 pending_rounds.cc:107] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:26:41.339182 10920 raft_consensus.cc:2889] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:41.325419 11616 raft_consensus.cc:2468] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 11.
I20260709 12:26:41.330153 11620 raft_consensus.cc:1275] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:41.335268 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:41.334622 11623 raft_consensus.cc:2468] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 14.
I20260709 12:26:41.346746 10853 raft_consensus.cc:2468] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 14.
I20260709 12:26:41.352391 15639 raft_consensus.cc:2804] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:41.353024 15639 raft_consensus.cc:493] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:41.353406 15639 raft_consensus.cc:3060] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:41.332159 15663 raft_consensus.cc:2749] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:41.357904 11588 leader_election.cc:304] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:41.358632 11621 raft_consensus.cc:2393] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 5: Already voted for candidate 3c52e0825c02476e89d84da9bb849f5d in this term.
I20260709 12:26:41.359308 10748 catalog_manager.cc:5697] T 4ef3220c51df47db8859f07ab745fad5 P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: term changed from 5 to 7, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68). New cstate: current_term: 7 leader_uuid: "3c52e0825c02476e89d84da9bb849f5d" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:41.347035 10819 leader_election.cc:304] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:41.365059 10748 catalog_manager.cc:5697] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: term changed from 8 to 11, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68). New cstate: current_term: 11 leader_uuid: "3c52e0825c02476e89d84da9bb849f5d" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:26:41.368173 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 54881us
I20260709 12:26:41.370627 10819 leader_election.cc:304] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:41.371613 10819 leader_election.cc:304] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:41.346179 15446 raft_consensus.cc:2804] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:26:41.375802 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 95827.6us
I20260709 12:26:41.376694 11000 raft_consensus.cc:2468] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 13.
I20260709 12:26:41.375711 10895 leader_election.cc:304] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:41.376720 15059 raft_consensus.cc:2749] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:41.374979 10748 catalog_manager.cc:5697] T ab816bcc6183447994a2cc013e46c5f8 P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: term changed from 3 to 4, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68). New cstate: current_term: 4 leader_uuid: "3c52e0825c02476e89d84da9bb849f5d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:41.382172 15515 raft_consensus.cc:2804] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:26:41.382647 15515 raft_consensus.cc:493] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:41.383033 15515 raft_consensus.cc:3060] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:41.374641 15718 raft_consensus.cc:2804] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:41.385526 15718 raft_consensus.cc:493] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:41.385890 15718 raft_consensus.cc:3060] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:41.390930 11588 leader_election.cc:304] T e8b17195a94142039c40f598ed006c94 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:41.391739 15770 consensus_queue.cc:1048] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:26:41.369946 15716 raft_consensus.cc:2804] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:26:41.393859 10895 leader_election.cc:304] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:41.394208 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:41.394375 15716 raft_consensus.cc:493] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:41.394963 15716 raft_consensus.cc:3060] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:41.395092 10998 raft_consensus.cc:2468] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 13.
I20260709 12:26:41.395778 15663 raft_consensus.cc:2804] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:41.396190 15663 raft_consensus.cc:493] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:41.396586 15663 raft_consensus.cc:3060] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:41.394781 15799 raft_consensus.cc:515] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:41.400400 15799 leader_election.cc:290] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 12 election: Requested vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:41.401124 15799 raft_consensus.cc:2804] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:41.401363 15669 leader_election.cc:290] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:41.401691 15799 raft_consensus.cc:493] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:41.402241 15799 raft_consensus.cc:3060] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:41.402120 15801 consensus_queue.cc:1059] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:26:41.403198 15801 raft_consensus.cc:3055] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:26:41.403092 11621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:41.403867 15801 raft_consensus.cc:740] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:41.404433 11621 raft_consensus.cc:3060] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:41.406872 10820 leader_election.cc:304] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040; no voters: 
I20260709 12:26:41.411063 10748 catalog_manager.cc:5697] T e8b17195a94142039c40f598ed006c94 P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: term changed from 3 to 4, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68). New cstate: current_term: 4 leader_uuid: "3c52e0825c02476e89d84da9bb849f5d" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:41.418241 10820 leader_election.cc:304] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
W20260709 12:26:41.391010 15803 log.cc:927] Time spent T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.068s	user 0.004s	sys 0.000s
I20260709 12:26:41.422405 10748 catalog_manager.cc:5697] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: term changed from 7 to 9, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68). New cstate: current_term: 9 leader_uuid: "3c52e0825c02476e89d84da9bb849f5d" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:41.445031 10968 leader_election.cc:304] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:41.429652 10819 leader_election.cc:304] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:41.373449 15446 raft_consensus.cc:493] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:41.453611 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c913e527ff46578e084c41eab7bb9d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:41.455673 11588 leader_election.cc:304] T e9331e5342644ca2bae19187b083a7d5 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040; no voters: edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:26:41.473242 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 46453.3us
I20260709 12:26:41.479924 15700 raft_consensus.cc:2749] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:41.480230 15801 consensus_queue.cc:260] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:41.481993 15700 raft_consensus.cc:2749] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:41.482446 15801 raft_consensus.cc:3060] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:41.412321 15636 raft_consensus.cc:2804] T e8b17195a94142039c40f598ed006c94 P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:41.486300 11588 leader_election.cc:304] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:41.475319 10998 raft_consensus.cc:2393] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 7: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:26:41.427009 15707 raft_consensus.cc:3055] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:26:41.444487 15719 raft_consensus.cc:2804] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:41.495265 15585 raft_consensus.cc:2804] T e9331e5342644ca2bae19187b083a7d5 P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:41.495525 15719 raft_consensus.cc:493] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:41.495812 15585 raft_consensus.cc:493] T e9331e5342644ca2bae19187b083a7d5 P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:41.495985 15719 raft_consensus.cc:3060] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:41.496263 15585 raft_consensus.cc:3060] T e9331e5342644ca2bae19187b083a7d5 P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:41.465482 15762 consensus_queue.cc:1048] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
W20260709 12:26:41.485334 15601 consensus_queue.cc:1175] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "80cd7d227db44f34a6108591dad9c040" responder_term: 8 status { last_received { term: 8 index: 9 } last_committed_idx: 9 last_received_current_leader { term: 8 index: 9 } }
I20260709 12:26:41.473186 15797 raft_consensus.cc:2764] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:26:41.455214 10748 catalog_manager.cc:5697] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: term changed from 7 to 10, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68). New cstate: current_term: 10 leader_uuid: "3c52e0825c02476e89d84da9bb849f5d" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:41.463914 15446 raft_consensus.cc:3060] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:41.510361 15059 consensus_queue.cc:1048] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:26:41.530895 10748 catalog_manager.cc:5697] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "3c52e0825c02476e89d84da9bb849f5d" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:41.538452 11000 raft_consensus.cc:1275] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:26:41.492264 15636 raft_consensus.cc:493] T e8b17195a94142039c40f598ed006c94 P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:41.549144 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 168613us
I20260709 12:26:41.551059 10748 catalog_manager.cc:5697] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "3c52e0825c02476e89d84da9bb849f5d" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:41.506520 15707 raft_consensus.cc:740] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
I20260709 12:26:41.516997 15619 raft_consensus.cc:2749] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:26:41.565805 10748 catalog_manager.cc:5697] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: term changed from 10 to 11, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68). New cstate: current_term: 11 leader_uuid: "3c52e0825c02476e89d84da9bb849f5d" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:41.499269 15716 raft_consensus.cc:515] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:41.572315 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 83603.6us
I20260709 12:26:41.569387 10968 leader_election.cc:304] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
W20260709 12:26:41.573747 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 144194us
I20260709 12:26:41.557121 15636 raft_consensus.cc:3060] T e8b17195a94142039c40f598ed006c94 P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:41.554808 15717 raft_consensus.cc:2749] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:41.576105 11000 raft_consensus.cc:1275] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 14 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:26:41.566277 15449 consensus_queue.cc:1059] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:26:41.558355 15797 raft_consensus.cc:493] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:41.578819 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad766f48812a4ddeb383179b1d84907b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:26:41.326854 10750 rpcz_store.cc:269] 0709 12:26:29.584636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:29.585037 (+   401us) service_pool.cc:224] Handling call
0709 12:26:41.284001 (+11698964us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:34.070558 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:34.191525 (+120967us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:34.191564 (+    39us) write_op.cc:435] Acquired schema lock
0709 12:26:34.191604 (+    40us) tablet.cc:662] Decoding operations
0709 12:26:34.192231 (+   627us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:34.192281 (+    50us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:34.192308 (+    27us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:26:34.192684 (+   376us) tablet.cc:701] Row locks acquired
0709 12:26:34.192700 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:26:34.192843 (+   143us) write_op.cc:270] Start()
0709 12:26:34.192946 (+   103us) write_op.cc:276] Timestamp: P: 1783599994192797 usec, L: 0
0709 12:26:34.192966 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:26:34.272039 (+ 79073us) log.cc:844] Serialized 1746 byte log entry
0709 12:26:35.120582 (+848543us) spinlock_profiling.cc:243] Waited 56.4 ms on lock 0x7b4400022b4c. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7591c23db1 00007f7591cc1c85 00007f7591cc26a2 00007f7594a341db 00007f7594a2faaf 00007f7591d7e0ac 00007f759abd89a9 00007f7591d9a69b 00007f7591d9893f 00007f7591d9ac02 00007f7594a2220b
0709 12:26:36.465521 (+1344939us) op_driver.cc:464] REPLICATION: finished
0709 12:26:36.627556 (+162035us) write_op.cc:301] APPLY: starting
0709 12:26:36.630327 (+  2771us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:36.654731 (+ 24404us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:36.654757 (+    26us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:36.701813 (+ 47056us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:36.702055 (+   242us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=0,mrs_lookups=0
0709 12:26:36.702102 (+    47us) write_op.cc:312] APPLY: finished
0709 12:26:36.702593 (+   491us) log.cc:844] Serialized 49 byte log entry
0709 12:26:36.702859 (+   266us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:36.702979 (+   120us) write_op.cc:454] Released schema lock
0709 12:26:36.703038 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:36.721461 (+ 18423us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:36.737912 (+ 16451us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":27557,"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":148552,"apply.run_cpu_time_us":7586,"apply.run_wall_time_us":81737,"cfile_cache_hit":18,"cfile_cache_hit_bytes":20847,"num_ops":4,"prepare.queue_time_us":856413,"prepare.run_cpu_time_us":58468,"prepare.run_wall_time_us":1498758,"raft.queue_time_us":247278,"raft.run_cpu_time_us":16252,"raft.run_wall_time_us":143568,"replication_time_us":2248166,"spinlock_wait_cycles":129806080,"thread_start_us":1598345,"threads_started":4,"wal-append.queue_time_us":1197925,"wal-append.run_cpu_time_us":56916,"wal-append.run_wall_time_us":2231512}]]}
I20260709 12:26:41.597473 11588 leader_election.cc:304] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:41.575870 15594 raft_consensus.cc:493] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:41.590481 15669 raft_consensus.cc:2749] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:41.611594 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:41.570441 15515 raft_consensus.cc:515] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:41.615423 15059 raft_consensus.cc:2749] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:26:41.619951 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:41.621032 10998 raft_consensus.cc:2393] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 14: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:26:41.625578 11617 raft_consensus.cc:1275] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:26:41.627897 15809 tablet_replica.cc:333] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea: stopping tablet replica
I20260709 12:26:41.629252 15809 raft_consensus.cc:2243] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:41.630461 15809 raft_consensus.cc:2272] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:41.626371 15707 consensus_queue.cc:260] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.13, Last appended by leader: 13, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:41.632815 15707 raft_consensus.cc:3060] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:41.639688 10895 leader_election.cc:304] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:26:41.640887 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 71602.6us
I20260709 12:26:41.644325 11621 raft_consensus.cc:2468] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 13.
I20260709 12:26:41.649010 11000 raft_consensus.cc:1275] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:41.656119 10923 raft_consensus.cc:2468] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 5.
W20260709 12:26:41.654488 10895 raft_consensus.cc:2686] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 12:26:41.660121 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 52207.4us
I20260709 12:26:41.600450 15700 consensus_queue.cc:1048] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 12:26:41.608222 15717 consensus_queue.cc:1048] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 12:26:41.682657 15717 raft_consensus.cc:493] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:41.684957 15515 leader_election.cc:290] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:41.686583 10847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:41.687364 10847 raft_consensus.cc:2468] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 13.
I20260709 12:26:41.688347 10853 raft_consensus.cc:1240] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 12. Current term is 13. Ops: []
I20260709 12:26:41.614951 15594 raft_consensus.cc:515] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:41.615320 15797 raft_consensus.cc:515] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:41.706194 10846 raft_consensus.cc:1240] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Rejecting Update request from peer 3c52e0825c02476e89d84da9bb849f5d for earlier term 12. Current term is 13. Ops: [12.13-12.13]
W20260709 12:26:41.697242 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 99915.8us
I20260709 12:26:41.616817 15663 raft_consensus.cc:515] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:41.706758 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:41.714907 10998 raft_consensus.cc:2393] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 11: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:26:41.695724 10895 leader_election.cc:304] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:41.699455 10969 leader_election.cc:304] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:41.714705 11588 leader_election.cc:304] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040; no voters: 
I20260709 12:26:41.656236 15767 consensus_queue.cc:1048] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:26:41.705740 15601 raft_consensus.cc:3055] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:26:41.746512 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c913e527ff46578e084c41eab7bb9d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:41.716221 15510 consensus_queue.cc:1059] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
W20260709 12:26:41.749183 10969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 56665.9us
I20260709 12:26:41.670475 15718 raft_consensus.cc:515] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:41.752174 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad766f48812a4ddeb383179b1d84907b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:41.782486 10853 raft_consensus.cc:2468] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 6.
I20260709 12:26:41.753629 15594 leader_election.cc:290] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:41.756153 15800 raft_consensus.cc:2804] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:26:41.691329 15717 raft_consensus.cc:515] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:41.764870 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 346707us
I20260709 12:26:41.749768 15795 raft_consensus.cc:493] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:41.742473 15797 leader_election.cc:290] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:41.764653 15612 raft_consensus.cc:2804] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:41.762398 15766 raft_consensus.cc:493] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
W20260709 12:26:41.831666 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 103162us
W20260709 12:26:41.833030 11589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:41.833168 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 77294.8us
I20260709 12:26:41.833855 15216 raft_consensus.cc:493] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:41.771808 15601 raft_consensus.cc:740] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:41.840296 10819 leader_election.cc:304] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
W20260709 12:26:41.850719 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 155126us
I20260709 12:26:41.840165 15216 raft_consensus.cc:515] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:41.872522 10820 leader_election.cc:304] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040; no voters: edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:26:41.874259 10894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:41.828603 15612 raft_consensus.cc:493] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:41.883757 10853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:41.885684 10853 raft_consensus.cc:1813] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Handling vote request from an unknown peer e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:41.883755 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:41.886413 10927 raft_consensus.cc:2468] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 6.
I20260709 12:26:41.888238 15827 raft_consensus.cc:493] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:41.888756 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:41.889143 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:41.889545 10850 raft_consensus.cc:2468] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 10.
I20260709 12:26:41.890364 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c913e527ff46578e084c41eab7bb9d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:41.890596 10850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:41.891158 10852 raft_consensus.cc:2468] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 7.
I20260709 12:26:41.889081 15827 raft_consensus.cc:515] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:41.891431 10850 raft_consensus.cc:2468] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 6.
I20260709 12:26:41.890673 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:41.893707 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad766f48812a4ddeb383179b1d84907b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:41.896808 10854 raft_consensus.cc:3060] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:26:41.863204 15639 consensus_meta.cc:287] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d: Time spent flushing consensus metadata: real 0.509s	user 0.009s	sys 0.005s
I20260709 12:26:41.884003 10846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
W20260709 12:26:41.875229 15712 consensus_meta.cc:287] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea: Time spent flushing consensus metadata: real 0.589s	user 0.010s	sys 0.003s
I20260709 12:26:41.927436 10853 raft_consensus.cc:2393] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 11: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:26:41.933912 15797 raft_consensus.cc:493] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:41.918017 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:41.935030 10929 raft_consensus.cc:3060] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:41.848582 15816 raft_consensus.cc:493] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:41.930353 10849 raft_consensus.cc:1240] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 12. Current term is 13. Ops: []
I20260709 12:26:41.862516 15716 leader_election.cc:290] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:41.934648 15797 raft_consensus.cc:515] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:41.843461 15585 raft_consensus.cc:515] T e9331e5342644ca2bae19187b083a7d5 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:41.982824 11621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b17195a94142039c40f598ed006c94" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
W20260709 12:26:41.984297 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 111905us
I20260709 12:26:42.023470 10820 leader_election.cc:304] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040; no voters: 
I20260709 12:26:41.875229 15766 raft_consensus.cc:515] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:41.899191 15612 raft_consensus.cc:3060] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:41.988788 15813 raft_consensus.cc:2804] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:41.920745 15663 leader_election.cc:290] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:41.991947 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:41.991742 15601 consensus_queue.cc:260] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:41.996137 10819 leader_election.cc:304] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:42.001092 10999 raft_consensus.cc:1275] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:26:41.908300 15827 leader_election.cc:290] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:42.002745 10852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:42.005800 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b17195a94142039c40f598ed006c94" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:26:42.007138 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 70865.4us
I20260709 12:26:41.846211 15795 raft_consensus.cc:515] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:42.010465 10925 raft_consensus.cc:1275] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:26:42.018596 11620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:42.052551 11620 raft_consensus.cc:2468] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 6.
I20260709 12:26:42.052949 11623 raft_consensus.cc:2368] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for earlier term 12. Current term is 13.
I20260709 12:26:41.929736 15669 raft_consensus.cc:493] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:41.942291 15700 raft_consensus.cc:2804] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:26:42.013032 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:42.073413 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:42.074275 10994 raft_consensus.cc:3060] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:42.069272 10996 raft_consensus.cc:2468] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 5.
I20260709 12:26:42.079221 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c913e527ff46578e084c41eab7bb9d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:42.082141 11002 raft_consensus.cc:2468] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 14.
I20260709 12:26:42.031945 15824 raft_consensus.cc:2804] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:42.088832 10999 raft_consensus.cc:2393] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 7: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:26:42.017748 10929 raft_consensus.cc:2468] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 8.
I20260709 12:26:41.984872 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:42.023202 11617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
W20260709 12:26:42.021196 15814 log.cc:927] Time spent T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
I20260709 12:26:41.940724 15816 raft_consensus.cc:515] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:42.022111 15719 consensus_meta.cc:287] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040: Time spent flushing consensus metadata: real 0.526s	user 0.007s	sys 0.006s
I20260709 12:26:42.042519 10894 leader_election.cc:304] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
W20260709 12:26:42.112237 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 69919.6us
I20260709 12:26:42.093384 11622 raft_consensus.cc:2468] T b289bc89d592435fb63c7fcf580d95a4 P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 11.
W20260709 12:26:42.113543 10892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:42.030243 15825 raft_consensus.cc:493] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:41.932277 15639 raft_consensus.cc:515] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:42.106045 10851 raft_consensus.cc:1240] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 11 LEADER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 10. Current term is 11. Ops: []
I20260709 12:26:42.032490 15716 consensus_queue.cc:1048] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 12:26:42.115450 10969 leader_election.cc:304] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
W20260709 12:26:42.144068 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 148002us
I20260709 12:26:42.127699 10968 leader_election.cc:304] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
W20260709 12:26:42.094123 15446 consensus_meta.cc:287] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040: Time spent flushing consensus metadata: real 0.541s	user 0.012s	sys 0.000s
I20260709 12:26:42.104118 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:42.123503 10994 raft_consensus.cc:2468] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 8.
W20260709 12:26:42.086736 15663 consensus_queue.cc:1175] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "edcc56ddd3264984b4da6c1db59e7f08" responder_term: 9 status { last_received { term: 9 index: 6 } last_committed_idx: 5 last_received_current_leader { term: 9 index: 6 } }
I20260709 12:26:42.105248 15800 raft_consensus.cc:697] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 13 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:26:42.103904 15594 raft_consensus.cc:2804] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:26:42.087670 15824 raft_consensus.cc:493] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:42.152686 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:42.107833 15726 raft_consensus.cc:2749] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:26:42.104900 15700 raft_consensus.cc:697] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 11 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:42.087373 15669 raft_consensus.cc:515] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:42.205494 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 92310.7us
I20260709 12:26:42.204581 15449 raft_consensus.cc:3055] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:26:42.203233 15615 raft_consensus.cc:493] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:42.204041 15833 raft_consensus.cc:2749] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:26:42.192262 15707 consensus_meta.cc:287] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d: Time spent flushing consensus metadata: real 0.559s	user 0.013s	sys 0.000s
I20260709 12:26:42.104653 15658 consensus_queue.cc:1059] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 12:26:42.151804 15827 raft_consensus.cc:2804] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:42.128407 15719 raft_consensus.cc:515] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:42.253413 15767 raft_consensus.cc:493] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:42.251914 15594 raft_consensus.cc:493] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:42.262677 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:42.297384 11003 raft_consensus.cc:2468] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 5.
W20260709 12:26:42.267308 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 139825us
I20260709 12:26:42.196666 15718 leader_election.cc:290] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 14 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:42.250869 15770 raft_consensus.cc:493] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:42.292497 15811 log.cc:927] Time spent T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.448s	user 0.002s	sys 0.000s
I20260709 12:26:42.268518 15449 raft_consensus.cc:740] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:42.209640 15216 leader_election.cc:290] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:42.295202 10852 raft_consensus.cc:1240] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 12. Current term is 13. Ops: []
I20260709 12:26:42.262552 15762 raft_consensus.cc:2804] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:42.296030 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:42.332340 10929 raft_consensus.cc:2393] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 8: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:26:42.152040 15446 raft_consensus.cc:515] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:42.292282 10819 leader_election.cc:304] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:42.256815 15824 raft_consensus.cc:3060] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:42.301137 10968 leader_election.cc:304] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:42.352401 15446 leader_election.cc:290] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 election: Requested vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:42.353269 15446 raft_consensus.cc:2804] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:26:42.353536 15835 raft_consensus.cc:3060] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:42.353965 15446 raft_consensus.cc:697] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 8 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:42.352475 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:42.356534 10925 raft_consensus.cc:3060] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Advancing to term 10
W20260709 12:26:42.355734 15826 log.cc:927] Time spent T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.279s	user 0.001s	sys 0.000s
I20260709 12:26:42.355218 15446 consensus_queue.cc:237] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:42.306455 15719 leader_election.cc:290] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 11 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:42.293965 15827 raft_consensus.cc:493] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:42.306887 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:42.360672 15827 raft_consensus.cc:3060] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:42.310038 10820 leader_election.cc:304] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:42.362062 15719 raft_consensus.cc:2749] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:26:42.304706 15819 consensus_queue.cc:1048] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.249s
I20260709 12:26:42.340878 15762 raft_consensus.cc:493] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:42.364418 10928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59626 (request call id 3660) took 1049 ms. Trace:
I20260709 12:26:42.364594 15762 raft_consensus.cc:3060] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:42.364859 10928 rpcz_store.cc:276] 0709 12:26:41.315115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:41.315232 (+   117us) service_pool.cc:224] Handling call
0709 12:26:41.321943 (+  6711us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:26:41.372874 (+ 50931us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:41.372897 (+    23us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:26:41.392685 (+ 19788us) log.cc:844] Serialized 52 byte log entry
0709 12:26:41.530283 (+137598us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:26:41.530326 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:41.530399 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:42.364189 (+833790us) raft_consensus.cc:1685] finished
0709 12:26:42.364211 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:42.364359 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":20852,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":179,"thread_start_us":137056,"threads_started":1,"wal-append.queue_time_us":287571}
I20260709 12:26:42.141425 15825 raft_consensus.cc:515] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:42.366271 15797 leader_election.cc:290] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:42.328470 10846 raft_consensus.cc:2393] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 11: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:26:42.296005 15838 raft_consensus.cc:493] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
W20260709 12:26:42.340417 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 48239us
I20260709 12:26:42.303406 15594 raft_consensus.cc:3060] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:42.367317 15838 raft_consensus.cc:515] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:42.297655 15615 raft_consensus.cc:515] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:42.360234 15585 leader_election.cc:290] T e9331e5342644ca2bae19187b083a7d5 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 6 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:42.372181 15449 consensus_queue.cc:260] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:42.374105 15449 raft_consensus.cc:3060] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:42.376554 15816 leader_election.cc:290] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:26:42.378384 15828 log.cc:927] Time spent T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 12:26:42.380750 15843 raft_consensus.cc:493] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:42.381516 15843 raft_consensus.cc:515] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:42.264637 10894 leader_election.cc:304] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:42.384307 15800 consensus_queue.cc:237] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:42.386168 15840 raft_consensus.cc:2804] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:26:42.387208 15840 raft_consensus.cc:493] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:42.387965 15840 raft_consensus.cc:3060] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:26:42.389822 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 125502us
I20260709 12:26:42.320973 15767 raft_consensus.cc:515] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:42.394827 10894 leader_election.cc:304] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:42.396476 15841 raft_consensus.cc:493] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:42.397244 15841 raft_consensus.cc:515] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:42.321921 15726 raft_consensus.cc:3055] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:26:42.399735 15726 raft_consensus.cc:740] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:42.400604 15726 consensus_queue.cc:260] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:42.401903 15726 raft_consensus.cc:3060] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:42.408588 15809 ts_tablet_manager.cc:1916] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:42.326896 15795 leader_election.cc:290] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:42.329142 15770 raft_consensus.cc:515] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:42.371407 15820 log.cc:927] Time spent T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.348s	user 0.000s	sys 0.001s
I20260709 12:26:42.419904 10997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37512 (request call id 3549) took 1090 ms. Trace:
I20260709 12:26:42.420292 10997 rpcz_store.cc:276] 0709 12:26:41.329622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:41.329767 (+   145us) service_pool.cc:224] Handling call
0709 12:26:41.332788 (+  3021us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:41.364625 (+ 31837us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:26:41.381758 (+ 17133us) log.cc:844] Serialized 14 byte log entry
0709 12:26:41.771273 (+389515us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:41.798776 (+ 27503us) log.cc:844] Serialized 26 byte log entry
0709 12:26:41.799043 (+   267us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:26:41.799096 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:41.799208 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:42.419657 (+620449us) raft_consensus.cc:1685] finished
0709 12:26:42.419682 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:42.419830 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":560,"prepare.queue_time_us":18874,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":125698,"raft.run_cpu_time_us":316,"raft.run_wall_time_us":5968,"thread_start_us":366596,"threads_started":1,"wal-append.queue_time_us":455704}
W20260709 12:26:42.428699 10894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:42.439714 10923 raft_consensus.cc:1275] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:26:42.441591 10852 raft_consensus.cc:1275] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:26:42.443869 15601 raft_consensus.cc:3060] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:26:42.446861 15829 log.cc:927] Time spent T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.237s	user 0.004s	sys 0.000s
I20260709 12:26:42.454103 15619 consensus_queue.cc:1048] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:26:42.489205 15700 consensus_queue.cc:237] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:42.496490 15458 raft_consensus.cc:493] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:42.497360 15458 raft_consensus.cc:515] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:42.499603 15830 consensus_queue.cc:1048] T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:26:42.504261 15823 log.cc:927] Time spent T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.446s	user 0.003s	sys 0.000s
I20260709 12:26:42.523486 15813 raft_consensus.cc:493] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:42.524451 15813 raft_consensus.cc:3060] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:42.524873 15795 raft_consensus.cc:493] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:42.525775 15795 raft_consensus.cc:515] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:42.536801 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b17195a94142039c40f598ed006c94" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:42.538017 10998 raft_consensus.cc:2393] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 5: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:26:42.539608 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:42.541625 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c913e527ff46578e084c41eab7bb9d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:42.542665 10996 raft_consensus.cc:2468] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 7.
I20260709 12:26:42.544241 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:26:42.545150 11589 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.673s	user 0.005s	sys 0.026s
W20260709 12:26:42.545624 11589 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.005s	sys 0.026s
I20260709 12:26:42.554369 11624 raft_consensus.cc:1240] T e9331e5342644ca2bae19187b083a7d5 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 5. Current term is 6. Ops: []
W20260709 12:26:42.554828 15817 log.cc:927] Time spent T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d: Append to log took a long time: real 0.613s	user 0.000s	sys 0.003s
W20260709 12:26:42.555636 10894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:42.557193 15836 log.cc:927] Time spent T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.303s	user 0.002s	sys 0.000s
I20260709 12:26:42.601752 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b17195a94142039c40f598ed006c94" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:42.607276 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:26:42.610522 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 300605us
I20260709 12:26:42.611357 10820 leader_election.cc:304] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:26:42.613296 10920 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.031s	sys 0.073s
W20260709 12:26:42.613674 10920 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.031s	sys 0.073s
W20260709 12:26:42.633096 10854 consensus_meta.cc:287] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040: Time spent flushing consensus metadata: real 0.736s	user 0.005s	sys 0.014s
I20260709 12:26:42.633688 10854 raft_consensus.cc:2468] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 7.
W20260709 12:26:42.644716 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 343658us
I20260709 12:26:42.606174 15717 leader_election.cc:290] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:42.648145 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:42.656625 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5794ba618e514e28a7542ab6af39d8c9" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:42.659710 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9331e5342644ca2bae19187b083a7d5" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:42.656642 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9331e5342644ca2bae19187b083a7d5" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:42.662627 10820 leader_election.cc:304] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:42.663486 10854 raft_consensus.cc:3060] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:42.664834 10848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5794ba618e514e28a7542ab6af39d8c9" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:42.667071 10846 raft_consensus.cc:1275] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:26:42.658557 10998 raft_consensus.cc:2468] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 5.
I20260709 12:26:42.649278 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:42.665658 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:42.672060 15458 leader_election.cc:290] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:42.673698 15795 leader_election.cc:290] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:42.645527 15797 raft_consensus.cc:493] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:42.674656 15797 raft_consensus.cc:515] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:42.684057 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:42.685062 10994 raft_consensus.cc:2468] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 5.
I20260709 12:26:42.649127 10995 raft_consensus.cc:2468] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 8.
I20260709 12:26:42.666131 10848 raft_consensus.cc:2468] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 5.
I20260709 12:26:42.690963 10994 raft_consensus.cc:1240] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 13 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 12. Current term is 13. Ops: []
I20260709 12:26:42.670293 10924 raft_consensus.cc:2468] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 8.
I20260709 12:26:42.670799 10928 raft_consensus.cc:2468] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 12.
I20260709 12:26:42.697477 10820 leader_election.cc:304] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:42.701155 10968 leader_election.cc:304] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:42.707558 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:42.709685 10929 raft_consensus.cc:3060] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:42.655407 15812 raft_consensus.cc:2749] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:26:42.712392 11617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:42.717283 11617 raft_consensus.cc:3060] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:42.718017 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:42.719040 10924 raft_consensus.cc:3060] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:42.720788 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad766f48812a4ddeb383179b1d84907b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:42.721449 11622 raft_consensus.cc:1275] T b289bc89d592435fb63c7fcf580d95a4 P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:26:42.721083 10851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040" is_pre_election: true
I20260709 12:26:42.725803 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:42.720798 10849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "80cd7d227db44f34a6108591dad9c040"
I20260709 12:26:42.728871 10849 raft_consensus.cc:3060] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:42.725248 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:42.731426 10923 raft_consensus.cc:3060] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:42.695379 15795 raft_consensus.cc:493] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:42.689199 15615 leader_election.cc:290] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:26:42.737988 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 50773us
I20260709 12:26:42.734263 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:42.743237  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:42.758445 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:42.701853 15766 leader_election.cc:290] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:42.658787 15834 consensus_queue.cc:1059] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 12:26:42.766805 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:42.754832 11001 raft_consensus.cc:2468] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 11.
I20260709 12:26:42.768769 10925 raft_consensus.cc:2468] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 10.
W20260709 12:26:42.768769 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 54244.7us
I20260709 12:26:42.770210 11589 leader_election.cc:304] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:42.729615 15717 raft_consensus.cc:2804] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:26:42.789880 10969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 48977.2us
I20260709 12:26:42.792798 10854 raft_consensus.cc:2468] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 6.
I20260709 12:26:42.795254 10968 leader_election.cc:304] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:42.797236 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:42.798288 10925 raft_consensus.cc:2393] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 11: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
W20260709 12:26:42.799439 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 58725us
I20260709 12:26:42.796288 10820 leader_election.cc:304] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:42.805137 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:42.766528 15639 leader_election.cc:290] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 15 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:42.806464 11622 raft_consensus.cc:2468] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 9.
I20260709 12:26:42.807699 10995 raft_consensus.cc:1275] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:26:42.813372 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:42.814368 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:42.807545 11589 leader_election.cc:304] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:42.725277 15458 consensus_queue.cc:1048] T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 12:26:42.814358 10894 leader_election.cc:304] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:42.823289 10921 raft_consensus.cc:2410] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3c52e0825c02476e89d84da9bb849f5d for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:26:42.827785 10968 leader_election.cc:304] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d
I20260709 12:26:42.788589 15669 leader_election.cc:290] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:42.760839 15658 consensus_queue.cc:1059] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 12:26:42.798609 15766 raft_consensus.cc:2804] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:42.822366 11589 leader_election.cc:304] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:42.790179 15797 leader_election.cc:290] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:42.854317 10929 raft_consensus.cc:2468] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 14.
I20260709 12:26:42.856863 10925 raft_consensus.cc:1275] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:26:42.768302 15795 raft_consensus.cc:515] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:42.862270 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:42.863269 10928 raft_consensus.cc:1275] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:26:42.820323 15816 raft_consensus.cc:2804] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:26:42.782238 15812 consensus_queue.cc:1048] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 12:26:42.804896 15844 raft_consensus.cc:493] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:42.795603 15510 consensus_queue.cc:1048] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
W20260709 12:26:42.876963 10922 consensus_meta.cc:287] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea: Time spent flushing consensus metadata: real 1.103s	user 0.012s	sys 0.008s
I20260709 12:26:42.873798 10969 leader_election.cc:304] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:42.815675 15841 leader_election.cc:290] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:42.882413 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352aa49c65194abbb863d7553a091f11" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:42.881770 10922 raft_consensus.cc:2468] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 7.
I20260709 12:26:42.884591 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:42.855618 15770 leader_election.cc:290] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:42.812605 15819 consensus_queue.cc:1048] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.064s
W20260709 12:26:42.872466 15636 consensus_meta.cc:287] T e8b17195a94142039c40f598ed006c94 P 3c52e0825c02476e89d84da9bb849f5d: Time spent flushing consensus metadata: real 1.281s	user 0.013s	sys 0.010s
I20260709 12:26:42.859642 15717 raft_consensus.cc:697] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 13 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:42.899170 10995 raft_consensus.cc:2468] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 4.
I20260709 12:26:42.892743 10922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59626 (request call id 3666) took 1139 ms. Trace:
I20260709 12:26:42.840489 15825 leader_election.cc:290] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:42.847501 15838 leader_election.cc:290] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:42.861932 15766 raft_consensus.cc:493] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:42.855432 15663 raft_consensus.cc:2804] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:26:42.904314 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 76825.3us
I20260709 12:26:42.880438 15816 raft_consensus.cc:493] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:42.900674 10922 rpcz_store.cc:276] 0709 12:26:41.745739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:41.746008 (+   269us) service_pool.cc:224] Handling call
0709 12:26:42.885021 (+1139013us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:42.873379 15797 raft_consensus.cc:493] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:42.908365 10921 raft_consensus.cc:1275] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 14 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 12:26:42.890110 15812 raft_consensus.cc:2749] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:26:42.951061 10921 pending_rounds.cc:85] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea: Aborting all ops after (but not including) 10
W20260709 12:26:42.895774 15801 consensus_meta.cc:287] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent flushing consensus metadata: real 1.413s	user 0.018s	sys 0.004s
W20260709 12:26:42.898751 15799 consensus_meta.cc:287] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent flushing consensus metadata: real 1.496s	user 0.009s	sys 0.014s
I20260709 12:26:42.865644 15848 consensus_queue.cc:1048] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.275s
I20260709 12:26:42.951403 10921 pending_rounds.cc:107] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 12:26:42.956746 10921 raft_consensus.cc:2889] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:42.912497 15766 raft_consensus.cc:3060] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:42.945405 15825 raft_consensus.cc:2804] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:26:42.913540 15615 raft_consensus.cc:2804] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:42.951197 15845 raft_consensus.cc:2749] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:26:42.950659 15816 raft_consensus.cc:3060] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:42.892746 15844 raft_consensus.cc:515] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:42.949851 15838 raft_consensus.cc:493] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:42.951638 15663 raft_consensus.cc:697] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [term 7 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:42.908972 15636 raft_consensus.cc:515] T e8b17195a94142039c40f598ed006c94 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:43.004401 10893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:43.006735 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:42.953924 15864 raft_consensus.cc:2749] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:43.035802 11624 raft_consensus.cc:2410] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:26:42.980386 15615 raft_consensus.cc:493] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:461: Failure
Failed
Bad status: Illegal state: leader_transfer_task size should be 0, but 5
I20260709 12:26:42.978567 15458 raft_consensus.cc:493] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:42.954882 15797 raft_consensus.cc:515] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:42.964474 15799 raft_consensus.cc:515] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 14 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:43.082561 11621 raft_consensus.cc:2368] T e8b17195a94142039c40f598ed006c94 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for earlier term 5. Current term is 6.
I20260709 12:26:43.071135 15801 raft_consensus.cc:493] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.068274 15615 raft_consensus.cc:3060] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:43.125741 11617 raft_consensus.cc:2468] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 11.
I20260709 12:26:43.094708 15717 consensus_queue.cc:237] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:43.083729 15832 raft_consensus.cc:2804] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:43.004431 15838 raft_consensus.cc:515] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:42.997969 15846 consensus_queue.cc:1059] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.307s
I20260709 12:26:43.143100  9681 tablet_server.cc:179] TabletServer@127.9.116.65:0 shutting down...
I20260709 12:26:43.101349 15864 raft_consensus.cc:493] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.142741 15837 raft_consensus.cc:2804] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:26:43.088891 15800 raft_consensus.cc:493] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:43.143276 15832 raft_consensus.cc:493] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:43.089262 15458 raft_consensus.cc:515] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:43.170760 10894 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:43.173246 15855 log.cc:927] Time spent T 00000000000000000000000000000000 P 9619ad7a9e7f4d9b8039487e3ee77243: Append to log took a long time: real 0.229s	user 0.001s	sys 0.001s
W20260709 12:26:43.178094 15853 log.cc:927] Time spent T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.311s	user 0.000s	sys 0.001s
W20260709 12:26:43.179100 15863 log.cc:927] Time spent T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 12:26:43.170761 15800 raft_consensus.cc:515] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:43.140799 15801 raft_consensus.cc:515] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:43.205291 15801 leader_election.cc:290] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:26:43.178169 15869 log.cc:927] Time spent T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 12:26:43.206691 15797 leader_election.cc:290] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:43.170871 15795 leader_election.cc:290] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:43.166210 15663 consensus_queue.cc:237] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:43.214519 15827 consensus_meta.cc:287] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08: Time spent flushing consensus metadata: real 0.853s	user 0.015s	sys 0.024s
I20260709 12:26:43.189276 15799 leader_election.cc:290] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 14 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:43.196887 15458 leader_election.cc:290] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:26:43.198877 10800 auto_rebalancer.cc:629] Failed to schedule move for tablet cb220f7497ef4e739938460527b9d6f0: Illegal state: Replica 80cd7d227db44f34a6108591dad9c040 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } }
I20260709 12:26:43.198668 15636 leader_election.cc:290] T e8b17195a94142039c40f598ed006c94 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 6 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:43.200176 15838 leader_election.cc:290] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:43.205385 15800 leader_election.cc:290] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:43.223861 10923 raft_consensus.cc:2468] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 11.
W20260709 12:26:43.194273 15601 consensus_meta.cc:287] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent flushing consensus metadata: real 0.750s	user 0.023s	sys 0.003s
I20260709 12:26:43.165385 15861 raft_consensus.cc:2804] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:26:43.161031 15858 raft_consensus.cc:493] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
W20260709 12:26:43.261487 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 465259us
I20260709 12:26:43.264115 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63ecfc9bd3945818cfe15c03f001315" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:43.267766 10820 leader_election.cc:304] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:43.268431 10994 raft_consensus.cc:2468] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 6.
I20260709 12:26:43.215051 15827 raft_consensus.cc:515] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:43.238619 10849 consensus_meta.cc:287] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040: Time spent flushing consensus metadata: real 0.509s	user 0.011s	sys 0.005s
I20260709 12:26:43.282521 10849 raft_consensus.cc:2468] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 15.
W20260709 12:26:43.262779 15762 consensus_meta.cc:287] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent flushing consensus metadata: real 0.892s	user 0.006s	sys 0.022s
W20260709 12:26:43.222950 15612 consensus_meta.cc:287] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d: Time spent flushing consensus metadata: real 1.163s	user 0.015s	sys 0.009s
I20260709 12:26:43.170663 15825 raft_consensus.cc:697] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:26:43.278720 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b17195a94142039c40f598ed006c94" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:43.170831 15832 raft_consensus.cc:3060] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:43.164772 15864 raft_consensus.cc:515] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:43.288198 10926 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.005s	sys 0.008s
I20260709 12:26:43.293802 10819 leader_election.cc:304] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:43.278797 11589 leader_election.cc:304] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:43.294361 10996 raft_consensus.cc:3060] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:26:43.242846 10924 consensus_meta.cc:287] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea: Time spent flushing consensus metadata: real 0.521s	user 0.013s	sys 0.005s
I20260709 12:26:43.265069 15861 raft_consensus.cc:493] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:43.277297 15819 raft_consensus.cc:3060] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:43.315874 10997 raft_consensus.cc:1240] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 11. Current term is 12. Ops: []
W20260709 12:26:43.317037 10926 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.005s	sys 0.009s
I20260709 12:26:43.317499 10924 raft_consensus.cc:2468] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 13.
I20260709 12:26:43.328728 15861 raft_consensus.cc:3060] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:26:43.330324 15726 consensus_meta.cc:287] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea: Time spent flushing consensus metadata: real 0.928s	user 0.017s	sys 0.001s
W20260709 12:26:43.371904 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 74476.5us
I20260709 12:26:43.331851 15862 raft_consensus.cc:493] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.277297 15871 raft_consensus.cc:493] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:43.371366 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 77651.4us
I20260709 12:26:43.294145 15762 raft_consensus.cc:515] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:43.392400 15825 consensus_queue.cc:237] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:43.393594 15762 leader_election.cc:290] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:43.398602 15871 raft_consensus.cc:515] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:43.399838 15885 raft_consensus.cc:2804] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:26:43.400305 15844 leader_election.cc:290] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:43.400580 15885 raft_consensus.cc:493] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
W20260709 12:26:43.401577 15876 log.cc:927] Time spent T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 12:26:43.402081 15870 consensus_queue.cc:1048] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.124s
I20260709 12:26:43.403925 15827 leader_election.cc:290] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:43.347765 15658 raft_consensus.cc:493] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.405428 15658 raft_consensus.cc:515] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:43.408061 10920 raft_consensus.cc:2393] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 11: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
W20260709 12:26:43.408210 15594 consensus_meta.cc:287] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040: Time spent flushing consensus metadata: real 1.040s	user 0.013s	sys 0.009s
I20260709 12:26:43.401320 15885 raft_consensus.cc:3060] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:43.408793 15594 raft_consensus.cc:515] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:43.408413 15877 log.cc:927] Time spent T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
W20260709 12:26:43.414171 10893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:43.428831 15849 raft_consensus.cc:2804] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:26:43.429297 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 49462.5us
W20260709 12:26:43.380486 15813 consensus_meta.cc:287] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040: Time spent flushing consensus metadata: real 0.855s	user 0.010s	sys 0.010s
W20260709 12:26:43.372131 15449 consensus_meta.cc:287] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea: Time spent flushing consensus metadata: real 0.997s	user 0.012s	sys 0.018s
W20260709 12:26:43.429888 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 49859us
I20260709 12:26:43.429808 15594 leader_election.cc:290] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:43.298144 15612 raft_consensus.cc:515] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:43.278056 15858 raft_consensus.cc:515] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } }
I20260709 12:26:43.452834 10819 leader_election.cc:304] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:43.438899 15830 raft_consensus.cc:493] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.457150 10996 raft_consensus.cc:2468] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 6.
I20260709 12:26:43.482605 11589 leader_election.cc:304] T e8b17195a94142039c40f598ed006c94 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:43.460789 15515 raft_consensus.cc:493] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.490917 15891 raft_consensus.cc:493] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:43.490023 15835 consensus_meta.cc:287] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08: Time spent flushing consensus metadata: real 1.136s	user 0.018s	sys 0.039s
I20260709 12:26:43.484701 15458 raft_consensus.cc:493] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.482474 15658 leader_election.cc:290] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:43.475418 15849 raft_consensus.cc:697] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 14 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:43.456243 15813 raft_consensus.cc:515] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:43.412568 15862 raft_consensus.cc:515] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:43.492127 15867 raft_consensus.cc:493] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.468883 15615 raft_consensus.cc:515] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:43.499641 15515 raft_consensus.cc:515] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:43.524935 15866 raft_consensus.cc:2804] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:26:43.509249 15848 raft_consensus.cc:493] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.525066 15880 raft_consensus.cc:2804] T e8b17195a94142039c40f598ed006c94 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:43.509627 15835 raft_consensus.cc:2749] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:26:43.517761 15840 consensus_meta.cc:287] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent flushing consensus metadata: real 1.125s	user 0.025s	sys 0.014s
I20260709 12:26:43.485256 15830 raft_consensus.cc:515] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:43.512717 15446 consensus_queue.cc:1048] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 12:26:43.512161 15458 raft_consensus.cc:515] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:43.508109 15891 raft_consensus.cc:515] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:43.651232 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:43.642976 10895 leader_election.cc:304] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:26:43.628404 10800 auto_rebalancer.cc:629] Failed to schedule move for tablet 73f1f3589fd343ba9289b327b8b35837: Illegal state: Replica edcc56ddd3264984b4da6c1db59e7f08 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } }
W20260709 12:26:43.668655 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 818667us
I20260709 12:26:43.756564 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:43.772543 11001 raft_consensus.cc:3060] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:43.774070 10996 raft_consensus.cc:3060] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:43.650780 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:43.636117 10997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37500 (request call id 3982) took 1102 ms. Trace:
I20260709 12:26:43.775671 10997 rpcz_store.cc:276] 0709 12:26:42.533274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:42.559357 (+ 26083us) service_pool.cc:224] Handling call
0709 12:26:42.559799 (+   442us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:43.375766 (+815967us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:43.635815 (+260049us) spinlock_profiling.cc:243] Waited 756 ms on lock 0x7b54003eb7d4. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e88e01 00007f7594e8783e 00007f7599e4c419 00007f75933c3bd4 00007f75933c3b62 00007f75933c3a91 00007f75933c3a0c 00007f75933c2cc2 00007f75931c348c 00007f75931c28c6
0709 12:26:43.636038 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1738050944}
W20260709 12:26:43.779808 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 136890us
I20260709 12:26:43.525665 15866 raft_consensus.cc:697] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [term 7 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:43.779177 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:43.775678 10994 raft_consensus.cc:2468] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 9.
I20260709 12:26:43.784003 10929 raft_consensus.cc:3060] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:26:43.580735 15888 log.cc:927] Time spent T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
W20260709 12:26:43.581779 15816 consensus_meta.cc:287] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d: Time spent flushing consensus metadata: real 0.577s	user 0.012s	sys 0.000s
W20260709 12:26:43.744465 15896 log.cc:927] Time spent T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.054s	user 0.002s	sys 0.000s
I20260709 12:26:43.710916 15831 raft_consensus.cc:3055] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:26:43.677250 15865 log.cc:927] Time spent T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d: Append to log took a long time: real 0.715s	user 0.011s	sys 0.000s
W20260709 12:26:43.617113 15824 consensus_meta.cc:287] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040: Time spent flushing consensus metadata: real 1.266s	user 0.016s	sys 0.033s
W20260709 12:26:43.658078 15766 consensus_meta.cc:287] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08: Time spent flushing consensus metadata: real 0.671s	user 0.014s	sys 0.002s
I20260709 12:26:43.799032 10999 raft_consensus.cc:2468] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 10.
I20260709 12:26:43.791414 11589 leader_election.cc:304] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:43.674464 15875 raft_consensus.cc:493] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.820231 11617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352aa49c65194abbb863d7553a091f11" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:43.820951 11617 raft_consensus.cc:2468] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 4.
W20260709 12:26:43.679852 15850 log.cc:927] Time spent T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.784s	user 0.001s	sys 0.005s
I20260709 12:26:43.756263 15819 raft_consensus.cc:2749] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:43.785683 15880 raft_consensus.cc:697] T e8b17195a94142039c40f598ed006c94 P 3c52e0825c02476e89d84da9bb849f5d [term 6 LEADER]: Becoming Leader. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
I20260709 12:26:43.641047 15619 raft_consensus.cc:493] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.847880 11624 raft_consensus.cc:1275] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [term 13 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:26:43.671244 15767 leader_election.cc:290] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:43.854228 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:43.643339 15612 leader_election.cc:290] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 15 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:43.642737 15862 leader_election.cc:290] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:43.812372 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b17195a94142039c40f598ed006c94" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:43.580940 15515 leader_election.cc:290] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:43.696415 15889 raft_consensus.cc:493] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:43.670933 15868 raft_consensus.cc:493] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:43.905850 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:43.679978 15843 leader_election.cc:290] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:43.683805 15834 raft_consensus.cc:493] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:43.781100 15712 raft_consensus.cc:2749] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:43.703874 15615 leader_election.cc:290] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 12 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:43.821481 10920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59626 (request call id 3675) took 1120 ms. Trace:
I20260709 12:26:43.523437 15867 raft_consensus.cc:515] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:43.697235 15861 raft_consensus.cc:515] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:43.850273 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:43.851202 11617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:43.803676 15831 raft_consensus.cc:740] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:43.855343 10924 raft_consensus.cc:3060] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:43.861306 15216 raft_consensus.cc:2804] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:26:43.861634 15818 raft_consensus.cc:493] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:43.862740 15510 raft_consensus.cc:3055] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:26:43.868301 10922 raft_consensus.cc:3060] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [term 4 FOLLOWER]: Advancing to term 6
W20260709 12:26:43.928830 15825 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.018s	sys 0.060s
I20260709 12:26:43.871245 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:43.825340 15824 raft_consensus.cc:515] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:43.878504 10995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57514 (request call id 1277) took 1009 ms. Trace:
I20260709 12:26:43.834034 15766 raft_consensus.cc:515] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:43.881985 15522 raft_consensus.cc:493] T b289bc89d592435fb63c7fcf580d95a4 P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.883107 15880 consensus_queue.cc:237] T e8b17195a94142039c40f598ed006c94 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:43.838935 15875 raft_consensus.cc:515] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:43.887367 10999 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37500 (request call id 3984) took 1353 ms (client timeout 1550 ms). Trace:
I20260709 12:26:43.846634 15718 raft_consensus.cc:493] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
W20260709 12:26:43.892403 11621 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45904 (request call id 967) took 1910 ms (client timeout 1795 ms). Trace:
I20260709 12:26:43.865679 15619 raft_consensus.cc:515] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:43.807675 15816 raft_consensus.cc:515] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:43.959945 10996 raft_consensus.cc:2468] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 12.
I20260709 12:26:43.648428 15864 leader_election.cc:290] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:43.778635 15840 raft_consensus.cc:515] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:43.545655 15848 raft_consensus.cc:515] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:43.923902 10920 rpcz_store.cc:276] 0709 12:26:42.701272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:42.758098 (+ 56826us) service_pool.cc:224] Handling call
0709 12:26:43.821313 (+1063215us) spinlock_profiling.cc:243] Waited 649 ms on lock 0x7b5400207bd4. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e8c2fa 00007f7599e4db17 00007f75933c86d4 00007f75933c8662 00007f75933c8591 00007f75933c850c 00007f75933c77c2 00007f75931c348c 00007f75931c28c6 00007f75931c226f
0709 12:26:43.821430 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1491628928}
I20260709 12:26:43.932019 11623 raft_consensus.cc:1240] T e9331e5342644ca2bae19187b083a7d5 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 5. Current term is 6. Ops: []
I20260709 12:26:43.930099 10969 leader_election.cc:304] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:43.637212 15849 consensus_queue.cc:237] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:43.759534 15832 raft_consensus.cc:515] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:43.936481 15216 raft_consensus.cc:493] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:43.947067 10995 rpcz_store.cc:276] 0709 12:26:42.868615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:42.869139 (+   524us) service_pool.cc:224] Handling call
0709 12:26:43.878115 (+1008976us) spinlock_profiling.cc:243] Waited 15.9 ms on lock 0x7b54001824d4. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e8c2fa 00007f7599e4db17 00007f75933c86d4 00007f75933c8662 00007f75933c8591 00007f75933c850c 00007f75933c77c2 00007f75931c348c 00007f75931c28c6 00007f75931c226f
0709 12:26:43.878381 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36462464}
W20260709 12:26:43.952342 10999 rpcz_store.cc:269] 0709 12:26:42.533987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:42.543804 (+  9817us) service_pool.cc:224] Handling call
0709 12:26:43.887019 (+1343215us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54002d3054. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e8c2fa 00007f7599e4db17 00007f75933c86d4 00007f75933c8662 00007f75933c8591 00007f75933c850c 00007f75933c77c2 00007f75931c348c 00007f75931c28c6 00007f75931c226f
0709 12:26:43.887218 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2882967936}
I20260709 12:26:43.949039 15818 raft_consensus.cc:515] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:43.947731 15825 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.019s	sys 0.060s
W20260709 12:26:43.954126 11621 rpcz_store.cc:269] 0709 12:26:41.981996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:41.982437 (+   441us) service_pool.cc:224] Handling call
0709 12:26:43.892055 (+1909618us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b540096cb54. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e8c2fa 00007f7599e4db17 00007f75933c86d4 00007f75933c8662 00007f75933c8591 00007f75933c850c 00007f75933c77c2 00007f75931c348c 00007f75931c28c6 00007f75931c226f
0709 12:26:43.892263 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2436064512}
I20260709 12:26:43.990193 15216 raft_consensus.cc:3060] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:26:43.955564 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 302025us
I20260709 12:26:43.966055 15862 raft_consensus.cc:493] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:43.997779 15862 raft_consensus.cc:515] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:43.999993 15862 leader_election.cc:290] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:43.962082 11589 leader_election.cc:304] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:44.001062 15875 leader_election.cc:290] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:43.968026 11002 raft_consensus.cc:3060] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:44.001996 15818 leader_election.cc:290] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:44.002259 15875 raft_consensus.cc:493] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:44.002636 15818 raft_consensus.cc:493] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:44.002836 15875 raft_consensus.cc:515] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:43.915776 15868 raft_consensus.cc:515] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:43.973693 10926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50036 (request call id 1040) took 1358 ms. Trace:
I20260709 12:26:43.974848 11624 raft_consensus.cc:2410] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for term 12 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 12:26:43.996721 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:44.004602 10926 rpcz_store.cc:276] 0709 12:26:42.614959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:42.615092 (+   133us) service_pool.cc:224] Handling call
0709 12:26:42.652753 (+ 37661us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:42.669643 (+ 16890us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:42.669690 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:42.713311 (+ 43621us) log.cc:844] Serialized 26 byte log entry
0709 12:26:43.341557 (+628246us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:26:43.341637 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:43.341723 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:43.973405 (+631682us) raft_consensus.cc:1685] finished
0709 12:26:43.973455 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:43.973616 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16506,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":110,"thread_start_us":567148,"threads_started":1,"wal-append.queue_time_us":751496}
I20260709 12:26:43.920239 15889 raft_consensus.cc:515] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:43.977573 10969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 49623.2us
I20260709 12:26:43.978335 11620 raft_consensus.cc:1240] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 8. Current term is 9. Ops: []
I20260709 12:26:43.948860 15831 consensus_queue.cc:260] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:43.975593 10929 raft_consensus.cc:2468] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 15.
I20260709 12:26:43.982254 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:44.016242 11000 raft_consensus.cc:2468] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 10.
I20260709 12:26:43.917465 15834 raft_consensus.cc:515] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:43.973069 15885 consensus_meta.cc:287] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d: Time spent flushing consensus metadata: real 0.564s	user 0.004s	sys 0.009s
I20260709 12:26:43.990422 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:44.023612 10996 raft_consensus.cc:2393] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 9: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:26:43.952092 15522 raft_consensus.cc:515] T b289bc89d592435fb63c7fcf580d95a4 P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:43.992789 11617 raft_consensus.cc:2468] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 13.
I20260709 12:26:43.993954 15830 leader_election.cc:290] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:43.996815 15816 leader_election.cc:290] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 9 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:43.942471 15510 raft_consensus.cc:740] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:43.968247 11001 raft_consensus.cc:2468] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 15.
I20260709 12:26:43.956164 15718 raft_consensus.cc:515] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:43.988672 15864 raft_consensus.cc:2804] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:44.003860 15458 leader_election.cc:290] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:44.003319 15818 raft_consensus.cc:515] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:44.008816 15862 raft_consensus.cc:2804] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:26:44.028934 10998 raft_consensus.cc:1275] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:26:43.963948 10922 raft_consensus.cc:2468] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 6.
I20260709 12:26:43.943369 15866 consensus_queue.cc:237] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:44.033646 10893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:44.026093 15831 raft_consensus.cc:3060] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:44.062481 11589 leader_election.cc:304] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:44.064098 11589 leader_election.cc:304] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:44.047650 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:44.041621 10924 raft_consensus.cc:2468] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 12.
I20260709 12:26:44.057363 11622 raft_consensus.cc:3060] T b289bc89d592435fb63c7fcf580d95a4 P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:44.066829 10996 raft_consensus.cc:3060] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:26:44.044600 11001 raft_consensus.cc:1240] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 10. Current term is 11. Ops: []
I20260709 12:26:44.070210 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:44.029498 15885 raft_consensus.cc:515] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:44.089263 15515 raft_consensus.cc:493] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:44.089572 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:44.089903 15515 raft_consensus.cc:515] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:44.090543 10998 raft_consensus.cc:2468] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 12.
I20260709 12:26:44.092824 15868 leader_election.cc:290] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
W20260709 12:26:44.093689 15904 log.cc:927] Time spent T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:26:44.094856 15885 leader_election.cc:290] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 7 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:44.095180 15861 leader_election.cc:290] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:44.095988 15515 leader_election.cc:290] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:44.097563 10996 raft_consensus.cc:2468] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 7.
I20260709 12:26:44.100071 11621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:44.102777 11622 raft_consensus.cc:2468] T b289bc89d592435fb63c7fcf580d95a4 P 3c52e0825c02476e89d84da9bb849f5d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 12.
I20260709 12:26:44.104074 15612 raft_consensus.cc:2804] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:44.110301 15612 raft_consensus.cc:493] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:44.110898 15612 raft_consensus.cc:3060] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:44.105029 15900 raft_consensus.cc:2804] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:26:44.114375 15900 raft_consensus.cc:697] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [term 15 LEADER]: Becoming Leader. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
I20260709 12:26:44.118275 15858 leader_election.cc:290] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265)
I20260709 12:26:44.119503 15900 consensus_queue.cc:237] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:44.084164 15899 raft_consensus.cc:493] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:44.124585 15899 raft_consensus.cc:515] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:44.125660 10928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59626 (request call id 3674) took 1429 ms. Trace:
I20260709 12:26:44.060689 15841 raft_consensus.cc:493] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.130461 15841 raft_consensus.cc:515] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:44.108186 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:44.106611 15891 leader_election.cc:290] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:44.145253 10820 leader_election.cc:304] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:44.115046 15871 leader_election.cc:290] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:44.126799 10928 rpcz_store.cc:276] 0709 12:26:42.696062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:42.885756 (+189694us) service_pool.cc:224] Handling call
0709 12:26:42.900330 (+ 14574us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:43.070954 (+170624us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:26:43.287047 (+216093us) log.cc:844] Serialized 14 byte log entry
0709 12:26:43.484940 (+197893us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:43.485031 (+    91us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:26:43.485446 (+   415us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:43.825034 (+339588us) spinlock_profiling.cc:243] Waited 2.25 ms on lock 0x7b1800463720. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f759ac63ab1 00007f759ac70281 00007f7591d692a6 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e88e01 00007f7594e8783e 00007f7599e4c419
0709 12:26:44.125173 (+300139us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b5400147dd4. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e88e01 00007f7594e8783e 00007f7599e4c419 00007f75933c3bd4 00007f75933c3b62 00007f75933c3a91 00007f75933c3a0c 00007f75933c2cc2 00007f75931c348c 00007f75931c28c6
0709 12:26:44.125272 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:44.125545 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6111,"prepare.queue_time_us":47979,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":61,"raft.queue_time_us":524,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":6584,"spinlock_wait_cycles":396971136,"thread_start_us":412432,"threads_started":2,"wal-append.queue_time_us":403170}
I20260709 12:26:44.162540 15515 raft_consensus.cc:2749] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:44.163856 15899 leader_election.cc:290] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:44.026481 15835 consensus_queue.cc:1059] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:26:44.022750 15767 consensus_queue.cc:1048] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 12:26:44.192589 11621 raft_consensus.cc:2468] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 9.
I20260709 12:26:44.142787 15700 raft_consensus.cc:493] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.159912 10820 leader_election.cc:304] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:44.182271 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63ecfc9bd3945818cfe15c03f001315" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:44.200961 10969 leader_election.cc:304] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
W20260709 12:26:44.207918 15902 log.cc:927] Time spent T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:26:44.213845 15832 leader_election.cc:290] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 6 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:26:44.262136 10969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 61333us
I20260709 12:26:44.264787 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:44.265056 10969 leader_election.cc:304] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:44.216279 15834 leader_election.cc:290] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:44.218120 15766 leader_election.cc:290] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:44.224224 15837 raft_consensus.cc:493] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:44.235179 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 441960us
I20260709 12:26:44.236572 15658 raft_consensus.cc:493] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:44.238171 15726 raft_consensus.cc:493] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:44.170359 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:44.287902 15726 raft_consensus.cc:515] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:44.289304 15658 raft_consensus.cc:515] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:44.239813 15712 raft_consensus.cc:493] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.292023 15712 raft_consensus.cc:515] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:44.294293 15852 log.cc:927] Time spent T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 1.406s	user 0.003s	sys 0.011s
I20260709 12:26:44.275077 15700 raft_consensus.cc:515] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:44.298483 10800 auto_rebalancer.cc:629] Failed to schedule move for tablet d5b6ea992cd64650b1c2da6c548d012f: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:44.299746 15522 leader_election.cc:290] T b289bc89d592435fb63c7fcf580d95a4 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:44.302276 15669 raft_consensus.cc:3055] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:26:44.302850 15669 raft_consensus.cc:740] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:26:44.295406 15712 leader_election.cc:290] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:26:44.258376 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 98587.6us
I20260709 12:26:44.308025 15712 consensus_queue.cc:1048] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 12:26:44.312311 11001 raft_consensus.cc:2368] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 14. Current term is 15.
I20260709 12:26:44.306689 15813 leader_election.cc:290] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:44.200963 15824 leader_election.cc:290] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 14 election: Requested vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
W20260709 12:26:44.319830 10800 auto_rebalancer.cc:629] Failed to schedule move for tablet f6820c5c64094058b98e641fdb7ffe67: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:44.299263 15700 leader_election.cc:290] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:44.340595 10850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56394 (request call id 4137) took 2430 ms. Trace:
I20260709 12:26:44.347237 10820 leader_election.cc:304] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:44.306569 15726 leader_election.cc:290] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:44.352115 15726 consensus_queue.cc:1059] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:26:44.350901 15446 consensus_queue.cc:1048] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:26:44.269431 15868 raft_consensus.cc:2804] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:44.279366 15835 raft_consensus.cc:2804] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:26:44.361951 15882 raft_consensus.cc:2804] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:44.361881 15700 consensus_queue.cc:1059] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:26:44.283881 15837 raft_consensus.cc:3060] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:44.368242 11624 raft_consensus.cc:1240] T e9331e5342644ca2bae19187b083a7d5 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 5. Current term is 6. Ops: []
I20260709 12:26:44.358021 10820 leader_election.cc:304] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:44.367506 11002 raft_consensus.cc:2468] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 14.
I20260709 12:26:44.393242 10997 raft_consensus.cc:1275] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 13 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:26:44.320302 15834 raft_consensus.cc:2804] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:26:44.315819 15891 raft_consensus.cc:493] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:44.196949 15510 consensus_queue.cc:260] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:44.341661 10850 rpcz_store.cc:276] 0709 12:26:41.890423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:41.895652 (+  5229us) service_pool.cc:224] Handling call
0709 12:26:41.895996 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:41.917632 (+ 21636us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:41.917684 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:41.988825 (+ 71141us) log.cc:844] Serialized 26 byte log entry
0709 12:26:42.492142 (+503317us) spinlock_profiling.cc:243] Waited 20.8 ms on lock 0x7b18003bc320. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f759ac63ab1 00007f759ac70281 00007f7591d7de07 00007f759abd89a9 00007f7591d9a69b 00007f7591d9893f 00007f7591d9ac02 00007f7594a2220b 00007f7594a27d23 00007f7594a280d1 00007f7594e43a0f
0709 12:26:42.683915 (+191773us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:26:42.683961 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:42.684052 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:44.293413 (+1609361us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b4400022b4c. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7591c23db1 00007f7591cc1c85 00007f7591cc26a2 00007f7594a341db 00007f7594a2faaf 00007f7594a2386e 00007f7594a22bb6 00007f7594a227d8 00007f7594a2c221 00007f7594a2c1d9 00007f7594a2c169
0709 12:26:44.320899 (+ 27486us) raft_consensus.cc:1685] finished
0709 12:26:44.320929 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:44.321109 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10888,"raft.queue_time_us":10974,"raft.run_cpu_time_us":388,"raft.run_wall_time_us":70989,"spinlock_wait_cycles":74920704,"thread_start_us":191529,"threads_started":1,"wal-append.queue_time_us":795709}
I20260709 12:26:44.363559 15843 raft_consensus.cc:493] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.429482 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5794ba618e514e28a7542ab6af39d8c9" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:44.430567 11001 raft_consensus.cc:3060] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:44.369067 15868 raft_consensus.cc:493] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:44.437494 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:44.438606 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:44.390610 15882 raft_consensus.cc:493] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:44.406287 15619 leader_election.cc:290] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:44.410409 15861 consensus_queue.cc:1059] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
W20260709 12:26:44.486011 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 399387us
I20260709 12:26:44.372249 15867 leader_election.cc:290] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:44.444927 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:26:44.523491 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 286422us
I20260709 12:26:44.410107 15824 raft_consensus.cc:2804] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:26:44.542400 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:44.543741 11002 raft_consensus.cc:2468] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 11.
W20260709 12:26:44.599530 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 64444.1us
I20260709 12:26:44.469750 15841 leader_election.cc:290] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:44.532472 15515 raft_consensus.cc:493] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:44.604031 15700 raft_consensus.cc:493] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.523681 15843 raft_consensus.cc:515] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:44.532153 15845 raft_consensus.cc:3055] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:26:44.435483 15834 raft_consensus.cc:697] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:26:44.433018 15712 raft_consensus.cc:3055] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:26:44.617002 15658 leader_election.cc:290] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:44.532675 15819 raft_consensus.cc:493] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:44.620486 11588 leader_election.cc:304] T e9331e5342644ca2bae19187b083a7d5 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:44.437496 15868 raft_consensus.cc:3060] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:44.491385 15882 raft_consensus.cc:3060] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:26:44.682363 10893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:44.608737 15848 leader_election.cc:290] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:44.622792 15824 raft_consensus.cc:697] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 7 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:44.430262 15835 raft_consensus.cc:697] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 9 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:26:44.471664 15718 leader_election.cc:290] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:44.431862 15891 raft_consensus.cc:515] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:44.644454 15845 raft_consensus.cc:740] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:44.459263 15889 leader_election.cc:290] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
W20260709 12:26:44.628576 15862 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.041s	sys 0.032s
W20260709 12:26:44.682624 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 44434us
I20260709 12:26:44.714149 11589 leader_election.cc:304] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:44.698915 15899 raft_consensus.cc:2804] T e9331e5342644ca2bae19187b083a7d5 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:44.685526 15658 raft_consensus.cc:493] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:44.646641 15866 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.031s	sys 0.051s
W20260709 12:26:44.690100 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 69700.7us
I20260709 12:26:44.734570 11588 leader_election.cc:304] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040; no voters: 
W20260709 12:26:44.711751 15862 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.041s	sys 0.033s
I20260709 12:26:44.642777 15700 raft_consensus.cc:515] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:44.697219 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 95843.4us
W20260709 12:26:44.696645 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 413050us
I20260709 12:26:44.660229 15712 raft_consensus.cc:740] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:44.458767 15831 raft_consensus.cc:493] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.728355 11001 raft_consensus.cc:2468] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 6.
I20260709 12:26:44.732122 10997 raft_consensus.cc:2468] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 11.
I20260709 12:26:44.643404 15515 raft_consensus.cc:515] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:44.682407 15867 consensus_queue.cc:1059] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:26:44.689416 15819 raft_consensus.cc:515] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:44.515290 15840 leader_election.cc:290] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:44.744102 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:26:44.734205 15866 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.031s	sys 0.052s
I20260709 12:26:44.733754 15885 raft_consensus.cc:2804] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:44.721048 15864 raft_consensus.cc:493] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:44.747561 10895 leader_election.cc:304] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:44.774435 11003 raft_consensus.cc:2468] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 12.
I20260709 12:26:44.737524 15862 raft_consensus.cc:697] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d [term 12 LEADER]: Becoming Leader. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
I20260709 12:26:44.741089 15899 raft_consensus.cc:697] T e9331e5342644ca2bae19187b083a7d5 P 3c52e0825c02476e89d84da9bb849f5d [term 6 LEADER]: Becoming Leader. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
I20260709 12:26:44.742070 15816 raft_consensus.cc:2804] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:26:44.771517 15809 ts_tablet_manager.cc:1929] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 9.9
I20260709 12:26:44.736316 15658 raft_consensus.cc:515] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:44.788285 10996 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.055s	sys 0.109s
W20260709 12:26:44.807852 10996 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.056s	sys 0.109s
I20260709 12:26:44.776569 15885 raft_consensus.cc:493] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:44.776755 15864 raft_consensus.cc:3060] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:44.777923 15867 consensus_queue.cc:1243] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer 3c52e0825c02476e89d84da9bb849f5d log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:26:44.776583 15818 leader_election.cc:290] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:44.735491 15845 consensus_queue.cc:260] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:44.827235 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 383234us
I20260709 12:26:44.759851 15831 raft_consensus.cc:515] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:44.820235 15216 consensus_meta.cc:287] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d: Time spent flushing consensus metadata: real 0.823s	user 0.009s	sys 0.005s
I20260709 12:26:44.826042 15809 log.cc:1199] T 87cb7b380c8446e6ab1355c203218967 P e2d5c637307a407ab688f5ccd6f0fcea: Deleting WAL directory at /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599781984018-9681-0/minicluster-data/ts-1-root/wals/87cb7b380c8446e6ab1355c203218967
I20260709 12:26:44.822163 15885 raft_consensus.cc:3060] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:44.821671 15866 raft_consensus.cc:493] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.824267 15921 raft_consensus.cc:493] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.746362 15834 consensus_queue.cc:237] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:44.826490 15816 raft_consensus.cc:697] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [term 15 LEADER]: Becoming Leader. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
I20260709 12:26:44.873930 11001 raft_consensus.cc:1275] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:26:44.781081 15835 consensus_queue.cc:237] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:44.832598 15712 consensus_queue.cc:260] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:44.804999 15824 consensus_queue.cc:237] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:44.890148 15899 consensus_queue.cc:237] T e9331e5342644ca2bae19187b083a7d5 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:44.890661 15832 raft_consensus.cc:493] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.875748 15921 raft_consensus.cc:515] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:44.858927 15216 raft_consensus.cc:515] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:44.908315 15843 leader_election.cc:290] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:26:44.908903 15918 log.cc:927] Time spent T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
W20260709 12:26:44.898542 15912 log.cc:927] Time spent T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
W20260709 12:26:44.904124 15911 log.cc:927] Time spent T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
W20260709 12:26:44.957803 10892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:44.960016 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 221788us
I20260709 12:26:44.899626 15712 raft_consensus.cc:3060] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:44.872988 15866 raft_consensus.cc:515] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:44.906546 15921 leader_election.cc:290] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:44.913039 15922 raft_consensus.cc:2804] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:26:44.908030 15891 leader_election.cc:290] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:44.927695 15818 raft_consensus.cc:493] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.897257 15845 raft_consensus.cc:3060] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:44.872699 15862 consensus_queue.cc:237] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:44.951203 15889 raft_consensus.cc:493] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:45.004282 15922 raft_consensus.cc:493] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:45.016323 15922 raft_consensus.cc:3060] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:45.016095 15889 raft_consensus.cc:515] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:44.999167 11588 leader_election.cc:304] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:45.019443 15893 raft_consensus.cc:2749] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:45.004987 15921 raft_consensus.cc:493] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.005082 15700 leader_election.cc:290] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:26:45.020962 15913 log.cc:927] Time spent T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.190s	user 0.000s	sys 0.001s
I20260709 12:26:45.023198 15809 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:59610 (request call id 85) took 3782 ms. Trace:
I20260709 12:26:45.025693 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:45.027060 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c6d38c4d8a90a81975a6a0cb13" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:45.028064 10995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37512 (request call id 3569) took 1036 ms. Trace:
I20260709 12:26:45.028198 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:45.028590 15818 raft_consensus.cc:515] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:45.029367 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:45.028496 10995 rpcz_store.cc:276] 0709 12:26:43.992020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:43.993441 (+  1421us) service_pool.cc:224] Handling call
0709 12:26:43.993871 (+   430us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:43.994317 (+   446us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:43.994359 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:43.994892 (+   533us) log.cc:844] Serialized 26 byte log entry
0709 12:26:44.317859 (+322967us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:26:44.317906 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:44.317979 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:45.027822 (+709843us) raft_consensus.cc:1685] finished
0709 12:26:45.027851 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:45.028004 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1936,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":105,"thread_start_us":322534,"threads_started":1,"wal-append.queue_time_us":651139}
I20260709 12:26:45.023320 11001 raft_consensus.cc:1240] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 10. Current term is 11. Ops: []
I20260709 12:26:45.032629 15809 rpcz_store.cc:276] 0709 12:26:41.287720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:41.288257 (+   537us) service_pool.cc:224] Handling call
0709 12:26:41.610954 (+322697us) ts_tablet_manager.cc:1151] Deleting tablet 87cb7b380c8446e6ab1355c203218967
0709 12:26:41.627445 (+ 16491us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:26:43.652929 (+2025484us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:44.745605 (+1092676us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:45.023090 (+277485us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":252761,"thread_start_us":146343,"threads_started":1}
I20260709 12:26:45.000074 15831 leader_election.cc:290] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:45.035750 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:45.036514 10927 raft_consensus.cc:2468] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 13.
I20260709 12:26:45.035773 15669 consensus_queue.cc:260] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:45.038486 15669 raft_consensus.cc:3060] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:45.009842 15816 consensus_queue.cc:237] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:45.000036 15924 log.cc:927] Time spent T e8b17195a94142039c40f598ed006c94 P 3c52e0825c02476e89d84da9bb849f5d: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 12:26:44.978770 15925 raft_consensus.cc:493] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.042098 15925 raft_consensus.cc:515] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:45.020344 15921 raft_consensus.cc:515] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:45.025830 15216 leader_election.cc:290] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 10 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:26:45.003131 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 259633us
I20260709 12:26:45.046095 15925 leader_election.cc:290] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:44.900163 15832 raft_consensus.cc:515] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:45.071776 15515 leader_election.cc:290] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:45.052554 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:45.072700 10927 raft_consensus.cc:3060] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:45.072747 15864 raft_consensus.cc:515] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:45.053871 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:45.073895 15832 leader_election.cc:290] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:45.074512 15866 leader_election.cc:290] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:45.058490 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:45.053814 15658 leader_election.cc:290] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:45.064203 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fd8fdac2fa449e9e184f3d668ea1a7" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:45.081462 11589 leader_election.cc:304] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:45.082515 11589 leader_election.cc:304] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:45.081615 10928 raft_consensus.cc:2468] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 9.
W20260709 12:26:45.083544 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 69944.9us
I20260709 12:26:45.061661 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:45.067718 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:45.086900 10922 raft_consensus.cc:2410] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3c52e0825c02476e89d84da9bb849f5d for term 12 because replica has last-logged OpId of term: 11 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260709 12:26:45.059193 10895 leader_election.cc:400] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 12 election: Vote denied by peer 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613) with higher term. Message: Invalid argument: T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for earlier term 12. Current term is 13.
I20260709 12:26:45.051548 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:45.088492 11001 raft_consensus.cc:3060] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:45.089030 10895 leader_election.cc:403] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
W20260709 12:26:45.047596 15612 consensus_meta.cc:287] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d: Time spent flushing consensus metadata: real 0.936s	user 0.014s	sys 0.001s
I20260709 12:26:45.090901 10895 leader_election.cc:304] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:26:45.066442 15923 log.cc:927] Time spent T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
W20260709 12:26:45.066864 15917 log.cc:927] Time spent T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.202s	user 0.003s	sys 0.000s
W20260709 12:26:45.094098 10968 leader_election.cc:336] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:26:45.052019 15920 log.cc:927] Time spent T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:26:44.976990 15840 raft_consensus.cc:493] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:45.095893 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:45.085696 10998 raft_consensus.cc:2410] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:26:45.101074 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fd8fdac2fa449e9e184f3d668ea1a7" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:45.105722 10924 raft_consensus.cc:2468] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 9.
W20260709 12:26:45.050487 15837 consensus_meta.cc:287] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea: Time spent flushing consensus metadata: real 0.612s	user 0.010s	sys 0.000s
I20260709 12:26:45.108603 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:45.049796 15921 leader_election.cc:290] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:45.090219 15585 raft_consensus.cc:2804] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:45.105628 10927 raft_consensus.cc:2468] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 9.
I20260709 12:26:45.092175 15619 raft_consensus.cc:2804] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:45.112551 10928 raft_consensus.cc:2393] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 7: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:26:45.095767 10968 leader_election.cc:304] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:45.116410 11624 raft_consensus.cc:2368] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 9. Current term is 10.
I20260709 12:26:45.117450 11620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:45.122735 11620 raft_consensus.cc:2393] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 11: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:26:45.094029 15658 raft_consensus.cc:2749] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613) with higher term. Message: Invalid argument: T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for earlier term 12. Current term is 13.
W20260709 12:26:45.128196 10968 leader_election.cc:336] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:45.130695 11624 raft_consensus.cc:1240] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 6. Current term is 7. Ops: []
I20260709 12:26:45.130512 10968 leader_election.cc:304] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:45.094976 15832 consensus_queue.cc:1048] T e8b17195a94142039c40f598ed006c94 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.032s
W20260709 12:26:45.135313 10968 leader_election.cc:336] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:45.092232 15882 raft_consensus.cc:515] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:45.125138 15619 raft_consensus.cc:493] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:45.095454 15612 raft_consensus.cc:515] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:45.130388 15585 raft_consensus.cc:697] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d [term 6 LEADER]: Becoming Leader. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
I20260709 12:26:45.140535 10927 raft_consensus.cc:1275] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:26:45.116688 15840 raft_consensus.cc:515] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:45.142644 10928 raft_consensus.cc:1275] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:26:45.118397 15837 raft_consensus.cc:515] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:45.143198 10968 leader_election.cc:304] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:45.120466 15932 raft_consensus.cc:2749] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:45.143432 11001 raft_consensus.cc:2468] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 10.
I20260709 12:26:45.138723 15858 raft_consensus.cc:2749] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:45.154589 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac8522e549a46e09593fa4c2e175557" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:26:45.155149 10968 leader_election.cc:336] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:45.162990 10968 leader_election.cc:304] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:45.120965 10895 leader_election.cc:304] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:45.162348 11589 leader_election.cc:304] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:45.140264 15818 leader_election.cc:290] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:45.151968 15889 leader_election.cc:290] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:45.146448 15619 raft_consensus.cc:3060] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:45.178627 15615 raft_consensus.cc:2804] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:26:45.180131 15615 raft_consensus.cc:697] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d [term 10 LEADER]: Becoming Leader. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
I20260709 12:26:45.181701 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:45.169091 10999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37512 (request call id 3570) took 1164 ms. Trace:
W20260709 12:26:45.178881 10968 leader_election.cc:336] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:45.166257 11000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37512 (request call id 3573) took 1145 ms. Trace:
I20260709 12:26:45.183043 10968 leader_election.cc:304] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:45.169937 11617 raft_consensus.cc:1240] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:26:45.183243 11000 rpcz_store.cc:276] 0709 12:26:44.020661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.032580 (+ 11919us) service_pool.cc:224] Handling call
0709 12:26:44.032921 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:44.061094 (+ 28173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:44.061148 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:44.156748 (+ 95600us) log.cc:844] Serialized 26 byte log entry
0709 12:26:44.719532 (+562784us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:26:44.720874 (+  1342us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:45.028412 (+307538us) spinlock_profiling.cc:243] Waited 3.68 ms on lock 0x7b54001824d4. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e88e01 00007f7594e8783e 00007f7599e4c419 00007f75933c3bd4 00007f75933c3b62 00007f75933c3a91 00007f75933c3a0c 00007f75933c2cc2 00007f75931c348c 00007f75931c28c6
0709 12:26:45.028459 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:45.153692 (+125233us) raft_consensus.cc:1685] finished
0709 12:26:45.153732 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:45.166182 (+ 12450us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":118,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":13115,"spinlock_wait_cycles":8467840,"thread_start_us":474911,"threads_started":1,"wal-append.queue_time_us":725745}
I20260709 12:26:45.185799 11619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:45.187042 11619 raft_consensus.cc:2393] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 5: Already voted for candidate 3c52e0825c02476e89d84da9bb849f5d in this term.
I20260709 12:26:45.182583 10999 rpcz_store.cc:276] 0709 12:26:44.004301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.004679 (+   378us) service_pool.cc:224] Handling call
0709 12:26:44.012249 (+  7570us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:44.021528 (+  9279us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:44.021566 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:44.032613 (+ 11047us) log.cc:844] Serialized 26 byte log entry
0709 12:26:44.644079 (+611466us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:26:44.644166 (+    87us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:44.644282 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:45.066015 (+421733us) spinlock_profiling.cc:243] Waited 3.64 ms on lock 0x7b4400022b4c. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7591c23db1 00007f7591cc1c85 00007f7591cc26a2 00007f7594a341db 00007f7594a2faaf 00007f7594a2386e 00007f7594a22bb6 00007f7594a227d8 00007f7594a2c221 00007f7594a2c1d9 00007f7594a2c169
0709 12:26:45.152888 (+ 86873us) raft_consensus.cc:1685] finished
0709 12:26:45.152923 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:45.169005 (+ 16082us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":110,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":13021,"spinlock_wait_cycles":8375552,"thread_start_us":467826,"threads_started":1,"wal-append.queue_time_us":718639}
I20260709 12:26:45.170792 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:45.172147 11621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac8522e549a46e09593fa4c2e175557" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:45.173244 11618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:45.174674 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:45.175467 11620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fd8fdac2fa449e9e184f3d668ea1a7" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:45.181295 15615 consensus_queue.cc:237] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:45.195986 11620 raft_consensus.cc:2468] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 9.
W20260709 12:26:45.165493 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 45932.8us
W20260709 12:26:45.233058 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 54218us
I20260709 12:26:45.161165 15767 raft_consensus.cc:2749] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:45.234680 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:45.147727 15922 raft_consensus.cc:515] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:45.170833 15867 raft_consensus.cc:2749] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:26:45.235055 10968 consensus_peers.cc:597] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:45.247877 10968 consensus_peers.cc:597] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:45.237460 11619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:45.168557 15921 raft_consensus.cc:2804] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:26:45.242878 11616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:45.249747 11619 raft_consensus.cc:2468] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 11.
W20260709 12:26:45.249132 10968 leader_election.cc:336] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:45.251348 10895 leader_election.cc:400] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Vote denied by peer 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613) with higher term. Message: Invalid argument: T e8b17195a94142039c40f598ed006c94 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for earlier term 5. Current term is 6.
I20260709 12:26:45.251529 11620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
W20260709 12:26:45.253041 10968 leader_election.cc:336] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:45.253434 10895 leader_election.cc:403] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:26:45.253696 10968 leader_election.cc:336] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:45.233695 15818 raft_consensus.cc:493] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:45.255273 10968 leader_election.cc:336] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:45.244930 11588 leader_election.cc:304] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:26:45.259615 10968 leader_election.cc:336] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:45.261401 10968 leader_election.cc:304] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:45.256642 10996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37512 (request call id 3577) took 1221 ms. Trace:
I20260709 12:26:45.236687 15669 raft_consensus.cc:2749] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:26:45.177886 15837 leader_election.cc:290] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:45.263706 10929 raft_consensus.cc:1240] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 6. Current term is 7. Ops: []
I20260709 12:26:45.262300 10996 rpcz_store.cc:276] 0709 12:26:44.035425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.098327 (+ 62902us) service_pool.cc:224] Handling call
0709 12:26:44.098825 (+   498us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:44.099044 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:26:44.130006 (+ 30962us) log.cc:844] Serialized 14 byte log entry
0709 12:26:45.024352 (+894346us) spinlock_profiling.cc:243] Waited 2.06 ms on lock 0x7b1800031ae0. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f759ac63ab1 00007f759ac70281 00007f7591d7de07 00007f759abd89a9 00007f7591d9a69b 00007f7591d9893f 00007f7591d98455 00007f75988803c7 00007f7594e929a7 00007f7594ea20bf 00007f7594ea2038
0709 12:26:45.255833 (+231481us) log.cc:844] Serialized 14 byte log entry
0709 12:26:45.256308 (+   475us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:45.256357 (+    49us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:26:45.256411 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:45.256474 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:45.256588 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44173,"prepare.queue_time_us":31279,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":53,"raft.queue_time_us":14198,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":7154,"spinlock_wait_cycles":5102336,"thread_start_us":908802,"threads_started":2,"wal-append.queue_time_us":776481}
I20260709 12:26:45.269091 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:45.270048 10927 raft_consensus.cc:2468] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 12.
I20260709 12:26:45.273695 11588 leader_election.cc:304] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:45.275403 10928 raft_consensus.cc:1275] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 12:26:45.276788 15893 raft_consensus.cc:2804] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:26:45.277204 10928 pending_rounds.cc:85] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea: Aborting all ops after (but not including) 7
I20260709 12:26:45.277640 10928 pending_rounds.cc:107] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 12:26:45.277545 15893 raft_consensus.cc:493] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:45.278707 15893 raft_consensus.cc:3060] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:26:45.280395 10893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:45.278143 10928 raft_consensus.cc:2889] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:45.264353 15932 raft_consensus.cc:2749] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613) with higher term. Message: Invalid argument: T e8b17195a94142039c40f598ed006c94 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for earlier term 5. Current term is 6.
I20260709 12:26:45.266104 11615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6a1da21304fcfacab384a6afc4101" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:45.269281 15832 raft_consensus.cc:2804] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:45.264695 15921 raft_consensus.cc:697] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 11 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:45.305065 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:45.272761 15891 raft_consensus.cc:2749] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:26:45.316468 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:26:45.300477 10895 connection.cc:256] RPC call timeout handler was delayed by -1.9761660399999528s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15500000000000003s for a response
I20260709 12:26:45.316761 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:45.274680 15834 raft_consensus.cc:2749] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:26:45.321659 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 62118.5us
I20260709 12:26:45.267190 15818 raft_consensus.cc:515] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:45.308585 15832 raft_consensus.cc:493] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:45.335997 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6a1da21304fcfacab384a6afc4101" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:26:45.322825 10968 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 55 similar messages]
W20260709 12:26:45.365635 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 77193us
I20260709 12:26:45.261023 15585 consensus_queue.cc:237] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:45.384869 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:45.394232 10920 raft_consensus.cc:2410] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for term 12 because replica has last-logged OpId of term: 11 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260709 12:26:45.395125 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:45.394579 11588 leader_election.cc:304] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:45.398418 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:45.399610 10927 raft_consensus.cc:2393] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 9: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:26:45.395974 10920 raft_consensus.cc:2468] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 13.
I20260709 12:26:45.401917 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:45.402361 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:45.328737 15837 raft_consensus.cc:493] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:45.408691 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b17195a94142039c40f598ed006c94" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:45.409493 10925 raft_consensus.cc:2393] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 6: Already voted for candidate 3c52e0825c02476e89d84da9bb849f5d in this term.
I20260709 12:26:45.335767 15871 raft_consensus.cc:493] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:45.404666 15830 raft_consensus.cc:2804] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:26:45.350514 15832 raft_consensus.cc:3060] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:45.388468 15932 raft_consensus.cc:493] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:45.411345 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:45.412104 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:45.413094 15882 leader_election.cc:290] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 13 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:45.413178 10738 catalog_manager.cc:5028] TS e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): tablet 87cb7b380c8446e6ab1355c203218967 (table test-workload [id=e990aaaec0ac4df0ac05b58d7699b219]) successfully deleted
W20260709 12:26:45.413271 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:45.422159 10927 raft_consensus.cc:2368] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for earlier term 6. Current term is 7.
I20260709 12:26:45.389927 15834 raft_consensus.cc:493] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:45.421501 15871 raft_consensus.cc:515] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:45.427500 15834 raft_consensus.cc:515] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:45.429797 15871 leader_election.cc:290] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:45.407364 15835 consensus_queue.cc:1048] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 12:26:45.414144 15922 leader_election.cc:290] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:45.432129 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:45.432879 11002 raft_consensus.cc:2468] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 9.
I20260709 12:26:45.434525 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:45.435125 11002 raft_consensus.cc:2468] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 11.
W20260709 12:26:45.435235 15885 consensus_meta.cc:287] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d: Time spent flushing consensus metadata: real 0.558s	user 0.009s	sys 0.002s
I20260709 12:26:45.435916 15834 leader_election.cc:290] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:45.435722 15885 raft_consensus.cc:515] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:45.437456 11624 raft_consensus.cc:1240] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d [term 12 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 11. Current term is 12. Ops: []
I20260709 12:26:45.438372 15885 leader_election.cc:290] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 12 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:45.438664 15818 leader_election.cc:290] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:45.382531 15934 raft_consensus.cc:493] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:45.423645 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:45.424345 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:45.425303 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:45.443742 10998 raft_consensus.cc:3060] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:45.445923 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac83709373b4efd9c3aa1472a9f9022" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:45.447296 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:45.447468 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:45.448369 11002 raft_consensus.cc:2393] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 7: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:26:45.448500 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:45.449061 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:45.449191 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:45.449568 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:45.425966 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:45.426795 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:45.450031 15932 raft_consensus.cc:515] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:45.450744 10997 raft_consensus.cc:2393] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 11: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:26:45.450977 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:45.451891 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:45.452526 15932 leader_election.cc:290] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:45.444024 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:45.419786 15612 leader_election.cc:290] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 5 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:45.456154 10996 raft_consensus.cc:2368] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for earlier term 11. Current term is 12.
I20260709 12:26:45.425082 15837 raft_consensus.cc:515] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:45.449680 11002 raft_consensus.cc:2468] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 13.
I20260709 12:26:45.452703 10927 raft_consensus.cc:2410] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for term 14 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
W20260709 12:26:45.416121 15935 log.cc:927] Time spent T e9331e5342644ca2bae19187b083a7d5 P 3c52e0825c02476e89d84da9bb849f5d: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
W20260709 12:26:45.419229 15868 consensus_meta.cc:287] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040: Time spent flushing consensus metadata: real 0.719s	user 0.007s	sys 0.007s
I20260709 12:26:45.429689 15921 consensus_queue.cc:237] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:45.450057 10925 raft_consensus.cc:2468] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 10.
I20260709 12:26:45.464414 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:45.450703 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c913e527ff46578e084c41eab7bb9d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:45.468652 15861 raft_consensus.cc:3055] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:26:45.469030 15830 raft_consensus.cc:697] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [term 9 LEADER]: Becoming Leader. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
I20260709 12:26:45.470327 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:45.471474 11003 raft_consensus.cc:3060] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:45.406817 15867 consensus_queue.cc:1048] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 12:26:45.462423 15934 raft_consensus.cc:515] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:45.459229 15840 leader_election.cc:290] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:45.461804 15932 raft_consensus.cc:493] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:45.482733 10924 raft_consensus.cc:2410] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for term 12 because replica has last-logged OpId of term: 11 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260709 12:26:45.474591 15861 raft_consensus.cc:740] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:26:45.483932 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:45.496160 10927 raft_consensus.cc:2393] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 9: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:26:45.496403 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c913e527ff46578e084c41eab7bb9d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:45.497210 10925 raft_consensus.cc:2393] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 8: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:26:45.441725 15933 raft_consensus.cc:493] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.504420 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:45.477646 15875 leader_election.cc:290] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:45.518474 15934 leader_election.cc:290] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:45.518867 10922 raft_consensus.cc:1275] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:26:45.519605 15882 raft_consensus.cc:493] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.520251 15882 raft_consensus.cc:515] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:45.522053 10994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57514 (request call id 1303) took 1101 ms. Trace:
I20260709 12:26:45.523792 15845 raft_consensus.cc:493] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:45.524217 15933 raft_consensus.cc:515] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:45.524595 15845 raft_consensus.cc:515] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:45.526023 10922 raft_consensus.cc:1240] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [term 7 LEADER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 6. Current term is 7. Ops: []
I20260709 12:26:45.527030 15933 leader_election.cc:290] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:45.528172 10820 leader_election.cc:400] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 14 election: Vote denied by peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945) with higher term. Message: Invalid argument: T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 14. Current term is 15.
I20260709 12:26:45.528610 10820 leader_election.cc:403] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:26:45.502700 15932 raft_consensus.cc:515] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:45.530817 15932 leader_election.cc:290] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:45.533448 15832 raft_consensus.cc:515] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:45.534080 10998 raft_consensus.cc:2468] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 11.
I20260709 12:26:45.536193 15832 leader_election.cc:290] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 14 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:45.538348 15510 raft_consensus.cc:3060] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:45.539559 15889 raft_consensus.cc:493] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:45.533841 15864 leader_election.cc:290] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:45.540264 15889 raft_consensus.cc:515] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:45.541508 10928 raft_consensus.cc:2468] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 5.
I20260709 12:26:45.543849 15936 raft_consensus.cc:3060] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:45.478552 15868 raft_consensus.cc:515] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:45.546808 15824 consensus_queue.cc:1048] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:26:45.547781 15882 leader_election.cc:290] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:45.550742 15837 leader_election.cc:290] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:45.470909 15948 consensus_queue.cc:1048] T e8b17195a94142039c40f598ed006c94 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.089s
I20260709 12:26:45.551403 15893 raft_consensus.cc:515] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:45.552086 15819 leader_election.cc:290] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:45.554057 15893 leader_election.cc:290] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 10 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:45.554746 10922 raft_consensus.cc:1240] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 8. Current term is 9. Ops: []
I20260709 12:26:45.556133 15936 raft_consensus.cc:2749] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945) with higher term. Message: Invalid argument: T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 14. Current term is 15.
I20260709 12:26:45.559597 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:45.560524 10922 raft_consensus.cc:3060] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:45.559962 15861 consensus_queue.cc:260] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:45.523943 15830 consensus_queue.cc:237] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:45.564004 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac83709373b4efd9c3aa1472a9f9022" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:45.566184 10820 leader_election.cc:304] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:45.567967 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:45.570989 10925 raft_consensus.cc:2368] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for earlier term 11. Current term is 12.
I20260709 12:26:45.563385 10895 leader_election.cc:304] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:45.569054 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:45.572227 10924 raft_consensus.cc:2393] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 14: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:26:45.569832 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:45.574700 10928 raft_consensus.cc:2376] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 13. Re-sending same reply.
I20260709 12:26:45.577579 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:45.578059 10922 raft_consensus.cc:2468] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 11.
I20260709 12:26:45.579847 10998 raft_consensus.cc:1275] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:26:45.578233 11000 raft_consensus.cc:3060] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:26:45.578292 10893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:45.522589 10994 rpcz_store.cc:276] 0709 12:26:44.421067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.421203 (+   136us) service_pool.cc:224] Handling call
0709 12:26:45.521816 (+1100613us) spinlock_profiling.cc:243] Waited 828 ms on lock 0x7b54003eb7d4. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e8c2fa 00007f7599e4db17 00007f75933c86d4 00007f75933c8662 00007f75933c8591 00007f75933c850c 00007f75933c77c2 00007f75931c348c 00007f75931c28c6 00007f75931c226f
0709 12:26:45.521979 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1905351552}
I20260709 12:26:45.563113 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:45.628121 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352aa49c65194abbb863d7553a091f11" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:45.628948 11002 raft_consensus.cc:2393] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3c52e0825c02476e89d84da9bb849f5d in current term 5: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:26:45.631139 15515 raft_consensus.cc:2804] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:45.631654 15515 raft_consensus.cc:493] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:45.632050 15515 raft_consensus.cc:3060] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:26:45.652629 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 62002.8us
I20260709 12:26:45.670792 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:45.671705 10928 raft_consensus.cc:3060] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:45.673846 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fd8fdac2fa449e9e184f3d668ea1a7" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:45.674732 10925 raft_consensus.cc:3060] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:45.567224 15619 raft_consensus.cc:515] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:45.673352 15861 raft_consensus.cc:3060] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:26:45.892155 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 253347us
W20260709 12:26:45.924335 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 189924us
I20260709 12:26:45.925733 10819 leader_election.cc:304] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
W20260709 12:26:45.933109 10968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:45.934175 10894 consensus_peers.cc:597] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:45.935143 15700 raft_consensus.cc:493] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.936247 15700 raft_consensus.cc:515] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:45.935168 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:45.938750 15700 leader_election.cc:290] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:45.939332 15700 raft_consensus.cc:493] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.939769 15891 raft_consensus.cc:493] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:45.940187 15700 raft_consensus.cc:515] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:45.940753 15891 raft_consensus.cc:515] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:45.940727 15889 leader_election.cc:290] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
W20260709 12:26:45.944175 10894 consensus_peers.cc:597] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:45.949208 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 360234us
W20260709 12:26:45.949702 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 386386us
I20260709 12:26:45.949503 10820 leader_election.cc:304] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:45.952414 10895 leader_election.cc:304] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
W20260709 12:26:45.947448 10894 consensus_peers.cc:597] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:45.965981 11616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9331e5342644ca2bae19187b083a7d5" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
W20260709 12:26:45.970597 10892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:45.966065 11620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:45.956789 10820 leader_election.cc:400] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 election: Vote denied by peer 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613) with higher term. Message: Invalid argument: T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 9. Current term is 10.
I20260709 12:26:45.957432 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:45.972117 10820 leader_election.cc:403] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
W20260709 12:26:45.972611 10893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:45.957719 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:45.971943 11620 raft_consensus.cc:2468] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 10.
W20260709 12:26:45.958971 10894 leader_election.cc:336] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:26:45.976687 10894 leader_election.cc:336] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:26:45.977275 10894 leader_election.cc:336] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:45.981158 10928 raft_consensus.cc:2468] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 14.
I20260709 12:26:45.988824 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
W20260709 12:26:45.993695 10894 leader_election.cc:336] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:45.996548 15619 leader_election.cc:290] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 14 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:45.997308 10925 raft_consensus.cc:2468] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 10.
I20260709 12:26:45.954896 15837 raft_consensus.cc:493] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:45.930653 15841 raft_consensus.cc:493] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.998205 15837 raft_consensus.cc:515] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:45.998653 15841 raft_consensus.cc:515] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:46.000926 15841 leader_election.cc:290] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:46.003695 11617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c6d38c4d8a90a81975a6a0cb13" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
W20260709 12:26:46.010794 10892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:46.011174 11000 raft_consensus.cc:2468] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 12.
I20260709 12:26:46.013300 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:46.014473 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:46.015389 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:46.016196 10927 raft_consensus.cc:2468] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 15.
I20260709 12:26:46.019277 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:46.020736 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:46.022358 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:46.024189 10925 raft_consensus.cc:1240] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 7. Current term is 8. Ops: []
W20260709 12:26:46.003480 10894 leader_election.cc:336] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:26:46.026520 10894 leader_election.cc:336] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:26:46.027905 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 75572.2us
I20260709 12:26:46.030055 10927 raft_consensus.cc:2393] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 11: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
W20260709 12:26:46.031635 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 106031us
W20260709 12:26:46.034739 10969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:46.034770 10819 leader_election.cc:304] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:45.965662 11618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:45.965014 11615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5794ba618e514e28a7542ab6af39d8c9" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:46.064081 15700 leader_election.cc:290] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:46.065711 15934 raft_consensus.cc:2804] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:46.066296 15934 raft_consensus.cc:493] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:46.066754 15934 raft_consensus.cc:3060] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:46.068292 15961 consensus_queue.cc:1048] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:26:46.068708 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 112039us
I20260709 12:26:46.069896 15961 raft_consensus.cc:3060] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:46.070044 15841 consensus_queue.cc:1059] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:26:46.070902 10820 leader_election.cc:304] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:45.970876 15925 raft_consensus.cc:2804] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:46.071975 15849 raft_consensus.cc:2749] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:46.072368 15925 raft_consensus.cc:493] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:46.071115 15841 raft_consensus.cc:3055] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:26:46.073521 10820 leader_election.cc:304] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:46.074012 15841 raft_consensus.cc:740] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:46.076179 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5794ba618e514e28a7542ab6af39d8c9" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:46.078469 15889 raft_consensus.cc:2749] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:46.079231 15889 raft_consensus.cc:2804] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:46.079646 15889 raft_consensus.cc:493] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:46.080004 15889 raft_consensus.cc:3060] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:46.082425 15813 consensus_queue.cc:1048] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:26:46.089833 10819 leader_election.cc:304] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:46.073102 15925 raft_consensus.cc:3060] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:46.091619 10820 leader_election.cc:304] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:45.992741 15834 raft_consensus.cc:493] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.092712 15834 raft_consensus.cc:515] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:46.093632 15891 leader_election.cc:290] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:46.095791 15718 raft_consensus.cc:2804] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:26:46.096210 15718 raft_consensus.cc:493] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:46.096563 15718 raft_consensus.cc:3060] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:46.098822 15849 raft_consensus.cc:2749] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:26:46.102273 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 50608.9us
I20260709 12:26:46.106314 10820 leader_election.cc:304] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:46.107594 10819 leader_election.cc:304] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:46.108071 15961 raft_consensus.cc:2749] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613) with higher term. Message: Invalid argument: T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for earlier term 9. Current term is 10.
I20260709 12:26:45.975212 15866 raft_consensus.cc:2749] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:26:46.121541 15882 raft_consensus.cc:2804] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:46.122048 15927 raft_consensus.cc:2749] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:26:46.122128 15882 raft_consensus.cc:493] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:46.122969 15882 raft_consensus.cc:3060] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:46.125718 10820 leader_election.cc:304] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:46.126111 10996 raft_consensus.cc:2393] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 6: Already voted for candidate 3c52e0825c02476e89d84da9bb849f5d in this term.
I20260709 12:26:46.144539 10998 raft_consensus.cc:1240] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 11. Current term is 12. Ops: []
I20260709 12:26:45.992517 15871 raft_consensus.cc:493] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:46.075909 15841 consensus_queue.cc:260] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:46.127873 10895 leader_election.cc:304] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:46.095297 15834 leader_election.cc:290] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:46.149520 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:46.163417 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:46.167223 10926 raft_consensus.cc:1275] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:26:46.157238 15889 raft_consensus.cc:515] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:46.205317 11621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:46.201157 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
W20260709 12:26:46.216976 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 251010us
I20260709 12:26:46.202438 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:46.200649 11617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:46.201778 11620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:46.204597 11623 raft_consensus.cc:1240] T e9331e5342644ca2bae19187b083a7d5 P 3c52e0825c02476e89d84da9bb849f5d [term 6 LEADER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 5. Current term is 6. Ops: []
W20260709 12:26:46.178650 10968 leader_election.cc:336] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Timed out: RequestConsensusVote RPC to 127.9.116.66:39339 timed out after 1.654s (SENT)
I20260709 12:26:46.209594 11616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:46.038663 15864 raft_consensus.cc:493] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:46.027562 15875 raft_consensus.cc:493] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
W20260709 12:26:46.172312 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 64847.4us
I20260709 12:26:46.254882 10819 leader_election.cc:304] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d
W20260709 12:26:46.162412 15510 consensus_meta.cc:287] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea: Time spent flushing consensus metadata: real 0.623s	user 0.013s	sys 0.001s
I20260709 12:26:46.218094 15947 raft_consensus.cc:493] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.217376 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:46.271042 10996 raft_consensus.cc:2468] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 12.
I20260709 12:26:46.210983 11619 raft_consensus.cc:1240] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [term 14 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
W20260709 12:26:46.212788 15515 consensus_meta.cc:287] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040: Time spent flushing consensus metadata: real 0.580s	user 0.006s	sys 0.005s
I20260709 12:26:46.225528 15868 leader_election.cc:290] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 11 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:26:46.273648 10818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:46.228746 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9331e5342644ca2bae19187b083a7d5" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:46.274749 10997 raft_consensus.cc:2410] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:26:46.244890 15813 raft_consensus.cc:2749] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:46.230463 11589 leader_election.cc:304] T b289bc89d592435fb63c7fcf580d95a4 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:26:46.281432 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 51065.7us
I20260709 12:26:46.247047 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab816bcc6183447994a2cc013e46c5f8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:46.251538 11616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18294423a68a4671bf6c5a0f98645e4c" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:46.248910 10968 leader_election.cc:304] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
W20260709 12:26:46.246707 11003 consensus_meta.cc:287] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08: Time spent flushing consensus metadata: real 0.754s	user 0.011s	sys 0.000s
W20260709 12:26:46.168570 15905 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.023s	sys 0.053s
I20260709 12:26:46.285506 11003 raft_consensus.cc:2468] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 8.
I20260709 12:26:46.246080 11624 raft_consensus.cc:2468] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 5.
I20260709 12:26:46.247324 11588 leader_election.cc:304] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:46.268010 15875 raft_consensus.cc:515] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:46.268750 11618 raft_consensus.cc:1240] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [term 9 LEADER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 8. Current term is 9. Ops: [6.7-8.8]
I20260709 12:26:46.247253 15832 consensus_queue.cc:1048] T e9331e5342644ca2bae19187b083a7d5 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:26:46.269779 10819 leader_election.cc:304] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
W20260709 12:26:46.172348 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 46918.8us
I20260709 12:26:46.275434 11619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352aa49c65194abbb863d7553a091f11" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:46.276137 15961 raft_consensus.cc:2804] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:46.276510 15849 consensus_queue.cc:1059] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:26:46.254611 15658 raft_consensus.cc:2749] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:46.277078 15837 leader_election.cc:290] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:46.277770 10921 raft_consensus.cc:2468] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 13.
I20260709 12:26:46.278492 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:46.301169 10996 raft_consensus.cc:2393] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 11: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:26:46.244222 15866 raft_consensus.cc:2749] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:26:46.288096 11000 raft_consensus.cc:1240] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 7. Current term is 8. Ops: []
I20260709 12:26:46.294062 11619 raft_consensus.cc:2393] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 5: Already voted for candidate 3c52e0825c02476e89d84da9bb849f5d in this term.
I20260709 12:26:46.273028 15841 raft_consensus.cc:3060] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:46.307998 11616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:46.308868 11616 raft_consensus.cc:2368] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for earlier term 13. Current term is 14.
I20260709 12:26:46.309573 15849 raft_consensus.cc:3055] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:26:46.295711 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 48491.1us
I20260709 12:26:46.310000 15849 raft_consensus.cc:740] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:46.310983 11588 leader_election.cc:304] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:46.310935 15849 consensus_queue.cc:260] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:46.296051 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 117446us
I20260709 12:26:46.166082 15871 raft_consensus.cc:515] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:46.276410 15515 raft_consensus.cc:515] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:46.321362 15515 leader_election.cc:290] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:46.322760 15961 raft_consensus.cc:697] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [term 5 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:46.294041 15619 raft_consensus.cc:2749] T b289bc89d592435fb63c7fcf580d95a4 P 3c52e0825c02476e89d84da9bb849f5d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:46.299943 15862 raft_consensus.cc:2804] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:26:46.323892 15961 consensus_queue.cc:237] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:46.325860 15889 leader_election.cc:290] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 13 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:26:46.292382 15905 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.023s	sys 0.053s
I20260709 12:26:46.302681 15726 raft_consensus.cc:493] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.327075 15726 raft_consensus.cc:515] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:46.327792 15866 consensus_queue.cc:1059] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:26:46.330668 15726 leader_election.cc:290] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:46.297029 15834 raft_consensus.cc:2749] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:26:46.304416 15875 leader_election.cc:290] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:46.304944 15868 consensus_queue.cc:1059] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:26:46.332656 15868 raft_consensus.cc:3055] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:26:46.333047 15868 raft_consensus.cc:740] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:46.333186 11618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d9a61ecaf84695b70f8519ee57706f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:46.305171 11589 leader_election.cc:304] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:46.334532 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9331e5342644ca2bae19187b083a7d5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:46.333943 15868 consensus_queue.cc:260] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:46.273523 15947 raft_consensus.cc:515] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:46.348665 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 43575.3us
I20260709 12:26:46.353325 11619 raft_consensus.cc:1275] T b289bc89d592435fb63c7fcf580d95a4 P 3c52e0825c02476e89d84da9bb849f5d [term 12 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:26:46.354562 10969 leader_election.cc:400] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613) with higher term. Message: Invalid argument: T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for earlier term 13. Current term is 14.
I20260709 12:26:46.354632 10820 leader_election.cc:304] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:46.356590 10969 leader_election.cc:403] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:46.348873 10929 raft_consensus.cc:1275] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 12:26:46.350178 10968 leader_election.cc:336] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:46.302371 15700 raft_consensus.cc:2804] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:46.269187 15864 raft_consensus.cc:515] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:46.362372 15871 leader_election.cc:290] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:46.354375 15834 consensus_queue.cc:1059] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 12:26:46.363610 15864 leader_election.cc:290] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:46.363819 15834 raft_consensus.cc:3055] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 12:26:46.358726 10968 leader_election.cc:336] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:46.364842 10968 leader_election.cc:304] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040
W20260709 12:26:46.347371 15861 consensus_meta.cc:287] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08: Time spent flushing consensus metadata: real 0.561s	user 0.008s	sys 0.004s
I20260709 12:26:46.356184 15636 raft_consensus.cc:2804] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:26:46.361029 15882 raft_consensus.cc:515] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:46.365684 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:46.366142 10968 leader_election.cc:336] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:26:46.428552 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 62449us
I20260709 12:26:46.357846 10820 leader_election.cc:304] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:46.345966 15813 raft_consensus.cc:493] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.431780 11622 raft_consensus.cc:2468] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 9.
W20260709 12:26:46.432215 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 74460us
I20260709 12:26:46.349244 15615 raft_consensus.cc:2804] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:26:46.436314 11619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab816bcc6183447994a2cc013e46c5f8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:46.364207 15834 raft_consensus.cc:740] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
W20260709 12:26:46.426894 10969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 80077.8us
I20260709 12:26:46.437181 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 14 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:46.442579 15718 raft_consensus.cc:515] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:46.445469 15718 leader_election.cc:290] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 10 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:46.364543 15700 raft_consensus.cc:493] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:46.447949 15700 raft_consensus.cc:3060] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:46.452188 15834 consensus_queue.cc:260] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:46.453540 15834 raft_consensus.cc:3060] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:46.458588 10926 raft_consensus.cc:1275] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:26:46.423962 15862 raft_consensus.cc:697] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [term 14 LEADER]: Becoming Leader. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
I20260709 12:26:46.461208 15862 consensus_queue.cc:237] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:46.463164 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad766f48812a4ddeb383179b1d84907b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:46.465432 15925 raft_consensus.cc:515] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:46.466694 15849 raft_consensus.cc:3060] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:46.467854 10922 raft_consensus.cc:2393] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 11: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:26:46.468532 15960 raft_consensus.cc:2749] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:26:46.473500 15947 leader_election.cc:290] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:26:46.474709 15962 log.cc:927] Time spent T 00000000000000000000000000000000 P 9619ad7a9e7f4d9b8039487e3ee77243: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 12:26:46.459961 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:46.479980 11615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:46.480877 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:46.481932 10921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59622 (request call id 3180) took 1120 ms. Trace:
I20260709 12:26:46.482349 10921 rpcz_store.cc:276] 0709 12:26:45.361882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:45.395189 (+ 33307us) service_pool.cc:224] Handling call
0709 12:26:46.481763 (+1086574us) spinlock_profiling.cc:243] Waited 875 ms on lock 0x7b540039ec54. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e8c2fa 00007f7599e4db17 00007f75933c86d4 00007f75933c8662 00007f75933c8591 00007f75933c850c 00007f75933c77c2 00007f75931c348c 00007f75931c28c6 00007f75931c226f
0709 12:26:46.481874 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2012485888}
I20260709 12:26:46.327425 15889 consensus_queue.cc:1059] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.157s
I20260709 12:26:46.484633 15889 raft_consensus.cc:3055] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:26:46.485080 15889 raft_consensus.cc:740] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:46.485986 15889 consensus_queue.cc:260] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:46.364274 15934 raft_consensus.cc:515] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:46.489741 10920 raft_consensus.cc:2393] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 12: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:26:46.493062 11624 raft_consensus.cc:2393] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 14: Already voted for candidate 3c52e0825c02476e89d84da9bb849f5d in this term.
W20260709 12:26:46.497229 10968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:46.499862 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:46.500717 10996 raft_consensus.cc:2468] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 11.
I20260709 12:26:46.502136 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad766f48812a4ddeb383179b1d84907b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:26:46.508594 10968 leader_election.cc:336] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Timed out: RequestConsensusVote RPC to 127.9.116.66:39339 timed out after 1.876s (SENT)
I20260709 12:26:46.503811 15867 raft_consensus.cc:493] T d0aed74af73a488f8b691578ca370226 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:46.512962 15867 raft_consensus.cc:515] T d0aed74af73a488f8b691578ca370226 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:46.515689 15636 raft_consensus.cc:697] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d [term 12 LEADER]: Becoming Leader. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
I20260709 12:26:46.516245 15615 raft_consensus.cc:697] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d [term 10 LEADER]: Becoming Leader. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
I20260709 12:26:46.516742 15636 consensus_queue.cc:237] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:46.517251 15615 consensus_queue.cc:237] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:46.520267 11003 raft_consensus.cc:1275] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:26:46.520875 15925 leader_election.cc:290] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:46.521466 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 14 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:26:46.522730 10800 auto_rebalancer.cc:629] Failed to schedule move for tablet 266989ea58c040cea1d5f1b425ba2d3b: Illegal state: Replica e2d5c637307a407ab688f5ccd6f0fcea is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } }
I20260709 12:26:46.515268 15867 leader_election.cc:290] T d0aed74af73a488f8b691578ca370226 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:46.422943 15891 raft_consensus.cc:2749] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:26:46.527720 11616 raft_consensus.cc:1275] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:26:46.528388 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:46.530165 10927 raft_consensus.cc:3060] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:46.434962 15864 raft_consensus.cc:3060] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:26:46.535357 10999 raft_consensus.cc:1240] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:46.538825 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:46.487419 15889 raft_consensus.cc:3060] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:46.491688 15936 raft_consensus.cc:2804] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:46.489742 15868 raft_consensus.cc:3060] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:46.580104 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:46.581219 10998 raft_consensus.cc:1275] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 14 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:26:46.588907 15882 leader_election.cc:290] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:46.492491 15813 raft_consensus.cc:515] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:46.558082 15867 consensus_queue.cc:1048] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.056s
I20260709 12:26:46.596513 10820 leader_election.cc:304] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:46.597390 15960 raft_consensus.cc:2749] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:46.598682 10820 leader_election.cc:304] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:46.599493 15960 raft_consensus.cc:2804] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:46.599927 15960 raft_consensus.cc:493] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
W20260709 12:26:46.490702 15866 consensus_queue.cc:1175] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "edcc56ddd3264984b4da6c1db59e7f08" responder_term: 12 status { last_received { term: 9 index: 10 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 11. Current term is 12. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:26:46.600368 15960 raft_consensus.cc:3060] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:46.601866 15845 leader_election.cc:290] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
W20260709 12:26:46.596004 10968 consensus_peers.cc:597] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:46.608069 10968 leader_election.cc:336] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:46.608300 10820 leader_election.cc:304] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:26:46.609225 10968 leader_election.cc:336] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:46.609737 10820 leader_election.cc:304] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:26:46.609956 10968 leader_election.cc:336] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:46.610191 10927 raft_consensus.cc:2468] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 13.
I20260709 12:26:46.566982 15936 raft_consensus.cc:493] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:46.615257 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:46.617688 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fd8fdac2fa449e9e184f3d668ea1a7" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:46.611239 10968 leader_election.cc:304] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:46.620182 10927 raft_consensus.cc:2393] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 10: Already voted for candidate 3c52e0825c02476e89d84da9bb849f5d in this term.
W20260709 12:26:46.621996 10968 leader_election.cc:336] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:46.622654 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
W20260709 12:26:46.622709 10968 leader_election.cc:336] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:26:46.628551 10968 leader_election.cc:336] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:26:46.622663 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 575149us
I20260709 12:26:46.635344 10895 leader_election.cc:304] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:46.640472 10820 leader_election.cc:304] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:46.611129 15882 raft_consensus.cc:2749] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:26:46.657442 10818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:46.615255 15936 raft_consensus.cc:3060] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:46.660432 10895 leader_election.cc:400] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 pre-election: Vote denied by peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945) with higher term. Message: Invalid argument: T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for earlier term 11. Current term is 12.
I20260709 12:26:46.662065 10895 leader_election.cc:403] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:46.664244 10820 leader_election.cc:304] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:46.624101 15834 raft_consensus.cc:2749] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:26:46.629454 10968 leader_election.cc:336] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:26:46.678406 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 48983.8us
I20260709 12:26:46.679993 10820 leader_election.cc:304] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:46.662220 15871 raft_consensus.cc:2749] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:46.681337 15718 raft_consensus.cc:2749] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:26:46.682564 15813 leader_election.cc:290] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:46.629447 15921 raft_consensus.cc:493] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:46.684983 10968 leader_election.cc:336] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:26:46.717151 10968 leader_election.cc:336] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:46.668692 15515 raft_consensus.cc:3060] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:26:46.713879 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 54967us
I20260709 12:26:46.661744 15845 raft_consensus.cc:2749] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:46.734326 10895 leader_election.cc:304] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:46.717865 10968 leader_election.cc:304] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040
W20260709 12:26:46.737077 10968 leader_election.cc:336] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:46.737834 10968 leader_election.cc:304] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:46.707645 10819 leader_election.cc:304] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
W20260709 12:26:46.739710 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 50137.3us
I20260709 12:26:46.740767 10820 leader_election.cc:304] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
W20260709 12:26:46.753202 10994 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.014s	sys 0.031s
W20260709 12:26:46.753615 10994 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.014s	sys 0.031s
I20260709 12:26:46.704130 15927 raft_consensus.cc:2749] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:26:46.758694 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:46.726326 15658 raft_consensus.cc:2749] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945) with higher term. Message: Invalid argument: T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for earlier term 11. Current term is 12.
I20260709 12:26:46.748482 15834 raft_consensus.cc:2749] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:46.763509 10895 leader_election.cc:304] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
W20260709 12:26:46.755651 11002 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.020s	sys 0.012s
W20260709 12:26:46.776885 10924 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.701s	user 0.014s	sys 0.016s
W20260709 12:26:46.755503 15900 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.019s	sys 0.011s
W20260709 12:26:46.778290 11001 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.020s	sys 0.053s
W20260709 12:26:46.782541 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 45514.1us
W20260709 12:26:46.828227 11001 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.021s	sys 0.054s
I20260709 12:26:46.718080 15882 consensus_queue.cc:1048] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.047s
W20260709 12:26:46.828598 10968 leader_election.cc:336] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:26:46.793373 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 52716.7us
W20260709 12:26:46.828708 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 65294.6us
I20260709 12:26:46.830883 10895 leader_election.cc:304] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:46.832357 10895 leader_election.cc:304] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:46.833547 10820 leader_election.cc:304] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:26:46.822338 10924 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.747s	user 0.014s	sys 0.016s
W20260709 12:26:46.821646 11002 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.020s	sys 0.013s
I20260709 12:26:46.838121 11001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57514 (request call id 1319) took 1261 ms. Trace:
W20260709 12:26:46.840489 10968 leader_election.cc:336] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:46.766619 15925 raft_consensus.cc:2749] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:46.736294 15921 raft_consensus.cc:515] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:46.848366 15726 raft_consensus.cc:2804] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:26:46.855136 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18294423a68a4671bf6c5a0f98645e4c" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:46.848805 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18294423a68a4671bf6c5a0f98645e4c" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:46.851243 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:46.856801 11623 raft_consensus.cc:3060] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:26:46.830232 15900 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.019s	sys 0.012s
I20260709 12:26:46.853356 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:46.822036 15891 raft_consensus.cc:2749] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:46.830101 15927 raft_consensus.cc:2804] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:26:46.863848 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac8522e549a46e09593fa4c2e175557" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:46.864748 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef3220c51df47db8859f07ab745fad5" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:26:46.868944 10894 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.712s	user 0.027s	sys 0.032s
I20260709 12:26:46.840392 11001 rpcz_store.cc:276] 0709 12:26:45.576422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:45.578816 (+  2394us) service_pool.cc:224] Handling call
0709 12:26:45.951488 (+372672us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:45.952012 (+   524us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:26:45.992995 (+ 40983us) log.cc:844] Serialized 14 byte log entry
0709 12:26:46.835657 (+842662us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:46.836069 (+   412us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:26:46.836454 (+   385us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:46.837031 (+   577us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:46.837745 (+   714us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":52178,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":83,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":19979,"thread_start_us":729756,"threads_started":1}
I20260709 12:26:46.886544 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aed74af73a488f8b691578ca370226" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
W20260709 12:26:46.867662 15819 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.009s	sys 0.033s
I20260709 12:26:46.841784 10968 leader_election.cc:304] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:46.928229 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:26:46.917088 10894 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.760s	user 0.030s	sys 0.032s
I20260709 12:26:46.859342 15658 raft_consensus.cc:2804] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:26:46.929173 10994 raft_consensus.cc:2468] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 14.
W20260709 12:26:46.917392 15446 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.016s	sys 0.017s
I20260709 12:26:46.927225 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:26:46.931517 10969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 441262us
W20260709 12:26:46.928751 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 88318.1us
I20260709 12:26:46.955988 15891 raft_consensus.cc:2749] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:26:46.959880 15921 leader_election.cc:290] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:46.961006 15866 consensus_queue.cc:1048] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:26:46.962764 10968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:46.963840 10968 leader_election.cc:304] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:46.937953 11615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef3220c51df47db8859f07ab745fad5" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:46.914096 15700 raft_consensus.cc:515] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:46.940832 15934 leader_election.cc:290] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 12 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:26:46.942373 15964 log.cc:927] Time spent T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
W20260709 12:26:46.946197 15954 log.cc:927] Time spent T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.579s	user 0.000s	sys 0.011s
W20260709 12:26:46.994979 11588 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.001s	sys 0.021s
W20260709 12:26:46.995375 11588 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.001s	sys 0.021s
I20260709 12:26:46.946628 11623 raft_consensus.cc:2468] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 7.
W20260709 12:26:46.926071 15819 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.009s	sys 0.033s
I20260709 12:26:46.936460 11001 raft_consensus.cc:2468] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 11.
I20260709 12:26:46.872486 15813 raft_consensus.cc:2804] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:46.899497 15726 raft_consensus.cc:697] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:47.001868 10968 leader_election.cc:304] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
W20260709 12:26:46.986794 10923 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.015s	sys 0.007s
I20260709 12:26:46.915341 15927 raft_consensus.cc:697] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 13 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:46.987908 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aed74af73a488f8b691578ca370226" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:26:47.004384 10923 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.015s	sys 0.007s
W20260709 12:26:47.005234 10925 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.015s	sys 0.007s
W20260709 12:26:47.005627 10925 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.015s	sys 0.007s
W20260709 12:26:46.980790 15446 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.016s	sys 0.017s
I20260709 12:26:46.929476 15845 raft_consensus.cc:2749] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:26:46.997695 11589 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.013s	sys 0.009s
I20260709 12:26:46.985966 15891 raft_consensus.cc:493] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.986923 15658 raft_consensus.cc:697] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [term 8 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
W20260709 12:26:47.028544 11589 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.013s	sys 0.009s
W20260709 12:26:46.992202 15961 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.012s	sys 0.009s
I20260709 12:26:46.998924 15813 raft_consensus.cc:493] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:47.043669 15961 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.013s	sys 0.009s
I20260709 12:26:47.076900 10895 leader_election.cc:304] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:47.092885 10895 leader_election.cc:304] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:47.050822 15875 raft_consensus.cc:2749] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:47.043673 15891 raft_consensus.cc:515] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:47.113421 10995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37500 (request call id 4000) took 1679 ms. Trace:
I20260709 12:26:47.072932 15813 raft_consensus.cc:3060] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:47.116187 10995 rpcz_store.cc:276] 0709 12:26:45.434189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:45.436487 (+  2298us) service_pool.cc:224] Handling call
0709 12:26:45.436858 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:45.461057 (+ 24199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:45.461098 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:45.475285 (+ 14187us) log.cc:844] Serialized 26 byte log entry
0709 12:26:45.882289 (+407004us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:26:45.882359 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:45.882485 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:46.945356 (+1062871us) spinlock_profiling.cc:243] Waited 2.16 ms on lock 0x7b4400022b4c. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7591c23db1 00007f7591cc1c85 00007f7591cc26a2 00007f7594a341db 00007f7594a2faaf 00007f7594a2386e 00007f7594a22bb6 00007f7594a227d8 00007f7594a2c221 00007f7594a2c1d9 00007f7594a2c169
0709 12:26:47.088676 (+143320us) raft_consensus.cc:1685] finished
0709 12:26:47.088704 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:47.113331 (+ 24627us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6038,"raft.queue_time_us":6150,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":92,"spinlock_wait_cycles":4973824,"thread_start_us":332668,"threads_started":1,"wal-append.queue_time_us":796034}
I20260709 12:26:47.124779 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:26:47.106923 15818 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.023s	sys 0.040s
I20260709 12:26:47.094424 15921 raft_consensus.cc:2749] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:26:47.135293 11001 raft_consensus.cc:1275] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:26:47.114945 10895 leader_election.cc:304] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:47.112761 15925 raft_consensus.cc:2749] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:26:47.130595 15818 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.023s	sys 0.041s
I20260709 12:26:47.148927 10895 leader_election.cc:304] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:47.156108 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:26:47.151196 15960 consensus_meta.cc:287] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040: Time spent flushing consensus metadata: real 0.540s	user 0.006s	sys 0.006s
I20260709 12:26:47.171329 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:47.172230 10994 raft_consensus.cc:3060] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:26:47.168329 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:47.158187 15921 raft_consensus.cc:2804] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:26:47.180698 10998 raft_consensus.cc:2468] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 12.
I20260709 12:26:47.140800 15973 raft_consensus.cc:2804] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:47.127527 15726 consensus_queue.cc:237] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:47.174475 15875 raft_consensus.cc:2749] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:26:47.139514 15981 consensus_queue.cc:1059] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 12:26:47.188586 15921 raft_consensus.cc:493] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:47.136868 15927 consensus_queue.cc:237] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:47.220001 15636 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.014s	sys 0.038s
I20260709 12:26:47.201431 15700 leader_election.cc:290] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 16 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
W20260709 12:26:47.225517 15615 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.703s	user 0.009s	sys 0.044s
I20260709 12:26:47.177189 15960 raft_consensus.cc:515] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:47.227268 15841 raft_consensus.cc:3055] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:47.228034 15921 raft_consensus.cc:3060] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:26:47.251783 15970 log.cc:927] Time spent T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.139s	user 0.000s	sys 0.002s
W20260709 12:26:47.216725 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 477360us
I20260709 12:26:47.198618 10895 leader_election.cc:304] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:47.188427 15973 raft_consensus.cc:493] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:47.252792 15615 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.731s	user 0.010s	sys 0.045s
W20260709 12:26:47.243819 15636 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.015s	sys 0.038s
I20260709 12:26:47.137696 15658 consensus_queue.cc:237] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:47.240206 15981 consensus_queue.cc:1243] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer e2d5c637307a407ab688f5ccd6f0fcea log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:26:47.293190 10994 raft_consensus.cc:2468] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 11.
W20260709 12:26:47.268179 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 69686.7us
W20260709 12:26:47.269038 10997 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.012s	sys 0.047s
I20260709 12:26:47.250007 15818 raft_consensus.cc:493] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.271522 10819 leader_election.cc:304] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:47.260560 15585 raft_consensus.cc:493] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.268537 15973 raft_consensus.cc:3060] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:47.258553 15841 raft_consensus.cc:740] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
W20260709 12:26:47.264730 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 428618us
I20260709 12:26:47.300166 15981 raft_consensus.cc:493] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
W20260709 12:26:47.295318 15968 log.cc:927] Time spent T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.219s	user 0.001s	sys 0.001s
I20260709 12:26:47.285373 15925 raft_consensus.cc:2804] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:26:47.326350 10820 leader_election.cc:304] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:47.329635 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18294423a68a4671bf6c5a0f98645e4c" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:26:47.300976 10997 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.012s	sys 0.047s
I20260709 12:26:47.304354 15871 raft_consensus.cc:2804] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:47.335449 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:47.337015 11002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37512 (request call id 3602) took 1144 ms. Trace:
I20260709 12:26:47.342866 15889 raft_consensus.cc:3060] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:26:47.346877 10817 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.009s	sys 0.047s
W20260709 12:26:47.379083 10817 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.009s	sys 0.048s
I20260709 12:26:47.348577 15861 raft_consensus.cc:3055] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:26:47.327173 15585 raft_consensus.cc:515] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:47.343555 15845 consensus_queue.cc:1059] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.011s
W20260709 12:26:47.360235 15979 log.cc:927] Time spent T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:26:47.360623 15960 leader_election.cc:290] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 11 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:47.314662 15891 leader_election.cc:290] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
W20260709 12:26:47.342129 15976 log.cc:927] Time spent T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.190s	user 0.000s	sys 0.005s
W20260709 12:26:47.364043 15972 log.cc:927] Time spent T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.274s	user 0.002s	sys 0.001s
W20260709 12:26:47.326447 15967 log.cc:927] Time spent T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.196s	user 0.001s	sys 0.001s
I20260709 12:26:47.382365 15861 raft_consensus.cc:740] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:26:47.370532 10920 raft_consensus.cc:2468] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 6.
I20260709 12:26:47.379735 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:47.404700 10928 raft_consensus.cc:2468] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 13.
I20260709 12:26:47.405085 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:47.405977 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:47.370564 11002 rpcz_store.cc:276] 0709 12:26:46.193000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:46.193248 (+   248us) service_pool.cc:224] Handling call
0709 12:26:46.200449 (+  7201us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:26:46.200886 (+   437us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:46.200914 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:26:46.201608 (+   694us) log.cc:844] Serialized 52 byte log entry
0709 12:26:46.837156 (+635548us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:26:46.838598 (+  1442us) log.cc:844] Serialized 14 byte log entry
0709 12:26:47.244135 (+405537us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:47.244245 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:47.336720 (+ 92475us) raft_consensus.cc:1685] finished
0709 12:26:47.336744 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:47.336933 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":560,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":24019,"raft.run_cpu_time_us":321,"raft.run_wall_time_us":6596,"thread_start_us":1038801,"threads_started":2,"wal-append.queue_time_us":801620}
W20260709 12:26:47.396144 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 69882.8us
I20260709 12:26:47.399200 15700 raft_consensus.cc:2749] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:26:47.372612 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 370868us
I20260709 12:26:47.322413 15818 raft_consensus.cc:515] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:47.405925 10920 raft_consensus.cc:2468] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 13.
I20260709 12:26:47.410778 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:47.389045 15925 raft_consensus.cc:697] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:47.409389 10968 leader_election.cc:304] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:47.414747 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:47.418552 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:47.365372 15981 raft_consensus.cc:515] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:47.422304 10920 raft_consensus.cc:2368] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for earlier term 6. Current term is 7.
I20260709 12:26:47.437111 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:47.438335 10928 raft_consensus.cc:2368] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for earlier term 10. Current term is 11.
W20260709 12:26:47.470233 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 62238.7us
W20260709 12:26:47.471052 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 61815.3us
W20260709 12:26:47.471978 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 347233us
I20260709 12:26:47.471925 10968 leader_election.cc:304] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:47.473910 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:47.474820 10928 raft_consensus.cc:2410] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for term 12 because replica has last-logged OpId of term: 11 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260709 12:26:47.480219 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d9a61ecaf84695b70f8519ee57706f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:47.481225 10920 raft_consensus.cc:2468] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 8.
I20260709 12:26:47.481295 11615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6a1da21304fcfacab384a6afc4101" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:47.482478 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:47.483299 11615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63ecfc9bd3945818cfe15c03f001315" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
W20260709 12:26:47.485008 10800 auto_rebalancer.cc:629] Failed to schedule move for tablet 54df1a3d45b746398c2831883d796c6d: Illegal state: Replica e2d5c637307a407ab688f5ccd6f0fcea is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } }
I20260709 12:26:47.485816 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:47.487198 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5794ba618e514e28a7542ab6af39d8c9" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:47.487519 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:47.488310 10921 raft_consensus.cc:2468] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 8.
I20260709 12:26:47.484705 11615 raft_consensus.cc:2393] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 7: Already voted for candidate 3c52e0825c02476e89d84da9bb849f5d in this term.
I20260709 12:26:47.489476 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:47.490777 10921 raft_consensus.cc:3060] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:47.495231 15871 raft_consensus.cc:493] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:47.483281 10920 raft_consensus.cc:2468] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 11.
I20260709 12:26:47.497208 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:47.498167 10920 raft_consensus.cc:2368] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for earlier term 13. Current term is 14.
I20260709 12:26:47.500384 15841 consensus_queue.cc:260] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:47.502038 15841 raft_consensus.cc:3060] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:47.504725 10921 raft_consensus.cc:2468] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 16.
I20260709 12:26:47.506719 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:47.509056 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:47.510943 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:47.512655 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:47.514979 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aed74af73a488f8b691578ca370226" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:47.516412 10920 raft_consensus.cc:1275] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 12. (term mismatch)
I20260709 12:26:47.516896 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:47.495859 15871 raft_consensus.cc:3060] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:47.518240 10921 raft_consensus.cc:2376] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 11. Re-sending same reply.
I20260709 12:26:47.520017 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c913e527ff46578e084c41eab7bb9d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:47.521548 10895 leader_election.cc:304] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:47.524634 11616 raft_consensus.cc:1275] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 12:26:47.524587 15987 log.cc:927] Time spent T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
W20260709 12:26:47.528132 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 53707.4us
W20260709 12:26:47.528429 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 460765us
I20260709 12:26:47.530615 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:47.517082 10920 pending_rounds.cc:85] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea: Aborting all ops after (but not including) 11
I20260709 12:26:47.531297 10995 raft_consensus.cc:2468] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 11.
I20260709 12:26:47.534325 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:47.487918 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aed74af73a488f8b691578ca370226" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
W20260709 12:26:47.536425 10800 auto_rebalancer.cc:629] Failed to schedule move for tablet c72fddfc26044838a71a798f3371636b: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:47.537572 11616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:47.544093 10920 pending_rounds.cc:107] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea: Aborting uncommitted NO_OP operation due to leader change: 11.12
I20260709 12:26:47.545388 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:47.545454 10920 raft_consensus.cc:2889] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:47.546212 10999 raft_consensus.cc:3060] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:47.542660 10895 leader_election.cc:304] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:26:47.547257 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 433783us
W20260709 12:26:47.563241 11588 connection.cc:256] RPC call timeout handler was delayed by -1.0029340020000745s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1502s for a response
I20260709 12:26:47.564765 10923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59626 (request call id 3717) took 1107 ms. Trace:
I20260709 12:26:47.565692 10923 rpcz_store.cc:276] 0709 12:26:46.457615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:46.461354 (+  3739us) service_pool.cc:224] Handling call
0709 12:26:46.461635 (+   281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:46.461945 (+   310us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:46.461990 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:46.462440 (+   450us) log.cc:844] Serialized 26 byte log entry
0709 12:26:47.004965 (+542525us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:26:47.338170 (+333205us) log.cc:844] Serialized 14 byte log entry
0709 12:26:47.373492 (+ 35322us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:47.373567 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:47.564371 (+190804us) raft_consensus.cc:1685] finished
0709 12:26:47.564411 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:47.564653 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":196073,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":62,"raft.queue_time_us":40994,"raft.run_cpu_time_us":266,"raft.run_wall_time_us":7743,"thread_start_us":846428,"threads_started":2,"wal-append.queue_time_us":782247}
W20260709 12:26:47.600654 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 128825us
I20260709 12:26:47.608031 10924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50036 (request call id 1071) took 2025 ms. Trace:
I20260709 12:26:47.608573 10924 rpcz_store.cc:276] 0709 12:26:45.582807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:45.583137 (+   330us) service_pool.cc:224] Handling call
0709 12:26:45.627870 (+ 44733us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:45.949831 (+321961us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:45.949861 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:45.974996 (+ 25135us) log.cc:844] Serialized 26 byte log entry
0709 12:26:46.836500 (+861504us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:26:46.836869 (+   369us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:46.837263 (+   394us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:47.607805 (+770542us) raft_consensus.cc:1685] finished
0709 12:26:47.607828 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:47.607967 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":347216,"raft.queue_time_us":341870,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":18321,"thread_start_us":759774,"threads_started":1,"wal-append.queue_time_us":1025648}
I20260709 12:26:47.599035 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:26:47.598690 10894 leader_election.cc:336] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:47.611690 10968 leader_election.cc:304] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d
W20260709 12:26:47.618072 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 44270.1us
W20260709 12:26:47.619493 10894 leader_election.cc:336] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:47.620849 10894 leader_election.cc:304] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:47.551783 15934 raft_consensus.cc:2749] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:26:47.624565 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 75477.7us
I20260709 12:26:47.543411 15891 raft_consensus.cc:493] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:47.545377 16002 raft_consensus.cc:2749] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:47.527915 15819 consensus_queue.cc:1048] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.086s
W20260709 12:26:47.626482 15989 log.cc:927] Time spent T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:26:47.647506 10820 leader_election.cc:304] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:47.651249 10994 raft_consensus.cc:1275] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 12:26:47.673748 10994 pending_rounds.cc:85] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08: Aborting all ops after (but not including) 7
I20260709 12:26:47.674162 10994 pending_rounds.cc:107] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:26:47.674499 10994 raft_consensus.cc:2889] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:47.543689 15216 consensus_queue.cc:1048] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.085s
W20260709 12:26:47.608198 15864 consensus_meta.cc:287] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08: Time spent flushing consensus metadata: real 1.040s	user 0.007s	sys 0.008s
I20260709 12:26:47.651113 10819 leader_election.cc:304] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:47.680895 10819 leader_election.cc:304] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:47.659126 11003 raft_consensus.cc:1275] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:26:47.616465 15834 raft_consensus.cc:2749] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:26:47.665042 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 53482.5us
I20260709 12:26:47.644009 10995 raft_consensus.cc:1275] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:26:47.685683 10968 leader_election.cc:304] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:47.677911 10820 leader_election.cc:304] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:47.692471 10999 raft_consensus.cc:2468] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 12.
I20260709 12:26:47.693012 10968 leader_election.cc:304] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
W20260709 12:26:47.695922 15849 consensus_meta.cc:287] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040: Time spent flushing consensus metadata: real 1.229s	user 0.015s	sys 0.005s
I20260709 12:26:47.654394 15718 raft_consensus.cc:493] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.668886 16000 raft_consensus.cc:2804] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:26:47.631516 15875 consensus_queue.cc:1048] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 12:26:47.695425 15993 raft_consensus.cc:3060] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:47.694180 16002 raft_consensus.cc:2804] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:47.661110 15658 raft_consensus.cc:2749] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:26:47.565402 15861 consensus_queue.cc:260] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:47.656924 15873 consensus_queue.cc:1048] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 12:26:47.573331 15996 consensus_queue.cc:1048] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.156s
I20260709 12:26:47.734328 15834 raft_consensus.cc:2804] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:47.773707 10920 raft_consensus.cc:1240] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 16 FOLLOWER]: Rejecting Update request from peer 3c52e0825c02476e89d84da9bb849f5d for earlier term 15. Current term is 16. Ops: []
I20260709 12:26:47.691290 15927 raft_consensus.cc:2749] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:47.735105 15868 raft_consensus.cc:2804] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:26:47.777830 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 213892us
W20260709 12:26:47.745391 15515 consensus_meta.cc:287] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040: Time spent flushing consensus metadata: real 0.994s	user 0.014s	sys 0.000s
W20260709 12:26:47.744725 15998 log.cc:927] Time spent T e8b17195a94142039c40f598ed006c94 P 3c52e0825c02476e89d84da9bb849f5d: Append to log took a long time: real 0.273s	user 0.001s	sys 0.000s
W20260709 12:26:47.761601 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 218993us
W20260709 12:26:47.754259 15997 log.cc:927] Time spent T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d: Append to log took a long time: real 0.334s	user 0.000s	sys 0.001s
I20260709 12:26:47.807410 10895 leader_election.cc:304] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:47.710191 15867 raft_consensus.cc:493] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:47.795943 10924 raft_consensus.cc:1275] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 12:26:47.796206 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 176912us
I20260709 12:26:47.753356 15969 raft_consensus.cc:2749] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:26:47.827183 10894 leader_election.cc:336] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:47.709371 15866 raft_consensus.cc:493] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:47.827816 10895 leader_election.cc:304] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
W20260709 12:26:47.835335 10894 leader_election.cc:336] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:47.835930 10894 leader_election.cc:304] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:47.836164 10895 leader_election.cc:304] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:47.825539 10997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57514 (request call id 1331) took 1337 ms. Trace:
I20260709 12:26:47.670785 15891 raft_consensus.cc:515] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:47.708041 15979 log.cc:927] Time spent T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
W20260709 12:26:47.845562 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 101555us
I20260709 12:26:47.703267 15700 raft_consensus.cc:2804] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:47.703769 15864 raft_consensus.cc:2749] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613) with higher term. Message: Invalid argument: T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for earlier term 13. Current term is 14.
I20260709 12:26:47.838599 10997 rpcz_store.cc:276] 0709 12:26:46.488280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:46.488620 (+   340us) service_pool.cc:224] Handling call
0709 12:26:46.489221 (+   601us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:46.504717 (+ 15496us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:46.504752 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:46.505517 (+   765us) log.cc:844] Serialized 26 byte log entry
0709 12:26:47.348263 (+842746us) spinlock_profiling.cc:243] Waited 3.87 ms on lock 0x7b48001b0258. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7599db1aa1 00007f7599da8b37 00007f7599da89ca 00007f7599ea026f 00007f7599e9ff37 00007f7599eb455c 00007f7599eb4508 00007f7599eb4488 00007f7599eb4443 00007f7599eb36ec 00007f7598ddda96
0709 12:26:47.371409 (+ 23146us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:26:47.371472 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:47.371604 (+   132us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:47.796922 (+425318us) raft_consensus.cc:1685] finished
0709 12:26:47.796955 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:47.825429 (+ 28474us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10195,"raft.queue_time_us":33980,"raft.run_cpu_time_us":6047,"raft.run_wall_time_us":820418,"spinlock_wait_cycles":8898816,"thread_start_us":783411,"threads_started":1,"wal-append.queue_time_us":878038}
I20260709 12:26:47.752646 16000 raft_consensus.cc:493] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:47.879770 16000 raft_consensus.cc:3060] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:26:47.882977 11588 leader_election.cc:336] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:26:47.884656 11588 consensus_peers.cc:597] T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:47.885566 11588 consensus_peers.cc:597] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:47.886385 11588 leader_election.cc:336] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:26:47.887807 11588 consensus_peers.cc:597] T 1f0741f995c74b5c91290f42110a3187 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:47.889915 11588 leader_election.cc:336] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:26:47.892532 11588 leader_election.cc:336] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:26:47.896121 11588 consensus_peers.cc:597] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:47.772643 16002 raft_consensus.cc:493] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:47.788339 15834 raft_consensus.cc:493] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:47.910346 15834 raft_consensus.cc:3060] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:26:47.805898 16005 log.cc:927] Time spent T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.172s	user 0.001s	sys 0.001s
I20260709 12:26:47.859084 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:47.868444 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:47.871666 11619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:47.910596 16002 raft_consensus.cc:3060] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:47.929550 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:47.824954 15515 raft_consensus.cc:2749] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:26:47.843997 15988 log.cc:927] Time spent T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d: Append to log took a long time: real 0.445s	user 0.000s	sys 0.001s
I20260709 12:26:47.873952 11616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fd8fdac2fa449e9e184f3d668ea1a7" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:47.834571 15585 leader_election.cc:290] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:47.768779 15718 raft_consensus.cc:515] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:47.838150 15861 raft_consensus.cc:3060] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:47.919013 10994 raft_consensus.cc:2468] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 15.
I20260709 12:26:47.919836 11624 raft_consensus.cc:3060] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:47.683205 15925 consensus_queue.cc:237] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:47.840893 15868 raft_consensus.cc:697] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 16 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
W20260709 12:26:47.931162 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 195783us
I20260709 12:26:47.860052 15700 raft_consensus.cc:493] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:47.861603 15927 raft_consensus.cc:493] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
W20260709 12:26:47.940318 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 247409us
I20260709 12:26:47.933296 15658 raft_consensus.cc:2749] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:47.960620 10968 leader_election.cc:304] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:47.941996 11000 raft_consensus.cc:2468] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 14.
I20260709 12:26:47.943511 11618 raft_consensus.cc:1275] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:26:47.936003 15995 raft_consensus.cc:493] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.964692 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 12 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:47.855216 15866 raft_consensus.cc:515] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:47.844786 15867 raft_consensus.cc:515] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:47.926941 15818 leader_election.cc:290] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:47.927666 15969 raft_consensus.cc:2804] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:47.958164 10924 raft_consensus.cc:1275] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 14 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:26:47.975775 10968 leader_election.cc:304] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:47.947218 11619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab816bcc6183447994a2cc013e46c5f8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
W20260709 12:26:47.973930 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 135704us
I20260709 12:26:47.977800 10895 leader_election.cc:304] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:47.982807 10968 leader_election.cc:400] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 10 pre-election: Vote denied by peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339) with higher term. Message: Invalid argument: T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for earlier term 10. Current term is 11.
I20260709 12:26:47.983287 10968 leader_election.cc:403] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:47.959084 15700 raft_consensus.cc:3060] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:47.949504 15981 leader_election.cc:290] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:47.989133 11588 leader_election.cc:304] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:47.959532 16017 raft_consensus.cc:2749] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:26:47.993737 10968 leader_election.cc:400] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 pre-election: Vote denied by peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339) with higher term. Message: Invalid argument: T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for earlier term 6. Current term is 7.
I20260709 12:26:47.998678 10968 leader_election.cc:403] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:26:47.980845 15936 consensus_meta.cc:287] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040: Time spent flushing consensus metadata: real 1.297s	user 0.009s	sys 0.008s
W20260709 12:26:47.995128 10969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:47.998117 10994 raft_consensus.cc:3055] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:26:48.008881 10968 leader_election.cc:304] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d
I20260709 12:26:48.009240 10994 raft_consensus.cc:740] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:26:48.003803 15834 raft_consensus.cc:515] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:47.990069 16006 log.cc:927] Time spent T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.324s	user 0.002s	sys 0.000s
I20260709 12:26:48.016315 10924 raft_consensus.cc:1275] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:26:47.981367 15969 raft_consensus.cc:493] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:47.986152 15996 raft_consensus.cc:2749] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:47.990587 15875 raft_consensus.cc:2749] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:48.028250 10994 consensus_queue.cc:260] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:48.029536 10994 raft_consensus.cc:3060] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:26:48.030421 16014 log.cc:927] Time spent T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
I20260709 12:26:48.037127 15891 leader_election.cc:290] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:48.038311 15891 raft_consensus.cc:2804] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:26:48.038733 15891 raft_consensus.cc:493] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:48.039258 15891 raft_consensus.cc:3060] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:48.040241 15867 leader_election.cc:290] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:48.040980 15867 raft_consensus.cc:493] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:48.041513 15867 raft_consensus.cc:515] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:48.042793 16011 consensus_queue.cc:1048] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:26:48.043702 16011 consensus_queue.cc:1243] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Peer edcc56ddd3264984b4da6c1db59e7f08 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:26:48.011668 11615 raft_consensus.cc:1240] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:26:48.046520 15868 consensus_queue.cc:237] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:48.019418 16001 log.cc:927] Time spent T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.309s	user 0.000s	sys 0.001s
I20260709 12:26:48.006937 15864 raft_consensus.cc:2749] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339) with higher term. Message: Invalid argument: T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for earlier term 10. Current term is 11.
I20260709 12:26:48.007561 16008 raft_consensus.cc:2749] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:26:47.970734 15927 raft_consensus.cc:515] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:48.051162 15813 consensus_meta.cc:287] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040: Time spent flushing consensus metadata: real 0.919s	user 0.015s	sys 0.000s
I20260709 12:26:47.986721 15871 raft_consensus.cc:515] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:48.087955 10994 raft_consensus.cc:1275] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 13 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 12:26:47.976258 15995 raft_consensus.cc:515] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:48.023501 15969 raft_consensus.cc:3060] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:48.101538 10994 pending_rounds.cc:85] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08: Aborting all ops after (but not including) 7
W20260709 12:26:48.090621 16010 log.cc:927] Time spent T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.163s	user 0.000s	sys 0.008s
W20260709 12:26:48.090462 16020 log.cc:927] Time spent T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.068s	user 0.004s	sys 0.000s
I20260709 12:26:48.084825 15615 consensus_queue.cc:1048] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:26:48.015002 15936 raft_consensus.cc:515] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:48.107707 10994 pending_rounds.cc:107] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08: Aborting uncommitted NO_OP operation due to leader change: 12.8
W20260709 12:26:48.126058 10817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:48.127204 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 291898us
I20260709 12:26:48.127421 10994 raft_consensus.cc:2889] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:26:48.129590 10894 leader_election.cc:336] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:48.133100 10894 leader_election.cc:304] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:48.059813 15952 consensus_queue.cc:1059] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 12:26:48.109477 16000 raft_consensus.cc:515] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:48.146621 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 137819us
I20260709 12:26:48.107461 15658 raft_consensus.cc:2804] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:26:48.153558 10928 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.002s	sys 0.012s
W20260709 12:26:48.156628 10928 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.002s	sys 0.013s
W20260709 12:26:48.112198 16013 log.cc:927] Time spent T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 12:26:48.138878 10894 leader_election.cc:336] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:48.157799 10894 leader_election.cc:304] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:48.158238 10968 leader_election.cc:400] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 election: Vote denied by peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339) with higher term. Message: Invalid argument: T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for earlier term 13. Current term is 14.
I20260709 12:26:48.093814 15813 raft_consensus.cc:515] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:48.165370 10894 leader_election.cc:336] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:48.167255 15952 raft_consensus.cc:3055] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:26:48.167893 15952 raft_consensus.cc:740] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
I20260709 12:26:48.168627 16000 leader_election.cc:290] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:48.113716 15718 leader_election.cc:290] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:48.113345 15871 leader_election.cc:290] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 14 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:26:48.176877 15999 log.cc:927] Time spent T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.545s	user 0.001s	sys 0.004s
I20260709 12:26:48.177049 16017 raft_consensus.cc:2749] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:26:48.118530 16002 raft_consensus.cc:515] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:48.179687 10894 consensus_peers.cc:597] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:48.144093 16022 raft_consensus.cc:493] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:48.152645 15993 raft_consensus.cc:2749] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:48.156239 15658 raft_consensus.cc:493] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:48.125914 16011 consensus_queue.cc:1048] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
W20260709 12:26:48.196902 10968 leader_election.cc:336] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:48.197956 10968 leader_election.cc:304] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:48.164284 15726 raft_consensus.cc:2804] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:26:48.181875 10894 consensus_peers.cc:597] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:48.189991 10994 raft_consensus.cc:1275] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:26:48.200969 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:48.167388 15867 leader_election.cc:290] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:26:48.206086 10968 leader_election.cc:336] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:26:48.218622 10968 leader_election.cc:336] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:48.219345 10968 leader_election.cc:304] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040
W20260709 12:26:48.221709 10894 leader_election.cc:336] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:48.226579 10894 leader_election.cc:304] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:48.232712 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
W20260709 12:26:48.234136 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 255238us
I20260709 12:26:48.234683 10994 pending_rounds.cc:85] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08: Aborting all ops after (but not including) 6
I20260709 12:26:48.235186 10994 pending_rounds.cc:107] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:26:48.235564 10994 raft_consensus.cc:2889] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:48.235761 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18294423a68a4671bf6c5a0f98645e4c" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:48.198300 15658 raft_consensus.cc:3060] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:48.234887 10895 leader_election.cc:304] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
W20260709 12:26:48.238788 10894 leader_election.cc:336] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:48.197867 15871 raft_consensus.cc:2749] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:48.194548 15718 raft_consensus.cc:493] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:48.244239 10894 leader_election.cc:336] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:48.216440 16000 raft_consensus.cc:2749] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:26:48.245240 10895 leader_election.cc:304] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
W20260709 12:26:48.247987 10894 leader_election.cc:336] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:48.251259 10894 leader_election.cc:304] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:48.226785 16031 raft_consensus.cc:493] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.229473 15875 raft_consensus.cc:3060] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:48.222286 16021 raft_consensus.cc:493] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:48.242825 15996 raft_consensus.cc:493] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
W20260709 12:26:48.261471 10894 leader_election.cc:336] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:48.266880 10894 leader_election.cc:304] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:48.261492 10895 leader_election.cc:304] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:26:48.263795 10968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:48.169032 15952 consensus_queue.cc:260] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:48.271420 10894 leader_election.cc:336] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:48.255152 16017 raft_consensus.cc:2804] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:26:48.284201 11624 raft_consensus.cc:2468] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 12.
W20260709 12:26:48.286291 15973 consensus_meta.cc:287] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea: Time spent flushing consensus metadata: real 0.946s	user 0.009s	sys 0.003s
I20260709 12:26:48.262427 16031 raft_consensus.cc:515] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:48.291236 15841 consensus_meta.cc:287] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040: Time spent flushing consensus metadata: real 0.788s	user 0.015s	sys 0.000s
I20260709 12:26:48.250628 16034 raft_consensus.cc:2749] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:48.273607 15996 raft_consensus.cc:515] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:48.272612 15871 raft_consensus.cc:2804] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:26:48.292647 10929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59626 (request call id 3718) took 1782 ms. Trace:
I20260709 12:26:48.292907 16032 raft_consensus.cc:493] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.294044 16002 leader_election.cc:290] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:48.294689 15927 leader_election.cc:290] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:48.295686 15995 leader_election.cc:290] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:48.297607 16025 raft_consensus.cc:2749] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:26:48.320454 10968 leader_election.cc:336] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Timed out: RequestConsensusVote RPC to 127.9.116.66:39339 timed out after 1.563s (SENT)
I20260709 12:26:48.258019 15834 leader_election.cc:290] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:48.347723 10929 rpcz_store.cc:276] 0709 12:26:46.510643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:46.511238 (+   595us) service_pool.cc:224] Handling call
0709 12:26:46.511664 (+   426us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:46.512188 (+   524us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:26:46.925350 (+413162us) log.cc:844] Serialized 14 byte log entry
0709 12:26:47.298972 (+373622us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:47.299603 (+   631us) log.cc:844] Serialized 26 byte log entry
0709 12:26:47.299772 (+   169us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:26:47.299832 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:47.299933 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:48.176322 (+876389us) spinlock_profiling.cc:243] Waited 3.61 ms on lock 0x7b4400022b4c. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7591c23db1 00007f7591cc1c85 00007f7591cc26a2 00007f7594a341db 00007f7594a2faaf 00007f7594a2386e 00007f7594a22bb6 00007f7594a227d8 00007f7594a2c221 00007f7594a2c1d9 00007f7594a2c169
0709 12:26:48.292347 (+116025us) raft_consensus.cc:1685] finished
0709 12:26:48.292440 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:48.292576 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":623463,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":1576,"raft.run_cpu_time_us":416,"raft.run_wall_time_us":3986,"spinlock_wait_cycles":8292736,"thread_start_us":763372,"threads_started":2,"wal-append.queue_time_us":540772}
W20260709 12:26:48.356554 10968 leader_election.cc:336] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Timed out: RequestConsensusVote RPC to 127.9.116.66:39339 timed out after 1.817s (SENT)
I20260709 12:26:48.362773 10968 leader_election.cc:304] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
W20260709 12:26:48.363691 11589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:48.242889 15718 raft_consensus.cc:515] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:48.279507 15952 raft_consensus.cc:3060] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:48.218154 16022 raft_consensus.cc:515] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:48.381608 10800 auto_rebalancer.cc:629] Failed to schedule move for tablet cd87c382c98f42fdb9ced96cf57e9714: Illegal state: Replica edcc56ddd3264984b4da6c1db59e7f08 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } }
W20260709 12:26:48.395793 10969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:48.409904 11000 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57514 (request call id 1327) took 1934 ms (client timeout 1560 ms). Trace:
W20260709 12:26:48.410679 11000 rpcz_store.cc:269] 0709 12:26:46.475199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:46.480600 (+  5401us) service_pool.cc:224] Handling call
0709 12:26:48.409625 (+1929025us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b5400050fd4. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e8c2fa 00007f7599e4db17 00007f75933c86d4 00007f75933c8662 00007f75933c8591 00007f75933c850c 00007f75933c77c2 00007f75931c348c 00007f75931c28c6 00007f75931c226f
0709 12:26:48.409795 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3230372096}
I20260709 12:26:48.364789 16007 raft_consensus.cc:493] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:48.420495 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 159111us
I20260709 12:26:48.442468 10925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50036 (request call id 1076) took 2103 ms. Trace:
I20260709 12:26:48.448153 11002 raft_consensus.cc:1275] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:26:48.392778 15871 raft_consensus.cc:697] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 12 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:48.448621 11002 pending_rounds.cc:85] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08: Aborting all ops after (but not including) 4
I20260709 12:26:48.496316 11002 pending_rounds.cc:107] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:26:48.496675 11002 raft_consensus.cc:2889] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:48.452256 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:48.395789 16034 raft_consensus.cc:2749] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:48.467850 16008 consensus_queue.cc:1048] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 12:26:48.445365 10925 rpcz_store.cc:276] 0709 12:26:46.338740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:46.338953 (+   213us) service_pool.cc:224] Handling call
0709 12:26:46.357026 (+ 18073us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:46.365063 (+  8037us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:26:47.006031 (+640968us) log.cc:844] Serialized 14 byte log entry
0709 12:26:47.403089 (+397058us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:47.403163 (+    74us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:26:47.403228 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:47.712737 (+309509us) spinlock_profiling.cc:243] Waited 2.55 ms on lock 0x7b18004348c0. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f759ac63ab1 00007f759ac70281 00007f7591d692a6 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e88e01 00007f7594e8783e 00007f7599e4c419
0709 12:26:48.442085 (+729348us) spinlock_profiling.cc:243] Waited 7.79 ms on lock 0x7b54003cdcd4. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e88e01 00007f7594e8783e 00007f7599e4c419 00007f75933c3bd4 00007f75933c3b62 00007f75933c3a91 00007f75933c3a0c 00007f75933c2cc2 00007f75931c348c 00007f75931c28c6
0709 12:26:48.442166 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:48.442359 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2295,"prepare.queue_time_us":730489,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":2985,"raft.queue_time_us":9411,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":7040,"spinlock_wait_cycles":23779584,"thread_start_us":960980,"threads_started":2,"wal-append.queue_time_us":622587}
W20260709 12:26:48.451231 15889 consensus_meta.cc:287] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040: Time spent flushing consensus metadata: real 1.069s	user 0.012s	sys 0.006s
W20260709 12:26:48.493027 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 128602us
W20260709 12:26:48.396236 15921 consensus_meta.cc:287] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea: Time spent flushing consensus metadata: real 1.128s	user 0.020s	sys 0.002s
I20260709 12:26:48.275358 16021 raft_consensus.cc:515] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:48.520219 10968 leader_election.cc:336] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Timed out: RequestConsensusVote RPC to 127.9.116.66:39339 timed out after 1.939s (SENT)
W20260709 12:26:48.521831 10968 leader_election.cc:336] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Timed out: RequestConsensusVote RPC to 127.9.116.66:39339 timed out after 2.113s (SENT)
I20260709 12:26:48.448458 16025 raft_consensus.cc:493] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:48.462216 15936 leader_election.cc:290] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 14 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:48.461720 16012 consensus_queue.cc:1048] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.072s
I20260709 12:26:48.466885 16007 raft_consensus.cc:515] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:48.352236 15973 raft_consensus.cc:515] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:48.371968 16032 raft_consensus.cc:515] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:48.453673 10929 raft_consensus.cc:1240] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:26:48.525724 10968 leader_election.cc:304] T d0aed74af73a488f8b691578ca370226 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:48.489990 15813 leader_election.cc:290] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:48.490972 15700 raft_consensus.cc:515] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:48.533890 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:48.543187 10968 leader_election.cc:304] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:48.542790 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18294423a68a4671bf6c5a0f98645e4c" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:48.512637 15995 raft_consensus.cc:493] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:48.442273 16037 consensus_queue.cc:1048] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.172s
I20260709 12:26:48.524143 15889 raft_consensus.cc:2749] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:48.554697 10968 leader_election.cc:304] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:48.523459 16043 raft_consensus.cc:493] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:48.526347 16021 leader_election.cc:290] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:48.559039 10923 raft_consensus.cc:1240] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 5. Current term is 6. Ops: []
I20260709 12:26:48.548604 16015 raft_consensus.cc:2749] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:26:48.569439 16040 log.cc:927] Time spent T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 12:26:48.558426 15861 raft_consensus.cc:2804] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:26:48.560923 15813 raft_consensus.cc:493] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:48.573865 16007 leader_election.cc:290] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:48.575515 16031 leader_election.cc:290] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
W20260709 12:26:48.577037 16046 log.cc:927] Time spent T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:26:48.577948 15866 leader_election.cc:290] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:48.573933 15813 raft_consensus.cc:515] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:48.580252 16003 log.cc:927] Time spent T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.306s	user 0.000s	sys 0.002s
I20260709 12:26:48.580475 15996 leader_election.cc:290] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:48.582130 15813 leader_election.cc:290] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:48.588013 15861 raft_consensus.cc:697] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:26:48.588475 15834 consensus_queue.cc:1048] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:26:48.589501 16043 raft_consensus.cc:515] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:48.589617 15861 consensus_queue.cc:237] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:48.551292 16000 raft_consensus.cc:2749] T d0aed74af73a488f8b691578ca370226 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:48.533619 16039 raft_consensus.cc:2749] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:48.593078 16015 raft_consensus.cc:493] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:48.529865 16025 raft_consensus.cc:515] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:48.593664 16015 raft_consensus.cc:515] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:48.594043 15973 leader_election.cc:290] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:48.599207 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:48.600106 10999 raft_consensus.cc:2468] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 14.
I20260709 12:26:48.603160 10895 leader_election.cc:304] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
W20260709 12:26:48.605000 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:48.605355 15992 raft_consensus.cc:493] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.605967 15992 raft_consensus.cc:515] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:48.606561 15718 leader_election.cc:290] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:48.608207 16015 leader_election.cc:290] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:48.612819 10925 raft_consensus.cc:2468] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 13.
I20260709 12:26:48.613297 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:48.614574 10999 raft_consensus.cc:2468] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 12.
I20260709 12:26:48.549930 15867 raft_consensus.cc:493] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.625855 10968 leader_election.cc:304] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:48.628262 10968 leader_election.cc:304] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:48.631318 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:48.634037 15864 raft_consensus.cc:2804] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:26:48.615743 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:48.617946 10895 leader_election.cc:304] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:48.529057 15921 raft_consensus.cc:515] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:48.579095 15891 consensus_meta.cc:287] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08: Time spent flushing consensus metadata: real 0.501s	user 0.010s	sys 0.000s
I20260709 12:26:48.650694 10922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59622 (request call id 3205) took 1321 ms. Trace:
I20260709 12:26:48.613297 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:48.565246 16002 raft_consensus.cc:2749] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:26:48.603701 16025 leader_election.cc:290] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:48.658283 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef3220c51df47db8859f07ab745fad5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:48.656551 10922 rpcz_store.cc:276] 0709 12:26:47.329512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:47.329635 (+   123us) service_pool.cc:224] Handling call
0709 12:26:47.332901 (+  3266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:47.333260 (+   359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:47.333291 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:47.333784 (+   493us) log.cc:844] Serialized 26 byte log entry
0709 12:26:47.540744 (+206960us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:26:47.627773 (+ 87029us) log.cc:844] Serialized 14 byte log entry
0709 12:26:48.486071 (+858298us) spinlock_profiling.cc:243] Waited 2.16 ms on lock 0x7b180043bb20. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f759ac63ab1 00007f759ac70281 00007f7591d7de07 00007f759abd89a9 00007f7591d9a69b 00007f7591d9893f 00007f7591d98455 00007f7594e80060 00007f7594e92716 00007f7594ea3287 00007f7594ea3208
0709 12:26:48.614000 (+127929us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:48.614112 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:48.614175 (+    63us) raft_consensus.cc:1685] finished
0709 12:26:48.647994 (+ 33819us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:48.650613 (+  2619us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23612,"prepare.queue_time_us":86752,"prepare.run_cpu_time_us":98,"prepare.run_wall_time_us":9043,"raft.queue_time_us":198306,"raft.run_cpu_time_us":278,"raft.run_wall_time_us":18971,"spinlock_wait_cycles":4975360,"thread_start_us":334119,"threads_started":2,"wal-append.queue_time_us":450207}
W20260709 12:26:48.660573 16042 log.cc:927] Time spent T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:26:48.618000 16034 raft_consensus.cc:2804] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:26:48.669728 16047 log.cc:927] Time spent T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:26:48.596439 16022 leader_election.cc:290] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:48.652937 15864 raft_consensus.cc:697] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 13 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:26:48.677742 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:48.661648 11000 raft_consensus.cc:1275] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:26:48.622085 15718 raft_consensus.cc:493] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.649876 16031 raft_consensus.cc:2749] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:26:48.630437 15996 raft_consensus.cc:493] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:48.696363 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 252418us
I20260709 12:26:48.700178 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:48.659376 15992 leader_election.cc:290] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:48.567178 15995 raft_consensus.cc:515] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:48.704293 10927 raft_consensus.cc:1240] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 9. Current term is 10. Ops: []
I20260709 12:26:48.704368 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:48.705865 10925 raft_consensus.cc:2468] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 8.
I20260709 12:26:48.655997 15981 raft_consensus.cc:2749] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339) with higher term. Message: Invalid argument: T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for earlier term 6. Current term is 7.
I20260709 12:26:48.715269 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:48.684108 16034 raft_consensus.cc:493] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 14 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:48.648716 15867 raft_consensus.cc:515] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:48.683944 16051 raft_consensus.cc:2804] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:48.716180 10968 leader_election.cc:304] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:48.705669 16002 raft_consensus.cc:493] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:48.620486 15871 consensus_queue.cc:237] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:48.724071 10968 leader_election.cc:304] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:48.680039 15891 raft_consensus.cc:515] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:48.700531 15658 raft_consensus.cc:515] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:48.723035 16032 leader_election.cc:290] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:48.723372 16034 raft_consensus.cc:3060] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:48.723297 16051 raft_consensus.cc:493] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:48.742725 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef3220c51df47db8859f07ab745fad5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:48.715679 15996 raft_consensus.cc:515] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:48.745517 11618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:48.753827 11618 raft_consensus.cc:3060] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:48.754026 10921 raft_consensus.cc:2368] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for earlier term 13. Current term is 14.
I20260709 12:26:48.746212 11616 raft_consensus.cc:1240] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d [term 12 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 11. Current term is 12. Ops: []
I20260709 12:26:48.757167 15996 leader_election.cc:290] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:48.758435 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:48.759049 10994 raft_consensus.cc:2376] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 14. Re-sending same reply.
I20260709 12:26:48.759555 11615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:48.749327 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:48.712967 15718 raft_consensus.cc:515] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:48.729557 16031 raft_consensus.cc:2804] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:26:48.750885 10998 raft_consensus.cc:1240] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Rejecting Update request from peer 3c52e0825c02476e89d84da9bb849f5d for earlier term 8. Current term is 9. Ops: []
I20260709 12:26:48.722502 16043 leader_election.cc:290] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:48.718947 15862 consensus_queue.cc:1048] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 12:26:48.770076 10895 leader_election.cc:304] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:48.744025 16017 raft_consensus.cc:697] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:48.776244 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:48.737450 16002 raft_consensus.cc:515] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:48.762434 16032 raft_consensus.cc:2749] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:48.775027 16021 raft_consensus.cc:493] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
W20260709 12:26:48.795677 11589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:48.777782 16043 raft_consensus.cc:2749] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:48.799327 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:26:48.784871 16053 log.cc:927] Time spent T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
W20260709 12:26:48.786051 15875 consensus_meta.cc:287] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08: Time spent flushing consensus metadata: real 0.514s	user 0.011s	sys 0.001s
W20260709 12:26:48.788319 16057 log.cc:927] Time spent T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:26:48.792855 15867 leader_election.cc:290] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:48.767740 16031 raft_consensus.cc:493] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:48.753213 16051 raft_consensus.cc:3060] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:48.780915 15700 leader_election.cc:290] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:48.776942 16044 consensus_queue.cc:1059] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
W20260709 12:26:48.834888 10969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 108270us
W20260709 12:26:48.836905 10969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:48.837036 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352aa49c65194abbb863d7553a091f11" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:48.839002 11616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:48.840498 11624 raft_consensus.cc:2468] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 5.
I20260709 12:26:48.764331 15864 consensus_queue.cc:237] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:48.837105 15921 leader_election.cc:290] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 10 election: Requested vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:48.813031 15875 raft_consensus.cc:2749] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:26:48.815838 16031 raft_consensus.cc:3060] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:48.808557 16021 raft_consensus.cc:515] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:48.856662 10969 leader_election.cc:304] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:48.818794 15867 raft_consensus.cc:493] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:48.887398 11001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37512 (request call id 3621) took 1359 ms. Trace:
I20260709 12:26:48.888113 11001 rpcz_store.cc:276] 0709 12:26:47.528046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:47.528590 (+   544us) service_pool.cc:224] Handling call
0709 12:26:47.529014 (+   424us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:47.552491 (+ 23477us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:47.552518 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:48.466862 (+914344us) spinlock_profiling.cc:243] Waited 6.35 ms on lock 0x7b2c0010cc78. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7593781a11 00007f7593791372 00007f7594ec3a01 00007f7594e8843a 00007f7594e8783e 00007f7599e4c419 00007f75933c3bd4 00007f75933c3b62 00007f75933c3a91 00007f75933c3a0c 00007f75933c2cc2
0709 12:26:48.467409 (+   547us) log.cc:844] Serialized 26 byte log entry
0709 12:26:48.653275 (+185866us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:26:48.653315 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:48.653388 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:48.880300 (+226912us) raft_consensus.cc:1685] finished
0709 12:26:48.880332 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:48.887288 (+  6956us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23057,"raft.queue_time_us":33276,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":30192,"spinlock_wait_cycles":14595840,"thread_start_us":153436,"threads_started":1,"wal-append.queue_time_us":223765}
I20260709 12:26:48.892470 16002 leader_election.cc:290] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
W20260709 12:26:48.896377 16062 log.cc:927] Time spent T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
W20260709 12:26:48.899225 16033 log.cc:927] Time spent T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.504s	user 0.004s	sys 0.000s
I20260709 12:26:48.899721 15726 raft_consensus.cc:493] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 14 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:48.871393 15995 leader_election.cc:290] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:48.900099 15658 leader_election.cc:290] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 14 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:48.910997 16066 raft_consensus.cc:2749] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:26:48.917239 10928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59626 (request call id 3733) took 1434 ms. Trace:
I20260709 12:26:48.917934 10928 rpcz_store.cc:276] 0709 12:26:47.482989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:47.547421 (+ 64432us) service_pool.cc:224] Handling call
0709 12:26:47.547815 (+   394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:47.548055 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:47.548078 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:47.568464 (+ 20386us) log.cc:844] Serialized 26 byte log entry
0709 12:26:48.160612 (+592148us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:26:48.160671 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:48.160851 (+   180us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:48.853816 (+692965us) spinlock_profiling.cc:243] Waited 4.39 ms on lock 0x7b4400022b4c. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7591c23db1 00007f7591cc1c85 00007f7591cc26a2 00007f7594a341db 00007f7594a2faaf 00007f7594a2386e 00007f7594a22bb6 00007f7594a227d8 00007f7594a2c221 00007f7594a2c1d9 00007f7594a2c169
0709 12:26:48.916026 (+ 62210us) raft_consensus.cc:1685] finished
0709 12:26:48.916053 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:48.917108 (+  1055us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10085760,"thread_start_us":531878,"threads_started":1,"wal-append.queue_time_us":637275}
I20260709 12:26:48.920298 16021 leader_election.cc:290] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:48.870721 16017 consensus_queue.cc:237] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:48.930732 11618 raft_consensus.cc:2468] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 6.
I20260709 12:26:48.931061 10927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59622 (request call id 3206) took 1601 ms. Trace:
I20260709 12:26:48.915436 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:48.931784 10927 rpcz_store.cc:276] 0709 12:26:47.329837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:47.330769 (+   932us) service_pool.cc:224] Handling call
0709 12:26:47.331179 (+   410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:48.713787 (+1382608us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:48.930727 (+216940us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b54002080d4. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e88e01 00007f7594e8783e 00007f7599e4c419 00007f75933c3bd4 00007f75933c3b62 00007f75933c3a91 00007f75933c3a0c 00007f75933c2cc2 00007f75931c348c 00007f75931c28c6
0709 12:26:48.930975 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3157479168}
I20260709 12:26:48.934844 11589 leader_election.cc:304] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:48.923110 16034 raft_consensus.cc:515] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:48.936275 10929 raft_consensus.cc:2393] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 15: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:26:48.939747 15700 raft_consensus.cc:493] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.940361 15700 raft_consensus.cc:515] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:48.942574 15700 leader_election.cc:290] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:48.945178 15925 raft_consensus.cc:493] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:48.945861 11616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:48.945770 15925 raft_consensus.cc:515] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:48.947991 15925 leader_election.cc:290] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:48.948189 11002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37500 (request call id 4022) took 1414 ms. Trace:
I20260709 12:26:48.948686 11002 rpcz_store.cc:276] 0709 12:26:47.534213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:47.534354 (+   141us) service_pool.cc:224] Handling call
0709 12:26:47.562053 (+ 27699us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:48.500977 (+938924us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:48.947951 (+446974us) spinlock_profiling.cc:243] Waited 882 ms on lock 0x7b540006d954. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e88e01 00007f7594e8783e 00007f7599e4c419 00007f75933c3bd4 00007f75933c3b62 00007f75933c3a91 00007f75933c3a0c 00007f75933c2cc2 00007f75931c348c 00007f75931c28c6
0709 12:26:48.948133 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2029330304}
I20260709 12:26:48.950878 11002 raft_consensus.cc:1275] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 14 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 12:26:48.951274 11002 pending_rounds.cc:85] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08: Aborting all ops after (but not including) 11
I20260709 12:26:48.948060 11616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63ecfc9bd3945818cfe15c03f001315" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:48.951550 11002 pending_rounds.cc:107] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 12:26:48.954715 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac8522e549a46e09593fa4c2e175557" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:48.967988 11002 raft_consensus.cc:2889] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:48.868894 15867 raft_consensus.cc:515] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:48.964146 10969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 107582us
I20260709 12:26:48.956388 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:48.955349 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6a1da21304fcfacab384a6afc4101" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
W20260709 12:26:48.967026 10817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:48.912149 15726 raft_consensus.cc:3060] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:48.962527 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:49.017638 10923 raft_consensus.cc:2393] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3c52e0825c02476e89d84da9bb849f5d in current term 6: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:26:49.004047 10969 leader_election.cc:304] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:48.954289 11616 raft_consensus.cc:2468] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 7.
I20260709 12:26:49.029011 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:26:48.995595 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 60806.9us
I20260709 12:26:48.956614 11620 raft_consensus.cc:1275] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [term 16 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
I20260709 12:26:49.032198 11620 pending_rounds.cc:85] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d: Aborting all ops after (but not including) 12
I20260709 12:26:49.032887 11620 pending_rounds.cc:107] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 12:26:49.033334 11620 raft_consensus.cc:2889] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:48.956111 11615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c6d38c4d8a90a81975a6a0cb13" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:48.958340 16034 leader_election.cc:290] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 15 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:48.996892 16028 raft_consensus.cc:2804] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:26:48.956952 11617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:49.035832 10969 leader_election.cc:304] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:49.039126 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:49.052174 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:48.956820 15718 leader_election.cc:290] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:49.045061 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:49.056317 10928 raft_consensus.cc:2468] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 13.
I20260709 12:26:48.992508 15700 raft_consensus.cc:493] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:49.071270 11620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c6d38c4d8a90a81975a6a0cb13" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:49.041327 10926 raft_consensus.cc:2955] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:49.072486 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63ecfc9bd3945818cfe15c03f001315" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:49.075866 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:49.076557 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:49.041129 16021 raft_consensus.cc:2749] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:49.073237 11002 raft_consensus.cc:2468] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 7.
I20260709 12:26:49.081655 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:49.053346 15995 raft_consensus.cc:493] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
W20260709 12:26:49.078534 15969 consensus_meta.cc:287] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea: Time spent flushing consensus metadata: real 0.949s	user 0.010s	sys 0.007s
I20260709 12:26:49.104115 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac8522e549a46e09593fa4c2e175557" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:49.066819 16028 raft_consensus.cc:697] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [term 14 LEADER]: Becoming Leader. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
I20260709 12:26:49.071815 15700 raft_consensus.cc:515] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:49.108206 15995 raft_consensus.cc:515] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:49.171833 16075 log.cc:927] Time spent T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.237s	user 0.002s	sys 0.000s
W20260709 12:26:49.220023 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 260673us
I20260709 12:26:49.110261 15969 raft_consensus.cc:515] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:49.299877 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:49.320930 11002 raft_consensus.cc:3060] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:49.107983 16021 raft_consensus.cc:2804] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:49.107115 15718 consensus_queue.cc:1048] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:26:49.305409 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:49.334700 11001 raft_consensus.cc:2393] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 12: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:26:49.335676 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:49.336351 10927 raft_consensus.cc:3060] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:26:49.318575 16076 log.cc:927] Time spent T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d: Append to log took a long time: real 0.192s	user 0.007s	sys 0.000s
I20260709 12:26:49.338960 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6a1da21304fcfacab384a6afc4101" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:49.420655 10922 raft_consensus.cc:2410] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:26:49.339186 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:26:49.330479 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:49.319008 16071 log.cc:927] Time spent T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d: Append to log took a long time: real 0.394s	user 0.000s	sys 0.012s
W20260709 12:26:49.317806 16069 log.cc:927] Time spent T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d: Append to log took a long time: real 0.256s	user 0.004s	sys 0.004s
I20260709 12:26:49.392916 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad766f48812a4ddeb383179b1d84907b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:49.431725 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c6d38c4d8a90a81975a6a0cb13" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:49.444567 11001 raft_consensus.cc:2468] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 8.
I20260709 12:26:49.445974 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:49.447535 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:26:49.457803 10817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:49.458751 10928 raft_consensus.cc:1240] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 11. Current term is 12. Ops: []
I20260709 12:26:49.324819 16021 raft_consensus.cc:493] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:49.471792 10927 raft_consensus.cc:2468] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 12.
I20260709 12:26:49.190192 16028 consensus_queue.cc:237] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:49.417771 15996 raft_consensus.cc:493] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:49.484189 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:49.486140 10924 raft_consensus.cc:1240] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 15 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 14. Current term is 15. Ops: []
I20260709 12:26:49.488421 15969 leader_election.cc:290] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 12 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:49.491310 10921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59622 (request call id 3232) took 1037 ms. Trace:
I20260709 12:26:49.530082 10921 rpcz_store.cc:276] 0709 12:26:48.453708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:48.613035 (+159327us) service_pool.cc:224] Handling call
0709 12:26:49.490917 (+877882us) spinlock_profiling.cc:243] Waited 91.2 ms on lock 0x7b540039ec54. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e8c2fa 00007f7599e4db17 00007f75933c86d4 00007f75933c8662 00007f75933c8591 00007f75933c850c 00007f75933c77c2 00007f75931c348c 00007f75931c28c6 00007f75931c226f
0709 12:26:49.491248 (+   331us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":209708416}
I20260709 12:26:49.498159 15726 raft_consensus.cc:515] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:49.500226 16055 raft_consensus.cc:493] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:49.502349 15995 leader_election.cc:290] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:49.504048 10998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57514 (request call id 1346) took 1487 ms. Trace:
I20260709 12:26:49.504370 16021 raft_consensus.cc:3060] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:49.472457 16017 raft_consensus.cc:493] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
W20260709 12:26:49.509697 11589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:49.545805 10998 rpcz_store.cc:276] 0709 12:26:48.016191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:48.143550 (+127359us) service_pool.cc:224] Handling call
0709 12:26:48.164179 (+ 20629us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:48.767926 (+603747us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:49.503790 (+735864us) spinlock_profiling.cc:243] Waited 586 ms on lock 0x7b5400180bd4. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e88e01 00007f7594e8783e 00007f7599e4c419 00007f75933c3bd4 00007f75933c3b62 00007f75933c3a91 00007f75933c3a0c 00007f75933c2cc2 00007f75931c348c 00007f75931c28c6
0709 12:26:49.503984 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1348898048}
I20260709 12:26:49.471949 16002 raft_consensus.cc:493] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:49.581341 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 281637us
I20260709 12:26:49.570864 15885 consensus_queue.cc:1048] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 12:26:49.536478 15925 raft_consensus.cc:493] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:49.537855 16007 raft_consensus.cc:493] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:49.620391 11002 raft_consensus.cc:2468] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 14.
W20260709 12:26:49.635560 10999 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.007s	sys 0.010s
W20260709 12:26:49.629405 16012 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.007s	sys 0.018s
I20260709 12:26:49.575634 16017 raft_consensus.cc:515] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:49.644414 16031 consensus_meta.cc:287] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08: Time spent flushing consensus metadata: real 0.780s	user 0.013s	sys 0.005s
I20260709 12:26:49.599745 15718 raft_consensus.cc:493] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:49.645433 10999 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.008s	sys 0.010s
I20260709 12:26:49.595142 15867 leader_election.cc:290] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:49.548120 16055 raft_consensus.cc:515] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:49.543368 15996 raft_consensus.cc:515] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:49.680752 15996 leader_election.cc:290] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:49.680754 16085 raft_consensus.cc:493] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:49.681664 16085 raft_consensus.cc:515] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:49.619105 16007 raft_consensus.cc:515] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:49.685890 16007 leader_election.cc:290] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:49.668522 10926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50036 (request call id 1096) took 1395 ms. Trace:
I20260709 12:26:49.692456 10926 rpcz_store.cc:276] 0709 12:26:48.273204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:48.273420 (+   216us) service_pool.cc:224] Handling call
0709 12:26:48.284365 (+ 10945us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:26:48.786292 (+501927us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b1800434bc0. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f759ac63ab1 00007f759ac70281 00007f7594a304bc 00007f7591d7e48b 00007f759abd89a9 00007f7591d9a69b 00007f7591d9893f 00007f7591d98455 00007f7594e80060 00007f7594e80bfb 00007f7594e8b64b
0709 12:26:48.786500 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:48.786680 (+   180us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:26:48.816834 (+ 30154us) log.cc:844] Serialized 546 byte log entry
0709 12:26:48.994383 (+177549us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:26:49.499452 (+505069us) log.cc:844] Serialized 14 byte log entry
0709 12:26:49.500081 (+   629us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:49.501028 (+   947us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:49.668212 (+167184us) raft_consensus.cc:1685] finished
0709 12:26:49.668299 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:49.668456 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62057,"raft.queue_time_us":110277,"raft.run_cpu_time_us":403,"raft.run_wall_time_us":15461,"spinlock_wait_cycles":30337920,"thread_start_us":171975,"threads_started":2,"wal-append.queue_time_us":810793}
I20260709 12:26:49.669437 10997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37512 (request call id 3627) took 1732 ms. Trace:
I20260709 12:26:49.695817 10997 rpcz_store.cc:276] 0709 12:26:47.936645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:47.936990 (+   345us) service_pool.cc:224] Handling call
0709 12:26:47.952335 (+ 15345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:47.994877 (+ 42542us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:26:48.024337 (+ 29460us) log.cc:844] Serialized 14 byte log entry
0709 12:26:48.184185 (+159848us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:48.184301 (+   116us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:26:48.184404 (+   103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:49.669207 (+1484803us) spinlock_profiling.cc:243] Waited 42.3 ms on lock 0x7b540006e854. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e88e01 00007f7594e8783e 00007f7599e4c419 00007f75933c3bd4 00007f75933c3b62 00007f75933c3a91 00007f75933c3a0c 00007f75933c2cc2 00007f75931c348c 00007f75931c28c6
0709 12:26:49.669253 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:49.669381 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":168788,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":25157,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":196,"spinlock_wait_cycles":97287040,"thread_start_us":182971,"threads_started":2}
I20260709 12:26:49.673250 16017 leader_election.cc:290] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:49.673874 15700 leader_election.cc:290] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:49.582621 16002 raft_consensus.cc:515] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:49.649832 16031 raft_consensus.cc:515] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:49.618721 15925 raft_consensus.cc:515] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:49.651778 15718 raft_consensus.cc:515] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:49.656356 16086 raft_consensus.cc:493] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
W20260709 12:26:49.677393 16051 consensus_meta.cc:287] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent flushing consensus metadata: real 0.841s	user 0.012s	sys 0.007s
I20260709 12:26:49.674937 15726 leader_election.cc:290] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 15 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:26:49.646533 16012 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.008s	sys 0.019s
I20260709 12:26:49.749799 11003 raft_consensus.cc:1240] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 8. Current term is 9. Ops: []
I20260709 12:26:49.751442 16002 leader_election.cc:290] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:49.751334 16087 consensus_queue.cc:1059] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:26:49.752226 16002 raft_consensus.cc:493] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:49.752811 16002 raft_consensus.cc:515] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:49.754954 16002 leader_election.cc:290] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:49.759178 16055 leader_election.cc:290] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:49.769497 15718 leader_election.cc:290] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:49.772682 15718 raft_consensus.cc:493] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:49.773253 16031 leader_election.cc:290] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:49.773196 15718 raft_consensus.cc:515] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:49.786003 10894 leader_election.cc:336] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Timed out: RequestConsensusVote RPC to 127.9.116.65:46265 timed out after 1.511s (SENT)
I20260709 12:26:49.786687 10894 leader_election.cc:304] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:49.770215 15925 leader_election.cc:290] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:49.737747 16086 raft_consensus.cc:515] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:49.788694 15726 raft_consensus.cc:2749] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:26:49.795468 16032 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.912s	user 0.001s	sys 0.021s
I20260709 12:26:49.738049 16051 raft_consensus.cc:515] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:49.796466 16085 leader_election.cc:290] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:49.828933 10920 raft_consensus.cc:1240] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 12. Current term is 13. Ops: []
W20260709 12:26:49.813690 16032 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.939s	user 0.002s	sys 0.021s
I20260709 12:26:49.840190 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:49.840595 10999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57514 (request call id 1358) took 1056 ms. Trace:
I20260709 12:26:49.840994 10999 rpcz_store.cc:276] 0709 12:26:48.784606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:48.921516 (+136910us) service_pool.cc:224] Handling call
0709 12:26:48.922094 (+   578us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:26:48.922775 (+   681us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:48.922822 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:26:48.978074 (+ 55252us) log.cc:844] Serialized 52 byte log entry
0709 12:26:49.650427 (+672353us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:26:49.670930 (+ 20503us) spinlock_profiling.cc:243] Waited 34.7 ms on lock 0x7b48001b0258. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7599db1aa1 00007f7599da8b37 00007f7599da89ca 00007f7599ea026f 00007f7599e9ff37 00007f7599eb455c 00007f7599eb4508 00007f7599eb4488 00007f7599eb4443 00007f7599eb36ec 00007f7598ddda96
0709 12:26:49.710772 (+ 39842us) log.cc:844] Serialized 14 byte log entry
0709 12:26:49.711210 (+   438us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:49.711366 (+   156us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:49.840262 (+128896us) raft_consensus.cc:1685] finished
0709 12:26:49.840374 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:49.840535 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25361,"prepare.queue_time_us":67819,"prepare.run_cpu_time_us":239,"prepare.run_wall_time_us":235,"raft.queue_time_us":71691,"raft.run_cpu_time_us":9738,"raft.run_wall_time_us":743004,"spinlock_wait_cycles":79845248,"thread_start_us":611530,"threads_started":1,"wal-append.queue_time_us":785730}
I20260709 12:26:49.821376 15700 raft_consensus.cc:493] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:49.855962 16012 raft_consensus.cc:493] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
W20260709 12:26:49.860512 10817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:49.909337 10969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:49.848482 15700 raft_consensus.cc:515] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:49.911837 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:49.865502 15718 leader_election.cc:290] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:49.903484 16032 raft_consensus.cc:493] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:49.902998 16066 raft_consensus.cc:493] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:49.904968 16055 raft_consensus.cc:493] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
W20260709 12:26:49.926596 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 398640us
I20260709 12:26:49.905511 15891 leader_election.cc:290] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:49.914733 15875 raft_consensus.cc:493] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:49.943411 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d9a61ecaf84695b70f8519ee57706f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:49.920902 11615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:49.915269 16090 raft_consensus.cc:493] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:49.920665 15996 raft_consensus.cc:493] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
W20260709 12:26:49.955344 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 371934us
W20260709 12:26:49.956476 11588 leader_election.cc:336] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:49.960064 11588 leader_election.cc:304] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:49.865068 16012 raft_consensus.cc:515] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:49.930305 15995 raft_consensus.cc:3055] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:26:49.964792 11588 leader_election.cc:336] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:26:49.990727 11588 leader_election.cc:336] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:49.964907 10999 raft_consensus.cc:1240] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Rejecting Update request from peer 3c52e0825c02476e89d84da9bb849f5d for earlier term 6. Current term is 7. Ops: []
W20260709 12:26:49.981046 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:49.992260 11588 leader_election.cc:304] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:49.936810 16032 raft_consensus.cc:515] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:49.943984 16055 raft_consensus.cc:515] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:50.000195 11588 leader_election.cc:336] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:50.000988 11588 leader_election.cc:304] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:49.963934 15873 raft_consensus.cc:2749] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:26:49.933207 16066 raft_consensus.cc:515] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:49.953574 15875 raft_consensus.cc:515] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:50.009795 16093 log.cc:927] Time spent T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 12:26:50.011785 15875 leader_election.cc:290] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:50.016336 15700 leader_election.cc:290] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:26:50.018791 11589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:50.019954 16099 raft_consensus.cc:493] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:50.020084 16106 raft_consensus.cc:493] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:50.020555 16099 raft_consensus.cc:515] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:50.020884 16106 raft_consensus.cc:515] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:50.023113 16099 leader_election.cc:290] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:50.025020 16012 leader_election.cc:290] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:49.988637 15995 raft_consensus.cc:740] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:50.026144 15995 consensus_queue.cc:260] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:50.019457 16097 raft_consensus.cc:2749] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:50.027953 15995 raft_consensus.cc:3060] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:50.028918 16059 consensus_queue.cc:1059] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:26:50.029486 16066 leader_election.cc:290] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:50.030072 16059 raft_consensus.cc:3055] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:26:50.030449 16059 raft_consensus.cc:740] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
I20260709 12:26:49.961823 15900 consensus_queue.cc:1059] T e3d9a61ecaf84695b70f8519ee57706f P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 12:26:50.035398 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:26:50.040351 11588 leader_election.cc:336] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:26:50.043391 10894 leader_election.cc:336] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Timed out: RequestConsensusVote RPC to 127.9.116.65:46265 timed out after 1.768s (SENT)
W20260709 12:26:50.005178 16095 log.cc:927] Time spent T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
I20260709 12:26:49.997440 16086 leader_election.cc:290] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
W20260709 12:26:50.057475 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 59108us
I20260709 12:26:49.960356 15996 raft_consensus.cc:515] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:50.005749 15992 raft_consensus.cc:493] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:50.055826 16065 raft_consensus.cc:3055] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:26:50.026078 16106 leader_election.cc:290] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:50.100091 10820 leader_election.cc:304] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:50.101063 16106 raft_consensus.cc:2804] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:50.101462 16106 raft_consensus.cc:493] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:50.101511 16077 raft_consensus.cc:493] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:50.102177 10820 leader_election.cc:304] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:50.102434 16077 raft_consensus.cc:515] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:50.044410 11588 leader_election.cc:336] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:50.056396 16100 raft_consensus.cc:3055] T e3d9a61ecaf84695b70f8519ee57706f P 3c52e0825c02476e89d84da9bb849f5d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:26:50.042095 16051 leader_election.cc:290] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 13 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:50.041882 15615 raft_consensus.cc:2749] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:50.074565 10928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59626 (request call id 3745) took 1005 ms. Trace:
I20260709 12:26:49.960538 16090 raft_consensus.cc:515] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:50.076375 10819 leader_election.cc:304] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
W20260709 12:26:50.119153 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 59636.5us
I20260709 12:26:50.096540 15992 raft_consensus.cc:515] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:50.098064 10996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57514 (request call id 1352) took 1366 ms. Trace:
I20260709 12:26:50.101799 16106 raft_consensus.cc:3060] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:26:50.104439 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 60061.4us
I20260709 12:26:50.064661 16032 leader_election.cc:290] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:50.116274 10928 rpcz_store.cc:276] 0709 12:26:49.069202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:49.069765 (+   563us) service_pool.cc:224] Handling call
0709 12:26:49.070218 (+   453us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:49.466983 (+396765us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:50.074158 (+607175us) spinlock_profiling.cc:243] Waited 358 ms on lock 0x7b54001e91d4. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e88e01 00007f7594e8783e 00007f7599e4c419 00007f75933c3bd4 00007f75933c3b62 00007f75933c3a91 00007f75933c3a0c 00007f75933c2cc2 00007f75931c348c 00007f75931c28c6
0709 12:26:50.074473 (+   315us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":824277760}
I20260709 12:26:50.121097 10996 rpcz_store.cc:276] 0709 12:26:48.731665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:48.733329 (+  1664us) service_pool.cc:224] Handling call
0709 12:26:48.733723 (+   394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:48.735995 (+  2272us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:26:48.749164 (+ 13169us) log.cc:844] Serialized 14 byte log entry
0709 12:26:48.839080 (+ 89916us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:48.852055 (+ 12975us) log.cc:844] Serialized 26 byte log entry
0709 12:26:48.852283 (+   228us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:26:48.852346 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:49.175366 (+323020us) spinlock_profiling.cc:243] Waited 5.58 ms on lock 0x7b48001b0258. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7599db1aa1 00007f7599da8b37 00007f7599da89ca 00007f7599ea026f 00007f7599e9ff37 00007f7599eb455c 00007f7599eb4508 00007f7599eb4488 00007f7599eb4443 00007f7599eb36ec 00007f7598ddda96
0709 12:26:49.767613 (+592247us) spinlock_profiling.cc:243] Waited 1.78 ms on lock 0x7b5400181ad4. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e88e01 00007f7594e8783e 00007f7599e4c419 00007f75933c3bd4 00007f75933c3b62 00007f75933c3a91 00007f75933c3a0c 00007f75933c2cc2 00007f75931c348c 00007f75931c28c6
0709 12:26:49.767669 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:50.094247 (+326578us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b180032ec60. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f759ac63ab1 00007f759ac70281 00007f7591d9b3f3 00007f7591d9d7c1 00007f7591d9d779 00007f7591d9d709 00007f7591d9d6d1 00007f7591d9c9cd 0000000000388634 0000000000388479 00007f7591d7e83a
0709 12:26:50.097801 (+  3554us) raft_consensus.cc:1685] finished
0709 12:26:50.097827 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:50.097980 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21083,"prepare.queue_time_us":15497,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":54,"raft.queue_time_us":37760,"raft.run_cpu_time_us":9766,"raft.run_wall_time_us":566031,"spinlock_wait_cycles":42683520,"thread_start_us":66909,"threads_started":1,"wal-append.queue_time_us":113484}
I20260709 12:26:50.103470 10820 leader_election.cc:304] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:50.093653 16065 raft_consensus.cc:740] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
W20260709 12:26:50.143081 10894 leader_election.cc:336] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Timed out: RequestConsensusVote RPC to 127.9.116.65:46265 timed out after 1.609s (SENT)
I20260709 12:26:50.031334 16059 consensus_queue.cc:260] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:50.104722 16100 raft_consensus.cc:740] T e3d9a61ecaf84695b70f8519ee57706f P 3c52e0825c02476e89d84da9bb849f5d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
I20260709 12:26:50.127226 15995 raft_consensus.cc:2749] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:50.155799 15819 raft_consensus.cc:2804] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:50.162566 15819 raft_consensus.cc:493] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:50.163367 15819 raft_consensus.cc:3060] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:26:50.165264 10894 leader_election.cc:336] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Timed out: RequestConsensusVote RPC to 127.9.116.65:46265 timed out after 1.785s (SENT)
I20260709 12:26:50.165769 10894 leader_election.cc:304] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:50.117358 16099 consensus_queue.cc:1048] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:26:50.169407 16051 raft_consensus.cc:2749] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:26:50.183669 10996 raft_consensus.cc:1275] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:26:50.184667 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:50.184681 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:50.186506 16077 leader_election.cc:290] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:50.187137 10748 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36188 (request call id 229) took 9915 ms. Trace:
I20260709 12:26:50.192265 11001 raft_consensus.cc:2393] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 14: Already voted for candidate 80cd7d227db44f34a6108591dad9c040 in this term.
I20260709 12:26:50.193077 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:50.189646 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:50.193885 10998 raft_consensus.cc:3060] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:50.194756 11001 raft_consensus.cc:1275] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:26:50.191237 15864 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.296s	user 0.034s	sys 0.035s
I20260709 12:26:50.202879 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:50.192168 10748 rpcz_store.cc:276] 0709 12:26:40.272407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:40.287766 (+ 15359us) service_pool.cc:224] Handling call
0709 12:26:50.186968 (+9899202us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:42.135699 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:42.389323 (+253624us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:42.389388 (+    65us) write_op.cc:435] Acquired schema lock
0709 12:26:42.389408 (+    20us) tablet.cc:662] Decoding operations
0709 12:26:42.390641 (+  1233us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:42.390747 (+   106us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:42.390790 (+    43us) tablet.cc:685] Acquiring locks for 13 operations
0709 12:26:42.450362 (+ 59572us) tablet.cc:701] Row locks acquired
0709 12:26:42.450434 (+    72us) write_op.cc:260] PREPARE: finished
0709 12:26:42.450651 (+   217us) write_op.cc:270] Start()
0709 12:26:42.451035 (+   384us) write_op.cc:276] Timestamp: P: 1783600002450572 usec, L: 0
0709 12:26:42.451058 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:26:42.452100 (+  1042us) log.cc:844] Serialized 5094 byte log entry
0709 12:26:43.692213 (+1240113us) op_driver.cc:464] REPLICATION: finished
0709 12:26:43.993069 (+300856us) write_op.cc:301] APPLY: starting
0709 12:26:43.993188 (+   119us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:45.075239 (+1082051us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:45.075399 (+   160us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:45.633199 (+557800us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:45.633573 (+   374us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=0,mrs_lookups=0
0709 12:26:45.633621 (+    48us) write_op.cc:312] APPLY: finished
0709 12:26:45.634072 (+   451us) log.cc:844] Serialized 121 byte log entry
0709 12:26:46.327075 (+693003us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:46.327241 (+   166us) write_op.cc:454] Released schema lock
0709 12:26:46.327311 (+    70us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:46.327818 (+   507us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:46.327847 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":305203,"reported_tablets":18,"child_traces":[["op",{"apply.queue_time_us":300489,"apply.run_cpu_time_us":110253,"apply.run_wall_time_us":2334723,"cfile_cache_hit":54,"cfile_cache_hit_bytes":58467,"num_ops":13,"prepare.queue_time_us":380874,"prepare.run_cpu_time_us":13852,"prepare.run_wall_time_us":652971,"raft.queue_time_us":494561,"raft.run_cpu_time_us":33423,"raft.run_wall_time_us":212339,"replication_time_us":1240922,"thread_start_us":1425524,"threads_started":5,"wal-append.queue_time_us":1123975,"wal-append.run_cpu_time_us":39379,"wal-append.run_wall_time_us":2623678}]]}
I20260709 12:26:50.207455 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:50.212550 10895 leader_election.cc:304] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:50.212993 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d9a61ecaf84695b70f8519ee57706f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:50.210996 10994 raft_consensus.cc:3060] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:50.205523 16065 consensus_queue.cc:260] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:50.216759 16115 raft_consensus.cc:2804] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:26:50.217300 16115 raft_consensus.cc:493] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:50.217793 16115 raft_consensus.cc:3060] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:50.219925 10997 raft_consensus.cc:2393] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 9: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:26:50.194097 16059 raft_consensus.cc:3060] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:50.221633 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aed74af73a488f8b691578ca370226" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:50.225839 11001 raft_consensus.cc:1275] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:26:50.229339 10998 raft_consensus.cc:2468] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 12.
W20260709 12:26:50.210741 16021 consensus_meta.cc:287] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08: Time spent flushing consensus metadata: real 0.635s	user 0.015s	sys 0.001s
W20260709 12:26:50.209380 15864 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.314s	user 0.035s	sys 0.035s
I20260709 12:26:50.246778 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:50.247522 10999 raft_consensus.cc:2468] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 7.
I20260709 12:26:50.245323 16021 raft_consensus.cc:515] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:50.250097 10995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37500 (request call id 4024) took 1798 ms. Trace:
I20260709 12:26:50.250795 16021 leader_election.cc:290] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:50.250661 10995 rpcz_store.cc:276] 0709 12:26:48.451497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:48.451803 (+   306us) service_pool.cc:224] Handling call
0709 12:26:48.470066 (+ 18263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:48.599937 (+129871us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:26:48.630625 (+ 30688us) log.cc:844] Serialized 14 byte log entry
0709 12:26:49.779222 (+1148597us) spinlock_profiling.cc:243] Waited 3.81 ms on lock 0x7b18003c8e00. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f759ac63ab1 00007f759ac70281 00007f7594a304bc 00007f7591d7e48b 00007f759abd89a9 00007f7591d9a69b 00007f7591d9893f 00007f7591d98455 00007f7594e80060 00007f7594e92716 00007f7594ea3287
0709 12:26:49.779394 (+   172us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:49.779471 (+    77us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:26:49.779545 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:50.249791 (+470246us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b54002c33d4. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e88e01 00007f7594e8783e 00007f7599e4c419 00007f75933c3bd4 00007f75933c3b62 00007f75933c3a91 00007f75933c3a0c 00007f75933c2cc2 00007f75931c348c 00007f75931c28c6
0709 12:26:50.249857 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:50.250023 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":31784,"prepare.run_cpu_time_us":182,"prepare.run_wall_time_us":4895,"raft.queue_time_us":24350,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":11660,"spinlock_wait_cycles":257473280,"thread_start_us":137616,"threads_started":2,"wal-append.queue_time_us":145878,"wal-append.run_cpu_time_us":3037,"wal-append.run_wall_time_us":1118748}
I20260709 12:26:50.256403 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:50.256906 11003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37512 (request call id 3634) took 1236 ms. Trace:
I20260709 12:26:50.257520 11003 rpcz_store.cc:276] 0709 12:26:49.020145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:49.492068 (+471923us) service_pool.cc:224] Handling call
0709 12:26:49.492330 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:49.750850 (+258520us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:50.256567 (+505717us) spinlock_profiling.cc:243] Waited 257 ms on lock 0x7b54002d2b54. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e88e01 00007f7594e8783e 00007f7599e4c419 00007f75933c3bd4 00007f75933c3b62 00007f75933c3a91 00007f75933c3a0c 00007f75933c2cc2 00007f75931c348c 00007f75931c28c6
0709 12:26:50.256818 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":591056640}
I20260709 12:26:50.260335 16000 raft_consensus.cc:493] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:50.261334 16090 leader_election.cc:290] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:50.261060 16000 raft_consensus.cc:515] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:50.225189 16017 raft_consensus.cc:2804] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:50.293855 10920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59626 (request call id 3739) took 1266 ms. Trace:
I20260709 12:26:50.294346 10920 rpcz_store.cc:276] 0709 12:26:49.027366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:49.028279 (+   913us) service_pool.cc:224] Handling call
0709 12:26:49.028572 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:49.830809 (+802237us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:50.293575 (+462766us) spinlock_profiling.cc:243] Waited 800 ms on lock 0x7b540012b1d4. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e88e01 00007f7594e8783e 00007f7599e4c419 00007f75933c3bd4 00007f75933c3b62 00007f75933c3a91 00007f75933c3a0c 00007f75933c2cc2 00007f75931c348c 00007f75931c28c6
0709 12:26:50.293784 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1839905024}
I20260709 12:26:50.301349 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:50.314407 16055 leader_election.cc:290] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:50.315064 16055 raft_consensus.cc:493] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:50.320067 16000 leader_election.cc:290] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:50.315532 16055 raft_consensus.cc:515] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:50.321987 16100 consensus_queue.cc:260] T e3d9a61ecaf84695b70f8519ee57706f P 3c52e0825c02476e89d84da9bb849f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:50.323143 16055 leader_election.cc:290] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:50.323853 11615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:50.324919 11615 raft_consensus.cc:2468] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 10.
I20260709 12:26:50.327418 15996 leader_election.cc:290] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:26:50.333642 10817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:50.241086 15925 consensus_queue.cc:1048] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 12:26:50.334287 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 15 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:50.335487 15925 raft_consensus.cc:493] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:50.336040 15925 raft_consensus.cc:515] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:50.336910 11619 raft_consensus.cc:1275] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:26:50.339257 11003 raft_consensus.cc:1275] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 14 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:26:50.340432 16100 raft_consensus.cc:3060] T e3d9a61ecaf84695b70f8519ee57706f P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:50.346748 11620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d9a61ecaf84695b70f8519ee57706f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:50.327495 11616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aed74af73a488f8b691578ca370226" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
W20260709 12:26:50.353344 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 230633us
I20260709 12:26:50.262663 16098 consensus_queue.cc:1048] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:26:50.358613 10994 raft_consensus.cc:2468] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 15.
I20260709 12:26:50.364888 10819 leader_election.cc:304] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
W20260709 12:26:50.377245 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 224301us
W20260709 12:26:50.384631 10817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:50.386046 10968 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.116.66:39339 timed out after 1.918s (SENT) [suppressed 71 similar messages]
W20260709 12:26:50.386873 11589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:50.405787 10968 leader_election.cc:304] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
W20260709 12:26:50.414382 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 310963us
I20260709 12:26:50.415174 10968 leader_election.cc:400] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 election: Vote denied by peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339) with higher term. Message: Invalid argument: T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for earlier term 13. Current term is 14.
I20260709 12:26:50.416141 10968 leader_election.cc:403] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:26:50.400051 15700 raft_consensus.cc:2804] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:26:50.418380 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 190034us
W20260709 12:26:50.421995 11586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:50.424638 10928 raft_consensus.cc:1240] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 11. Current term is 12. Ops: []
I20260709 12:26:50.372850 15977 consensus_queue.cc:1048] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.044s
I20260709 12:26:50.414316 16000 raft_consensus.cc:2749] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:50.414956 15992 leader_election.cc:290] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:50.441109 11617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:50.420250 16090 raft_consensus.cc:2749] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339) with higher term. Message: Invalid argument: T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 for earlier term 13. Current term is 14.
W20260709 12:26:50.443133 11588 consensus_peers.cc:597] T 435d66c6d38c4d8a90a81975a6a0cb13 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:50.453639 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 331699us
W20260709 12:26:50.454399 11588 leader_election.cc:336] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:50.417254 16110 consensus_queue.cc:1059] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 12:26:50.420962 15864 consensus_queue.cc:1059] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
W20260709 12:26:50.459971 11588 consensus_peers.cc:597] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:50.443835 15700 raft_consensus.cc:697] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 12 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:50.442878 16017 raft_consensus.cc:697] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:50.485781 16017 consensus_queue.cc:237] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:50.486369 16115 raft_consensus.cc:515] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:50.489383 16115 leader_election.cc:290] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 election: Requested vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:50.480468 16090 raft_consensus.cc:3055] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:26:50.497635 15925 leader_election.cc:290] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:50.504820 16090 raft_consensus.cc:740] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:26:50.504382 16106 raft_consensus.cc:515] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:50.559887  9681 thread.cc:527] Waited for 1000ms trying to join with heartbeat (tid 10879)
I20260709 12:26:50.417145 10820 leader_election.cc:304] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
W20260709 12:26:50.567116 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 149891us
I20260709 12:26:50.568907 10819 leader_election.cc:304] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:50.571992 10820 leader_election.cc:304] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:50.423380 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac83709373b4efd9c3aa1472a9f9022" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:50.582964 10920 raft_consensus.cc:2468] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 7.
I20260709 12:26:50.589524 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:50.585670 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:50.593042 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:50.593456 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:50.594461 10922 raft_consensus.cc:2468] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 13.
I20260709 12:26:50.595112 10924 raft_consensus.cc:2393] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 12: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:26:50.596354 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:50.597568 10923 raft_consensus.cc:2468] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 13.
I20260709 12:26:50.600809 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d9a61ecaf84695b70f8519ee57706f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:50.601972 10926 raft_consensus.cc:3060] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:26:50.602015 10969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:50.604295 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:50.606213 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:50.607161 10928 raft_consensus.cc:2468] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 8.
I20260709 12:26:50.608376 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad766f48812a4ddeb383179b1d84907b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:26:50.610379 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:50.616518 10892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:50.632467 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:50.639463 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:50.649201 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c913e527ff46578e084c41eab7bb9d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:50.651484 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:50.653216 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:50.653614 10929 raft_consensus.cc:2393] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 15: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:26:50.654964 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:50.656061 10927 raft_consensus.cc:2393] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 15: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
W20260709 12:26:50.657401 11588 consensus_peers.cc:597] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:50.658215 11588 consensus_peers.cc:597] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:50.658987 11588 leader_election.cc:336] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:26:50.661075 11588 leader_election.cc:336] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:50.661556 11588 leader_election.cc:304] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
W20260709 12:26:50.663934 11588 consensus_peers.cc:597] T ab816bcc6183447994a2cc013e46c5f8 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:50.665426 11588 leader_election.cc:336] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:50.665989 11588 leader_election.cc:304] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:26:50.668998 11589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:50.687531 15700 consensus_queue.cc:237] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:50.690025 15216 raft_consensus.cc:2749] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:26:50.689893 15612 raft_consensus.cc:2749] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:26:50.715157 15819 consensus_meta.cc:287] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040: Time spent flushing consensus metadata: real 0.551s	user 0.012s	sys 0.000s
I20260709 12:26:50.715902 15819 raft_consensus.cc:515] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:50.719414 15718 raft_consensus.cc:493] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:50.719707 15819 leader_election.cc:290] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 14 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:50.720336 15718 raft_consensus.cc:515] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:50.720950 15819 raft_consensus.cc:2804] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:26:50.721391 15819 raft_consensus.cc:493] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:50.721794 15819 raft_consensus.cc:3060] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:50.723167 15718 leader_election.cc:290] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:50.724872 15864 raft_consensus.cc:493] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:50.725569 15834 raft_consensus.cc:493] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:50.727535 15969 raft_consensus.cc:493] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
W20260709 12:26:50.775873 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 150238us
I20260709 12:26:50.728104 15995 raft_consensus.cc:2749] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:26:50.730820 16051 raft_consensus.cc:493] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:50.731038 15992 raft_consensus.cc:2749] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:50.738575 16017 raft_consensus.cc:493] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:50.740321 16113 consensus_queue.cc:1059] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:26:50.740635 16090 consensus_queue.cc:260] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:50.743317 16106 leader_election.cc:290] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 16 election: Requested vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:50.512398 16065 raft_consensus.cc:3060] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:26:50.748616 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 172675us
I20260709 12:26:50.729928 15925 raft_consensus.cc:493] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
W20260709 12:26:50.763346 11588 leader_election.cc:336] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:50.763186 15861 consensus_queue.cc:1059] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 12:26:50.764449 10968 leader_election.cc:304] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:50.784857 10926 raft_consensus.cc:2468] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 9.
W20260709 12:26:50.790912 10817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:50.791260 16039 raft_consensus.cc:493] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:50.792099 10817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:50.792335 16039 raft_consensus.cc:515] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:50.793804 16000 raft_consensus.cc:2804] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:26:50.794133 15834 raft_consensus.cc:515] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:50.793597 10968 leader_election.cc:304] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d
I20260709 12:26:50.794484 16000 raft_consensus.cc:493] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:50.791337 15861 raft_consensus.cc:3055] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:26:50.793644 15925 raft_consensus.cc:515] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:50.802081 15861 raft_consensus.cc:740] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:26:50.803874 15861 consensus_queue.cc:260] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:50.798787 16000 raft_consensus.cc:3060] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:50.824165 10820 leader_election.cc:304] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:50.797187 15969 raft_consensus.cc:515] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:50.824930 16090 raft_consensus.cc:3060] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:50.838131 11618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:50.810247 15864 raft_consensus.cc:515] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } }
I20260709 12:26:50.809599 16051 raft_consensus.cc:515] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:50.849206 11618 raft_consensus.cc:2468] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 16.
I20260709 12:26:50.849360 15867 raft_consensus.cc:2804] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:26:50.850026 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 56752.3us
I20260709 12:26:50.850426 15867 raft_consensus.cc:493] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
W20260709 12:26:50.852367 16100 consensus_meta.cc:287] T e3d9a61ecaf84695b70f8519ee57706f P 3c52e0825c02476e89d84da9bb849f5d: Time spent flushing consensus metadata: real 0.511s	user 0.012s	sys 0.006s
I20260709 12:26:50.863834 16039 leader_election.cc:290] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:50.866578 15834 leader_election.cc:290] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:50.870522 10921 raft_consensus.cc:2468] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 8.
I20260709 12:26:50.875238 11620 raft_consensus.cc:2468] T e3d9a61ecaf84695b70f8519ee57706f P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 9.
I20260709 12:26:50.875856 16137 raft_consensus.cc:2804] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:26:50.876673 16137 raft_consensus.cc:697] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 14 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:50.826676 16017 raft_consensus.cc:515] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:50.878098 16137 consensus_queue.cc:237] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:50.880066 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 116820us
W20260709 12:26:50.881102 11588 consensus_peers.cc:597] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:50.880992 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 83122.1us
I20260709 12:26:50.851238 10968 leader_election.cc:304] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:50.891028 15864 leader_election.cc:290] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265)
I20260709 12:26:50.851311 15867 raft_consensus.cc:3060] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:50.816848 15995 consensus_queue.cc:1059] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
W20260709 12:26:50.894964 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 43908.9us
I20260709 12:26:50.902663 15925 leader_election.cc:290] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:50.906301 11618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9331e5342644ca2bae19187b083a7d5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:50.907799 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:50.910629 16017 leader_election.cc:290] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:50.911924 15996 raft_consensus.cc:2804] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:50.912472 15996 raft_consensus.cc:493] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:50.912974 15996 raft_consensus.cc:3060] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:50.921185 15969 leader_election.cc:290] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:50.921555 15861 raft_consensus.cc:3060] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:50.941854 16099 consensus_queue.cc:1059] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:26:50.943878 16087 raft_consensus.cc:3055] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:26:50.943746 11616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63ecfc9bd3945818cfe15c03f001315" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:50.944576 16087 raft_consensus.cc:740] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
W20260709 12:26:50.944947 11588 leader_election.cc:336] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:50.946686 16107 raft_consensus.cc:3055] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:26:50.946273 16087 consensus_queue.cc:260] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:50.947377 16107 raft_consensus.cc:740] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:50.948375 16087 raft_consensus.cc:3060] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:50.949738 16107 consensus_queue.cc:260] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:50.952036 16051 leader_election.cc:290] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:50.952021 16107 raft_consensus.cc:3060] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:26:50.952152 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 66519.6us
I20260709 12:26:50.956703 10895 leader_election.cc:304] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:50.956943 11621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352aa49c65194abbb863d7553a091f11" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:50.957858 11621 raft_consensus.cc:3060] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:50.958027 16098 raft_consensus.cc:2804] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:50.958678 10895 leader_election.cc:304] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:50.960063 16051 raft_consensus.cc:2749] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:26:50.962164 15718 raft_consensus.cc:3055] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:26:50.962777 15718 raft_consensus.cc:740] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:50.944993 11616 raft_consensus.cc:2468] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 7.
W20260709 12:26:50.967476 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 249925us
I20260709 12:26:50.967549 10969 leader_election.cc:304] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:50.969000 15992 raft_consensus.cc:3055] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:26:50.969660 15992 raft_consensus.cc:740] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:50.964238 15718 consensus_queue.cc:260] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:50.971258 15992 consensus_queue.cc:260] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:50.974814 15718 raft_consensus.cc:3060] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:50.978861 16051 consensus_queue.cc:1048] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:26:50.958778 16098 raft_consensus.cc:493] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:50.981356 16098 raft_consensus.cc:3060] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:50.984862 15992 raft_consensus.cc:3060] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:26:50.947499 11588 leader_election.cc:336] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:51.000991 15700 raft_consensus.cc:493] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:51.002606 15700 raft_consensus.cc:515] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:51.001261 10750 catalog_manager.cc:5697] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 8 to 11, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 11 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } }
I20260709 12:26:51.005278 15700 leader_election.cc:290] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
W20260709 12:26:51.009037 11589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:51.010756 16000 raft_consensus.cc:515] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:51.011713 16068 raft_consensus.cc:2804] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:26:50.994952 16051 raft_consensus.cc:493] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:51.004611 10750 catalog_manager.cc:5697] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 10 to 12, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 12 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
W20260709 12:26:51.024549 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:51.025808 16059 consensus_meta.cc:287] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d: Time spent flushing consensus metadata: real 0.789s	user 0.014s	sys 0.010s
W20260709 12:26:51.026357 11586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:51.031592 16021 raft_consensus.cc:493] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:51.038364 16021 raft_consensus.cc:515] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:51.015427 16068 raft_consensus.cc:493] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:51.034197 10894 leader_election.cc:336] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Timed out: RequestConsensusVote RPC to 127.9.116.65:46265 timed out after 2.184s (SENT)
I20260709 12:26:51.043056 11621 raft_consensus.cc:2468] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 6.
W20260709 12:26:51.043655 10817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:51.039800 16068 raft_consensus.cc:3060] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:51.052472 10895 leader_election.cc:304] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:51.056088 10969 leader_election.cc:304] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:51.057523 15864 raft_consensus.cc:2804] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:51.058207 15864 raft_consensus.cc:697] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:26:51.056169 15834 raft_consensus.cc:493] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:51.059345 15864 consensus_queue.cc:237] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:51.060564 15834 raft_consensus.cc:515] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:51.063200 15834 leader_election.cc:290] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:26:51.066193 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 118823us
W20260709 12:26:51.072203 11588 consensus_peers.cc:597] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:51.039800 16051 raft_consensus.cc:515] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:51.060087 10750 catalog_manager.cc:5697] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 2 to 4, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 4 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:51.075822 15969 raft_consensus.cc:493] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:51.076566 15969 raft_consensus.cc:515] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:51.076989 10895 leader_election.cc:304] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:51.077081 16051 leader_election.cc:290] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
W20260709 12:26:51.078248 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 79422us
I20260709 12:26:51.078959 15969 leader_election.cc:290] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:51.081000 16125 raft_consensus.cc:2764] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:26:51.083127 16000 leader_election.cc:290] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:51.086784 15969 consensus_queue.cc:1048] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:26:51.089423 16125 consensus_queue.cc:1048] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:26:51.092172 10895 leader_election.cc:304] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:51.094277 16098 raft_consensus.cc:515] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:51.097203 16098 leader_election.cc:290] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 election: Requested vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:51.103968 15969 raft_consensus.cc:2749] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:51.105628 10895 leader_election.cc:304] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:51.105479 15969 consensus_queue.cc:1048] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:26:51.107060 16125 raft_consensus.cc:2804] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:26:51.107751 16125 raft_consensus.cc:697] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 12 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
W20260709 12:26:51.108538 11588 consensus_peers.cc:597] T e9331e5342644ca2bae19187b083a7d5 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:51.109380 11588 consensus_peers.cc:597] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:51.108929 16125 consensus_queue.cc:237] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:51.110272 11588 consensus_peers.cc:597] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:51.113986 10895 leader_election.cc:304] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:51.115947 16098 raft_consensus.cc:2749] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:26:51.119990 10892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:51.051163 15819 raft_consensus.cc:515] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:51.123483 10895 leader_election.cc:304] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:51.125293 16051 raft_consensus.cc:2804] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:26:51.125921 16051 raft_consensus.cc:493] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:51.127038 16051 raft_consensus.cc:3060] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:26:51.128986 16142 log.cc:927] Time spent T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:26:51.130407 16065 raft_consensus.cc:2804] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:51.131052 16065 raft_consensus.cc:493] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:51.131490 16065 raft_consensus.cc:3060] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:51.134174 10750 catalog_manager.cc:5697] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 10 to 12, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 12 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:51.141342 15996 raft_consensus.cc:515] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:51.148483 15996 leader_election.cc:290] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 14 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:51.149317 16021 leader_election.cc:290] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:51.149541 11621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18294423a68a4671bf6c5a0f98645e4c" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:51.142815 16098 raft_consensus.cc:493] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:51.176653 16098 raft_consensus.cc:515] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } }
I20260709 12:26:51.179253 16098 leader_election.cc:290] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265)
I20260709 12:26:51.175541 11621 raft_consensus.cc:2468] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 7.
I20260709 12:26:51.175944 15819 leader_election.cc:290] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 election: Requested vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:51.159967 10895 leader_election.cc:304] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:51.181197 10750 catalog_manager.cc:5697] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 9 to 11, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 11 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
W20260709 12:26:51.184754 10894 leader_election.cc:336] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Timed out: RequestConsensusVote RPC to 127.9.116.65:46265 timed out after 2.234s (SENT)
I20260709 12:26:51.187654 10969 leader_election.cc:304] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:51.189577 16021 raft_consensus.cc:2804] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:26:51.190135 16021 raft_consensus.cc:493] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:51.190579 16021 raft_consensus.cc:3060] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:51.192066 16098 raft_consensus.cc:2804] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:26:51.193364 11621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18294423a68a4671bf6c5a0f98645e4c" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:51.194140 11621 raft_consensus.cc:2468] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 7.
I20260709 12:26:51.193214 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18294423a68a4671bf6c5a0f98645e4c" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:51.200820 11620 raft_consensus.cc:1275] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:26:51.202374 15969 raft_consensus.cc:493] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:51.202302 11617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:51.205082 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:51.205085 16125 raft_consensus.cc:493] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:51.209085 16125 raft_consensus.cc:515] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:51.209754 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:51.211616 16125 leader_election.cc:290] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:51.211269 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef3220c51df47db8859f07ab745fad5" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:51.212432 10968 leader_election.cc:304] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d
I20260709 12:26:51.213976 10968 leader_election.cc:304] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:51.203181 15969 raft_consensus.cc:515] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:51.216372 16090 raft_consensus.cc:2804] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:26:51.216929 16090 raft_consensus.cc:697] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 9 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:26:51.218670 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:51.218928 15861 raft_consensus.cc:2804] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:26:51.219702 10995 raft_consensus.cc:2468] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 8.
I20260709 12:26:51.218254 16090 consensus_queue.cc:237] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:51.220745 15969 leader_election.cc:290] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:51.221607 15925 raft_consensus.cc:493] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:51.222462 15925 raft_consensus.cc:515] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:51.224725 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:51.225301 15925 leader_election.cc:290] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:51.225692 11002 raft_consensus.cc:2468] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 8.
I20260709 12:26:51.226936 10994 raft_consensus.cc:2393] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 9: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:26:51.209451 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:26:51.228161 10969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:51.219731 15861 raft_consensus.cc:493] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:51.229507 15861 raft_consensus.cc:3060] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:26:51.232654 10817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:51.236297 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:51.203317 16098 raft_consensus.cc:697] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 15 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
W20260709 12:26:51.243353 10817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:51.202394 10750 catalog_manager.cc:5697] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } }
I20260709 12:26:51.155311 15867 raft_consensus.cc:515] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:51.244561 11620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef3220c51df47db8859f07ab745fad5" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
W20260709 12:26:51.250011 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 44278.2us
I20260709 12:26:51.253268 15925 raft_consensus.cc:493] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:51.254136 15925 raft_consensus.cc:515] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:51.257776 16125 raft_consensus.cc:493] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:51.258240 16130 raft_consensus.cc:493] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:51.258654 11621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:51.258838 16125 raft_consensus.cc:515] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:51.259204 16130 raft_consensus.cc:515] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:51.267001 16125 leader_election.cc:290] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:51.267421 16130 leader_election.cc:290] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:51.270234 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:51.271121 10928 raft_consensus.cc:2468] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 11.
I20260709 12:26:51.271437 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:51.274400 16051 raft_consensus.cc:515] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:51.261652 15996 raft_consensus.cc:493] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:51.277143 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c913e527ff46578e084c41eab7bb9d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:51.277305 15996 raft_consensus.cc:515] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:51.278410 16051 leader_election.cc:290] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:51.280874 16065 raft_consensus.cc:515] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 17 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:51.283623 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:51.284497 10927 raft_consensus.cc:1240] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Rejecting Update request from peer 3c52e0825c02476e89d84da9bb849f5d for earlier term 8. Current term is 9. Ops: []
I20260709 12:26:51.285946 16021 raft_consensus.cc:515] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:51.287374 11621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:51.289182 11000 raft_consensus.cc:2368] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for earlier term 7. Current term is 8.
W20260709 12:26:51.289284 10817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:51.290104 10968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:51.286926 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:51.287374 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:51.287850 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:51.292140 10929 raft_consensus.cc:2468] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 8.
I20260709 12:26:51.312608 10920 raft_consensus.cc:1240] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 10. Current term is 11. Ops: []
I20260709 12:26:51.313478 10928 raft_consensus.cc:2393] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3c52e0825c02476e89d84da9bb849f5d in current term 17: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:26:51.328672 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:51.333336 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b17195a94142039c40f598ed006c94" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:51.336418 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac83709373b4efd9c3aa1472a9f9022" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:51.337365 10926 raft_consensus.cc:3060] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:51.340122 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:51.340739 10895 leader_election.cc:304] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:51.342036 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:51.342921 10920 raft_consensus.cc:2468] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 9.
I20260709 12:26:51.346015 10895 leader_election.cc:304] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:51.347057 16125 consensus_queue.cc:1048] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:26:51.354969 16051 raft_consensus.cc:2804] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:26:51.355470 16051 raft_consensus.cc:493] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:51.355861 16051 raft_consensus.cc:3060] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:51.356106 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:51.358359 10895 leader_election.cc:304] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:51.359867 15969 raft_consensus.cc:2749] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:26:51.360517 10894 consensus_peers.cc:597] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:51.360878 15969 raft_consensus.cc:2749] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:26:51.364128 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:51.364595 10895 leader_election.cc:304] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:51.365770 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18294423a68a4671bf6c5a0f98645e4c" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:51.366076 10895 leader_election.cc:304] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:51.370002 10895 leader_election.cc:304] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:51.288520 16065 leader_election.cc:290] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 17 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:51.389060 10924 raft_consensus.cc:2393] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 13: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:26:51.391736 15726 raft_consensus.cc:2804] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:26:51.392308 15726 raft_consensus.cc:493] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:51.392746 15726 raft_consensus.cc:3060] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:51.396348 11620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:51.398288 11620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:51.399443 11002 raft_consensus.cc:3060] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:51.283105 15861 raft_consensus.cc:515] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:51.383864 16125 raft_consensus.cc:2804] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:26:51.408465 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:51.409247 10922 raft_consensus.cc:1240] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 14 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 13. Current term is 14. Ops: []
I20260709 12:26:51.401381 10750 catalog_manager.cc:5697] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 12 to 13, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 13 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:51.414453 11003 raft_consensus.cc:1240] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 14 FOLLOWER]: Rejecting Update request from peer 3c52e0825c02476e89d84da9bb849f5d for earlier term 13. Current term is 14. Ops: []
I20260709 12:26:51.461982 10895 leader_election.cc:400] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 pre-election: Vote denied by peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945) with higher term. Message: Invalid argument: T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for earlier term 7. Current term is 8.
W20260709 12:26:51.462961 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 72082.8us
I20260709 12:26:51.465879 11621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:51.457047 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:51.470184 10924 raft_consensus.cc:1240] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 7. Current term is 8. Ops: []
I20260709 12:26:51.410843 16017 raft_consensus.cc:2749] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:51.477834 15861 leader_election.cc:290] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:51.479305 11616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fd8fdac2fa449e9e184f3d668ea1a7" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:51.481782 11620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac8522e549a46e09593fa4c2e175557" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:51.487442 10750 catalog_manager.cc:5697] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:26:51.494628 11586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:51.499280 15718 raft_consensus.cc:493] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:51.500394 15718 raft_consensus.cc:515] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:51.503479 15819 raft_consensus.cc:493] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:51.504261 15819 raft_consensus.cc:515] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:51.500347 10819 leader_election.cc:304] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:51.507074 16087 raft_consensus.cc:2804] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:51.504170 16137 raft_consensus.cc:493] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:51.503746 16107 raft_consensus.cc:493] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:51.508062 16137 raft_consensus.cc:515] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:51.508275 16107 raft_consensus.cc:515] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:51.507493 16087 raft_consensus.cc:493] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:51.510638 16137 leader_election.cc:290] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:51.511946 16087 raft_consensus.cc:3060] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:51.503551 15718 leader_election.cc:290] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:51.507493 15819 leader_election.cc:290] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:51.510614 16107 leader_election.cc:290] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:51.521493 10926 raft_consensus.cc:2468] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 8.
I20260709 12:26:51.523918 10968 leader_election.cc:304] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:51.390952 15925 leader_election.cc:290] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:51.406114 15996 leader_election.cc:290] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:51.425516 16125 raft_consensus.cc:493] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:51.531934 10750 catalog_manager.cc:5697] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 10 to 12, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 12 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } }
I20260709 12:26:51.538064 10895 leader_election.cc:304] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:51.531049 10968 leader_election.cc:304] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:51.539414 11588 leader_election.cc:304] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:51.548158 15925 raft_consensus.cc:2749] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:26:51.552502 16039 raft_consensus.cc:2804] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:26:51.553022 16039 raft_consensus.cc:493] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:51.553449 16039 raft_consensus.cc:3060] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:51.556170 15726 raft_consensus.cc:515] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:51.541834 15834 raft_consensus.cc:2804] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:26:51.557787 15834 raft_consensus.cc:493] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:51.558615 15834 raft_consensus.cc:3060] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:51.558032 11620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
W20260709 12:26:51.561195  9681 thread.cc:527] Waited for 2000ms trying to join with heartbeat (tid 10879)
I20260709 12:26:51.561022 11620 raft_consensus.cc:3060] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:51.550973 10750 catalog_manager.cc:5697] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 9 to 12, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 12 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:51.565624 10929 raft_consensus.cc:1240] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 8. Current term is 9. Ops: []
I20260709 12:26:51.559851 15726 leader_election.cc:290] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:51.540868 15861 raft_consensus.cc:493] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:51.541656 15969 raft_consensus.cc:493] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:51.515486 16137 consensus_queue.cc:1059] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 12:26:51.546526 16125 raft_consensus.cc:3060] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:51.460222 16068 raft_consensus.cc:515] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:51.549191 16000 raft_consensus.cc:493] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:51.576604 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:51.582204 10927 raft_consensus.cc:3060] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:51.582222 10750 catalog_manager.cc:5697] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 4 to 6, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 6 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:51.542516 15864 consensus_queue.cc:1059] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:26:51.465307 16098 consensus_queue.cc:237] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:51.584409 16000 raft_consensus.cc:515] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:51.595410 10817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:51.606482 11621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b17195a94142039c40f598ed006c94" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:51.584151 15952 raft_consensus.cc:2749] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:51.599368 16000 leader_election.cc:290] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:51.620389 10750 catalog_manager.cc:5697] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 6 to 9, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 9 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:51.600559 16021 leader_election.cc:290] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:51.610184 15861 raft_consensus.cc:515] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:51.614316 15867 leader_election.cc:290] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 14 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:51.582412 15969 raft_consensus.cc:515] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:51.639183 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:51.634064 10894 leader_election.cc:336] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:51.631371 15864 raft_consensus.cc:3055] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:26:51.643430 10894 leader_election.cc:304] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:26:51.662464 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 170777us
I20260709 12:26:51.672034 10820 leader_election.cc:304] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:51.677311 15861 leader_election.cc:290] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
W20260709 12:26:51.682662 16149 log.cc:927] Time spent T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:26:51.686528 11620 raft_consensus.cc:2468] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 17.
I20260709 12:26:51.675390 15834 raft_consensus.cc:515] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } }
I20260709 12:26:51.683436 10927 raft_consensus.cc:2468] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 9.
I20260709 12:26:51.694916 10895 leader_election.cc:304] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:51.698540 15969 leader_election.cc:290] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
W20260709 12:26:51.699887 10817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:51.637509 10750 catalog_manager.cc:5697] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:51.652537 15864 raft_consensus.cc:740] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
W20260709 12:26:51.704385 10969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:51.706383 10750 catalog_manager.cc:5697] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 10 to 12, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 12 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:51.719604 11620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:51.730679 11618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18294423a68a4671bf6c5a0f98645e4c" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:51.731710 11618 raft_consensus.cc:3060] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:51.731777 11002 raft_consensus.cc:2468] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 8.
I20260709 12:26:51.734298 10895 leader_election.cc:304] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:51.734618 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:51.735529 10998 raft_consensus.cc:3060] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:26:51.737804 10817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:51.746743 10895 leader_election.cc:304] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:26:51.739408 10892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:51.756348 11620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:51.760305 15925 raft_consensus.cc:2749] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:51.765483 11620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
W20260709 12:26:51.777398 10817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:51.779079 11619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:51.737032 15969 raft_consensus.cc:2804] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:26:51.686594 16087 raft_consensus.cc:515] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:51.781517 15864 consensus_queue.cc:260] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:51.713879 15834 leader_election.cc:290] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265)
I20260709 12:26:51.784338 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
W20260709 12:26:51.786342 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 152318us
W20260709 12:26:51.800046 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 253094us
W20260709 12:26:51.800484 10894 leader_election.cc:336] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:51.800941 10894 leader_election.cc:304] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:51.786820 16107 raft_consensus.cc:2749] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:26:51.790938 10924 raft_consensus.cc:1240] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 7. Current term is 8. Ops: []
I20260709 12:26:51.738914 16017 raft_consensus.cc:2749] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:26:51.773994 15726 raft_consensus.cc:2749] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:26:51.822686 11624 raft_consensus.cc:2468] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 12.
I20260709 12:26:51.832427 15969 raft_consensus.cc:697] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 17 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:51.826530 16051 raft_consensus.cc:515] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:51.833350 15726 raft_consensus.cc:2749] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:26:51.833613 15969 consensus_queue.cc:237] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:51.834940 16051 leader_election.cc:290] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 election: Requested vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:51.835393 10923 raft_consensus.cc:2468] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 7.
I20260709 12:26:51.825538 16039 raft_consensus.cc:515] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:51.836323 15700 raft_consensus.cc:493] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:51.837155 15700 raft_consensus.cc:515] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:51.838860 16039 leader_election.cc:290] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 10 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:51.835762 15992 raft_consensus.cc:493] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:51.849642 15992 raft_consensus.cc:515] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:51.850252 16068 leader_election.cc:290] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:51.851179 11618 raft_consensus.cc:2468] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 8.
I20260709 12:26:51.852273 10998 raft_consensus.cc:2468] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 9.
I20260709 12:26:51.852519 15992 leader_election.cc:290] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:51.853454 15992 consensus_queue.cc:1059] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:26:51.841614 16087 leader_election.cc:290] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:51.855306 16087 raft_consensus.cc:3055] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:26:51.826504 10968 leader_election.cc:304] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:51.855795 16087 raft_consensus.cc:740] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:51.857110 16087 consensus_queue.cc:260] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:51.858538 15996 raft_consensus.cc:2804] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:26:51.842527 15700 leader_election.cc:290] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:51.859200 15996 raft_consensus.cc:697] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:26:51.860574 15996 consensus_queue.cc:237] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:51.861886 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 189981us
I20260709 12:26:51.864950 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:51.865852 10820 leader_election.cc:304] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:51.864885 10968 leader_election.cc:304] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:51.874857 15718 raft_consensus.cc:3055] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:26:51.876245 16068 raft_consensus.cc:2804] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:26:51.877220 16068 raft_consensus.cc:697] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 9 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:26:51.878352 16068 consensus_queue.cc:237] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:51.879979 15864 raft_consensus.cc:3060] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:51.836387 10924 raft_consensus.cc:1240] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 8. Current term is 9. Ops: []
I20260709 12:26:51.875488 15718 raft_consensus.cc:740] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
W20260709 12:26:51.912039 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 46300us
I20260709 12:26:51.899317 16137 raft_consensus.cc:2804] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:26:51.821683 15819 consensus_queue.cc:1059] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.105s
I20260709 12:26:51.942983 11620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
W20260709 12:26:51.921967 10925 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.029s	sys 0.073s
W20260709 12:26:51.949276 10925 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.029s	sys 0.073s
I20260709 12:26:51.966096 10969 leader_election.cc:304] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
W20260709 12:26:51.974639 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 215641us
I20260709 12:26:51.981979 10895 leader_election.cc:304] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:51.984313 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63ecfc9bd3945818cfe15c03f001315" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:51.985378 11623 raft_consensus.cc:3060] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:26:51.988955 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 162113us
I20260709 12:26:51.992445 10920 raft_consensus.cc:1240] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 15 LEADER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 14. Current term is 15. Ops: []
I20260709 12:26:51.998350 10820 leader_election.cc:304] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
W20260709 12:26:51.998181 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 197707us
I20260709 12:26:51.977195 16137 raft_consensus.cc:697] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 12 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:51.990927 16039 raft_consensus.cc:2804] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:26:52.002645 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 117195us
W20260709 12:26:52.000783 10894 leader_election.cc:336] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:52.009351 10894 leader_election.cc:304] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:26:52.013772 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 209957us
W20260709 12:26:52.025694 11588 leader_election.cc:336] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:52.027932 11588 leader_election.cc:304] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:52.015705 16039 raft_consensus.cc:697] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [term 8 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:26:52.016391 16011 consensus_queue.cc:1059] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 12:26:52.036681 16039 consensus_queue.cc:237] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:52.041451 10968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:52.045899 10817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:52.047845 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 64125.9us
I20260709 12:26:52.048915 10895 leader_election.cc:304] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:52.016858 16165 raft_consensus.cc:2804] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:26:52.056282 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 55539.9us
W20260709 12:26:52.060000 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 73291.8us
I20260709 12:26:52.061247 10820 leader_election.cc:304] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:52.060281 10998 raft_consensus.cc:1240] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Rejecting Update request from peer 3c52e0825c02476e89d84da9bb849f5d for earlier term 9. Current term is 10. Ops: []
I20260709 12:26:52.066879 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:52.038479 15700 raft_consensus.cc:2749] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:26:52.070262 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:52.081337 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:26:52.070232 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 55260.4us
W20260709 12:26:52.058409 10894 leader_election.cc:336] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:26:52.087791 11588 consensus_peers.cc:597] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:52.094233 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:52.098248 16060 raft_consensus.cc:2749] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:52.010655 15718 consensus_queue.cc:260] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:52.101276 10800 auto_rebalancer.cc:629] Failed to schedule move for tablet 24c913e527ff46578e084c41eab7bb9d: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:26:52.089407 16165 raft_consensus.cc:697] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:52.142792 11617 raft_consensus.cc:1275] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:26:52.147475 10920 raft_consensus.cc:1275] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:26:52.103881 15700 consensus_queue.cc:1059] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:26:52.160777 11620 raft_consensus.cc:1275] T e3d9a61ecaf84695b70f8519ee57706f P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 12:26:52.132799 11588 leader_election.cc:336] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:52.162439 11588 leader_election.cc:304] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:52.156176 16059 consensus_queue.cc:1059] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 12:26:52.167277 16098 raft_consensus.cc:2804] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:26:52.168089 16098 raft_consensus.cc:697] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 9 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:52.169329 16098 consensus_queue.cc:237] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:52.121174 15718 raft_consensus.cc:3060] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:52.125087 16130 raft_consensus.cc:2749] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:26:52.180581 10969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:52.188120 10817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:52.202977 16157 raft_consensus.cc:493] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.203822 10921 raft_consensus.cc:1240] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 17 LEADER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 16. Current term is 17. Ops: []
I20260709 12:26:52.203852 16157 raft_consensus.cc:515] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:52.208300 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 80810.7us
I20260709 12:26:52.210250 11617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:52.207463 16157 leader_election.cc:290] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:52.217356 15900 raft_consensus.cc:2749] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:26:52.216135 10800 auto_rebalancer.cc:629] Failed to schedule move for tablet d5b6ea992cd64650b1c2da6c548d012f: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:26:52.218583 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 160203us
W20260709 12:26:52.222427 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 173584us
W20260709 12:26:52.224961 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 71266.1us
W20260709 12:26:52.222790 10894 leader_election.cc:336] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:26:52.228811 10968 leader_election.cc:336] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Timed out: RequestConsensusVote RPC to 127.9.116.65:46265 timed out after 1.609s (SENT)
I20260709 12:26:52.229606 10895 leader_election.cc:304] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:52.231627 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18294423a68a4671bf6c5a0f98645e4c" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:52.232218 10920 raft_consensus.cc:3060] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:52.232311 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:26:52.233729 10817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:52.233009 10925 raft_consensus.cc:2468] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 14.
I20260709 12:26:52.236696 11617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18294423a68a4671bf6c5a0f98645e4c" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:52.239264 10998 raft_consensus.cc:1275] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:26:52.242654 11617 raft_consensus.cc:2368] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for earlier term 7. Current term is 8.
I20260709 12:26:52.247313 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:52.150750 16137 consensus_queue.cc:237] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:52.249349 10925 raft_consensus.cc:1240] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 10. Current term is 11. Ops: []
I20260709 12:26:52.250478 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18294423a68a4671bf6c5a0f98645e4c" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:52.251298 10923 raft_consensus.cc:1275] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:26:52.198091 16090 consensus_queue.cc:1048] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:26:52.253052 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
W20260709 12:26:52.232018 16125 consensus_meta.cc:287] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent flushing consensus metadata: real 0.640s	user 0.011s	sys 0.002s
W20260709 12:26:52.260427 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 199345us
I20260709 12:26:52.258203 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
W20260709 12:26:52.265267 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 44904.7us
W20260709 12:26:52.280019 10800 auto_rebalancer.cc:629] Failed to schedule move for tablet c72fddfc26044838a71a798f3371636b: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:26:52.292145 10969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:52.285800 10894 leader_election.cc:336] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:52.236697 16166 consensus_queue.cc:1059] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 12:26:52.303167 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:52.312825 10927 raft_consensus.cc:2468] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 10.
I20260709 12:26:52.287554 16175 raft_consensus.cc:2749] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:52.287384 16172 raft_consensus.cc:2804] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:52.268081 16125 raft_consensus.cc:515] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } }
I20260709 12:26:52.301050 16011 raft_consensus.cc:493] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
W20260709 12:26:52.353658 10892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:52.356942 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 79512.5us
I20260709 12:26:52.332633 10820 leader_election.cc:304] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
W20260709 12:26:52.346585 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 123616us
I20260709 12:26:52.313999 16090 raft_consensus.cc:493] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.348620 15700 raft_consensus.cc:3055] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:26:52.377753 10922 raft_consensus.cc:1240] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 8. Current term is 9. Ops: []
I20260709 12:26:52.347041 16172 raft_consensus.cc:493] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:52.401801 16087 raft_consensus.cc:3060] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:52.362705 16011 raft_consensus.cc:515] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:52.405817 16011 leader_election.cc:290] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:26:52.406400 10818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:52.384378 16090 raft_consensus.cc:515] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:52.409297 15819 consensus_queue.cc:1048] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:26:52.410126 16090 leader_election.cc:290] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:52.410948 15830 raft_consensus.cc:3055] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:26:52.275910 16165 consensus_queue.cc:237] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:52.426512 10920 raft_consensus.cc:2468] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 8.
I20260709 12:26:52.413252 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:26:52.411612 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 107176us
I20260709 12:26:52.411170 15819 raft_consensus.cc:2749] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:26:52.416129 16172 raft_consensus.cc:3060] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:52.431003 10995 raft_consensus.cc:2468] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 10.
W20260709 12:26:52.479559 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 157590us
I20260709 12:26:52.366494 15700 raft_consensus.cc:740] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
W20260709 12:26:52.485711 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:52.498536 10817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:52.499058 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 52599us
I20260709 12:26:52.364763 16176 consensus_queue.cc:1048] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.167s
I20260709 12:26:52.411429 15830 raft_consensus.cc:740] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
I20260709 12:26:52.541707 10895 leader_election.cc:400] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 election: Vote denied by peer 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613) with higher term. Message: Invalid argument: T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for earlier term 7. Current term is 8.
I20260709 12:26:52.542289 10895 leader_election.cc:403] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
W20260709 12:26:52.551496 11623 consensus_meta.cc:287] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d: Time spent flushing consensus metadata: real 0.563s	user 0.010s	sys 0.003s
I20260709 12:26:52.552083 11623 raft_consensus.cc:2468] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 8.
I20260709 12:26:52.536641 10968 leader_election.cc:304] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d
I20260709 12:26:52.560819 10968 leader_election.cc:304] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
W20260709 12:26:52.561710  9681 thread.cc:527] Waited for 3000ms trying to join with heartbeat (tid 10879)
I20260709 12:26:52.384723 16177 consensus_queue.cc:1059] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.144s
I20260709 12:26:52.582185 10968 leader_election.cc:304] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
W20260709 12:26:52.630671 10894 consensus_peers.cc:597] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:52.631296 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 58259.5us
W20260709 12:26:52.632215 10894 consensus_peers.cc:597] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:52.592535 11002 raft_consensus.cc:1275] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 15 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 12:26:52.650755 10817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:52.556180 15819 raft_consensus.cc:493] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.568416 16090 raft_consensus.cc:2804] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:52.574888 16157 raft_consensus.cc:2749] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:26:52.630040 16107 raft_consensus.cc:3055] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:26:52.628154 16039 consensus_queue.cc:1048] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.125s
W20260709 12:26:52.768923 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 269584us
I20260709 12:26:52.538568 15700 consensus_queue.cc:260] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:52.732108 10894 consensus_peers.cc:597] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:52.771371 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 138149us
W20260709 12:26:52.772725 10817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:52.691371 16155 log.cc:927] Time spent T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 12:26:52.672232 15996 raft_consensus.cc:2749] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:26:52.532696 16183 raft_consensus.cc:493] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:52.772675 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 270040us
I20260709 12:26:52.752197 16173 raft_consensus.cc:2749] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613) with higher term. Message: Invalid argument: T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for earlier term 7. Current term is 8.
I20260709 12:26:52.746112 16090 raft_consensus.cc:493] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:52.756496 16107 raft_consensus.cc:740] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:52.793071 11589 leader_election.cc:304] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
W20260709 12:26:52.774288 16181 log.cc:927] Time spent T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.406s	user 0.004s	sys 0.000s
I20260709 12:26:52.775643 16125 leader_election.cc:290] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 election: Requested vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265)
W20260709 12:26:52.812975 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 227992us
I20260709 12:26:52.831305 10968 leader_election.cc:304] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
W20260709 12:26:52.831463 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 58721.9us
I20260709 12:26:52.752092 15819 raft_consensus.cc:515] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:52.770309 16177 consensus_queue.cc:1243] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer e2d5c637307a407ab688f5ccd6f0fcea log is divergent from this leader: its last log entry 15.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:26:52.813338 16090 raft_consensus.cc:3060] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:26:52.833776 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 292374us
W20260709 12:26:52.852794 10817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:52.868836 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 370936us
I20260709 12:26:52.875469 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:52.834753 15996 raft_consensus.cc:493] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.835687 16191 raft_consensus.cc:493] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.904870 16191 raft_consensus.cc:515] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:52.909211 16191 leader_election.cc:290] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:52.876394 10924 raft_consensus.cc:2393] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3c52e0825c02476e89d84da9bb849f5d in current term 10: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:26:52.876365 10997 raft_consensus.cc:1240] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 14 FOLLOWER]: Rejecting Update request from peer 3c52e0825c02476e89d84da9bb849f5d for earlier term 13. Current term is 14. Ops: []
I20260709 12:26:52.904721 15996 raft_consensus.cc:515] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:52.915140 10894 leader_election.cc:336] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:26:52.915916 16192 log.cc:927] Time spent T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 12:26:52.917649 10928 raft_consensus.cc:1275] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:26:52.931669 10922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59626 (request call id 3766) took 1573 ms. Trace:
I20260709 12:26:52.932407 10922 rpcz_store.cc:276] 0709 12:26:51.351736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:51.461355 (+109619us) service_pool.cc:224] Handling call
0709 12:26:51.475722 (+ 14367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:52.384803 (+909081us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:52.924879 (+540076us) spinlock_profiling.cc:243] Waited 901 ms on lock 0x7b54002869d4. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e88e01 00007f7594e8783e 00007f7599e4c419 00007f75933c3bd4 00007f75933c3b62 00007f75933c3a91 00007f75933c3a0c 00007f75933c2cc2 00007f75931c348c 00007f75931c28c6
0709 12:26:52.925133 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2072963456}
I20260709 12:26:52.924253 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:52.819559 16183 raft_consensus.cc:515] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:52.949517 10928 raft_consensus.cc:2468] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 14.
W20260709 12:26:52.943495 10817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:52.933241 10820 leader_election.cc:304] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:52.972549 10928 raft_consensus.cc:1275] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:26:52.989959 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 50003.4us
W20260709 12:26:53.015305 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:52.942798 16178 consensus_queue.cc:1048] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 12:26:52.957736 16191 consensus_queue.cc:1048] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.058s
I20260709 12:26:52.954387 16107 consensus_queue.cc:260] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:53.076642 16166 raft_consensus.cc:2749] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:26:53.088346 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 155255us
W20260709 12:26:53.096130 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 100553us
I20260709 12:26:53.080054 16051 raft_consensus.cc:493] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:53.106499 16208 raft_consensus.cc:2804] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:26:53.111706 16160 log.cc:927] Time spent T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:26:53.094993 16028 raft_consensus.cc:2804] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:26:53.119786 16193 log.cc:927] Time spent T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
W20260709 12:26:53.120824 16159 log.cc:927] Time spent T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 1.084s	user 0.006s	sys 0.003s
I20260709 12:26:53.125100 16163 raft_consensus.cc:3055] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:26:53.127060 16168 log.cc:927] Time spent T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.961s	user 0.004s	sys 0.003s
W20260709 12:26:53.127760 16190 log.cc:927] Time spent T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.292s	user 0.001s	sys 0.001s
W20260709 12:26:53.128872 10817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:53.104971 16107 raft_consensus.cc:3060] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:53.135074 16183 leader_election.cc:290] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:53.136288 15819 leader_election.cc:290] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:53.140323 15996 leader_election.cc:290] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:26:53.144213 16186 log.cc:927] Time spent T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.729s	user 0.004s	sys 0.001s
I20260709 12:26:53.153457 10921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59626 (request call id 3771) took 1403 ms. Trace:
W20260709 12:26:53.140136 16217 log.cc:927] Time spent T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:26:53.200894 16163 raft_consensus.cc:740] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
I20260709 12:26:53.206501 16090 raft_consensus.cc:515] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:53.210850 10968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:53.221547 16172 consensus_meta.cc:287] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea: Time spent flushing consensus metadata: real 0.783s	user 0.008s	sys 0.007s
I20260709 12:26:53.231451 10920 raft_consensus.cc:1240] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 LEADER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 7. Current term is 8. Ops: []
I20260709 12:26:53.191886 16051 raft_consensus.cc:515] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:53.192577 16028 raft_consensus.cc:493] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:53.222537 10921 rpcz_store.cc:276] 0709 12:26:51.749709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:51.775591 (+ 25882us) service_pool.cc:224] Handling call
0709 12:26:51.805336 (+ 29745us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:52.204512 (+399176us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:53.153089 (+948577us) spinlock_profiling.cc:243] Waited 398 ms on lock 0x7b540012cad4. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e88e01 00007f7594e8783e 00007f7599e4c419 00007f75933c3bd4 00007f75933c3b62 00007f75933c3a91 00007f75933c3a0c 00007f75933c2cc2 00007f75931c348c 00007f75931c28c6
0709 12:26:53.153361 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":915698944}
W20260709 12:26:53.219038 15718 consensus_meta.cc:287] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040: Time spent flushing consensus metadata: real 1.026s	user 0.015s	sys 0.001s
W20260709 12:26:53.230387 10968 leader_election.cc:336] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Timed out: RequestConsensusVote RPC to 127.9.116.65:46265 timed out after 1.918s (SENT)
I20260709 12:26:53.240059 10968 leader_election.cc:304] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
W20260709 12:26:53.199349 16087 consensus_meta.cc:287] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040: Time spent flushing consensus metadata: real 0.797s	user 0.014s	sys 0.000s
I20260709 12:26:53.243712 16216 consensus_queue.cc:1059] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 12:26:53.244969 16068 raft_consensus.cc:3060] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:53.247083 11001 raft_consensus.cc:1240] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 15 FOLLOWER]: Rejecting Update request from peer 3c52e0825c02476e89d84da9bb849f5d for earlier term 14. Current term is 15. Ops: []
I20260709 12:26:53.248248 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:53.216571 16178 raft_consensus.cc:493] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:53.253428 10968 leader_election.cc:336] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Timed out: RequestConsensusVote RPC to 127.9.116.65:46265 timed out after 1.781s (SENT)
W20260709 12:26:53.221632 15864 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.005s	sys 0.029s
I20260709 12:26:53.189649 16208 raft_consensus.cc:493] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:53.235230 16172 raft_consensus.cc:515] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:53.249321 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 332957us
I20260709 12:26:53.354382 11624 raft_consensus.cc:1275] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:26:53.478813 10894 leader_election.cc:336] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:53.249866 16166 raft_consensus.cc:493] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:53.280032 16189 log.cc:927] Time spent T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d: Append to log took a long time: real 0.587s	user 0.004s	sys 0.000s
I20260709 12:26:53.480715 16166 raft_consensus.cc:515] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:53.289860 10817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:53.482033 11616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45920 (request call id 989) took 1222 ms. Trace:
W20260709 12:26:53.482227 10817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:53.483240 10817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:53.249315 16028 raft_consensus.cc:3060] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:26:53.437582 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 81285us
W20260709 12:26:53.350577 10969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:53.492230 11588 leader_election.cc:336] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:53.492708 11588 leader_election.cc:304] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
W20260709 12:26:53.480090 10894 leader_election.cc:336] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:26:53.351284 10800 auto_rebalancer.cc:629] Failed to schedule move for tablet 266989ea58c040cea1d5f1b425ba2d3b: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:26:53.353744 11620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:53.488317 16208 raft_consensus.cc:3060] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:53.253039 16178 raft_consensus.cc:515] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:53.489355 10817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:53.348145 16180 log.cc:927] Time spent T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.942s	user 0.004s	sys 0.009s
I20260709 12:26:53.495167 10894 leader_election.cc:304] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:53.314260 15700 raft_consensus.cc:3060] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:26:53.325659 16201 log.cc:927] Time spent T 00000000000000000000000000000000 P 9619ad7a9e7f4d9b8039487e3ee77243: Append to log took a long time: real 0.270s	user 0.003s	sys 0.000s
I20260709 12:26:53.257361 10968 leader_election.cc:304] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:53.502525 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:53.507896 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:53.253332 16090 leader_election.cc:290] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 15 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:53.275219 16179 raft_consensus.cc:493] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:53.357132 16175 raft_consensus.cc:3055] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:26:53.506652 11588 consensus_peers.cc:597] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:53.352276 16182 raft_consensus.cc:3055] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:26:53.508526 10929 raft_consensus.cc:2468] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 8.
I20260709 12:26:53.508490 10926 raft_consensus.cc:2468] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 15.
I20260709 12:26:53.499513 10969 leader_election.cc:304] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
W20260709 12:26:53.491101 15864 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.800s	user 0.022s	sys 0.070s
I20260709 12:26:53.353534 15830 consensus_queue.cc:260] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:53.507385 16203 raft_consensus.cc:2749] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:53.511668 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:26:53.512002 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 258587us
I20260709 12:26:53.512567 16039 raft_consensus.cc:2749] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:53.529492 10819 leader_election.cc:304] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:53.530421 10819 leader_election.cc:304] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:53.531771 16177 raft_consensus.cc:2804] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:26:53.532177 16177 raft_consensus.cc:493] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:53.532508 16177 raft_consensus.cc:3060] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:53.534795 16107 raft_consensus.cc:2804] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:53.535254 16107 raft_consensus.cc:493] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:53.535647 16107 raft_consensus.cc:3060] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:53.527505 16090 raft_consensus.cc:2804] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:26:53.536584 16090 raft_consensus.cc:697] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:26:53.537825 16090 consensus_queue.cc:237] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:53.548923 16178 leader_election.cc:290] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:53.551192 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:53.553030 15830 raft_consensus.cc:3060] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:53.351760 16087 consensus_queue.cc:1059] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.162s
I20260709 12:26:53.514756 10996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37500 (request call id 4069) took 1051 ms. Trace:
I20260709 12:26:53.515060 16125 raft_consensus.cc:2749] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:26:53.505820 16228 consensus_queue.cc:1048] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
W20260709 12:26:53.516422 16233 log.cc:927] Time spent T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 12:26:53.493269 16051 leader_election.cc:290] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:53.513427 10925 raft_consensus.cc:1240] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 8. Current term is 9. Ops: []
I20260709 12:26:53.493247 15925 raft_consensus.cc:493] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:53.570232 15925 raft_consensus.cc:515] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:53.572713 15925 leader_election.cc:290] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
W20260709 12:26:53.524214 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 44131.9us
I20260709 12:26:53.482591 11616 rpcz_store.cc:276] 0709 12:26:52.260059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:52.262190 (+  2131us) service_pool.cc:224] Handling call
0709 12:26:52.291527 (+ 29337us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:26:52.302547 (+ 11020us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:52.302590 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:26:52.303394 (+   804us) log.cc:844] Serialized 52 byte log entry
0709 12:26:52.377418 (+ 74024us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:26:52.377487 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:52.377562 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:53.279258 (+901696us) spinlock_profiling.cc:243] Waited 6.45 ms on lock 0x7b4400022b4c. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7591c23db1 00007f7591cc1c85 00007f7591cc26a2 00007f7594a341db 00007f7594a2faaf 00007f7594a2386e 00007f7594a22bb6 00007f7594a227d8 00007f7594a2c221 00007f7594a2c1d9 00007f7594a2c169
0709 12:26:53.481714 (+202456us) raft_consensus.cc:1685] finished
0709 12:26:53.481742 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:53.481953 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24218,"raft.queue_time_us":8393,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":8974,"spinlock_wait_cycles":14844800,"thread_start_us":73449,"threads_started":1,"wal-append.queue_time_us":212072}
W20260709 12:26:53.528235 10968 leader_election.cc:336] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Timed out: RequestConsensusVote RPC to 127.9.116.65:46265 timed out after 1.953s (SENT)
I20260709 12:26:53.573819 10968 leader_election.cc:304] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040
W20260709 12:26:53.573870 10894 leader_election.cc:336] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:53.553960 11620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fd8fdac2fa449e9e184f3d668ea1a7" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:53.513262 10928 raft_consensus.cc:1217] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 15 LEADER]: Deduplicated request from leader. Original: 12.10->[14.11-14.11]   Dedup: 14.11->[]
I20260709 12:26:53.575182 10920 raft_consensus.cc:2468] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 13.
I20260709 12:26:53.556198 11617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9331e5342644ca2bae19187b083a7d5" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:53.556875 11618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352aa49c65194abbb863d7553a091f11" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:53.557556 11619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:53.555696 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab816bcc6183447994a2cc013e46c5f8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:53.558331 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
W20260709 12:26:53.562376  9681 thread.cc:527] Waited for 4000ms trying to join with heartbeat (tid 10879)
I20260709 12:26:53.560288 10996 rpcz_store.cc:276] 0709 12:26:52.283076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:52.295911 (+ 12835us) service_pool.cc:224] Handling call
0709 12:26:52.313192 (+ 17281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:52.319215 (+  6023us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:26:52.746299 (+427084us) log.cc:844] Serialized 14 byte log entry
0709 12:26:53.325800 (+579501us) spinlock_profiling.cc:243] Waited 1.27 ms on lock 0x7b1800388a20. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f759ac63ab1 00007f759ac70281 00007f7591d15c0a 00007f759b455219 00007f7591d9da40 00007f7591d984e4 00007f7591d98455 00007f75988803c7 00007f7594e929a7 00007f7594ea20bf 00007f7594ea2038
0709 12:26:53.326102 (+   302us) log.cc:844] Serialized 14 byte log entry
0709 12:26:53.334215 (+  8113us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:53.334293 (+    78us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:26:53.334367 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:53.334463 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:53.334619 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":310663,"prepare.queue_time_us":1214221,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":57,"raft.queue_time_us":32819,"raft.run_cpu_time_us":404,"raft.run_wall_time_us":7111,"spinlock_wait_cycles":2911616,"thread_start_us":655490,"threads_started":2,"wal-append.queue_time_us":447913}
I20260709 12:26:53.522214 16175 raft_consensus.cc:740] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:53.522915 16182 raft_consensus.cc:740] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:53.564908 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:53.570689 16087 consensus_queue.cc:1243] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer e2d5c637307a407ab688f5ccd6f0fcea log is divergent from this leader: its last log entry 17.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:26:53.350912 16191 consensus_queue.cc:1059] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.159s
I20260709 12:26:53.592895 16191 raft_consensus.cc:3055] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:26:53.593367 16191 raft_consensus.cc:740] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:53.594504 16191 consensus_queue.cc:260] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } }
I20260709 12:26:53.596513 16137 raft_consensus.cc:3055] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:26:53.597048 16137 raft_consensus.cc:740] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:53.575714 10928 raft_consensus.cc:1240] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 15 LEADER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 12:26:53.598038 16137 consensus_queue.cc:260] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:53.581565 16175 consensus_queue.cc:260] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:53.580021 15718 consensus_queue.cc:1059] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:26:53.600071 16175 raft_consensus.cc:3060] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:53.601924 16137 raft_consensus.cc:3060] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:26:53.602491 16167 log.cc:927] Time spent T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 1.434s	user 0.001s	sys 0.011s
I20260709 12:26:53.604326 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad766f48812a4ddeb383179b1d84907b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:53.606825 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c913e527ff46578e084c41eab7bb9d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:53.607838 16163 consensus_queue.cc:260] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:53.608963 16068 raft_consensus.cc:2749] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:53.609300 16163 raft_consensus.cc:3060] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:53.624270 16191 raft_consensus.cc:3060] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:26:53.636713 10819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:53.641822 16166 leader_election.cc:290] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:53.643548 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab816bcc6183447994a2cc013e46c5f8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:53.644527 16157 consensus_queue.cc:1048] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:26:53.645753 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:53.646759 16107 raft_consensus.cc:515] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:53.648757 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9331e5342644ca2bae19187b083a7d5" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:53.658104 10819 leader_election.cc:304] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:53.525414 16179 raft_consensus.cc:515] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:53.581483 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 53260.1us
W20260709 12:26:53.665294 10968 leader_election.cc:336] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Timed out: RequestConsensusVote RPC to 127.9.116.65:46265 timed out after 1.967s (SENT)
W20260709 12:26:53.583451 10894 consensus_peers.cc:597] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:53.665916 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 82542.2us
W20260709 12:26:53.666656 10894 leader_election.cc:336] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:53.667264 10894 leader_election.cc:304] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:53.586459 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:53.558419 16172 leader_election.cc:290] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 13 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:53.582556 16228 raft_consensus.cc:2749] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:26:53.598178 16229 log.cc:927] Time spent T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 12:26:53.668823 11000 raft_consensus.cc:2393] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 9: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:26:53.669926 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:53.679171 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352aa49c65194abbb863d7553a091f11" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:53.679198 11618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf2fcbf6a2d4432a846a1e5cfa1c52a" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:53.680866 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:53.682349 10927 raft_consensus.cc:3060] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:53.683938 11620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:53.683938 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:53.687894 10997 raft_consensus.cc:2393] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 10: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:26:53.690323 11618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5794ba618e514e28a7542ab6af39d8c9" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
W20260709 12:26:53.692487 10894 leader_election.cc:336] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:26:53.693343 10894 consensus_peers.cc:597] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:53.693786 10894 leader_election.cc:336] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:53.695395 11619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63ecfc9bd3945818cfe15c03f001315" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:53.695894 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d9a61ecaf84695b70f8519ee57706f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:53.670264 16175 raft_consensus.cc:2804] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:53.694087 10894 leader_election.cc:304] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:53.697923 11619 raft_consensus.cc:2393] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 in current term 8: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:26:53.705394 10997 raft_consensus.cc:1240] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 14 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:26:53.706571 15700 raft_consensus.cc:493] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:53.707037 16162 raft_consensus.cc:2749] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:53.707231 15700 raft_consensus.cc:515] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:53.709798 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:53.711303 10998 raft_consensus.cc:2393] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 14: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:26:53.712515 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:53.714041 15700 leader_election.cc:290] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:53.714345 11621 raft_consensus.cc:1275] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [term 17 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:26:53.703737 16172 raft_consensus.cc:493] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:53.715862 16172 raft_consensus.cc:515] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:53.718858 16172 leader_election.cc:290] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:53.720590 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c6d38c4d8a90a81975a6a0cb13" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:53.722884 16051 raft_consensus.cc:3060] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:53.726142 16107 leader_election.cc:290] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 16 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:53.728242 11615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:53.728542 11619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d9a61ecaf84695b70f8519ee57706f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:53.729082 11615 raft_consensus.cc:2468] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 14.
I20260709 12:26:53.709388 16125 raft_consensus.cc:493] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:53.730822 11003 raft_consensus.cc:1240] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 LEADER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 7. Current term is 8. Ops: []
I20260709 12:26:53.731953 10923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59626 (request call id 3780) took 1252 ms. Trace:
I20260709 12:26:53.732821 10994 raft_consensus.cc:1240] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 8. Current term is 9. Ops: []
I20260709 12:26:53.733811 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:53.734889 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:53.735984 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:53.737142 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 15 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:53.738183 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c6d38c4d8a90a81975a6a0cb13" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:53.740343 10995 raft_consensus.cc:1240] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 8. Current term is 9. Ops: []
I20260709 12:26:53.741463 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5794ba618e514e28a7542ab6af39d8c9" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:53.741817 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:53.743046 10995 raft_consensus.cc:1240] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 15 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 14. Current term is 15. Ops: []
I20260709 12:26:53.698385 16175 raft_consensus.cc:493] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:53.743818 16175 raft_consensus.cc:3060] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:53.744717 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:53.729152 11000 raft_consensus.cc:1240] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 7. Current term is 8. Ops: []
I20260709 12:26:53.744782 11618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:53.746914 11618 raft_consensus.cc:3060] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:53.730512 16125 raft_consensus.cc:515] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:53.748301 16177 raft_consensus.cc:515] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:53.749264 16125 leader_election.cc:290] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:53.751176 16177 leader_election.cc:290] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 10 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:26:53.763937 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 60858.6us
I20260709 12:26:53.765388 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:53.766189 11000 raft_consensus.cc:2468] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 12.
I20260709 12:26:53.768431 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:53.769248 11000 raft_consensus.cc:2468] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 9.
I20260709 12:26:53.768961 16028 raft_consensus.cc:515] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:53.751929 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 86665.8us
W20260709 12:26:53.773387 10968 leader_election.cc:336] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Timed out: RequestConsensusVote RPC to 127.9.116.65:46265 timed out after 2.078s (SENT)
W20260709 12:26:53.774762 10968 leader_election.cc:336] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Timed out: RequestConsensusVote RPC to 127.9.116.65:46265 timed out after 2.151s (SENT)
I20260709 12:26:53.752957 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63ecfc9bd3945818cfe15c03f001315" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:53.777014 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:53.756549 11618 raft_consensus.cc:2468] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 13.
I20260709 12:26:53.778266 16182 consensus_queue.cc:260] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:53.780139 16182 raft_consensus.cc:3060] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:53.781500 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:53.782447 11622 raft_consensus.cc:2468] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 10.
I20260709 12:26:53.757200 16179 leader_election.cc:290] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:53.745141 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:53.732316 10923 rpcz_store.cc:276] 0709 12:26:52.480002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:52.491029 (+ 11027us) service_pool.cc:224] Handling call
0709 12:26:52.515289 (+ 24260us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:53.003340 (+488051us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:53.003372 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:53.041355 (+ 37983us) log.cc:844] Serialized 26 byte log entry
0709 12:26:53.254595 (+213240us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:26:53.254639 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:53.254713 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:53.731751 (+477038us) raft_consensus.cc:1685] finished
0709 12:26:53.731773 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:53.731896 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29584,"raft.queue_time_us":94199,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":25547,"thread_start_us":568689,"threads_started":2,"wal-append.queue_time_us":440531}
I20260709 12:26:53.760618 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:53.788373 11002 raft_consensus.cc:2410] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:26:53.761047 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:53.762213 16165 raft_consensus.cc:493] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:53.789481 16107 raft_consensus.cc:493] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:53.790081 16107 raft_consensus.cc:515] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:53.790441 10998 raft_consensus.cc:2468] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 15.
I20260709 12:26:53.792979 16107 leader_election.cc:290] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:53.793710 16231 consensus_queue.cc:1059] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:26:53.794920 16231 raft_consensus.cc:3055] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:26:53.790076 16165 raft_consensus.cc:515] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:53.795328 16231 raft_consensus.cc:740] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
I20260709 12:26:53.798172 16165 leader_election.cc:290] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:53.796525 16231 consensus_queue.cc:260] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:53.794574 10894 leader_election.cc:336] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:53.800546 16231 raft_consensus.cc:3060] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:26:53.801249 10894 consensus_peers.cc:597] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:53.775282 10968 leader_election.cc:304] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:53.812323 11618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
W20260709 12:26:53.813014 10817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:53.819150 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:53.820082 11002 raft_consensus.cc:2468] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 11.
I20260709 12:26:53.826215 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:53.829430 11618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:53.830045 10927 raft_consensus.cc:2468] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 16.
I20260709 12:26:53.829798 11620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:53.831941 10819 leader_election.cc:304] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
W20260709 12:26:53.804494 10894 leader_election.cc:336] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:53.834000 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac83709373b4efd9c3aa1472a9f9022" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:53.836424 11618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 15 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:53.837376 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:26:53.834996 10894 leader_election.cc:336] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:53.831259 11620 raft_consensus.cc:2468] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 10.
I20260709 12:26:53.837404 10895 leader_election.cc:304] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:53.846527 11002 raft_consensus.cc:1240] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Rejecting Update request from peer 3c52e0825c02476e89d84da9bb849f5d for earlier term 9. Current term is 10. Ops: []
I20260709 12:26:53.827456 10923 raft_consensus.cc:2468] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 14.
I20260709 12:26:53.849745 11618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:53.850275 11620 raft_consensus.cc:1240] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d [term 13 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 12. Current term is 13. Ops: []
I20260709 12:26:53.851073 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:53.852326 11002 raft_consensus.cc:2468] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 11.
I20260709 12:26:53.854132 11618 raft_consensus.cc:1240] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [term 17 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 12:26:53.855991 11616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:53.856421 10895 leader_election.cc:304] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:53.835471 16068 raft_consensus.cc:2749] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:53.868884 11589 leader_election.cc:304] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:53.870098 16203 raft_consensus.cc:2804] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:53.870445 16165 raft_consensus.cc:2749] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:26:53.859877 16125 raft_consensus.cc:2804] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:53.871430 16125 raft_consensus.cc:493] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
W20260709 12:26:53.871670 10818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:53.871945 16125 raft_consensus.cc:3060] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:53.838631 10894 leader_election.cc:304] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:53.870523 16203 raft_consensus.cc:493] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Starting leader election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:53.839758 16157 raft_consensus.cc:493] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:26:53.876164 16203 raft_consensus.cc:3060] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:53.876709 16157 raft_consensus.cc:515] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:53.884086 10819 leader_election.cc:304] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
W20260709 12:26:53.886905 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 51922us
W20260709 12:26:53.888325 10894 leader_election.cc:336] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:53.889057 10894 leader_election.cc:304] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:53.839852 16107 raft_consensus.cc:2804] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:26:53.897244 10817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:53.906159 10895 leader_election.cc:304] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
W20260709 12:26:53.936092 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 47826.5us
W20260709 12:26:53.937182 10894 leader_election.cc:336] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:53.938205 10894 leader_election.cc:304] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040
W20260709 12:26:53.939975 10894 leader_election.cc:336] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:53.940531 10894 leader_election.cc:304] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:53.943953 10895 leader_election.cc:304] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:53.844053 15726 consensus_queue.cc:1048] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.061s
I20260709 12:26:53.892335 16177 raft_consensus.cc:2804] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:26:53.951211 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 176509us
I20260709 12:26:53.955632 10895 leader_election.cc:304] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:53.902032 16165 raft_consensus.cc:2749] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:26:53.964103 10817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:53.976907 15925 raft_consensus.cc:2749] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:53.982149 10968 leader_election.cc:304] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:53.984385 16157 leader_election.cc:290] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:53.984808 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:53.985376 16157 raft_consensus.cc:2804] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:53.985920 16157 raft_consensus.cc:493] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:53.986301 16157 raft_consensus.cc:3060] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:53.905230 16107 raft_consensus.cc:697] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 16 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:53.952291 16162 raft_consensus.cc:2749] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:53.952073 16172 raft_consensus.cc:2749] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:26:53.994772 10968 leader_election.cc:336] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Timed out: RequestConsensusVote RPC to 127.9.116.65:46265 timed out after 2.248s (SENT)
I20260709 12:26:53.959074 16177 raft_consensus.cc:493] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:53.973425 16130 raft_consensus.cc:2804] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:54.000663 10968 leader_election.cc:304] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:53.972980 15969 raft_consensus.cc:2804] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:26:53.973230 16178 raft_consensus.cc:2804] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:26:53.990150 16191 raft_consensus.cc:493] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.002002 16130 raft_consensus.cc:493] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:54.023617 16130 raft_consensus.cc:3060] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:26:54.025352 10968 leader_election.cc:336] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Timed out: RequestConsensusVote RPC to 127.9.116.65:46265 timed out after 2.429s (SENT)
I20260709 12:26:54.026335 10968 leader_election.cc:304] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:54.011837 16178 raft_consensus.cc:493] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:54.028146 16178 raft_consensus.cc:3060] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:54.002303 16177 raft_consensus.cc:3060] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:54.031673 16191 raft_consensus.cc:515] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:54.034057 16191 leader_election.cc:290] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:54.028159 16175 raft_consensus.cc:515] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:54.037267 15864 raft_consensus.cc:2749] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:26:53.990617 15996 consensus_queue.cc:1048] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:26:54.039036 16175 leader_election.cc:290] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 14 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:26:54.044807 16208 consensus_meta.cc:287] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08: Time spent flushing consensus metadata: real 0.535s	user 0.013s	sys 0.000s
I20260709 12:26:54.045125 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:54.060760 11001 raft_consensus.cc:2468] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 9.
I20260709 12:26:54.060531 16208 raft_consensus.cc:515] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:54.049155 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:54.055763 16028 leader_election.cc:290] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 10 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:53.991696 16039 consensus_queue.cc:1048] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:26:54.023406 16107 consensus_queue.cc:237] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:54.067397 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:54.070082 11002 raft_consensus.cc:3060] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:54.071030 10925 raft_consensus.cc:2393] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3c52e0825c02476e89d84da9bb849f5d in current term 10: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:26:54.072469 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:54.073323 10998 raft_consensus.cc:3060] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:54.075358 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac83709373b4efd9c3aa1472a9f9022" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:26:54.088871 10969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:54.069512 15996 raft_consensus.cc:493] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:54.092869 10817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:54.095741 10817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:54.106439 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:54.107884 11001 raft_consensus.cc:2410] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 12:26:54.109490 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:54.110327 11003 raft_consensus.cc:3060] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:26:54.111937 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac83709373b4efd9c3aa1472a9f9022" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:54.112614 10928 raft_consensus.cc:2468] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 8.
I20260709 12:26:54.113634 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:54.114251 16203 raft_consensus.cc:515] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:54.114630 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:54.115203 10926 raft_consensus.cc:3060] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:54.117733 16203 leader_election.cc:290] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 11 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:54.063561 16228 raft_consensus.cc:2749] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:54.022404 15969 raft_consensus.cc:697] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 13 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:54.125291 10819 leader_election.cc:304] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
W20260709 12:26:54.130157 16189 log.cc:927] Time spent T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
W20260709 12:26:54.146092 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:54.163602 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:54.168049 10995 raft_consensus.cc:2368] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3c52e0825c02476e89d84da9bb849f5d for earlier term 10. Current term is 11.
I20260709 12:26:54.171774 11003 raft_consensus.cc:2468] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 14.
W20260709 12:26:54.173951 10818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:54.178853 11589 leader_election.cc:400] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 10 election: Vote denied by peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945) with higher term. Message: Invalid argument: T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3c52e0825c02476e89d84da9bb849f5d for earlier term 10. Current term is 11.
I20260709 12:26:54.179451 11589 leader_election.cc:403] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:26:54.180020 10998 raft_consensus.cc:2468] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 10.
I20260709 12:26:54.180212 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
W20260709 12:26:54.183663 10968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:54.126950 16208 leader_election.cc:290] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:54.195300 10820 leader_election.cc:304] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:54.173295 16175 raft_consensus.cc:2804] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:26:54.196837 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 256889us
W20260709 12:26:54.230366 10894 leader_election.cc:336] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:54.230789 10926 raft_consensus.cc:2468] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 14.
W20260709 12:26:54.231600 10894 leader_election.cc:336] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:26:54.168201 16210 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.010s	sys 0.018s
I20260709 12:26:54.175886 16191 raft_consensus.cc:493] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:54.114256 15996 raft_consensus.cc:515] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:54.126922 15969 consensus_queue.cc:237] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:54.223268 10819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:54.187860 16177 raft_consensus.cc:515] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:54.225972 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 268774us
I20260709 12:26:54.182041 16125 raft_consensus.cc:515] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:54.238590 16175 raft_consensus.cc:493] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:54.248960 11623 raft_consensus.cc:1275] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:26:54.226447 11002 raft_consensus.cc:2468] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 16.
I20260709 12:26:54.255004 11616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
W20260709 12:26:54.268287 10817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:54.282105 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:54.209839 16028 raft_consensus.cc:3060] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:54.285413 11000 raft_consensus.cc:2393] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 14: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:26:54.291141 10920 raft_consensus.cc:1275] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 14 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 12:26:54.251405 16210 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.010s	sys 0.018s
W20260709 12:26:54.284521 16051 consensus_meta.cc:287] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent flushing consensus metadata: real 0.561s	user 0.010s	sys 0.003s
I20260709 12:26:54.270684 16125 leader_election.cc:290] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 14 election: Requested vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:54.258335 15996 leader_election.cc:290] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:54.283506 16175 raft_consensus.cc:3060] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:54.268128 16177 leader_election.cc:290] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 15 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:54.255836 16191 raft_consensus.cc:515] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:54.253449 16157 raft_consensus.cc:515] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:54.260710 16130 raft_consensus.cc:515] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:54.310719 10819 leader_election.cc:304] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
W20260709 12:26:54.335727 10968 leader_election.cc:336] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:54.336171 10994 raft_consensus.cc:2468] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 11.
W20260709 12:26:54.341394 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 146212us
I20260709 12:26:54.357429 10820 leader_election.cc:304] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:54.311815 16182 raft_consensus.cc:2749] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:54.360363 16130 leader_election.cc:290] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 12 election: Requested vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:54.309201 16051 raft_consensus.cc:2749] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:26:54.362082 16244 log.cc:927] Time spent T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:26:54.362417 10921 raft_consensus.cc:3060] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:54.358757 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:54.359350 16107 consensus_queue.cc:1048] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:26:54.380137 10818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:54.360507 10923 raft_consensus.cc:2368] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3c52e0825c02476e89d84da9bb849f5d for earlier term 11. Current term is 12.
I20260709 12:26:54.386169 10920 raft_consensus.cc:3060] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:54.382156 10820 leader_election.cc:304] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:54.397387 11620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
W20260709 12:26:54.399199 10817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:54.353026 16177 raft_consensus.cc:2804] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:26:54.404008 10999 raft_consensus.cc:1240] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 15 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 14. Current term is 15. Ops: []
W20260709 12:26:54.371467 16241 log.cc:927] Time spent T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 12:26:54.371356 10968 leader_election.cc:304] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
W20260709 12:26:54.370648 16240 log.cc:927] Time spent T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:26:54.368789 16247 raft_consensus.cc:493] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:54.382423 16182 raft_consensus.cc:2749] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:26:54.427999 10926 raft_consensus.cc:1240] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 13 LEADER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 12. Current term is 13. Ops: []
I20260709 12:26:54.431640 10925 raft_consensus.cc:1275] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:26:54.363435 16178 raft_consensus.cc:515] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:54.437259 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 55189.4us
I20260709 12:26:54.437814 10920 raft_consensus.cc:2468] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 15.
I20260709 12:26:54.442761 10820 leader_election.cc:304] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:26:54.438090 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 102407us
I20260709 12:26:54.443879 10819 leader_election.cc:304] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
W20260709 12:26:54.444232 10968 leader_election.cc:336] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:54.409278 16039 raft_consensus.cc:2749] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:54.444983 10968 leader_election.cc:304] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:54.451958 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
W20260709 12:26:54.454519 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 144996us
I20260709 12:26:54.450313 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:54.425004 16177 raft_consensus.cc:697] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 14 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:54.406744 16208 consensus_queue.cc:1048] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:26:54.460238 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:54.474093 10921 raft_consensus.cc:2468] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 10.
I20260709 12:26:54.474843 10994 raft_consensus.cc:3060] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:54.476447 11620 raft_consensus.cc:2468] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 14.
I20260709 12:26:54.429870 16051 raft_consensus.cc:493] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.460799 11002 raft_consensus.cc:1275] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:26:54.462541 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:54.486245 11623 raft_consensus.cc:3060] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:54.468940 16182 raft_consensus.cc:2804] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:26:54.470342 16166 raft_consensus.cc:2749] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:54.471607 16157 leader_election.cc:290] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 15 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:54.501940 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:54.502538 10994 raft_consensus.cc:2468] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 12.
I20260709 12:26:54.458082 16087 raft_consensus.cc:2749] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:54.435353 16247 raft_consensus.cc:515] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:54.521430 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 58487.6us
W20260709 12:26:54.521356 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 94218.8us
I20260709 12:26:54.516789 11589 leader_election.cc:304] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:54.515789 16090 raft_consensus.cc:493] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.512008 16182 raft_consensus.cc:697] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 15 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:54.515792 16210 raft_consensus.cc:2749] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:54.496784 16051 raft_consensus.cc:515] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:54.540418 10894 leader_election.cc:336] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:26:54.542313 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 98071.7us
I20260709 12:26:54.555107 11623 raft_consensus.cc:2468] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 12.
W20260709 12:26:54.555490 10817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:54.558213 10968 leader_election.cc:336] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:54.561501 10968 leader_election.cc:304] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
W20260709 12:26:54.568284 16254 log.cc:927] Time spent T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 12:26:54.556865 16090 raft_consensus.cc:515] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:54.574260 16090 leader_election.cc:290] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:54.575610 16182 consensus_queue.cc:237] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:54.577020 10894 leader_election.cc:336] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:26:54.579929  9681 thread.cc:527] Waited for 5000ms trying to join with heartbeat (tid 10879)
I20260709 12:26:54.533028 16125 raft_consensus.cc:493] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:26:54.595000 10895 leader_election.cc:304] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
W20260709 12:26:54.593725 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 151008us
W20260709 12:26:54.603719 16253 log.cc:927] Time spent T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.130s	user 0.000s	sys 0.002s
I20260709 12:26:54.605147 15636 raft_consensus.cc:2764] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260709 12:26:54.607498 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac8522e549a46e09593fa4c2e175557" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:54.616547 16261 consensus_queue.cc:1059] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 12:26:54.618028 15700 raft_consensus.cc:3055] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:26:54.618608 15700 raft_consensus.cc:740] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:54.619729 15700 consensus_queue.cc:260] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:54.616942 16087 consensus_queue.cc:1059] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:26:54.622308 16087 consensus_queue.cc:1243] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer e2d5c637307a407ab688f5ccd6f0fcea log is divergent from this leader: its last log entry 13.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:26:54.622958 16087 raft_consensus.cc:3055] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:26:54.623505 16087 raft_consensus.cc:740] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:54.624604 16087 consensus_queue.cc:260] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.13, Last appended by leader: 13, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:54.627257 10817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:54.632205 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 74051.3us
W20260709 12:26:54.633038 10968 leader_election.cc:336] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:54.639539 15726 raft_consensus.cc:2804] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:26:54.640166 15726 raft_consensus.cc:697] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 12 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:54.644218 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:54.626201 16087 raft_consensus.cc:3060] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:54.591959 16090 raft_consensus.cc:2749] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:26:54.641160 15726 consensus_queue.cc:237] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:54.643219 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:54.639060 10895 leader_election.cc:304] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:26:54.646162 10818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:54.650828 10999 raft_consensus.cc:2393] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 10: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
W20260709 12:26:54.644652 10968 leader_election.cc:336] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:54.651347 10968 leader_election.cc:304] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:54.647352 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:54.626284 16178 leader_election.cc:290] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 10 election: Requested vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:54.662010 10820 leader_election.cc:304] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:54.559980 16177 consensus_queue.cc:237] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:54.666325 10819 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:54.669258 16039 raft_consensus.cc:2749] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:26:54.674356 10968 leader_election.cc:336] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:54.674840 10968 leader_election.cc:304] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:54.665048 16172 raft_consensus.cc:2804] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:26:54.627558 16125 raft_consensus.cc:515] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:54.652915 16249 log.cc:927] Time spent T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.283s	user 0.001s	sys 0.003s
I20260709 12:26:54.636909 16256 consensus_queue.cc:1048] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
W20260709 12:26:54.684288 10968 leader_election.cc:336] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:54.682281 11623 raft_consensus.cc:2468] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 10.
I20260709 12:26:54.653447 15700 raft_consensus.cc:3060] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:54.689831 10895 leader_election.cc:304] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:26:54.694988 10968 leader_election.cc:336] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:54.686475 16039 raft_consensus.cc:2749] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:26:54.696982 10968 leader_election.cc:336] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:54.697714 10968 leader_election.cc:304] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:54.698450 16039 raft_consensus.cc:2749] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:54.650615 16175 raft_consensus.cc:515] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:54.684512 16182 raft_consensus.cc:2749] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:26:54.705780 16238 log.cc:927] Time spent T e3d9a61ecaf84695b70f8519ee57706f P 3c52e0825c02476e89d84da9bb849f5d: Append to log took a long time: real 0.399s	user 0.005s	sys 0.000s
I20260709 12:26:54.709261 16247 leader_election.cc:290] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:54.686897 16172 raft_consensus.cc:697] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 14 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:54.712785 16257 raft_consensus.cc:2804] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:26:54.714936 10800 auto_rebalancer.cc:629] Failed to schedule move for tablet f6820c5c64094058b98e641fdb7ffe67: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:54.715564 10820 leader_election.cc:304] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:54.718044 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:54.720495 16125 leader_election.cc:290] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:54.702370 16028 raft_consensus.cc:2749] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945) with higher term. Message: Invalid argument: T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3c52e0825c02476e89d84da9bb849f5d for earlier term 10. Current term is 11.
I20260709 12:26:54.723999 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:26:54.724732 10968 leader_election.cc:336] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:54.725297 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b289bc89d592435fb63c7fcf580d95a4" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
W20260709 12:26:54.742419 10817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:54.745594 16182 raft_consensus.cc:2749] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:26:54.746109 16241 log.cc:927] Time spent T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.307s	user 0.002s	sys 0.000s
W20260709 12:26:54.749007 10968 leader_election.cc:336] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:54.749559 10968 leader_election.cc:304] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
W20260709 12:26:54.751518 10968 leader_election.cc:336] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:54.754249 10895 leader_election.cc:304] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:54.755084 10968 leader_election.cc:304] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:54.754571 10927 raft_consensus.cc:1275] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 16 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:26:54.760517 11616 raft_consensus.cc:2468] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 11.
I20260709 12:26:54.752781 16172 consensus_queue.cc:237] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:54.771751 16051 leader_election.cc:290] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:54.767081 16247 raft_consensus.cc:2749] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:26:54.773470 10968 leader_election.cc:336] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:54.773931 10968 leader_election.cc:304] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
W20260709 12:26:54.775024 10968 leader_election.cc:336] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:54.776721 11588 leader_election.cc:400] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 11 pre-election: Vote denied by peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339) with higher term. Message: Invalid argument: T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3c52e0825c02476e89d84da9bb849f5d for earlier term 11. Current term is 12.
W20260709 12:26:54.785270 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 199781us
W20260709 12:26:54.786085 10894 consensus_peers.cc:597] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:54.787410 10894 consensus_peers.cc:597] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:54.788733 10819 leader_election.cc:304] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:54.791766 16262 consensus_queue.cc:1048] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:54.793678 16262 raft_consensus.cc:2804] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:26:54.794258 16262 raft_consensus.cc:697] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 10 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:54.795535 16216 raft_consensus.cc:493] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.796536 16216 raft_consensus.cc:515] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:54.798987 16216 leader_election.cc:290] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:54.759519 16257 raft_consensus.cc:697] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:54.801221 16257 consensus_queue.cc:237] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:54.810176 11620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:54.779919 16039 raft_consensus.cc:2749] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:54.779994 16210 raft_consensus.cc:2749] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:54.811039 11620 raft_consensus.cc:2468] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 14.
W20260709 12:26:54.812220 16264 log.cc:927] Time spent T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
W20260709 12:26:54.819959 10969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:54.821066 10969 leader_election.cc:304] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:54.822773 16191 leader_election.cc:290] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:54.838276 10969 leader_election.cc:304] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:54.824366 10995 raft_consensus.cc:1275] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:26:54.826671 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63ecfc9bd3945818cfe15c03f001315" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:26:54.828474 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 53475.7us
W20260709 12:26:54.836086 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 74046.9us
I20260709 12:26:54.841745 10820 leader_election.cc:304] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:26:54.841926 10968 leader_election.cc:336] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:54.842368 10968 leader_election.cc:304] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:54.847410 10820 leader_election.cc:304] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:54.876258 10820 leader_election.cc:304] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:54.795207 16262 consensus_queue.cc:237] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:54.860401 16182 raft_consensus.cc:2749] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:26:54.887758 10894 leader_election.cc:336] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:54.871233 16191 raft_consensus.cc:493] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.870584 16261 raft_consensus.cc:2804] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:26:54.893231 10894 leader_election.cc:304] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:54.870491 16166 raft_consensus.cc:493] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.874150 16157 raft_consensus.cc:2804] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:26:54.891211 16068 raft_consensus.cc:2804] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:26:54.900633 16267 log.cc:927] Time spent T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
W20260709 12:26:54.910660 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:54.898422 16177 raft_consensus.cc:2749] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:54.911602 16166 raft_consensus.cc:515] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:54.925009 16166 leader_election.cc:290] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:54.903095 16191 raft_consensus.cc:515] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:54.897821 16261 raft_consensus.cc:493] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:54.915854 10894 consensus_peers.cc:597] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:54.945479 10894 consensus_peers.cc:597] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:54.916075 16208 raft_consensus.cc:2749] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:26:54.916927 16162 raft_consensus.cc:2749] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:26:54.920708 16157 raft_consensus.cc:697] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 11 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:26:54.921623 16068 raft_consensus.cc:493] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:54.888629 16256 consensus_queue.cc:1048] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 12:26:54.886899 16210 raft_consensus.cc:493] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.912575 10820 leader_election.cc:304] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:54.965144 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac83709373b4efd9c3aa1472a9f9022" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:54.966007 10927 raft_consensus.cc:3060] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:54.928081 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6a1da21304fcfacab384a6afc4101" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:54.981591 10927 raft_consensus.cc:2468] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 9.
I20260709 12:26:54.983805 10819 leader_election.cc:304] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:54.947829 16261 raft_consensus.cc:3060] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:26:54.982065 10894 leader_election.cc:336] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:26:54.994254 10894 leader_election.cc:336] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:54.965035 16068 raft_consensus.cc:3060] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:54.994897 10894 leader_election.cc:304] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:54.963765 16090 raft_consensus.cc:2749] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:26:55.001302 10817 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:55.003307 10894 leader_election.cc:336] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:55.003814 10894 leader_election.cc:304] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:55.007090 16175 leader_election.cc:290] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:55.007755 16166 raft_consensus.cc:2749] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:26:55.009922 16191 leader_election.cc:290] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:55.005241 16107 raft_consensus.cc:2804] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:26:54.987728 16210 raft_consensus.cc:515] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:55.019387 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:26:55.024169 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 182252us
I20260709 12:26:55.026062 10927 raft_consensus.cc:1275] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 15 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 12:26:55.025522 10968 leader_election.cc:336] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:55.027396 10968 leader_election.cc:304] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:55.028627 16039 raft_consensus.cc:2749] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:55.030722 16162 raft_consensus.cc:2749] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:55.027971 16157 consensus_queue.cc:237] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:55.037850 10968 leader_election.cc:336] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:55.039438 11620 raft_consensus.cc:1275] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d [term 13 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:26:55.022024 16257 raft_consensus.cc:2749] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:55.045768 16107 raft_consensus.cc:697] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [term 9 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:55.046841 16107 consensus_queue.cc:237] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:55.052014 16269 log.cc:927] Time spent T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:26:55.052903 16191 consensus_queue.cc:1048] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:26:55.041038 16172 raft_consensus.cc:493] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:55.058591 11620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:55.059329 11620 raft_consensus.cc:2468] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 10.
I20260709 12:26:55.057005 16172 raft_consensus.cc:515] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:55.060761 10969 leader_election.cc:304] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
W20260709 12:26:55.062551 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 150040us
I20260709 12:26:55.063359 10820 leader_election.cc:304] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:55.073042 16039 raft_consensus.cc:2804] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:55.073727 16039 raft_consensus.cc:493] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:55.074124 16039 raft_consensus.cc:3060] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:55.080379 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18294423a68a4671bf6c5a0f98645e4c" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:55.084896 10820 leader_election.cc:304] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:55.086288 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "114b16c8c992413dab64ab31b16cb06f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:55.086949 10929 raft_consensus.cc:3060] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:55.086208 10926 raft_consensus.cc:1240] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Rejecting Update request from peer edcc56ddd3264984b4da6c1db59e7f08 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:26:55.106462 10968 leader_election.cc:304] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:55.065526 15636 raft_consensus.cc:493] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:55.042330 16210 leader_election.cc:290] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:55.112598 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:55.115013 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:55.123869 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:55.124715 10820 leader_election.cc:304] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:55.102206 16177 raft_consensus.cc:2749] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:26:55.138414 16265 log.cc:927] Time spent T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.296s	user 0.005s	sys 0.000s
I20260709 12:26:55.119884 16090 consensus_queue.cc:1048] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 12:26:55.143755 10820 leader_election.cc:304] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:55.145256 10820 leader_election.cc:304] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:55.146694 10820 leader_election.cc:304] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
W20260709 12:26:55.148859 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 131668us
I20260709 12:26:55.151819 15700 raft_consensus.cc:2749] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:55.153340 16177 raft_consensus.cc:2749] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:55.152366 16191 raft_consensus.cc:2749] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:26:55.152868 16182 raft_consensus.cc:2749] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:26:55.155637 10820 leader_election.cc:304] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:55.157271 10820 leader_election.cc:304] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:55.158044 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:26:55.160490 10894 leader_election.cc:336] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:55.112970 16172 leader_election.cc:290] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:55.122081 15996 raft_consensus.cc:2749] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:26:55.127805 16261 raft_consensus.cc:515] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:55.161387 16182 raft_consensus.cc:2749] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:26:55.164580 10894 leader_election.cc:304] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:26:55.177193 11588 leader_election.cc:336] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:55.184620 11620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18294423a68a4671bf6c5a0f98645e4c" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:55.130421 16087 raft_consensus.cc:2749] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:55.219369 11588 leader_election.cc:304] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:26:55.232115 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 71674.1us
I20260709 12:26:55.232172 11001 raft_consensus.cc:1275] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:26:55.233381 10894 leader_election.cc:336] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:55.234426 10894 leader_election.cc:304] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:26:55.234773 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 77576.1us
W20260709 12:26:55.237136 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 50112.9us
W20260709 12:26:55.237576 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 61557.9us
W20260709 12:26:55.240521 10894 consensus_peers.cc:597] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:55.247267 10820 leader_election.cc:304] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:55.252420 10820 leader_election.cc:304] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:55.171868 16162 consensus_queue.cc:1048] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.068s
I20260709 12:26:55.124801 15636 raft_consensus.cc:515] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:55.255151 10820 leader_election.cc:304] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:55.188006 16208 consensus_queue.cc:1059] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 12:26:55.242143 16191 raft_consensus.cc:2749] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:26:55.260552 10820 leader_election.cc:304] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:55.254058 16177 raft_consensus.cc:2749] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:26:55.266203 16166 raft_consensus.cc:2749] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:55.254078 15700 raft_consensus.cc:2749] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:26:55.248538 16172 raft_consensus.cc:2749] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:26:55.270680 16276 log.cc:927] Time spent T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.227s	user 0.000s	sys 0.009s
W20260709 12:26:55.272883 10818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:55.273798 16068 raft_consensus.cc:515] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:55.277801 16208 raft_consensus.cc:3055] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:26:55.278286 16208 raft_consensus.cc:740] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:26:55.279182 16208 consensus_queue.cc:260] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:55.280653 16208 raft_consensus.cc:3060] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:55.286458 10820 leader_election.cc:304] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:55.249961 16284 raft_consensus.cc:2749] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:26:55.293548 10894 consensus_peers.cc:597] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:55.294041 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 50793.3us
I20260709 12:26:55.293596 10820 leader_election.cc:304] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:55.295416 10929 raft_consensus.cc:2468] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 11.
I20260709 12:26:55.299914 10820 leader_election.cc:304] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:55.304388 11001 raft_consensus.cc:1275] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 12:26:55.304888 11001 pending_rounds.cc:85] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08: Aborting all ops after (but not including) 8
I20260709 12:26:55.304900 11620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6a1da21304fcfacab384a6afc4101" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:55.306097 10999 raft_consensus.cc:1240] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 15 FOLLOWER]: Rejecting Update request from peer 80cd7d227db44f34a6108591dad9c040 for earlier term 14. Current term is 15. Ops: []
I20260709 12:26:55.308068 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac83709373b4efd9c3aa1472a9f9022" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:55.303906 11617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac8522e549a46e09593fa4c2e175557" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:55.313619 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:55.314296 10997 raft_consensus.cc:3060] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 13 FOLLOWER]: Advancing to term 15
W20260709 12:26:55.315088 10800 auto_rebalancer.cc:629] Failed to schedule move for tablet 63acd3ecccdf41f5856ce30bc68864e8: Illegal state: Replica edcc56ddd3264984b4da6c1db59e7f08 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } }
I20260709 12:26:55.302610 16177 raft_consensus.cc:2749] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:55.317145 11003 raft_consensus.cc:1275] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 14 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:26:55.308791 16191 raft_consensus.cc:2749] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:26:55.318069 15925 consensus_queue.cc:1048] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:26:55.319840 16261 leader_election.cc:290] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 10 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:55.319939 16087 raft_consensus.cc:493] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:55.320628 16087 raft_consensus.cc:515] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:55.321755 15700 raft_consensus.cc:493] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:55.322517 15700 raft_consensus.cc:515] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:55.324950 15700 leader_election.cc:290] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:55.325554 15636 leader_election.cc:290] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:55.326663 16068 leader_election.cc:290] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 15 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:55.309775 16182 raft_consensus.cc:2749] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:26:55.329012 16277 log.cc:927] Time spent T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.316s	user 0.003s	sys 0.000s
I20260709 12:26:55.308522 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:55.299134 16107 raft_consensus.cc:2749] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:26:55.334005 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:55.334486 10925 raft_consensus.cc:1275] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 14 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:26:55.305186 11001 pending_rounds.cc:107] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 12:26:55.336045 11001 raft_consensus.cc:2889] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:55.336202 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:55.336818 11624 raft_consensus.cc:3060] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:26:55.338495 16285 log.cc:927] Time spent T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.071s	user 0.002s	sys 0.000s
I20260709 12:26:55.345527 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:55.346033 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:26:55.346971 16281 log.cc:927] Time spent T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.097s	user 0.003s	sys 0.000s
I20260709 12:26:55.349555 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:55.350548 10999 raft_consensus.cc:2468] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 15.
I20260709 12:26:55.316025 16039 raft_consensus.cc:515] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:55.353291 16039 leader_election.cc:290] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:55.355783 10895 leader_election.cc:304] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:55.356225 16172 raft_consensus.cc:493] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:55.356671 15969 raft_consensus.cc:2749] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:55.356758 16172 raft_consensus.cc:515] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:55.359623 10922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:55.359807 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d7ffc5e5d146d1b661abde11cf2f04" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:55.361937 16172 leader_election.cc:290] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:55.364182 11620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3357adbb6a514faf958aff009c4e4af8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d"
I20260709 12:26:55.365037 11620 raft_consensus.cc:3060] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:55.343389 10927 consensus_queue.cc:237] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:26:55.382287 16166 raft_consensus.cc:493] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:55.383026 16166 raft_consensus.cc:515] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:55.385423 16166 leader_election.cc:290] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:55.387012 11000 raft_consensus.cc:1240] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 15 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 14. Current term is 15. Ops: []
I20260709 12:26:55.394670 11589 leader_election.cc:304] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:55.395776 11624 raft_consensus.cc:2468] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 15.
I20260709 12:26:55.400545 10969 leader_election.cc:304] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:55.399220 10926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:26:55.386611 10894 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 157 similar messages]
I20260709 12:26:55.405268 11617 raft_consensus.cc:1275] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [term 12 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:26:55.415419 15996 raft_consensus.cc:2804] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:26:55.415761 16177 raft_consensus.cc:493] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:55.416280 15996 raft_consensus.cc:697] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 15 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:26:55.416491 16177 raft_consensus.cc:515] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } }
I20260709 12:26:55.417534 15996 consensus_queue.cc:237] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:55.395897 16166 raft_consensus.cc:493] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:55.421018 16166 raft_consensus.cc:515] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:55.421407 16256 consensus_queue.cc:1048] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:26:55.422214 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:55.395674 16107 raft_consensus.cc:493] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:55.423946 16107 raft_consensus.cc:515] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:55.430109 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:55.431788 15700 raft_consensus.cc:493] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:55.425962 16188 raft_consensus.cc:2804] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:55.399993 16182 consensus_queue.cc:1048] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
W20260709 12:26:55.438364 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:55.437143 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:55.441201 11000 raft_consensus.cc:2393] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 15: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:26:55.442299 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:55.439769 10997 raft_consensus.cc:2468] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 15.
I20260709 12:26:55.444316 10820 leader_election.cc:304] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:55.445299 10998 raft_consensus.cc:1275] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 16 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:26:55.420794 16177 leader_election.cc:290] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:55.450565 11000 raft_consensus.cc:1275] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:26:55.423419 16166 leader_election.cc:290] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:55.452237 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:55.453477 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:55.460829 10998 raft_consensus.cc:2468] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 9.
I20260709 12:26:55.454944 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:55.463852 11620 raft_consensus.cc:2468] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 11.
I20260709 12:26:55.465662 11618 raft_consensus.cc:1240] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 10. Current term is 11. Ops: []
I20260709 12:26:55.466079 10969 leader_election.cc:304] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
W20260709 12:26:55.467336 10969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:55.436575 16087 leader_election.cc:290] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:55.447077 16188 raft_consensus.cc:493] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:55.480958 16068 raft_consensus.cc:2804] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:26:55.483608 16107 leader_election.cc:290] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:55.483922 16068 raft_consensus.cc:697] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:26:55.485437 16068 consensus_queue.cc:237] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:55.466444 15700 raft_consensus.cc:515] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:55.472404 16175 raft_consensus.cc:493] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:55.488845 16175 raft_consensus.cc:515] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:55.482086 16188 raft_consensus.cc:3060] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:55.498651 11620 raft_consensus.cc:1275] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:26:55.503818 16157 consensus_queue.cc:1048] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:26:55.486243 16166 raft_consensus.cc:2749] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:55.451830 16172 consensus_queue.cc:1059] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 12:26:55.482075 16051 raft_consensus.cc:2749] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:26:55.516590 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 113505us
W20260709 12:26:55.518702 10968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:55.519173 16172 raft_consensus.cc:3055] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:26:55.519673 16172 raft_consensus.cc:740] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:55.523368 10994 raft_consensus.cc:2410] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 80cd7d227db44f34a6108591dad9c040 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:26:55.523765 16175 leader_election.cc:290] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:55.524935 16172 consensus_queue.cc:260] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:55.533427 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:55.534420 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:55.533504 10920 raft_consensus.cc:1275] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:26:55.535297 10921 raft_consensus.cc:2468] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 9.
W20260709 12:26:55.544057 10968 leader_election.cc:336] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:55.548023 10996 raft_consensus.cc:1240] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 LEADER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 10. Current term is 11. Ops: []
I20260709 12:26:55.545023 10968 leader_election.cc:304] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:55.548988 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:55.559299 10819 leader_election.cc:304] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
W20260709 12:26:55.569461 10968 leader_election.cc:336] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:55.574493 10968 leader_election.cc:304] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
W20260709 12:26:55.547650 16294 log.cc:927] Time spent T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
W20260709 12:26:55.580578  9681 thread.cc:527] Waited for 6000ms trying to join with heartbeat (tid 10879)
W20260709 12:26:55.580708 10968 leader_election.cc:336] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:26:55.581871 10968 leader_election.cc:336] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:26:55.583050 10968 leader_election.cc:336] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:55.568531 16297 raft_consensus.cc:2804] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:26:55.596644 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:55.583540 10968 leader_election.cc:304] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:55.569491 16068 raft_consensus.cc:2749] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:55.615154 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:55.532064 16248 consensus_queue.cc:1059] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
W20260709 12:26:55.620711 10968 leader_election.cc:336] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:55.640496 10968 leader_election.cc:304] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:55.593343 16157 raft_consensus.cc:2749] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:26:55.645588 10968 consensus_peers.cc:597] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:55.646478 10968 leader_election.cc:336] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:26:55.647653 10968 leader_election.cc:336] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:55.648178 10968 leader_election.cc:304] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, 80cd7d227db44f34a6108591dad9c040
I20260709 12:26:55.588693 16297 raft_consensus.cc:493] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:55.589263 15700 leader_election.cc:290] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
W20260709 12:26:55.653775 10968 leader_election.cc:336] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:55.664496 10968 leader_election.cc:304] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
W20260709 12:26:55.666167 10968 leader_election.cc:336] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:26:55.670316 10968 leader_election.cc:336] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:26:55.673127 10968 leader_election.cc:336] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:55.674309 10968 leader_election.cc:304] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:55.629135 16039 raft_consensus.cc:2749] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:26:55.680120 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 118009us
W20260709 12:26:55.682334 10968 consensus_peers.cc:597] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:55.683393 10968 consensus_peers.cc:597] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:55.678645 16068 raft_consensus.cc:2749] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:26:55.681203 16090 raft_consensus.cc:2749] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:55.654613 16208 raft_consensus.cc:2749] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:55.657409 16157 raft_consensus.cc:2749] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:55.656935 16297 raft_consensus.cc:3060] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:26:55.697791 10968 leader_election.cc:336] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:55.700383 10968 leader_election.cc:304] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:55.701239 16188 raft_consensus.cc:515] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:55.703125 11624 raft_consensus.cc:2368] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for earlier term 15. Current term is 16.
I20260709 12:26:55.712118 11620 raft_consensus.cc:1240] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [term 15 FOLLOWER]: Rejecting Update request from peer e2d5c637307a407ab688f5ccd6f0fcea for earlier term 14. Current term is 15. Ops: []
W20260709 12:26:55.726867 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 282617us
I20260709 12:26:55.727958 10820 leader_election.cc:304] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:55.739218 15700 consensus_queue.cc:1059] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:26:55.740285 15700 raft_consensus.cc:3055] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:26:55.740651 15700 raft_consensus.cc:740] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:55.741948 15700 consensus_queue.cc:260] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:55.744131 16208 raft_consensus.cc:2749] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:55.743798 16039 consensus_queue.cc:1048] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:26:55.746114 10820 leader_election.cc:304] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:55.747507 10820 leader_election.cc:304] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:55.755177 16175 raft_consensus.cc:2749] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:26:55.755856 15700 raft_consensus.cc:3060] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:55.756076 16175 consensus_queue.cc:1048] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:55.756428 16137 consensus_queue.cc:1048] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:26:55.762513 10820 leader_election.cc:304] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:55.749506 16261 raft_consensus.cc:2749] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:55.749292 16298 consensus_queue.cc:1048] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 12:26:55.747318 16191 raft_consensus.cc:2749] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:26:55.749711 16166 consensus_queue.cc:1048] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 12:26:55.807997 16304 raft_consensus.cc:3055] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:26:55.808722 16304 raft_consensus.cc:740] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:55.810308 16304 consensus_queue.cc:260] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:55.815500 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 53125us
I20260709 12:26:55.816679 10820 leader_election.cc:304] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:26:55.824928 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 109885us
I20260709 12:26:55.831838 10996 raft_consensus.cc:1275] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 15 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:26:55.833734 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:55.835289 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f8ad7184804b8da671a0b32db088ba" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:26:55.846004 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 444791us
I20260709 12:26:55.849892 11001 raft_consensus.cc:1275] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 12:26:55.850378 11001 pending_rounds.cc:85] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08: Aborting all ops after (but not including) 5
I20260709 12:26:55.850672 11001 pending_rounds.cc:107] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:26:55.850955 11001 raft_consensus.cc:2889] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:26:55.858060 10968 consensus_peers.cc:597] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:55.828431 16191 raft_consensus.cc:2749] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:26:55.864209 10968 leader_election.cc:336] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:55.864899 10968 leader_election.cc:304] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:55.829962 16166 raft_consensus.cc:2749] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:55.848738 16298 raft_consensus.cc:493] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:55.858090 16304 raft_consensus.cc:3060] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:55.876433 15996 raft_consensus.cc:2749] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:55.868131 16107 consensus_queue.cc:1048] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
W20260709 12:26:55.899662 10750 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60734 (request call id 362) took 13890 ms (client timeout 15000 ms). Trace:
I20260709 12:26:55.925535 10819 leader_election.cc:304] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:55.927816 16309 raft_consensus.cc:2749] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:26:55.930794 16297 raft_consensus.cc:515] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } }
I20260709 12:26:55.879174 16298 raft_consensus.cc:515] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:55.879069 16295 consensus_queue.cc:1048] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 12:26:55.927567 10819 leader_election.cc:304] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:26:55.937767 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 73586.7us
W20260709 12:26:55.947122 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 88601.7us
W20260709 12:26:55.956468 10894 consensus_peers.cc:597] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:55.959906 10968 leader_election.cc:336] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:55.960718 10968 leader_election.cc:304] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:55.962867 16137 raft_consensus.cc:2749] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:26:55.969290 16314 log.cc:927] Time spent T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 12:26:55.972169 16312 log.cc:927] Time spent T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:26:55.975684 11624 raft_consensus.cc:1275] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [term 15 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:26:55.977133 16298 leader_election.cc:290] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:55.978070 16188 leader_election.cc:290] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 16 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:26:55.904840 10750 rpcz_store.cc:269] 0709 12:26:42.003202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:42.018416 (+ 15214us) service_pool.cc:224] Handling call
0709 12:26:55.889746 (+13871330us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:52.252066 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:52.252814 (+   748us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:52.252871 (+    57us) write_op.cc:435] Acquired schema lock
0709 12:26:52.252902 (+    31us) tablet.cc:662] Decoding operations
0709 12:26:52.256844 (+  3942us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:52.256940 (+    96us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:52.256975 (+    35us) tablet.cc:685] Acquiring locks for 14 operations
0709 12:26:52.438143 (+181168us) tablet.cc:701] Row locks acquired
0709 12:26:52.438355 (+   212us) write_op.cc:260] PREPARE: finished
0709 12:26:52.438669 (+   314us) write_op.cc:270] Start()
0709 12:26:52.438866 (+   197us) write_op.cc:276] Timestamp: P: 1783600012438578 usec, L: 0
0709 12:26:52.438888 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:26:52.440027 (+  1139us) log.cc:844] Serialized 5529 byte log entry
0709 12:26:53.315705 (+875678us) spinlock_profiling.cc:243] Waited 9.38 ms on lock 0x7b4400022b4c. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7591c23db1 00007f7591cc1c85 00007f7591cc26a2 00007f7594a341db 00007f7594a2faaf 00007f7594a2386e 00007f7594a22bb6 00007f7594a227d8 00007f7594a2c221 00007f7594a2c1d9 00007f7594a2c169
0709 12:26:53.990925 (+675220us) op_driver.cc:464] REPLICATION: finished
0709 12:26:54.368337 (+377412us) write_op.cc:301] APPLY: starting
0709 12:26:54.368473 (+   136us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:54.673461 (+304988us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:54.673516 (+    55us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:54.912849 (+239333us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:54.913247 (+   398us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=28,key_file_lookups=28,delta_file_lookups=0,mrs_lookups=0
0709 12:26:54.913296 (+    49us) write_op.cc:312] APPLY: finished
0709 12:26:54.913734 (+   438us) log.cc:844] Serialized 129 byte log entry
0709 12:26:54.996654 (+ 82920us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:55.004944 (+  8290us) write_op.cc:454] Released schema lock
0709 12:26:55.015948 (+ 11004us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:55.029542 (+ 13594us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:55.029575 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3683,"reported_tablets":32,"child_traces":[["op",{"apply.queue_time_us":363826,"apply.run_cpu_time_us":34087,"apply.run_wall_time_us":661168,"cfile_cache_hit":58,"cfile_cache_hit_bytes":62647,"num_ops":14,"prepare.queue_time_us":214728,"prepare.run_cpu_time_us":44891,"prepare.run_wall_time_us":447446,"raft.queue_time_us":290553,"raft.run_cpu_time_us":12467,"raft.run_wall_time_us":396641,"replication_time_us":1495834,"spinlock_wait_cycles":21574912,"thread_start_us":671806,"threads_started":5,"wal-append.queue_time_us":580322,"wal-append.run_cpu_time_us":32526,"wal-append.run_wall_time_us":1772104}]]}
W20260709 12:26:55.987766 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 107622us
I20260709 12:26:55.995615 10997 raft_consensus.cc:1275] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:26:55.995854 10752 catalog_manager.cc:5697] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 13 to 14, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 14 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:55.998708 16297 leader_election.cc:290] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 10 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:56.000841 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:56.001588 11000 raft_consensus.cc:3060] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:56.010882 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:56.012166 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:56.012758 10998 raft_consensus.cc:3060] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:56.014281 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dca008c268416c8e63091506d1653e" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:56.015106 10921 raft_consensus.cc:3060] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:26:56.016589 10925 raft_consensus.cc:1275] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:26:56.038309 10924 raft_consensus.cc:1275] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:26:56.037468 10752 catalog_manager.cc:5697] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 5 to 6, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 6 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:26:56.045487 10969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 60812.1us
W20260709 12:26:56.047099 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 87249.8us
I20260709 12:26:56.019357 16172 raft_consensus.cc:3060] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:26:56.044494 16274 log.cc:927] Time spent T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.054s	user 0.011s	sys 0.002s
I20260709 12:26:56.026472 15996 raft_consensus.cc:2749] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:26:56.050055 10752 catalog_manager.cc:5697] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:56.076846 10921 raft_consensus.cc:2468] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 16.
I20260709 12:26:56.081231 10752 catalog_manager.cc:5697] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 5 to 8, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 8 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:56.088091 16322 consensus_queue.cc:1048] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 12:26:56.107954 10752 catalog_manager.cc:5697] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:56.115983 10998 raft_consensus.cc:2468] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 10.
I20260709 12:26:56.157059 11620 raft_consensus.cc:1275] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:26:56.164732 10895 leader_election.cc:400] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 15 pre-election: Vote denied by peer 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613) with higher term. Message: Invalid argument: T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for earlier term 15. Current term is 16.
I20260709 12:26:56.165231 10895 leader_election.cc:403] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:26:56.170878 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 127473us
I20260709 12:26:56.176681 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8a389131ef4c77a3e08488aa4759eb" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:56.179345 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5cbc6740ba4e518cfc3499d4a01d2a" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:56.186367 16107 raft_consensus.cc:493] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:56.187512 16107 raft_consensus.cc:515] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:56.191289 10820 leader_election.cc:304] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:56.209213 11617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834361a055d34950b4edecba39f07657" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:56.208349 11620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:56.208793 15700 raft_consensus.cc:2749] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:26:56.281834 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 64601.2us
I20260709 12:26:56.299075 11000 raft_consensus.cc:2468] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 16.
I20260709 12:26:56.293784 16107 leader_election.cc:290] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:56.332027 10820 leader_election.cc:304] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:56.334408 16107 raft_consensus.cc:2804] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:26:56.335038 16107 raft_consensus.cc:697] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [term 10 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:56.336028 16107 consensus_queue.cc:237] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } }
I20260709 12:26:56.316597 16278 consensus_queue.cc:1048] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 12:26:56.349844 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:56.366292 16297 raft_consensus.cc:493] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:56.367457 16297 raft_consensus.cc:515] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:56.371256 16297 leader_election.cc:290] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
W20260709 12:26:56.376807 16324 log.cc:927] Time spent T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.238s	user 0.005s	sys 0.000s
I20260709 12:26:56.392455 16051 raft_consensus.cc:493] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:56.393110 16051 raft_consensus.cc:515] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:56.397346 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 232955us
I20260709 12:26:56.397787 15969 raft_consensus.cc:2749] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613) with higher term. Message: Invalid argument: T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea for earlier term 15. Current term is 16.
I20260709 12:26:56.398043 16210 raft_consensus.cc:493] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
W20260709 12:26:56.398489 10895 consensus_peers.cc:597] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613): Couldn't send request to peer 3c52e0825c02476e89d84da9bb849f5d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 54df1a3d45b746398c2831883d796c6d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:56.398926 16210 raft_consensus.cc:515] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:56.403425 16210 leader_election.cc:290] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:56.406035 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:56.411338 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a194e99ec5435b9e871484ecb661a1" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:56.414582 16298 consensus_queue.cc:1048] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:56.421494 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:56.422354 10923 raft_consensus.cc:3060] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:56.435279 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:56.395336 16051 leader_election.cc:290] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:26:56.436498 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 141730us
I20260709 12:26:56.440877 10995 raft_consensus.cc:2393] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 14: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:26:56.439301 11588 leader_election.cc:304] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea; no voters: 
I20260709 12:26:56.449397 11620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2937f569e8041d9a71a575dc1b9d74d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:56.450519 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:56.428474 16295 raft_consensus.cc:493] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:56.455199 16295 raft_consensus.cc:515] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:56.457531 16295 leader_election.cc:290] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:56.452347 16163 raft_consensus.cc:2804] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:26:56.459009 16163 raft_consensus.cc:697] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [term 16 LEADER]: Becoming Leader. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
I20260709 12:26:56.440500 15969 consensus_queue.cc:1048] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 12:26:56.459960 16137 raft_consensus.cc:493] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:56.410425 15700 consensus_queue.cc:1048] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:26:56.446306 16278 raft_consensus.cc:493] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:56.494302 10924 raft_consensus.cc:1275] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 12:26:56.494760 10924 pending_rounds.cc:85] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea: Aborting all ops after (but not including) 8
I20260709 12:26:56.495005 10924 pending_rounds.cc:107] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 12:26:56.495252 10924 raft_consensus.cc:2889] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:56.496333 10921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:56.460786 16137 raft_consensus.cc:515] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:56.487231 16325 log.cc:927] Time spent T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.383s	user 0.007s	sys 0.002s
I20260709 12:26:56.460055 16163 consensus_queue.cc:237] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:56.537922 16125 raft_consensus.cc:493] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:56.490918 16278 raft_consensus.cc:515] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:26:56.581092  9681 thread.cc:527] Waited for 7000ms trying to join with heartbeat (tid 10879)
W20260709 12:26:56.595727 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 166548us
I20260709 12:26:56.600389 10819 leader_election.cc:304] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:26:56.614289 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 200149us
I20260709 12:26:56.576406 16125 raft_consensus.cc:515] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:56.647334 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:56.613230 15700 raft_consensus.cc:2749] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:56.619059 16039 consensus_queue.cc:1048] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 12:26:56.685700 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd87c382c98f42fdb9ced96cf57e9714" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:56.697669 16137 leader_election.cc:290] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:26:56.706907 16172 consensus_meta.cc:287] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea: Time spent flushing consensus metadata: real 0.644s	user 0.009s	sys 0.003s
W20260709 12:26:56.710299 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 75493.8us
I20260709 12:26:56.711267 10923 raft_consensus.cc:2468] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 10.
I20260709 12:26:56.713577 10925 raft_consensus.cc:1275] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 15 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 12:26:56.713990 10925 pending_rounds.cc:85] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea: Aborting all ops after (but not including) 11
I20260709 12:26:56.714216 10925 pending_rounds.cc:107] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 12:26:56.714450 10925 raft_consensus.cc:2889] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:56.735996 10820 leader_election.cc:304] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
W20260709 12:26:56.737182 16347 log.cc:927] Time spent T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:26:56.737435 16125 leader_election.cc:290] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:56.744621 10820 leader_election.cc:304] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:56.752707 10820 leader_election.cc:304] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:56.754206 10820 leader_election.cc:304] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:56.753523 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:56.758337 16365 raft_consensus.cc:2749] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:56.759861 10820 leader_election.cc:304] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:56.759987 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c913e527ff46578e084c41eab7bb9d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:56.771649 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c913e527ff46578e084c41eab7bb9d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:56.762506 11002 raft_consensus.cc:2393] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 15: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
W20260709 12:26:56.762907 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 45085.9us
I20260709 12:26:56.751322 16137 raft_consensus.cc:493] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:56.762612 15700 raft_consensus.cc:2749] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:56.755847 16350 raft_consensus.cc:2749] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:26:56.793138 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 64117.7us
I20260709 12:26:56.762450 16348 raft_consensus.cc:2749] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:56.798655 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:26:56.802618 16352 log.cc:927] Time spent T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:26:56.803800 16278 leader_election.cc:290] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:56.820632 11618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b822586ed04f2cb681fefd045b3f6d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
W20260709 12:26:56.819487 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 52298.4us
I20260709 12:26:56.818336 16365 raft_consensus.cc:2749] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:56.790540 16137 raft_consensus.cc:515] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:56.874265 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 62204us
I20260709 12:26:56.863592 16172 raft_consensus.cc:2955] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 9 LEADER]: Committing config change with OpId 9.8: config changed from index -1 to 8, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:26:56.894126 10995 raft_consensus.cc:2955] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index -1 to 8, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
W20260709 12:26:56.941368 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 214513us
I20260709 12:26:56.965509 16208 consensus_queue.cc:1048] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:26:56.983497 10820 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 192630us
I20260709 12:26:56.984465 10820 leader_election.cc:304] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:56.991245 11002 raft_consensus.cc:1275] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 12:26:56.995034 10968 leader_election.cc:336] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:56.995626 10968 leader_election.cc:304] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:57.003520 10969 leader_election.cc:304] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
W20260709 12:26:57.004500 10894 consensus_peers.cc:597] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:57.003660 11588 consensus_peers.cc:597] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:57.014871 16370 consensus_queue.cc:1048] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:26:57.024292 16298 raft_consensus.cc:493] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.025020 16298 raft_consensus.cc:515] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:57.027614 16298 leader_election.cc:290] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:57.007292 16208 raft_consensus.cc:2749] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:26:57.039855 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 43535.7us
I20260709 12:26:57.056952 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:56.996791 16351 raft_consensus.cc:2749] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:26:57.146136 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 70345us
W20260709 12:26:57.147219 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 52278.1us
W20260709 12:26:57.070420 16360 log.cc:927] Time spent T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 12:26:57.149519 10894 leader_election.cc:336] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:57.154173 10894 leader_election.cc:304] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:26:57.160518 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 83891.8us
W20260709 12:26:57.167004 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 96676us
I20260709 12:26:57.145608 16367 raft_consensus.cc:493] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.175235 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:26:57.161800 10894 consensus_peers.cc:597] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:57.211184 11620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a28416571247df878823d464c05f1e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:57.170862 16348 raft_consensus.cc:493] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.216881 10995 raft_consensus.cc:1275] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 16 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:26:57.174268 16315 raft_consensus.cc:3060] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:57.173190 15700 raft_consensus.cc:493] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:57.205749 16347 log.cc:927] Time spent T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 12:26:57.213059 16068 raft_consensus.cc:2749] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:26:57.206990 16369 raft_consensus.cc:493] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.192169 16367 raft_consensus.cc:515] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:57.173190 16172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:50034 (request call id 17) took 1819 ms. Trace:
W20260709 12:26:57.256438 16373 log.cc:927] Time spent T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 12:26:57.235685 16348 raft_consensus.cc:515] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:57.251348 16369 raft_consensus.cc:515] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:57.264989 16369 leader_election.cc:290] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
W20260709 12:26:57.282390 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 61717.2us
I20260709 12:26:57.293840 16367 leader_election.cc:290] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:57.295204 16137 leader_election.cc:290] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:57.305037 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:57.305912 11000 raft_consensus.cc:2468] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 14.
I20260709 12:26:57.307087 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:57.241659 16309 raft_consensus.cc:493] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.310137 16309 raft_consensus.cc:515] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:57.313100 16309 leader_election.cc:290] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:57.317112 16297 raft_consensus.cc:493] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:57.250488 15700 raft_consensus.cc:515] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:57.326716 10925 raft_consensus.cc:1275] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:26:57.326778 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:57.336189 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:57.337514 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:26:57.340294 10894 consensus_peers.cc:597] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:57.342521 10894 leader_election.cc:336] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:57.342335 16297 raft_consensus.cc:515] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:57.330773 16298 raft_consensus.cc:493] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:57.343298 10894 leader_election.cc:304] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:57.344195 16298 raft_consensus.cc:515] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:57.361951 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:26:57.358728 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 148613us
I20260709 12:26:57.367511 10820 leader_election.cc:304] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:57.374006 10820 leader_election.cc:304] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:57.349485 16051 raft_consensus.cc:3060] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:57.387877 10927 raft_consensus.cc:1275] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 16 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:26:57.354998 15700 leader_election.cc:290] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
W20260709 12:26:57.400883 10879 heartbeater.cc:646] Failed to heartbeat to 127.9.116.126:44563 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.9.116.126:44563 timed out after 15.000s (SENT)
I20260709 12:26:57.404603 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab816bcc6183447994a2cc013e46c5f8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:26:57.407714 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 181369us
I20260709 12:26:57.349799 16369 consensus_queue.cc:1048] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:26:57.380549 16295 raft_consensus.cc:2749] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:57.388156 16137 raft_consensus.cc:2804] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:57.433312 16298 leader_election.cc:290] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:57.426249 16348 leader_election.cc:290] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:57.442297 16297 leader_election.cc:290] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:57.422274 16137 raft_consensus.cc:493] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:57.452214 16137 raft_consensus.cc:3060] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:57.458187 10820 leader_election.cc:304] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:57.459057 11618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:57.459375 11620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb7b380c8446e6ab1355c203218967" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:57.461110 11620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:57.462929 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352aa49c65194abbb863d7553a091f11" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:57.464818 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:57.462301 16295 raft_consensus.cc:2749] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:26:57.475265 11618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9211e3b6d81447798824045b9515c0ee" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:57.479697 11617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab816bcc6183447994a2cc013e46c5f8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:57.493309 11620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352aa49c65194abbb863d7553a091f11" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:57.502333 16297 raft_consensus.cc:493] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.503919 16297 raft_consensus.cc:515] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:57.504873 16051 raft_consensus.cc:2749] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:57.508154 10820 leader_election.cc:304] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:57.508353 16297 leader_election.cc:290] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:57.517092 16315 raft_consensus.cc:2749] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:57.518779 16295 raft_consensus.cc:2749] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:57.519554 10924 raft_consensus.cc:2468] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 14.
I20260709 12:26:57.520424 10820 leader_election.cc:304] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:57.521268 16295 raft_consensus.cc:2749] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:57.522598 10820 leader_election.cc:304] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:57.525214 16295 raft_consensus.cc:2749] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:26:57.532968 11003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63ecfc9bd3945818cfe15c03f001315" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:26:57.541102 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 49657.2us
I20260709 12:26:57.554282 10820 leader_election.cc:304] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:57.555861 10820 leader_election.cc:304] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:57.557014 10820 leader_election.cc:304] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:26:57.556669 11588 consensus_peers.cc:597] T e9331e5342644ca2bae19187b083a7d5 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:57.563261 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63ecfc9bd3945818cfe15c03f001315" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:57.539243 16351 raft_consensus.cc:493] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.566115 10820 leader_election.cc:304] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:57.549124 16298 raft_consensus.cc:493] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.566746 16309 raft_consensus.cc:2749] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:26:57.570710 11588 consensus_peers.cc:597] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:57.557335 16367 raft_consensus.cc:2749] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:57.558722 16368 raft_consensus.cc:2749] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:57.575059 16298 raft_consensus.cc:515] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:57.570962 16370 raft_consensus.cc:2749] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:57.560532 16343 consensus_queue.cc:1048] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 12:26:57.588181 16309 raft_consensus.cc:493] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.590832 16367 raft_consensus.cc:493] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.578709 16380 ts_tablet_manager.cc:933] T 54df1a3d45b746398c2831883d796c6d P 3c52e0825c02476e89d84da9bb849f5d: Initiating tablet copy from peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:57.248577 16172 rpcz_store.cc:276] 0709 12:26:55.340419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:55.340828 (+   409us) service_pool.cc:224] Handling call
0709 12:26:55.378038 (+ 37210us) log.cc:844] Serialized 499 byte log entry
0709 12:26:55.709074 (+331036us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b18004ab8a0. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f759ac63ab1 00007f759ac70281 00007f7591d692a6 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e01142 00007f7594de1eaa 00007f7594de8d53
0709 12:26:55.717676 (+  8602us) spinlock_profiling.cc:243] Waited 8.37 ms on lock 0x7b540015a520. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e01142 00007f7594de1eaa 00007f7594de8d53 00007f7594de8cd9 00007f7594de8c69 00007f7594de8c31 00007f7594de7dfd 0000000000388634 0000000000388479 00007f7591d9b475
0709 12:26:55.771094 (+ 53418us) spinlock_profiling.cc:243] Waited 4.94 ms on lock 0x7b540015a520. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e01142 00007f7594de1eaa 00007f7594de8d53 00007f7594de8cd9 00007f7594de8c69 00007f7594de8c31 00007f7594de7dfd 0000000000388634 0000000000388479 00007f7591d9b475
0709 12:26:55.799925 (+ 28831us) spinlock_profiling.cc:243] Waited 4.42 ms on lock 0x7b540015a520. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df1571 00007f7594e08b26 00007f7594e0249a 00007f7594e01714 00007f7594de1eaa 00007f7594de8d53 00007f7594de8cd9 00007f7594de8c69 00007f7594de8c31 00007f7594de7dfd 0000000000388634
0709 12:26:57.159891 (+1359966us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35725,"raft.queue_time_us":37181,"raft.run_cpu_time_us":10084,"raft.run_wall_time_us":637981,"spinlock_wait_cycles":65139072,"thread_start_us":133655,"threads_started":1,"wal-append.queue_time_us":127023,"wal-append.run_cpu_time_us":3301,"wal-append.run_wall_time_us":1148395}
W20260709 12:26:57.595114 10894 consensus_peers.cc:597] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:57.603070 10894 consensus_peers.cc:597] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:57.573439 16351 raft_consensus.cc:515] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:57.608357 11588 consensus_peers.cc:597] T ab816bcc6183447994a2cc013e46c5f8 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:57.607164 16188 consensus_queue.cc:1048] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 12:26:57.624795 16351 leader_election.cc:290] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:57.632790 16298 leader_election.cc:290] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:57.637327 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:57.602902 16367 raft_consensus.cc:515] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:57.641734 16367 leader_election.cc:290] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:57.641779  9681 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:57.642318 16367 raft_consensus.cc:493] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.600586 16309 raft_consensus.cc:515] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:57.649816  9681 tablet_replica.cc:333] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040: stopping tablet replica
I20260709 12:26:57.651882  9681 raft_consensus.cc:2243] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:57.652530 16309 leader_election.cc:290] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:57.642993 16367 raft_consensus.cc:515] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:57.655112 16367 leader_election.cc:290] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:57.655278 16137 raft_consensus.cc:515] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:57.657074 10800 auto_rebalancer.cc:629] Failed to schedule move for tablet 1e97a41f10c041deb11464b469d0b5dd: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:57.652634  9681 raft_consensus.cc:2272] T 435d66c6d38c4d8a90a81975a6a0cb13 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:57.661708 16380 tablet_copy_client.cc:323] T 54df1a3d45b746398c2831883d796c6d P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Beginning tablet copy session from remote peer at address 127.9.116.66:39339
I20260709 12:26:57.664776 16137 leader_election.cc:290] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 15 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:57.670976  9681 tablet_replica.cc:333] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040: stopping tablet replica
I20260709 12:26:57.692662 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:57.695699 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:57.697719 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:57.700002 10939 tablet_copy_service.cc:140] P e2d5c637307a407ab688f5ccd6f0fcea: Received BeginTabletCopySession request for tablet 54df1a3d45b746398c2831883d796c6d from peer 3c52e0825c02476e89d84da9bb849f5d ({username='slave'} at 127.0.0.1:50036)
I20260709 12:26:57.701225 10939 tablet_copy_service.cc:161] P e2d5c637307a407ab688f5ccd6f0fcea: Beginning new tablet copy session on tablet 54df1a3d45b746398c2831883d796c6d from peer 3c52e0825c02476e89d84da9bb849f5d at {username='slave'} at 127.0.0.1:50036: session id = 3c52e0825c02476e89d84da9bb849f5d-54df1a3d45b746398c2831883d796c6d
I20260709 12:26:57.708209 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:57.708971 10996 raft_consensus.cc:3060] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:57.711956 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:57.708823 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:57.714494 11002 raft_consensus.cc:2468] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 15.
I20260709 12:26:57.686484 16367 raft_consensus.cc:493] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.717136 16367 raft_consensus.cc:515] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:57.725559  9681 raft_consensus.cc:2243] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:57.745814 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266989ea58c040cea1d5f1b425ba2d3b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:57.742036 10820 leader_election.cc:304] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:57.754348 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5794ba618e514e28a7542ab6af39d8c9" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:57.755820  9681 pending_rounds.cc:70] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040: Trying to abort 1 pending ops.
I20260709 12:26:57.760576 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fd8fdac2fa449e9e184f3d668ea1a7" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:57.757066  9681 pending_rounds.cc:77] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040: Aborting op as it isn't in flight: id { term: 16 index: 13 } timestamp: 7305625632969543680 op_type: NO_OP noop_request { }
I20260709 12:26:57.764256  9681 raft_consensus.cc:2889] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:26:57.765458 10819 leader_election.cc:304] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:57.765030  9681 raft_consensus.cc:2272] T 834361a055d34950b4edecba39f07657 P 80cd7d227db44f34a6108591dad9c040 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:57.766350 10924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:57.755038 16368 raft_consensus.cc:2804] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:57.768313 16368 raft_consensus.cc:493] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:57.768805 16368 raft_consensus.cc:3060] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:57.773504 16370 raft_consensus.cc:2749] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:57.778615 10939 tablet_copy_source_session.cc:215] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:57.780149 16367 leader_election.cc:290] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:57.767004 10924 raft_consensus.cc:2468] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 15.
W20260709 12:26:57.782480 10968 consensus_peers.cc:597] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:57.782346 10751 catalog_manager.cc:5697] T b289bc89d592435fb63c7fcf580d95a4 P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: term changed from 10 to 12, leader changed from 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 12 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:57.785969 10751 catalog_manager.cc:5697] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: term changed from 9 to 12, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68). New cstate: current_term: 12 leader_uuid: "3c52e0825c02476e89d84da9bb849f5d" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:57.788245 10751 catalog_manager.cc:5697] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: term changed from 10 to 14, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68). New cstate: current_term: 14 leader_uuid: "3c52e0825c02476e89d84da9bb849f5d" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:57.790237 10751 catalog_manager.cc:5697] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: term changed from 8 to 9, leader changed from 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 9 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:57.792378 10927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fd8fdac2fa449e9e184f3d668ea1a7" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:57.792804 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:57.793792 10920 raft_consensus.cc:3060] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:57.810159 10751 catalog_manager.cc:5697] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "3c52e0825c02476e89d84da9bb849f5d" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:57.820353 10819 leader_election.cc:304] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:57.832463  9681 tablet_replica.cc:333] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040: stopping tablet replica
I20260709 12:26:57.833765  9681 raft_consensus.cc:2243] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:57.834358  9681 pending_rounds.cc:70] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040: Trying to abort 1 pending ops.
I20260709 12:26:57.834640  9681 pending_rounds.cc:77] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040: Aborting op as it isn't in flight: id { term: 7 index: 6 } timestamp: 7305625616752594944 op_type: NO_OP noop_request { }
I20260709 12:26:57.834996  9681 raft_consensus.cc:2889] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:26:57.835880  9681 raft_consensus.cc:2272] T 24c913e527ff46578e084c41eab7bb9d P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:57.804436 16309 raft_consensus.cc:493] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:57.836903 11588 consensus_peers.cc:597] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:57.840629 10752 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60730 (request call id 351) took 15761 ms (client timeout 15000 ms). Trace:
I20260709 12:26:57.811271 16370 raft_consensus.cc:493] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.816427 10751 catalog_manager.cc:5697] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: term changed from 6 to 8, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68). New cstate: current_term: 8 leader_uuid: "3c52e0825c02476e89d84da9bb849f5d" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:26:57.845253 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 80933.9us
W20260709 12:26:57.846367 10894 consensus_peers.cc:597] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:57.849367 11588 consensus_peers.cc:597] T 1f0741f995c74b5c91290f42110a3187 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:57.843906 10751 catalog_manager.cc:5697] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:57.849090 16370 raft_consensus.cc:515] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:57.858119 16370 leader_election.cc:290] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:57.858805  9681 tablet_replica.cc:333] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040: stopping tablet replica
I20260709 12:26:57.861167 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:26:57.841192 10752 rpcz_store.cc:269] 0709 12:26:42.079179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:42.191874 (+112695us) service_pool.cc:224] Handling call
0709 12:26:42.742657 (+550783us) spinlock_profiling.cc:243] Waited 42.3 ms on lock 0x7b540007b554. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7594df2090 00007f7594e90f3a 00007f759ac46e9c 00007f759ad4504e 00007f75992062a4 00007f7599206232 00007f7599206161 00007f75992060dc 00007f7599205392 00007f75931c348c 00007f75931c28c6
0709 12:26:57.840546 (+15097889us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:56.284539 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:56.317430 (+ 32891us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:56.317467 (+    37us) write_op.cc:435] Acquired schema lock
0709 12:26:56.317485 (+    18us) tablet.cc:662] Decoding operations
0709 12:26:56.340399 (+ 22914us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:56.345387 (+  4988us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:56.351354 (+  5967us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:26:56.464356 (+113002us) tablet.cc:701] Row locks acquired
0709 12:26:56.466647 (+  2291us) write_op.cc:260] PREPARE: finished
0709 12:26:56.479757 (+ 13110us) write_op.cc:270] Start()
0709 12:26:56.492013 (+ 12256us) write_op.cc:276] Timestamp: P: 1783600016475187 usec, L: 0
0709 12:26:56.492455 (+   442us) op_driver.cc:348] REPLICATION: starting
0709 12:26:56.548979 (+ 56524us) log.cc:844] Serialized 2069 byte log entry
0709 12:26:57.167330 (+618351us) op_driver.cc:464] REPLICATION: finished
0709 12:26:57.419286 (+251956us) write_op.cc:301] APPLY: starting
0709 12:26:57.423470 (+  4184us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:57.501815 (+ 78345us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:57.505799 (+  3984us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:57.509677 (+  3878us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:57.509926 (+   249us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=0,mrs_lookups=0
0709 12:26:57.509971 (+    45us) write_op.cc:312] APPLY: finished
0709 12:26:57.510219 (+   248us) log.cc:844] Serialized 57 byte log entry
0709 12:26:57.510422 (+   203us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:57.510535 (+   113us) write_op.cc:454] Released schema lock
0709 12:26:57.510582 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:57.562869 (+ 52287us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:57.567230 (+  4361us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":42706,"reported_tablets":32,"spinlock_wait_cycles":97223424,"child_traces":[["op",{"apply.queue_time_us":221630,"apply.run_cpu_time_us":9990,"apply.run_wall_time_us":132875,"cfile_cache_hit":22,"cfile_cache_hit_bytes":25027,"num_ops":5,"prepare.queue_time_us":85142,"prepare.run_cpu_time_us":60895,"prepare.run_wall_time_us":388389,"raft.queue_time_us":328853,"raft.run_cpu_time_us":43212,"raft.run_wall_time_us":97499,"replication_time_us":674656,"thread_start_us":365904,"threads_started":4,"wal-append.queue_time_us":194874}]]}
W20260709 12:26:57.854610 11588 consensus_peers.cc:597] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:57.873239 11588 consensus_peers.cc:597] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:57.874358 11588 consensus_peers.cc:597] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:57.852814 10751 catalog_manager.cc:5697] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: term changed from 8 to 10, leader changed from 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 10 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:57.880813 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5794ba618e514e28a7542ab6af39d8c9" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:57.881745 10920 raft_consensus.cc:2468] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 15.
W20260709 12:26:57.884196 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 64231.9us
I20260709 12:26:57.884330  9681 raft_consensus.cc:2243] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:57.885536 10751 catalog_manager.cc:5697] T e8b17195a94142039c40f598ed006c94 P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "3c52e0825c02476e89d84da9bb849f5d" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:57.887535 10751 catalog_manager.cc:5697] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: term changed from 8 to 10, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68). New cstate: current_term: 10 leader_uuid: "3c52e0825c02476e89d84da9bb849f5d" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:57.889765 10751 catalog_manager.cc:5697] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "3c52e0825c02476e89d84da9bb849f5d" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:57.891935 10751 catalog_manager.cc:5697] T e9331e5342644ca2bae19187b083a7d5 P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: term changed from 4 to 6, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68). New cstate: current_term: 6 leader_uuid: "3c52e0825c02476e89d84da9bb849f5d" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:26:57.892725 10894 consensus_peers.cc:597] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:57.893617 10751 catalog_manager.cc:5697] T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: term changed from 4 to 7, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68). New cstate: current_term: 7 leader_uuid: "3c52e0825c02476e89d84da9bb849f5d" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:57.897701 10996 raft_consensus.cc:2468] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 15.
I20260709 12:26:57.900367 10820 leader_election.cc:304] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:57.851850 15700 raft_consensus.cc:493] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:57.883399 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 63125.4us
I20260709 12:26:57.910585 10819 leader_election.cc:304] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:57.913793 10819 leader_election.cc:304] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:57.914069 10820 leader_election.cc:304] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:57.916518  9681 raft_consensus.cc:2272] T 2ac8522e549a46e09593fa4c2e175557 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:57.884572 16370 raft_consensus.cc:2749] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:57.849985 16309 raft_consensus.cc:515] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:57.929668  9681 tablet_replica.cc:333] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040: stopping tablet replica
I20260709 12:26:57.931213  9681 raft_consensus.cc:2243] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:57.931923  9681 raft_consensus.cc:2272] T dad6a1da21304fcfacab384a6afc4101 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:57.935045  9681 tablet_replica.cc:333] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040: stopping tablet replica
I20260709 12:26:57.936100  9681 raft_consensus.cc:2243] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:26:57.937247  9681 raft_consensus.cc:2272] T 3589745d67944a8a9a5c66ee8d04fc62 P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:57.917300 16348 raft_consensus.cc:2749] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:57.907218 16137 raft_consensus.cc:2804] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:26:57.919220 16298 raft_consensus.cc:2749] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:26:57.941993 16137 raft_consensus.cc:697] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 15 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
I20260709 12:26:57.923403 15700 raft_consensus.cc:515] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:57.943382 16380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54df1a3d45b746398c2831883d796c6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:57.943219 16137 consensus_queue.cc:237] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:57.945335  9681 tablet_replica.cc:333] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040: stopping tablet replica
I20260709 12:26:57.945211 15700 leader_election.cc:290] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:57.898347 10751 catalog_manager.cc:5697] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "3c52e0825c02476e89d84da9bb849f5d" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:26:57.959322 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 44333.3us
I20260709 12:26:57.964613  9681 raft_consensus.cc:2243] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:57.965690  9681 raft_consensus.cc:2272] T 07a194e99ec5435b9e871484ecb661a1 P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:57.970141 10751 catalog_manager.cc:5697] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "3c52e0825c02476e89d84da9bb849f5d" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:57.972863 10751 catalog_manager.cc:5697] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: term changed from 4 to 9, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68). New cstate: current_term: 9 leader_uuid: "3c52e0825c02476e89d84da9bb849f5d" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:57.923221 16351 raft_consensus.cc:493] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.920109 16297 raft_consensus.cc:2749] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:57.976496 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:57.989538 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:57.974418 10751 catalog_manager.cc:5697] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "3c52e0825c02476e89d84da9bb849f5d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:57.988947 16370 raft_consensus.cc:493] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.995288 16370 raft_consensus.cc:515] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:57.989106 16351 raft_consensus.cc:515] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:58.011449  9681 tablet_replica.cc:333] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040: stopping tablet replica
I20260709 12:26:58.013036  9681 raft_consensus.cc:2243] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:58.013140 16351 leader_election.cc:290] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:58.013722  9681 raft_consensus.cc:2272] T 53f8ad7184804b8da671a0b32db088ba P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:58.022655 10894 consensus_peers.cc:597] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:58.031136 11620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577c93bfc0d84ec6ad610cad0cf16899" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:58.036156 10820 leader_election.cc:304] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:58.050700 15700 raft_consensus.cc:2749] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:58.030732 16297 raft_consensus.cc:493] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.065084 10819 leader_election.cc:304] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:26:58.064378 11588 consensus_peers.cc:597] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:58.074822 16298 raft_consensus.cc:2749] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:58.093932 16370 leader_election.cc:290] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:58.098492 16309 leader_election.cc:290] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:26:58.104683 10894 consensus_peers.cc:597] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:58.069990 16297 raft_consensus.cc:515] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:58.115011 16297 leader_election.cc:290] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:58.118167 16368 raft_consensus.cc:515] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:26:58.077409 11588 consensus_peers.cc:597] T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:58.122931 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 45586.7us
I20260709 12:26:58.125569 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:58.126159 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:58.120615  9681 tablet_replica.cc:333] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040: stopping tablet replica
W20260709 12:26:58.128577 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 122775us
W20260709 12:26:58.130162 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 59614.7us
I20260709 12:26:58.139016 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:26:58.146431 10968 consensus_peers.cc:597] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:58.147132  9681 raft_consensus.cc:2243] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:58.160488 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 15 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:26:58.141490 11588 consensus_peers.cc:597] T 435d66c6d38c4d8a90a81975a6a0cb13 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:58.165187 11588 consensus_peers.cc:597] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:58.165980 11588 consensus_peers.cc:597] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:58.172364 10894 consensus_peers.cc:597] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:58.175910 10894 consensus_peers.cc:597] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:58.185160 11620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438b1d5ca177401b94c157e6f4836150" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:58.185993 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee998be153d94f6f91c39dace2c32f19" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 15 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:58.188289 10820 leader_election.cc:304] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:58.189956 15700 raft_consensus.cc:2749] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:58.191028 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e97a41f10c041deb11464b469d0b5dd" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:58.192325 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928860b1f6314ad3bd3582c7f89e460e" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:58.212762  9681 pending_rounds.cc:70] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040: Trying to abort 1 pending ops.
I20260709 12:26:58.213172  9681 pending_rounds.cc:77] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040: Aborting op as it isn't in flight: id { term: 11 index: 12 } timestamp: 7305625610334027776 op_type: NO_OP noop_request { }
I20260709 12:26:58.213569  9681 raft_consensus.cc:2889] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:26:58.213920  9681 raft_consensus.cc:2272] T 87cb7b380c8446e6ab1355c203218967 P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:58.232462 16309 raft_consensus.cc:493] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.256428 16309 raft_consensus.cc:515] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:58.265525 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9331e5342644ca2bae19187b083a7d5" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:58.277468 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:58.278247 10998 raft_consensus.cc:3060] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:58.299739 10820 leader_election.cc:304] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:58.266752 16309 leader_election.cc:290] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:58.317440 16380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:45904 (request call id 1074) took 1252 ms. Trace:
I20260709 12:26:58.311192  9681 tablet_replica.cc:333] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040: stopping tablet replica
I20260709 12:26:58.311725 16351 raft_consensus.cc:2749] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:58.331983  9681 raft_consensus.cc:2243] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Raft consensus shutting down.
W20260709 12:26:58.351092 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 161169us
I20260709 12:26:58.357363 10819 leader_election.cc:304] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:58.358717 15700 raft_consensus.cc:2749] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:58.360875 10819 leader_election.cc:304] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:58.361187 10998 raft_consensus.cc:2468] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 16.
W20260709 12:26:58.367682 10894 consensus_peers.cc:597] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:58.369668 15700 raft_consensus.cc:2749] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:26:58.373926 10894 consensus_peers.cc:597] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:58.378278 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:26:58.380196 10928 raft_consensus.cc:3060] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:58.381392  9681 raft_consensus.cc:2272] T 3f8a389131ef4c77a3e08488aa4759eb P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:58.398976 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 210420us
I20260709 12:26:58.408775  9681 tablet_replica.cc:333] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040: stopping tablet replica
I20260709 12:26:58.327701 16380 rpcz_store.cc:276] 0709 12:26:57.147061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:57.150581 (+  3520us) service_pool.cc:224] Handling call
0709 12:26:57.604115 (+453534us) ts_tablet_manager.cc:934] T 54df1a3d45b746398c2831883d796c6d P 3c52e0825c02476e89d84da9bb849f5d: Initiating tablet copy from peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
0709 12:26:57.906088 (+301973us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:26:58.275021 (+368933us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:58.275200 (+   179us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:26:58.316445 (+ 41245us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:26:58.316784 (+   339us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:58.317223 (+   439us) ts_tablet_manager.cc:989] Replica registered.
0709 12:26:58.317311 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":759,"tablet-copy.queue_time_us":378787,"thread_start_us":248534,"threads_started":2}
I20260709 12:26:58.410290  9681 raft_consensus.cc:2243] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:58.411194 16380 tablet_copy_client.cc:806] T 54df1a3d45b746398c2831883d796c6d P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:58.411638  9681 raft_consensus.cc:2272] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:58.416023 10820 leader_election.cc:304] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:58.417282 16369 raft_consensus.cc:2804] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:26:58.417980 16369 raft_consensus.cc:697] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 16 LEADER]: Becoming Leader. State: Replica: 80cd7d227db44f34a6108591dad9c040, State: Running, Role: LEADER
W20260709 12:26:58.403829 11588 consensus_peers.cc:597] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:58.438382 10928 raft_consensus.cc:2468] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cd7d227db44f34a6108591dad9c040 in term 16.
I20260709 12:26:58.425647 16369 consensus_queue.cc:237] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:58.442107 16368 leader_election.cc:290] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 16 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:58.460640  9681 tablet_replica.cc:333] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040: stopping tablet replica
I20260709 12:26:58.461853  9681 raft_consensus.cc:2243] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:58.481222  9681 raft_consensus.cc:2272] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:58.480010 16380 tablet_copy_client.cc:670] T 54df1a3d45b746398c2831883d796c6d P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 1 WAL segments...
W20260709 12:26:58.493633 10819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 113904us
I20260709 12:26:58.510138 10929 raft_consensus.cc:1275] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 15 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:26:58.521587 16409 consensus_queue.cc:1048] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:26:58.522972 10894 consensus_peers.cc:597] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:58.558800 11002 raft_consensus.cc:1275] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 15 FOLLOWER]: Refusing update from remote peer 80cd7d227db44f34a6108591dad9c040: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 12:26:58.561772 10968 consensus_peers.cc:597] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:58.570955 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 51842us
I20260709 12:26:58.565411 11617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9331e5342644ca2bae19187b083a7d5" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:58.613579  9681 tablet_replica.cc:333] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040: stopping tablet replica
I20260709 12:26:58.635651  9681 raft_consensus.cc:2243] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:58.636525  9681 raft_consensus.cc:2272] T c2937f569e8041d9a71a575dc1b9d74d P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:58.644666 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 118023us
I20260709 12:26:58.650508  9681 tablet_replica.cc:333] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040: stopping tablet replica
I20260709 12:26:58.651710  9681 raft_consensus.cc:2243] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:26:58.659443 16370 consensus_queue.cc:1048] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 12:26:58.659888  9681 pending_rounds.cc:70] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040: Trying to abort 1 pending ops.
I20260709 12:26:58.671711  9681 pending_rounds.cc:77] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040: Aborting op as it isn't in flight: id { term: 16 index: 11 } timestamp: 7305625675536445440 op_type: NO_OP noop_request { }
I20260709 12:26:58.674455  9681 raft_consensus.cc:2889] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 16 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:26:58.674971  9681 raft_consensus.cc:2272] T c72fddfc26044838a71a798f3371636b P 80cd7d227db44f34a6108591dad9c040 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:58.694756  9681 tablet_replica.cc:333] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040: stopping tablet replica
I20260709 12:26:58.716291  9681 raft_consensus.cc:2243] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:58.717042  9681 raft_consensus.cc:2272] T c63ecfc9bd3945818cfe15c03f001315 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:58.724853  9681 tablet_replica.cc:333] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040: stopping tablet replica
I20260709 12:26:58.737002  9681 raft_consensus.cc:2243] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:58.737766  9681 raft_consensus.cc:2272] T f52e71e935934a298445f2f87c913f9e P 80cd7d227db44f34a6108591dad9c040 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:58.748883 10820 leader_election.cc:304] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:26:58.749958 10820 raft_consensus.cc:2686] T e9331e5342644ca2bae19187b083a7d5 P 80cd7d227db44f34a6108591dad9c040: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 12:26:58.755080 10968 consensus_peers.cc:597] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:58.787695 16380 tablet_copy_client.cc:538] T 54df1a3d45b746398c2831883d796c6d P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:26:58.819891 10894 consensus_peers.cc:597] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:58.828981  9681 tablet_replica.cc:333] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040: stopping tablet replica
I20260709 12:26:58.830397  9681 raft_consensus.cc:2243] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Raft consensus shutting down.
W20260709 12:26:58.830605 11588 consensus_peers.cc:597] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:58.831116  9681 raft_consensus.cc:2272] T 928860b1f6314ad3bd3582c7f89e460e P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:58.882608 16380 tablet_bootstrap.cc:492] T 54df1a3d45b746398c2831883d796c6d P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap starting.
W20260709 12:26:58.884627 10968 consensus_peers.cc:597] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:58.885733  9681 tablet_replica.cc:333] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040: stopping tablet replica
I20260709 12:26:58.904860  9681 raft_consensus.cc:2243] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 14 FOLLOWER]: Raft consensus shutting down.
W20260709 12:26:58.940542 10894 consensus_peers.cc:597] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:58.942049  9681 raft_consensus.cc:2272] T ee998be153d94f6f91c39dace2c32f19 P 80cd7d227db44f34a6108591dad9c040 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:58.992604 16370 raft_consensus.cc:493] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.993260 16370 raft_consensus.cc:515] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:58.995527 16370 leader_election.cc:290] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:58.997269 11617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:59.003145 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0e2cbee394228af2190d22e7ea9ef" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:59.010809 16370 raft_consensus.cc:493] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.011457 16370 raft_consensus.cc:515] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:59.013777 16370 leader_election.cc:290] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:59.015203 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:59.021072  9681 tablet_replica.cc:333] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040: stopping tablet replica
I20260709 12:26:59.022251  9681 raft_consensus.cc:2243] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:59.022869  9681 raft_consensus.cc:2272] T cb3b4ab419804fabb71d2a98c266b209 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:59.021159 16370 raft_consensus.cc:493] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.024302 16370 raft_consensus.cc:515] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:59.031386 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c494f15d054d2bba575010ccfbb60f" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:59.034458 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad766f48812a4ddeb383179b1d84907b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:59.036252 10819 leader_election.cc:304] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:59.050208 10819 leader_election.cc:304] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:59.052842 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad766f48812a4ddeb383179b1d84907b" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:59.061852 10820 leader_election.cc:304] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:59.059563 10751 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36188 (request call id 230) took 7699 ms. Trace:
I20260709 12:26:59.058233 16367 raft_consensus.cc:2749] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:59.050593 16348 raft_consensus.cc:2749] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:59.063730 10751 rpcz_store.cc:276] 0709 12:26:51.353429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:51.353743 (+   314us) service_pool.cc:224] Handling call
0709 12:26:59.052905 (+7699162us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:58.315158 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:58.315834 (+   676us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:58.315872 (+    38us) write_op.cc:435] Acquired schema lock
0709 12:26:58.315892 (+    20us) tablet.cc:662] Decoding operations
0709 12:26:58.317494 (+  1602us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:58.317584 (+    90us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:58.317615 (+    31us) tablet.cc:685] Acquiring locks for 17 operations
0709 12:26:58.319421 (+  1806us) tablet.cc:701] Row locks acquired
0709 12:26:58.319446 (+    25us) write_op.cc:260] PREPARE: finished
0709 12:26:58.319671 (+   225us) write_op.cc:270] Start()
0709 12:26:58.319843 (+   172us) write_op.cc:276] Timestamp: P: 1783600018319610 usec, L: 0
0709 12:26:58.319869 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:26:58.401526 (+ 81657us) log.cc:844] Serialized 6676 byte log entry
0709 12:26:58.603916 (+202390us) op_driver.cc:464] REPLICATION: finished
0709 12:26:58.640446 (+ 36530us) write_op.cc:301] APPLY: starting
0709 12:26:58.640695 (+   249us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:58.838513 (+197818us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:58.838633 (+   120us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:58.950069 (+111436us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:58.950478 (+   409us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=0,mrs_lookups=0
0709 12:26:58.950537 (+    59us) write_op.cc:312] APPLY: finished
0709 12:26:58.950996 (+   459us) log.cc:844] Serialized 156 byte log entry
0709 12:26:58.974531 (+ 23535us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:58.985485 (+ 10954us) write_op.cc:454] Released schema lock
0709 12:26:58.985553 (+    68us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:59.015892 (+ 30339us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:59.015926 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":30,"child_traces":[["op",{"apply.queue_time_us":36162,"apply.run_cpu_time_us":29337,"apply.run_wall_time_us":375400,"cfile_cache_hit":70,"cfile_cache_hit_bytes":75187,"num_ops":17,"prepare.queue_time_us":88392,"prepare.run_cpu_time_us":6505,"prepare.run_wall_time_us":94159,"replication_time_us":283833,"spinlock_wait_cycles":2944,"thread_start_us":112167,"threads_started":2}]]}
I20260709 12:26:59.055238 16370 leader_election.cc:290] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:59.090699 10748 catalog_manager.cc:5697] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:59.083412 16367 raft_consensus.cc:2749] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:26:59.103353 10748 catalog_manager.cc:5697] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 5 to 8, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 8 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } }
I20260709 12:26:59.112653 10748 catalog_manager.cc:5697] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "3c52e0825c02476e89d84da9bb849f5d" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:59.121552 10748 catalog_manager.cc:5697] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 6 to 7, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 7 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } }
I20260709 12:26:59.095763 16068 raft_consensus.cc:493] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:59.131460 16068 raft_consensus.cc:515] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:59.133966 16068 leader_election.cc:290] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:26:59.136356 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
W20260709 12:26:59.144179 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 49326.6us
I20260709 12:26:59.141888  9681 tablet_replica.cc:333] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040: stopping tablet replica
I20260709 12:26:59.147425  9681 raft_consensus.cc:2243] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:26:59.148559  9681 raft_consensus.cc:2272] T 8b297008d51d40b98784ce74e225b8f5 P 80cd7d227db44f34a6108591dad9c040 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:59.166899 10968 leader_election.cc:336] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:59.169785 10968 leader_election.cc:304] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:59.167724  9681 tablet_replica.cc:333] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040: stopping tablet replica
W20260709 12:26:59.191944 10894 consensus_peers.cc:597] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:59.197192 16315 raft_consensus.cc:493] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:59.199050 16315 raft_consensus.cc:515] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:59.201602 16315 leader_election.cc:290] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:59.177157 16068 raft_consensus.cc:2749] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:59.212253  9681 raft_consensus.cc:2243] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:59.217371 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:59.240276 10996 raft_consensus.cc:2468] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 12.
I20260709 12:26:59.218461  9681 raft_consensus.cc:2272] T 577c93bfc0d84ec6ad610cad0cf16899 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:59.242636 10895 leader_election.cc:304] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
W20260709 12:26:59.231129 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 52974.9us
I20260709 12:26:59.244661 16403 raft_consensus.cc:2804] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:59.245357 16403 raft_consensus.cc:493] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:26:59.245908 16403 raft_consensus.cc:3060] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:26:59.265067 10894 leader_election.cc:336] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:59.279359  9681 tablet_replica.cc:333] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040: stopping tablet replica
I20260709 12:26:59.280810  9681 raft_consensus.cc:2243] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:59.281461  9681 raft_consensus.cc:2272] T ab816bcc6183447994a2cc013e46c5f8 P 80cd7d227db44f34a6108591dad9c040 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:59.315871 16403 raft_consensus.cc:515] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:59.332103 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3589745d67944a8a9a5c66ee8d04fc62" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:26:59.333003 10998 raft_consensus.cc:3060] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:59.329813 16403 leader_election.cc:290] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 13 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:59.386870 10998 raft_consensus.cc:2468] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 13.
I20260709 12:26:59.388289 10895 leader_election.cc:304] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:26:59.391714 16403 raft_consensus.cc:2804] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:26:59.392318 16403 raft_consensus.cc:697] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 13 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:26:59.393296 16403 consensus_queue.cc:237] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:59.430943  9681 tablet_replica.cc:333] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040: stopping tablet replica
I20260709 12:26:59.432303  9681 raft_consensus.cc:2243] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:59.449887  9681 raft_consensus.cc:2272] T ad766f48812a4ddeb383179b1d84907b P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:59.452672 10894 leader_election.cc:336] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:59.491492  9681 tablet_replica.cc:333] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040: stopping tablet replica
I20260709 12:26:59.492583  9681 raft_consensus.cc:2243] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:59.499066  9681 raft_consensus.cc:2272] T 9211e3b6d81447798824045b9515c0ee P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:59.495642 10751 catalog_manager.cc:5697] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: term changed from 6 to 7, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 7 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:59.504456  9681 tablet_replica.cc:333] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040: stopping tablet replica
I20260709 12:26:59.513888  9681 raft_consensus.cc:2243] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:59.518388  9681 pending_rounds.cc:70] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040: Trying to abort 1 pending ops.
I20260709 12:26:59.518690  9681 pending_rounds.cc:77] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040: Aborting op as it isn't in flight: id { term: 12 index: 9 } timestamp: 7305625577071017984 op_type: NO_OP noop_request { }
I20260709 12:26:59.519164  9681 raft_consensus.cc:2889] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:26:59.519862 10751 catalog_manager.cc:5697] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:59.521490 10751 catalog_manager.cc:5697] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: term changed from 9 to 11, leader changed from 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 11 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:59.523015 10751 catalog_manager.cc:5697] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: term changed from 13 to 17, leader changed from 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 17 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:59.525348 16380 tablet_bootstrap.cc:492] T 54df1a3d45b746398c2831883d796c6d P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=2 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:59.524894 10751 catalog_manager.cc:5697] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: term changed from 10 to 12, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 12 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:59.524335  9681 raft_consensus.cc:2272] T 12c494f15d054d2bba575010ccfbb60f P 80cd7d227db44f34a6108591dad9c040 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:59.535882  9681 tablet_replica.cc:333] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040: stopping tablet replica
I20260709 12:26:59.536841  9681 raft_consensus.cc:2243] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:26:59.538007  9681 raft_consensus.cc:2272] T 73f1f3589fd343ba9289b327b8b35837 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:59.526609 16380 tablet_bootstrap.cc:492] T 54df1a3d45b746398c2831883d796c6d P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap complete.
I20260709 12:26:59.540462 16380 ts_tablet_manager.cc:1403] T 54df1a3d45b746398c2831883d796c6d P 3c52e0825c02476e89d84da9bb849f5d: Time spent bootstrapping tablet: real 0.658s	user 0.047s	sys 0.022s
I20260709 12:26:59.543061 16367 raft_consensus.cc:493] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.542647 10751 catalog_manager.cc:5697] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:59.543721 16367 raft_consensus.cc:515] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:59.544564 10751 catalog_manager.cc:5697] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: term changed from 6 to 8, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 8 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:59.546664 16367 leader_election.cc:290] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:59.546904 10751 catalog_manager.cc:5697] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:59.548595 10751 catalog_manager.cc:5697] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "3c52e0825c02476e89d84da9bb849f5d" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:59.549041 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:59.550391 10751 catalog_manager.cc:5697] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: term changed from 6 to 8, leader changed from 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 8 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:59.553638 10751 catalog_manager.cc:5697] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: term changed from 13 to 15, leader changed from 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 15 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:59.555505 10748 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60736 (request call id 390) took 8953 ms. Trace:
I20260709 12:26:59.555070 10751 catalog_manager.cc:5697] T e3d9a61ecaf84695b70f8519ee57706f P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: term changed from 8 to 9, leader changed from 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 9 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:59.555866 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0741f995c74b5c91290f42110a3187" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:59.560710 16370 raft_consensus.cc:493] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.562383 16368 raft_consensus.cc:493] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.564776 16370 raft_consensus.cc:515] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:59.564884 16368 raft_consensus.cc:515] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:59.567307 16368 leader_election.cc:290] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:59.569319 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352aa49c65194abbb863d7553a091f11" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:59.575049 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:59.564141 10751 catalog_manager.cc:5697] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: term changed from 3 to 6, leader changed from 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 6 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:26:59.567234 16370 leader_election.cc:290] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:59.576864 11618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352aa49c65194abbb863d7553a091f11" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:59.576608 16380 raft_consensus.cc:359] T 54df1a3d45b746398c2831883d796c6d P 3c52e0825c02476e89d84da9bb849f5d [term 9 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:26:59.577600 16380 raft_consensus.cc:740] T 54df1a3d45b746398c2831883d796c6d P 3c52e0825c02476e89d84da9bb849f5d [term 9 LEARNER]: Becoming Follower/Learner. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Initialized, Role: LEARNER
I20260709 12:26:59.578328 16380 consensus_queue.cc:260] T 54df1a3d45b746398c2831883d796c6d P 3c52e0825c02476e89d84da9bb849f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:26:59.579679 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442726a7f1e441248ec80a98b31eb341" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:59.589674 10820 leader_election.cc:304] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:26:59.590898 16370 raft_consensus.cc:2749] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:59.600253 10819 leader_election.cc:304] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:59.601042  9681 tablet_replica.cc:333] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040: stopping tablet replica
I20260709 12:26:59.601413 16370 raft_consensus.cc:2749] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:59.602056  9681 raft_consensus.cc:2243] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:26:59.614626 10819 leader_election.cc:304] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:59.621469 16370 raft_consensus.cc:2749] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:26:59.617081 16380 ts_tablet_manager.cc:1434] T 54df1a3d45b746398c2831883d796c6d P 3c52e0825c02476e89d84da9bb849f5d: Time spent starting tablet: real 0.076s	user 0.008s	sys 0.000s
I20260709 12:26:59.555961 10748 rpcz_store.cc:276] 0709 12:26:50.601981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:50.602367 (+   386us) service_pool.cc:224] Handling call
0709 12:26:59.555432 (+8953065us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:59.352415 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:59.352989 (+   574us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:59.353023 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:26:59.353041 (+    18us) tablet.cc:662] Decoding operations
0709 12:26:59.353615 (+   574us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:59.353688 (+    73us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:59.353715 (+    27us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:26:59.374057 (+ 20342us) tablet.cc:701] Row locks acquired
0709 12:26:59.376787 (+  2730us) write_op.cc:260] PREPARE: finished
0709 12:26:59.380722 (+  3935us) write_op.cc:270] Start()
0709 12:26:59.380869 (+   147us) write_op.cc:276] Timestamp: P: 1783600019380651 usec, L: 0
0709 12:26:59.380895 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:26:59.381684 (+   789us) log.cc:844] Serialized 1689 byte log entry
0709 12:26:59.444488 (+ 62804us) op_driver.cc:464] REPLICATION: finished
0709 12:26:59.445123 (+   635us) write_op.cc:301] APPLY: starting
0709 12:26:59.445207 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:59.447432 (+  2225us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:59.447525 (+    93us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:59.451437 (+  3912us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:59.452149 (+   712us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=0,mrs_lookups=0
0709 12:26:59.453870 (+  1721us) write_op.cc:312] APPLY: finished
0709 12:26:59.454236 (+   366us) log.cc:844] Serialized 49 byte log entry
0709 12:26:59.454469 (+   233us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:59.454624 (+   155us) write_op.cc:454] Released schema lock
0709 12:26:59.454687 (+    63us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:59.487986 (+ 33299us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:59.488026 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":25068,"reported_tablets":37,"child_traces":[["op",{"apply.queue_time_us":395,"apply.run_cpu_time_us":6621,"apply.run_wall_time_us":42595,"cfile_cache_hit":16,"cfile_cache_hit_bytes":16720,"num_ops":4,"prepare.queue_time_us":162191,"prepare.run_cpu_time_us":3649,"prepare.run_wall_time_us":29904,"replication_time_us":63405,"thread_start_us":121040,"threads_started":1}]]}
I20260709 12:26:59.627391 10939 tablet_copy_service.cc:342] P e2d5c637307a407ab688f5ccd6f0fcea: Request end of tablet copy session 3c52e0825c02476e89d84da9bb849f5d-54df1a3d45b746398c2831883d796c6d received from {username='slave'} at 127.0.0.1:50036
I20260709 12:26:59.627959 10939 tablet_copy_service.cc:434] P e2d5c637307a407ab688f5ccd6f0fcea: ending tablet copy session 3c52e0825c02476e89d84da9bb849f5d-54df1a3d45b746398c2831883d796c6d on tablet 54df1a3d45b746398c2831883d796c6d with peer 3c52e0825c02476e89d84da9bb849f5d
I20260709 12:26:59.631665  9681 raft_consensus.cc:2272] T f6820c5c64094058b98e641fdb7ffe67 P 80cd7d227db44f34a6108591dad9c040 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:59.635380  9681 tablet_replica.cc:333] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040: stopping tablet replica
I20260709 12:26:59.636329  9681 raft_consensus.cc:2243] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:59.636976  9681 raft_consensus.cc:2272] T 1f0741f995c74b5c91290f42110a3187 P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:59.652551  9681 tablet_replica.cc:333] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040: stopping tablet replica
I20260709 12:26:59.653591  9681 raft_consensus.cc:2243] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:59.654333  9681 pending_rounds.cc:70] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040: Trying to abort 2 pending ops.
I20260709 12:26:59.654624  9681 pending_rounds.cc:77] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040: Aborting op as it isn't in flight: id { term: 8 index: 8 } timestamp: 7305625599357235200 op_type: NO_OP noop_request { }
I20260709 12:26:59.655001  9681 raft_consensus.cc:2889] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:26:59.655345  9681 pending_rounds.cc:77] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040: Aborting op as it isn't in flight: id { term: 6 index: 7 } timestamp: 7305625540662661120 op_type: NO_OP noop_request { }
I20260709 12:26:59.655709  9681 raft_consensus.cc:2889] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:26:59.656075  9681 raft_consensus.cc:2272] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:59.673995  9681 tablet_replica.cc:333] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040: stopping tablet replica
I20260709 12:26:59.675021  9681 raft_consensus.cc:2243] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:59.675789  9681 raft_consensus.cc:2272] T 438b1d5ca177401b94c157e6f4836150 P 80cd7d227db44f34a6108591dad9c040 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:59.694581 16370 raft_consensus.cc:493] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3c52e0825c02476e89d84da9bb849f5d)
I20260709 12:26:59.695251 16370 raft_consensus.cc:515] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:26:59.698562 16370 leader_election.cc:290] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:26:59.699127 16370 raft_consensus.cc:493] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.701277 11618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:26:59.701133 16370 raft_consensus.cc:515] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:59.707235  9681 tablet_replica.cc:333] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040: stopping tablet replica
I20260709 12:26:59.708813  9681 raft_consensus.cc:2243] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:59.711468 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0dd1f84a304be0be5f4e4bf2aae6de" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:59.714664 10819 leader_election.cc:304] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:26:59.715757 16368 raft_consensus.cc:2749] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:26:59.716259 16370 leader_election.cc:290] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:59.717621  9681 raft_consensus.cc:2272] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:59.717332 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:59.719029 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63acd3ecccdf41f5856ce30bc68864e8" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:59.730821 10819 leader_election.cc:304] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:26:59.731892 10819 raft_consensus.cc:2686] T 63acd3ecccdf41f5856ce30bc68864e8 P 80cd7d227db44f34a6108591dad9c040: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:26:59.748147  9681 tablet_replica.cc:333] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040: stopping tablet replica
I20260709 12:26:59.749367  9681 raft_consensus.cc:2243] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:26:59.772214  9681 raft_consensus.cc:2272] T d5b6ea992cd64650b1c2da6c548d012f P 80cd7d227db44f34a6108591dad9c040 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:59.789994  9681 tablet_replica.cc:333] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040: stopping tablet replica
I20260709 12:26:59.790867  9681 raft_consensus.cc:2243] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:26:59.803601 10752 catalog_manager.cc:5697] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 11 to 12, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 12 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:59.805859 10752 catalog_manager.cc:5697] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 3 to 7, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 7 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:59.806872  9681 raft_consensus.cc:2272] T 02a088f690eb45beb958d74519a39b7f P 80cd7d227db44f34a6108591dad9c040 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:59.810549 10752 catalog_manager.cc:5697] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 8 to 9, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 9 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } }
I20260709 12:26:59.813238 10752 catalog_manager.cc:5697] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:59.821653  9681 tablet_replica.cc:333] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040: stopping tablet replica
I20260709 12:26:59.815214 10752 catalog_manager.cc:5697] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } }
I20260709 12:26:59.824040  9681 raft_consensus.cc:2243] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:59.824040 10752 catalog_manager.cc:5697] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } }
I20260709 12:26:59.828114  9681 raft_consensus.cc:2272] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:59.832768  9681 tablet_replica.cc:333] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040: stopping tablet replica
I20260709 12:26:59.836956 10752 catalog_manager.cc:5697] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: config changed from index -1 to 8, term changed from 8 to 9, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66), NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New cstate: current_term: 9 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:59.845835  9681 raft_consensus.cc:2243] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:59.846581  9681 raft_consensus.cc:2272] T cd87c382c98f42fdb9ced96cf57e9714 P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:59.844434 10752 catalog_manager.cc:5697] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } }
I20260709 12:26:59.850801  9681 tablet_replica.cc:333] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040: stopping tablet replica
I20260709 12:26:59.851822  9681 raft_consensus.cc:2243] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:59.852377  9681 raft_consensus.cc:2272] T 266989ea58c040cea1d5f1b425ba2d3b P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:59.855453 10752 catalog_manager.cc:5697] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 3 to 8, leader changed from edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 8 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:59.860610 10752 catalog_manager.cc:5697] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:59.872007 11618 raft_consensus.cc:1217] T 54df1a3d45b746398c2831883d796c6d P 3c52e0825c02476e89d84da9bb849f5d [term 9 LEARNER]: Deduplicated request from leader. Original: 9.7->[9.8-9.8]   Dedup: 9.8->[]
I20260709 12:26:59.875455  9681 tablet_replica.cc:333] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040: stopping tablet replica
I20260709 12:26:59.876655  9681 raft_consensus.cc:2243] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:59.877391  9681 raft_consensus.cc:2272] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:59.881841  9681 tablet_replica.cc:333] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040: stopping tablet replica
I20260709 12:26:59.885447 16367 raft_consensus.cc:493] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.886207 16367 raft_consensus.cc:515] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:26:59.889676 16367 leader_election.cc:290] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:26:59.865345 10752 catalog_manager.cc:5697] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } }
I20260709 12:26:59.891714 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:26:59.893041 10752 catalog_manager.cc:5697] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:59.894556 10752 catalog_manager.cc:5697] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 12 to 13, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 13 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } }
I20260709 12:26:59.896557 10752 catalog_manager.cc:5697] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 7 to 11, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 11 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:59.898451 10752 catalog_manager.cc:5697] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 9 to 12, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 12 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:59.900143  9681 raft_consensus.cc:2243] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:59.906680  9681 pending_rounds.cc:70] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040: Trying to abort 1 pending ops.
I20260709 12:26:59.907049  9681 pending_rounds.cc:77] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040: Aborting op as it isn't in flight: id { term: 5 index: 8 } timestamp: 7305625625991933952 op_type: NO_OP noop_request { }
I20260709 12:26:59.907765  9681 raft_consensus.cc:2889] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:26:59.908293  9681 raft_consensus.cc:2272] T a6a28416571247df878823d464c05f1e P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:59.908491 10894 consensus_peers.cc:597] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:59.911557  9681 tablet_replica.cc:333] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040: stopping tablet replica
I20260709 12:26:59.912451  9681 raft_consensus.cc:2243] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:59.913026  9681 raft_consensus.cc:2272] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:59.903637 10998 raft_consensus.cc:1275] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 13 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:26:59.915120 16402 consensus_queue.cc:1048] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:26:59.916759 10752 catalog_manager.cc:5697] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 12 to 15, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 80cd7d227db44f34a6108591dad9c040 (127.9.116.65). New cstate: current_term: 15 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } }
I20260709 12:26:59.920275  9681 tablet_replica.cc:333] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040: stopping tablet replica
I20260709 12:26:59.921751  9681 raft_consensus.cc:2243] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:59.922334  9681 pending_rounds.cc:70] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040: Trying to abort 1 pending ops.
I20260709 12:26:59.922586  9681 pending_rounds.cc:77] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040: Aborting op as it isn't in flight: id { term: 12 index: 13 } timestamp: 7305625650181058560 op_type: NO_OP noop_request { }
I20260709 12:26:59.923408 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb220f7497ef4e739938460527b9d6f0" candidate_uuid: "80cd7d227db44f34a6108591dad9c040" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:26:59.925051 10752 catalog_manager.cc:5697] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } }
I20260709 12:26:59.927508 10752 catalog_manager.cc:5697] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } }
I20260709 12:26:59.922963  9681 raft_consensus.cc:2889] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:26:59.932552  9681 raft_consensus.cc:2272] T 53b0e2cbee394228af2190d22e7ea9ef P 80cd7d227db44f34a6108591dad9c040 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:59.941895  9681 tablet_replica.cc:333] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040: stopping tablet replica
I20260709 12:26:59.943212  9681 raft_consensus.cc:2243] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:26:59.948535 10819 leader_election.cc:304] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80cd7d227db44f34a6108591dad9c040; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
W20260709 12:26:59.949399 10894 consensus_peers.cc:597] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:59.961092 10819 raft_consensus.cc:2686] T cb220f7497ef4e739938460527b9d6f0 P 80cd7d227db44f34a6108591dad9c040: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:26:59.968657  9681 raft_consensus.cc:2272] T 7ac83709373b4efd9c3aa1472a9f9022 P 80cd7d227db44f34a6108591dad9c040 [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:59.978207 10894 consensus_peers.cc:597] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:59.986506  9681 tablet_replica.cc:333] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040: stopping tablet replica
W20260709 12:26:59.995846 10894 consensus_peers.cc:597] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:59.996717 10894 consensus_peers.cc:597] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:00.011025  9681 raft_consensus.cc:2243] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:00.011940  9681 raft_consensus.cc:2272] T 5794ba618e514e28a7542ab6af39d8c9 P 80cd7d227db44f34a6108591dad9c040 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:00.014971  9681 tablet_replica.cc:333] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040: stopping tablet replica
I20260709 12:27:00.023192  9681 raft_consensus.cc:2243] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:00.030896  9681 raft_consensus.cc:2272] T 54df1a3d45b746398c2831883d796c6d P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:00.034214  9681 tablet_replica.cc:333] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040: stopping tablet replica
I20260709 12:27:00.038470  9681 raft_consensus.cc:2243] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:00.044622  9681 raft_consensus.cc:2272] T 352aa49c65194abbb863d7553a091f11 P 80cd7d227db44f34a6108591dad9c040 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:00.047781  9681 tablet_replica.cc:333] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040: stopping tablet replica
I20260709 12:27:00.056209  9681 raft_consensus.cc:2243] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [term 10 LEADER]: Raft consensus shutting down.
W20260709 12:27:00.056957 11588 consensus_peers.cc:597] T e9331e5342644ca2bae19187b083a7d5 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:00.057226 10894 consensus_peers.cc:597] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:00.059116  9681 raft_consensus.cc:2272] T 26c7a4ac9606419a90700eec61a02bd8 P 80cd7d227db44f34a6108591dad9c040 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:00.062444  9681 tablet_replica.cc:333] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040: stopping tablet replica
I20260709 12:27:00.067842  9681 raft_consensus.cc:2243] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:00.074265  9681 pending_rounds.cc:70] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040: Trying to abort 1 pending ops.
I20260709 12:27:00.074656  9681 pending_rounds.cc:77] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040: Aborting op as it isn't in flight: id { term: 10 index: 8 } timestamp: 7305625594634469376 op_type: NO_OP noop_request { }
I20260709 12:27:00.083851  9681 raft_consensus.cc:2889] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:27:00.084649  9681 raft_consensus.cc:2272] T 1e97a41f10c041deb11464b469d0b5dd P 80cd7d227db44f34a6108591dad9c040 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:00.094139  9681 tablet_replica.cc:333] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040: stopping tablet replica
I20260709 12:27:00.094998  9681 raft_consensus.cc:2243] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:00.099354  9681 raft_consensus.cc:2272] T 442726a7f1e441248ec80a98b31eb341 P 80cd7d227db44f34a6108591dad9c040 [term 7 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:00.121873 11588 consensus_peers.cc:597] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:00.154934 11588 consensus_peers.cc:597] T ab816bcc6183447994a2cc013e46c5f8 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:00.157178 16402 raft_consensus.cc:493] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:27:00.157783 16402 raft_consensus.cc:515] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:27:00.160976 10751 catalog_manager.cc:5697] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 10 to 15. New cstate: current_term: 15 leader_uuid: "80cd7d227db44f34a6108591dad9c040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } }
I20260709 12:27:00.163616 16402 leader_election.cc:290] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:27:00.165897 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:27:00.166342 10894 leader_election.cc:336] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:00.185709 10894 consensus_peers.cc:597] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:00.186547 10894 consensus_peers.cc:597] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:00.188648 10895 leader_election.cc:304] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:27:00.190649 16402 raft_consensus.cc:2749] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:27:00.228374 10752 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60734 (request call id 363) took 2018 ms. Trace:
W20260709 12:27:00.229717 10894 consensus_peers.cc:597] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:00.228832 10752 rpcz_store.cc:276] 0709 12:26:58.209584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:58.209746 (+   162us) service_pool.cc:224] Handling call
0709 12:27:00.228265 (+2018519us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:00.003952 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:00.004606 (+   654us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:00.004647 (+    41us) write_op.cc:435] Acquired schema lock
0709 12:27:00.004663 (+    16us) tablet.cc:662] Decoding operations
0709 12:27:00.007244 (+  2581us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:00.007308 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:00.007346 (+    38us) tablet.cc:685] Acquiring locks for 18 operations
0709 12:27:00.009178 (+  1832us) tablet.cc:701] Row locks acquired
0709 12:27:00.009205 (+    27us) write_op.cc:260] PREPARE: finished
0709 12:27:00.009400 (+   195us) write_op.cc:270] Start()
0709 12:27:00.009547 (+   147us) write_op.cc:276] Timestamp: P: 1783600020009343 usec, L: 0
0709 12:27:00.009574 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 12:27:00.010459 (+   885us) log.cc:844] Serialized 7137 byte log entry
0709 12:27:00.013646 (+  3187us) op_driver.cc:464] REPLICATION: finished
0709 12:27:00.014133 (+   487us) write_op.cc:301] APPLY: starting
0709 12:27:00.014224 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:00.025948 (+ 11724us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:00.026059 (+   111us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:00.091491 (+ 65432us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:00.091804 (+   313us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=36,key_file_lookups=36,delta_file_lookups=0,mrs_lookups=0
0709 12:27:00.091861 (+    57us) write_op.cc:312] APPLY: finished
0709 12:27:00.103495 (+ 11634us) log.cc:844] Serialized 164 byte log entry
0709 12:27:00.104605 (+  1110us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:00.104837 (+   232us) write_op.cc:454] Released schema lock
0709 12:27:00.104920 (+    83us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:00.105548 (+   628us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:00.105580 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":39444,"reported_tablets":42,"child_traces":[["op",{"apply.queue_time_us":278,"apply.run_cpu_time_us":26542,"apply.run_wall_time_us":91365,"cfile_cache_hit":72,"cfile_cache_hit_bytes":75240,"num_ops":18,"prepare.queue_time_us":7746,"prepare.run_cpu_time_us":6602,"prepare.run_wall_time_us":9403,"replication_time_us":3927,"spinlock_wait_cycles":92928}]]}
I20260709 12:27:00.255633 10751 catalog_manager.cc:5697] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 12 to 13, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 13 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:00.293025 16068 raft_consensus.cc:493] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:27:00.293658 16068 raft_consensus.cc:515] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:27:00.296165 16068 leader_election.cc:290] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:27:00.303450 10968 leader_election.cc:336] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:00.301132 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:27:00.304525 10928 raft_consensus.cc:2468] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 14.
I20260709 12:27:00.305760 10968 leader_election.cc:304] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:27:00.308156 16068 raft_consensus.cc:2804] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:27:00.310598 16068 raft_consensus.cc:493] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:27:00.311074 16068 raft_consensus.cc:3060] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:27:00.313830 10894 consensus_peers.cc:597] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:00.315011 11588 consensus_peers.cc:597] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:00.331993 16068 raft_consensus.cc:515] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:27:00.346864 16068 leader_election.cc:290] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 15 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:27:00.354522 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b297008d51d40b98784ce74e225b8f5" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:27:00.363210 10928 raft_consensus.cc:3060] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:27:00.359932 10968 leader_election.cc:336] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:00.358856 16428 raft_consensus.cc:1064] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea: attempting to promote NON_VOTER 3c52e0825c02476e89d84da9bb849f5d to VOTER
I20260709 12:27:00.370435 16428 consensus_queue.cc:237] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 6, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:27:00.401286 10928 raft_consensus.cc:2468] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 15.
W20260709 12:27:00.402810 10894 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 290 similar messages]
I20260709 12:27:00.405002 11623 raft_consensus.cc:1275] T 54df1a3d45b746398c2831883d796c6d P 3c52e0825c02476e89d84da9bb849f5d [term 9 LEARNER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:27:00.407327 10998 raft_consensus.cc:1275] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:27:00.410317 16396 consensus_queue.cc:1048] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:27:00.411533 11588 consensus_peers.cc:597] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:00.413388 10894 consensus_peers.cc:597] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:00.416464 16428 consensus_queue.cc:1048] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:27:00.423697 10968 leader_election.cc:304] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:27:00.425603 16068 raft_consensus.cc:2804] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:27:00.426463 16068 raft_consensus.cc:697] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 15 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:27:00.431977 16068 consensus_queue.cc:237] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:27:00.481912 16157 raft_consensus.cc:493] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:27:00.482503 16157 raft_consensus.cc:515] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:27:00.490108 16157 leader_election.cc:290] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:27:00.497516 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:27:00.504602 16396 raft_consensus.cc:2955] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 9 LEADER]: Committing config change with OpId 9.9: config changed from index 8 to 9, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
W20260709 12:27:00.509042 10968 leader_election.cc:336] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:00.509934 11588 consensus_peers.cc:597] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:00.509843 10968 leader_election.cc:304] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:27:00.511801 16423 raft_consensus.cc:2749] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:00.514394 10996 raft_consensus.cc:2955] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 8 to 9, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
W20260709 12:27:00.517153 11588 consensus_peers.cc:597] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:00.526051 10752 catalog_manager.cc:5697] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 14 to 15, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 15 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:00.588207 10752 catalog_manager.cc:5697] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: config changed from index 8 to 9, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New cstate: current_term: 9 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:27:00.614547 11620 raft_consensus.cc:2955] T 54df1a3d45b746398c2831883d796c6d P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 8 to 9, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } attrs { replace: true } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
W20260709 12:27:00.621007 11588 consensus_peers.cc:597] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:00.629469 11588 consensus_peers.cc:597] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:00.631724 10968 consensus_peers.cc:597] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:00.663422 10894 consensus_peers.cc:597] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:00.752168 10968 consensus_peers.cc:597] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:00.755066 10894 consensus_peers.cc:597] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:00.748759 10927 consensus_queue.cc:237] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:27:00.796854 10819 connection.cc:466] server connection from 127.0.0.1:46480 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46480 (request call id 1255) could send its response
W20260709 12:27:00.816890 10819 connection.cc:466] server connection from 127.0.0.1:46480 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46480 (request call id 1256) could send its response
W20260709 12:27:00.818260 10819 connection.cc:466] server connection from 127.0.0.1:46480 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46480 (request call id 1257) could send its response
I20260709 12:27:00.821292 16396 raft_consensus.cc:493] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:27:00.829067 16396 raft_consensus.cc:515] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:27:00.826844 10999 raft_consensus.cc:1275] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:27:00.831527 16396 leader_election.cc:290] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:27:00.832966 16157 raft_consensus.cc:493] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:27:00.834365 16157 raft_consensus.cc:515] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:27:00.837122 10819 connection.cc:466] server connection from 127.0.0.1:46480 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46480 (request call id 1258) could send its response
W20260709 12:27:00.838074 10819 connection.cc:466] server connection from 127.0.0.1:46480 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46480 (request call id 1259) could send its response
W20260709 12:27:00.838996 10819 connection.cc:466] server connection from 127.0.0.1:46480 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46480 (request call id 1260) could send its response
W20260709 12:27:00.839849 10819 connection.cc:466] server connection from 127.0.0.1:46480 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46480 (request call id 1261) could send its response
W20260709 12:27:00.841462 10894 connection.cc:573] client connection to 127.9.116.65:46265 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 12:27:00.841871 10968 leader_election.cc:336] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:00.842911 10894 consensus_peers.cc:597] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:00.844012 16157 leader_election.cc:290] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:27:00.831634 11620 raft_consensus.cc:1275] T 54df1a3d45b746398c2831883d796c6d P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 12:27:00.843493 10894 consensus_peers.cc:597] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:00.858457 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:27:00.866333 16396 consensus_queue.cc:1048] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:27:00.872658 16305 raft_consensus.cc:493] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:27:00.873586 16305 raft_consensus.cc:515] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:27:00.877182 16305 leader_election.cc:290] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:27:00.945926 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:27:00.948176 10929 raft_consensus.cc:2468] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 15.
W20260709 12:27:00.948589 10894 leader_election.cc:336] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111)
I20260709 12:27:00.977499 10894 leader_election.cc:304] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:27:00.980371 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
W20260709 12:27:00.981282 11588 connection.cc:769] client connection to 127.9.116.65:46265 send error: Network error: sendmsg error: Connection reset by peer (error 104)
I20260709 12:27:00.981534 10999 raft_consensus.cc:2468] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 10.
W20260709 12:27:00.990401 11588 consensus_peers.cc:597] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: sendmsg error: Connection reset by peer (error 104). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:00.998004 16396 raft_consensus.cc:2749] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:27:01.054064 16305 consensus_queue.cc:1048] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 12:27:01.080292 16423 raft_consensus.cc:493] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:27:01.089699 10895 leader_election.cc:304] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:27:01.110124 16433 raft_consensus.cc:2804] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:01.110831 16433 raft_consensus.cc:493] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:27:01.111305 16433 raft_consensus.cc:3060] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:01.122284 16396 raft_consensus.cc:493] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:01.123188 16396 raft_consensus.cc:515] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:27:01.082388 16423 raft_consensus.cc:515] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:27:01.156209 10968 leader_election.cc:304] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:27:01.160270 16068 raft_consensus.cc:2804] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:27:01.161331 16068 raft_consensus.cc:493] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:27:01.162038 16068 raft_consensus.cc:3060] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:27:01.162930 16436 raft_consensus.cc:493] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:27:01.166038 16396 leader_election.cc:290] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:27:01.171499 10894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 229135us
I20260709 12:27:01.176642 16439 raft_consensus.cc:493] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:27:01.177582 16439 raft_consensus.cc:515] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } }
I20260709 12:27:01.190982 10924 raft_consensus.cc:1275] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 15 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:27:01.193804 16428 raft_consensus.cc:493] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:27:01.194597 16428 raft_consensus.cc:515] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:27:01.196686 16305 raft_consensus.cc:2955] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 9 LEADER]: Committing config change with OpId 9.10: config changed from index 9 to 10, VOTER 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:27:01.206710 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:27:01.211126 10998 raft_consensus.cc:2468] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 16.
I20260709 12:27:01.216033 10895 leader_election.cc:304] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:27:01.217097 16402 raft_consensus.cc:2804] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:27:01.217505 16402 raft_consensus.cc:493] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:01.217868 16402 raft_consensus.cc:3060] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:27:01.217918 16423 leader_election.cc:290] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:27:01.220901 10998 raft_consensus.cc:2955] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Committing config change with OpId 9.10: config changed from index 9 to 10, VOTER 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:27:01.203724 16428 leader_election.cc:290] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:27:01.223845 16423 consensus_queue.cc:1048] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 12:27:01.229020 16439 leader_election.cc:290] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265)
I20260709 12:27:01.244683 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:27:01.245445 10996 raft_consensus.cc:2468] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 16.
W20260709 12:27:01.250485 11588 consensus_peers.cc:597] T 1f0741f995c74b5c91290f42110a3187 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:01.251116 11588 consensus_peers.cc:597] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:01.164041 16436 raft_consensus.cc:515] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:27:01.255127 16436 leader_election.cc:290] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:27:01.255674 16068 raft_consensus.cc:515] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:27:01.258496 16068 leader_election.cc:290] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 16 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:27:01.273463 11588 consensus_peers.cc:597] T 435d66c6d38c4d8a90a81975a6a0cb13 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:01.293239 16402 raft_consensus.cc:515] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:27:01.296690 16428 raft_consensus.cc:493] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:27:01.297612 16428 raft_consensus.cc:515] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:27:01.299739 11588 consensus_peers.cc:597] T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:01.309103 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:27:01.307713 16402 leader_election.cc:290] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 17 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:27:01.304239 16433 raft_consensus.cc:515] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:27:01.316484 16433 leader_election.cc:290] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:27:01.319017 10738 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 54df1a3d45b746398c2831883d796c6d with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:27:01.329017 16428 leader_election.cc:290] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:27:01.326507 10752 catalog_manager.cc:5697] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: config changed from index 9 to 10, VOTER 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) evicted. New cstate: current_term: 9 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
W20260709 12:27:01.333817 11588 consensus_peers.cc:597] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:01.343729 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 55898.2us
W20260709 12:27:01.346455 10968 consensus_peers.cc:597] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:01.352455 10928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:27:01.353214 10928 raft_consensus.cc:2468] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 16.
I20260709 12:27:01.353250 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:27:01.353700 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6820c5c64094058b98e641fdb7ffe67" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:27:01.354069 10920 raft_consensus.cc:2468] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 15.
I20260709 12:27:01.354318 10923 raft_consensus.cc:3060] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:27:01.347524 10968 consensus_peers.cc:597] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:01.361037 10968 consensus_peers.cc:597] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:01.361850 10968 leader_election.cc:336] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111)
W20260709 12:27:01.365643 10968 leader_election.cc:336] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111)
W20260709 12:27:01.370153 10968 consensus_peers.cc:597] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:01.396487 10923 raft_consensus.cc:2468] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 16.
I20260709 12:27:01.418890 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72fddfc26044838a71a798f3371636b" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:27:01.420296 11001 raft_consensus.cc:3060] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:27:01.422041 10894 leader_election.cc:336] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111)
I20260709 12:27:01.400156 10968 leader_election.cc:304] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:27:01.442540 16157 raft_consensus.cc:2749] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:27:01.451808 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 51742.1us
I20260709 12:27:01.452525 16445 raft_consensus.cc:493] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:27:01.453174 16445 raft_consensus.cc:515] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } }
W20260709 12:27:01.453864 10968 leader_election.cc:336] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111)
W20260709 12:27:01.454402 10968 leader_election.cc:336] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111)
I20260709 12:27:01.455355 16445 leader_election.cc:290] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265)
W20260709 12:27:01.467216 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 84825.6us
I20260709 12:27:01.474143 16068 raft_consensus.cc:493] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:27:01.475016 16068 raft_consensus.cc:515] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:27:01.477406 16068 leader_election.cc:290] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:27:01.486778 10894 leader_election.cc:336] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111)
W20260709 12:27:01.487633 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 91241.1us
I20260709 12:27:01.490494 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73f1f3589fd343ba9289b327b8b35837" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:27:01.502669 10998 raft_consensus.cc:3060] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:01.491021 10895 leader_election.cc:304] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:27:01.491991 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac83709373b4efd9c3aa1472a9f9022" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:27:01.506966 10996 raft_consensus.cc:2468] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 9.
W20260709 12:27:01.506747 10894 leader_election.cc:336] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111)
I20260709 12:27:01.494274 11618 raft_consensus.cc:2955] T 54df1a3d45b746398c2831883d796c6d P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Committing config change with OpId 9.10: config changed from index 9 to 10, VOTER 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:27:01.506287 16444 raft_consensus.cc:2804] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:27:01.510507 16444 raft_consensus.cc:493] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 16 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:27:01.511152 16444 raft_consensus.cc:3060] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:27:01.512706 10968 leader_election.cc:336] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111)
I20260709 12:27:01.514163 10968 leader_election.cc:304] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:27:01.518126 10895 leader_election.cc:304] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
W20260709 12:27:01.533881 10894 consensus_peers.cc:597] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:01.534570 10894 leader_election.cc:336] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111)
W20260709 12:27:01.535066 10894 leader_election.cc:336] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111)
W20260709 12:27:01.535549 10894 leader_election.cc:336] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111)
W20260709 12:27:01.536087 10894 consensus_peers.cc:597] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:01.540251 16445 raft_consensus.cc:2804] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:01.540872 16445 raft_consensus.cc:493] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:27:01.541363 16445 raft_consensus.cc:3060] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:01.543885 16436 raft_consensus.cc:2804] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:27:01.544469 16436 raft_consensus.cc:493] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:27:01.544865 16436 raft_consensus.cc:3060] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:27:01.549698 10894 leader_election.cc:336] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111)
I20260709 12:27:01.554630 16436 raft_consensus.cc:515] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:27:01.556219 10968 leader_election.cc:304] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:27:01.515074 11001 raft_consensus.cc:2468] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 17.
I20260709 12:27:01.566263 10968 leader_election.cc:304] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:27:01.572872 10998 raft_consensus.cc:2468] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 11.
I20260709 12:27:01.578189 16436 leader_election.cc:290] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 17 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:27:01.579164 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:27:01.580121 11002 raft_consensus.cc:2468] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 10.
I20260709 12:27:01.590190 16438 raft_consensus.cc:2804] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:27:01.591034 16438 raft_consensus.cc:697] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 16 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:27:01.569463 16439 raft_consensus.cc:2804] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:27:01.591838 16439 raft_consensus.cc:493] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:27:01.592458 16439 raft_consensus.cc:3060] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:27:01.591776 16445 raft_consensus.cc:515] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:27:01.597636 11588 consensus_peers.cc:597] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:01.611294 10925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac83709373b4efd9c3aa1472a9f9022" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:27:01.611644 16438 consensus_queue.cc:237] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:27:01.612324 10925 raft_consensus.cc:2393] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 10: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:27:01.618403 16445 leader_election.cc:290] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 10 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:27:01.622412 10920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
W20260709 12:27:01.663684 10894 leader_election.cc:336] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111)
I20260709 12:27:01.679057 10968 leader_election.cc:304] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:27:01.681203 16157 raft_consensus.cc:3060] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:01.724517 16444 raft_consensus.cc:515] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:27:01.728825 10920 raft_consensus.cc:2393] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate edcc56ddd3264984b4da6c1db59e7f08 in current term 17: Already voted for candidate e2d5c637307a407ab688f5ccd6f0fcea in this term.
I20260709 12:27:01.729626 10895 leader_election.cc:304] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:27:01.732014 16433 raft_consensus.cc:2804] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:27:01.732579 16433 raft_consensus.cc:697] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:27:01.733137 10895 leader_election.cc:304] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:27:01.733700 16433 consensus_queue.cc:237] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:27:01.734637 16442 raft_consensus.cc:2804] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:27:01.735212 16442 raft_consensus.cc:697] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 17 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:27:01.736127 16442 consensus_queue.cc:237] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:27:01.736892 16444 leader_election.cc:290] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 17 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:27:01.737829 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac83709373b4efd9c3aa1472a9f9022" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:27:01.734638 10895 leader_election.cc:304] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:27:01.749239 16446 raft_consensus.cc:2804] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:01.749830 16446 raft_consensus.cc:493] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Starting leader election (detected failure of leader 80cd7d227db44f34a6108591dad9c040)
I20260709 12:27:01.750233 16446 raft_consensus.cc:3060] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:27:01.752399 10894 leader_election.cc:336] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111)
I20260709 12:27:01.766362 16157 raft_consensus.cc:2749] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:01.780292 10998 raft_consensus.cc:2468] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 10.
W20260709 12:27:01.816543 10894 consensus_peers.cc:597] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:01.782840 16439 raft_consensus.cc:515] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:27:01.821585 16439 leader_election.cc:290] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 16 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:27:01.829008 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:27:01.829881 10998 raft_consensus.cc:2393] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e2d5c637307a407ab688f5ccd6f0fcea in current term 17: Already voted for candidate edcc56ddd3264984b4da6c1db59e7f08 in this term.
I20260709 12:27:01.832165 10895 leader_election.cc:304] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:27:01.833356 10895 leader_election.cc:304] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:27:01.833380 16402 raft_consensus.cc:2804] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:27:01.834139 16402 raft_consensus.cc:697] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:27:01.834851 16444 raft_consensus.cc:2749] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:27:01.834684 16446 raft_consensus.cc:515] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } }
W20260709 12:27:01.838207 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 154845us
I20260709 12:27:01.835141 16402 consensus_queue.cc:237] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:27:01.860117 16446 leader_election.cc:290] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 election: Requested vote from peers edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945), 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265)
I20260709 12:27:01.862880 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7a4ac9606419a90700eec61a02bd8" candidate_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:27:01.864177 10999 raft_consensus.cc:3060] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:27:01.871129 10894 leader_election.cc:336] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111)
W20260709 12:27:01.903330 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 63128.1us
W20260709 12:27:01.904071 10968 leader_election.cc:336] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111)
I20260709 12:27:01.904567 10968 leader_election.cc:304] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:27:01.906463 16439 raft_consensus.cc:2749] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:27:01.913553 10999 raft_consensus.cc:2468] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2d5c637307a407ab688f5ccd6f0fcea in term 11.
I20260709 12:27:01.916204 10895 leader_election.cc:304] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:27:01.923992 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b6ea992cd64650b1c2da6c548d012f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:27:01.925117 10929 raft_consensus.cc:3060] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:27:01.927309 16433 raft_consensus.cc:2804] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:27:01.928049 16433 raft_consensus.cc:697] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 LEADER]: Becoming Leader. State: Replica: e2d5c637307a407ab688f5ccd6f0fcea, State: Running, Role: LEADER
I20260709 12:27:01.929068 16433 consensus_queue.cc:237] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } }
I20260709 12:27:01.937433 10752 catalog_manager.cc:5697] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 15 to 16, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 16 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
W20260709 12:27:01.972890  9681 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 10875)
I20260709 12:27:01.977875 10929 raft_consensus.cc:2468] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 16.
W20260709 12:27:01.979848 10968 leader_election.cc:336] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111)
I20260709 12:27:01.987035 10751 catalog_manager.cc:5697] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 12 to 17. New cstate: current_term: 17 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:01.998188 10968 leader_election.cc:304] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:27:01.999486 16458 raft_consensus.cc:2804] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:27:02.000375 16458 raft_consensus.cc:697] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 16 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:27:01.999382 10751 catalog_manager.cc:5697] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 10 to 11, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 11 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:02.001632 16458 consensus_queue.cc:237] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:27:02.003201 10751 catalog_manager.cc:5697] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 9 to 10, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 10 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } }
W20260709 12:27:02.042097 10968 consensus_peers.cc:597] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:02.073369 10738 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 94688.7us
W20260709 12:27:02.078187 10738 catalog_manager.cc:4755] TS 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 54df1a3d45b746398c2831883d796c6d: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111)
I20260709 12:27:02.090225 10751 catalog_manager.cc:5697] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 15 to 16, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 16 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:02.098979 10752 catalog_manager.cc:5697] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: term changed from 10 to 11, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66). New cstate: current_term: 11 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:02.153846 10999 raft_consensus.cc:1275] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 12:27:02.173019 10894 consensus_peers.cc:597] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:02.176486 10929 raft_consensus.cc:1275] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 16 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:27:02.179422 16444 consensus_queue.cc:1048] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:27:02.186345 16157 consensus_queue.cc:1048] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:27:02.246043 10894 consensus_peers.cc:597] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:02.333668 11002 raft_consensus.cc:1275] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:27:02.339275 16402 consensus_queue.cc:1048] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 12:27:02.386427 10999 raft_consensus.cc:1275] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 17 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 12:27:02.388316 10894 consensus_peers.cc:597] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:02.404086 16433 consensus_queue.cc:1048] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:27:02.408782 10968 consensus_peers.cc:597] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:02.410362 10999 raft_consensus.cc:1275] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:27:02.420862 16433 consensus_queue.cc:1048] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
W20260709 12:27:02.442418 10894 consensus_peers.cc:597] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:02.462585 10925 raft_consensus.cc:1275] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 16 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 12:27:02.477439 10894 consensus_peers.cc:597] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:02.487955 10894 consensus_peers.cc:597] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:02.478547 16157 consensus_queue.cc:1048] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:27:02.616991 10894 consensus_peers.cc:597] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:02.625159 11588 consensus_peers.cc:597] T ab816bcc6183447994a2cc013e46c5f8 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:02.736464 10894 consensus_peers.cc:597] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:02.773942 10894 consensus_peers.cc:597] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:02.822764 10894 consensus_peers.cc:597] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:02.856323 10894 consensus_peers.cc:597] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:02.929286 10894 consensus_peers.cc:597] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:02.932955 11588 consensus_peers.cc:597] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:02.940073 10894 consensus_peers.cc:597] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:02.973708  9681 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 10875)
W20260709 12:27:02.997845 11588 consensus_peers.cc:597] T e9331e5342644ca2bae19187b083a7d5 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:03.005396 10894 consensus_peers.cc:597] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:03.007015 10894 consensus_peers.cc:597] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:03.045270 11588 consensus_peers.cc:597] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:03.220292 10968 consensus_peers.cc:597] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:03.256546 11588 consensus_peers.cc:597] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:03.324916 11588 consensus_peers.cc:597] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:03.325977 10968 consensus_peers.cc:597] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:03.347734 10894 consensus_peers.cc:597] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:03.351903 11588 consensus_peers.cc:597] T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:03.353363 10800 auto_rebalancer.cc:629] Failed to schedule move for tablet 02a088f690eb45beb958d74519a39b7f: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111)
I20260709 12:27:03.366058 10929 consensus_queue.cc:237] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
W20260709 12:27:03.372961 10738 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 52004.6us
W20260709 12:27:03.377285 10738 catalog_manager.cc:4755] TS 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 54df1a3d45b746398c2831883d796c6d: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111)
I20260709 12:27:03.392710 11002 raft_consensus.cc:1275] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 15 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 12:27:03.398031 10895 consensus_peers.cc:597] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613): Couldn't send request to peer 3c52e0825c02476e89d84da9bb849f5d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f52e71e935934a298445f2f87c913f9e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:03.399844 16446 consensus_queue.cc:1048] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 12:27:03.405452 10894 consensus_peers.cc:597] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:03.406273 10894 consensus_peers.cc:597] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:03.433120 11588 consensus_peers.cc:597] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:03.465652 11588 consensus_peers.cc:597] T 435d66c6d38c4d8a90a81975a6a0cb13 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:27:03.466074 16445 raft_consensus.cc:2955] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 15 LEADER]: Committing config change with OpId 15.13: config changed from index -1 to 13, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:27:03.468631 11001 raft_consensus.cc:2955] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 15 FOLLOWER]: Committing config change with OpId 15.13: config changed from index -1 to 13, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
W20260709 12:27:03.494923 11588 consensus_peers.cc:597] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:03.496929 10968 consensus_peers.cc:597] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:27:03.501657 10752 catalog_manager.cc:5697] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea reported cstate change: config changed from index -1 to 13, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New cstate: current_term: 15 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:27:03.505172 11588 consensus_peers.cc:597] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:27:03.505584 11002 consensus_queue.cc:237] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:27:03.536237 10925 raft_consensus.cc:1275] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 12:27:03.536684 10969 consensus_peers.cc:597] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613): Couldn't send request to peer 3c52e0825c02476e89d84da9bb849f5d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12c494f15d054d2bba575010ccfbb60f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:03.544085 16458 consensus_queue.cc:1048] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:27:03.550761 10968 consensus_peers.cc:597] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:03.579105 10925 raft_consensus.cc:2955] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index -1 to 11, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
W20260709 12:27:03.599834 11588 consensus_peers.cc:597] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:03.600469 11588 consensus_peers.cc:597] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:03.600867 11588 consensus_peers.cc:597] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:27:03.571182 16458 raft_consensus.cc:2955] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 13 LEADER]: Committing config change with OpId 13.11: config changed from index -1 to 11, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
W20260709 12:27:03.637562 10968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 52350.8us
W20260709 12:27:03.674963 10894 consensus_peers.cc:597] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:27:03.689759 16484 raft_consensus.cc:493] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:03.690606 16484 raft_consensus.cc:515] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:27:03.693753 16484 leader_election.cc:290] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:27:03.706379 10968 consensus_peers.cc:597] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:03.726461 10968 consensus_peers.cc:597] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:03.726992 10968 leader_election.cc:336] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111)
W20260709 12:27:03.742596 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 91480.9us
I20260709 12:27:03.743454 10925 consensus_queue.cc:237] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:27:03.760416 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" is_pre_election: true
I20260709 12:27:03.761278 10929 raft_consensus.cc:2468] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 17.
W20260709 12:27:03.769431 11588 consensus_peers.cc:597] T 1f0741f995c74b5c91290f42110a3187 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:03.772294 11588 consensus_peers.cc:597] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:27:03.772450 10968 leader_election.cc:304] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:27:03.773643 16485 raft_consensus.cc:2804] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:27:03.774111 16485 raft_consensus.cc:493] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:03.774444 16485 raft_consensus.cc:3060] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:27:03.813316 16485 raft_consensus.cc:515] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:27:03.822717 10923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a088f690eb45beb958d74519a39b7f" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e2d5c637307a407ab688f5ccd6f0fcea"
I20260709 12:27:03.824218 10923 raft_consensus.cc:3060] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:27:03.818704 16485 leader_election.cc:290] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 18 election: Requested vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:27:03.834947 10752 catalog_manager.cc:5697] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: config changed from index -1 to 11, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New cstate: current_term: 13 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:27:03.836500 10968 consensus_peers.cc:597] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:03.837059 10968 leader_election.cc:336] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111)
I20260709 12:27:03.861209 11002 raft_consensus.cc:1275] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 12:27:03.863338 10895 consensus_peers.cc:597] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613): Couldn't send request to peer 3c52e0825c02476e89d84da9bb849f5d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cb3b4ab419804fabb71d2a98c266b209. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:03.864078 16446 consensus_queue.cc:1048] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:27:03.874377 10894 consensus_peers.cc:597] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:03.894542 10923 raft_consensus.cc:2468] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 18.
I20260709 12:27:03.895205 16493 ts_tablet_manager.cc:933] T f52e71e935934a298445f2f87c913f9e P 3c52e0825c02476e89d84da9bb849f5d: Initiating tablet copy from peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:27:03.909842 10968 leader_election.cc:304] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040
I20260709 12:27:03.914708 16485 raft_consensus.cc:2804] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:27:03.917093 16485 raft_consensus.cc:697] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 18 LEADER]: Becoming Leader. State: Replica: edcc56ddd3264984b4da6c1db59e7f08, State: Running, Role: LEADER
I20260709 12:27:03.918645 16485 consensus_queue.cc:237] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:27:03.923156 16493 tablet_copy_client.cc:323] T f52e71e935934a298445f2f87c913f9e P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Beginning tablet copy session from remote peer at address 127.9.116.66:39339
I20260709 12:27:03.933609 16490 raft_consensus.cc:2955] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 LEADER]: Committing config change with OpId 11.9: config changed from index -1 to 9, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
W20260709 12:27:03.940799 10894 consensus_peers.cc:597] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:27:03.952509 10939 tablet_copy_service.cc:140] P e2d5c637307a407ab688f5ccd6f0fcea: Received BeginTabletCopySession request for tablet f52e71e935934a298445f2f87c913f9e from peer 3c52e0825c02476e89d84da9bb849f5d ({username='slave'} at 127.0.0.1:50036)
I20260709 12:27:03.953287 10939 tablet_copy_service.cc:161] P e2d5c637307a407ab688f5ccd6f0fcea: Beginning new tablet copy session on tablet f52e71e935934a298445f2f87c913f9e from peer 3c52e0825c02476e89d84da9bb849f5d at {username='slave'} at 127.0.0.1:50036: session id = 3c52e0825c02476e89d84da9bb849f5d-f52e71e935934a298445f2f87c913f9e
I20260709 12:27:03.958348 10752 catalog_manager.cc:5697] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: term changed from 16 to 18, leader changed from 80cd7d227db44f34a6108591dad9c040 (127.9.116.65) to edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67). New cstate: current_term: 18 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:03.973326 10939 tablet_copy_source_session.cc:215] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:27:03.974201  9681 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 10875)
I20260709 12:27:03.974102 11001 raft_consensus.cc:2955] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index -1 to 9, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
I20260709 12:27:04.022403 16493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f52e71e935934a298445f2f87c913f9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:04.048533 10752 catalog_manager.cc:5697] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 reported cstate change: config changed from index -1 to 9, NON_VOTER 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) added. New cstate: current_term: 11 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } } }
W20260709 12:27:04.056595 10894 consensus_peers.cc:597] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:27:04.125548 16497 ts_tablet_manager.cc:933] T 12c494f15d054d2bba575010ccfbb60f P 3c52e0825c02476e89d84da9bb849f5d: Initiating tablet copy from peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:27:04.122469 16493 tablet_copy_client.cc:806] T f52e71e935934a298445f2f87c913f9e P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 0 data blocks...
I20260709 12:27:04.158833 16493 tablet_copy_client.cc:670] T f52e71e935934a298445f2f87c913f9e P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:27:04.191270 16493 tablet_copy_client.cc:538] T f52e71e935934a298445f2f87c913f9e P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:27:04.198751 16497 tablet_copy_client.cc:323] T 12c494f15d054d2bba575010ccfbb60f P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Beginning tablet copy session from remote peer at address 127.9.116.67:39945
I20260709 12:27:04.203704 11013 tablet_copy_service.cc:140] P edcc56ddd3264984b4da6c1db59e7f08: Received BeginTabletCopySession request for tablet 12c494f15d054d2bba575010ccfbb60f from peer 3c52e0825c02476e89d84da9bb849f5d ({username='slave'} at 127.0.0.1:57514)
I20260709 12:27:04.204545 11013 tablet_copy_service.cc:161] P edcc56ddd3264984b4da6c1db59e7f08: Beginning new tablet copy session on tablet 12c494f15d054d2bba575010ccfbb60f from peer 3c52e0825c02476e89d84da9bb849f5d at {username='slave'} at 127.0.0.1:57514: session id = 3c52e0825c02476e89d84da9bb849f5d-12c494f15d054d2bba575010ccfbb60f
I20260709 12:27:04.221204 11013 tablet_copy_source_session.cc:215] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:27:04.225953 16497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12c494f15d054d2bba575010ccfbb60f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:04.274065 16493 tablet_bootstrap.cc:492] T f52e71e935934a298445f2f87c913f9e P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap starting.
I20260709 12:27:04.314055 16497 tablet_copy_client.cc:806] T 12c494f15d054d2bba575010ccfbb60f P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 0 data blocks...
I20260709 12:27:04.314754 16497 tablet_copy_client.cc:670] T 12c494f15d054d2bba575010ccfbb60f P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:27:04.332118 16497 tablet_copy_client.cc:538] T 12c494f15d054d2bba575010ccfbb60f P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:27:04.351403 16499 ts_tablet_manager.cc:933] T cb3b4ab419804fabb71d2a98c266b209 P 3c52e0825c02476e89d84da9bb849f5d: Initiating tablet copy from peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:27:04.356933 10968 consensus_peers.cc:597] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:04.374383 10968 consensus_peers.cc:597] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:04.408761 16499 tablet_copy_client.cc:323] T cb3b4ab419804fabb71d2a98c266b209 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Beginning tablet copy session from remote peer at address 127.9.116.66:39339
I20260709 12:27:04.446339 10939 tablet_copy_service.cc:140] P e2d5c637307a407ab688f5ccd6f0fcea: Received BeginTabletCopySession request for tablet cb3b4ab419804fabb71d2a98c266b209 from peer 3c52e0825c02476e89d84da9bb849f5d ({username='slave'} at 127.0.0.1:50036)
I20260709 12:27:04.447072 10939 tablet_copy_service.cc:161] P e2d5c637307a407ab688f5ccd6f0fcea: Beginning new tablet copy session on tablet cb3b4ab419804fabb71d2a98c266b209 from peer 3c52e0825c02476e89d84da9bb849f5d at {username='slave'} at 127.0.0.1:50036: session id = 3c52e0825c02476e89d84da9bb849f5d-cb3b4ab419804fabb71d2a98c266b209
W20260709 12:27:04.475032 10894 consensus_peers.cc:597] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:04.479252 16493 tablet_bootstrap.cc:492] T f52e71e935934a298445f2f87c913f9e P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=0 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:04.451380 16497 tablet_bootstrap.cc:492] T 12c494f15d054d2bba575010ccfbb60f P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap starting.
I20260709 12:27:04.528304 10939 tablet_copy_source_session.cc:215] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:27:04.531970 16493 tablet_bootstrap.cc:492] T f52e71e935934a298445f2f87c913f9e P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap complete.
I20260709 12:27:04.539364 16493 ts_tablet_manager.cc:1403] T f52e71e935934a298445f2f87c913f9e P 3c52e0825c02476e89d84da9bb849f5d: Time spent bootstrapping tablet: real 0.266s	user 0.043s	sys 0.019s
W20260709 12:27:04.571736 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:39339, user_credentials={real_user=slave}} blocked reactor thread for 75133.4us
W20260709 12:27:04.595546 10738 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 56313.7us
I20260709 12:27:04.608520 10923 raft_consensus.cc:1275] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 18 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:27:04.609490 16499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb3b4ab419804fabb71d2a98c266b209. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:04.614212 16504 consensus_queue.cc:1048] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 12:27:04.618480 10738 catalog_manager.cc:4755] TS 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 54df1a3d45b746398c2831883d796c6d: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111)
I20260709 12:27:04.630154 16493 raft_consensus.cc:359] T f52e71e935934a298445f2f87c913f9e P 3c52e0825c02476e89d84da9bb849f5d [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:27:04.631238 16493 raft_consensus.cc:740] T f52e71e935934a298445f2f87c913f9e P 3c52e0825c02476e89d84da9bb849f5d [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Initialized, Role: LEARNER
I20260709 12:27:04.633208 16493 consensus_queue.cc:260] T f52e71e935934a298445f2f87c913f9e P 3c52e0825c02476e89d84da9bb849f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:27:04.637197 16493 ts_tablet_manager.cc:1434] T f52e71e935934a298445f2f87c913f9e P 3c52e0825c02476e89d84da9bb849f5d: Time spent starting tablet: real 0.097s	user 0.002s	sys 0.009s
I20260709 12:27:04.648511 10939 tablet_copy_service.cc:342] P e2d5c637307a407ab688f5ccd6f0fcea: Request end of tablet copy session 3c52e0825c02476e89d84da9bb849f5d-f52e71e935934a298445f2f87c913f9e received from {username='slave'} at 127.0.0.1:50036
I20260709 12:27:04.649135 10939 tablet_copy_service.cc:434] P e2d5c637307a407ab688f5ccd6f0fcea: ending tablet copy session 3c52e0825c02476e89d84da9bb849f5d-f52e71e935934a298445f2f87c913f9e on tablet f52e71e935934a298445f2f87c913f9e with peer 3c52e0825c02476e89d84da9bb849f5d
W20260709 12:27:04.662001 10894 consensus_peers.cc:597] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:04.667176 10894 consensus_peers.cc:597] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:27:04.779865 16499 tablet_copy_client.cc:806] T cb3b4ab419804fabb71d2a98c266b209 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 0 data blocks...
I20260709 12:27:04.780790 16499 tablet_copy_client.cc:670] T cb3b4ab419804fabb71d2a98c266b209 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:27:04.785645 16499 tablet_copy_client.cc:538] T cb3b4ab419804fabb71d2a98c266b209 P 3c52e0825c02476e89d84da9bb849f5d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:27:04.799824 10894 consensus_peers.cc:597] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:27:04.816560 16499 tablet_bootstrap.cc:492] T cb3b4ab419804fabb71d2a98c266b209 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap starting.
I20260709 12:27:04.902197 16497 tablet_bootstrap.cc:492] T 12c494f15d054d2bba575010ccfbb60f P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:04.903318 16497 tablet_bootstrap.cc:492] T 12c494f15d054d2bba575010ccfbb60f P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap complete.
I20260709 12:27:04.904613 16497 ts_tablet_manager.cc:1403] T 12c494f15d054d2bba575010ccfbb60f P 3c52e0825c02476e89d84da9bb849f5d: Time spent bootstrapping tablet: real 0.454s	user 0.049s	sys 0.017s
W20260709 12:27:04.955986 10894 consensus_peers.cc:597] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:04.975649  9681 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 10875)
I20260709 12:27:04.971781 11618 raft_consensus.cc:1217] T f52e71e935934a298445f2f87c913f9e P 3c52e0825c02476e89d84da9bb849f5d [term 15 LEARNER]: Deduplicated request from leader. Original: 15.12->[15.13-15.13]   Dedup: 15.13->[]
W20260709 12:27:04.990551 10894 consensus_peers.cc:597] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:27:04.931551 16497 raft_consensus.cc:359] T 12c494f15d054d2bba575010ccfbb60f P 3c52e0825c02476e89d84da9bb849f5d [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:27:05.016685 16497 raft_consensus.cc:740] T 12c494f15d054d2bba575010ccfbb60f P 3c52e0825c02476e89d84da9bb849f5d [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Initialized, Role: LEARNER
I20260709 12:27:05.017665 16497 consensus_queue.cc:260] T 12c494f15d054d2bba575010ccfbb60f P 3c52e0825c02476e89d84da9bb849f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:27:05.065790 16497 ts_tablet_manager.cc:1434] T 12c494f15d054d2bba575010ccfbb60f P 3c52e0825c02476e89d84da9bb849f5d: Time spent starting tablet: real 0.161s	user 0.009s	sys 0.000s
I20260709 12:27:05.068027 11013 tablet_copy_service.cc:342] P edcc56ddd3264984b4da6c1db59e7f08: Request end of tablet copy session 3c52e0825c02476e89d84da9bb849f5d-12c494f15d054d2bba575010ccfbb60f received from {username='slave'} at 127.0.0.1:57514
I20260709 12:27:05.068697 11013 tablet_copy_service.cc:434] P edcc56ddd3264984b4da6c1db59e7f08: ending tablet copy session 3c52e0825c02476e89d84da9bb849f5d-12c494f15d054d2bba575010ccfbb60f on tablet 12c494f15d054d2bba575010ccfbb60f with peer 3c52e0825c02476e89d84da9bb849f5d
W20260709 12:27:05.077329 10894 consensus_peers.cc:597] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:05.125471 11618 raft_consensus.cc:1217] T 12c494f15d054d2bba575010ccfbb60f P 3c52e0825c02476e89d84da9bb849f5d [term 13 LEARNER]: Deduplicated request from leader. Original: 13.10->[13.11-13.11]   Dedup: 13.11->[]
W20260709 12:27:05.166524 10968 consensus_peers.cc:597] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:05.168651 10894 consensus_peers.cc:597] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:05.212889 10894 consensus_peers.cc:597] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:05.256711 11588 consensus_peers.cc:597] T ab816bcc6183447994a2cc013e46c5f8 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:05.303782 10894 consensus_peers.cc:597] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:05.311726 11588 consensus_peers.cc:597] T e9331e5342644ca2bae19187b083a7d5 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:05.342193 16499 log.cc:927] Time spent T cb3b4ab419804fabb71d2a98c266b209 P 3c52e0825c02476e89d84da9bb849f5d: Append to log took a long time: real 0.059s	user 0.003s	sys 0.001s
W20260709 12:27:05.348951 10894 consensus_peers.cc:597] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:05.351063 11588 consensus_peers.cc:597] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:27:05.352509 16499 tablet_bootstrap.cc:492] T cb3b4ab419804fabb71d2a98c266b209 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:27:05.353741 10894 consensus_peers.cc:597] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:05.355181 10894 consensus_peers.cc:597] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:27:05.359078 16499 tablet_bootstrap.cc:492] T cb3b4ab419804fabb71d2a98c266b209 P 3c52e0825c02476e89d84da9bb849f5d: Bootstrap complete.
I20260709 12:27:05.360105 16499 ts_tablet_manager.cc:1403] T cb3b4ab419804fabb71d2a98c266b209 P 3c52e0825c02476e89d84da9bb849f5d: Time spent bootstrapping tablet: real 0.544s	user 0.031s	sys 0.018s
I20260709 12:27:05.387856 16499 raft_consensus.cc:359] T cb3b4ab419804fabb71d2a98c266b209 P 3c52e0825c02476e89d84da9bb849f5d [term 11 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:27:05.388805 16499 raft_consensus.cc:740] T cb3b4ab419804fabb71d2a98c266b209 P 3c52e0825c02476e89d84da9bb849f5d [term 11 LEARNER]: Becoming Follower/Learner. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Initialized, Role: LEARNER
I20260709 12:27:05.391460 16499 consensus_queue.cc:260] T cb3b4ab419804fabb71d2a98c266b209 P 3c52e0825c02476e89d84da9bb849f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: NON_VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: true } }
I20260709 12:27:05.398787 16499 ts_tablet_manager.cc:1434] T cb3b4ab419804fabb71d2a98c266b209 P 3c52e0825c02476e89d84da9bb849f5d: Time spent starting tablet: real 0.038s	user 0.008s	sys 0.000s
W20260709 12:27:05.406024 10894 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111) [suppressed 448 similar messages]
W20260709 12:27:05.412726 10894 consensus_peers.cc:597] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:27:05.418074 10939 tablet_copy_service.cc:342] P e2d5c637307a407ab688f5ccd6f0fcea: Request end of tablet copy session 3c52e0825c02476e89d84da9bb849f5d-cb3b4ab419804fabb71d2a98c266b209 received from {username='slave'} at 127.0.0.1:50036
I20260709 12:27:05.418613 10939 tablet_copy_service.cc:434] P e2d5c637307a407ab688f5ccd6f0fcea: ending tablet copy session 3c52e0825c02476e89d84da9bb849f5d-cb3b4ab419804fabb71d2a98c266b209 on tablet cb3b4ab419804fabb71d2a98c266b209 with peer 3c52e0825c02476e89d84da9bb849f5d
W20260709 12:27:05.492734 10894 consensus_peers.cc:597] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:27:05.496892 11618 raft_consensus.cc:1217] T cb3b4ab419804fabb71d2a98c266b209 P 3c52e0825c02476e89d84da9bb849f5d [term 11 LEARNER]: Deduplicated request from leader. Original: 11.8->[11.9-11.9]   Dedup: 11.9->[]
I20260709 12:27:05.537163 16445 raft_consensus.cc:1064] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea: attempting to promote NON_VOTER 3c52e0825c02476e89d84da9bb849f5d to VOTER
I20260709 12:27:05.540369 16445 consensus_queue.cc:237] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 11, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:27:05.574493 10968 consensus_peers.cc:597] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:27:05.596447 16487 raft_consensus.cc:1064] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08: attempting to promote NON_VOTER 3c52e0825c02476e89d84da9bb849f5d to VOTER
I20260709 12:27:05.600011 16487 consensus_queue.cc:237] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 9, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:27:05.665238 11588 consensus_peers.cc:597] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:27:05.703791 11623 raft_consensus.cc:1275] T f52e71e935934a298445f2f87c913f9e P 3c52e0825c02476e89d84da9bb849f5d [term 15 LEARNER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:27:05.708518 11623 raft_consensus.cc:1275] T 12c494f15d054d2bba575010ccfbb60f P 3c52e0825c02476e89d84da9bb849f5d [term 13 LEARNER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:27:05.712040 16485 consensus_queue.cc:1048] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:27:05.752852 10923 raft_consensus.cc:1275] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Refusing update from remote peer edcc56ddd3264984b4da6c1db59e7f08: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:27:05.765023 16518 consensus_queue.cc:1048] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:27:05.769409 10894 consensus_peers.cc:597] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:05.770119 10968 consensus_peers.cc:597] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:05.770750 10968 consensus_peers.cc:597] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:27:05.772768 10999 raft_consensus.cc:1275] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 15 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:27:05.778072 16517 consensus_queue.cc:1048] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:27:05.795389 16485 consensus_queue.cc:1048] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:27:05.797274 11588 consensus_peers.cc:597] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:05.807293 11588 consensus_peers.cc:597] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:05.824154 11588 consensus_peers.cc:597] T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:27:05.867249 16517 raft_consensus.cc:2955] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 15 LEADER]: Committing config change with OpId 15.14: config changed from index 13 to 14, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:27:05.885315 11624 raft_consensus.cc:2955] T f52e71e935934a298445f2f87c913f9e P 3c52e0825c02476e89d84da9bb849f5d [term 15 FOLLOWER]: Committing config change with OpId 15.14: config changed from index 13 to 14, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:27:05.888682 16445 raft_consensus.cc:1064] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea: attempting to promote NON_VOTER 3c52e0825c02476e89d84da9bb849f5d to VOTER
I20260709 12:27:05.892402 16445 consensus_queue.cc:237] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:27:05.907305 16485 raft_consensus.cc:2955] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 13 LEADER]: Committing config change with OpId 13.12: config changed from index 11 to 12, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:27:05.912325 10929 raft_consensus.cc:2955] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 11 to 12, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:27:05.953523 10751 catalog_manager.cc:5697] T f52e71e935934a298445f2f87c913f9e P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: config changed from index 13 to 14, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:27:05.970419 11001 raft_consensus.cc:2955] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 15 FOLLOWER]: Committing config change with OpId 15.14: config changed from index 13 to 14, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
W20260709 12:27:05.984099  9681 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 10875)
W20260709 12:27:05.988351 11588 consensus_peers.cc:597] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:06.042263 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:46265, user_credentials={real_user=slave}} blocked reactor thread for 53107.2us
W20260709 12:27:06.068663 10894 consensus_peers.cc:597] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:06.071055 11624 raft_consensus.cc:1275] T cb3b4ab419804fabb71d2a98c266b209 P 3c52e0825c02476e89d84da9bb849f5d [term 11 LEARNER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:27:06.071533 10999 raft_consensus.cc:1275] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Refusing update from remote peer e2d5c637307a407ab688f5ccd6f0fcea: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:27:06.073356 11624 raft_consensus.cc:2955] T 12c494f15d054d2bba575010ccfbb60f P 3c52e0825c02476e89d84da9bb849f5d [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 11 to 12, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:27:06.087153 16445 consensus_queue.cc:1048] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:27:06.089367 16520 consensus_queue.cc:1048] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:27:06.113592 11588 consensus_peers.cc:597] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:06.152402 11588 consensus_peers.cc:597] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:06.154310 11588 consensus_peers.cc:597] T 435d66c6d38c4d8a90a81975a6a0cb13 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:06.160141 11588 consensus_peers.cc:597] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:06.164050 10894 consensus_peers.cc:597] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:06.165827 11588 consensus_peers.cc:597] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:27:06.167364 16445 raft_consensus.cc:2955] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 LEADER]: Committing config change with OpId 11.10: config changed from index 9 to 10, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:27:06.186110 10999 raft_consensus.cc:2955] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:27:06.187700 11624 raft_consensus.cc:2955] T cb3b4ab419804fabb71d2a98c266b209 P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
W20260709 12:27:06.245658 10894 consensus_peers.cc:597] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:06.245975 16531 log.cc:927] Time spent T 00000000000000000000000000000000 P 9619ad7a9e7f4d9b8039487e3ee77243: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
W20260709 12:27:06.251214 10968 consensus_peers.cc:597] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:06.290426 10968 consensus_peers.cc:597] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:06.302865 11588 consensus_peers.cc:597] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:27:06.349211 10748 catalog_manager.cc:5697] T 12c494f15d054d2bba575010ccfbb60f P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: config changed from index 11 to 12, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "edcc56ddd3264984b4da6c1db59e7f08" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
I20260709 12:27:06.351670 10748 catalog_manager.cc:5697] T cb3b4ab419804fabb71d2a98c266b209 P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: config changed from index 9 to 10, 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68) changed from NON_VOTER to VOTER. New cstate: current_term: 11 leader_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } } }
W20260709 12:27:06.449877 11588 consensus_peers.cc:597] T 1f0741f995c74b5c91290f42110a3187 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:06.468040 10968 consensus_peers.cc:597] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:06.473284 11588 consensus_peers.cc:597] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:06.601621 10894 consensus_peers.cc:597] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:06.641649 10968 consensus_peers.cc:597] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:06.765731 10738 catalog_manager.cc:4755] TS 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 54df1a3d45b746398c2831883d796c6d: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111)
W20260709 12:27:06.798228 10968 consensus_peers.cc:597] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:06.939213 10894 consensus_peers.cc:597] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:06.988196  9681 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 10875)
W20260709 12:27:07.204681 10894 consensus_peers.cc:597] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:07.298571 10894 consensus_peers.cc:597] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:07.313308 10969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37613, user_credentials={real_user=slave}} blocked reactor thread for 77761.5us
W20260709 12:27:07.311810 10894 consensus_peers.cc:597] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:07.373806 10894 consensus_peers.cc:597] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:07.472239 10968 consensus_peers.cc:597] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:07.618331 11588 consensus_peers.cc:597] T ab816bcc6183447994a2cc013e46c5f8 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:07.630949 10894 consensus_peers.cc:597] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:07.668720 10894 consensus_peers.cc:597] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:07.801829 10894 consensus_peers.cc:597] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:07.822379 10894 consensus_peers.cc:597] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:07.831736 10894 consensus_peers.cc:597] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:07.889879 10894 consensus_peers.cc:597] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:07.900019 11588 consensus_peers.cc:597] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:07.909677 10894 consensus_peers.cc:597] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:07.941608 10894 consensus_peers.cc:597] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:07.969424 10894 consensus_peers.cc:597] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:07.970269 10894 consensus_peers.cc:597] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:07.970783 10894 consensus_peers.cc:597] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:07.988963  9681 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 10875)
W20260709 12:27:08.061082 10968 consensus_peers.cc:597] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:08.094084 11588 consensus_peers.cc:597] T e9331e5342644ca2bae19187b083a7d5 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:08.118324 11588 consensus_peers.cc:597] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:08.184542 11588 consensus_peers.cc:597] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:08.373492 11588 consensus_peers.cc:597] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:08.386977 11588 consensus_peers.cc:597] T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:08.399255 10968 consensus_peers.cc:597] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:08.403362 10894 consensus_peers.cc:597] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:08.453135 11588 consensus_peers.cc:597] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:08.528492 10894 consensus_peers.cc:597] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:08.548923 10968 consensus_peers.cc:597] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:08.554919 11588 consensus_peers.cc:597] T 435d66c6d38c4d8a90a81975a6a0cb13 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:08.584826 11588 consensus_peers.cc:597] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:08.692380 11588 consensus_peers.cc:597] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:08.772224 11588 consensus_peers.cc:597] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:08.773432 10894 consensus_peers.cc:597] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:08.783793 11588 consensus_peers.cc:597] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:08.814076 10968 consensus_peers.cc:597] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:08.817763 11588 consensus_peers.cc:597] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:08.826464 10968 consensus_peers.cc:597] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:08.839107 11588 consensus_peers.cc:597] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:08.863646 11588 consensus_peers.cc:597] T 1f0741f995c74b5c91290f42110a3187 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:08.953589 10968 consensus_peers.cc:597] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:08.979674 10894 consensus_peers.cc:597] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:08.984181 10968 consensus_peers.cc:597] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:08.989504  9681 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 10875)
W20260709 12:27:09.216591 10894 consensus_peers.cc:597] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:09.274281 10968 consensus_peers.cc:597] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:09.766034 10895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 109427us
W20260709 12:27:09.781894 10894 consensus_peers.cc:597] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:09.785879 10894 consensus_peers.cc:597] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:09.881546 10894 consensus_peers.cc:597] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:09.882534 10894 consensus_peers.cc:597] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:10.023500 10894 consensus_peers.cc:597] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:10.165485 10894 consensus_peers.cc:597] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:10.195713 11588 consensus_peers.cc:597] T ab816bcc6183447994a2cc013e46c5f8 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:10.201915 10968 consensus_peers.cc:597] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:10.229216 10894 consensus_peers.cc:597] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:27:10.253821  9681 tablet_server.cc:196] TabletServer@127.9.116.65:0 shutdown complete.
W20260709 12:27:10.333214 10894 consensus_peers.cc:597] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:10.380897 10894 consensus_peers.cc:597] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:10.391853 10894 consensus_peers.cc:597] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:10.394760 10894 consensus_peers.cc:597] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:10.429018 11588 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111) [suppressed 446 similar messages]
W20260709 12:27:10.434441 11588 consensus_peers.cc:597] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:27:10.456262  9681 tablet_server.cc:179] TabletServer@127.9.116.66:0 shutting down...
W20260709 12:27:10.468396 11588 consensus_peers.cc:597] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:10.476276 10968 consensus_peers.cc:597] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 -> Peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Couldn't send request to peer e2d5c637307a407ab688f5ccd6f0fcea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:10.490609 11588 consensus_peers.cc:597] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:10.518335 11588 consensus_peers.cc:597] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d -> Peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Couldn't send request to peer e2d5c637307a407ab688f5ccd6f0fcea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:10.531069 10968 consensus_peers.cc:597] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 -> Peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Couldn't send request to peer e2d5c637307a407ab688f5ccd6f0fcea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:10.540802 11588 consensus_peers.cc:597] T e8b17195a94142039c40f598ed006c94 P 3c52e0825c02476e89d84da9bb849f5d -> Peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Couldn't send request to peer e2d5c637307a407ab688f5ccd6f0fcea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:10.547686 10894 consensus_peers.cc:597] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:10.552901 10894 consensus_peers.cc:597] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:27:10.559552  9681 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:10.561326  9681 tablet_replica.cc:333] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea: stopping tablet replica
I20260709 12:27:10.563637  9681 raft_consensus.cc:2243] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:27:10.565276  9681 raft_consensus.cc:2272] T 24c913e527ff46578e084c41eab7bb9d P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.568648  9681 tablet_replica.cc:333] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea: stopping tablet replica
I20260709 12:27:10.569607  9681 raft_consensus.cc:2243] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:10.570393  9681 raft_consensus.cc:2272] T dad6a1da21304fcfacab384a6afc4101 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:10.573055 11024 debug-util.cc:398] Leaking SignalData structure 0x7b080015b440 after lost signal to thread 9684
I20260709 12:27:10.573386  9681 tablet_replica.cc:333] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea: stopping tablet replica
W20260709 12:27:10.574344 11024 debug-util.cc:398] Leaking SignalData structure 0x7b08000fba80 after lost signal to thread 10786
I20260709 12:27:10.574438  9681 raft_consensus.cc:2243] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:10.575266  9681 raft_consensus.cc:2272] T d0aed74af73a488f8b691578ca370226 P e2d5c637307a407ab688f5ccd6f0fcea [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:10.575891 11024 debug-util.cc:398] Leaking SignalData structure 0x7b080016e500 after lost signal to thread 10953
W20260709 12:27:10.577126 11024 debug-util.cc:398] Leaking SignalData structure 0x7b08002cf420 after lost signal to thread 11027
I20260709 12:27:10.578038  9681 tablet_replica.cc:333] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea: stopping tablet replica
W20260709 12:27:10.578425 11024 debug-util.cc:398] Leaking SignalData structure 0x7b080036bee0 after lost signal to thread 11648
I20260709 12:27:10.579031  9681 raft_consensus.cc:2243] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Raft consensus shutting down.
W20260709 12:27:10.579457 10968 consensus_peers.cc:597] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:27:10.580610  9681 raft_consensus.cc:2272] T 2ac8522e549a46e09593fa4c2e175557 P e2d5c637307a407ab688f5ccd6f0fcea [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:10.582006 10968 consensus_peers.cc:597] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 -> Peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Couldn't send request to peer e2d5c637307a407ab688f5ccd6f0fcea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:10.587200  9681 tablet_replica.cc:333] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea: stopping tablet replica
I20260709 12:27:10.594015  9681 raft_consensus.cc:2243] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:27:10.599452  9681 raft_consensus.cc:2272] T 834361a055d34950b4edecba39f07657 P e2d5c637307a407ab688f5ccd6f0fcea [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:10.597463 11588 consensus_peers.cc:597] T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d -> Peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Couldn't send request to peer e2d5c637307a407ab688f5ccd6f0fcea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:10.605845 11588 consensus_peers.cc:597] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d -> Peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Couldn't send request to peer e2d5c637307a407ab688f5ccd6f0fcea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:10.608242  9681 tablet_replica.cc:333] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea: stopping tablet replica
I20260709 12:27:10.609169  9681 raft_consensus.cc:2243] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 13 LEADER]: Raft consensus shutting down.
W20260709 12:27:10.610749 10968 consensus_peers.cc:597] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 -> Peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Couldn't send request to peer e2d5c637307a407ab688f5ccd6f0fcea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:10.613584  9681 raft_consensus.cc:2272] T 3589745d67944a8a9a5c66ee8d04fc62 P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.621608  9681 tablet_replica.cc:333] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea: stopping tablet replica
I20260709 12:27:10.622732  9681 raft_consensus.cc:2243] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:10.623513  9681 raft_consensus.cc:2272] T 07a194e99ec5435b9e871484ecb661a1 P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.627890  9681 tablet_replica.cc:333] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea: stopping tablet replica
I20260709 12:27:10.628868  9681 raft_consensus.cc:2243] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:10.629873  9681 raft_consensus.cc:2272] T 53f8ad7184804b8da671a0b32db088ba P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.633459  9681 tablet_replica.cc:333] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea: stopping tablet replica
I20260709 12:27:10.634600  9681 raft_consensus.cc:2243] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:10.635382  9681 raft_consensus.cc:2272] T f5b822586ed04f2cb681fefd045b3f6d P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.638252  9681 tablet_replica.cc:333] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea: stopping tablet replica
I20260709 12:27:10.639389  9681 raft_consensus.cc:2243] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:27:10.646093  9681 raft_consensus.cc:2272] T 3f8a389131ef4c77a3e08488aa4759eb P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.649904  9681 tablet_replica.cc:333] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea: stopping tablet replica
I20260709 12:27:10.650784  9681 raft_consensus.cc:2243] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:10.651465  9681 raft_consensus.cc:2272] T 69fd8fdac2fa449e9e184f3d668ea1a7 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.655076  9681 tablet_replica.cc:333] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea: stopping tablet replica
I20260709 12:27:10.655987  9681 raft_consensus.cc:2243] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:27:10.659385  9681 raft_consensus.cc:2272] T c72fddfc26044838a71a798f3371636b P e2d5c637307a407ab688f5ccd6f0fcea [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.662907  9681 tablet_replica.cc:333] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea: stopping tablet replica
I20260709 12:27:10.664024  9681 raft_consensus.cc:2243] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:27:10.665977  9681 raft_consensus.cc:2272] T f52e71e935934a298445f2f87c913f9e P e2d5c637307a407ab688f5ccd6f0fcea [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.669023  9681 tablet_replica.cc:333] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea: stopping tablet replica
I20260709 12:27:10.670094  9681 raft_consensus.cc:2243] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:27:10.672195  9681 raft_consensus.cc:2272] T 928860b1f6314ad3bd3582c7f89e460e P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.676054  9681 tablet_replica.cc:333] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea: stopping tablet replica
I20260709 12:27:10.676852  9681 raft_consensus.cc:2243] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:27:10.678064  9681 raft_consensus.cc:2272] T ad766f48812a4ddeb383179b1d84907b P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.682971  9681 tablet_replica.cc:333] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea: stopping tablet replica
I20260709 12:27:10.684967  9681 raft_consensus.cc:2243] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:10.686081  9681 raft_consensus.cc:2272] T 8b297008d51d40b98784ce74e225b8f5 P e2d5c637307a407ab688f5ccd6f0fcea [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.688828  9681 tablet_replica.cc:333] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea: stopping tablet replica
I20260709 12:27:10.689687  9681 raft_consensus.cc:2243] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:27:10.690963  9681 raft_consensus.cc:2272] T 266989ea58c040cea1d5f1b425ba2d3b P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.694868  9681 tablet_replica.cc:333] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea: stopping tablet replica
I20260709 12:27:10.695832  9681 raft_consensus.cc:2243] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:27:10.697158  9681 raft_consensus.cc:2272] T cd87c382c98f42fdb9ced96cf57e9714 P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.699895  9681 tablet_replica.cc:333] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea: stopping tablet replica
I20260709 12:27:10.700995  9681 raft_consensus.cc:2243] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:10.701737  9681 raft_consensus.cc:2272] T 73d7ffc5e5d146d1b661abde11cf2f04 P e2d5c637307a407ab688f5ccd6f0fcea [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.704806  9681 tablet_replica.cc:333] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea: stopping tablet replica
W20260709 12:27:10.705801 10968 consensus_peers.cc:597] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 -> Peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Couldn't send request to peer e2d5c637307a407ab688f5ccd6f0fcea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:10.707792 10894 consensus_peers.cc:597] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:27:10.706328  9681 raft_consensus.cc:2243] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:27:10.710229  9681 raft_consensus.cc:2272] T cb3b4ab419804fabb71d2a98c266b209 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:10.712067 10968 consensus_peers.cc:597] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 -> Peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Couldn't send request to peer e2d5c637307a407ab688f5ccd6f0fcea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:10.715377  9681 tablet_replica.cc:333] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea: stopping tablet replica
I20260709 12:27:10.716375  9681 raft_consensus.cc:2243] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:10.717041  9681 raft_consensus.cc:2272] T 4ef3220c51df47db8859f07ab745fad5 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.720512  9681 tablet_replica.cc:333] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea: stopping tablet replica
I20260709 12:27:10.722021  9681 raft_consensus.cc:2243] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:10.722844  9681 raft_consensus.cc:2272] T 18294423a68a4671bf6c5a0f98645e4c P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.726408  9681 tablet_replica.cc:333] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea: stopping tablet replica
I20260709 12:27:10.727494  9681 raft_consensus.cc:2243] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:10.728629  9681 raft_consensus.cc:2272] T 12c494f15d054d2bba575010ccfbb60f P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.731926  9681 tablet_replica.cc:333] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea: stopping tablet replica
I20260709 12:27:10.733489  9681 raft_consensus.cc:2243] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:27:10.734720  9681 raft_consensus.cc:2272] T 73f1f3589fd343ba9289b327b8b35837 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.737001  9681 tablet_replica.cc:333] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea: stopping tablet replica
I20260709 12:27:10.737933  9681 raft_consensus.cc:2243] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:10.739104  9681 raft_consensus.cc:2272] T f6820c5c64094058b98e641fdb7ffe67 P e2d5c637307a407ab688f5ccd6f0fcea [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.743716  9681 tablet_replica.cc:333] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea: stopping tablet replica
I20260709 12:27:10.744844  9681 raft_consensus.cc:2243] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:10.747239  9681 raft_consensus.cc:2272] T 1f0741f995c74b5c91290f42110a3187 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.751091  9681 tablet_replica.cc:333] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea: stopping tablet replica
I20260709 12:27:10.752180  9681 raft_consensus.cc:2243] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:10.753192  9681 raft_consensus.cc:2272] T 9b5cbc6740ba4e518cfc3499d4a01d2a P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.756237  9681 tablet_replica.cc:333] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea: stopping tablet replica
I20260709 12:27:10.757120  9681 raft_consensus.cc:2243] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:10.757927  9681 raft_consensus.cc:2272] T 60dca008c268416c8e63091506d1653e P e2d5c637307a407ab688f5ccd6f0fcea [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.760764  9681 tablet_replica.cc:333] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea: stopping tablet replica
I20260709 12:27:10.761561  9681 raft_consensus.cc:2243] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:10.762658  9681 raft_consensus.cc:2272] T 3357adbb6a514faf958aff009c4e4af8 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:10.765486 11588 consensus_peers.cc:597] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d -> Peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Couldn't send request to peer e2d5c637307a407ab688f5ccd6f0fcea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:10.765905  9681 tablet_replica.cc:333] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea: stopping tablet replica
I20260709 12:27:10.767345  9681 raft_consensus.cc:2243] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:27:10.768621  9681 raft_consensus.cc:2272] T 63acd3ecccdf41f5856ce30bc68864e8 P e2d5c637307a407ab688f5ccd6f0fcea [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.771710  9681 tablet_replica.cc:333] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea: stopping tablet replica
I20260709 12:27:10.772548  9681 raft_consensus.cc:2243] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:10.773274  9681 raft_consensus.cc:2272] T d5b6ea992cd64650b1c2da6c548d012f P e2d5c637307a407ab688f5ccd6f0fcea [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:10.773543 11588 consensus_peers.cc:597] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 3c52e0825c02476e89d84da9bb849f5d -> Peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Couldn't send request to peer e2d5c637307a407ab688f5ccd6f0fcea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:10.777084  9681 tablet_replica.cc:333] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea: stopping tablet replica
I20260709 12:27:10.778143  9681 raft_consensus.cc:2243] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:10.778847  9681 raft_consensus.cc:2272] T b289bc89d592435fb63c7fcf580d95a4 P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.781580  9681 tablet_replica.cc:333] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea: stopping tablet replica
I20260709 12:27:10.782420  9681 raft_consensus.cc:2243] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:10.783141  9681 raft_consensus.cc:2272] T 02a088f690eb45beb958d74519a39b7f P e2d5c637307a407ab688f5ccd6f0fcea [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.787832  9681 tablet_replica.cc:333] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea: stopping tablet replica
I20260709 12:27:10.788735  9681 raft_consensus.cc:2243] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:27:10.790838  9681 raft_consensus.cc:2272] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.793931  9681 tablet_replica.cc:333] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea: stopping tablet replica
I20260709 12:27:10.794814  9681 raft_consensus.cc:2243] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:10.795466  9681 raft_consensus.cc:2272] T 9f0dd1f84a304be0be5f4e4bf2aae6de P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.798436  9681 tablet_replica.cc:333] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea: stopping tablet replica
I20260709 12:27:10.799736  9681 raft_consensus.cc:2243] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [term 6 LEADER]: Raft consensus shutting down.
W20260709 12:27:10.800393 10894 consensus_peers.cc:597] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:27:10.801644  9681 raft_consensus.cc:2272] T a6a28416571247df878823d464c05f1e P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:10.802361 11588 consensus_peers.cc:597] T 1f0741f995c74b5c91290f42110a3187 P 3c52e0825c02476e89d84da9bb849f5d -> Peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Couldn't send request to peer e2d5c637307a407ab688f5ccd6f0fcea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:10.810250  9681 tablet_replica.cc:333] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea: stopping tablet replica
I20260709 12:27:10.811286  9681 raft_consensus.cc:2243] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:27:10.812902  9681 raft_consensus.cc:2272] T 7ac83709373b4efd9c3aa1472a9f9022 P e2d5c637307a407ab688f5ccd6f0fcea [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.815651  9681 tablet_replica.cc:333] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea: stopping tablet replica
W20260709 12:27:10.816469 11588 consensus_peers.cc:597] T e9331e5342644ca2bae19187b083a7d5 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:27:10.816578  9681 raft_consensus.cc:2243] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:10.827303  9681 raft_consensus.cc:2272] T e3d9a61ecaf84695b70f8519ee57706f P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:10.830976 10968 consensus_peers.cc:597] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 -> Peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Couldn't send request to peer e2d5c637307a407ab688f5ccd6f0fcea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:10.831983  9681 tablet_replica.cc:333] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea: stopping tablet replica
W20260709 12:27:10.834515 10968 consensus_peers.cc:597] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 -> Peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Couldn't send request to peer e2d5c637307a407ab688f5ccd6f0fcea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:10.833643 11588 consensus_peers.cc:597] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d -> Peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Couldn't send request to peer e2d5c637307a407ab688f5ccd6f0fcea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:10.834996  9681 raft_consensus.cc:2243] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Raft consensus shutting down.
W20260709 12:27:10.835770 11588 consensus_peers.cc:597] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d -> Peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Couldn't send request to peer e2d5c637307a407ab688f5ccd6f0fcea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:10.836154  9681 raft_consensus.cc:2272] T e8b17195a94142039c40f598ed006c94 P e2d5c637307a407ab688f5ccd6f0fcea [term 6 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:10.835240 10968 consensus_peers.cc:597] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 -> Peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Couldn't send request to peer e2d5c637307a407ab688f5ccd6f0fcea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:10.838186 10968 consensus_peers.cc:597] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 -> Peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Couldn't send request to peer e2d5c637307a407ab688f5ccd6f0fcea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:10.839388  9681 tablet_replica.cc:333] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea: stopping tablet replica
I20260709 12:27:10.841985  9681 raft_consensus.cc:2243] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:27:10.843676  9681 raft_consensus.cc:2272] T 54df1a3d45b746398c2831883d796c6d P e2d5c637307a407ab688f5ccd6f0fcea [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.847083  9681 tablet_replica.cc:333] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea: stopping tablet replica
W20260709 12:27:10.847993 11588 consensus_peers.cc:597] T d0aed74af73a488f8b691578ca370226 P 3c52e0825c02476e89d84da9bb849f5d -> Peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Couldn't send request to peer e2d5c637307a407ab688f5ccd6f0fcea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:10.848124  9681 raft_consensus.cc:2243] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:27:10.849679  9681 raft_consensus.cc:2272] T 26c7a4ac9606419a90700eec61a02bd8 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.852813  9681 tablet_replica.cc:333] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea: stopping tablet replica
I20260709 12:27:10.853713  9681 raft_consensus.cc:2243] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:10.854432  9681 raft_consensus.cc:2272] T 114b16c8c992413dab64ab31b16cb06f P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.857645  9681 tablet_replica.cc:333] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea: stopping tablet replica
I20260709 12:27:10.858461  9681 raft_consensus.cc:2243] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:27:10.859740  9681 raft_consensus.cc:2272] T cb220f7497ef4e739938460527b9d6f0 P e2d5c637307a407ab688f5ccd6f0fcea [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.863127  9681 tablet_replica.cc:333] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea: stopping tablet replica
I20260709 12:27:10.863929  9681 raft_consensus.cc:2243] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:27:10.865093  9681 raft_consensus.cc:2272] T 53b0e2cbee394228af2190d22e7ea9ef P e2d5c637307a407ab688f5ccd6f0fcea [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:10.868963 10968 consensus_peers.cc:597] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 -> Peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Couldn't send request to peer e2d5c637307a407ab688f5ccd6f0fcea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:10.869407  9681 tablet_replica.cc:333] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea: stopping tablet replica
I20260709 12:27:10.871407  9681 raft_consensus.cc:2243] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:27:10.874351  9681 raft_consensus.cc:2272] T 3ad755c012434396a53498486697a9b4 P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:10.876726 10968 consensus_peers.cc:597] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 -> Peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Couldn't send request to peer e2d5c637307a407ab688f5ccd6f0fcea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:10.877995 10968 consensus_peers.cc:597] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 -> Peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Couldn't send request to peer e2d5c637307a407ab688f5ccd6f0fcea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:10.878998  9681 tablet_replica.cc:333] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea: stopping tablet replica
I20260709 12:27:10.882031  9681 raft_consensus.cc:2243] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:27:10.883416  9681 raft_consensus.cc:2272] T 1e97a41f10c041deb11464b469d0b5dd P e2d5c637307a407ab688f5ccd6f0fcea [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.887948  9681 tablet_replica.cc:333] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea: stopping tablet replica
I20260709 12:27:10.888805  9681 raft_consensus.cc:2243] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:27:10.890043  9681 raft_consensus.cc:2272] T 442726a7f1e441248ec80a98b31eb341 P e2d5c637307a407ab688f5ccd6f0fcea [term 7 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:10.901609 11588 consensus_peers.cc:597] T 4ef3220c51df47db8859f07ab745fad5 P 3c52e0825c02476e89d84da9bb849f5d -> Peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Couldn't send request to peer e2d5c637307a407ab688f5ccd6f0fcea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:10.897250 10968 consensus_peers.cc:597] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:10.916538 11588 consensus_peers.cc:597] T 435d66c6d38c4d8a90a81975a6a0cb13 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:10.987797 10738 catalog_manager.cc:4755] TS 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 54df1a3d45b746398c2831883d796c6d: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111)
W20260709 12:27:11.027612 11588 consensus_peers.cc:597] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:11.029549 11588 consensus_peers.cc:597] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:11.048362 11588 consensus_peers.cc:597] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:11.126452 11588 consensus_peers.cc:597] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:11.232508 11588 consensus_peers.cc:597] T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:11.236280 10968 consensus_peers.cc:597] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:11.237448 11588 consensus_peers.cc:597] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:11.268028 11589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:39945, user_credentials={real_user=slave}} blocked reactor thread for 48165.5us
W20260709 12:27:11.311825 10968 consensus_peers.cc:597] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:11.322743 11588 consensus_peers.cc:597] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:11.328423 11588 consensus_peers.cc:597] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:11.392192 10968 consensus_peers.cc:597] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:11.417893 11588 consensus_peers.cc:597] T 1f0741f995c74b5c91290f42110a3187 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:11.636476 10968 consensus_peers.cc:597] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:11.648145 10968 consensus_peers.cc:597] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:11.686324 11588 consensus_peers.cc:597] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:27:11.700506 16564 raft_consensus.cc:493] T f52e71e935934a298445f2f87c913f9e P 3c52e0825c02476e89d84da9bb849f5d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:27:11.702068 16564 raft_consensus.cc:515] T f52e71e935934a298445f2f87c913f9e P 3c52e0825c02476e89d84da9bb849f5d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:27:11.728484 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:27:11.737335 16564 leader_election.cc:290] T f52e71e935934a298445f2f87c913f9e P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:27:11.732010 16567 raft_consensus.cc:493] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:27:11.739511 16567 raft_consensus.cc:515] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:27:11.741940 16567 leader_election.cc:290] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:27:11.744758 11588 leader_election.cc:336] T f52e71e935934a298445f2f87c913f9e P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111)
I20260709 12:27:11.745405 11588 leader_election.cc:304] T f52e71e935934a298445f2f87c913f9e P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:27:11.746225 16567 raft_consensus.cc:2749] T f52e71e935934a298445f2f87c913f9e P 3c52e0825c02476e89d84da9bb849f5d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:27:11.747803 11588 leader_election.cc:336] T f52e71e935934a298445f2f87c913f9e P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111)
I20260709 12:27:11.750324 16567 raft_consensus.cc:493] T cb3b4ab419804fabb71d2a98c266b209 P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:27:11.751061 16567 raft_consensus.cc:515] T cb3b4ab419804fabb71d2a98c266b209 P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:27:11.755174 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:27:11.757211 16567 leader_election.cc:290] T cb3b4ab419804fabb71d2a98c266b209 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:27:11.769294 11588 leader_election.cc:336] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111)
W20260709 12:27:11.771287 11588 leader_election.cc:336] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111)
I20260709 12:27:11.771859 11588 leader_election.cc:304] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:27:11.772631 16567 raft_consensus.cc:2749] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:27:11.779053 11588 leader_election.cc:336] T cb3b4ab419804fabb71d2a98c266b209 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111)
I20260709 12:27:11.779541 11588 leader_election.cc:304] T cb3b4ab419804fabb71d2a98c266b209 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:27:11.780303 16567 raft_consensus.cc:2749] T cb3b4ab419804fabb71d2a98c266b209 P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:27:11.781775 11588 leader_election.cc:336] T cb3b4ab419804fabb71d2a98c266b209 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111)
I20260709 12:27:11.802850 16554 raft_consensus.cc:493] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:27:11.804098 16554 raft_consensus.cc:515] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:27:11.815321 16554 leader_election.cc:290] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:27:11.816731 10968 leader_election.cc:336] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111)
W20260709 12:27:11.817513 10968 leader_election.cc:336] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111)
I20260709 12:27:11.817896 10968 leader_election.cc:304] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:27:11.821360 16569 raft_consensus.cc:493] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:27:11.822278 16569 raft_consensus.cc:515] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } }
I20260709 12:27:11.824719 16570 raft_consensus.cc:493] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:27:11.825412 16570 raft_consensus.cc:515] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:27:11.829897 16554 raft_consensus.cc:2749] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:11.828940 16569 leader_election.cc:290] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265)
I20260709 12:27:11.833993 16551 raft_consensus.cc:493] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:27:11.834718 16551 raft_consensus.cc:515] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:27:11.837184 16551 leader_election.cc:290] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:27:11.833171 16570 leader_election.cc:290] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:27:11.839638 16551 raft_consensus.cc:493] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:27:11.840544 16551 raft_consensus.cc:515] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:27:11.843370 16551 leader_election.cc:290] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:27:11.847931 16573 raft_consensus.cc:493] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:27:11.848555 16570 raft_consensus.cc:493] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:27:11.849443 16570 raft_consensus.cc:515] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:27:11.853077 16570 leader_election.cc:290] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:27:11.856001 10968 consensus_peers.cc:597] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:11.857434 10968 leader_election.cc:336] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111)
W20260709 12:27:11.858048 10968 leader_election.cc:336] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111)
I20260709 12:27:11.849025 16573 raft_consensus.cc:515] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:27:11.869040 16573 leader_election.cc:290] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:27:11.874918 16570 raft_consensus.cc:493] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:27:11.875590 16570 raft_consensus.cc:515] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:27:11.877645 16570 leader_election.cc:290] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:27:11.893249 10968 leader_election.cc:336] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111)
I20260709 12:27:11.893893 10968 leader_election.cc:304] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:27:11.894690 16570 raft_consensus.cc:2749] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:27:11.895896 10968 leader_election.cc:336] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111)
I20260709 12:27:11.902086 16570 raft_consensus.cc:493] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:27:11.902940 16570 raft_consensus.cc:515] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:27:11.905805 16570 leader_election.cc:290] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:27:11.914054 10968 leader_election.cc:304] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:27:11.917711 16570 raft_consensus.cc:2749] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:27:11.922923 10968 leader_election.cc:336] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111)
W20260709 12:27:11.924326 10968 leader_election.cc:336] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111)
I20260709 12:27:11.930423 16573 raft_consensus.cc:493] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:27:11.931205 16573 raft_consensus.cc:515] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:27:11.931897 10968 leader_election.cc:336] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111)
I20260709 12:27:11.932529 10968 leader_election.cc:304] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:27:11.933399 16570 raft_consensus.cc:2749] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:11.934198 16573 leader_election.cc:290] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
W20260709 12:27:11.935485 10968 leader_election.cc:336] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111)
I20260709 12:27:11.936118 10968 leader_election.cc:304] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:27:11.938702 11620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3b4ab419804fabb71d2a98c266b209" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:27:11.939458 11620 raft_consensus.cc:2468] T cb3b4ab419804fabb71d2a98c266b209 P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 11.
I20260709 12:27:11.945745 16573 raft_consensus.cc:2749] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:27:11.946503 10968 leader_election.cc:336] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111)
W20260709 12:27:11.948629 10968 leader_election.cc:336] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111)
I20260709 12:27:11.949093 10968 leader_election.cc:304] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:27:11.949932 16573 raft_consensus.cc:2749] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:27:11.950063 10968 leader_election.cc:336] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111)
W20260709 12:27:11.950773 10968 leader_election.cc:336] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111)
I20260709 12:27:11.954233 16573 raft_consensus.cc:493] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
W20260709 12:27:11.955142 10968 leader_election.cc:336] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111)
I20260709 12:27:11.955058 16573 raft_consensus.cc:515] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:27:11.955745 10968 leader_election.cc:304] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:27:11.956629 16570 raft_consensus.cc:2749] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:27:11.957744 10968 leader_election.cc:336] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111)
I20260709 12:27:11.962757 16573 leader_election.cc:290] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:27:11.966029 10968 leader_election.cc:304] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:27:11.968452 16573 raft_consensus.cc:2749] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:27:11.968806 10968 leader_election.cc:336] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111)
W20260709 12:27:11.971192 10968 leader_election.cc:336] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111)
I20260709 12:27:11.971700 10968 leader_election.cc:304] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:27:11.972198 16564 raft_consensus.cc:493] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:27:11.972901 16564 raft_consensus.cc:515] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:27:11.975944 10968 leader_election.cc:336] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111)
I20260709 12:27:11.975313 16564 leader_election.cc:290] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:27:11.993151 11588 leader_election.cc:336] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111)
W20260709 12:27:11.993918 10968 leader_election.cc:336] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111)
W20260709 12:27:11.994526 10968 leader_election.cc:336] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111)
I20260709 12:27:11.995038 10968 leader_election.cc:304] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:27:11.996131 16570 raft_consensus.cc:2749] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:27:11.996884 10968 leader_election.cc:336] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111)
I20260709 12:27:11.997166 16570 raft_consensus.cc:2749] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:11.997593 10968 leader_election.cc:304] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:27:11.998373 16569 raft_consensus.cc:2749] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:27:11.997999 11588 leader_election.cc:336] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111)
I20260709 12:27:12.000845 11588 leader_election.cc:304] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:27:12.001662 16564 raft_consensus.cc:2749] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:27:12.005156 16564 raft_consensus.cc:493] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:27:12.005940 16564 raft_consensus.cc:515] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:27:12.009199 16564 leader_election.cc:290] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:27:12.022679 16564 raft_consensus.cc:493] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:27:12.023806 16564 raft_consensus.cc:515] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:27:12.026060 16564 leader_election.cc:290] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:27:12.037827 11588 leader_election.cc:336] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111)
I20260709 12:27:12.041694 16573 raft_consensus.cc:493] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:27:12.042456 16573 raft_consensus.cc:515] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
W20260709 12:27:12.044684 11588 leader_election.cc:336] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111)
I20260709 12:27:12.044896 16573 leader_election.cc:290] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:27:12.045284 11588 leader_election.cc:304] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:27:12.046586 16564 raft_consensus.cc:2749] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:27:12.053179 10968 leader_election.cc:336] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111)
W20260709 12:27:12.054137 10968 leader_election.cc:336] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111)
I20260709 12:27:12.054684 10968 leader_election.cc:304] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:27:12.055630 16573 raft_consensus.cc:2749] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:27:12.057792 11588 leader_election.cc:336] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111)
W20260709 12:27:12.060312 11588 leader_election.cc:336] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111)
I20260709 12:27:12.060850 11588 leader_election.cc:304] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:27:12.061712 16564 raft_consensus.cc:2749] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:12.071029 16564 raft_consensus.cc:493] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:27:12.071906 16564 raft_consensus.cc:515] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:27:12.075143 16564 leader_election.cc:290] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:27:12.077020 16573 raft_consensus.cc:493] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:27:12.077692 16573 raft_consensus.cc:515] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:27:12.081317 16573 leader_election.cc:290] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:27:12.085613 16573 raft_consensus.cc:493] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:27:12.086364 16573 raft_consensus.cc:515] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:27:12.089212 10968 leader_election.cc:336] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111)
I20260709 12:27:12.090075 11620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
W20260709 12:27:12.090517 10968 leader_election.cc:336] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111)
I20260709 12:27:12.091070 10968 leader_election.cc:304] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:27:12.089311 16573 leader_election.cc:290] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:27:12.107026 16567 raft_consensus.cc:493] T 54df1a3d45b746398c2831883d796c6d P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:27:12.107901 16567 raft_consensus.cc:515] T 54df1a3d45b746398c2831883d796c6d P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:27:12.110072 16567 leader_election.cc:290] T 54df1a3d45b746398c2831883d796c6d P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:27:12.091984 16569 raft_consensus.cc:2749] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:27:12.095813 10968 leader_election.cc:336] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111)
I20260709 12:27:12.111075 10968 leader_election.cc:304] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:27:12.112125 16569 raft_consensus.cc:2749] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:12.113443 16573 raft_consensus.cc:493] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:27:12.114022 16573 raft_consensus.cc:515] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:27:12.114074 16551 raft_consensus.cc:493] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:27:12.116076 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:27:12.116744 11002 raft_consensus.cc:2468] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 9.
I20260709 12:27:12.115828 16551 raft_consensus.cc:515] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:27:12.117837 11589 leader_election.cc:304] T 54df1a3d45b746398c2831883d796c6d P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:27:12.118872 16564 raft_consensus.cc:2804] T 54df1a3d45b746398c2831883d796c6d P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:12.119277 16564 raft_consensus.cc:493] T 54df1a3d45b746398c2831883d796c6d P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:27:12.119807 16564 raft_consensus.cc:3060] T 54df1a3d45b746398c2831883d796c6d P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:12.121773 11620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52e71e935934a298445f2f87c913f9e" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
I20260709 12:27:12.122740 16551 leader_election.cc:290] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:27:12.141022 11620 raft_consensus.cc:2468] T f52e71e935934a298445f2f87c913f9e P 3c52e0825c02476e89d84da9bb849f5d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcc56ddd3264984b4da6c1db59e7f08 in term 15.
I20260709 12:27:12.123227 16573 leader_election.cc:290] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68:37613)
I20260709 12:27:12.126492 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "edcc56ddd3264984b4da6c1db59e7f08" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3c52e0825c02476e89d84da9bb849f5d" is_pre_election: true
W20260709 12:27:12.130388 10968 leader_election.cc:336] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111)
W20260709 12:27:12.146109 10968 leader_election.cc:336] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111)
I20260709 12:27:12.146576 10968 leader_election.cc:304] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
W20260709 12:27:12.147358 10968 leader_election.cc:336] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111)
I20260709 12:27:12.147384 16573 raft_consensus.cc:2749] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:27:12.150631 10969 leader_election.cc:304] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 3c52e0825c02476e89d84da9bb849f5d, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:27:12.160609 16573 raft_consensus.cc:2749] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:27:12.187239 11588 leader_election.cc:336] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111)
W20260709 12:27:12.195838 11588 leader_election.cc:336] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111)
I20260709 12:27:12.196451 11588 leader_election.cc:304] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:27:12.197969 16567 raft_consensus.cc:2749] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:27:12.210141 16564 raft_consensus.cc:515] T 54df1a3d45b746398c2831883d796c6d P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:27:12.219974 11588 leader_election.cc:336] T 54df1a3d45b746398c2831883d796c6d P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111)
I20260709 12:27:12.222787 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df1a3d45b746398c2831883d796c6d" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:27:12.224159 11002 raft_consensus.cc:3060] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:12.234728 11002 raft_consensus.cc:2468] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 10.
I20260709 12:27:12.244729 11589 leader_election.cc:304] T 54df1a3d45b746398c2831883d796c6d P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:27:12.246208 16567 raft_consensus.cc:2804] T 54df1a3d45b746398c2831883d796c6d P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:27:12.246771 16567 raft_consensus.cc:697] T 54df1a3d45b746398c2831883d796c6d P 3c52e0825c02476e89d84da9bb849f5d [term 10 LEADER]: Becoming Leader. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
I20260709 12:27:12.248436 16567 consensus_queue.cc:237] T 54df1a3d45b746398c2831883d796c6d P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:27:12.253368 16541 raft_consensus.cc:493] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:27:12.254310 16541 raft_consensus.cc:515] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:27:12.256460 16541 leader_election.cc:290] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:27:12.223309 16564 leader_election.cc:290] T 54df1a3d45b746398c2831883d796c6d P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 10 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:27:12.286630 16573 raft_consensus.cc:493] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:27:12.287375 16573 raft_consensus.cc:515] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:27:12.292019 16573 leader_election.cc:290] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:27:12.295127 11588 leader_election.cc:336] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111)
W20260709 12:27:12.295774 10968 leader_election.cc:336] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111)
W20260709 12:27:12.296028 11588 leader_election.cc:336] T 54df1a3d45b746398c2831883d796c6d P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111)
W20260709 12:27:12.296535 10968 leader_election.cc:336] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111)
I20260709 12:27:12.297120 10968 leader_election.cc:304] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:27:12.298681 16573 raft_consensus.cc:2749] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:27:12.300328 11588 leader_election.cc:336] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111)
I20260709 12:27:12.300873 11588 leader_election.cc:304] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:27:12.301909 16567 raft_consensus.cc:2749] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:12.308523 10752 catalog_manager.cc:5697] T 54df1a3d45b746398c2831883d796c6d P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: term changed from 9 to 10, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68). New cstate: current_term: 10 leader_uuid: "3c52e0825c02476e89d84da9bb849f5d" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:27:12.350080 11588 consensus_peers.cc:597] T ab816bcc6183447994a2cc013e46c5f8 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:27:12.362195 16564 raft_consensus.cc:493] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:27:12.362964 16564 raft_consensus.cc:515] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:27:12.366999 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08" is_pre_election: true
I20260709 12:27:12.367686 11002 raft_consensus.cc:2468] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 12.
I20260709 12:27:12.370352 11589 leader_election.cc:304] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:27:12.371165 16567 raft_consensus.cc:2804] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:27:12.371533 16567 raft_consensus.cc:493] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [term 12 FOLLOWER]: Starting leader election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:27:12.371937 16567 raft_consensus.cc:3060] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:12.374958 16564 leader_election.cc:290] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:27:12.377693 11588 leader_election.cc:336] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111)
I20260709 12:27:12.381034 16567 raft_consensus.cc:515] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:27:12.384691 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad755c012434396a53498486697a9b4" candidate_uuid: "3c52e0825c02476e89d84da9bb849f5d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "edcc56ddd3264984b4da6c1db59e7f08"
I20260709 12:27:12.385392 11002 raft_consensus.cc:3060] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:12.393630 16567 leader_election.cc:290] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 13 election: Requested vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:27:12.395028 11002 raft_consensus.cc:2468] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c52e0825c02476e89d84da9bb849f5d in term 13.
I20260709 12:27:12.396358 11589 leader_election.cc:304] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d, edcc56ddd3264984b4da6c1db59e7f08; no voters: 
I20260709 12:27:12.397425 16567 raft_consensus.cc:2804] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:27:12.398252 16567 raft_consensus.cc:697] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [term 13 LEADER]: Becoming Leader. State: Replica: 3c52e0825c02476e89d84da9bb849f5d, State: Running, Role: LEADER
I20260709 12:27:12.399394 16567 consensus_queue.cc:237] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:27:12.400218 11588 leader_election.cc:336] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111)
I20260709 12:27:12.415858 10752 catalog_manager.cc:5697] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d reported cstate change: term changed from 12 to 13, leader changed from e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66) to 3c52e0825c02476e89d84da9bb849f5d (127.9.116.68). New cstate: current_term: 13 leader_uuid: "3c52e0825c02476e89d84da9bb849f5d" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:27:12.687124 10968 consensus_peers.cc:597] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:12.771399 11588 consensus_peers.cc:597] T 54df1a3d45b746398c2831883d796c6d P 3c52e0825c02476e89d84da9bb849f5d -> Peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Couldn't send request to peer e2d5c637307a407ab688f5ccd6f0fcea. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:12.796351  9681 tablet_server.cc:196] TabletServer@127.9.116.66:0 shutdown complete.
I20260709 12:27:12.850272 10998 raft_consensus.cc:1275] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:27:12.852790 16553 consensus_queue.cc:1048] T 54df1a3d45b746398c2831883d796c6d P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:27:12.964895 10968 consensus_peers.cc:597] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 -> Peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Couldn't send request to peer e2d5c637307a407ab688f5ccd6f0fcea. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:12.998705 11588 consensus_peers.cc:597] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:27:12.999099 10998 raft_consensus.cc:1275] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 13 FOLLOWER]: Refusing update from remote peer 3c52e0825c02476e89d84da9bb849f5d: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:27:13.027959 16582 consensus_queue.cc:1048] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:27:13.034272 10968 consensus_peers.cc:597] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 -> Peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Couldn't send request to peer e2d5c637307a407ab688f5ccd6f0fcea. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:13.035898 10968 consensus_peers.cc:597] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 -> Peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Couldn't send request to peer e2d5c637307a407ab688f5ccd6f0fcea. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:13.036891 10968 consensus_peers.cc:597] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:27:13.089725 11588 consensus_peers.cc:597] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 3c52e0825c02476e89d84da9bb849f5d -> Peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Couldn't send request to peer e2d5c637307a407ab688f5ccd6f0fcea. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:13.090301 11588 consensus_peers.cc:597] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d -> Peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Couldn't send request to peer e2d5c637307a407ab688f5ccd6f0fcea. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:13.090754 11588 consensus_peers.cc:597] T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d -> Peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Couldn't send request to peer e2d5c637307a407ab688f5ccd6f0fcea. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:13.093097 11588 consensus_peers.cc:597] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:27:13.095877 10968 consensus_peers.cc:597] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 -> Peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Couldn't send request to peer e2d5c637307a407ab688f5ccd6f0fcea. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:13.101413 11588 consensus_peers.cc:597] T e8b17195a94142039c40f598ed006c94 P 3c52e0825c02476e89d84da9bb849f5d -> Peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Couldn't send request to peer e2d5c637307a407ab688f5ccd6f0fcea. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:13.102180 11588 consensus_peers.cc:597] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d -> Peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Couldn't send request to peer e2d5c637307a407ab688f5ccd6f0fcea. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:13.123777 11588 consensus_peers.cc:597] T 1f0741f995c74b5c91290f42110a3187 P 3c52e0825c02476e89d84da9bb849f5d -> Peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Couldn't send request to peer e2d5c637307a407ab688f5ccd6f0fcea. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:13.124805 11588 consensus_peers.cc:597] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d -> Peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Couldn't send request to peer e2d5c637307a407ab688f5ccd6f0fcea. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:13.141309 10968 consensus_peers.cc:597] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:27:13.158504 11588 consensus_peers.cc:597] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d -> Peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Couldn't send request to peer e2d5c637307a407ab688f5ccd6f0fcea. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:13.178607 11588 consensus_peers.cc:597] T e9331e5342644ca2bae19187b083a7d5 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:27:13.206436  9681 tablet_server.cc:179] TabletServer@127.9.116.67:0 shutting down...
W20260709 12:27:13.256842 10968 consensus_peers.cc:597] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 -> Peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Couldn't send request to peer e2d5c637307a407ab688f5ccd6f0fcea. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:13.283691 11588 consensus_peers.cc:597] T d0aed74af73a488f8b691578ca370226 P 3c52e0825c02476e89d84da9bb849f5d -> Peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Couldn't send request to peer e2d5c637307a407ab688f5ccd6f0fcea. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:13.308756 11588 consensus_peers.cc:597] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d -> Peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Couldn't send request to peer e2d5c637307a407ab688f5ccd6f0fcea. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:13.312625 11588 consensus_peers.cc:597] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:27:13.315384  9681 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:13.316829  9681 tablet_replica.cc:333] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08: stopping tablet replica
I20260709 12:27:13.318148  9681 raft_consensus.cc:2243] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.319512  9681 raft_consensus.cc:2272] T 435d66c6d38c4d8a90a81975a6a0cb13 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.324589  9681 tablet_replica.cc:333] T d0aed74af73a488f8b691578ca370226 P edcc56ddd3264984b4da6c1db59e7f08: stopping tablet replica
I20260709 12:27:13.326345  9681 raft_consensus.cc:2243] T d0aed74af73a488f8b691578ca370226 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.327446  9681 raft_consensus.cc:2272] T d0aed74af73a488f8b691578ca370226 P edcc56ddd3264984b4da6c1db59e7f08 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:13.332674 11589 consensus_peers.cc:597] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d -> Peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): Couldn't send request to peer edcc56ddd3264984b4da6c1db59e7f08. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:13.332993  9681 tablet_replica.cc:333] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08: stopping tablet replica
I20260709 12:27:13.334146  9681 raft_consensus.cc:2243] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.335076  9681 raft_consensus.cc:2272] T 24c913e527ff46578e084c41eab7bb9d P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.338649  9681 tablet_replica.cc:333] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08: stopping tablet replica
I20260709 12:27:13.340193  9681 raft_consensus.cc:2243] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.341301  9681 raft_consensus.cc:2272] T f5b822586ed04f2cb681fefd045b3f6d P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.345837  9681 tablet_replica.cc:333] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08: stopping tablet replica
I20260709 12:27:13.347465  9681 raft_consensus.cc:2243] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.348707  9681 raft_consensus.cc:2272] T 87cb7b380c8446e6ab1355c203218967 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:13.349852 11589 consensus_peers.cc:597] T e8b17195a94142039c40f598ed006c94 P 3c52e0825c02476e89d84da9bb849f5d -> Peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): Couldn't send request to peer edcc56ddd3264984b4da6c1db59e7f08. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:13.351711  9681 tablet_replica.cc:333] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08: stopping tablet replica
I20260709 12:27:13.352495  9681 raft_consensus.cc:2243] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.353281  9681 raft_consensus.cc:2272] T 3589745d67944a8a9a5c66ee8d04fc62 P edcc56ddd3264984b4da6c1db59e7f08 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.355523  9681 tablet_replica.cc:333] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08: stopping tablet replica
I20260709 12:27:13.356453  9681 raft_consensus.cc:2243] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.357801  9681 raft_consensus.cc:2272] T e9331e5342644ca2bae19187b083a7d5 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.361748  9681 tablet_replica.cc:333] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08: stopping tablet replica
I20260709 12:27:13.362998  9681 raft_consensus.cc:2243] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.363914  9681 raft_consensus.cc:2272] T c2937f569e8041d9a71a575dc1b9d74d P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.367921  9681 tablet_replica.cc:333] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08: stopping tablet replica
I20260709 12:27:13.368969  9681 raft_consensus.cc:2243] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.370111  9681 raft_consensus.cc:2272] T c72fddfc26044838a71a798f3371636b P edcc56ddd3264984b4da6c1db59e7f08 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.373389  9681 tablet_replica.cc:333] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08: stopping tablet replica
I20260709 12:27:13.374425  9681 raft_consensus.cc:2243] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:27:13.375808  9681 raft_consensus.cc:2272] T c63ecfc9bd3945818cfe15c03f001315 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.378973  9681 tablet_replica.cc:333] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08: stopping tablet replica
I20260709 12:27:13.379971  9681 raft_consensus.cc:2243] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.381729  9681 raft_consensus.cc:2272] T f52e71e935934a298445f2f87c913f9e P edcc56ddd3264984b4da6c1db59e7f08 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.385816  9681 tablet_replica.cc:333] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08: stopping tablet replica
I20260709 12:27:13.387176  9681 raft_consensus.cc:2243] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.388118  9681 raft_consensus.cc:2272] T 928860b1f6314ad3bd3582c7f89e460e P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.391306  9681 tablet_replica.cc:333] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08: stopping tablet replica
I20260709 12:27:13.392153  9681 raft_consensus.cc:2243] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.392787  9681 raft_consensus.cc:2272] T ab816bcc6183447994a2cc013e46c5f8 P edcc56ddd3264984b4da6c1db59e7f08 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.395965  9681 tablet_replica.cc:333] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08: stopping tablet replica
I20260709 12:27:13.396942  9681 raft_consensus.cc:2243] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.397899  9681 raft_consensus.cc:2272] T ad766f48812a4ddeb383179b1d84907b P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:13.402842 11588 consensus_peers.cc:597] T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:27:13.403147  9681 tablet_replica.cc:333] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08: stopping tablet replica
I20260709 12:27:13.408079  9681 raft_consensus.cc:2243] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.409267  9681 raft_consensus.cc:2272] T ee998be153d94f6f91c39dace2c32f19 P edcc56ddd3264984b4da6c1db59e7f08 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.413185  9681 tablet_replica.cc:333] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08: stopping tablet replica
I20260709 12:27:13.414237  9681 raft_consensus.cc:2243] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Raft consensus shutting down.
W20260709 12:27:13.413218 10968 consensus_peers.cc:597] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 -> Peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Couldn't send request to peer e2d5c637307a407ab688f5ccd6f0fcea. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:13.415791  9681 raft_consensus.cc:2272] T cb3b4ab419804fabb71d2a98c266b209 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.419299  9681 tablet_replica.cc:333] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08: stopping tablet replica
I20260709 12:27:13.420327  9681 raft_consensus.cc:2243] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:27:13.422387  9681 raft_consensus.cc:2272] T 8b297008d51d40b98784ce74e225b8f5 P edcc56ddd3264984b4da6c1db59e7f08 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:13.425146 11589 consensus_peers.cc:597] T 54df1a3d45b746398c2831883d796c6d P 3c52e0825c02476e89d84da9bb849f5d -> Peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): Couldn't send request to peer edcc56ddd3264984b4da6c1db59e7f08. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:13.425828  9681 tablet_replica.cc:333] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08: stopping tablet replica
I20260709 12:27:13.427671  9681 raft_consensus.cc:2243] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.428488  9681 raft_consensus.cc:2272] T 577c93bfc0d84ec6ad610cad0cf16899 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.434407  9681 tablet_replica.cc:333] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08: stopping tablet replica
I20260709 12:27:13.435425  9681 raft_consensus.cc:2243] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.436703  9681 raft_consensus.cc:2272] T 9b5cbc6740ba4e518cfc3499d4a01d2a P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.441804  9681 tablet_replica.cc:333] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08: stopping tablet replica
I20260709 12:27:13.443073  9681 raft_consensus.cc:2243] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.444275  9681 raft_consensus.cc:2272] T 438b1d5ca177401b94c157e6f4836150 P edcc56ddd3264984b4da6c1db59e7f08 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:13.444499 11589 consensus_peers.cc:597] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d -> Peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): Couldn't send request to peer edcc56ddd3264984b4da6c1db59e7f08. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:13.448750  9681 tablet_replica.cc:333] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08: stopping tablet replica
W20260709 12:27:13.448885 11588 consensus_peers.cc:597] T 435d66c6d38c4d8a90a81975a6a0cb13 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:27:13.465770  9681 raft_consensus.cc:2243] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.466795  9681 raft_consensus.cc:2272] T 60dca008c268416c8e63091506d1653e P edcc56ddd3264984b4da6c1db59e7f08 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:13.470118 11588 consensus_peers.cc:597] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:27:13.470440  9681 tablet_replica.cc:333] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08: stopping tablet replica
I20260709 12:27:13.471550  9681 raft_consensus.cc:2243] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.472508  9681 raft_consensus.cc:2272] T 4ef3220c51df47db8859f07ab745fad5 P edcc56ddd3264984b4da6c1db59e7f08 [term 7 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:13.463974 10968 consensus_peers.cc:597] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 -> Peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Couldn't send request to peer e2d5c637307a407ab688f5ccd6f0fcea. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:13.446852 11589 consensus_peers.cc:597] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d -> Peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): Couldn't send request to peer edcc56ddd3264984b4da6c1db59e7f08. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:13.475597  9681 tablet_replica.cc:333] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08: stopping tablet replica
I20260709 12:27:13.476586  9681 raft_consensus.cc:2243] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:27:13.482529  9681 raft_consensus.cc:2272] T 18294423a68a4671bf6c5a0f98645e4c P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.486341  9681 tablet_replica.cc:333] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08: stopping tablet replica
W20260709 12:27:13.487025 11589 consensus_peers.cc:597] T 4ef3220c51df47db8859f07ab745fad5 P 3c52e0825c02476e89d84da9bb849f5d -> Peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): Couldn't send request to peer edcc56ddd3264984b4da6c1db59e7f08. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:13.489106 11588 consensus_peers.cc:597] T 4ef3220c51df47db8859f07ab745fad5 P 3c52e0825c02476e89d84da9bb849f5d -> Peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Couldn't send request to peer e2d5c637307a407ab688f5ccd6f0fcea. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:13.489526 11589 consensus_peers.cc:597] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d -> Peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): Couldn't send request to peer edcc56ddd3264984b4da6c1db59e7f08. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:13.490571 16569 raft_consensus.cc:493] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:27:13.491179 16569 raft_consensus.cc:515] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:27:13.493268 16569 leader_election.cc:290] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:27:13.490569 11588 consensus_peers.cc:597] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:27:13.498754 10968 consensus_peers.cc:597] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 -> Peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Couldn't send request to peer e2d5c637307a407ab688f5ccd6f0fcea. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:13.499491 10968 consensus_peers.cc:597] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 -> Peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Couldn't send request to peer e2d5c637307a407ab688f5ccd6f0fcea. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:13.487187  9681 raft_consensus.cc:2243] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.504259  9681 raft_consensus.cc:2272] T 9211e3b6d81447798824045b9515c0ee P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:13.506067 10968 consensus_peers.cc:597] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 -> Peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Couldn't send request to peer e2d5c637307a407ab688f5ccd6f0fcea. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:13.506803 10968 consensus_peers.cc:597] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 -> Peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Couldn't send request to peer e2d5c637307a407ab688f5ccd6f0fcea. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:13.507051 11589 consensus_peers.cc:597] T ab816bcc6183447994a2cc013e46c5f8 P 3c52e0825c02476e89d84da9bb849f5d -> Peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): Couldn't send request to peer edcc56ddd3264984b4da6c1db59e7f08. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:13.507376  9681 tablet_replica.cc:333] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08: stopping tablet replica
W20260709 12:27:13.507413 10968 consensus_peers.cc:597] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 -> Peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Couldn't send request to peer e2d5c637307a407ab688f5ccd6f0fcea. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:13.508172 10968 leader_election.cc:336] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111)
I20260709 12:27:13.508731  9681 raft_consensus.cc:2243] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 13 LEADER]: Raft consensus shutting down.
W20260709 12:27:13.509297 10968 leader_election.cc:336] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111)
I20260709 12:27:13.509883 10968 leader_election.cc:304] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:27:13.510823 16569 raft_consensus.cc:2749] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:27:13.511219  9681 raft_consensus.cc:2272] T 12c494f15d054d2bba575010ccfbb60f P edcc56ddd3264984b4da6c1db59e7f08 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.514838  9681 tablet_replica.cc:333] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08: stopping tablet replica
I20260709 12:27:13.516047  9681 raft_consensus.cc:2243] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.516916  9681 raft_consensus.cc:2272] T 73f1f3589fd343ba9289b327b8b35837 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.520946  9681 tablet_replica.cc:333] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08: stopping tablet replica
I20260709 12:27:13.522884  9681 raft_consensus.cc:2243] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 16 LEADER]: Raft consensus shutting down.
W20260709 12:27:13.523492 11589 consensus_peers.cc:597] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d -> Peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): Couldn't send request to peer edcc56ddd3264984b4da6c1db59e7f08. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:13.524314  9681 raft_consensus.cc:2272] T f6820c5c64094058b98e641fdb7ffe67 P edcc56ddd3264984b4da6c1db59e7f08 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.532230 16582 raft_consensus.cc:493] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:27:13.533028 16582 raft_consensus.cc:515] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:27:13.535531 16582 leader_election.cc:290] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:27:13.544531 11588 leader_election.cc:336] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111)
W20260709 12:27:13.545586 11588 leader_election.cc:336] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111)
I20260709 12:27:13.546060 11588 leader_election.cc:304] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:27:13.546663  9681 tablet_replica.cc:333] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08: stopping tablet replica
I20260709 12:27:13.548030 16582 raft_consensus.cc:2749] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:27:13.550235  9681 raft_consensus.cc:2243] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.559404  9681 raft_consensus.cc:2272] T cd87c382c98f42fdb9ced96cf57e9714 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.562767  9681 tablet_replica.cc:333] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08: stopping tablet replica
W20260709 12:27:13.563627 11589 consensus_peers.cc:597] T d0aed74af73a488f8b691578ca370226 P 3c52e0825c02476e89d84da9bb849f5d -> Peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): Couldn't send request to peer edcc56ddd3264984b4da6c1db59e7f08. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:13.563762  9681 raft_consensus.cc:2243] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Raft consensus shutting down.
W20260709 12:27:13.551151 10968 consensus_peers.cc:597] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 -> Peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Couldn't send request to peer e2d5c637307a407ab688f5ccd6f0fcea. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:13.564579 11589 consensus_peers.cc:597] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d -> Peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): Couldn't send request to peer edcc56ddd3264984b4da6c1db59e7f08. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:13.565303 11589 consensus_peers.cc:597] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d -> Peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): Couldn't send request to peer edcc56ddd3264984b4da6c1db59e7f08. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:13.565320  9681 raft_consensus.cc:2272] T 266989ea58c040cea1d5f1b425ba2d3b P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.569231  9681 tablet_replica.cc:333] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08: stopping tablet replica
I20260709 12:27:13.570271  9681 raft_consensus.cc:2243] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:27:13.571645  9681 raft_consensus.cc:2272] T 3357adbb6a514faf958aff009c4e4af8 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.574880  9681 tablet_replica.cc:333] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08: stopping tablet replica
I20260709 12:27:13.575912  9681 raft_consensus.cc:2243] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.576715  9681 raft_consensus.cc:2272] T 63acd3ecccdf41f5856ce30bc68864e8 P edcc56ddd3264984b4da6c1db59e7f08 [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:13.577849 11588 consensus_peers.cc:597] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d -> Peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Couldn't send request to peer e2d5c637307a407ab688f5ccd6f0fcea. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:13.579942  9681 tablet_replica.cc:333] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08: stopping tablet replica
W20260709 12:27:13.580816 11589 consensus_peers.cc:597] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d -> Peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): Couldn't send request to peer edcc56ddd3264984b4da6c1db59e7f08. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:13.581110  9681 raft_consensus.cc:2243] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:27:13.582791  9681 raft_consensus.cc:2272] T d5b6ea992cd64650b1c2da6c548d012f P edcc56ddd3264984b4da6c1db59e7f08 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.586531  9681 tablet_replica.cc:333] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08: stopping tablet replica
I20260709 12:27:13.587397  9681 raft_consensus.cc:2243] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:27:13.588792  9681 raft_consensus.cc:2272] T b289bc89d592435fb63c7fcf580d95a4 P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.591758  9681 tablet_replica.cc:333] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08: stopping tablet replica
I20260709 12:27:13.592528  9681 raft_consensus.cc:2243] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:27:13.593753  9681 raft_consensus.cc:2272] T 02a088f690eb45beb958d74519a39b7f P edcc56ddd3264984b4da6c1db59e7f08 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.596596  9681 tablet_replica.cc:333] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08: stopping tablet replica
I20260709 12:27:13.597400  9681 raft_consensus.cc:2243] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:27:13.599092 16569 raft_consensus.cc:493] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:27:13.599646 16569 raft_consensus.cc:515] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:27:13.601956 16569 leader_election.cc:290] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:27:13.603154 11589 consensus_peers.cc:597] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d -> Peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): Couldn't send request to peer edcc56ddd3264984b4da6c1db59e7f08. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:13.612416 10968 leader_election.cc:336] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111)
W20260709 12:27:13.613184 10968 leader_election.cc:336] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111)
I20260709 12:27:13.613548 10968 leader_election.cc:304] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:27:13.615083 16569 raft_consensus.cc:2749] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:13.598651  9681 raft_consensus.cc:2272] T 114b16c8c992413dab64ab31b16cb06f P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.622993  9681 tablet_replica.cc:333] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08: stopping tablet replica
I20260709 12:27:13.623803  9681 raft_consensus.cc:2243] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.624754  9681 raft_consensus.cc:2272] T cb220f7497ef4e739938460527b9d6f0 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.627632  9681 tablet_replica.cc:333] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08: stopping tablet replica
I20260709 12:27:13.628441  9681 raft_consensus.cc:2243] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.629089  9681 raft_consensus.cc:2272] T 3ad755c012434396a53498486697a9b4 P edcc56ddd3264984b4da6c1db59e7f08 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.632148  9681 tablet_replica.cc:333] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08: stopping tablet replica
I20260709 12:27:13.632901  9681 raft_consensus.cc:2243] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:27:13.634085  9681 raft_consensus.cc:2272] T e3d9a61ecaf84695b70f8519ee57706f P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.636541  9681 tablet_replica.cc:333] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08: stopping tablet replica
I20260709 12:27:13.637271  9681 raft_consensus.cc:2243] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.637907  9681 raft_consensus.cc:2272] T 7ac83709373b4efd9c3aa1472a9f9022 P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:13.639094 11589 consensus_peers.cc:597] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d -> Peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): Couldn't send request to peer edcc56ddd3264984b4da6c1db59e7f08. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:13.640880  9681 tablet_replica.cc:333] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08: stopping tablet replica
W20260709 12:27:13.641039 11588 consensus_peers.cc:597] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:27:13.642484  9681 raft_consensus.cc:2243] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.643975  9681 raft_consensus.cc:2272] T 5794ba618e514e28a7542ab6af39d8c9 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:13.644060 11589 consensus_peers.cc:597] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d -> Peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): Couldn't send request to peer edcc56ddd3264984b4da6c1db59e7f08. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:13.647102  9681 tablet_replica.cc:333] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08: stopping tablet replica
I20260709 12:27:13.647995  9681 raft_consensus.cc:2243] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.649322  9681 raft_consensus.cc:2272] T e8b17195a94142039c40f598ed006c94 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.652735  9681 tablet_replica.cc:333] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08: stopping tablet replica
I20260709 12:27:13.653683  9681 raft_consensus.cc:2243] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.655432  9681 raft_consensus.cc:2272] T 54df1a3d45b746398c2831883d796c6d P edcc56ddd3264984b4da6c1db59e7f08 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.659289  9681 tablet_replica.cc:333] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08: stopping tablet replica
I20260709 12:27:13.659957 16569 raft_consensus.cc:493] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:27:13.660531 16569 raft_consensus.cc:515] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } }
I20260709 12:27:13.661651  9681 raft_consensus.cc:2243] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:27:13.662946 16569 leader_election.cc:290] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:27:13.664646  9681 raft_consensus.cc:2272] T 352aa49c65194abbb863d7553a091f11 P edcc56ddd3264984b4da6c1db59e7f08 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.668471  9681 tablet_replica.cc:333] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08: stopping tablet replica
I20260709 12:27:13.669451  9681 raft_consensus.cc:2243] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.670383  9681 raft_consensus.cc:2272] T 26c7a4ac9606419a90700eec61a02bd8 P edcc56ddd3264984b4da6c1db59e7f08 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.674108  9681 tablet_replica.cc:333] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08: stopping tablet replica
W20260709 12:27:13.674510 10968 leader_election.cc:336] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111)
W20260709 12:27:13.675302 10968 leader_election.cc:336] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111)
I20260709 12:27:13.675367  9681 raft_consensus.cc:2243] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.675778 10968 leader_election.cc:304] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcc56ddd3264984b4da6c1db59e7f08; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:27:13.676590 16569 raft_consensus.cc:2706] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Received pre-election callback for term 13 while not running: Illegal state: RaftConsensus is not running: State = Stopping
I20260709 12:27:13.677824  9681 raft_consensus.cc:2272] T 1e97a41f10c041deb11464b469d0b5dd P edcc56ddd3264984b4da6c1db59e7f08 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.684085  9681 tablet_replica.cc:333] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08: stopping tablet replica
I20260709 12:27:13.685089  9681 raft_consensus.cc:2243] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:27:13.687040  9681 raft_consensus.cc:2272] T 53f8ad7184804b8da671a0b32db088ba P edcc56ddd3264984b4da6c1db59e7f08 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.690233  9681 tablet_replica.cc:333] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08: stopping tablet replica
I20260709 12:27:13.690976  9681 raft_consensus.cc:2243] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:27:13.692222  9681 raft_consensus.cc:2272] T 07a194e99ec5435b9e871484ecb661a1 P edcc56ddd3264984b4da6c1db59e7f08 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:13.693338 11589 consensus_peers.cc:597] T e9331e5342644ca2bae19187b083a7d5 P 3c52e0825c02476e89d84da9bb849f5d -> Peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): Couldn't send request to peer edcc56ddd3264984b4da6c1db59e7f08. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:13.695139  9681 tablet_replica.cc:333] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08: stopping tablet replica
I20260709 12:27:13.695909  9681 raft_consensus.cc:2243] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:27:13.697098  9681 raft_consensus.cc:2272] T 73d7ffc5e5d146d1b661abde11cf2f04 P edcc56ddd3264984b4da6c1db59e7f08 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.713254 16582 raft_consensus.cc:493] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:27:13.714072 16582 raft_consensus.cc:515] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:27:13.716985 16582 leader_election.cc:290] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:27:13.728582 11588 leader_election.cc:336] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111)
W20260709 12:27:13.729733 11588 leader_election.cc:336] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111)
I20260709 12:27:13.730746 11588 leader_election.cc:304] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:27:13.731830 16582 raft_consensus.cc:2749] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:27:13.774892 11589 consensus_peers.cc:597] T 435d66c6d38c4d8a90a81975a6a0cb13 P 3c52e0825c02476e89d84da9bb849f5d -> Peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): Couldn't send request to peer edcc56ddd3264984b4da6c1db59e7f08. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:13.779162 11588 consensus_peers.cc:597] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:27:13.877394 16582 raft_consensus.cc:493] T f52e71e935934a298445f2f87c913f9e P 3c52e0825c02476e89d84da9bb849f5d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:27:13.878033 16582 raft_consensus.cc:515] T f52e71e935934a298445f2f87c913f9e P 3c52e0825c02476e89d84da9bb849f5d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:27:13.881338 16582 leader_election.cc:290] T f52e71e935934a298445f2f87c913f9e P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:27:13.889621 11588 leader_election.cc:336] T f52e71e935934a298445f2f87c913f9e P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111)
W20260709 12:27:13.891122 11589 leader_election.cc:336] T f52e71e935934a298445f2f87c913f9e P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): Network error: Client connection negotiation failed: client connection to 127.9.116.67:39945: connect: Connection refused (error 111)
I20260709 12:27:13.891678 11589 leader_election.cc:304] T f52e71e935934a298445f2f87c913f9e P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:27:13.892717 16583 raft_consensus.cc:2749] T f52e71e935934a298445f2f87c913f9e P 3c52e0825c02476e89d84da9bb849f5d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:27:13.892827 11588 leader_election.cc:336] T f52e71e935934a298445f2f87c913f9e P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111)
I20260709 12:27:13.897548 16582 raft_consensus.cc:493] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:27:13.899215 16582 raft_consensus.cc:515] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:27:13.908644 11588 consensus_peers.cc:597] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:27:13.913444 16583 raft_consensus.cc:493] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:27:13.914060 16583 raft_consensus.cc:515] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:27:13.915390 16553 raft_consensus.cc:493] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:27:13.916175 16553 raft_consensus.cc:515] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:27:13.916532 16583 leader_election.cc:290] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:27:13.918382 16582 leader_election.cc:290] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
I20260709 12:27:13.921205 16553 leader_election.cc:290] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:27:13.925189 11588 consensus_peers.cc:597] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:27:13.943121 11588 leader_election.cc:336] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111)
W20260709 12:27:13.943948 11588 leader_election.cc:336] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111)
W20260709 12:27:13.944657 11588 leader_election.cc:336] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111)
W20260709 12:27:13.946635 11588 leader_election.cc:336] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111)
I20260709 12:27:13.947234 11588 leader_election.cc:304] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:27:13.948905 16553 raft_consensus.cc:2749] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:27:13.949014 11588 leader_election.cc:336] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111)
I20260709 12:27:13.950026 11588 leader_election.cc:304] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:27:13.950903 16553 raft_consensus.cc:2749] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:27:13.951129 11588 leader_election.cc:336] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111)
I20260709 12:27:13.951669 11588 leader_election.cc:304] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:27:13.952775 16553 raft_consensus.cc:2749] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:27:13.956144 11588 consensus_peers.cc:597] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:27:14.018435 16583 raft_consensus.cc:493] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:27:14.019011 16583 raft_consensus.cc:515] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:27:14.021955 16583 leader_election.cc:290] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:27:14.027387 11588 consensus_peers.cc:597] T 1f0741f995c74b5c91290f42110a3187 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:27:14.032609 11588 leader_election.cc:336] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111)
W20260709 12:27:14.033802 11588 leader_election.cc:336] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111)
I20260709 12:27:14.034286 11588 leader_election.cc:304] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:27:14.035066 16583 raft_consensus.cc:2749] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:27:14.059185 11588 consensus_peers.cc:597] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:27:14.467932 16553 raft_consensus.cc:493] T cb3b4ab419804fabb71d2a98c266b209 P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:27:14.468557 16553 raft_consensus.cc:515] T cb3b4ab419804fabb71d2a98c266b209 P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } attrs { replace: true } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:27:14.471771 16553 leader_election.cc:290] T cb3b4ab419804fabb71d2a98c266b209 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:27:14.476752 11589 leader_election.cc:336] T cb3b4ab419804fabb71d2a98c266b209 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): Network error: Client connection negotiation failed: client connection to 127.9.116.67:39945: connect: Connection refused (error 111)
W20260709 12:27:14.480027 11588 leader_election.cc:336] T cb3b4ab419804fabb71d2a98c266b209 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111)
I20260709 12:27:14.480633 11588 leader_election.cc:304] T cb3b4ab419804fabb71d2a98c266b209 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:27:14.481369 16553 raft_consensus.cc:2749] T cb3b4ab419804fabb71d2a98c266b209 P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:27:14.481521 11588 leader_election.cc:336] T cb3b4ab419804fabb71d2a98c266b209 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111)
I20260709 12:27:14.594008 16553 raft_consensus.cc:493] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:27:14.594674 16553 raft_consensus.cc:515] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:27:14.596993 16553 leader_election.cc:290] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:27:14.604805 11588 leader_election.cc:336] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111)
W20260709 12:27:14.607878 11589 leader_election.cc:336] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): Network error: Client connection negotiation failed: client connection to 127.9.116.67:39945: connect: Connection refused (error 111)
I20260709 12:27:14.608448 11589 leader_election.cc:304] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:27:14.609386 16553 raft_consensus.cc:2749] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:14.622180 16564 raft_consensus.cc:493] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:27:14.623215 16564 raft_consensus.cc:515] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:27:14.627992 16564 leader_election.cc:290] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:27:14.639777 11589 leader_election.cc:336] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): Network error: Client connection negotiation failed: client connection to 127.9.116.67:39945: connect: Connection refused (error 111)
W20260709 12:27:14.641139 11588 leader_election.cc:336] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111)
I20260709 12:27:14.641706 11588 leader_election.cc:304] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:27:14.642825 16583 raft_consensus.cc:2749] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:27:14.703285 11588 consensus_peers.cc:597] T ab816bcc6183447994a2cc013e46c5f8 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:27:14.798949 16583 raft_consensus.cc:493] T 12c494f15d054d2bba575010ccfbb60f P 3c52e0825c02476e89d84da9bb849f5d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:27:14.799602 16583 raft_consensus.cc:515] T 12c494f15d054d2bba575010ccfbb60f P 3c52e0825c02476e89d84da9bb849f5d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } attrs { replace: true } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:27:14.805914 16553 raft_consensus.cc:493] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:27:14.806540 16553 raft_consensus.cc:515] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:27:14.809122 16553 leader_election.cc:290] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:27:14.815307 11589 leader_election.cc:336] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): Network error: Client connection negotiation failed: client connection to 127.9.116.67:39945: connect: Connection refused (error 111)
W20260709 12:27:14.815908 11589 leader_election.cc:336] T 12c494f15d054d2bba575010ccfbb60f P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): Network error: Client connection negotiation failed: client connection to 127.9.116.67:39945: connect: Connection refused (error 111)
W20260709 12:27:14.822692 11588 leader_election.cc:336] T 12c494f15d054d2bba575010ccfbb60f P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111)
I20260709 12:27:14.823458 11588 leader_election.cc:304] T 12c494f15d054d2bba575010ccfbb60f P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:27:14.823788 16583 leader_election.cc:290] T 12c494f15d054d2bba575010ccfbb60f P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:27:14.824762 11588 leader_election.cc:336] T 12c494f15d054d2bba575010ccfbb60f P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111)
I20260709 12:27:14.828677 16553 raft_consensus.cc:2749] T 12c494f15d054d2bba575010ccfbb60f P 3c52e0825c02476e89d84da9bb849f5d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:27:14.831295 11588 leader_election.cc:336] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111)
I20260709 12:27:14.832304 11588 leader_election.cc:304] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:27:14.834348 16583 raft_consensus.cc:2749] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:14.836310 16583 raft_consensus.cc:493] T e3d9a61ecaf84695b70f8519ee57706f P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:27:14.836829 16583 raft_consensus.cc:515] T e3d9a61ecaf84695b70f8519ee57706f P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:27:14.838673 16583 leader_election.cc:290] T e3d9a61ecaf84695b70f8519ee57706f P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:27:14.846720 11588 leader_election.cc:336] T e3d9a61ecaf84695b70f8519ee57706f P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111)
I20260709 12:27:14.848349 16583 raft_consensus.cc:493] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:27:14.848971 16583 raft_consensus.cc:515] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:27:14.851359 16583 leader_election.cc:290] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:27:14.852269 11589 leader_election.cc:336] T e3d9a61ecaf84695b70f8519ee57706f P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): Network error: Client connection negotiation failed: client connection to 127.9.116.67:39945: connect: Connection refused (error 111)
I20260709 12:27:14.852762 11589 leader_election.cc:304] T e3d9a61ecaf84695b70f8519ee57706f P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:27:14.854115 16583 raft_consensus.cc:2749] T e3d9a61ecaf84695b70f8519ee57706f P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:27:14.861644 11589 leader_election.cc:336] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): Network error: Client connection negotiation failed: client connection to 127.9.116.67:39945: connect: Connection refused (error 111)
W20260709 12:27:14.862504 11588 leader_election.cc:336] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111)
I20260709 12:27:14.862897 11588 leader_election.cc:304] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:27:14.863621 16583 raft_consensus.cc:2749] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:14.871313 16583 raft_consensus.cc:493] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:27:14.871950 16583 raft_consensus.cc:515] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:27:14.875344 16583 leader_election.cc:290] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:27:14.878715 16583 raft_consensus.cc:493] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:27:14.879420 16583 raft_consensus.cc:515] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
W20260709 12:27:14.883162 11588 leader_election.cc:336] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111)
W20260709 12:27:14.891496 11588 leader_election.cc:336] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111)
W20260709 12:27:14.900527 11589 leader_election.cc:336] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): Network error: Client connection negotiation failed: client connection to 127.9.116.67:39945: connect: Connection refused (error 111)
I20260709 12:27:14.901086 11589 leader_election.cc:304] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:27:14.901684 16583 leader_election.cc:290] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
I20260709 12:27:14.902335 16564 raft_consensus.cc:2749] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:27:14.908587 11589 leader_election.cc:336] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): Network error: Client connection negotiation failed: client connection to 127.9.116.67:39945: connect: Connection refused (error 111)
I20260709 12:27:14.909178 11589 leader_election.cc:304] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:27:14.911703 16583 raft_consensus.cc:2749] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:27:14.955148 16564 raft_consensus.cc:493] T b289bc89d592435fb63c7fcf580d95a4 P 3c52e0825c02476e89d84da9bb849f5d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader edcc56ddd3264984b4da6c1db59e7f08)
I20260709 12:27:14.956048 16564 raft_consensus.cc:515] T b289bc89d592435fb63c7fcf580d95a4 P 3c52e0825c02476e89d84da9bb849f5d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "edcc56ddd3264984b4da6c1db59e7f08" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 39945 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:27:14.958462 16564 leader_election.cc:290] T b289bc89d592435fb63c7fcf580d95a4 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339), edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945)
W20260709 12:27:14.964864 11589 leader_election.cc:336] T b289bc89d592435fb63c7fcf580d95a4 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): Network error: Client connection negotiation failed: client connection to 127.9.116.67:39945: connect: Connection refused (error 111)
W20260709 12:27:14.967968 11588 leader_election.cc:336] T b289bc89d592435fb63c7fcf580d95a4 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111)
I20260709 12:27:14.968394 11588 leader_election.cc:304] T b289bc89d592435fb63c7fcf580d95a4 P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: e2d5c637307a407ab688f5ccd6f0fcea, edcc56ddd3264984b4da6c1db59e7f08
I20260709 12:27:14.969051 16564 raft_consensus.cc:2749] T b289bc89d592435fb63c7fcf580d95a4 P 3c52e0825c02476e89d84da9bb849f5d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:27:15.162364 11588 consensus_peers.cc:597] T 54df1a3d45b746398c2831883d796c6d P 3c52e0825c02476e89d84da9bb849f5d -> Peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Couldn't send request to peer e2d5c637307a407ab688f5ccd6f0fcea. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:15.258549 11588 consensus_peers.cc:597] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 3c52e0825c02476e89d84da9bb849f5d -> Peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Couldn't send request to peer e2d5c637307a407ab688f5ccd6f0fcea. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:15.347744 11588 consensus_peers.cc:597] T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d -> Peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Couldn't send request to peer e2d5c637307a407ab688f5ccd6f0fcea. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:15.362643 11588 consensus_peers.cc:597] T 1f0741f995c74b5c91290f42110a3187 P 3c52e0825c02476e89d84da9bb849f5d -> Peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Couldn't send request to peer e2d5c637307a407ab688f5ccd6f0fcea. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:15.378978 11588 consensus_peers.cc:597] T e8b17195a94142039c40f598ed006c94 P 3c52e0825c02476e89d84da9bb849f5d -> Peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Couldn't send request to peer e2d5c637307a407ab688f5ccd6f0fcea. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:15.429821 11588 consensus_peers.cc:597] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:27:15.439258 11588 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111) [suppressed 602 similar messages]
W20260709 12:27:15.535935 11588 consensus_peers.cc:597] T e9331e5342644ca2bae19187b083a7d5 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:27:15.572052 11588 consensus_peers.cc:597] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d -> Peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Couldn't send request to peer e2d5c637307a407ab688f5ccd6f0fcea. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:15.583705 16564 raft_consensus.cc:493] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:27:15.584707 16564 raft_consensus.cc:515] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:27:15.587684 16564 leader_election.cc:290] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:27:15.593758 11588 leader_election.cc:336] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111)
W20260709 12:27:15.594609 11588 leader_election.cc:336] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111)
I20260709 12:27:15.595006 11588 leader_election.cc:304] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:27:15.595882 16564 raft_consensus.cc:2749] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:27:15.613725 11588 consensus_peers.cc:597] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:27:15.623355 11588 consensus_peers.cc:597] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d -> Peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Couldn't send request to peer e2d5c637307a407ab688f5ccd6f0fcea. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:15.647812 11588 consensus_peers.cc:597] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d -> Peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Couldn't send request to peer e2d5c637307a407ab688f5ccd6f0fcea. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:15.719502 11589 consensus_peers.cc:597] T 54df1a3d45b746398c2831883d796c6d P 3c52e0825c02476e89d84da9bb849f5d -> Peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): Couldn't send request to peer edcc56ddd3264984b4da6c1db59e7f08. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.67:39945: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:15.723210 11588 consensus_peers.cc:597] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d -> Peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Couldn't send request to peer e2d5c637307a407ab688f5ccd6f0fcea. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:15.733310 11588 consensus_peers.cc:597] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:27:15.760073  9681 tablet_server.cc:196] TabletServer@127.9.116.67:0 shutdown complete.
I20260709 12:27:15.786192 16564 raft_consensus.cc:493] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e2d5c637307a407ab688f5ccd6f0fcea)
I20260709 12:27:15.787040 16564 raft_consensus.cc:515] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "80cd7d227db44f34a6108591dad9c040" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 46265 } } peers { permanent_uuid: "e2d5c637307a407ab688f5ccd6f0fcea" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 39339 } } peers { permanent_uuid: "3c52e0825c02476e89d84da9bb849f5d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37613 } attrs { promote: false } }
I20260709 12:27:15.789716 16564 leader_election.cc:290] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265), e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339)
W20260709 12:27:15.795141 11588 leader_election.cc:336] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111)
W20260709 12:27:15.795993 11588 leader_election.cc:336] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111)
I20260709 12:27:15.796356 11588 leader_election.cc:304] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c52e0825c02476e89d84da9bb849f5d; no voters: 80cd7d227db44f34a6108591dad9c040, e2d5c637307a407ab688f5ccd6f0fcea
I20260709 12:27:15.797036 16564 raft_consensus.cc:2749] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:27:15.817365 11588 consensus_peers.cc:597] T d0aed74af73a488f8b691578ca370226 P 3c52e0825c02476e89d84da9bb849f5d -> Peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Couldn't send request to peer e2d5c637307a407ab688f5ccd6f0fcea. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:15.851759 11589 consensus_peers.cc:597] T e8b17195a94142039c40f598ed006c94 P 3c52e0825c02476e89d84da9bb849f5d -> Peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): Couldn't send request to peer edcc56ddd3264984b4da6c1db59e7f08. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.67:39945: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:15.870640 11589 consensus_peers.cc:597] T ab816bcc6183447994a2cc013e46c5f8 P 3c52e0825c02476e89d84da9bb849f5d -> Peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): Couldn't send request to peer edcc56ddd3264984b4da6c1db59e7f08. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.67:39945: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:15.870885 11588 consensus_peers.cc:597] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:27:15.877351 11588 consensus_peers.cc:597] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d -> Peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Couldn't send request to peer e2d5c637307a407ab688f5ccd6f0fcea. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:15.909401 11589 consensus_peers.cc:597] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d -> Peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): Couldn't send request to peer edcc56ddd3264984b4da6c1db59e7f08. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.67:39945: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:15.914139 11588 consensus_peers.cc:597] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d -> Peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Couldn't send request to peer e2d5c637307a407ab688f5ccd6f0fcea. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:15.921993 11589 consensus_peers.cc:597] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d -> Peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): Couldn't send request to peer edcc56ddd3264984b4da6c1db59e7f08. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.67:39945: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:15.929126 11588 consensus_peers.cc:597] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:27:15.929819  9681 tablet_server.cc:179] TabletServer@127.9.116.68:0 shutting down...
W20260709 12:27:15.977070 11588 consensus_peers.cc:597] T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:27:16.013620  9681 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:27:16.015018 11589 consensus_peers.cc:597] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d -> Peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): Couldn't send request to peer edcc56ddd3264984b4da6c1db59e7f08. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.67:39945: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:16.015156  9681 tablet_replica.cc:333] T cb3b4ab419804fabb71d2a98c266b209 P 3c52e0825c02476e89d84da9bb849f5d: stopping tablet replica
I20260709 12:27:16.017299  9681 raft_consensus.cc:2243] T cb3b4ab419804fabb71d2a98c266b209 P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:16.018769  9681 raft_consensus.cc:2272] T cb3b4ab419804fabb71d2a98c266b209 P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:16.019299 11588 consensus_peers.cc:597] T 435d66c6d38c4d8a90a81975a6a0cb13 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:27:16.023495  9681 tablet_replica.cc:333] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d: stopping tablet replica
I20260709 12:27:16.024909  9681 raft_consensus.cc:2243] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:16.025928  9681 raft_consensus.cc:2272] T 3357adbb6a514faf958aff009c4e4af8 P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:16.029742  9681 tablet_replica.cc:333] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d: stopping tablet replica
I20260709 12:27:16.030866  9681 raft_consensus.cc:2243] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:27:16.032510  9681 raft_consensus.cc:2272] T 87cb7b380c8446e6ab1355c203218967 P 3c52e0825c02476e89d84da9bb849f5d [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:16.036008  9681 tablet_replica.cc:333] T e9331e5342644ca2bae19187b083a7d5 P 3c52e0825c02476e89d84da9bb849f5d: stopping tablet replica
I20260709 12:27:16.037016  9681 raft_consensus.cc:2243] T e9331e5342644ca2bae19187b083a7d5 P 3c52e0825c02476e89d84da9bb849f5d [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:27:16.038309  9681 raft_consensus.cc:2272] T e9331e5342644ca2bae19187b083a7d5 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:16.042665  9681 tablet_replica.cc:333] T 12c494f15d054d2bba575010ccfbb60f P 3c52e0825c02476e89d84da9bb849f5d: stopping tablet replica
I20260709 12:27:16.043928  9681 raft_consensus.cc:2243] T 12c494f15d054d2bba575010ccfbb60f P 3c52e0825c02476e89d84da9bb849f5d [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:16.046293  9681 raft_consensus.cc:2272] T 12c494f15d054d2bba575010ccfbb60f P 3c52e0825c02476e89d84da9bb849f5d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:16.050630  9681 tablet_replica.cc:333] T e8b17195a94142039c40f598ed006c94 P 3c52e0825c02476e89d84da9bb849f5d: stopping tablet replica
I20260709 12:27:16.051708  9681 raft_consensus.cc:2243] T e8b17195a94142039c40f598ed006c94 P 3c52e0825c02476e89d84da9bb849f5d [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:27:16.053128  9681 raft_consensus.cc:2272] T e8b17195a94142039c40f598ed006c94 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:16.056805  9681 tablet_replica.cc:333] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d: stopping tablet replica
I20260709 12:27:16.057808  9681 raft_consensus.cc:2243] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:27:16.059412  9681 raft_consensus.cc:2272] T 9b5cbc6740ba4e518cfc3499d4a01d2a P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:16.063851  9681 tablet_replica.cc:333] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d: stopping tablet replica
I20260709 12:27:16.064806  9681 raft_consensus.cc:2243] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:16.065510  9681 raft_consensus.cc:2272] T 1bf2fcbf6a2d4432a846a1e5cfa1c52a P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:16.069381  9681 tablet_replica.cc:333] T 1f0741f995c74b5c91290f42110a3187 P 3c52e0825c02476e89d84da9bb849f5d: stopping tablet replica
I20260709 12:27:16.070245  9681 raft_consensus.cc:2243] T 1f0741f995c74b5c91290f42110a3187 P 3c52e0825c02476e89d84da9bb849f5d [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:27:16.071360  9681 raft_consensus.cc:2272] T 1f0741f995c74b5c91290f42110a3187 P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:16.075174  9681 tablet_replica.cc:333] T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d: stopping tablet replica
I20260709 12:27:16.076090  9681 raft_consensus.cc:2243] T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:27:16.077405  9681 raft_consensus.cc:2272] T dad6a1da21304fcfacab384a6afc4101 P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:16.080447  9681 tablet_replica.cc:333] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d: stopping tablet replica
I20260709 12:27:16.081305  9681 raft_consensus.cc:2243] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:27:16.082460  9681 raft_consensus.cc:2272] T 438b1d5ca177401b94c157e6f4836150 P 3c52e0825c02476e89d84da9bb849f5d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:16.086361  9681 tablet_replica.cc:333] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d: stopping tablet replica
I20260709 12:27:16.087268  9681 raft_consensus.cc:2243] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:27:16.088646  9681 raft_consensus.cc:2272] T 60dca008c268416c8e63091506d1653e P 3c52e0825c02476e89d84da9bb849f5d [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:16.091611 11589 consensus_peers.cc:597] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d -> Peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): Couldn't send request to peer edcc56ddd3264984b4da6c1db59e7f08. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.67:39945: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:16.092269  9681 tablet_replica.cc:333] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d: stopping tablet replica
I20260709 12:27:16.093257  9681 raft_consensus.cc:2243] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:27:16.094374  9681 raft_consensus.cc:2272] T f5b822586ed04f2cb681fefd045b3f6d P 3c52e0825c02476e89d84da9bb849f5d [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:16.097683  9681 tablet_replica.cc:333] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d: stopping tablet replica
I20260709 12:27:16.098598  9681 raft_consensus.cc:2243] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:27:16.099714  9681 raft_consensus.cc:2272] T 9211e3b6d81447798824045b9515c0ee P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:16.102741  9681 tablet_replica.cc:333] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d: stopping tablet replica
I20260709 12:27:16.103637  9681 raft_consensus.cc:2243] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:16.104243  9681 raft_consensus.cc:2272] T 18294423a68a4671bf6c5a0f98645e4c P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:16.107530  9681 tablet_replica.cc:333] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d: stopping tablet replica
I20260709 12:27:16.108844  9681 raft_consensus.cc:2243] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:27:16.111016  9681 raft_consensus.cc:2272] T 577c93bfc0d84ec6ad610cad0cf16899 P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:16.115094  9681 tablet_replica.cc:333] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d: stopping tablet replica
I20260709 12:27:16.116115  9681 raft_consensus.cc:2243] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:27:16.117553  9681 raft_consensus.cc:2272] T ee998be153d94f6f91c39dace2c32f19 P 3c52e0825c02476e89d84da9bb849f5d [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:16.119239 11588 consensus_peers.cc:597] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d -> Peer 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): Couldn't send request to peer 80cd7d227db44f34a6108591dad9c040. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:27:16.121294  9681 tablet_replica.cc:333] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d: stopping tablet replica
I20260709 12:27:16.122380  9681 raft_consensus.cc:2243] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:16.123461  9681 raft_consensus.cc:2272] T c63ecfc9bd3945818cfe15c03f001315 P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:16.127077  9681 tablet_replica.cc:333] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 3c52e0825c02476e89d84da9bb849f5d: stopping tablet replica
I20260709 12:27:16.128038  9681 raft_consensus.cc:2243] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 3c52e0825c02476e89d84da9bb849f5d [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:27:16.129402  9681 raft_consensus.cc:2272] T 9f0dd1f84a304be0be5f4e4bf2aae6de P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:16.133477  9681 tablet_replica.cc:333] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d: stopping tablet replica
I20260709 12:27:16.134776  9681 raft_consensus.cc:2243] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:16.137341  9681 raft_consensus.cc:2272] T a6a28416571247df878823d464c05f1e P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:16.141217 11589 consensus_peers.cc:597] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d -> Peer edcc56ddd3264984b4da6c1db59e7f08 (127.9.116.67:39945): Couldn't send request to peer edcc56ddd3264984b4da6c1db59e7f08. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.67:39945: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:16.141595  9681 tablet_replica.cc:333] T 435d66c6d38c4d8a90a81975a6a0cb13 P 3c52e0825c02476e89d84da9bb849f5d: stopping tablet replica
I20260709 12:27:16.142891  9681 raft_consensus.cc:2243] T 435d66c6d38c4d8a90a81975a6a0cb13 P 3c52e0825c02476e89d84da9bb849f5d [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:27:16.144491  9681 raft_consensus.cc:2272] T 435d66c6d38c4d8a90a81975a6a0cb13 P 3c52e0825c02476e89d84da9bb849f5d [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:16.149070  9681 tablet_replica.cc:333] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d: stopping tablet replica
I20260709 12:27:16.150259  9681 raft_consensus.cc:2243] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:16.151440  9681 raft_consensus.cc:2272] T 442726a7f1e441248ec80a98b31eb341 P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:16.155057  9681 tablet_replica.cc:333] T b289bc89d592435fb63c7fcf580d95a4 P 3c52e0825c02476e89d84da9bb849f5d: stopping tablet replica
I20260709 12:27:16.155898  9681 raft_consensus.cc:2243] T b289bc89d592435fb63c7fcf580d95a4 P 3c52e0825c02476e89d84da9bb849f5d [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:16.156530  9681 raft_consensus.cc:2272] T b289bc89d592435fb63c7fcf580d95a4 P 3c52e0825c02476e89d84da9bb849f5d [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:16.156684 11588 consensus_peers.cc:597] T 4ef3220c51df47db8859f07ab745fad5 P 3c52e0825c02476e89d84da9bb849f5d -> Peer e2d5c637307a407ab688f5ccd6f0fcea (127.9.116.66:39339): Couldn't send request to peer e2d5c637307a407ab688f5ccd6f0fcea. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.66:39339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:16.160125  9681 tablet_replica.cc:333] T e3d9a61ecaf84695b70f8519ee57706f P 3c52e0825c02476e89d84da9bb849f5d: stopping tablet replica
I20260709 12:27:16.161089  9681 raft_consensus.cc:2243] T e3d9a61ecaf84695b70f8519ee57706f P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:16.162038  9681 raft_consensus.cc:2272] T e3d9a61ecaf84695b70f8519ee57706f P 3c52e0825c02476e89d84da9bb849f5d [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:16.165170  9681 tablet_replica.cc:333] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d: stopping tablet replica
I20260709 12:27:16.166013  9681 raft_consensus.cc:2243] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:16.166600  9681 raft_consensus.cc:2272] T 73d7ffc5e5d146d1b661abde11cf2f04 P 3c52e0825c02476e89d84da9bb849f5d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:16.170306  9681 tablet_replica.cc:333] T 4ef3220c51df47db8859f07ab745fad5 P 3c52e0825c02476e89d84da9bb849f5d: stopping tablet replica
I20260709 12:27:16.171226  9681 raft_consensus.cc:2243] T 4ef3220c51df47db8859f07ab745fad5 P 3c52e0825c02476e89d84da9bb849f5d [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:27:16.172413  9681 raft_consensus.cc:2272] T 4ef3220c51df47db8859f07ab745fad5 P 3c52e0825c02476e89d84da9bb849f5d [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:16.175621  9681 tablet_replica.cc:333] T d0aed74af73a488f8b691578ca370226 P 3c52e0825c02476e89d84da9bb849f5d: stopping tablet replica
I20260709 12:27:16.176409  9681 raft_consensus.cc:2243] T d0aed74af73a488f8b691578ca370226 P 3c52e0825c02476e89d84da9bb849f5d [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:27:16.177407  9681 raft_consensus.cc:2272] T d0aed74af73a488f8b691578ca370226 P 3c52e0825c02476e89d84da9bb849f5d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:16.180790  9681 tablet_replica.cc:333] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d: stopping tablet replica
I20260709 12:27:16.181782  9681 raft_consensus.cc:2243] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:16.182441  9681 raft_consensus.cc:2272] T 3f8a389131ef4c77a3e08488aa4759eb P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:16.185444  9681 tablet_replica.cc:333] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d: stopping tablet replica
I20260709 12:27:16.186201  9681 raft_consensus.cc:2243] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:27:16.187229  9681 raft_consensus.cc:2272] T 69fd8fdac2fa449e9e184f3d668ea1a7 P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:16.190059  9681 tablet_replica.cc:333] T 54df1a3d45b746398c2831883d796c6d P 3c52e0825c02476e89d84da9bb849f5d: stopping tablet replica
I20260709 12:27:16.190801  9681 raft_consensus.cc:2243] T 54df1a3d45b746398c2831883d796c6d P 3c52e0825c02476e89d84da9bb849f5d [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:27:16.192129  9681 raft_consensus.cc:2272] T 54df1a3d45b746398c2831883d796c6d P 3c52e0825c02476e89d84da9bb849f5d [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:16.195209  9681 tablet_replica.cc:333] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d: stopping tablet replica
I20260709 12:27:16.196118  9681 raft_consensus.cc:2243] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:27:16.197264  9681 raft_consensus.cc:2272] T 5794ba618e514e28a7542ab6af39d8c9 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:16.200719  9681 tablet_replica.cc:333] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d: stopping tablet replica
I20260709 12:27:16.201586  9681 raft_consensus.cc:2243] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:16.202257  9681 raft_consensus.cc:2272] T 352aa49c65194abbb863d7553a091f11 P 3c52e0825c02476e89d84da9bb849f5d [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:16.205475  9681 tablet_replica.cc:333] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d: stopping tablet replica
I20260709 12:27:16.206290  9681 raft_consensus.cc:2243] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:16.206948  9681 raft_consensus.cc:2272] T 114b16c8c992413dab64ab31b16cb06f P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:16.210635  9681 tablet_replica.cc:333] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d: stopping tablet replica
I20260709 12:27:16.211483  9681 raft_consensus.cc:2243] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:16.212553  9681 raft_consensus.cc:2272] T 53b0e2cbee394228af2190d22e7ea9ef P 3c52e0825c02476e89d84da9bb849f5d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:16.216163  9681 tablet_replica.cc:333] T ab816bcc6183447994a2cc013e46c5f8 P 3c52e0825c02476e89d84da9bb849f5d: stopping tablet replica
I20260709 12:27:16.217031  9681 raft_consensus.cc:2243] T ab816bcc6183447994a2cc013e46c5f8 P 3c52e0825c02476e89d84da9bb849f5d [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:27:16.218196  9681 raft_consensus.cc:2272] T ab816bcc6183447994a2cc013e46c5f8 P 3c52e0825c02476e89d84da9bb849f5d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:16.222148  9681 tablet_replica.cc:333] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d: stopping tablet replica
I20260709 12:27:16.223345  9681 raft_consensus.cc:2243] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:16.224167  9681 raft_consensus.cc:2272] T 834361a055d34950b4edecba39f07657 P 3c52e0825c02476e89d84da9bb849f5d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:16.228643  9681 tablet_replica.cc:333] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d: stopping tablet replica
I20260709 12:27:16.229648  9681 raft_consensus.cc:2243] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:27:16.231084  9681 raft_consensus.cc:2272] T 3ad755c012434396a53498486697a9b4 P 3c52e0825c02476e89d84da9bb849f5d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:16.234880  9681 tablet_replica.cc:333] T f52e71e935934a298445f2f87c913f9e P 3c52e0825c02476e89d84da9bb849f5d: stopping tablet replica
I20260709 12:27:16.235826  9681 raft_consensus.cc:2243] T f52e71e935934a298445f2f87c913f9e P 3c52e0825c02476e89d84da9bb849f5d [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:16.237473  9681 raft_consensus.cc:2272] T f52e71e935934a298445f2f87c913f9e P 3c52e0825c02476e89d84da9bb849f5d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:16.242038  9681 tablet_replica.cc:333] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d: stopping tablet replica
I20260709 12:27:16.242955  9681 raft_consensus.cc:2243] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:27:16.244343  9681 raft_consensus.cc:2272] T c2937f569e8041d9a71a575dc1b9d74d P 3c52e0825c02476e89d84da9bb849f5d [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:16.248035  9681 tablet_replica.cc:333] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d: stopping tablet replica
I20260709 12:27:16.248787  9681 raft_consensus.cc:2243] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:27:16.250298  9681 raft_consensus.cc:2272] T 2ac8522e549a46e09593fa4c2e175557 P 3c52e0825c02476e89d84da9bb849f5d [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:16.585685  9681 tablet_server.cc:196] TabletServer@127.9.116.68:0 shutdown complete.
I20260709 12:27:16.697805  9681 master.cc:562] Master@127.9.116.126:44563 shutting down...
W20260709 12:27:16.774130 10800 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 12:27:16.774480 10800 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:27:16.774717 10800 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:27:19.194458 10738 catalog_manager.cc:4755] TS 80cd7d227db44f34a6108591dad9c040 (127.9.116.65:46265): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 54df1a3d45b746398c2831883d796c6d: Network error: Client connection negotiation failed: client connection to 127.9.116.65:46265: connect: Connection refused (error 111)
I20260709 12:27:19.661171  9681 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 9619ad7a9e7f4d9b8039487e3ee77243 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:19.661928  9681 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 9619ad7a9e7f4d9b8039487e3ee77243 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.662266  9681 tablet_replica.cc:333] T 00000000000000000000000000000000 P 9619ad7a9e7f4d9b8039487e3ee77243: stopping tablet replica
I20260709 12:27:19.986672  9681 master.cc:584] Master@127.9.116.126:44563 shutdown complete.
I20260709 12:27:20.038532  9681 test_util.cc:182] -----------------------------------------------
I20260709 12:27:20.039029  9681 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599781984018-9681-0
[  FAILED  ] LeaderRebalancerTest.AddTserver (196839 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 12:27:20.043357  9681 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.9.116.126:46577
I20260709 12:27:20.044776  9681 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:20.052593 16593 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:20.052800 16595 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:20.053833 16592 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:20.054189  9681 server_base.cc:1061] running on GCE node
I20260709 12:27:20.058609  9681 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:20.058867  9681 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:20.059041  9681 hybrid_clock.cc:648] HybridClock initialized: now 1783600040059016 us; error 0 us; skew 500 ppm
I20260709 12:27:20.059707  9681 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:20.062944  9681 webserver.cc:533] Webserver started at http://127.9.116.126:45903/ using document root <none> and password file <none>
I20260709 12:27:20.063524  9681 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:20.063778  9681 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:20.064051  9681 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:20.065557  9681 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599781984018-9681-0/minicluster-data/master-0-root/instance:
uuid: "6ab0b5a8a05748e0b6c4b2e058a40dc4"
format_stamp: "Formatted at 2026-07-09 12:27:20 on dist-test-slave-zk51"
I20260709 12:27:20.071777  9681 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.001s
I20260709 12:27:20.076905 16600 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:20.078125  9681 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.003s
I20260709 12:27:20.078647  9681 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599781984018-9681-0/minicluster-data/master-0-root
uuid: "6ab0b5a8a05748e0b6c4b2e058a40dc4"
format_stamp: "Formatted at 2026-07-09 12:27:20 on dist-test-slave-zk51"
I20260709 12:27:20.079012  9681 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599781984018-9681-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599781984018-9681-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599781984018-9681-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:20.103972  9681 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:20.105551  9681 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:20.159271  9681 rpc_server.cc:307] RPC server started. Bound to: 127.9.116.126:46577
I20260709 12:27:20.159404 16651 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.116.126:46577 every 8 connection(s)
I20260709 12:27:20.164124 16652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:20.179528 16652 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ab0b5a8a05748e0b6c4b2e058a40dc4: Bootstrap starting.
I20260709 12:27:20.186465 16652 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6ab0b5a8a05748e0b6c4b2e058a40dc4: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:20.192365 16652 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ab0b5a8a05748e0b6c4b2e058a40dc4: No bootstrap required, opened a new log
I20260709 12:27:20.194643 16652 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6ab0b5a8a05748e0b6c4b2e058a40dc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ab0b5a8a05748e0b6c4b2e058a40dc4" member_type: VOTER }
I20260709 12:27:20.195060 16652 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6ab0b5a8a05748e0b6c4b2e058a40dc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:20.195263 16652 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6ab0b5a8a05748e0b6c4b2e058a40dc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ab0b5a8a05748e0b6c4b2e058a40dc4, State: Initialized, Role: FOLLOWER
I20260709 12:27:20.195957 16652 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6ab0b5a8a05748e0b6c4b2e058a40dc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ab0b5a8a05748e0b6c4b2e058a40dc4" member_type: VOTER }
I20260709 12:27:20.196416 16652 raft_consensus.cc:399] T 00000000000000000000000000000000 P 6ab0b5a8a05748e0b6c4b2e058a40dc4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:27:20.196624 16652 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6ab0b5a8a05748e0b6c4b2e058a40dc4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:27:20.196847 16652 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6ab0b5a8a05748e0b6c4b2e058a40dc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:20.204337 16652 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6ab0b5a8a05748e0b6c4b2e058a40dc4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ab0b5a8a05748e0b6c4b2e058a40dc4" member_type: VOTER }
I20260709 12:27:20.204929 16652 leader_election.cc:304] T 00000000000000000000000000000000 P 6ab0b5a8a05748e0b6c4b2e058a40dc4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6ab0b5a8a05748e0b6c4b2e058a40dc4; no voters: 
I20260709 12:27:20.206225 16652 leader_election.cc:290] T 00000000000000000000000000000000 P 6ab0b5a8a05748e0b6c4b2e058a40dc4 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:27:20.206683 16655 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6ab0b5a8a05748e0b6c4b2e058a40dc4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:20.208182 16655 raft_consensus.cc:697] T 00000000000000000000000000000000 P 6ab0b5a8a05748e0b6c4b2e058a40dc4 [term 1 LEADER]: Becoming Leader. State: Replica: 6ab0b5a8a05748e0b6c4b2e058a40dc4, State: Running, Role: LEADER
I20260709 12:27:20.208920 16655 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6ab0b5a8a05748e0b6c4b2e058a40dc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ab0b5a8a05748e0b6c4b2e058a40dc4" member_type: VOTER }
I20260709 12:27:20.209409 16652 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6ab0b5a8a05748e0b6c4b2e058a40dc4 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:27:20.216432 16657 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ab0b5a8a05748e0b6c4b2e058a40dc4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6ab0b5a8a05748e0b6c4b2e058a40dc4. Latest consensus state: current_term: 1 leader_uuid: "6ab0b5a8a05748e0b6c4b2e058a40dc4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ab0b5a8a05748e0b6c4b2e058a40dc4" member_type: VOTER } }
I20260709 12:27:20.217504 16657 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ab0b5a8a05748e0b6c4b2e058a40dc4 [sys.catalog]: This master's current role is: LEADER
I20260709 12:27:20.220531 16656 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ab0b5a8a05748e0b6c4b2e058a40dc4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6ab0b5a8a05748e0b6c4b2e058a40dc4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ab0b5a8a05748e0b6c4b2e058a40dc4" member_type: VOTER } }
I20260709 12:27:20.221230 16664 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:27:20.221311 16656 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ab0b5a8a05748e0b6c4b2e058a40dc4 [sys.catalog]: This master's current role is: LEADER
I20260709 12:27:20.228909 16664 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:27:20.232671  9681 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:27:20.242102 16664 catalog_manager.cc:1383] Generated new cluster ID: 3f24bd53dd184dcaa559ad6fccf31c60
I20260709 12:27:20.242440 16664 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:27:20.266842 16664 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:27:20.268177 16664 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:27:20.282924 16664 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 6ab0b5a8a05748e0b6c4b2e058a40dc4: Generated new TSK 0
I20260709 12:27:20.283640 16664 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:27:20.300269  9681 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:20.307893 16673 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:20.308883 16674 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:20.311683 16676 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:20.312211  9681 server_base.cc:1061] running on GCE node
I20260709 12:27:20.315551  9681 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:20.316090  9681 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:20.316372  9681 hybrid_clock.cc:648] HybridClock initialized: now 1783600040316353 us; error 0 us; skew 500 ppm
I20260709 12:27:20.317178  9681 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:20.320504  9681 webserver.cc:533] Webserver started at http://127.9.116.65:43467/ using document root <none> and password file <none>
I20260709 12:27:20.321199  9681 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:20.321424  9681 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:20.321775  9681 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:20.323328  9681 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599781984018-9681-0/minicluster-data/ts-0-root/instance:
uuid: "879366e90f5c420588945e0d545017c8"
format_stamp: "Formatted at 2026-07-09 12:27:20 on dist-test-slave-zk51"
I20260709 12:27:20.329340  9681 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:27:20.333458 16681 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:20.334560  9681 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 12:27:20.335120  9681 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599781984018-9681-0/minicluster-data/ts-0-root
uuid: "879366e90f5c420588945e0d545017c8"
format_stamp: "Formatted at 2026-07-09 12:27:20 on dist-test-slave-zk51"
I20260709 12:27:20.335701  9681 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599781984018-9681-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599781984018-9681-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599781984018-9681-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:20.357728  9681 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:20.359486  9681 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:20.361178  9681 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:27:20.364121  9681 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:27:20.364382  9681 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:20.364670  9681 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:27:20.364861  9681 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:20.420080  9681 rpc_server.cc:307] RPC server started. Bound to: 127.9.116.65:39833
I20260709 12:27:20.420238 16743 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.116.65:39833 every 8 connection(s)
I20260709 12:27:20.426347  9681 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:20.436687 16749 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:20.438527 16748 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:20.442749 16751 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:20.443070 16744 heartbeater.cc:344] Connected to a master server at 127.9.116.126:46577
I20260709 12:27:20.442768  9681 server_base.cc:1061] running on GCE node
I20260709 12:27:20.443774 16744 heartbeater.cc:461] Registering TS with master...
I20260709 12:27:20.444674 16744 heartbeater.cc:507] Master 127.9.116.126:46577 requested a full tablet report, sending...
I20260709 12:27:20.446302  9681 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:20.446573  9681 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:20.446784  9681 hybrid_clock.cc:648] HybridClock initialized: now 1783600040446740 us; error 0 us; skew 500 ppm
I20260709 12:27:20.447233 16617 ts_manager.cc:194] Registered new tserver with Master: 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:20.447485  9681 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:20.449433 16617 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45682
I20260709 12:27:20.450913  9681 webserver.cc:533] Webserver started at http://127.9.116.66:44445/ using document root <none> and password file <none>
I20260709 12:27:20.451629  9681 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:20.451896  9681 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:20.452279  9681 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:20.453577  9681 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599781984018-9681-0/minicluster-data/ts-1-root/instance:
uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b"
format_stamp: "Formatted at 2026-07-09 12:27:20 on dist-test-slave-zk51"
I20260709 12:27:20.458794  9681 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:27:20.463366 16756 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:20.464582  9681 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:27:20.465014  9681 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599781984018-9681-0/minicluster-data/ts-1-root
uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b"
format_stamp: "Formatted at 2026-07-09 12:27:20 on dist-test-slave-zk51"
I20260709 12:27:20.465343  9681 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599781984018-9681-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599781984018-9681-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599781984018-9681-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:20.478952  9681 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:20.480350  9681 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:20.482134  9681 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:27:20.484704  9681 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:27:20.484898  9681 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:20.485215  9681 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:27:20.485360  9681 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:20.541808  9681 rpc_server.cc:307] RPC server started. Bound to: 127.9.116.66:43629
I20260709 12:27:20.541930 16818 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.116.66:43629 every 8 connection(s)
I20260709 12:27:20.547968  9681 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:20.557209 16822 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:20.559038 16823 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:20.560988 16825 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:20.562815  9681 server_base.cc:1061] running on GCE node
I20260709 12:27:20.563962  9681 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:20.564275  9681 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:20.564474  9681 hybrid_clock.cc:648] HybridClock initialized: now 1783600040564438 us; error 0 us; skew 500 ppm
I20260709 12:27:20.564946 16819 heartbeater.cc:344] Connected to a master server at 127.9.116.126:46577
I20260709 12:27:20.565212  9681 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:20.565467 16819 heartbeater.cc:461] Registering TS with master...
I20260709 12:27:20.566592 16819 heartbeater.cc:507] Master 127.9.116.126:46577 requested a full tablet report, sending...
I20260709 12:27:20.568678  9681 webserver.cc:533] Webserver started at http://127.9.116.67:34445/ using document root <none> and password file <none>
I20260709 12:27:20.569376  9681 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:20.569623  9681 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:20.569655 16617 ts_manager.cc:194] Registered new tserver with Master: 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:20.569924  9681 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:20.571411  9681 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599781984018-9681-0/minicluster-data/ts-2-root/instance:
uuid: "17294485b7f24e2b9fae71dd3169a336"
format_stamp: "Formatted at 2026-07-09 12:27:20 on dist-test-slave-zk51"
I20260709 12:27:20.571426 16617 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45692
I20260709 12:27:20.579249  9681 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:27:20.583425 16830 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:20.584496  9681 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:27:20.584846  9681 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599781984018-9681-0/minicluster-data/ts-2-root
uuid: "17294485b7f24e2b9fae71dd3169a336"
format_stamp: "Formatted at 2026-07-09 12:27:20 on dist-test-slave-zk51"
I20260709 12:27:20.585163  9681 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599781984018-9681-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599781984018-9681-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599781984018-9681-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:20.599808  9681 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:20.601617  9681 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:20.603525  9681 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:27:20.606578  9681 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:27:20.606887  9681 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:20.607188  9681 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:27:20.607395  9681 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:20.655104  9681 rpc_server.cc:307] RPC server started. Bound to: 127.9.116.67:38103
I20260709 12:27:20.655283 16892 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.116.67:38103 every 8 connection(s)
I20260709 12:27:20.661386  9681 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:20.670302 16896 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:20.671670 16897 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:20.676755  9681 server_base.cc:1061] running on GCE node
W20260709 12:27:20.676725 16900 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:20.678408  9681 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:27:20.678426 16893 heartbeater.cc:344] Connected to a master server at 127.9.116.126:46577
W20260709 12:27:20.678821  9681 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:20.679028 16893 heartbeater.cc:461] Registering TS with master...
I20260709 12:27:20.679092  9681 hybrid_clock.cc:648] HybridClock initialized: now 1783600040679066 us; error 0 us; skew 500 ppm
I20260709 12:27:20.680380  9681 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:20.680516 16893 heartbeater.cc:507] Master 127.9.116.126:46577 requested a full tablet report, sending...
I20260709 12:27:20.683485 16617 ts_manager.cc:194] Registered new tserver with Master: 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
I20260709 12:27:20.683954  9681 webserver.cc:533] Webserver started at http://127.9.116.68:44589/ using document root <none> and password file <none>
I20260709 12:27:20.684753  9681 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:20.685031  9681 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:20.685434  9681 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:20.685576 16617 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45696
I20260709 12:27:20.687147  9681 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599781984018-9681-0/minicluster-data/ts-3-root/instance:
uuid: "82f27bcdf252425aad4c4a37d064f68d"
format_stamp: "Formatted at 2026-07-09 12:27:20 on dist-test-slave-zk51"
I20260709 12:27:20.692689  9681 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:27:20.697692 16904 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:20.699023  9681 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:27:20.699543  9681 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599781984018-9681-0/minicluster-data/ts-3-root
uuid: "82f27bcdf252425aad4c4a37d064f68d"
format_stamp: "Formatted at 2026-07-09 12:27:20 on dist-test-slave-zk51"
I20260709 12:27:20.699987  9681 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599781984018-9681-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599781984018-9681-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599781984018-9681-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:20.713253  9681 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:20.714637  9681 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:20.716980  9681 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:27:20.719376  9681 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:27:20.719564  9681 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:20.719959  9681 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:27:20.720168  9681 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:20.774972  9681 rpc_server.cc:307] RPC server started. Bound to: 127.9.116.68:37919
I20260709 12:27:20.775110 16966 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.116.68:37919 every 8 connection(s)
I20260709 12:27:20.791158 16967 heartbeater.cc:344] Connected to a master server at 127.9.116.126:46577
I20260709 12:27:20.791797 16967 heartbeater.cc:461] Registering TS with master...
I20260709 12:27:20.792729 16967 heartbeater.cc:507] Master 127.9.116.126:46577 requested a full tablet report, sending...
I20260709 12:27:20.795270 16617 ts_manager.cc:194] Registered new tserver with Master: 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919)
I20260709 12:27:20.795521  9681 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.017119316s
I20260709 12:27:20.797353 16617 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45712
I20260709 12:27:20.830444 16617 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45714:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 12:27:21.103330 16932 tablet_service.cc:1511] Processing CreateTablet for tablet 30a37807dd6548adb6e16f8a4d2e5774 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:27:21.104856 16932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30a37807dd6548adb6e16f8a4d2e5774. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:21.119503 16931 tablet_service.cc:1511] Processing CreateTablet for tablet 6916ee6a900c46508c98006aa85fe2d9 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:27:21.121451 16931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6916ee6a900c46508c98006aa85fe2d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:21.125880 16857 tablet_service.cc:1511] Processing CreateTablet for tablet 52538067157143b2abd4656a4bbb9442 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:27:21.127844 16857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52538067157143b2abd4656a4bbb9442. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:21.119665 16858 tablet_service.cc:1511] Processing CreateTablet for tablet 30a37807dd6548adb6e16f8a4d2e5774 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:27:21.130340 16858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30a37807dd6548adb6e16f8a4d2e5774. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:21.139897 16930 tablet_service.cc:1511] Processing CreateTablet for tablet 27dda31a8cd1468eb3a824ae026485a3 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:27:21.139642 16856 tablet_service.cc:1511] Processing CreateTablet for tablet 27dda31a8cd1468eb3a824ae026485a3 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:27:21.141999 16930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27dda31a8cd1468eb3a824ae026485a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:21.143044 16856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27dda31a8cd1468eb3a824ae026485a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:21.143266 16855 tablet_service.cc:1511] Processing CreateTablet for tablet 840a644e56054e13bfd7585fa064120c (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:27:21.144889 16855 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 840a644e56054e13bfd7585fa064120c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:21.146158 16929 tablet_service.cc:1511] Processing CreateTablet for tablet fbafe39b79894737b395f95013bc6c86 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:27:21.146754 16854 tablet_service.cc:1511] Processing CreateTablet for tablet 288d05b8017c4e0f8cd40048647aecae (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:27:21.147848 16929 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbafe39b79894737b395f95013bc6c86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:21.148321 16854 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 288d05b8017c4e0f8cd40048647aecae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:21.151952 16708 tablet_service.cc:1511] Processing CreateTablet for tablet 6916ee6a900c46508c98006aa85fe2d9 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:27:21.152905 16928 tablet_service.cc:1511] Processing CreateTablet for tablet 288d05b8017c4e0f8cd40048647aecae (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:27:21.153697 16708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6916ee6a900c46508c98006aa85fe2d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:21.154915 16928 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 288d05b8017c4e0f8cd40048647aecae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:21.155687 16853 tablet_service.cc:1511] Processing CreateTablet for tablet aee6b58df96f401f88392d39eba8ffbf (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:27:21.157325 16853 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aee6b58df96f401f88392d39eba8ffbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:21.158008 16927 tablet_service.cc:1511] Processing CreateTablet for tablet aee6b58df96f401f88392d39eba8ffbf (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:27:21.158424 16705 tablet_service.cc:1511] Processing CreateTablet for tablet fbafe39b79894737b395f95013bc6c86 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:27:21.160116 16705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbafe39b79894737b395f95013bc6c86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:21.160465 16927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aee6b58df96f401f88392d39eba8ffbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:21.161309 16707 tablet_service.cc:1511] Processing CreateTablet for tablet 27dda31a8cd1468eb3a824ae026485a3 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:27:21.163244 16707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27dda31a8cd1468eb3a824ae026485a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:21.165027 16706 tablet_service.cc:1511] Processing CreateTablet for tablet 840a644e56054e13bfd7585fa064120c (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:27:21.165422 16926 tablet_service.cc:1511] Processing CreateTablet for tablet d6811cd94dfd44149e1329e919d82f0f (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:27:21.165905 16704 tablet_service.cc:1511] Processing CreateTablet for tablet 288d05b8017c4e0f8cd40048647aecae (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:27:21.167013 16926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6811cd94dfd44149e1329e919d82f0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:21.168365 16852 tablet_service.cc:1511] Processing CreateTablet for tablet cd637126e0044d7996f18e258282a145 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:27:21.169983 16852 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd637126e0044d7996f18e258282a145. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:21.173120 16709 tablet_service.cc:1511] Processing CreateTablet for tablet 52538067157143b2abd4656a4bbb9442 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:27:21.175956 16709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52538067157143b2abd4656a4bbb9442. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:21.177716 16704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 288d05b8017c4e0f8cd40048647aecae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:21.192024 16706 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 840a644e56054e13bfd7585fa064120c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:21.235119 16989 tablet_bootstrap.cc:492] T 30a37807dd6548adb6e16f8a4d2e5774 P 82f27bcdf252425aad4c4a37d064f68d: Bootstrap starting.
I20260709 12:27:21.235119 16987 tablet_bootstrap.cc:492] T fbafe39b79894737b395f95013bc6c86 P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:21.244143 16987 tablet_bootstrap.cc:654] T fbafe39b79894737b395f95013bc6c86 P 879366e90f5c420588945e0d545017c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:21.287683 16703 tablet_service.cc:1511] Processing CreateTablet for tablet cd637126e0044d7996f18e258282a145 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:27:21.292753 16703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd637126e0044d7996f18e258282a145. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:27:21.293057 16665 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:27:21.293653 16702 tablet_service.cc:1511] Processing CreateTablet for tablet d6811cd94dfd44149e1329e919d82f0f (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:27:21.330560 16783 tablet_service.cc:1511] Processing CreateTablet for tablet 52538067157143b2abd4656a4bbb9442 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:27:21.333701 16783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52538067157143b2abd4656a4bbb9442. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:21.339756 16988 tablet_bootstrap.cc:492] T 27dda31a8cd1468eb3a824ae026485a3 P 17294485b7f24e2b9fae71dd3169a336: Bootstrap starting.
I20260709 12:27:21.310853 16784 tablet_service.cc:1511] Processing CreateTablet for tablet 30a37807dd6548adb6e16f8a4d2e5774 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:27:21.361282 16988 tablet_bootstrap.cc:654] T 27dda31a8cd1468eb3a824ae026485a3 P 17294485b7f24e2b9fae71dd3169a336: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:21.368244 16702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6811cd94dfd44149e1329e919d82f0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:21.375979 16781 tablet_service.cc:1511] Processing CreateTablet for tablet 840a644e56054e13bfd7585fa064120c (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:27:21.376250 16782 tablet_service.cc:1511] Processing CreateTablet for tablet 6916ee6a900c46508c98006aa85fe2d9 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:27:21.377579 16779 tablet_service.cc:1511] Processing CreateTablet for tablet aee6b58df96f401f88392d39eba8ffbf (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:27:21.244642 16989 tablet_bootstrap.cc:654] T 30a37807dd6548adb6e16f8a4d2e5774 P 82f27bcdf252425aad4c4a37d064f68d: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:21.377871 16778 tablet_service.cc:1511] Processing CreateTablet for tablet cd637126e0044d7996f18e258282a145 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:27:21.376250 16780 tablet_service.cc:1511] Processing CreateTablet for tablet fbafe39b79894737b395f95013bc6c86 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:27:21.355479 16784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30a37807dd6548adb6e16f8a4d2e5774. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:21.392222 16779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aee6b58df96f401f88392d39eba8ffbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:21.393127 16857 tablet_service.cc:1511] Processing CreateTablet for tablet 98a96f910b4449f7ba9c875e45090080 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:27:21.395251 16857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98a96f910b4449f7ba9c875e45090080. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:21.396066 16780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbafe39b79894737b395f95013bc6c86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:21.395689 16707 tablet_service.cc:1511] Processing CreateTablet for tablet 98a96f910b4449f7ba9c875e45090080 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:27:21.397612 16707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98a96f910b4449f7ba9c875e45090080. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:21.400839 16782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6916ee6a900c46508c98006aa85fe2d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:21.404044 16781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 840a644e56054e13bfd7585fa064120c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:21.405917 16777 tablet_service.cc:1511] Processing CreateTablet for tablet d6811cd94dfd44149e1329e919d82f0f (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:27:21.407949 16777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6811cd94dfd44149e1329e919d82f0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:21.409090 16778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd637126e0044d7996f18e258282a145. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:21.421221 16929 tablet_service.cc:1511] Processing CreateTablet for tablet 98a96f910b4449f7ba9c875e45090080 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:27:21.422197 16776 tablet_service.cc:1511] Processing CreateTablet for tablet fd1494eb0dd14dab9a2e4c07812117c2 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:27:21.423022 16929 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98a96f910b4449f7ba9c875e45090080. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:21.424355 16776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd1494eb0dd14dab9a2e4c07812117c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:21.454632 16744 heartbeater.cc:499] Master 127.9.116.126:46577 was elected leader, sending a full tablet report...
I20260709 12:27:21.457809 16989 tablet_bootstrap.cc:492] T 30a37807dd6548adb6e16f8a4d2e5774 P 82f27bcdf252425aad4c4a37d064f68d: No bootstrap required, opened a new log
I20260709 12:27:21.458791 16989 ts_tablet_manager.cc:1403] T 30a37807dd6548adb6e16f8a4d2e5774 P 82f27bcdf252425aad4c4a37d064f68d: Time spent bootstrapping tablet: real 0.224s	user 0.010s	sys 0.011s
I20260709 12:27:21.473978 16991 tablet_bootstrap.cc:492] T 52538067157143b2abd4656a4bbb9442 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Bootstrap starting.
I20260709 12:27:21.464166 16989 raft_consensus.cc:359] T 30a37807dd6548adb6e16f8a4d2e5774 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:21.479780 16989 raft_consensus.cc:385] T 30a37807dd6548adb6e16f8a4d2e5774 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:21.480727 16989 raft_consensus.cc:740] T 30a37807dd6548adb6e16f8a4d2e5774 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f27bcdf252425aad4c4a37d064f68d, State: Initialized, Role: FOLLOWER
I20260709 12:27:21.482798 16989 consensus_queue.cc:260] T 30a37807dd6548adb6e16f8a4d2e5774 P 82f27bcdf252425aad4c4a37d064f68d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
W20260709 12:27:21.483978 16603 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.9.116.65:39833, user_credentials={real_user=slave}} blocked reactor thread for 44613.2us
I20260709 12:27:21.515081 16855 tablet_service.cc:1511] Processing CreateTablet for tablet fd1494eb0dd14dab9a2e4c07812117c2 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:27:21.520746 16855 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd1494eb0dd14dab9a2e4c07812117c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:21.526703 16930 tablet_service.cc:1511] Processing CreateTablet for tablet fd1494eb0dd14dab9a2e4c07812117c2 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:27:21.530160 16930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd1494eb0dd14dab9a2e4c07812117c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:21.540613 16704 tablet_service.cc:1511] Processing CreateTablet for tablet 28bdf20fc71548da87c4558dacc503db (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:27:21.542325 16704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28bdf20fc71548da87c4558dacc503db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:21.543056 16991 tablet_bootstrap.cc:654] T 52538067157143b2abd4656a4bbb9442 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:21.547518 16988 tablet_bootstrap.cc:492] T 27dda31a8cd1468eb3a824ae026485a3 P 17294485b7f24e2b9fae71dd3169a336: No bootstrap required, opened a new log
I20260709 12:27:21.547684 16987 tablet_bootstrap.cc:492] T fbafe39b79894737b395f95013bc6c86 P 879366e90f5c420588945e0d545017c8: No bootstrap required, opened a new log
I20260709 12:27:21.548362 16988 ts_tablet_manager.cc:1403] T 27dda31a8cd1468eb3a824ae026485a3 P 17294485b7f24e2b9fae71dd3169a336: Time spent bootstrapping tablet: real 0.210s	user 0.022s	sys 0.012s
I20260709 12:27:21.548523 16987 ts_tablet_manager.cc:1403] T fbafe39b79894737b395f95013bc6c86 P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.314s	user 0.051s	sys 0.019s
I20260709 12:27:21.535247 16783 tablet_service.cc:1511] Processing CreateTablet for tablet 28bdf20fc71548da87c4558dacc503db (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:27:21.552906 16783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28bdf20fc71548da87c4558dacc503db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:21.552726 16987 raft_consensus.cc:359] T fbafe39b79894737b395f95013bc6c86 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:21.553212 16988 raft_consensus.cc:359] T 27dda31a8cd1468eb3a824ae026485a3 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:21.554031 16858 tablet_service.cc:1511] Processing CreateTablet for tablet 28bdf20fc71548da87c4558dacc503db (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:27:21.555513 16858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28bdf20fc71548da87c4558dacc503db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:21.553653 16987 raft_consensus.cc:385] T fbafe39b79894737b395f95013bc6c86 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:21.558635 16987 raft_consensus.cc:740] T fbafe39b79894737b395f95013bc6c86 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:21.554086 16988 raft_consensus.cc:385] T 27dda31a8cd1468eb3a824ae026485a3 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:21.560292 16988 raft_consensus.cc:740] T 27dda31a8cd1468eb3a824ae026485a3 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Initialized, Role: FOLLOWER
I20260709 12:27:21.561262 16988 consensus_queue.cc:260] T 27dda31a8cd1468eb3a824ae026485a3 P 17294485b7f24e2b9fae71dd3169a336 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:21.570858 16987 consensus_queue.cc:260] T fbafe39b79894737b395f95013bc6c86 P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:21.575268 16819 heartbeater.cc:499] Master 127.9.116.126:46577 was elected leader, sending a full tablet report...
I20260709 12:27:21.595036 16929 tablet_service.cc:1511] Processing CreateTablet for tablet ea5085716661498e9f3bfdfa2fc5737a (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:27:21.600841 16929 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea5085716661498e9f3bfdfa2fc5737a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:21.618311 16989 ts_tablet_manager.cc:1434] T 30a37807dd6548adb6e16f8a4d2e5774 P 82f27bcdf252425aad4c4a37d064f68d: Time spent starting tablet: real 0.159s	user 0.013s	sys 0.007s
I20260709 12:27:21.631764 16967 heartbeater.cc:499] Master 127.9.116.126:46577 was elected leader, sending a full tablet report...
I20260709 12:27:21.632232 16708 tablet_service.cc:1511] Processing CreateTablet for tablet ea5085716661498e9f3bfdfa2fc5737a (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:27:21.633291 16777 tablet_service.cc:1511] Processing CreateTablet for tablet ea5085716661498e9f3bfdfa2fc5737a (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:27:21.637192 16777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea5085716661498e9f3bfdfa2fc5737a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:21.634521 16708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea5085716661498e9f3bfdfa2fc5737a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:21.638392 16987 ts_tablet_manager.cc:1434] T fbafe39b79894737b395f95013bc6c86 P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.089s	user 0.008s	sys 0.007s
I20260709 12:27:21.639716 16987 tablet_bootstrap.cc:492] T 27dda31a8cd1468eb3a824ae026485a3 P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:21.653900 16987 tablet_bootstrap.cc:654] T 27dda31a8cd1468eb3a824ae026485a3 P 879366e90f5c420588945e0d545017c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:21.655443 16988 ts_tablet_manager.cc:1434] T 27dda31a8cd1468eb3a824ae026485a3 P 17294485b7f24e2b9fae71dd3169a336: Time spent starting tablet: real 0.107s	user 0.011s	sys 0.019s
W20260709 12:27:21.661751 16894 tablet.cc:2406] T 27dda31a8cd1468eb3a824ae026485a3 P 17294485b7f24e2b9fae71dd3169a336: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:27:21.664039 16893 heartbeater.cc:499] Master 127.9.116.126:46577 was elected leader, sending a full tablet report...
I20260709 12:27:21.665156 16989 tablet_bootstrap.cc:492] T d6811cd94dfd44149e1329e919d82f0f P 82f27bcdf252425aad4c4a37d064f68d: Bootstrap starting.
I20260709 12:27:21.670531 16994 raft_consensus.cc:493] T fbafe39b79894737b395f95013bc6c86 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:21.671232 16994 raft_consensus.cc:515] T fbafe39b79894737b395f95013bc6c86 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:21.679615 16991 tablet_bootstrap.cc:492] T 52538067157143b2abd4656a4bbb9442 P 3c1aba6ee1d244fd9c0daba722aa0b3b: No bootstrap required, opened a new log
I20260709 12:27:21.679394 16994 leader_election.cc:290] T fbafe39b79894737b395f95013bc6c86 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:21.685724 16991 ts_tablet_manager.cc:1403] T 52538067157143b2abd4656a4bbb9442 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent bootstrapping tablet: real 0.212s	user 0.016s	sys 0.019s
I20260709 12:27:21.686350 16928 tablet_service.cc:1511] Processing CreateTablet for tablet 27f104a1ba60493ab47f6b876da48d67 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:27:21.670547 16988 tablet_bootstrap.cc:492] T 52538067157143b2abd4656a4bbb9442 P 17294485b7f24e2b9fae71dd3169a336: Bootstrap starting.
I20260709 12:27:21.693678 16928 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27f104a1ba60493ab47f6b876da48d67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:21.696806 16703 tablet_service.cc:1511] Processing CreateTablet for tablet 27f104a1ba60493ab47f6b876da48d67 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:27:21.698676 16703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27f104a1ba60493ab47f6b876da48d67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:21.717211 16855 tablet_service.cc:1511] Processing CreateTablet for tablet 27f104a1ba60493ab47f6b876da48d67 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:27:21.718797 16855 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27f104a1ba60493ab47f6b876da48d67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:21.722815 16988 tablet_bootstrap.cc:654] T 52538067157143b2abd4656a4bbb9442 P 17294485b7f24e2b9fae71dd3169a336: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:21.755971 16997 raft_consensus.cc:493] T 30a37807dd6548adb6e16f8a4d2e5774 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:21.756731 16997 raft_consensus.cc:515] T 30a37807dd6548adb6e16f8a4d2e5774 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:21.758364 16858 tablet_service.cc:1511] Processing CreateTablet for tablet 6e43addba09b4930a12c94e691b2c76f (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:27:21.766990 16991 raft_consensus.cc:359] T 52538067157143b2abd4656a4bbb9442 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:21.767882 16991 raft_consensus.cc:385] T 52538067157143b2abd4656a4bbb9442 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:21.768174 16991 raft_consensus.cc:740] T 52538067157143b2abd4656a4bbb9442 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c1aba6ee1d244fd9c0daba722aa0b3b, State: Initialized, Role: FOLLOWER
I20260709 12:27:21.768844 16858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e43addba09b4930a12c94e691b2c76f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:21.770850 16779 tablet_service.cc:1511] Processing CreateTablet for tablet 6e43addba09b4930a12c94e691b2c76f (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:27:21.772243 16779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e43addba09b4930a12c94e691b2c76f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:21.772985 16997 leader_election.cc:290] T 30a37807dd6548adb6e16f8a4d2e5774 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:21.774446 16782 tablet_service.cc:1511] Processing CreateTablet for tablet e628dacc30694988a7c795441df15600 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:27:21.775194 16930 tablet_service.cc:1511] Processing CreateTablet for tablet 6e43addba09b4930a12c94e691b2c76f (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:27:21.775414 16991 consensus_queue.cc:260] T 52538067157143b2abd4656a4bbb9442 P 3c1aba6ee1d244fd9c0daba722aa0b3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:21.776111 16782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e628dacc30694988a7c795441df15600. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:21.776664 16930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e43addba09b4930a12c94e691b2c76f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:21.774482 16704 tablet_service.cc:1511] Processing CreateTablet for tablet e628dacc30694988a7c795441df15600 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:27:21.795053 16704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e628dacc30694988a7c795441df15600. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:21.799710 16778 tablet_service.cc:1511] Processing CreateTablet for tablet 00e5268529b241f184c460704ab9ed3c (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:27:21.793809 16989 tablet_bootstrap.cc:654] T d6811cd94dfd44149e1329e919d82f0f P 82f27bcdf252425aad4c4a37d064f68d: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:21.803371 16932 tablet_service.cc:1511] Processing CreateTablet for tablet 00e5268529b241f184c460704ab9ed3c (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:27:21.805697 16932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00e5268529b241f184c460704ab9ed3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:21.810886 16702 tablet_service.cc:1511] Processing CreateTablet for tablet 00e5268529b241f184c460704ab9ed3c (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:27:21.812983 16702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00e5268529b241f184c460704ab9ed3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:21.814036 16987 tablet_bootstrap.cc:492] T 27dda31a8cd1468eb3a824ae026485a3 P 879366e90f5c420588945e0d545017c8: No bootstrap required, opened a new log
I20260709 12:27:21.814637 16987 ts_tablet_manager.cc:1403] T 27dda31a8cd1468eb3a824ae026485a3 P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.175s	user 0.020s	sys 0.016s
I20260709 12:27:21.811038 16852 tablet_service.cc:1511] Processing CreateTablet for tablet e628dacc30694988a7c795441df15600 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:27:21.818156 16852 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e628dacc30694988a7c795441df15600. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:21.821429 16857 tablet_service.cc:1511] Processing CreateTablet for tablet 28c655b68dc545948c67e0977b49e770 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:27:21.822990 16857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28c655b68dc545948c67e0977b49e770. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:21.830389 16931 tablet_service.cc:1511] Processing CreateTablet for tablet 28c655b68dc545948c67e0977b49e770 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:27:21.832475 16931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28c655b68dc545948c67e0977b49e770. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:21.841269 16707 tablet_service.cc:1511] Processing CreateTablet for tablet 28c655b68dc545948c67e0977b49e770 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:27:21.848196 16707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28c655b68dc545948c67e0977b49e770. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:21.846268 16778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00e5268529b241f184c460704ab9ed3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:21.852774 16991 ts_tablet_manager.cc:1434] T 52538067157143b2abd4656a4bbb9442 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent starting tablet: real 0.166s	user 0.012s	sys 0.008s
I20260709 12:27:21.853979 16991 tablet_bootstrap.cc:492] T 30a37807dd6548adb6e16f8a4d2e5774 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Bootstrap starting.
I20260709 12:27:21.859139 16794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbafe39b79894737b395f95013bc6c86" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
I20260709 12:27:21.863540 16987 raft_consensus.cc:359] T 27dda31a8cd1468eb3a824ae026485a3 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
W20260709 12:27:21.864053 16685 leader_election.cc:343] T fbafe39b79894737b395f95013bc6c86 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:21.863404 16777 tablet_service.cc:1511] Processing CreateTablet for tablet de72d440fa1641a39aee027ffc0588a3 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:27:21.881073 16777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de72d440fa1641a39aee027ffc0588a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:21.882947 16927 tablet_service.cc:1511] Processing CreateTablet for tablet de72d440fa1641a39aee027ffc0588a3 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:27:21.885243 16927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de72d440fa1641a39aee027ffc0588a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:21.870749 16783 tablet_service.cc:1511] Processing CreateTablet for tablet c5baa0b4140847958c6528b3dbda7617 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:27:21.876310 16853 tablet_service.cc:1511] Processing CreateTablet for tablet de72d440fa1641a39aee027ffc0588a3 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:27:21.877470 16995 raft_consensus.cc:493] T 27dda31a8cd1468eb3a824ae026485a3 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:21.878322 16706 tablet_service.cc:1511] Processing CreateTablet for tablet c5baa0b4140847958c6528b3dbda7617 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:27:21.903833 16706 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5baa0b4140847958c6528b3dbda7617. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:21.906162 16854 tablet_service.cc:1511] Processing CreateTablet for tablet c5baa0b4140847958c6528b3dbda7617 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:27:21.908102 16854 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5baa0b4140847958c6528b3dbda7617. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:21.902053 16995 raft_consensus.cc:515] T 27dda31a8cd1468eb3a824ae026485a3 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:21.911010 16708 tablet_service.cc:1511] Processing CreateTablet for tablet 223b3745452c412581caf058f6b81fe2 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:27:21.916016 16708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 223b3745452c412581caf058f6b81fe2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:21.893332 16987 raft_consensus.cc:385] T 27dda31a8cd1468eb3a824ae026485a3 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:21.918216 16780 tablet_service.cc:1511] Processing CreateTablet for tablet 223b3745452c412581caf058f6b81fe2 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:27:21.920711 16783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5baa0b4140847958c6528b3dbda7617. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:21.924022 16987 raft_consensus.cc:740] T 27dda31a8cd1468eb3a824ae026485a3 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:21.925069 16987 consensus_queue.cc:260] T 27dda31a8cd1468eb3a824ae026485a3 P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:21.932255 16853 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de72d440fa1641a39aee027ffc0588a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:21.940442 16929 tablet_service.cc:1511] Processing CreateTablet for tablet 223b3745452c412581caf058f6b81fe2 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:27:21.948655 16929 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 223b3745452c412581caf058f6b81fe2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:21.944583 16780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 223b3745452c412581caf058f6b81fe2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:21.935003 16987 ts_tablet_manager.cc:1434] T 27dda31a8cd1468eb3a824ae026485a3 P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.113s	user 0.004s	sys 0.004s
I20260709 12:27:21.981993 16987 tablet_bootstrap.cc:492] T 52538067157143b2abd4656a4bbb9442 P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:21.983981 16995 leader_election.cc:290] T 27dda31a8cd1468eb3a824ae026485a3 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919)
I20260709 12:27:21.989691 16928 tablet_service.cc:1511] Processing CreateTablet for tablet b10d5b4017584d0fb22f9e542d95fcb1 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:27:21.993557 16989 tablet_bootstrap.cc:492] T d6811cd94dfd44149e1329e919d82f0f P 82f27bcdf252425aad4c4a37d064f68d: No bootstrap required, opened a new log
I20260709 12:27:21.993228 16856 tablet_service.cc:1511] Processing CreateTablet for tablet b10d5b4017584d0fb22f9e542d95fcb1 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:27:21.993893 16988 tablet_bootstrap.cc:492] T 52538067157143b2abd4656a4bbb9442 P 17294485b7f24e2b9fae71dd3169a336: No bootstrap required, opened a new log
I20260709 12:27:21.994102 16989 ts_tablet_manager.cc:1403] T d6811cd94dfd44149e1329e919d82f0f P 82f27bcdf252425aad4c4a37d064f68d: Time spent bootstrapping tablet: real 0.363s	user 0.020s	sys 0.011s
I20260709 12:27:21.994562 16988 ts_tablet_manager.cc:1403] T 52538067157143b2abd4656a4bbb9442 P 17294485b7f24e2b9fae71dd3169a336: Time spent bootstrapping tablet: real 0.324s	user 0.018s	sys 0.005s
I20260709 12:27:21.994617 16856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b10d5b4017584d0fb22f9e542d95fcb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:21.998270 16989 raft_consensus.cc:359] T d6811cd94dfd44149e1329e919d82f0f P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:21.999121 16989 raft_consensus.cc:385] T d6811cd94dfd44149e1329e919d82f0f P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:21.999426 16989 raft_consensus.cc:740] T d6811cd94dfd44149e1329e919d82f0f P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f27bcdf252425aad4c4a37d064f68d, State: Initialized, Role: FOLLOWER
I20260709 12:27:22.000900 16989 consensus_queue.cc:260] T d6811cd94dfd44149e1329e919d82f0f P 82f27bcdf252425aad4c4a37d064f68d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:22.001924 16928 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b10d5b4017584d0fb22f9e542d95fcb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:22.009989 16868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a37807dd6548adb6e16f8a4d2e5774" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:22.011010 16991 tablet_bootstrap.cc:654] T 30a37807dd6548adb6e16f8a4d2e5774 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Neither blocks nor log segments found. Creating new log.
W20260709 12:27:22.020772 16907 leader_election.cc:343] T 30a37807dd6548adb6e16f8a4d2e5774 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:22.022689 16703 tablet_service.cc:1511] Processing CreateTablet for tablet b10d5b4017584d0fb22f9e542d95fcb1 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:27:22.036759 16994 raft_consensus.cc:493] T 27dda31a8cd1468eb3a824ae026485a3 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:22.037583 16703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b10d5b4017584d0fb22f9e542d95fcb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:22.037737 16994 raft_consensus.cc:515] T 27dda31a8cd1468eb3a824ae026485a3 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:22.041625 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbafe39b79894737b395f95013bc6c86" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
W20260709 12:27:22.048940 16684 leader_election.cc:343] T fbafe39b79894737b395f95013bc6c86 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:22.049543 16684 leader_election.cc:304] T fbafe39b79894737b395f95013bc6c86 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 879366e90f5c420588945e0d545017c8; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 82f27bcdf252425aad4c4a37d064f68d
I20260709 12:27:22.062765 16994 leader_election.cc:290] T 27dda31a8cd1468eb3a824ae026485a3 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919)
I20260709 12:27:22.063431 16994 raft_consensus.cc:2749] T fbafe39b79894737b395f95013bc6c86 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:22.065735 16988 raft_consensus.cc:359] T 52538067157143b2abd4656a4bbb9442 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:22.066519 16988 raft_consensus.cc:385] T 52538067157143b2abd4656a4bbb9442 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:22.069264 16988 raft_consensus.cc:740] T 52538067157143b2abd4656a4bbb9442 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Initialized, Role: FOLLOWER
I20260709 12:27:22.073136 16988 consensus_queue.cc:260] T 52538067157143b2abd4656a4bbb9442 P 17294485b7f24e2b9fae71dd3169a336 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:22.078375 16989 ts_tablet_manager.cc:1434] T d6811cd94dfd44149e1329e919d82f0f P 82f27bcdf252425aad4c4a37d064f68d: Time spent starting tablet: real 0.084s	user 0.009s	sys 0.001s
I20260709 12:27:22.100725 16931 tablet_service.cc:1511] Processing CreateTablet for tablet 60a8110f7e424463ae56af0646bf4434 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:27:22.102603 16931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60a8110f7e424463ae56af0646bf4434. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:22.115705 16704 tablet_service.cc:1511] Processing CreateTablet for tablet 5025c37302bd4a2aa076878e1af90366 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:27:22.117303 16704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5025c37302bd4a2aa076878e1af90366. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:22.120064 16997 raft_consensus.cc:493] T d6811cd94dfd44149e1329e919d82f0f P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:22.120913 16997 raft_consensus.cc:515] T d6811cd94dfd44149e1329e919d82f0f P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:22.122818 16987 tablet_bootstrap.cc:654] T 52538067157143b2abd4656a4bbb9442 P 879366e90f5c420588945e0d545017c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:22.163223 16852 tablet_service.cc:1511] Processing CreateTablet for tablet 60a8110f7e424463ae56af0646bf4434 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:27:22.168190 16794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a37807dd6548adb6e16f8a4d2e5774" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
I20260709 12:27:22.168831 16852 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60a8110f7e424463ae56af0646bf4434. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:27:22.170095 16908 leader_election.cc:343] T 30a37807dd6548adb6e16f8a4d2e5774 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:22.170272 16778 tablet_service.cc:1511] Processing CreateTablet for tablet 60a8110f7e424463ae56af0646bf4434 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:27:22.170704 16908 leader_election.cc:304] T 30a37807dd6548adb6e16f8a4d2e5774 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 17294485b7f24e2b9fae71dd3169a336, 3c1aba6ee1d244fd9c0daba722aa0b3b
I20260709 12:27:22.170941 16997 leader_election.cc:290] T d6811cd94dfd44149e1329e919d82f0f P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:22.174418 16794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6811cd94dfd44149e1329e919d82f0f" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
W20260709 12:27:22.158334 16684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37919, user_credentials={real_user=slave}} blocked reactor thread for 109579us
I20260709 12:27:22.176570 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27dda31a8cd1468eb3a824ae026485a3" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
W20260709 12:27:22.177841 16908 leader_election.cc:343] T d6811cd94dfd44149e1329e919d82f0f P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:22.177857 16988 ts_tablet_manager.cc:1434] T 52538067157143b2abd4656a4bbb9442 P 17294485b7f24e2b9fae71dd3169a336: Time spent starting tablet: real 0.183s	user 0.008s	sys 0.002s
I20260709 12:27:22.178807 16997 raft_consensus.cc:2749] T 30a37807dd6548adb6e16f8a4d2e5774 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:22.188095 16778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60a8110f7e424463ae56af0646bf4434. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:22.187942 16782 tablet_service.cc:1511] Processing CreateTablet for tablet 5025c37302bd4a2aa076878e1af90366 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:27:22.189493 16782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5025c37302bd4a2aa076878e1af90366. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:22.196843 16928 tablet_service.cc:1511] Processing CreateTablet for tablet a0409dc146674a39a9ceeeeebc081453 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:27:22.197930 16991 tablet_bootstrap.cc:492] T 30a37807dd6548adb6e16f8a4d2e5774 P 3c1aba6ee1d244fd9c0daba722aa0b3b: No bootstrap required, opened a new log
I20260709 12:27:22.197438 16707 tablet_service.cc:1511] Processing CreateTablet for tablet a0409dc146674a39a9ceeeeebc081453 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:27:22.198526 16991 ts_tablet_manager.cc:1403] T 30a37807dd6548adb6e16f8a4d2e5774 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent bootstrapping tablet: real 0.345s	user 0.044s	sys 0.055s
I20260709 12:27:22.199424 16707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0409dc146674a39a9ceeeeebc081453. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:22.199069 16854 tablet_service.cc:1511] Processing CreateTablet for tablet 5025c37302bd4a2aa076878e1af90366 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:27:22.201552 16854 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5025c37302bd4a2aa076878e1af90366. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:22.198288 16928 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0409dc146674a39a9ceeeeebc081453. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:22.202208 16991 raft_consensus.cc:359] T 30a37807dd6548adb6e16f8a4d2e5774 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:22.203029 16991 raft_consensus.cc:385] T 30a37807dd6548adb6e16f8a4d2e5774 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:22.187824 16989 tablet_bootstrap.cc:492] T aee6b58df96f401f88392d39eba8ffbf P 82f27bcdf252425aad4c4a37d064f68d: Bootstrap starting.
I20260709 12:27:22.203366 16991 raft_consensus.cc:740] T 30a37807dd6548adb6e16f8a4d2e5774 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c1aba6ee1d244fd9c0daba722aa0b3b, State: Initialized, Role: FOLLOWER
I20260709 12:27:22.212041 16991 consensus_queue.cc:260] T 30a37807dd6548adb6e16f8a4d2e5774 P 3c1aba6ee1d244fd9c0daba722aa0b3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:22.213059 17005 raft_consensus.cc:493] T 52538067157143b2abd4656a4bbb9442 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:22.216800 17005 raft_consensus.cc:515] T 52538067157143b2abd4656a4bbb9442 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:22.227674 17005 leader_election.cc:290] T 52538067157143b2abd4656a4bbb9442 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
I20260709 12:27:22.229624 16783 tablet_service.cc:1511] Processing CreateTablet for tablet a0409dc146674a39a9ceeeeebc081453 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:27:22.228765 16868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27dda31a8cd1468eb3a824ae026485a3" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:22.230752 16868 raft_consensus.cc:2468] T 27dda31a8cd1468eb3a824ae026485a3 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 0.
I20260709 12:27:22.233093 16783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0409dc146674a39a9ceeeeebc081453. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:22.242841 16989 tablet_bootstrap.cc:654] T aee6b58df96f401f88392d39eba8ffbf P 82f27bcdf252425aad4c4a37d064f68d: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:22.235914 16988 tablet_bootstrap.cc:492] T 288d05b8017c4e0f8cd40048647aecae P 17294485b7f24e2b9fae71dd3169a336: Bootstrap starting.
I20260709 12:27:22.256389 16927 tablet_service.cc:1511] Processing CreateTablet for tablet b777ccb9937a476590a534fea0428c5c (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:27:22.260926 16927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b777ccb9937a476590a534fea0428c5c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:27:22.229725 16684 leader_election.cc:343] T 27dda31a8cd1468eb3a824ae026485a3 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:22.257858 16987 tablet_bootstrap.cc:492] T 52538067157143b2abd4656a4bbb9442 P 879366e90f5c420588945e0d545017c8: No bootstrap required, opened a new log
I20260709 12:27:22.256596 16853 tablet_service.cc:1511] Processing CreateTablet for tablet b777ccb9937a476590a534fea0428c5c (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:27:22.268460 16987 ts_tablet_manager.cc:1403] T 52538067157143b2abd4656a4bbb9442 P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.287s	user 0.021s	sys 0.007s
I20260709 12:27:22.269018 16853 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b777ccb9937a476590a534fea0428c5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:22.269567 16777 tablet_service.cc:1511] Processing CreateTablet for tablet cfc80a8e57c24a768ebc48dd544a6c80 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:27:22.271005 16777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfc80a8e57c24a768ebc48dd544a6c80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:22.272145 16987 raft_consensus.cc:359] T 52538067157143b2abd4656a4bbb9442 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:22.273026 16987 raft_consensus.cc:385] T 52538067157143b2abd4656a4bbb9442 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:22.273379 16987 raft_consensus.cc:740] T 52538067157143b2abd4656a4bbb9442 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:22.267058 16708 tablet_service.cc:1511] Processing CreateTablet for tablet b777ccb9937a476590a534fea0428c5c (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:27:22.274983 16987 consensus_queue.cc:260] T 52538067157143b2abd4656a4bbb9442 P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:22.276440 16708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b777ccb9937a476590a534fea0428c5c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:27:22.273866 16684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37919, user_credentials={real_user=slave}} blocked reactor thread for 44196.3us
I20260709 12:27:22.279484 16995 raft_consensus.cc:493] T 52538067157143b2abd4656a4bbb9442 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:22.280088 16995 raft_consensus.cc:515] T 52538067157143b2abd4656a4bbb9442 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:22.284500 16719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27dda31a8cd1468eb3a824ae026485a3" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8" is_pre_election: true
I20260709 12:27:22.285521 16719 raft_consensus.cc:2468] T 27dda31a8cd1468eb3a824ae026485a3 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 0.
I20260709 12:27:22.287503 16991 ts_tablet_manager.cc:1434] T 30a37807dd6548adb6e16f8a4d2e5774 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent starting tablet: real 0.089s	user 0.010s	sys 0.010s
I20260709 12:27:22.288864 16991 tablet_bootstrap.cc:492] T fd1494eb0dd14dab9a2e4c07812117c2 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Bootstrap starting.
I20260709 12:27:22.289110 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27dda31a8cd1468eb3a824ae026485a3" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:22.291258 16995 leader_election.cc:290] T 52538067157143b2abd4656a4bbb9442 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:22.291218 16929 tablet_service.cc:1511] Processing CreateTablet for tablet cfc80a8e57c24a768ebc48dd544a6c80 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:27:22.293289 16929 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfc80a8e57c24a768ebc48dd544a6c80. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:27:22.296660 16665 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:27:22.301054 16704 tablet_service.cc:1511] Processing CreateTablet for tablet fe16827e0b4a45baa99739174f92a0f7 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:27:22.287134 16856 tablet_service.cc:1511] Processing CreateTablet for tablet cfc80a8e57c24a768ebc48dd544a6c80 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:27:22.303818 16704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe16827e0b4a45baa99739174f92a0f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:22.311394 16856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfc80a8e57c24a768ebc48dd544a6c80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:22.312261 16988 tablet_bootstrap.cc:654] T 288d05b8017c4e0f8cd40048647aecae P 17294485b7f24e2b9fae71dd3169a336: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:22.319967 16719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52538067157143b2abd4656a4bbb9442" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8" is_pre_election: true
I20260709 12:27:22.320777 16719 raft_consensus.cc:2468] T 52538067157143b2abd4656a4bbb9442 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 0.
I20260709 12:27:22.321837 16857 tablet_service.cc:1511] Processing CreateTablet for tablet fe16827e0b4a45baa99739174f92a0f7 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:27:22.319967 16778 tablet_service.cc:1511] Processing CreateTablet for tablet fe16827e0b4a45baa99739174f92a0f7 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:27:22.323833 16857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe16827e0b4a45baa99739174f92a0f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:22.324328 16778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe16827e0b4a45baa99739174f92a0f7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:27:22.337850 16833 leader_election.cc:343] T 27dda31a8cd1468eb3a824ae026485a3 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:22.338960 16833 leader_election.cc:304] T 27dda31a8cd1468eb3a824ae026485a3 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8; no voters: 82f27bcdf252425aad4c4a37d064f68d
I20260709 12:27:22.350472 16987 ts_tablet_manager.cc:1434] T 52538067157143b2abd4656a4bbb9442 P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.082s	user 0.008s	sys 0.000s
I20260709 12:27:22.352385 16719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6811cd94dfd44149e1329e919d82f0f" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8" is_pre_election: true
I20260709 12:27:22.363469 16995 raft_consensus.cc:2804] T 27dda31a8cd1468eb3a824ae026485a3 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:22.364097 16995 raft_consensus.cc:493] T 27dda31a8cd1468eb3a824ae026485a3 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:22.364533 16995 raft_consensus.cc:3060] T 27dda31a8cd1468eb3a824ae026485a3 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:22.365494 16833 leader_election.cc:304] T 52538067157143b2abd4656a4bbb9442 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8; no voters: 
I20260709 12:27:22.357474 16991 tablet_bootstrap.cc:654] T fd1494eb0dd14dab9a2e4c07812117c2 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:22.353351 16684 leader_election.cc:304] T 27dda31a8cd1468eb3a824ae026485a3 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8; no voters: 82f27bcdf252425aad4c4a37d064f68d
I20260709 12:27:22.364425 16987 tablet_bootstrap.cc:492] T 840a644e56054e13bfd7585fa064120c P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
W20260709 12:27:22.378151 16907 leader_election.cc:343] T d6811cd94dfd44149e1329e919d82f0f P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:22.378528 17011 raft_consensus.cc:2804] T 27dda31a8cd1468eb3a824ae026485a3 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:22.378770 16907 leader_election.cc:304] T d6811cd94dfd44149e1329e919d82f0f P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8
I20260709 12:27:22.379096 17011 raft_consensus.cc:493] T 27dda31a8cd1468eb3a824ae026485a3 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:22.378190 16931 tablet_service.cc:1511] Processing CreateTablet for tablet 7b90200ef21f42f1929fbf0051ef5b3e (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:27:22.390525 16931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b90200ef21f42f1929fbf0051ef5b3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:22.379554 17011 raft_consensus.cc:3060] T 27dda31a8cd1468eb3a824ae026485a3 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:22.385313 16997 raft_consensus.cc:2749] T d6811cd94dfd44149e1329e919d82f0f P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:22.413327 17011 raft_consensus.cc:515] T 27dda31a8cd1468eb3a824ae026485a3 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:22.416349 16719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52538067157143b2abd4656a4bbb9442" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8" is_pre_election: true
I20260709 12:27:22.417591 16719 raft_consensus.cc:2468] T 52538067157143b2abd4656a4bbb9442 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in term 0.
I20260709 12:27:22.422191 16703 tablet_service.cc:1511] Processing CreateTablet for tablet 7b90200ef21f42f1929fbf0051ef5b3e (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:27:22.428053 16703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b90200ef21f42f1929fbf0051ef5b3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:22.428726 17016 raft_consensus.cc:493] T 30a37807dd6548adb6e16f8a4d2e5774 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:22.429623 17016 raft_consensus.cc:515] T 30a37807dd6548adb6e16f8a4d2e5774 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:22.434655 16759 leader_election.cc:304] T 52538067157143b2abd4656a4bbb9442 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8; no voters: 
I20260709 12:27:22.435882 17005 raft_consensus.cc:2804] T 52538067157143b2abd4656a4bbb9442 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:22.436295 17005 raft_consensus.cc:493] T 52538067157143b2abd4656a4bbb9442 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:22.436769 17005 raft_consensus.cc:3060] T 52538067157143b2abd4656a4bbb9442 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:22.438699 17011 leader_election.cc:290] T 27dda31a8cd1468eb3a824ae026485a3 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 election: Requested vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919)
I20260709 12:27:22.442585 17016 leader_election.cc:290] T 30a37807dd6548adb6e16f8a4d2e5774 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
I20260709 12:27:22.446142 16988 tablet_bootstrap.cc:492] T 288d05b8017c4e0f8cd40048647aecae P 17294485b7f24e2b9fae71dd3169a336: No bootstrap required, opened a new log
I20260709 12:27:22.446976 16988 ts_tablet_manager.cc:1403] T 288d05b8017c4e0f8cd40048647aecae P 17294485b7f24e2b9fae71dd3169a336: Time spent bootstrapping tablet: real 0.232s	user 0.021s	sys 0.010s
I20260709 12:27:22.454164 16794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52538067157143b2abd4656a4bbb9442" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
I20260709 12:27:22.463068 16868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27dda31a8cd1468eb3a824ae026485a3" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336"
I20260709 12:27:22.465366 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27dda31a8cd1468eb3a824ae026485a3" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d"
I20260709 12:27:22.470830 16989 tablet_bootstrap.cc:492] T aee6b58df96f401f88392d39eba8ffbf P 82f27bcdf252425aad4c4a37d064f68d: No bootstrap required, opened a new log
I20260709 12:27:22.471532 16989 ts_tablet_manager.cc:1403] T aee6b58df96f401f88392d39eba8ffbf P 82f27bcdf252425aad4c4a37d064f68d: Time spent bootstrapping tablet: real 0.286s	user 0.038s	sys 0.031s
I20260709 12:27:22.473902 16995 raft_consensus.cc:515] T 27dda31a8cd1468eb3a824ae026485a3 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:22.476015 16868 raft_consensus.cc:2393] T 27dda31a8cd1468eb3a824ae026485a3 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 879366e90f5c420588945e0d545017c8 in current term 1: Already voted for candidate 17294485b7f24e2b9fae71dd3169a336 in this term.
I20260709 12:27:22.481499 16987 tablet_bootstrap.cc:654] T 840a644e56054e13bfd7585fa064120c P 879366e90f5c420588945e0d545017c8: Neither blocks nor log segments found. Creating new log.
W20260709 12:27:22.486685 16684 leader_election.cc:343] T 27dda31a8cd1468eb3a824ae026485a3 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:22.487290 16684 leader_election.cc:304] T 27dda31a8cd1468eb3a824ae026485a3 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 879366e90f5c420588945e0d545017c8; no voters: 17294485b7f24e2b9fae71dd3169a336, 82f27bcdf252425aad4c4a37d064f68d
I20260709 12:27:22.488117 16782 tablet_service.cc:1511] Processing CreateTablet for tablet 7b90200ef21f42f1929fbf0051ef5b3e (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:27:22.488687 17011 raft_consensus.cc:2749] T 27dda31a8cd1468eb3a824ae026485a3 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:27:22.489754 16782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b90200ef21f42f1929fbf0051ef5b3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:22.475088 16989 raft_consensus.cc:359] T aee6b58df96f401f88392d39eba8ffbf P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:22.491603 16989 raft_consensus.cc:385] T aee6b58df96f401f88392d39eba8ffbf P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:22.474052 16988 raft_consensus.cc:359] T 288d05b8017c4e0f8cd40048647aecae P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:22.500030 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a37807dd6548adb6e16f8a4d2e5774" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:22.501072 16942 raft_consensus.cc:2468] T 30a37807dd6548adb6e16f8a4d2e5774 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in term 0.
I20260709 12:27:22.491941 16989 raft_consensus.cc:740] T aee6b58df96f401f88392d39eba8ffbf P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f27bcdf252425aad4c4a37d064f68d, State: Initialized, Role: FOLLOWER
I20260709 12:27:22.503063 16989 consensus_queue.cc:260] T aee6b58df96f401f88392d39eba8ffbf P 82f27bcdf252425aad4c4a37d064f68d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:22.503862 16759 leader_election.cc:304] T 30a37807dd6548adb6e16f8a4d2e5774 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 82f27bcdf252425aad4c4a37d064f68d; no voters: 
I20260709 12:27:22.505712 17016 raft_consensus.cc:2804] T 30a37807dd6548adb6e16f8a4d2e5774 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:22.506084 16989 ts_tablet_manager.cc:1434] T aee6b58df96f401f88392d39eba8ffbf P 82f27bcdf252425aad4c4a37d064f68d: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.000s
I20260709 12:27:22.506321 17016 raft_consensus.cc:493] T 30a37807dd6548adb6e16f8a4d2e5774 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:22.507017 17016 raft_consensus.cc:3060] T 30a37807dd6548adb6e16f8a4d2e5774 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:22.508613 17005 raft_consensus.cc:515] T 52538067157143b2abd4656a4bbb9442 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:22.509994 16794 raft_consensus.cc:2393] T 52538067157143b2abd4656a4bbb9442 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17294485b7f24e2b9fae71dd3169a336 in current term 1: Already voted for candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in this term.
I20260709 12:27:22.507279 16989 tablet_bootstrap.cc:492] T 6916ee6a900c46508c98006aa85fe2d9 P 82f27bcdf252425aad4c4a37d064f68d: Bootstrap starting.
I20260709 12:27:22.515926 16719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52538067157143b2abd4656a4bbb9442" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8"
I20260709 12:27:22.516016 17022 raft_consensus.cc:2804] T 52538067157143b2abd4656a4bbb9442 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:22.517812 16991 tablet_bootstrap.cc:492] T fd1494eb0dd14dab9a2e4c07812117c2 P 3c1aba6ee1d244fd9c0daba722aa0b3b: No bootstrap required, opened a new log
I20260709 12:27:22.544248 16703 tablet_service.cc:1511] Processing CreateTablet for tablet e477f70d4c8d466e9d45e6645e2a2869 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:27:22.545442 16719 raft_consensus.cc:3060] T 52538067157143b2abd4656a4bbb9442 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:22.526104 16857 tablet_service.cc:1511] Processing CreateTablet for tablet 514ee26ff21e4c08976b6a0397b730fe (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:27:22.546487 17022 raft_consensus.cc:493] T 52538067157143b2abd4656a4bbb9442 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:22.546921 17022 raft_consensus.cc:3060] T 52538067157143b2abd4656a4bbb9442 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:22.547263 16857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 514ee26ff21e4c08976b6a0397b730fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:22.495460 16988 raft_consensus.cc:385] T 288d05b8017c4e0f8cd40048647aecae P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:22.529644 16928 tablet_service.cc:1511] Processing CreateTablet for tablet 514ee26ff21e4c08976b6a0397b730fe (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:27:22.552445 16928 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 514ee26ff21e4c08976b6a0397b730fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:22.535295 16708 tablet_service.cc:1511] Processing CreateTablet for tablet 514ee26ff21e4c08976b6a0397b730fe (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:27:22.536613 16783 tablet_service.cc:1511] Processing CreateTablet for tablet 5868b3bc1ee44923a18d74874a8f3b30 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:27:22.540866 16854 tablet_service.cc:1511] Processing CreateTablet for tablet 5868b3bc1ee44923a18d74874a8f3b30 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:27:22.556696 16854 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5868b3bc1ee44923a18d74874a8f3b30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:22.560606 16988 raft_consensus.cc:740] T 288d05b8017c4e0f8cd40048647aecae P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Initialized, Role: FOLLOWER
I20260709 12:27:22.562718 16708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 514ee26ff21e4c08976b6a0397b730fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:22.563472 17022 raft_consensus.cc:515] T 52538067157143b2abd4656a4bbb9442 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:22.565457 16783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5868b3bc1ee44923a18d74874a8f3b30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:22.570840 17022 leader_election.cc:290] T 52538067157143b2abd4656a4bbb9442 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 election: Requested vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:22.571815 16794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52538067157143b2abd4656a4bbb9442" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b"
I20260709 12:27:22.572825 16794 raft_consensus.cc:2393] T 52538067157143b2abd4656a4bbb9442 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 17294485b7f24e2b9fae71dd3169a336 in current term 1: Already voted for candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in this term.
I20260709 12:27:22.572628 16988 consensus_queue.cc:260] T 288d05b8017c4e0f8cd40048647aecae P 17294485b7f24e2b9fae71dd3169a336 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:22.544087 17005 leader_election.cc:290] T 52538067157143b2abd4656a4bbb9442 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 election: Requested vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
I20260709 12:27:22.545955 16991 ts_tablet_manager.cc:1403] T fd1494eb0dd14dab9a2e4c07812117c2 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent bootstrapping tablet: real 0.257s	user 0.034s	sys 0.033s
I20260709 12:27:22.524107 16995 leader_election.cc:290] T 27dda31a8cd1468eb3a824ae026485a3 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 election: Requested vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919)
I20260709 12:27:22.544422 16931 tablet_service.cc:1511] Processing CreateTablet for tablet 5868b3bc1ee44923a18d74874a8f3b30 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:27:22.531091 17016 raft_consensus.cc:515] T 30a37807dd6548adb6e16f8a4d2e5774 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
W20260709 12:27:22.576797 16833 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:39833, user_credentials={real_user=slave}} blocked reactor thread for 211371us
I20260709 12:27:22.579774 16703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e477f70d4c8d466e9d45e6645e2a2869. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:22.581477 17016 leader_election.cc:290] T 30a37807dd6548adb6e16f8a4d2e5774 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 election: Requested vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
I20260709 12:27:22.584414 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a37807dd6548adb6e16f8a4d2e5774" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d"
I20260709 12:27:22.585660 16942 raft_consensus.cc:3060] T 30a37807dd6548adb6e16f8a4d2e5774 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:22.588711 16991 raft_consensus.cc:359] T fd1494eb0dd14dab9a2e4c07812117c2 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:22.592213 16987 tablet_bootstrap.cc:492] T 840a644e56054e13bfd7585fa064120c P 879366e90f5c420588945e0d545017c8: No bootstrap required, opened a new log
I20260709 12:27:22.591958 16991 raft_consensus.cc:385] T fd1494eb0dd14dab9a2e4c07812117c2 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:22.593334 16987 ts_tablet_manager.cc:1403] T 840a644e56054e13bfd7585fa064120c P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.229s	user 0.016s	sys 0.002s
I20260709 12:27:22.596414 16718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27dda31a8cd1468eb3a824ae026485a3" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8"
I20260709 12:27:22.597350 16718 raft_consensus.cc:2393] T 27dda31a8cd1468eb3a824ae026485a3 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 17294485b7f24e2b9fae71dd3169a336 in current term 1: Already voted for candidate 879366e90f5c420588945e0d545017c8 in this term.
I20260709 12:27:22.598884 16988 ts_tablet_manager.cc:1434] T 288d05b8017c4e0f8cd40048647aecae P 17294485b7f24e2b9fae71dd3169a336: Time spent starting tablet: real 0.152s	user 0.008s	sys 0.006s
I20260709 12:27:22.599172 16987 raft_consensus.cc:359] T 840a644e56054e13bfd7585fa064120c P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:22.600694 16987 raft_consensus.cc:385] T 840a644e56054e13bfd7585fa064120c P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:22.601022 16987 raft_consensus.cc:740] T 840a644e56054e13bfd7585fa064120c P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:22.601764 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27dda31a8cd1468eb3a824ae026485a3" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d"
I20260709 12:27:22.601992 16987 consensus_queue.cc:260] T 840a644e56054e13bfd7585fa064120c P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:22.606722 16929 tablet_service.cc:1511] Processing CreateTablet for tablet 442e0dfc272840f7a14c2232ed65425c (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:27:22.607087 16718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52538067157143b2abd4656a4bbb9442" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8"
I20260709 12:27:22.584664 16931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5868b3bc1ee44923a18d74874a8f3b30. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:27:22.595326 16604 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.9.116.66:43629, user_credentials={real_user=slave}} blocked reactor thread for 52562.7us
W20260709 12:27:22.612639 16833 leader_election.cc:343] T 27dda31a8cd1468eb3a824ae026485a3 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:22.613456 16833 leader_election.cc:304] T 27dda31a8cd1468eb3a824ae026485a3 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336; no voters: 82f27bcdf252425aad4c4a37d064f68d, 879366e90f5c420588945e0d545017c8
I20260709 12:27:22.614692 16995 raft_consensus.cc:2749] T 27dda31a8cd1468eb3a824ae026485a3 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:27:22.600244 16991 raft_consensus.cc:740] T fd1494eb0dd14dab9a2e4c07812117c2 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c1aba6ee1d244fd9c0daba722aa0b3b, State: Initialized, Role: FOLLOWER
I20260709 12:27:22.615446 16988 tablet_bootstrap.cc:492] T aee6b58df96f401f88392d39eba8ffbf P 17294485b7f24e2b9fae71dd3169a336: Bootstrap starting.
I20260709 12:27:22.616122 16991 consensus_queue.cc:260] T fd1494eb0dd14dab9a2e4c07812117c2 P 3c1aba6ee1d244fd9c0daba722aa0b3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:22.618703 16778 tablet_service.cc:1511] Processing CreateTablet for tablet e477f70d4c8d466e9d45e6645e2a2869 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:27:22.620436 16778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e477f70d4c8d466e9d45e6645e2a2869. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:22.626142 16707 tablet_service.cc:1511] Processing CreateTablet for tablet 442e0dfc272840f7a14c2232ed65425c (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:27:22.626748 16989 tablet_bootstrap.cc:654] T 6916ee6a900c46508c98006aa85fe2d9 P 82f27bcdf252425aad4c4a37d064f68d: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:22.628952 16707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 442e0dfc272840f7a14c2232ed65425c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:22.629099 16853 tablet_service.cc:1511] Processing CreateTablet for tablet 3649e7bb023a4958a01ad5ecbe446f0f (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:27:22.631299 16853 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3649e7bb023a4958a01ad5ecbe446f0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:22.632148 16991 ts_tablet_manager.cc:1434] T fd1494eb0dd14dab9a2e4c07812117c2 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent starting tablet: real 0.056s	user 0.002s	sys 0.008s
I20260709 12:27:22.612015 16856 tablet_service.cc:1511] Processing CreateTablet for tablet e477f70d4c8d466e9d45e6645e2a2869 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:27:22.634455 16856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e477f70d4c8d466e9d45e6645e2a2869. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:22.635545 16782 tablet_service.cc:1511] Processing CreateTablet for tablet 442e0dfc272840f7a14c2232ed65425c (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:27:22.637010 16782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 442e0dfc272840f7a14c2232ed65425c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:22.638952 16927 tablet_service.cc:1511] Processing CreateTablet for tablet 3649e7bb023a4958a01ad5ecbe446f0f (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:27:22.643347 16704 tablet_service.cc:1511] Processing CreateTablet for tablet 3649e7bb023a4958a01ad5ecbe446f0f (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:27:22.645560 16704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3649e7bb023a4958a01ad5ecbe446f0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:22.647513 16927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3649e7bb023a4958a01ad5ecbe446f0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:22.650975 16929 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 442e0dfc272840f7a14c2232ed65425c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:22.651847 16777 tablet_service.cc:1511] Processing CreateTablet for tablet 51d96c645e894c8597652daf12a21cf3 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:27:22.653733 16777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51d96c645e894c8597652daf12a21cf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:22.614799 16833 leader_election.cc:304] T 52538067157143b2abd4656a4bbb9442 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8
I20260709 12:27:22.640558 16987 ts_tablet_manager.cc:1434] T 840a644e56054e13bfd7585fa064120c P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.002s
I20260709 12:27:22.659088 16991 tablet_bootstrap.cc:492] T 840a644e56054e13bfd7585fa064120c P 3c1aba6ee1d244fd9c0daba722aa0b3b: Bootstrap starting.
I20260709 12:27:22.610433 16942 raft_consensus.cc:2468] T 30a37807dd6548adb6e16f8a4d2e5774 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in term 1.
I20260709 12:27:22.593640 16719 raft_consensus.cc:2468] T 52538067157143b2abd4656a4bbb9442 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in term 1.
I20260709 12:27:22.665134 16995 raft_consensus.cc:2749] T 52538067157143b2abd4656a4bbb9442 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:27:22.690497 16987 tablet_bootstrap.cc:492] T 288d05b8017c4e0f8cd40048647aecae P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:22.667356 16759 leader_election.cc:304] T 30a37807dd6548adb6e16f8a4d2e5774 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 82f27bcdf252425aad4c4a37d064f68d; no voters: 
I20260709 12:27:22.710294 16930 tablet_service.cc:1511] Processing CreateTablet for tablet 51d96c645e894c8597652daf12a21cf3 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:27:22.710774 16759 leader_election.cc:304] T 52538067157143b2abd4656a4bbb9442 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8; no voters: 
I20260709 12:27:22.700752 16854 tablet_service.cc:1511] Processing CreateTablet for tablet 51d96c645e894c8597652daf12a21cf3 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:27:22.712476 16930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51d96c645e894c8597652daf12a21cf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:22.713431 16854 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51d96c645e894c8597652daf12a21cf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:22.715862 17005 raft_consensus.cc:2804] T 30a37807dd6548adb6e16f8a4d2e5774 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:22.715896 17016 raft_consensus.cc:2804] T 52538067157143b2abd4656a4bbb9442 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:22.729970 16991 tablet_bootstrap.cc:654] T 840a644e56054e13bfd7585fa064120c P 3c1aba6ee1d244fd9c0daba722aa0b3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:22.740882 16988 tablet_bootstrap.cc:654] T aee6b58df96f401f88392d39eba8ffbf P 17294485b7f24e2b9fae71dd3169a336: Neither blocks nor log segments found. Creating new log.
W20260709 12:27:22.700241 16833 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:39833, user_credentials={real_user=slave}} blocked reactor thread for 85446.5us
I20260709 12:27:22.778930 17005 raft_consensus.cc:697] T 30a37807dd6548adb6e16f8a4d2e5774 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 LEADER]: Becoming Leader. State: Replica: 3c1aba6ee1d244fd9c0daba722aa0b3b, State: Running, Role: LEADER
I20260709 12:27:22.751789 17016 raft_consensus.cc:697] T 52538067157143b2abd4656a4bbb9442 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 LEADER]: Becoming Leader. State: Replica: 3c1aba6ee1d244fd9c0daba722aa0b3b, State: Running, Role: LEADER
I20260709 12:27:22.789070 16706 tablet_service.cc:1511] Processing CreateTablet for tablet 9067b67140fa48e883d2d240a6046d63 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:27:22.790629 16706 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9067b67140fa48e883d2d240a6046d63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:22.793890 16989 tablet_bootstrap.cc:492] T 6916ee6a900c46508c98006aa85fe2d9 P 82f27bcdf252425aad4c4a37d064f68d: No bootstrap required, opened a new log
I20260709 12:27:22.794469 16989 ts_tablet_manager.cc:1403] T 6916ee6a900c46508c98006aa85fe2d9 P 82f27bcdf252425aad4c4a37d064f68d: Time spent bootstrapping tablet: real 0.287s	user 0.041s	sys 0.022s
I20260709 12:27:22.796304 16780 tablet_service.cc:1511] Processing CreateTablet for tablet 9067b67140fa48e883d2d240a6046d63 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:27:22.797730 16780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9067b67140fa48e883d2d240a6046d63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:22.797910 16989 raft_consensus.cc:359] T 6916ee6a900c46508c98006aa85fe2d9 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:22.798810 16989 raft_consensus.cc:385] T 6916ee6a900c46508c98006aa85fe2d9 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:22.799098 16989 raft_consensus.cc:740] T 6916ee6a900c46508c98006aa85fe2d9 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f27bcdf252425aad4c4a37d064f68d, State: Initialized, Role: FOLLOWER
I20260709 12:27:22.800221 16989 consensus_queue.cc:260] T 6916ee6a900c46508c98006aa85fe2d9 P 82f27bcdf252425aad4c4a37d064f68d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:22.806502 16989 ts_tablet_manager.cc:1434] T 6916ee6a900c46508c98006aa85fe2d9 P 82f27bcdf252425aad4c4a37d064f68d: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.004s
I20260709 12:27:22.818567 17016 consensus_queue.cc:237] T 52538067157143b2abd4656a4bbb9442 P 3c1aba6ee1d244fd9c0daba722aa0b3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:22.821480 16868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52538067157143b2abd4656a4bbb9442" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:22.822448 16868 raft_consensus.cc:2393] T 52538067157143b2abd4656a4bbb9442 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in current term 1: Already voted for candidate 17294485b7f24e2b9fae71dd3169a336 in this term.
I20260709 12:27:22.822597 16867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a37807dd6548adb6e16f8a4d2e5774" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:22.823376 16995 raft_consensus.cc:493] T 288d05b8017c4e0f8cd40048647aecae P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:22.823982 16995 raft_consensus.cc:515] T 288d05b8017c4e0f8cd40048647aecae P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:22.826786 16995 leader_election.cc:290] T 288d05b8017c4e0f8cd40048647aecae P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:22.826691 16867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52538067157143b2abd4656a4bbb9442" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336"
I20260709 12:27:22.826603 17005 consensus_queue.cc:237] T 30a37807dd6548adb6e16f8a4d2e5774 P 3c1aba6ee1d244fd9c0daba722aa0b3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:22.827771 16867 raft_consensus.cc:2393] T 52538067157143b2abd4656a4bbb9442 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in current term 1: Already voted for candidate 17294485b7f24e2b9fae71dd3169a336 in this term.
I20260709 12:27:22.829311 16987 tablet_bootstrap.cc:654] T 288d05b8017c4e0f8cd40048647aecae P 879366e90f5c420588945e0d545017c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:22.832204 16989 tablet_bootstrap.cc:492] T fbafe39b79894737b395f95013bc6c86 P 82f27bcdf252425aad4c4a37d064f68d: Bootstrap starting.
I20260709 12:27:22.850255 16719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "288d05b8017c4e0f8cd40048647aecae" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8" is_pre_election: true
W20260709 12:27:22.852252 16833 leader_election.cc:343] T 288d05b8017c4e0f8cd40048647aecae P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:22.854127 16991 tablet_bootstrap.cc:492] T 840a644e56054e13bfd7585fa064120c P 3c1aba6ee1d244fd9c0daba722aa0b3b: No bootstrap required, opened a new log
I20260709 12:27:22.854787 16991 ts_tablet_manager.cc:1403] T 840a644e56054e13bfd7585fa064120c P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent bootstrapping tablet: real 0.196s	user 0.003s	sys 0.017s
I20260709 12:27:22.837162 16927 tablet_service.cc:1511] Processing CreateTablet for tablet 62e4e875fd4e4604952120df324e99cb (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:27:22.837764 16868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a37807dd6548adb6e16f8a4d2e5774" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336"
W20260709 12:27:22.839435 16759 leader_election.cc:343] T 30a37807dd6548adb6e16f8a4d2e5774 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:22.859145 16991 raft_consensus.cc:359] T 840a644e56054e13bfd7585fa064120c P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:22.840071 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "288d05b8017c4e0f8cd40048647aecae" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:22.860332 16991 raft_consensus.cc:385] T 840a644e56054e13bfd7585fa064120c P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:22.860725 16991 raft_consensus.cc:740] T 840a644e56054e13bfd7585fa064120c P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c1aba6ee1d244fd9c0daba722aa0b3b, State: Initialized, Role: FOLLOWER
I20260709 12:27:22.861661 16991 consensus_queue.cc:260] T 840a644e56054e13bfd7585fa064120c P 3c1aba6ee1d244fd9c0daba722aa0b3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
W20260709 12:27:22.863058 16833 leader_election.cc:343] T 288d05b8017c4e0f8cd40048647aecae P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:22.863653 16833 leader_election.cc:304] T 288d05b8017c4e0f8cd40048647aecae P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336; no voters: 82f27bcdf252425aad4c4a37d064f68d, 879366e90f5c420588945e0d545017c8
W20260709 12:27:22.864748 16759 leader_election.cc:343] T 30a37807dd6548adb6e16f8a4d2e5774 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:22.866189 16708 tablet_service.cc:1511] Processing CreateTablet for tablet 62e4e875fd4e4604952120df324e99cb (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:27:22.839216 16857 tablet_service.cc:1511] Processing CreateTablet for tablet 9067b67140fa48e883d2d240a6046d63 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:27:22.826099 16988 tablet_bootstrap.cc:492] T aee6b58df96f401f88392d39eba8ffbf P 17294485b7f24e2b9fae71dd3169a336: No bootstrap required, opened a new log
I20260709 12:27:22.867769 16708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62e4e875fd4e4604952120df324e99cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:22.867949 16988 ts_tablet_manager.cc:1403] T aee6b58df96f401f88392d39eba8ffbf P 17294485b7f24e2b9fae71dd3169a336: Time spent bootstrapping tablet: real 0.253s	user 0.014s	sys 0.009s
I20260709 12:27:22.868847 16853 tablet_service.cc:1511] Processing CreateTablet for tablet a4f2b93e5d2045a5a0cd1f9b5806a133 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:27:22.869884 16995 raft_consensus.cc:2749] T 288d05b8017c4e0f8cd40048647aecae P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:22.857015 16927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62e4e875fd4e4604952120df324e99cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:22.872094 16988 raft_consensus.cc:359] T aee6b58df96f401f88392d39eba8ffbf P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:22.872972 16988 raft_consensus.cc:385] T aee6b58df96f401f88392d39eba8ffbf P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:22.873308 16988 raft_consensus.cc:740] T aee6b58df96f401f88392d39eba8ffbf P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Initialized, Role: FOLLOWER
I20260709 12:27:22.873989 16857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9067b67140fa48e883d2d240a6046d63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:22.874261 16988 consensus_queue.cc:260] T aee6b58df96f401f88392d39eba8ffbf P 17294485b7f24e2b9fae71dd3169a336 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:22.875386 16853 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4f2b93e5d2045a5a0cd1f9b5806a133. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:22.857602 16989 tablet_bootstrap.cc:654] T fbafe39b79894737b395f95013bc6c86 P 82f27bcdf252425aad4c4a37d064f68d: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:22.882047 16777 tablet_service.cc:1511] Processing CreateTablet for tablet 62e4e875fd4e4604952120df324e99cb (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:27:22.884982 16777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62e4e875fd4e4604952120df324e99cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:22.886945 16987 tablet_bootstrap.cc:492] T 288d05b8017c4e0f8cd40048647aecae P 879366e90f5c420588945e0d545017c8: No bootstrap required, opened a new log
I20260709 12:27:22.887970 16987 ts_tablet_manager.cc:1403] T 288d05b8017c4e0f8cd40048647aecae P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.198s	user 0.009s	sys 0.008s
I20260709 12:27:22.872566 16991 ts_tablet_manager.cc:1434] T 840a644e56054e13bfd7585fa064120c P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent starting tablet: real 0.017s	user 0.011s	sys 0.000s
I20260709 12:27:22.891333 16987 raft_consensus.cc:359] T 288d05b8017c4e0f8cd40048647aecae P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:22.892390 16987 raft_consensus.cc:385] T 288d05b8017c4e0f8cd40048647aecae P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:22.892786 16987 raft_consensus.cc:740] T 288d05b8017c4e0f8cd40048647aecae P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:22.893846 16987 consensus_queue.cc:260] T 288d05b8017c4e0f8cd40048647aecae P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:22.896281 16987 ts_tablet_manager.cc:1434] T 288d05b8017c4e0f8cd40048647aecae P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:27:22.905140 16987 tablet_bootstrap.cc:492] T 98a96f910b4449f7ba9c875e45090080 P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:22.879206 16988 ts_tablet_manager.cc:1434] T aee6b58df96f401f88392d39eba8ffbf P 17294485b7f24e2b9fae71dd3169a336: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 12:27:22.909368 16988 tablet_bootstrap.cc:492] T 30a37807dd6548adb6e16f8a4d2e5774 P 17294485b7f24e2b9fae71dd3169a336: Bootstrap starting.
I20260709 12:27:22.914408 16989 tablet_bootstrap.cc:492] T fbafe39b79894737b395f95013bc6c86 P 82f27bcdf252425aad4c4a37d064f68d: No bootstrap required, opened a new log
I20260709 12:27:22.915203 16989 ts_tablet_manager.cc:1403] T fbafe39b79894737b395f95013bc6c86 P 82f27bcdf252425aad4c4a37d064f68d: Time spent bootstrapping tablet: real 0.083s	user 0.012s	sys 0.000s
I20260709 12:27:22.918699 16987 tablet_bootstrap.cc:654] T 98a96f910b4449f7ba9c875e45090080 P 879366e90f5c420588945e0d545017c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:22.919061 16997 raft_consensus.cc:493] T aee6b58df96f401f88392d39eba8ffbf P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:22.920149 16929 tablet_service.cc:1511] Processing CreateTablet for tablet a4f2b93e5d2045a5a0cd1f9b5806a133 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:27:22.921144 16997 raft_consensus.cc:515] T aee6b58df96f401f88392d39eba8ffbf P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:22.919204 16989 raft_consensus.cc:359] T fbafe39b79894737b395f95013bc6c86 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:22.930050 16989 raft_consensus.cc:385] T fbafe39b79894737b395f95013bc6c86 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:22.930474 16989 raft_consensus.cc:740] T fbafe39b79894737b395f95013bc6c86 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f27bcdf252425aad4c4a37d064f68d, State: Initialized, Role: FOLLOWER
I20260709 12:27:22.931336 16794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee6b58df96f401f88392d39eba8ffbf" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
W20260709 12:27:22.933923 16908 leader_election.cc:343] T aee6b58df96f401f88392d39eba8ffbf P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:22.936540 16868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee6b58df96f401f88392d39eba8ffbf" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:22.937258 16868 raft_consensus.cc:2468] T aee6b58df96f401f88392d39eba8ffbf P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82f27bcdf252425aad4c4a37d064f68d in term 0.
I20260709 12:27:22.938848 16907 leader_election.cc:304] T aee6b58df96f401f88392d39eba8ffbf P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 82f27bcdf252425aad4c4a37d064f68d; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b
I20260709 12:27:22.939683 16989 consensus_queue.cc:260] T fbafe39b79894737b395f95013bc6c86 P 82f27bcdf252425aad4c4a37d064f68d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:22.943845 16997 leader_election.cc:290] T aee6b58df96f401f88392d39eba8ffbf P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
I20260709 12:27:22.945477 17035 raft_consensus.cc:2804] T aee6b58df96f401f88392d39eba8ffbf P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:22.946121 17035 raft_consensus.cc:493] T aee6b58df96f401f88392d39eba8ffbf P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:22.946789 17035 raft_consensus.cc:3060] T aee6b58df96f401f88392d39eba8ffbf P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:22.948261 16988 tablet_bootstrap.cc:654] T 30a37807dd6548adb6e16f8a4d2e5774 P 17294485b7f24e2b9fae71dd3169a336: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:22.944283 16987 tablet_bootstrap.cc:492] T 98a96f910b4449f7ba9c875e45090080 P 879366e90f5c420588945e0d545017c8: No bootstrap required, opened a new log
I20260709 12:27:22.949600 16987 ts_tablet_manager.cc:1403] T 98a96f910b4449f7ba9c875e45090080 P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.045s	user 0.015s	sys 0.003s
I20260709 12:27:22.892804 16991 tablet_bootstrap.cc:492] T fbafe39b79894737b395f95013bc6c86 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Bootstrap starting.
I20260709 12:27:22.946929 16989 ts_tablet_manager.cc:1434] T fbafe39b79894737b395f95013bc6c86 P 82f27bcdf252425aad4c4a37d064f68d: Time spent starting tablet: real 0.031s	user 0.011s	sys 0.000s
I20260709 12:27:22.956625 16707 tablet_service.cc:1511] Processing CreateTablet for tablet a4f2b93e5d2045a5a0cd1f9b5806a133 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:27:22.957542 16857 tablet_service.cc:1511] Processing CreateTablet for tablet c220555f395e46d4be83f2b16f9691ef (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:27:22.958144 16707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4f2b93e5d2045a5a0cd1f9b5806a133. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:22.958916 16857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c220555f395e46d4be83f2b16f9691ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:22.963181 16777 tablet_service.cc:1511] Processing CreateTablet for tablet c220555f395e46d4be83f2b16f9691ef (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:27:22.964670 16989 tablet_bootstrap.cc:492] T 288d05b8017c4e0f8cd40048647aecae P 82f27bcdf252425aad4c4a37d064f68d: Bootstrap starting.
I20260709 12:27:22.970191 16777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c220555f395e46d4be83f2b16f9691ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:22.971364 16987 raft_consensus.cc:359] T 98a96f910b4449f7ba9c875e45090080 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:22.972189 16987 raft_consensus.cc:385] T 98a96f910b4449f7ba9c875e45090080 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:22.972491 16987 raft_consensus.cc:740] T 98a96f910b4449f7ba9c875e45090080 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:22.969515 17005 raft_consensus.cc:493] T fd1494eb0dd14dab9a2e4c07812117c2 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:22.973915 16989 tablet_bootstrap.cc:654] T 288d05b8017c4e0f8cd40048647aecae P 82f27bcdf252425aad4c4a37d064f68d: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:22.973666 17005 raft_consensus.cc:515] T fd1494eb0dd14dab9a2e4c07812117c2 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:22.975657 16929 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4f2b93e5d2045a5a0cd1f9b5806a133. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:22.976683 16927 tablet_service.cc:1511] Processing CreateTablet for tablet c220555f395e46d4be83f2b16f9691ef (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:27:22.976954 16868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1494eb0dd14dab9a2e4c07812117c2" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:22.978083 16927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c220555f395e46d4be83f2b16f9691ef. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:27:22.978639 16759 leader_election.cc:343] T fd1494eb0dd14dab9a2e4c07812117c2 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:22.983119 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1494eb0dd14dab9a2e4c07812117c2" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
W20260709 12:27:22.984670 16759 leader_election.cc:343] T fd1494eb0dd14dab9a2e4c07812117c2 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:22.985221 16759 leader_election.cc:304] T fd1494eb0dd14dab9a2e4c07812117c2 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b; no voters: 17294485b7f24e2b9fae71dd3169a336, 82f27bcdf252425aad4c4a37d064f68d
I20260709 12:27:22.986194 17016 raft_consensus.cc:2749] T fd1494eb0dd14dab9a2e4c07812117c2 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:22.985348 16616 catalog_manager.cc:5697] T 30a37807dd6548adb6e16f8a4d2e5774 P 3c1aba6ee1d244fd9c0daba722aa0b3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66). New cstate: current_term: 1 leader_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:22.987497 17005 leader_election.cc:290] T fd1494eb0dd14dab9a2e4c07812117c2 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919)
I20260709 12:27:22.988673 16987 consensus_queue.cc:260] T 98a96f910b4449f7ba9c875e45090080 P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:22.994601 17011 raft_consensus.cc:493] T 840a644e56054e13bfd7585fa064120c P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:22.995328 17011 raft_consensus.cc:515] T 840a644e56054e13bfd7585fa064120c P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:22.999404 16708 tablet_service.cc:1511] Processing CreateTablet for tablet 5f88e29c7ffd4b3b856561ee240cdd43 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:27:23.000663 16794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840a644e56054e13bfd7585fa064120c" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
I20260709 12:27:23.001471 16708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f88e29c7ffd4b3b856561ee240cdd43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.001628 16794 raft_consensus.cc:2468] T 840a644e56054e13bfd7585fa064120c P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 0.
I20260709 12:27:23.002662 16868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840a644e56054e13bfd7585fa064120c" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:23.004729 16685 leader_election.cc:304] T 840a644e56054e13bfd7585fa064120c P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8; no voters: 
W20260709 12:27:23.007995 16684 leader_election.cc:343] T 840a644e56054e13bfd7585fa064120c P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:23.009701 17011 leader_election.cc:290] T 840a644e56054e13bfd7585fa064120c P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
I20260709 12:27:23.017724 17011 raft_consensus.cc:2804] T 840a644e56054e13bfd7585fa064120c P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:23.023859 17035 raft_consensus.cc:515] T aee6b58df96f401f88392d39eba8ffbf P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:23.027669 16794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee6b58df96f401f88392d39eba8ffbf" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b"
I20260709 12:27:23.029480 17011 raft_consensus.cc:493] T 840a644e56054e13bfd7585fa064120c P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:23.029753 16908 leader_election.cc:343] T aee6b58df96f401f88392d39eba8ffbf P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:23.030471 17011 raft_consensus.cc:3060] T 840a644e56054e13bfd7585fa064120c P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:23.030588 16778 tablet_service.cc:1511] Processing CreateTablet for tablet 5f88e29c7ffd4b3b856561ee240cdd43 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:27:23.032186 16778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f88e29c7ffd4b3b856561ee240cdd43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.036906 16854 tablet_service.cc:1511] Processing CreateTablet for tablet 5f88e29c7ffd4b3b856561ee240cdd43 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:27:23.050442 17035 leader_election.cc:290] T aee6b58df96f401f88392d39eba8ffbf P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 election: Requested vote from peers 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
I20260709 12:27:23.045017 16991 tablet_bootstrap.cc:654] T fbafe39b79894737b395f95013bc6c86 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:23.045993 16988 tablet_bootstrap.cc:492] T 30a37807dd6548adb6e16f8a4d2e5774 P 17294485b7f24e2b9fae71dd3169a336: No bootstrap required, opened a new log
I20260709 12:27:23.070196 16988 ts_tablet_manager.cc:1403] T 30a37807dd6548adb6e16f8a4d2e5774 P 17294485b7f24e2b9fae71dd3169a336: Time spent bootstrapping tablet: real 0.161s	user 0.017s	sys 0.004s
I20260709 12:27:23.054044 16987 ts_tablet_manager.cc:1434] T 98a96f910b4449f7ba9c875e45090080 P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.103s	user 0.008s	sys 0.000s
I20260709 12:27:23.073590 17011 raft_consensus.cc:515] T 840a644e56054e13bfd7585fa064120c P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:23.074878 16987 tablet_bootstrap.cc:492] T 6916ee6a900c46508c98006aa85fe2d9 P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:23.077443 17011 leader_election.cc:290] T 840a644e56054e13bfd7585fa064120c P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 election: Requested vote from peers 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
I20260709 12:27:23.067775 16854 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f88e29c7ffd4b3b856561ee240cdd43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.059774 16868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee6b58df96f401f88392d39eba8ffbf" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336"
I20260709 12:27:23.080093 17035 raft_consensus.cc:493] T fbafe39b79894737b395f95013bc6c86 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:23.084450 16867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840a644e56054e13bfd7585fa064120c" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336"
I20260709 12:27:23.084259 17035 raft_consensus.cc:515] T fbafe39b79894737b395f95013bc6c86 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:23.093120 16794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbafe39b79894737b395f95013bc6c86" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
W20260709 12:27:23.093284 16684 leader_election.cc:343] T 840a644e56054e13bfd7585fa064120c P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:23.086418 16868 raft_consensus.cc:3060] T aee6b58df96f401f88392d39eba8ffbf P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:27:23.095243 16908 leader_election.cc:343] T fbafe39b79894737b395f95013bc6c86 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:23.095621 16719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbafe39b79894737b395f95013bc6c86" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8" is_pre_election: true
I20260709 12:27:23.096417 16719 raft_consensus.cc:2468] T fbafe39b79894737b395f95013bc6c86 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82f27bcdf252425aad4c4a37d064f68d in term 0.
I20260709 12:27:23.097728 16907 leader_election.cc:304] T fbafe39b79894737b395f95013bc6c86 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d, 879366e90f5c420588945e0d545017c8; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b
I20260709 12:27:23.098752 17034 raft_consensus.cc:2804] T fbafe39b79894737b395f95013bc6c86 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:23.099189 17034 raft_consensus.cc:493] T fbafe39b79894737b395f95013bc6c86 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:23.099537 17034 raft_consensus.cc:3060] T fbafe39b79894737b395f95013bc6c86 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:23.092082 17035 leader_election.cc:290] T fbafe39b79894737b395f95013bc6c86 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:23.109786 16988 raft_consensus.cc:359] T 30a37807dd6548adb6e16f8a4d2e5774 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:23.111008 16988 raft_consensus.cc:385] T 30a37807dd6548adb6e16f8a4d2e5774 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:23.111884 17034 raft_consensus.cc:515] T fbafe39b79894737b395f95013bc6c86 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:23.115795 16719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbafe39b79894737b395f95013bc6c86" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8"
I20260709 12:27:23.116521 16719 raft_consensus.cc:3060] T fbafe39b79894737b395f95013bc6c86 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:23.111442 16988 raft_consensus.cc:740] T 30a37807dd6548adb6e16f8a4d2e5774 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Initialized, Role: FOLLOWER
I20260709 12:27:23.129148 16794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbafe39b79894737b395f95013bc6c86" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b"
I20260709 12:27:23.125988 16988 consensus_queue.cc:260] T 30a37807dd6548adb6e16f8a4d2e5774 P 17294485b7f24e2b9fae71dd3169a336 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
W20260709 12:27:23.131842 16908 leader_election.cc:343] T fbafe39b79894737b395f95013bc6c86 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:27:23.078593 16685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:43629, user_credentials={real_user=slave}} blocked reactor thread for 73987.4us
I20260709 12:27:23.132790 17034 leader_election.cc:290] T fbafe39b79894737b395f95013bc6c86 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 election: Requested vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:23.134033 16794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840a644e56054e13bfd7585fa064120c" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b"
I20260709 12:27:23.134768 16794 raft_consensus.cc:3060] T 840a644e56054e13bfd7585fa064120c P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:23.135649 16719 raft_consensus.cc:2468] T fbafe39b79894737b395f95013bc6c86 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82f27bcdf252425aad4c4a37d064f68d in term 1.
I20260709 12:27:23.136965 16907 leader_election.cc:304] T fbafe39b79894737b395f95013bc6c86 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d, 879366e90f5c420588945e0d545017c8; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b
I20260709 12:27:23.138326 17034 raft_consensus.cc:2804] T fbafe39b79894737b395f95013bc6c86 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:23.139099 17034 raft_consensus.cc:697] T fbafe39b79894737b395f95013bc6c86 P 82f27bcdf252425aad4c4a37d064f68d [term 1 LEADER]: Becoming Leader. State: Replica: 82f27bcdf252425aad4c4a37d064f68d, State: Running, Role: LEADER
I20260709 12:27:23.147718 16929 tablet_service.cc:1511] Processing CreateTablet for tablet 2f737ece325c44c58194725a82923014 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:27:23.150440 16929 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f737ece325c44c58194725a82923014. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.150751 17034 consensus_queue.cc:237] T fbafe39b79894737b395f95013bc6c86 P 82f27bcdf252425aad4c4a37d064f68d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:23.151554 16989 tablet_bootstrap.cc:492] T 288d05b8017c4e0f8cd40048647aecae P 82f27bcdf252425aad4c4a37d064f68d: No bootstrap required, opened a new log
I20260709 12:27:23.154474 16989 ts_tablet_manager.cc:1403] T 288d05b8017c4e0f8cd40048647aecae P 82f27bcdf252425aad4c4a37d064f68d: Time spent bootstrapping tablet: real 0.190s	user 0.029s	sys 0.029s
I20260709 12:27:23.157183 16794 raft_consensus.cc:2468] T 840a644e56054e13bfd7585fa064120c P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 1.
I20260709 12:27:23.158977 16685 leader_election.cc:304] T 840a644e56054e13bfd7585fa064120c P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8; no voters: 17294485b7f24e2b9fae71dd3169a336
I20260709 12:27:23.160694 17011 raft_consensus.cc:2804] T 840a644e56054e13bfd7585fa064120c P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:23.161253 17011 raft_consensus.cc:697] T 840a644e56054e13bfd7585fa064120c P 879366e90f5c420588945e0d545017c8 [term 1 LEADER]: Becoming Leader. State: Replica: 879366e90f5c420588945e0d545017c8, State: Running, Role: LEADER
I20260709 12:27:23.162460 16991 tablet_bootstrap.cc:492] T fbafe39b79894737b395f95013bc6c86 P 3c1aba6ee1d244fd9c0daba722aa0b3b: No bootstrap required, opened a new log
I20260709 12:27:23.162170 17011 consensus_queue.cc:237] T 840a644e56054e13bfd7585fa064120c P 879366e90f5c420588945e0d545017c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:23.163482 16991 ts_tablet_manager.cc:1403] T fbafe39b79894737b395f95013bc6c86 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent bootstrapping tablet: real 0.271s	user 0.026s	sys 0.046s
I20260709 12:27:23.167486 16988 ts_tablet_manager.cc:1434] T 30a37807dd6548adb6e16f8a4d2e5774 P 17294485b7f24e2b9fae71dd3169a336: Time spent starting tablet: real 0.097s	user 0.011s	sys 0.001s
I20260709 12:27:23.159359 16989 raft_consensus.cc:359] T 288d05b8017c4e0f8cd40048647aecae P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:23.168793 16989 raft_consensus.cc:385] T 288d05b8017c4e0f8cd40048647aecae P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:23.169286 16988 tablet_bootstrap.cc:492] T 840a644e56054e13bfd7585fa064120c P 17294485b7f24e2b9fae71dd3169a336: Bootstrap starting.
I20260709 12:27:23.183827 16991 raft_consensus.cc:359] T fbafe39b79894737b395f95013bc6c86 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:23.185076 16991 raft_consensus.cc:385] T fbafe39b79894737b395f95013bc6c86 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:23.184962 16707 tablet_service.cc:1511] Processing CreateTablet for tablet 2f737ece325c44c58194725a82923014 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:27:23.189327 16707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f737ece325c44c58194725a82923014. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.169283 16989 raft_consensus.cc:740] T 288d05b8017c4e0f8cd40048647aecae P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f27bcdf252425aad4c4a37d064f68d, State: Initialized, Role: FOLLOWER
I20260709 12:27:23.192312 16989 consensus_queue.cc:260] T 288d05b8017c4e0f8cd40048647aecae P 82f27bcdf252425aad4c4a37d064f68d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:23.192713 16778 tablet_service.cc:1511] Processing CreateTablet for tablet 2f737ece325c44c58194725a82923014 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:27:23.194528 16778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f737ece325c44c58194725a82923014. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.194832 16989 ts_tablet_manager.cc:1434] T 288d05b8017c4e0f8cd40048647aecae P 82f27bcdf252425aad4c4a37d064f68d: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.000s
I20260709 12:27:23.176810 16987 tablet_bootstrap.cc:654] T 6916ee6a900c46508c98006aa85fe2d9 P 879366e90f5c420588945e0d545017c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:23.201611 16857 tablet_service.cc:1511] Processing CreateTablet for tablet 51ebab30b5104589803b75a1b48c5aa2 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:27:23.204773 16857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51ebab30b5104589803b75a1b48c5aa2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.186568 16991 raft_consensus.cc:740] T fbafe39b79894737b395f95013bc6c86 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c1aba6ee1d244fd9c0daba722aa0b3b, State: Initialized, Role: FOLLOWER
I20260709 12:27:23.207674 16991 consensus_queue.cc:260] T fbafe39b79894737b395f95013bc6c86 P 3c1aba6ee1d244fd9c0daba722aa0b3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:23.215852 16868 raft_consensus.cc:2468] T aee6b58df96f401f88392d39eba8ffbf P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82f27bcdf252425aad4c4a37d064f68d in term 1.
I20260709 12:27:23.211516 16991 ts_tablet_manager.cc:1434] T fbafe39b79894737b395f95013bc6c86 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent starting tablet: real 0.048s	user 0.009s	sys 0.001s
I20260709 12:27:23.219038 16927 tablet_service.cc:1511] Processing CreateTablet for tablet 51ebab30b5104589803b75a1b48c5aa2 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:27:23.219215 16988 tablet_bootstrap.cc:654] T 840a644e56054e13bfd7585fa064120c P 17294485b7f24e2b9fae71dd3169a336: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:23.219835 16991 tablet_bootstrap.cc:492] T d6811cd94dfd44149e1329e919d82f0f P 3c1aba6ee1d244fd9c0daba722aa0b3b: Bootstrap starting.
I20260709 12:27:23.221937 16927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51ebab30b5104589803b75a1b48c5aa2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.222949 16907 leader_election.cc:304] T aee6b58df96f401f88392d39eba8ffbf P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 82f27bcdf252425aad4c4a37d064f68d; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b
I20260709 12:27:23.224516 17037 raft_consensus.cc:493] T 288d05b8017c4e0f8cd40048647aecae P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:23.224944 17035 raft_consensus.cc:493] T 6916ee6a900c46508c98006aa85fe2d9 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:23.223517 16708 tablet_service.cc:1511] Processing CreateTablet for tablet 51ebab30b5104589803b75a1b48c5aa2 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:27:23.230427 17035 raft_consensus.cc:515] T 6916ee6a900c46508c98006aa85fe2d9 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:23.231277 17037 raft_consensus.cc:515] T 288d05b8017c4e0f8cd40048647aecae P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:23.231551 16777 tablet_service.cc:1511] Processing CreateTablet for tablet f5345dc6d3b946e0bb9220acf126cf59 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:27:23.232688 16997 raft_consensus.cc:2804] T aee6b58df96f401f88392d39eba8ffbf P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:23.235018 16989 tablet_bootstrap.cc:492] T 27dda31a8cd1468eb3a824ae026485a3 P 82f27bcdf252425aad4c4a37d064f68d: Bootstrap starting.
I20260709 12:27:23.239454 16997 raft_consensus.cc:697] T aee6b58df96f401f88392d39eba8ffbf P 82f27bcdf252425aad4c4a37d064f68d [term 1 LEADER]: Becoming Leader. State: Replica: 82f27bcdf252425aad4c4a37d064f68d, State: Running, Role: LEADER
I20260709 12:27:23.240559 16997 consensus_queue.cc:237] T aee6b58df96f401f88392d39eba8ffbf P 82f27bcdf252425aad4c4a37d064f68d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:23.252566 16853 tablet_service.cc:1511] Processing CreateTablet for tablet f5345dc6d3b946e0bb9220acf126cf59 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:27:23.252905 17035 leader_election.cc:290] T 6916ee6a900c46508c98006aa85fe2d9 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:23.254244 16853 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5345dc6d3b946e0bb9220acf126cf59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.254302 17037 leader_election.cc:290] T 288d05b8017c4e0f8cd40048647aecae P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919)
I20260709 12:27:23.255311 16777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5345dc6d3b946e0bb9220acf126cf59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.255478 16868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "288d05b8017c4e0f8cd40048647aecae" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:23.256238 16868 raft_consensus.cc:2468] T 288d05b8017c4e0f8cd40048647aecae P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 0.
I20260709 12:27:23.257925 16684 leader_election.cc:304] T 288d05b8017c4e0f8cd40048647aecae P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8; no voters: 
I20260709 12:27:23.258920 17011 raft_consensus.cc:493] T 98a96f910b4449f7ba9c875e45090080 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:23.259800 17037 raft_consensus.cc:2804] T 288d05b8017c4e0f8cd40048647aecae P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:23.260346 17037 raft_consensus.cc:493] T 288d05b8017c4e0f8cd40048647aecae P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:23.260748 17037 raft_consensus.cc:3060] T 288d05b8017c4e0f8cd40048647aecae P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:23.259438 17011 raft_consensus.cc:515] T 98a96f910b4449f7ba9c875e45090080 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:23.265913 16719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6916ee6a900c46508c98006aa85fe2d9" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8" is_pre_election: true
I20260709 12:27:23.268159 16868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a96f910b4449f7ba9c875e45090080" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
W20260709 12:27:23.270164 16684 leader_election.cc:343] T 98a96f910b4449f7ba9c875e45090080 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:27:23.271026 16907 leader_election.cc:343] T 6916ee6a900c46508c98006aa85fe2d9 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:23.272805 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "288d05b8017c4e0f8cd40048647aecae" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:23.273564 16942 raft_consensus.cc:2468] T 288d05b8017c4e0f8cd40048647aecae P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 0.
I20260709 12:27:23.273773 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a96f910b4449f7ba9c875e45090080" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:23.274933 16794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6916ee6a900c46508c98006aa85fe2d9" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
W20260709 12:27:23.288234 16908 leader_election.cc:343] T 6916ee6a900c46508c98006aa85fe2d9 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:23.288908 16908 leader_election.cc:304] T 6916ee6a900c46508c98006aa85fe2d9 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8
I20260709 12:27:23.289834 17035 raft_consensus.cc:2749] T 6916ee6a900c46508c98006aa85fe2d9 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:23.292624 16931 tablet_service.cc:1511] Processing CreateTablet for tablet f5345dc6d3b946e0bb9220acf126cf59 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:27:23.292976 16617 catalog_manager.cc:5697] T 840a644e56054e13bfd7585fa064120c P 879366e90f5c420588945e0d545017c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 879366e90f5c420588945e0d545017c8 (127.9.116.65). New cstate: current_term: 1 leader_uuid: "879366e90f5c420588945e0d545017c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:23.294459 16931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5345dc6d3b946e0bb9220acf126cf59. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:27:23.276059 16684 leader_election.cc:343] T 98a96f910b4449f7ba9c875e45090080 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:23.295902 16684 leader_election.cc:304] T 98a96f910b4449f7ba9c875e45090080 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 879366e90f5c420588945e0d545017c8; no voters: 17294485b7f24e2b9fae71dd3169a336, 82f27bcdf252425aad4c4a37d064f68d
I20260709 12:27:23.262799 16614 catalog_manager.cc:5697] T fbafe39b79894737b395f95013bc6c86 P 82f27bcdf252425aad4c4a37d064f68d reported cstate change: term changed from 0 to 1, leader changed from <none> to 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68). New cstate: current_term: 1 leader_uuid: "82f27bcdf252425aad4c4a37d064f68d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } health_report { overall_health: UNKNOWN } } }
W20260709 12:27:23.299444 16665 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:27:23.306814 16991 tablet_bootstrap.cc:654] T d6811cd94dfd44149e1329e919d82f0f P 3c1aba6ee1d244fd9c0daba722aa0b3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:23.265874 17011 leader_election.cc:290] T 98a96f910b4449f7ba9c875e45090080 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919)
I20260709 12:27:23.330317 17011 raft_consensus.cc:2749] T 98a96f910b4449f7ba9c875e45090080 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:23.331831 16708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51ebab30b5104589803b75a1b48c5aa2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.336388 16987 tablet_bootstrap.cc:492] T 6916ee6a900c46508c98006aa85fe2d9 P 879366e90f5c420588945e0d545017c8: No bootstrap required, opened a new log
I20260709 12:27:23.337122 16987 ts_tablet_manager.cc:1403] T 6916ee6a900c46508c98006aa85fe2d9 P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.263s	user 0.007s	sys 0.024s
I20260709 12:27:23.338563 17005 consensus_queue.cc:1048] T 52538067157143b2abd4656a4bbb9442 P 3c1aba6ee1d244fd9c0daba722aa0b3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:23.342200 16987 raft_consensus.cc:359] T 6916ee6a900c46508c98006aa85fe2d9 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:23.343468 16987 raft_consensus.cc:385] T 6916ee6a900c46508c98006aa85fe2d9 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:27:23.356014 16684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37919, user_credentials={real_user=slave}} blocked reactor thread for 79980.5us
I20260709 12:27:23.356463 16987 raft_consensus.cc:740] T 6916ee6a900c46508c98006aa85fe2d9 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:23.356889 17037 raft_consensus.cc:515] T 288d05b8017c4e0f8cd40048647aecae P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:23.374539 17037 leader_election.cc:290] T 288d05b8017c4e0f8cd40048647aecae P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 election: Requested vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919)
I20260709 12:27:23.376719 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "288d05b8017c4e0f8cd40048647aecae" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d"
I20260709 12:27:23.377492 16941 raft_consensus.cc:3060] T 288d05b8017c4e0f8cd40048647aecae P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:23.377934 16706 tablet_service.cc:1511] Processing CreateTablet for tablet b6f178076e7f4c7bb41b4853bacbfc4e (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:27:23.379328 16706 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6f178076e7f4c7bb41b4853bacbfc4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.383644 16987 consensus_queue.cc:260] T 6916ee6a900c46508c98006aa85fe2d9 P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:23.390774 16941 raft_consensus.cc:2468] T 288d05b8017c4e0f8cd40048647aecae P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 1.
I20260709 12:27:23.402038 16684 leader_election.cc:304] T 288d05b8017c4e0f8cd40048647aecae P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d, 879366e90f5c420588945e0d545017c8; no voters: 
I20260709 12:27:23.403402 17048 raft_consensus.cc:2804] T 288d05b8017c4e0f8cd40048647aecae P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:23.409639 16857 tablet_service.cc:1511] Processing CreateTablet for tablet b6f178076e7f4c7bb41b4853bacbfc4e (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:27:23.410681 16988 tablet_bootstrap.cc:492] T 840a644e56054e13bfd7585fa064120c P 17294485b7f24e2b9fae71dd3169a336: No bootstrap required, opened a new log
I20260709 12:27:23.396363 16868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "288d05b8017c4e0f8cd40048647aecae" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336"
I20260709 12:27:23.390702 17005 consensus_queue.cc:1048] T 30a37807dd6548adb6e16f8a4d2e5774 P 3c1aba6ee1d244fd9c0daba722aa0b3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:27:23.404361 17048 raft_consensus.cc:697] T 288d05b8017c4e0f8cd40048647aecae P 879366e90f5c420588945e0d545017c8 [term 1 LEADER]: Becoming Leader. State: Replica: 879366e90f5c420588945e0d545017c8, State: Running, Role: LEADER
I20260709 12:27:23.411561 16857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6f178076e7f4c7bb41b4853bacbfc4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.416023 16988 ts_tablet_manager.cc:1403] T 840a644e56054e13bfd7585fa064120c P 17294485b7f24e2b9fae71dd3169a336: Time spent bootstrapping tablet: real 0.243s	user 0.034s	sys 0.035s
I20260709 12:27:23.413753 16868 raft_consensus.cc:3060] T 288d05b8017c4e0f8cd40048647aecae P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:23.427181 16927 tablet_service.cc:1511] Processing CreateTablet for tablet 6a86fc21ef0044bb91dd271c9a019336 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:27:23.429025 16927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a86fc21ef0044bb91dd271c9a019336. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.430524 16988 raft_consensus.cc:359] T 840a644e56054e13bfd7585fa064120c P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:23.412959 16783 tablet_service.cc:1511] Processing CreateTablet for tablet b6f178076e7f4c7bb41b4853bacbfc4e (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:27:23.442190 16703 tablet_service.cc:1511] Processing CreateTablet for tablet 6a86fc21ef0044bb91dd271c9a019336 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:27:23.452683 16780 tablet_service.cc:1511] Processing CreateTablet for tablet 6a86fc21ef0044bb91dd271c9a019336 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:27:23.459101 16703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a86fc21ef0044bb91dd271c9a019336. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.434252 16987 ts_tablet_manager.cc:1434] T 6916ee6a900c46508c98006aa85fe2d9 P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.097s	user 0.007s	sys 0.005s
I20260709 12:27:23.416988 17048 consensus_queue.cc:237] T 288d05b8017c4e0f8cd40048647aecae P 879366e90f5c420588945e0d545017c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:23.431433 16988 raft_consensus.cc:385] T 840a644e56054e13bfd7585fa064120c P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:23.467703 16988 raft_consensus.cc:740] T 840a644e56054e13bfd7585fa064120c P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Initialized, Role: FOLLOWER
I20260709 12:27:23.470270 16988 consensus_queue.cc:260] T 840a644e56054e13bfd7585fa064120c P 17294485b7f24e2b9fae71dd3169a336 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:23.473012 16988 ts_tablet_manager.cc:1434] T 840a644e56054e13bfd7585fa064120c P 17294485b7f24e2b9fae71dd3169a336: Time spent starting tablet: real 0.047s	user 0.002s	sys 0.006s
I20260709 12:27:23.473242 17016 consensus_queue.cc:1048] T 52538067157143b2abd4656a4bbb9442 P 3c1aba6ee1d244fd9c0daba722aa0b3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:23.474073 16988 tablet_bootstrap.cc:492] T 98a96f910b4449f7ba9c875e45090080 P 17294485b7f24e2b9fae71dd3169a336: Bootstrap starting.
I20260709 12:27:23.476843 16783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6f178076e7f4c7bb41b4853bacbfc4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.467195 16989 tablet_bootstrap.cc:654] T 27dda31a8cd1468eb3a824ae026485a3 P 82f27bcdf252425aad4c4a37d064f68d: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:23.483510 16867 raft_consensus.cc:3060] T 30a37807dd6548adb6e16f8a4d2e5774 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:23.492996 16991 tablet_bootstrap.cc:492] T d6811cd94dfd44149e1329e919d82f0f P 3c1aba6ee1d244fd9c0daba722aa0b3b: No bootstrap required, opened a new log
I20260709 12:27:23.494518 16991 ts_tablet_manager.cc:1403] T d6811cd94dfd44149e1329e919d82f0f P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent bootstrapping tablet: real 0.275s	user 0.036s	sys 0.012s
I20260709 12:27:23.497987 16991 raft_consensus.cc:359] T d6811cd94dfd44149e1329e919d82f0f P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:23.493899 16987 tablet_bootstrap.cc:492] T cd637126e0044d7996f18e258282a145 P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:23.503247 16777 tablet_service.cc:1511] Processing CreateTablet for tablet 29fcc4f156a54ca4b54a4a11e2cee973 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:27:23.505486 16777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29fcc4f156a54ca4b54a4a11e2cee973. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.523195 16929 tablet_service.cc:1511] Processing CreateTablet for tablet 3e78004b8cc14ac6b93c857cbdd63329 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:27:23.531652 16929 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e78004b8cc14ac6b93c857cbdd63329. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.524451 17016 consensus_queue.cc:1048] T 30a37807dd6548adb6e16f8a4d2e5774 P 3c1aba6ee1d244fd9c0daba722aa0b3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:23.525353 17054 raft_consensus.cc:493] T 30a37807dd6548adb6e16f8a4d2e5774 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:23.527248 16778 tablet_service.cc:1511] Processing CreateTablet for tablet ce37f3e8575c4b8e88935db231644a27 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:27:23.528173 16930 tablet_service.cc:1511] Processing CreateTablet for tablet 29fcc4f156a54ca4b54a4a11e2cee973 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:27:23.528173 16707 tablet_service.cc:1511] Processing CreateTablet for tablet ce37f3e8575c4b8e88935db231644a27 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:27:23.528744 16868 raft_consensus.cc:2468] T 288d05b8017c4e0f8cd40048647aecae P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 1.
I20260709 12:27:23.550499 16707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce37f3e8575c4b8e88935db231644a27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.503686 16991 raft_consensus.cc:385] T d6811cd94dfd44149e1329e919d82f0f P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:23.551221 16991 raft_consensus.cc:740] T d6811cd94dfd44149e1329e919d82f0f P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c1aba6ee1d244fd9c0daba722aa0b3b, State: Initialized, Role: FOLLOWER
I20260709 12:27:23.551498 16988 tablet_bootstrap.cc:654] T 98a96f910b4449f7ba9c875e45090080 P 17294485b7f24e2b9fae71dd3169a336: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:23.552392 16991 consensus_queue.cc:260] T d6811cd94dfd44149e1329e919d82f0f P 3c1aba6ee1d244fd9c0daba722aa0b3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:23.531545 16857 tablet_service.cc:1511] Processing CreateTablet for tablet 29fcc4f156a54ca4b54a4a11e2cee973 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:27:23.555255 16857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29fcc4f156a54ca4b54a4a11e2cee973. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.536928 16708 tablet_service.cc:1511] Processing CreateTablet for tablet 3e78004b8cc14ac6b93c857cbdd63329 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:27:23.556715 16708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e78004b8cc14ac6b93c857cbdd63329. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.541692 16780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a86fc21ef0044bb91dd271c9a019336. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.541188 17054 raft_consensus.cc:515] T 30a37807dd6548adb6e16f8a4d2e5774 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:23.541210 16853 tablet_service.cc:1511] Processing CreateTablet for tablet 3e78004b8cc14ac6b93c857cbdd63329 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:27:23.568339 16930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29fcc4f156a54ca4b54a4a11e2cee973. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.573807 16853 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e78004b8cc14ac6b93c857cbdd63329. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.590077 16778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce37f3e8575c4b8e88935db231644a27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.615806 17054 leader_election.cc:290] T 30a37807dd6548adb6e16f8a4d2e5774 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:23.618155 16614 catalog_manager.cc:5697] T aee6b58df96f401f88392d39eba8ffbf P 82f27bcdf252425aad4c4a37d064f68d reported cstate change: term changed from 0 to 1, leader changed from <none> to 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68). New cstate: current_term: 1 leader_uuid: "82f27bcdf252425aad4c4a37d064f68d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:23.615834 16987 tablet_bootstrap.cc:654] T cd637126e0044d7996f18e258282a145 P 879366e90f5c420588945e0d545017c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:23.623714 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a37807dd6548adb6e16f8a4d2e5774" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:23.636401 16854 tablet_service.cc:1511] Processing CreateTablet for tablet ce37f3e8575c4b8e88935db231644a27 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:27:23.638006 16854 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce37f3e8575c4b8e88935db231644a27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.638273 16997 consensus_queue.cc:1048] T fbafe39b79894737b395f95013bc6c86 P 82f27bcdf252425aad4c4a37d064f68d [LEADER]: Connected to new peer: Peer: permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:23.637724 16794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a37807dd6548adb6e16f8a4d2e5774" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
I20260709 12:27:23.652222 16868 raft_consensus.cc:3060] T 840a644e56054e13bfd7585fa064120c P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:23.654742 16793 raft_consensus.cc:3060] T fbafe39b79894737b395f95013bc6c86 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:23.672676 16834 leader_election.cc:304] T 30a37807dd6548adb6e16f8a4d2e5774 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 82f27bcdf252425aad4c4a37d064f68d
I20260709 12:27:23.674417 17054 raft_consensus.cc:2749] T 30a37807dd6548adb6e16f8a4d2e5774 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:23.680496 16988 tablet_bootstrap.cc:492] T 98a96f910b4449f7ba9c875e45090080 P 17294485b7f24e2b9fae71dd3169a336: No bootstrap required, opened a new log
I20260709 12:27:23.681190 16988 ts_tablet_manager.cc:1403] T 98a96f910b4449f7ba9c875e45090080 P 17294485b7f24e2b9fae71dd3169a336: Time spent bootstrapping tablet: real 0.207s	user 0.015s	sys 0.002s
I20260709 12:27:23.685372 16931 tablet_service.cc:1511] Processing CreateTablet for tablet 6a1e8d1852ae457db7e3be5b6957f1b3 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:27:23.687219 16931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a1e8d1852ae457db7e3be5b6957f1b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.685374 16856 tablet_service.cc:1511] Processing CreateTablet for tablet b86527b8a77848629c50a32e2534f7ba (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:27:23.699054 16777 tablet_service.cc:1511] Processing CreateTablet for tablet 6a1e8d1852ae457db7e3be5b6957f1b3 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:27:23.700554 16777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a1e8d1852ae457db7e3be5b6957f1b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.702553 17011 consensus_queue.cc:1048] T 840a644e56054e13bfd7585fa064120c P 879366e90f5c420588945e0d545017c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:23.706272 16989 tablet_bootstrap.cc:492] T 27dda31a8cd1468eb3a824ae026485a3 P 82f27bcdf252425aad4c4a37d064f68d: No bootstrap required, opened a new log
I20260709 12:27:23.707100 16989 ts_tablet_manager.cc:1403] T 27dda31a8cd1468eb3a824ae026485a3 P 82f27bcdf252425aad4c4a37d064f68d: Time spent bootstrapping tablet: real 0.479s	user 0.017s	sys 0.028s
I20260709 12:27:23.711534 17005 raft_consensus.cc:493] T d6811cd94dfd44149e1329e919d82f0f P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:23.712127 16927 tablet_service.cc:1511] Processing CreateTablet for tablet b86527b8a77848629c50a32e2534f7ba (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:27:23.712241 17005 raft_consensus.cc:515] T d6811cd94dfd44149e1329e919d82f0f P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:23.714331 16856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b86527b8a77848629c50a32e2534f7ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.714540 17005 leader_election.cc:290] T d6811cd94dfd44149e1329e919d82f0f P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
W20260709 12:27:23.647431 16759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37919, user_credentials={real_user=slave}} blocked reactor thread for 117081us
W20260709 12:27:23.721784 16908 consensus_peers.cc:597] T aee6b58df96f401f88392d39eba8ffbf P 82f27bcdf252425aad4c4a37d064f68d -> Peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Couldn't send request to peer 3c1aba6ee1d244fd9c0daba722aa0b3b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:23.724045 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6811cd94dfd44149e1329e919d82f0f" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:23.725286 16719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6811cd94dfd44149e1329e919d82f0f" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8" is_pre_election: true
I20260709 12:27:23.726171 16989 raft_consensus.cc:359] T 27dda31a8cd1468eb3a824ae026485a3 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:23.725199 16942 raft_consensus.cc:2468] T d6811cd94dfd44149e1329e919d82f0f P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in term 0.
I20260709 12:27:23.731163 16707 tablet_service.cc:1511] Processing CreateTablet for tablet 6a1e8d1852ae457db7e3be5b6957f1b3 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:27:23.733155 16707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a1e8d1852ae457db7e3be5b6957f1b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.735824 16927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b86527b8a77848629c50a32e2534f7ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.742920 17016 raft_consensus.cc:493] T fbafe39b79894737b395f95013bc6c86 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:23.743626 17016 raft_consensus.cc:515] T fbafe39b79894737b395f95013bc6c86 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:23.746555 17016 leader_election.cc:290] T fbafe39b79894737b395f95013bc6c86 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
W20260709 12:27:23.746711 16759 leader_election.cc:343] T d6811cd94dfd44149e1329e919d82f0f P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:23.748934 16991 ts_tablet_manager.cc:1434] T d6811cd94dfd44149e1329e919d82f0f P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent starting tablet: real 0.254s	user 0.015s	sys 0.017s
I20260709 12:27:23.749369 16759 leader_election.cc:304] T d6811cd94dfd44149e1329e919d82f0f P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 82f27bcdf252425aad4c4a37d064f68d; no voters: 879366e90f5c420588945e0d545017c8
I20260709 12:27:23.750494 17016 raft_consensus.cc:2804] T d6811cd94dfd44149e1329e919d82f0f P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:23.750919 17016 raft_consensus.cc:493] T d6811cd94dfd44149e1329e919d82f0f P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:23.751024 16719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbafe39b79894737b395f95013bc6c86" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8" is_pre_election: true
I20260709 12:27:23.751322 17016 raft_consensus.cc:3060] T d6811cd94dfd44149e1329e919d82f0f P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:23.751260 16703 tablet_service.cc:1511] Processing CreateTablet for tablet b86527b8a77848629c50a32e2534f7ba (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:27:23.750270 16991 tablet_bootstrap.cc:492] T 6916ee6a900c46508c98006aa85fe2d9 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Bootstrap starting.
I20260709 12:27:23.749483 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbafe39b79894737b395f95013bc6c86" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:23.752851 16703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b86527b8a77848629c50a32e2534f7ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.754597 16759 leader_election.cc:304] T fbafe39b79894737b395f95013bc6c86 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b; no voters: 82f27bcdf252425aad4c4a37d064f68d, 879366e90f5c420588945e0d545017c8
I20260709 12:27:23.755702 17060 raft_consensus.cc:2749] T fbafe39b79894737b395f95013bc6c86 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:23.726928 16989 raft_consensus.cc:385] T 27dda31a8cd1468eb3a824ae026485a3 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:23.789330 17048 consensus_queue.cc:1048] T 840a644e56054e13bfd7585fa064120c P 879366e90f5c420588945e0d545017c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:23.797061 16997 consensus_queue.cc:1048] T fbafe39b79894737b395f95013bc6c86 P 82f27bcdf252425aad4c4a37d064f68d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:23.776508 17011 raft_consensus.cc:493] T 6916ee6a900c46508c98006aa85fe2d9 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:23.802134 17011 raft_consensus.cc:515] T 6916ee6a900c46508c98006aa85fe2d9 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:23.805603 17011 leader_election.cc:290] T 6916ee6a900c46508c98006aa85fe2d9 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:23.763187 16989 raft_consensus.cc:740] T 27dda31a8cd1468eb3a824ae026485a3 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f27bcdf252425aad4c4a37d064f68d, State: Initialized, Role: FOLLOWER
I20260709 12:27:23.823850 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6916ee6a900c46508c98006aa85fe2d9" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:23.825079 16942 raft_consensus.cc:2468] T 6916ee6a900c46508c98006aa85fe2d9 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 0.
I20260709 12:27:23.825974 16991 tablet_bootstrap.cc:654] T 6916ee6a900c46508c98006aa85fe2d9 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:23.826802 16684 leader_election.cc:304] T 6916ee6a900c46508c98006aa85fe2d9 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d, 879366e90f5c420588945e0d545017c8; no voters: 
I20260709 12:27:23.827768 16857 tablet_service.cc:1511] Processing CreateTablet for tablet f29cf6eb18e842c3a5aa62d8fae53279 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:27:23.829298 16857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f29cf6eb18e842c3a5aa62d8fae53279. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.830427 16778 tablet_service.cc:1511] Processing CreateTablet for tablet f29cf6eb18e842c3a5aa62d8fae53279 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:27:23.831388 16778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f29cf6eb18e842c3a5aa62d8fae53279. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.837375 16997 consensus_queue.cc:1048] T aee6b58df96f401f88392d39eba8ffbf P 82f27bcdf252425aad4c4a37d064f68d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:27:23.828277 17011 raft_consensus.cc:2804] T 6916ee6a900c46508c98006aa85fe2d9 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:23.850129 16792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6916ee6a900c46508c98006aa85fe2d9" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
I20260709 12:27:23.848501 17011 raft_consensus.cc:493] T 6916ee6a900c46508c98006aa85fe2d9 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:23.852501 17011 raft_consensus.cc:3060] T 6916ee6a900c46508c98006aa85fe2d9 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:27:23.852418 16685 leader_election.cc:343] T 6916ee6a900c46508c98006aa85fe2d9 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:23.740208 16614 catalog_manager.cc:5697] T 52538067157143b2abd4656a4bbb9442 P 3c1aba6ee1d244fd9c0daba722aa0b3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66). New cstate: current_term: 1 leader_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:23.882558 16927 tablet_service.cc:1511] Processing CreateTablet for tablet f29cf6eb18e842c3a5aa62d8fae53279 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:27:23.882761 16707 tablet_service.cc:1511] Processing CreateTablet for tablet 6e89df746e0c49d184637314ce87045a (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:27:23.886101 16927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f29cf6eb18e842c3a5aa62d8fae53279. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.886312 16707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e89df746e0c49d184637314ce87045a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.839427 16988 raft_consensus.cc:359] T 98a96f910b4449f7ba9c875e45090080 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:23.839660 16989 consensus_queue.cc:260] T 27dda31a8cd1468eb3a824ae026485a3 P 82f27bcdf252425aad4c4a37d064f68d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
W20260709 12:27:23.905426 16907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:39833, user_credentials={real_user=slave}} blocked reactor thread for 77418.2us
I20260709 12:27:23.915866 16988 raft_consensus.cc:385] T 98a96f910b4449f7ba9c875e45090080 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:23.916289 16988 raft_consensus.cc:740] T 98a96f910b4449f7ba9c875e45090080 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Initialized, Role: FOLLOWER
I20260709 12:27:23.917066 16989 ts_tablet_manager.cc:1434] T 27dda31a8cd1468eb3a824ae026485a3 P 82f27bcdf252425aad4c4a37d064f68d: Time spent starting tablet: real 0.210s	user 0.009s	sys 0.002s
I20260709 12:27:23.917119 16988 consensus_queue.cc:260] T 98a96f910b4449f7ba9c875e45090080 P 17294485b7f24e2b9fae71dd3169a336 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:23.918404 16989 tablet_bootstrap.cc:492] T 98a96f910b4449f7ba9c875e45090080 P 82f27bcdf252425aad4c4a37d064f68d: Bootstrap starting.
I20260709 12:27:23.921811 16988 ts_tablet_manager.cc:1434] T 98a96f910b4449f7ba9c875e45090080 P 17294485b7f24e2b9fae71dd3169a336: Time spent starting tablet: real 0.240s	user 0.014s	sys 0.000s
I20260709 12:27:23.922906 16777 tablet_service.cc:1511] Processing CreateTablet for tablet 6e89df746e0c49d184637314ce87045a (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:27:23.924868 16777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e89df746e0c49d184637314ce87045a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.926426 16997 raft_consensus.cc:493] T 27dda31a8cd1468eb3a824ae026485a3 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:23.962303 16987 tablet_bootstrap.cc:492] T cd637126e0044d7996f18e258282a145 P 879366e90f5c420588945e0d545017c8: No bootstrap required, opened a new log
I20260709 12:27:23.962888 16987 ts_tablet_manager.cc:1403] T cd637126e0044d7996f18e258282a145 P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.469s	user 0.019s	sys 0.033s
I20260709 12:27:23.970166 16989 tablet_bootstrap.cc:654] T 98a96f910b4449f7ba9c875e45090080 P 82f27bcdf252425aad4c4a37d064f68d: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:23.969625 17016 raft_consensus.cc:515] T d6811cd94dfd44149e1329e919d82f0f P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:23.974974 16988 tablet_bootstrap.cc:492] T cd637126e0044d7996f18e258282a145 P 17294485b7f24e2b9fae71dd3169a336: Bootstrap starting.
I20260709 12:27:23.978856 17037 consensus_queue.cc:1048] T 288d05b8017c4e0f8cd40048647aecae P 879366e90f5c420588945e0d545017c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:27:23.995298 16778 tablet_service.cc:1511] Processing CreateTablet for tablet 8eaf179090b14105b52c4701d5599216 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:27:23.996752 16778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8eaf179090b14105b52c4701d5599216. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.954156 16997 raft_consensus.cc:515] T 27dda31a8cd1468eb3a824ae026485a3 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:23.988171 16615 catalog_manager.cc:5697] T 288d05b8017c4e0f8cd40048647aecae P 879366e90f5c420588945e0d545017c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 879366e90f5c420588945e0d545017c8 (127.9.116.65). New cstate: current_term: 1 leader_uuid: "879366e90f5c420588945e0d545017c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:24.004119 16927 tablet_service.cc:1511] Processing CreateTablet for tablet 8eaf179090b14105b52c4701d5599216 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:27:24.006527 16927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8eaf179090b14105b52c4701d5599216. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:24.011234 16853 tablet_service.cc:1511] Processing CreateTablet for tablet 6e89df746e0c49d184637314ce87045a (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:27:24.016467 16987 raft_consensus.cc:359] T cd637126e0044d7996f18e258282a145 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:24.017253 16780 tablet_service.cc:1511] Processing CreateTablet for tablet f39dd87ef56a40e2bf56704b2815a619 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:27:24.018733 16991 tablet_bootstrap.cc:492] T 6916ee6a900c46508c98006aa85fe2d9 P 3c1aba6ee1d244fd9c0daba722aa0b3b: No bootstrap required, opened a new log
I20260709 12:27:24.021078 17016 leader_election.cc:290] T d6811cd94dfd44149e1329e919d82f0f P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 election: Requested vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:24.020941 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6811cd94dfd44149e1329e919d82f0f" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d"
I20260709 12:27:24.017297 16987 raft_consensus.cc:385] T cd637126e0044d7996f18e258282a145 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:24.022737 16987 raft_consensus.cc:740] T cd637126e0044d7996f18e258282a145 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:24.019354 16780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f39dd87ef56a40e2bf56704b2815a619. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:24.026926 16987 consensus_queue.cc:260] T cd637126e0044d7996f18e258282a145 P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:24.021756 16941 raft_consensus.cc:3060] T d6811cd94dfd44149e1329e919d82f0f P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:24.013466 16853 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e89df746e0c49d184637314ce87045a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:24.019352 16991 ts_tablet_manager.cc:1403] T 6916ee6a900c46508c98006aa85fe2d9 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent bootstrapping tablet: real 0.269s	user 0.029s	sys 0.013s
I20260709 12:27:23.986047 17011 raft_consensus.cc:515] T 6916ee6a900c46508c98006aa85fe2d9 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:24.055368 16930 tablet_service.cc:1511] Processing CreateTablet for tablet 3d614e06fd2c40189161e22ad9217e5d (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:27:24.056279 16929 tablet_service.cc:1511] Processing CreateTablet for tablet f39dd87ef56a40e2bf56704b2815a619 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:27:24.064822 16929 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f39dd87ef56a40e2bf56704b2815a619. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:24.056447 16718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6811cd94dfd44149e1329e919d82f0f" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8"
I20260709 12:27:24.056834 16857 tablet_service.cc:1511] Processing CreateTablet for tablet 3d614e06fd2c40189161e22ad9217e5d (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:27:24.058734 16856 tablet_service.cc:1511] Processing CreateTablet for tablet f39dd87ef56a40e2bf56704b2815a619 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:27:24.061287 16997 leader_election.cc:290] T 27dda31a8cd1468eb3a824ae026485a3 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
I20260709 12:27:24.061090 16987 ts_tablet_manager.cc:1434] T cd637126e0044d7996f18e258282a145 P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.098s	user 0.009s	sys 0.000s
W20260709 12:27:24.026302 16908 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:43629, user_credentials={real_user=slave}} blocked reactor thread for 63585.3us
I20260709 12:27:24.067543 17011 leader_election.cc:290] T 6916ee6a900c46508c98006aa85fe2d9 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 election: Requested vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:24.069041 16703 tablet_service.cc:1511] Processing CreateTablet for tablet 3d614e06fd2c40189161e22ad9217e5d (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:27:24.080648 16930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d614e06fd2c40189161e22ad9217e5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:24.070662 16857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d614e06fd2c40189161e22ad9217e5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:24.084983 16867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27dda31a8cd1468eb3a824ae026485a3" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:24.085933 16867 raft_consensus.cc:2393] T 27dda31a8cd1468eb3a824ae026485a3 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 82f27bcdf252425aad4c4a37d064f68d in current term 1: Already voted for candidate 17294485b7f24e2b9fae71dd3169a336 in this term.
I20260709 12:27:24.086772 16793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6916ee6a900c46508c98006aa85fe2d9" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b"
I20260709 12:27:24.072865 16707 tablet_service.cc:1511] Processing CreateTablet for tablet 8eaf179090b14105b52c4701d5599216 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:27:24.077041 16987 tablet_bootstrap.cc:492] T d6811cd94dfd44149e1329e919d82f0f P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:24.093364 16941 raft_consensus.cc:2468] T d6811cd94dfd44149e1329e919d82f0f P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in term 1.
W20260709 12:27:24.094871 16759 leader_election.cc:343] T d6811cd94dfd44149e1329e919d82f0f P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:27:24.063402 16684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:38103, user_credentials={real_user=slave}} blocked reactor thread for 81666.1us
I20260709 12:27:24.080765 16703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d614e06fd2c40189161e22ad9217e5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:24.099504 16856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f39dd87ef56a40e2bf56704b2815a619. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:24.112455 16759 leader_election.cc:304] T d6811cd94dfd44149e1329e919d82f0f P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 82f27bcdf252425aad4c4a37d064f68d; no voters: 879366e90f5c420588945e0d545017c8
I20260709 12:27:24.098982 16991 raft_consensus.cc:359] T 6916ee6a900c46508c98006aa85fe2d9 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:24.114368 17016 raft_consensus.cc:2804] T d6811cd94dfd44149e1329e919d82f0f P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:24.114660 16991 raft_consensus.cc:385] T 6916ee6a900c46508c98006aa85fe2d9 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:24.114898 17016 raft_consensus.cc:697] T d6811cd94dfd44149e1329e919d82f0f P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 LEADER]: Becoming Leader. State: Replica: 3c1aba6ee1d244fd9c0daba722aa0b3b, State: Running, Role: LEADER
I20260709 12:27:24.115970 17016 consensus_queue.cc:237] T d6811cd94dfd44149e1329e919d82f0f P 3c1aba6ee1d244fd9c0daba722aa0b3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:24.117676 16989 tablet_bootstrap.cc:492] T 98a96f910b4449f7ba9c875e45090080 P 82f27bcdf252425aad4c4a37d064f68d: No bootstrap required, opened a new log
W20260709 12:27:24.102125 16685 leader_election.cc:343] T 6916ee6a900c46508c98006aa85fe2d9 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:24.118227 16989 ts_tablet_manager.cc:1403] T 98a96f910b4449f7ba9c875e45090080 P 82f27bcdf252425aad4c4a37d064f68d: Time spent bootstrapping tablet: real 0.200s	user 0.021s	sys 0.005s
I20260709 12:27:24.124343 16988 tablet_bootstrap.cc:654] T cd637126e0044d7996f18e258282a145 P 17294485b7f24e2b9fae71dd3169a336: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:24.115005 16991 raft_consensus.cc:740] T 6916ee6a900c46508c98006aa85fe2d9 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c1aba6ee1d244fd9c0daba722aa0b3b, State: Initialized, Role: FOLLOWER
I20260709 12:27:24.119475 16707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8eaf179090b14105b52c4701d5599216. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:24.126653 16777 tablet_service.cc:1511] Processing CreateTablet for tablet a4252af16e15424399c32c789c8e6c23 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:27:24.128036 16777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4252af16e15424399c32c789c8e6c23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:24.138418 16706 tablet_service.cc:1511] Processing CreateTablet for tablet a4252af16e15424399c32c789c8e6c23 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:27:24.140122 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6916ee6a900c46508c98006aa85fe2d9" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d"
I20260709 12:27:24.140856 16941 raft_consensus.cc:3060] T 6916ee6a900c46508c98006aa85fe2d9 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:24.148738 16706 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4252af16e15424399c32c789c8e6c23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:24.160660 16857 tablet_service.cc:1511] Processing CreateTablet for tablet a4252af16e15424399c32c789c8e6c23 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:27:24.162673 16857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4252af16e15424399c32c789c8e6c23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:24.164328 16991 consensus_queue.cc:260] T 6916ee6a900c46508c98006aa85fe2d9 P 3c1aba6ee1d244fd9c0daba722aa0b3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:24.168529 16991 ts_tablet_manager.cc:1434] T 6916ee6a900c46508c98006aa85fe2d9 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent starting tablet: real 0.124s	user 0.005s	sys 0.005s
I20260709 12:27:24.180856 16987 tablet_bootstrap.cc:654] T d6811cd94dfd44149e1329e919d82f0f P 879366e90f5c420588945e0d545017c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:24.169981 16991 tablet_bootstrap.cc:492] T aee6b58df96f401f88392d39eba8ffbf P 3c1aba6ee1d244fd9c0daba722aa0b3b: Bootstrap starting.
I20260709 12:27:24.176438 16931 tablet_service.cc:1511] Processing CreateTablet for tablet a8a632c738e94b26a8352a68a42a0670 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:27:24.201233 16708 tablet_service.cc:1511] Processing CreateTablet for tablet a8a632c738e94b26a8352a68a42a0670 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:27:24.201539 16778 tablet_service.cc:1511] Processing CreateTablet for tablet a8a632c738e94b26a8352a68a42a0670 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:27:24.213646 16708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8a632c738e94b26a8352a68a42a0670. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:24.220144 16929 tablet_service.cc:1511] Processing CreateTablet for tablet 7562feb416f84f0b948343356153d8d2 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:27:24.222483 16929 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7562feb416f84f0b948343356153d8d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:24.227528 16857 tablet_service.cc:1511] Processing CreateTablet for tablet 7562feb416f84f0b948343356153d8d2 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:27:24.242595 16857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7562feb416f84f0b948343356153d8d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:24.231842 16718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27dda31a8cd1468eb3a824ae026485a3" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8" is_pre_election: true
I20260709 12:27:24.248215 16718 raft_consensus.cc:2393] T 27dda31a8cd1468eb3a824ae026485a3 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 82f27bcdf252425aad4c4a37d064f68d in current term 1: Already voted for candidate 879366e90f5c420588945e0d545017c8 in this term.
I20260709 12:27:24.247902 16989 raft_consensus.cc:359] T 98a96f910b4449f7ba9c875e45090080 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:24.248657 16989 raft_consensus.cc:385] T 98a96f910b4449f7ba9c875e45090080 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:24.248939 16989 raft_consensus.cc:740] T 98a96f910b4449f7ba9c875e45090080 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f27bcdf252425aad4c4a37d064f68d, State: Initialized, Role: FOLLOWER
I20260709 12:27:24.232901 17037 consensus_queue.cc:1048] T 288d05b8017c4e0f8cd40048647aecae P 879366e90f5c420588945e0d545017c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:24.249684 16989 consensus_queue.cc:260] T 98a96f910b4449f7ba9c875e45090080 P 82f27bcdf252425aad4c4a37d064f68d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:24.255472 16778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8a632c738e94b26a8352a68a42a0670. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:24.187705 16941 raft_consensus.cc:2468] T 6916ee6a900c46508c98006aa85fe2d9 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 1.
I20260709 12:27:24.270676 16907 leader_election.cc:304] T 27dda31a8cd1468eb3a824ae026485a3 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8
I20260709 12:27:24.271669 16989 ts_tablet_manager.cc:1434] T 98a96f910b4449f7ba9c875e45090080 P 82f27bcdf252425aad4c4a37d064f68d: Time spent starting tablet: real 0.153s	user 0.005s	sys 0.004s
I20260709 12:27:24.268603 16931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8a632c738e94b26a8352a68a42a0670. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:24.282411 17016 raft_consensus.cc:493] T 6916ee6a900c46508c98006aa85fe2d9 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:24.283242 17016 raft_consensus.cc:515] T 6916ee6a900c46508c98006aa85fe2d9 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:24.283850 17037 raft_consensus.cc:493] T 27dda31a8cd1468eb3a824ae026485a3 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:24.284502 17037 raft_consensus.cc:515] T 27dda31a8cd1468eb3a824ae026485a3 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:24.285835 17016 leader_election.cc:290] T 6916ee6a900c46508c98006aa85fe2d9 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919)
I20260709 12:27:24.281754 16989 tablet_bootstrap.cc:492] T fd1494eb0dd14dab9a2e4c07812117c2 P 82f27bcdf252425aad4c4a37d064f68d: Bootstrap starting.
I20260709 12:27:24.286690 17037 leader_election.cc:290] T 27dda31a8cd1468eb3a824ae026485a3 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919)
I20260709 12:27:24.293290 16939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6916ee6a900c46508c98006aa85fe2d9" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:24.294646 16989 tablet_bootstrap.cc:654] T fd1494eb0dd14dab9a2e4c07812117c2 P 82f27bcdf252425aad4c4a37d064f68d: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:24.286815 17075 raft_consensus.cc:3060] T 27dda31a8cd1468eb3a824ae026485a3 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:24.304457 16707 tablet_service.cc:1511] Processing CreateTablet for tablet 7562feb416f84f0b948343356153d8d2 (DEFAULT_TABLE table=test-workload [id=e5e18304b61a439887d4510f317615e3]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:27:24.305982 16707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7562feb416f84f0b948343356153d8d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:24.292148 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27dda31a8cd1468eb3a824ae026485a3" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:24.291127 16718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6916ee6a900c46508c98006aa85fe2d9" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8" is_pre_election: true
I20260709 12:27:24.306869 16718 raft_consensus.cc:2393] T 6916ee6a900c46508c98006aa85fe2d9 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in current term 1: Already voted for candidate 879366e90f5c420588945e0d545017c8 in this term.
I20260709 12:27:24.308535 16759 leader_election.cc:304] T 6916ee6a900c46508c98006aa85fe2d9 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b; no voters: 82f27bcdf252425aad4c4a37d064f68d, 879366e90f5c420588945e0d545017c8
I20260709 12:27:24.309571 17016 raft_consensus.cc:3060] T 6916ee6a900c46508c98006aa85fe2d9 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:24.311143 17079 raft_consensus.cc:493] T 98a96f910b4449f7ba9c875e45090080 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:24.311730 17079 raft_consensus.cc:515] T 98a96f910b4449f7ba9c875e45090080 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:24.313254 16987 tablet_bootstrap.cc:492] T d6811cd94dfd44149e1329e919d82f0f P 879366e90f5c420588945e0d545017c8: No bootstrap required, opened a new log
I20260709 12:27:24.313800 16987 ts_tablet_manager.cc:1403] T d6811cd94dfd44149e1329e919d82f0f P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.237s	user 0.018s	sys 0.005s
I20260709 12:27:24.314217 17079 leader_election.cc:290] T 98a96f910b4449f7ba9c875e45090080 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:24.316049 16939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a96f910b4449f7ba9c875e45090080" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:24.316802 16939 raft_consensus.cc:2468] T 98a96f910b4449f7ba9c875e45090080 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 0.
W20260709 12:27:24.317288 16665 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:27:24.318290 17016 raft_consensus.cc:2749] T 6916ee6a900c46508c98006aa85fe2d9 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:24.318457 16866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27dda31a8cd1468eb3a824ae026485a3" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:24.318689 16718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a96f910b4449f7ba9c875e45090080" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8" is_pre_election: true
I20260709 12:27:24.319346 16718 raft_consensus.cc:2468] T 98a96f910b4449f7ba9c875e45090080 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 0.
I20260709 12:27:24.318300 16833 leader_election.cc:304] T 98a96f910b4449f7ba9c875e45090080 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 82f27bcdf252425aad4c4a37d064f68d; no voters: 
I20260709 12:27:24.323076 17079 raft_consensus.cc:2804] T 98a96f910b4449f7ba9c875e45090080 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:24.323494 17079 raft_consensus.cc:493] T 98a96f910b4449f7ba9c875e45090080 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:24.323875 17079 raft_consensus.cc:3060] T 98a96f910b4449f7ba9c875e45090080 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:24.319254 16866 raft_consensus.cc:2468] T 27dda31a8cd1468eb3a824ae026485a3 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 1.
I20260709 12:27:24.334797 16684 leader_election.cc:304] T 27dda31a8cd1468eb3a824ae026485a3 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8; no voters: 
I20260709 12:27:24.309780 16617 catalog_manager.cc:5697] T d6811cd94dfd44149e1329e919d82f0f P 3c1aba6ee1d244fd9c0daba722aa0b3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66). New cstate: current_term: 1 leader_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:24.336021 17081 raft_consensus.cc:2804] T 27dda31a8cd1468eb3a824ae026485a3 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:24.336131 17075 raft_consensus.cc:2749] T 27dda31a8cd1468eb3a824ae026485a3 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:24.336589 17081 raft_consensus.cc:493] T 27dda31a8cd1468eb3a824ae026485a3 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:24.337113 17081 raft_consensus.cc:3060] T 27dda31a8cd1468eb3a824ae026485a3 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:24.340808 16940 raft_consensus.cc:2468] T 27dda31a8cd1468eb3a824ae026485a3 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 1.
I20260709 12:27:24.348977 16987 raft_consensus.cc:359] T d6811cd94dfd44149e1329e919d82f0f P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:24.351166 16987 raft_consensus.cc:385] T d6811cd94dfd44149e1329e919d82f0f P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:24.302897 17037 raft_consensus.cc:493] T cd637126e0044d7996f18e258282a145 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:24.357060 17037 raft_consensus.cc:515] T cd637126e0044d7996f18e258282a145 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:24.363757 16684 leader_election.cc:304] T 6916ee6a900c46508c98006aa85fe2d9 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d, 879366e90f5c420588945e0d545017c8; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b
I20260709 12:27:24.365835 17076 raft_consensus.cc:2804] T 6916ee6a900c46508c98006aa85fe2d9 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:24.366446 17076 raft_consensus.cc:697] T 6916ee6a900c46508c98006aa85fe2d9 P 879366e90f5c420588945e0d545017c8 [term 1 LEADER]: Becoming Leader. State: Replica: 879366e90f5c420588945e0d545017c8, State: Running, Role: LEADER
I20260709 12:27:24.366290 16793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd637126e0044d7996f18e258282a145" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
I20260709 12:27:24.367683 17076 consensus_queue.cc:237] T 6916ee6a900c46508c98006aa85fe2d9 P 879366e90f5c420588945e0d545017c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
W20260709 12:27:24.368582 16685 leader_election.cc:343] T cd637126e0044d7996f18e258282a145 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:24.364609 17037 leader_election.cc:290] T cd637126e0044d7996f18e258282a145 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
I20260709 12:27:24.355967 16987 raft_consensus.cc:740] T d6811cd94dfd44149e1329e919d82f0f P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:24.372704 16991 tablet_bootstrap.cc:654] T aee6b58df96f401f88392d39eba8ffbf P 3c1aba6ee1d244fd9c0daba722aa0b3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:24.377854 17079 raft_consensus.cc:515] T 98a96f910b4449f7ba9c875e45090080 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:24.379398 16987 consensus_queue.cc:260] T d6811cd94dfd44149e1329e919d82f0f P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:24.385803 16987 ts_tablet_manager.cc:1434] T d6811cd94dfd44149e1329e919d82f0f P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.072s	user 0.008s	sys 0.002s
I20260709 12:27:24.387455 16987 tablet_bootstrap.cc:492] T 28bdf20fc71548da87c4558dacc503db P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:24.390378 16988 tablet_bootstrap.cc:492] T cd637126e0044d7996f18e258282a145 P 17294485b7f24e2b9fae71dd3169a336: No bootstrap required, opened a new log
I20260709 12:27:24.391222 16988 ts_tablet_manager.cc:1403] T cd637126e0044d7996f18e258282a145 P 17294485b7f24e2b9fae71dd3169a336: Time spent bootstrapping tablet: real 0.452s	user 0.025s	sys 0.015s
I20260709 12:27:24.394145 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a96f910b4449f7ba9c875e45090080" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d"
I20260709 12:27:24.394927 16941 raft_consensus.cc:3060] T 98a96f910b4449f7ba9c875e45090080 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:24.397470 16988 raft_consensus.cc:359] T cd637126e0044d7996f18e258282a145 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:24.398648 16988 raft_consensus.cc:385] T cd637126e0044d7996f18e258282a145 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:24.399032 16988 raft_consensus.cc:740] T cd637126e0044d7996f18e258282a145 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Initialized, Role: FOLLOWER
I20260709 12:27:24.401047 16988 consensus_queue.cc:260] T cd637126e0044d7996f18e258282a145 P 17294485b7f24e2b9fae71dd3169a336 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:24.403394 16866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd637126e0044d7996f18e258282a145" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:24.404227 16866 raft_consensus.cc:2468] T cd637126e0044d7996f18e258282a145 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 0.
I20260709 12:27:24.406387 16988 ts_tablet_manager.cc:1434] T cd637126e0044d7996f18e258282a145 P 17294485b7f24e2b9fae71dd3169a336: Time spent starting tablet: real 0.015s	user 0.010s	sys 0.000s
I20260709 12:27:24.408434 16988 tablet_bootstrap.cc:492] T fd1494eb0dd14dab9a2e4c07812117c2 P 17294485b7f24e2b9fae71dd3169a336: Bootstrap starting.
I20260709 12:27:24.414996 17081 raft_consensus.cc:515] T 27dda31a8cd1468eb3a824ae026485a3 P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:24.419930 16988 tablet_bootstrap.cc:654] T fd1494eb0dd14dab9a2e4c07812117c2 P 17294485b7f24e2b9fae71dd3169a336: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:24.421644 17081 leader_election.cc:290] T 27dda31a8cd1468eb3a824ae026485a3 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 2 election: Requested vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919)
I20260709 12:27:24.425132 16684 leader_election.cc:304] T cd637126e0044d7996f18e258282a145 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b
I20260709 12:27:24.431298 17079 leader_election.cc:290] T 98a96f910b4449f7ba9c875e45090080 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 election: Requested vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:24.429359 17011 raft_consensus.cc:493] T d6811cd94dfd44149e1329e919d82f0f P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:24.432682 17048 raft_consensus.cc:2804] T cd637126e0044d7996f18e258282a145 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:24.432333 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27dda31a8cd1468eb3a824ae026485a3" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d"
I20260709 12:27:24.433086 17048 raft_consensus.cc:493] T cd637126e0044d7996f18e258282a145 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:24.433451 16942 raft_consensus.cc:3060] T 27dda31a8cd1468eb3a824ae026485a3 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:24.433774 16868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27dda31a8cd1468eb3a824ae026485a3" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336"
I20260709 12:27:24.434783 16868 raft_consensus.cc:3060] T 27dda31a8cd1468eb3a824ae026485a3 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:24.433486 17048 raft_consensus.cc:3060] T cd637126e0044d7996f18e258282a145 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:24.440183 16718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a96f910b4449f7ba9c875e45090080" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8"
I20260709 12:27:24.441213 16718 raft_consensus.cc:3060] T 98a96f910b4449f7ba9c875e45090080 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:24.433079 17011 raft_consensus.cc:515] T d6811cd94dfd44149e1329e919d82f0f P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:24.448547 17011 leader_election.cc:290] T d6811cd94dfd44149e1329e919d82f0f P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:24.456240 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6811cd94dfd44149e1329e919d82f0f" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:24.460793 16989 tablet_bootstrap.cc:492] T fd1494eb0dd14dab9a2e4c07812117c2 P 82f27bcdf252425aad4c4a37d064f68d: No bootstrap required, opened a new log
I20260709 12:27:24.465267 16989 ts_tablet_manager.cc:1403] T fd1494eb0dd14dab9a2e4c07812117c2 P 82f27bcdf252425aad4c4a37d064f68d: Time spent bootstrapping tablet: real 0.184s	user 0.048s	sys 0.021s
I20260709 12:27:24.467020 16940 raft_consensus.cc:2393] T d6811cd94dfd44149e1329e919d82f0f P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 879366e90f5c420588945e0d545017c8 in current term 1: Already voted for candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in this term.
I20260709 12:27:24.469151 16989 raft_consensus.cc:359] T fd1494eb0dd14dab9a2e4c07812117c2 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:24.470057 16989 raft_consensus.cc:385] T fd1494eb0dd14dab9a2e4c07812117c2 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:24.471949 16991 tablet_bootstrap.cc:492] T aee6b58df96f401f88392d39eba8ffbf P 3c1aba6ee1d244fd9c0daba722aa0b3b: No bootstrap required, opened a new log
I20260709 12:27:24.470386 16989 raft_consensus.cc:740] T fd1494eb0dd14dab9a2e4c07812117c2 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f27bcdf252425aad4c4a37d064f68d, State: Initialized, Role: FOLLOWER
I20260709 12:27:24.472568 16991 ts_tablet_manager.cc:1403] T aee6b58df96f401f88392d39eba8ffbf P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent bootstrapping tablet: real 0.303s	user 0.010s	sys 0.009s
I20260709 12:27:24.473663 16987 tablet_bootstrap.cc:654] T 28bdf20fc71548da87c4558dacc503db P 879366e90f5c420588945e0d545017c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:24.477797 16942 raft_consensus.cc:2468] T 27dda31a8cd1468eb3a824ae026485a3 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 2.
I20260709 12:27:24.478348 16991 raft_consensus.cc:359] T aee6b58df96f401f88392d39eba8ffbf P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:24.478718 16989 consensus_queue.cc:260] T fd1494eb0dd14dab9a2e4c07812117c2 P 82f27bcdf252425aad4c4a37d064f68d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:24.479275 16991 raft_consensus.cc:385] T aee6b58df96f401f88392d39eba8ffbf P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:24.480192 16991 raft_consensus.cc:740] T aee6b58df96f401f88392d39eba8ffbf P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c1aba6ee1d244fd9c0daba722aa0b3b, State: Initialized, Role: FOLLOWER
I20260709 12:27:24.479985 16684 leader_election.cc:304] T 27dda31a8cd1468eb3a824ae026485a3 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d, 879366e90f5c420588945e0d545017c8; no voters: 
I20260709 12:27:24.481582 16991 consensus_queue.cc:260] T aee6b58df96f401f88392d39eba8ffbf P 3c1aba6ee1d244fd9c0daba722aa0b3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:24.484006 17089 raft_consensus.cc:2804] T 27dda31a8cd1468eb3a824ae026485a3 P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:24.484450 17048 raft_consensus.cc:515] T cd637126e0044d7996f18e258282a145 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:24.484999 17089 raft_consensus.cc:697] T 27dda31a8cd1468eb3a824ae026485a3 P 879366e90f5c420588945e0d545017c8 [term 2 LEADER]: Becoming Leader. State: Replica: 879366e90f5c420588945e0d545017c8, State: Running, Role: LEADER
I20260709 12:27:24.477906 16941 raft_consensus.cc:2468] T 98a96f910b4449f7ba9c875e45090080 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 1.
I20260709 12:27:24.489248 16718 raft_consensus.cc:2468] T 98a96f910b4449f7ba9c875e45090080 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 1.
I20260709 12:27:24.489585 16833 leader_election.cc:304] T 98a96f910b4449f7ba9c875e45090080 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 82f27bcdf252425aad4c4a37d064f68d; no voters: 
I20260709 12:27:24.490643 17079 raft_consensus.cc:2804] T 98a96f910b4449f7ba9c875e45090080 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:24.488572 17089 consensus_queue.cc:237] T 27dda31a8cd1468eb3a824ae026485a3 P 879366e90f5c420588945e0d545017c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:24.495064 16989 ts_tablet_manager.cc:1434] T fd1494eb0dd14dab9a2e4c07812117c2 P 82f27bcdf252425aad4c4a37d064f68d: Time spent starting tablet: real 0.029s	user 0.010s	sys 0.000s
I20260709 12:27:24.496337 16793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6811cd94dfd44149e1329e919d82f0f" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
I20260709 12:27:24.496912 16989 tablet_bootstrap.cc:492] T 27f104a1ba60493ab47f6b876da48d67 P 82f27bcdf252425aad4c4a37d064f68d: Bootstrap starting.
I20260709 12:27:24.498961 17048 leader_election.cc:290] T cd637126e0044d7996f18e258282a145 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 election: Requested vote from peers 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
I20260709 12:27:24.486994 16868 raft_consensus.cc:2468] T 27dda31a8cd1468eb3a824ae026485a3 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 2.
I20260709 12:27:24.501334 16991 ts_tablet_manager.cc:1434] T aee6b58df96f401f88392d39eba8ffbf P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent starting tablet: real 0.028s	user 0.004s	sys 0.005s
I20260709 12:27:24.502493 16991 tablet_bootstrap.cc:492] T cd637126e0044d7996f18e258282a145 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Bootstrap starting.
I20260709 12:27:24.506124 16989 tablet_bootstrap.cc:654] T 27f104a1ba60493ab47f6b876da48d67 P 82f27bcdf252425aad4c4a37d064f68d: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:24.508740 16991 tablet_bootstrap.cc:654] T cd637126e0044d7996f18e258282a145 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:24.492836 17079 raft_consensus.cc:697] T 98a96f910b4449f7ba9c875e45090080 P 17294485b7f24e2b9fae71dd3169a336 [term 1 LEADER]: Becoming Leader. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Running, Role: LEADER
I20260709 12:27:24.514994 16988 tablet_bootstrap.cc:492] T fd1494eb0dd14dab9a2e4c07812117c2 P 17294485b7f24e2b9fae71dd3169a336: No bootstrap required, opened a new log
I20260709 12:27:24.516137 16988 ts_tablet_manager.cc:1403] T fd1494eb0dd14dab9a2e4c07812117c2 P 17294485b7f24e2b9fae71dd3169a336: Time spent bootstrapping tablet: real 0.108s	user 0.016s	sys 0.004s
I20260709 12:27:24.518703 17060 raft_consensus.cc:493] T aee6b58df96f401f88392d39eba8ffbf P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:24.519390 17060 raft_consensus.cc:515] T aee6b58df96f401f88392d39eba8ffbf P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:24.519810 16793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd637126e0044d7996f18e258282a145" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b"
I20260709 12:27:24.521265 16866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd637126e0044d7996f18e258282a145" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336"
I20260709 12:27:24.522056 16866 raft_consensus.cc:3060] T cd637126e0044d7996f18e258282a145 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:24.522634 16685 leader_election.cc:304] T d6811cd94dfd44149e1329e919d82f0f P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 879366e90f5c420588945e0d545017c8; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 82f27bcdf252425aad4c4a37d064f68d
W20260709 12:27:24.524399 16685 leader_election.cc:343] T cd637126e0044d7996f18e258282a145 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:24.531898 17076 raft_consensus.cc:3060] T d6811cd94dfd44149e1329e919d82f0f P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:24.537701 16867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee6b58df96f401f88392d39eba8ffbf" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:24.538036 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee6b58df96f401f88392d39eba8ffbf" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:24.540294 16866 raft_consensus.cc:2468] T cd637126e0044d7996f18e258282a145 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 1.
I20260709 12:27:24.540656 16759 leader_election.cc:304] T aee6b58df96f401f88392d39eba8ffbf P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b; no voters: 17294485b7f24e2b9fae71dd3169a336, 82f27bcdf252425aad4c4a37d064f68d
I20260709 12:27:24.535439 17060 leader_election.cc:290] T aee6b58df96f401f88392d39eba8ffbf P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919)
I20260709 12:27:24.543141 17060 raft_consensus.cc:2749] T aee6b58df96f401f88392d39eba8ffbf P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:24.541319 16989 tablet_bootstrap.cc:492] T 27f104a1ba60493ab47f6b876da48d67 P 82f27bcdf252425aad4c4a37d064f68d: No bootstrap required, opened a new log
I20260709 12:27:24.545236 16988 raft_consensus.cc:359] T fd1494eb0dd14dab9a2e4c07812117c2 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:24.545785 16989 ts_tablet_manager.cc:1403] T 27f104a1ba60493ab47f6b876da48d67 P 82f27bcdf252425aad4c4a37d064f68d: Time spent bootstrapping tablet: real 0.049s	user 0.024s	sys 0.002s
I20260709 12:27:24.546239 16988 raft_consensus.cc:385] T fd1494eb0dd14dab9a2e4c07812117c2 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:24.548148 16988 raft_consensus.cc:740] T fd1494eb0dd14dab9a2e4c07812117c2 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Initialized, Role: FOLLOWER
I20260709 12:27:24.546916 16684 leader_election.cc:304] T cd637126e0044d7996f18e258282a145 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b
I20260709 12:27:24.549938 16988 consensus_queue.cc:260] T fd1494eb0dd14dab9a2e4c07812117c2 P 17294485b7f24e2b9fae71dd3169a336 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:24.551715 17048 raft_consensus.cc:2804] T cd637126e0044d7996f18e258282a145 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:24.552291 17048 raft_consensus.cc:697] T cd637126e0044d7996f18e258282a145 P 879366e90f5c420588945e0d545017c8 [term 1 LEADER]: Becoming Leader. State: Replica: 879366e90f5c420588945e0d545017c8, State: Running, Role: LEADER
I20260709 12:27:24.552712 16988 ts_tablet_manager.cc:1434] T fd1494eb0dd14dab9a2e4c07812117c2 P 17294485b7f24e2b9fae71dd3169a336: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.001s
I20260709 12:27:24.552389 16989 raft_consensus.cc:359] T 27f104a1ba60493ab47f6b876da48d67 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:24.553103 16989 raft_consensus.cc:385] T 27f104a1ba60493ab47f6b876da48d67 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:24.553393 16989 raft_consensus.cc:740] T 27f104a1ba60493ab47f6b876da48d67 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f27bcdf252425aad4c4a37d064f68d, State: Initialized, Role: FOLLOWER
I20260709 12:27:24.553738 16988 tablet_bootstrap.cc:492] T 28bdf20fc71548da87c4558dacc503db P 17294485b7f24e2b9fae71dd3169a336: Bootstrap starting.
I20260709 12:27:24.553200 17048 consensus_queue.cc:237] T cd637126e0044d7996f18e258282a145 P 879366e90f5c420588945e0d545017c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:24.554147 16989 consensus_queue.cc:260] T 27f104a1ba60493ab47f6b876da48d67 P 82f27bcdf252425aad4c4a37d064f68d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:24.547657 17079 consensus_queue.cc:237] T 98a96f910b4449f7ba9c875e45090080 P 17294485b7f24e2b9fae71dd3169a336 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:24.563802 16989 ts_tablet_manager.cc:1434] T 27f104a1ba60493ab47f6b876da48d67 P 82f27bcdf252425aad4c4a37d064f68d: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 12:27:24.565270 16989 tablet_bootstrap.cc:492] T ea5085716661498e9f3bfdfa2fc5737a P 82f27bcdf252425aad4c4a37d064f68d: Bootstrap starting.
I20260709 12:27:24.572186 17060 consensus_queue.cc:1048] T d6811cd94dfd44149e1329e919d82f0f P 3c1aba6ee1d244fd9c0daba722aa0b3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:24.594272 16987 tablet_bootstrap.cc:492] T 28bdf20fc71548da87c4558dacc503db P 879366e90f5c420588945e0d545017c8: No bootstrap required, opened a new log
I20260709 12:27:24.594820 16987 ts_tablet_manager.cc:1403] T 28bdf20fc71548da87c4558dacc503db P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.208s	user 0.012s	sys 0.011s
I20260709 12:27:24.597852 16987 raft_consensus.cc:359] T 28bdf20fc71548da87c4558dacc503db P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:24.598657 16987 raft_consensus.cc:385] T 28bdf20fc71548da87c4558dacc503db P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:24.598989 16987 raft_consensus.cc:740] T 28bdf20fc71548da87c4558dacc503db P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:24.599862 16987 consensus_queue.cc:260] T 28bdf20fc71548da87c4558dacc503db P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:24.603008 16987 ts_tablet_manager.cc:1434] T 28bdf20fc71548da87c4558dacc503db P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:27:24.604106 16987 tablet_bootstrap.cc:492] T ea5085716661498e9f3bfdfa2fc5737a P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:24.607854 16617 catalog_manager.cc:5697] T 98a96f910b4449f7ba9c875e45090080 P 17294485b7f24e2b9fae71dd3169a336 reported cstate change: term changed from 0 to 1, leader changed from <none> to 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67). New cstate: current_term: 1 leader_uuid: "17294485b7f24e2b9fae71dd3169a336" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:24.610656 16987 tablet_bootstrap.cc:654] T ea5085716661498e9f3bfdfa2fc5737a P 879366e90f5c420588945e0d545017c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:24.610662 16988 tablet_bootstrap.cc:654] T 28bdf20fc71548da87c4558dacc503db P 17294485b7f24e2b9fae71dd3169a336: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:24.612581 16615 catalog_manager.cc:5697] T 6916ee6a900c46508c98006aa85fe2d9 P 879366e90f5c420588945e0d545017c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 879366e90f5c420588945e0d545017c8 (127.9.116.65). New cstate: current_term: 1 leader_uuid: "879366e90f5c420588945e0d545017c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:24.614315 16989 tablet_bootstrap.cc:654] T ea5085716661498e9f3bfdfa2fc5737a P 82f27bcdf252425aad4c4a37d064f68d: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:24.622232 17076 raft_consensus.cc:2749] T d6811cd94dfd44149e1329e919d82f0f P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:24.626396 16991 tablet_bootstrap.cc:492] T cd637126e0044d7996f18e258282a145 P 3c1aba6ee1d244fd9c0daba722aa0b3b: No bootstrap required, opened a new log
I20260709 12:27:24.627013 16991 ts_tablet_manager.cc:1403] T cd637126e0044d7996f18e258282a145 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent bootstrapping tablet: real 0.125s	user 0.012s	sys 0.015s
I20260709 12:27:24.636768 16991 raft_consensus.cc:359] T cd637126e0044d7996f18e258282a145 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:24.632989 17060 consensus_queue.cc:1048] T d6811cd94dfd44149e1329e919d82f0f P 3c1aba6ee1d244fd9c0daba722aa0b3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:27:24.637661 16991 raft_consensus.cc:385] T cd637126e0044d7996f18e258282a145 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:24.638023 16991 raft_consensus.cc:740] T cd637126e0044d7996f18e258282a145 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c1aba6ee1d244fd9c0daba722aa0b3b, State: Initialized, Role: FOLLOWER
I20260709 12:27:24.638964 16991 consensus_queue.cc:260] T cd637126e0044d7996f18e258282a145 P 3c1aba6ee1d244fd9c0daba722aa0b3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:24.641775 16991 ts_tablet_manager.cc:1434] T cd637126e0044d7996f18e258282a145 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:27:24.655977 16991 tablet_bootstrap.cc:492] T ea5085716661498e9f3bfdfa2fc5737a P 3c1aba6ee1d244fd9c0daba722aa0b3b: Bootstrap starting.
I20260709 12:27:24.668637 16989 tablet_bootstrap.cc:492] T ea5085716661498e9f3bfdfa2fc5737a P 82f27bcdf252425aad4c4a37d064f68d: No bootstrap required, opened a new log
I20260709 12:27:24.668479 16997 raft_consensus.cc:493] T fd1494eb0dd14dab9a2e4c07812117c2 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:24.669369 16989 ts_tablet_manager.cc:1403] T ea5085716661498e9f3bfdfa2fc5737a P 82f27bcdf252425aad4c4a37d064f68d: Time spent bootstrapping tablet: real 0.104s	user 0.022s	sys 0.000s
I20260709 12:27:24.669265 16997 raft_consensus.cc:515] T fd1494eb0dd14dab9a2e4c07812117c2 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:24.672564 16793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1494eb0dd14dab9a2e4c07812117c2" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
I20260709 12:27:24.673539 16793 raft_consensus.cc:2468] T fd1494eb0dd14dab9a2e4c07812117c2 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82f27bcdf252425aad4c4a37d064f68d in term 0.
I20260709 12:27:24.675361 16997 leader_election.cc:290] T fd1494eb0dd14dab9a2e4c07812117c2 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
I20260709 12:27:24.679216 16866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1494eb0dd14dab9a2e4c07812117c2" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:24.680065 16866 raft_consensus.cc:2468] T fd1494eb0dd14dab9a2e4c07812117c2 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82f27bcdf252425aad4c4a37d064f68d in term 0.
I20260709 12:27:24.680464 16991 tablet_bootstrap.cc:654] T ea5085716661498e9f3bfdfa2fc5737a P 3c1aba6ee1d244fd9c0daba722aa0b3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:24.681862 16908 leader_election.cc:304] T fd1494eb0dd14dab9a2e4c07812117c2 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 82f27bcdf252425aad4c4a37d064f68d; no voters: 
I20260709 12:27:24.682870 17069 raft_consensus.cc:2804] T fd1494eb0dd14dab9a2e4c07812117c2 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:24.683311 17069 raft_consensus.cc:493] T fd1494eb0dd14dab9a2e4c07812117c2 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:24.683678 17069 raft_consensus.cc:3060] T fd1494eb0dd14dab9a2e4c07812117c2 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:24.682875 16793 raft_consensus.cc:3060] T aee6b58df96f401f88392d39eba8ffbf P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:24.694233 17069 raft_consensus.cc:515] T fd1494eb0dd14dab9a2e4c07812117c2 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:24.696905 16989 raft_consensus.cc:359] T ea5085716661498e9f3bfdfa2fc5737a P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:24.699549 16989 raft_consensus.cc:385] T ea5085716661498e9f3bfdfa2fc5737a P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:24.699947 16989 raft_consensus.cc:740] T ea5085716661498e9f3bfdfa2fc5737a P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f27bcdf252425aad4c4a37d064f68d, State: Initialized, Role: FOLLOWER
I20260709 12:27:24.702898 16989 consensus_queue.cc:260] T ea5085716661498e9f3bfdfa2fc5737a P 82f27bcdf252425aad4c4a37d064f68d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:24.709146 16989 ts_tablet_manager.cc:1434] T ea5085716661498e9f3bfdfa2fc5737a P 82f27bcdf252425aad4c4a37d064f68d: Time spent starting tablet: real 0.039s	user 0.009s	sys 0.000s
I20260709 12:27:24.711242 16989 tablet_bootstrap.cc:492] T 00e5268529b241f184c460704ab9ed3c P 82f27bcdf252425aad4c4a37d064f68d: Bootstrap starting.
I20260709 12:27:24.711436 16792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1494eb0dd14dab9a2e4c07812117c2" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b"
I20260709 12:27:24.712226 16792 raft_consensus.cc:3060] T fd1494eb0dd14dab9a2e4c07812117c2 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:24.719446 16989 tablet_bootstrap.cc:654] T 00e5268529b241f184c460704ab9ed3c P 82f27bcdf252425aad4c4a37d064f68d: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:24.730072 16866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1494eb0dd14dab9a2e4c07812117c2" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336"
I20260709 12:27:24.730997 16866 raft_consensus.cc:3060] T fd1494eb0dd14dab9a2e4c07812117c2 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:24.729947 16615 catalog_manager.cc:5697] T cd637126e0044d7996f18e258282a145 P 879366e90f5c420588945e0d545017c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 879366e90f5c420588945e0d545017c8 (127.9.116.65). New cstate: current_term: 1 leader_uuid: "879366e90f5c420588945e0d545017c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:24.733412 16987 tablet_bootstrap.cc:492] T ea5085716661498e9f3bfdfa2fc5737a P 879366e90f5c420588945e0d545017c8: No bootstrap required, opened a new log
I20260709 12:27:24.732594 16615 catalog_manager.cc:5697] T 27dda31a8cd1468eb3a824ae026485a3 P 879366e90f5c420588945e0d545017c8 reported cstate change: term changed from 0 to 2, leader changed from <none> to 879366e90f5c420588945e0d545017c8 (127.9.116.65). New cstate: current_term: 2 leader_uuid: "879366e90f5c420588945e0d545017c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:24.734105 16987 ts_tablet_manager.cc:1403] T ea5085716661498e9f3bfdfa2fc5737a P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.130s	user 0.015s	sys 0.002s
I20260709 12:27:24.731227 16988 tablet_bootstrap.cc:492] T 28bdf20fc71548da87c4558dacc503db P 17294485b7f24e2b9fae71dd3169a336: No bootstrap required, opened a new log
I20260709 12:27:24.738785 16988 ts_tablet_manager.cc:1403] T 28bdf20fc71548da87c4558dacc503db P 17294485b7f24e2b9fae71dd3169a336: Time spent bootstrapping tablet: real 0.185s	user 0.008s	sys 0.015s
I20260709 12:27:24.742403 16988 raft_consensus.cc:359] T 28bdf20fc71548da87c4558dacc503db P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:24.746217 16988 raft_consensus.cc:385] T 28bdf20fc71548da87c4558dacc503db P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:24.746544 16988 raft_consensus.cc:740] T 28bdf20fc71548da87c4558dacc503db P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Initialized, Role: FOLLOWER
I20260709 12:27:24.737912 16987 raft_consensus.cc:359] T ea5085716661498e9f3bfdfa2fc5737a P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:24.745194 16792 raft_consensus.cc:2468] T fd1494eb0dd14dab9a2e4c07812117c2 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82f27bcdf252425aad4c4a37d064f68d in term 1.
I20260709 12:27:24.747391 16988 consensus_queue.cc:260] T 28bdf20fc71548da87c4558dacc503db P 17294485b7f24e2b9fae71dd3169a336 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:24.751533 16908 leader_election.cc:304] T fd1494eb0dd14dab9a2e4c07812117c2 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 82f27bcdf252425aad4c4a37d064f68d; no voters: 
I20260709 12:27:24.752166 16988 ts_tablet_manager.cc:1434] T 28bdf20fc71548da87c4558dacc503db P 17294485b7f24e2b9fae71dd3169a336: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.005s
I20260709 12:27:24.752628 16997 raft_consensus.cc:2804] T fd1494eb0dd14dab9a2e4c07812117c2 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:24.753307 16988 tablet_bootstrap.cc:492] T 6e43addba09b4930a12c94e691b2c76f P 17294485b7f24e2b9fae71dd3169a336: Bootstrap starting.
I20260709 12:27:24.753247 16997 raft_consensus.cc:697] T fd1494eb0dd14dab9a2e4c07812117c2 P 82f27bcdf252425aad4c4a37d064f68d [term 1 LEADER]: Becoming Leader. State: Replica: 82f27bcdf252425aad4c4a37d064f68d, State: Running, Role: LEADER
I20260709 12:27:24.754249 16997 consensus_queue.cc:237] T fd1494eb0dd14dab9a2e4c07812117c2 P 82f27bcdf252425aad4c4a37d064f68d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:24.743676 16866 raft_consensus.cc:2468] T fd1494eb0dd14dab9a2e4c07812117c2 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82f27bcdf252425aad4c4a37d064f68d in term 1.
I20260709 12:27:24.760475 16988 tablet_bootstrap.cc:654] T 6e43addba09b4930a12c94e691b2c76f P 17294485b7f24e2b9fae71dd3169a336: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:24.745213 16989 tablet_bootstrap.cc:492] T 00e5268529b241f184c460704ab9ed3c P 82f27bcdf252425aad4c4a37d064f68d: No bootstrap required, opened a new log
I20260709 12:27:24.762063 16989 ts_tablet_manager.cc:1403] T 00e5268529b241f184c460704ab9ed3c P 82f27bcdf252425aad4c4a37d064f68d: Time spent bootstrapping tablet: real 0.051s	user 0.015s	sys 0.000s
I20260709 12:27:24.748159 16991 tablet_bootstrap.cc:492] T ea5085716661498e9f3bfdfa2fc5737a P 3c1aba6ee1d244fd9c0daba722aa0b3b: No bootstrap required, opened a new log
I20260709 12:27:24.749778 16987 raft_consensus.cc:385] T ea5085716661498e9f3bfdfa2fc5737a P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:24.764256 16987 raft_consensus.cc:740] T ea5085716661498e9f3bfdfa2fc5737a P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:24.765053 16987 consensus_queue.cc:260] T ea5085716661498e9f3bfdfa2fc5737a P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:24.767191 16989 raft_consensus.cc:359] T 00e5268529b241f184c460704ab9ed3c P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:24.768040 16989 raft_consensus.cc:385] T 00e5268529b241f184c460704ab9ed3c P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:24.768343 16987 ts_tablet_manager.cc:1434] T ea5085716661498e9f3bfdfa2fc5737a P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.034s	user 0.010s	sys 0.001s
I20260709 12:27:24.769503 16987 tablet_bootstrap.cc:492] T 00e5268529b241f184c460704ab9ed3c P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:24.748433 17069 leader_election.cc:290] T fd1494eb0dd14dab9a2e4c07812117c2 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 election: Requested vote from peers 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
I20260709 12:27:24.763842 16991 ts_tablet_manager.cc:1403] T ea5085716661498e9f3bfdfa2fc5737a P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent bootstrapping tablet: real 0.121s	user 0.023s	sys 0.006s
I20260709 12:27:24.783047 16991 raft_consensus.cc:359] T ea5085716661498e9f3bfdfa2fc5737a P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:24.786443 16991 raft_consensus.cc:385] T ea5085716661498e9f3bfdfa2fc5737a P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:24.786993 16991 raft_consensus.cc:740] T ea5085716661498e9f3bfdfa2fc5737a P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c1aba6ee1d244fd9c0daba722aa0b3b, State: Initialized, Role: FOLLOWER
I20260709 12:27:24.787808 16991 consensus_queue.cc:260] T ea5085716661498e9f3bfdfa2fc5737a P 3c1aba6ee1d244fd9c0daba722aa0b3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:24.768323 16989 raft_consensus.cc:740] T 00e5268529b241f184c460704ab9ed3c P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f27bcdf252425aad4c4a37d064f68d, State: Initialized, Role: FOLLOWER
I20260709 12:27:24.790428 16991 ts_tablet_manager.cc:1434] T ea5085716661498e9f3bfdfa2fc5737a P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:27:24.790246 16989 consensus_queue.cc:260] T 00e5268529b241f184c460704ab9ed3c P 82f27bcdf252425aad4c4a37d064f68d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:24.791525 16991 tablet_bootstrap.cc:492] T 28bdf20fc71548da87c4558dacc503db P 3c1aba6ee1d244fd9c0daba722aa0b3b: Bootstrap starting.
I20260709 12:27:24.796200 16987 tablet_bootstrap.cc:654] T 00e5268529b241f184c460704ab9ed3c P 879366e90f5c420588945e0d545017c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:24.796239 17048 consensus_queue.cc:1048] T 6916ee6a900c46508c98006aa85fe2d9 P 879366e90f5c420588945e0d545017c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:24.797132 17079 raft_consensus.cc:493] T 28bdf20fc71548da87c4558dacc503db P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:24.801052 17079 raft_consensus.cc:515] T 28bdf20fc71548da87c4558dacc503db P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:24.806931 17079 leader_election.cc:290] T 28bdf20fc71548da87c4558dacc503db P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:24.808739 16718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28bdf20fc71548da87c4558dacc503db" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8" is_pre_election: true
I20260709 12:27:24.809518 16718 raft_consensus.cc:2468] T 28bdf20fc71548da87c4558dacc503db P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 0.
I20260709 12:27:24.798966 16989 ts_tablet_manager.cc:1434] T 00e5268529b241f184c460704ab9ed3c P 82f27bcdf252425aad4c4a37d064f68d: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260709 12:27:24.810891 16833 leader_election.cc:304] T 28bdf20fc71548da87c4558dacc503db P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8; no voters: 
I20260709 12:27:24.811712 16989 tablet_bootstrap.cc:492] T 28c655b68dc545948c67e0977b49e770 P 82f27bcdf252425aad4c4a37d064f68d: Bootstrap starting.
I20260709 12:27:24.812137 16793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28bdf20fc71548da87c4558dacc503db" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
W20260709 12:27:24.813519 16834 leader_election.cc:343] T 28bdf20fc71548da87c4558dacc503db P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:24.811774 17079 raft_consensus.cc:2804] T 28bdf20fc71548da87c4558dacc503db P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:24.814826 17079 raft_consensus.cc:493] T 28bdf20fc71548da87c4558dacc503db P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:24.815223 17079 raft_consensus.cc:3060] T 28bdf20fc71548da87c4558dacc503db P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:24.816582 16614 catalog_manager.cc:5697] T fd1494eb0dd14dab9a2e4c07812117c2 P 82f27bcdf252425aad4c4a37d064f68d reported cstate change: term changed from 0 to 1, leader changed from <none> to 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68). New cstate: current_term: 1 leader_uuid: "82f27bcdf252425aad4c4a37d064f68d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:24.825448 16991 tablet_bootstrap.cc:654] T 28bdf20fc71548da87c4558dacc503db P 3c1aba6ee1d244fd9c0daba722aa0b3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:24.818778 16989 tablet_bootstrap.cc:654] T 28c655b68dc545948c67e0977b49e770 P 82f27bcdf252425aad4c4a37d064f68d: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:24.831460 17079 raft_consensus.cc:515] T 28bdf20fc71548da87c4558dacc503db P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:24.836040 16718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28bdf20fc71548da87c4558dacc503db" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8"
I20260709 12:27:24.836871 16718 raft_consensus.cc:3060] T 28bdf20fc71548da87c4558dacc503db P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:24.841722 17048 consensus_queue.cc:1048] T 6916ee6a900c46508c98006aa85fe2d9 P 879366e90f5c420588945e0d545017c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:24.852208 16991 tablet_bootstrap.cc:492] T 28bdf20fc71548da87c4558dacc503db P 3c1aba6ee1d244fd9c0daba722aa0b3b: No bootstrap required, opened a new log
I20260709 12:27:24.859396 16987 tablet_bootstrap.cc:492] T 00e5268529b241f184c460704ab9ed3c P 879366e90f5c420588945e0d545017c8: No bootstrap required, opened a new log
I20260709 12:27:24.860198 16987 ts_tablet_manager.cc:1403] T 00e5268529b241f184c460704ab9ed3c P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.091s	user 0.008s	sys 0.007s
I20260709 12:27:24.861582 16792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28bdf20fc71548da87c4558dacc503db" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b"
I20260709 12:27:24.853022 16991 ts_tablet_manager.cc:1403] T 28bdf20fc71548da87c4558dacc503db P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent bootstrapping tablet: real 0.062s	user 0.013s	sys 0.003s
W20260709 12:27:24.867057 16834 leader_election.cc:343] T 28bdf20fc71548da87c4558dacc503db P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:24.868438 16718 raft_consensus.cc:2468] T 28bdf20fc71548da87c4558dacc503db P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 1.
I20260709 12:27:24.868626 16991 raft_consensus.cc:359] T 28bdf20fc71548da87c4558dacc503db P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:24.869395 16991 raft_consensus.cc:385] T 28bdf20fc71548da87c4558dacc503db P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:24.869724 16991 raft_consensus.cc:740] T 28bdf20fc71548da87c4558dacc503db P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c1aba6ee1d244fd9c0daba722aa0b3b, State: Initialized, Role: FOLLOWER
I20260709 12:27:24.869930 16833 leader_election.cc:304] T 28bdf20fc71548da87c4558dacc503db P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b
I20260709 12:27:24.870523 16991 consensus_queue.cc:260] T 28bdf20fc71548da87c4558dacc503db P 3c1aba6ee1d244fd9c0daba722aa0b3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:24.870972 16995 raft_consensus.cc:2804] T 28bdf20fc71548da87c4558dacc503db P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:24.872686 16991 ts_tablet_manager.cc:1434] T 28bdf20fc71548da87c4558dacc503db P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:27:24.874322 16991 tablet_bootstrap.cc:492] T 6e43addba09b4930a12c94e691b2c76f P 3c1aba6ee1d244fd9c0daba722aa0b3b: Bootstrap starting.
I20260709 12:27:24.871016 16988 tablet_bootstrap.cc:492] T 6e43addba09b4930a12c94e691b2c76f P 17294485b7f24e2b9fae71dd3169a336: No bootstrap required, opened a new log
I20260709 12:27:24.878505 16988 ts_tablet_manager.cc:1403] T 6e43addba09b4930a12c94e691b2c76f P 17294485b7f24e2b9fae71dd3169a336: Time spent bootstrapping tablet: real 0.125s	user 0.037s	sys 0.068s
I20260709 12:27:24.852412 17079 leader_election.cc:290] T 28bdf20fc71548da87c4558dacc503db P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 election: Requested vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:24.880650 16995 raft_consensus.cc:697] T 28bdf20fc71548da87c4558dacc503db P 17294485b7f24e2b9fae71dd3169a336 [term 1 LEADER]: Becoming Leader. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Running, Role: LEADER
I20260709 12:27:24.887161 16997 raft_consensus.cc:493] T 00e5268529b241f184c460704ab9ed3c P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:24.887806 16997 raft_consensus.cc:515] T 00e5268529b241f184c460704ab9ed3c P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:24.888957 16989 tablet_bootstrap.cc:492] T 28c655b68dc545948c67e0977b49e770 P 82f27bcdf252425aad4c4a37d064f68d: No bootstrap required, opened a new log
I20260709 12:27:24.889449 16989 ts_tablet_manager.cc:1403] T 28c655b68dc545948c67e0977b49e770 P 82f27bcdf252425aad4c4a37d064f68d: Time spent bootstrapping tablet: real 0.078s	user 0.012s	sys 0.011s
I20260709 12:27:24.884457 16987 raft_consensus.cc:359] T 00e5268529b241f184c460704ab9ed3c P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:24.890020 16987 raft_consensus.cc:385] T 00e5268529b241f184c460704ab9ed3c P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:24.890357 16987 raft_consensus.cc:740] T 00e5268529b241f184c460704ab9ed3c P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:24.891296 16995 consensus_queue.cc:237] T 28bdf20fc71548da87c4558dacc503db P 17294485b7f24e2b9fae71dd3169a336 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:24.892376 17069 raft_consensus.cc:493] T ea5085716661498e9f3bfdfa2fc5737a P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:24.891309 16997 leader_election.cc:290] T 00e5268529b241f184c460704ab9ed3c P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:24.892962 17069 raft_consensus.cc:515] T ea5085716661498e9f3bfdfa2fc5737a P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:24.893566 16718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5268529b241f184c460704ab9ed3c" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8" is_pre_election: true
I20260709 12:27:24.895164 17069 leader_election.cc:290] T ea5085716661498e9f3bfdfa2fc5737a P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:24.892421 16792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5268529b241f184c460704ab9ed3c" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
I20260709 12:27:24.897173 16987 consensus_queue.cc:260] T 00e5268529b241f184c460704ab9ed3c P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:24.901149 16719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5085716661498e9f3bfdfa2fc5737a" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8" is_pre_election: true
I20260709 12:27:24.902945 16719 raft_consensus.cc:2468] T ea5085716661498e9f3bfdfa2fc5737a P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82f27bcdf252425aad4c4a37d064f68d in term 0.
I20260709 12:27:24.899433 16794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5085716661498e9f3bfdfa2fc5737a" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
I20260709 12:27:24.904143 16794 raft_consensus.cc:2468] T ea5085716661498e9f3bfdfa2fc5737a P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82f27bcdf252425aad4c4a37d064f68d in term 0.
I20260709 12:27:24.904834 16989 raft_consensus.cc:359] T 28c655b68dc545948c67e0977b49e770 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
W20260709 12:27:24.901063 16908 leader_election.cc:343] T 00e5268529b241f184c460704ab9ed3c P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:24.905700 16988 raft_consensus.cc:359] T 6e43addba09b4930a12c94e691b2c76f P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:24.901937 16866 raft_consensus.cc:1275] T 27dda31a8cd1468eb3a824ae026485a3 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Refusing update from remote peer 879366e90f5c420588945e0d545017c8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:27:24.909299 17037 consensus_queue.cc:1048] T 27dda31a8cd1468eb3a824ae026485a3 P 879366e90f5c420588945e0d545017c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:24.910321 16987 ts_tablet_manager.cc:1434] T 00e5268529b241f184c460704ab9ed3c P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.050s	user 0.005s	sys 0.002s
I20260709 12:27:24.906281 16908 leader_election.cc:304] T ea5085716661498e9f3bfdfa2fc5737a P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 82f27bcdf252425aad4c4a37d064f68d; no voters: 
I20260709 12:27:24.911492 17069 raft_consensus.cc:2804] T ea5085716661498e9f3bfdfa2fc5737a P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:24.911926 17069 raft_consensus.cc:493] T ea5085716661498e9f3bfdfa2fc5737a P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:24.912325 17069 raft_consensus.cc:3060] T ea5085716661498e9f3bfdfa2fc5737a P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:24.914942 16617 catalog_manager.cc:5697] T 28bdf20fc71548da87c4558dacc503db P 17294485b7f24e2b9fae71dd3169a336 reported cstate change: term changed from 0 to 1, leader changed from <none> to 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67). New cstate: current_term: 1 leader_uuid: "17294485b7f24e2b9fae71dd3169a336" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:24.916625 16987 tablet_bootstrap.cc:492] T 27f104a1ba60493ab47f6b876da48d67 P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:24.920023 16718 raft_consensus.cc:2468] T 00e5268529b241f184c460704ab9ed3c P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82f27bcdf252425aad4c4a37d064f68d in term 0.
I20260709 12:27:24.898479 16991 tablet_bootstrap.cc:654] T 6e43addba09b4930a12c94e691b2c76f P 3c1aba6ee1d244fd9c0daba722aa0b3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:24.905517 16989 raft_consensus.cc:385] T 28c655b68dc545948c67e0977b49e770 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:24.928071 16989 raft_consensus.cc:740] T 28c655b68dc545948c67e0977b49e770 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f27bcdf252425aad4c4a37d064f68d, State: Initialized, Role: FOLLOWER
I20260709 12:27:24.929055 16989 consensus_queue.cc:260] T 28c655b68dc545948c67e0977b49e770 P 82f27bcdf252425aad4c4a37d064f68d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:24.906375 16988 raft_consensus.cc:385] T 6e43addba09b4930a12c94e691b2c76f P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:24.930295 16988 raft_consensus.cc:740] T 6e43addba09b4930a12c94e691b2c76f P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Initialized, Role: FOLLOWER
I20260709 12:27:24.931288 16988 consensus_queue.cc:260] T 6e43addba09b4930a12c94e691b2c76f P 17294485b7f24e2b9fae71dd3169a336 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:24.932197 17069 raft_consensus.cc:515] T ea5085716661498e9f3bfdfa2fc5737a P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:24.933478 16988 ts_tablet_manager.cc:1434] T 6e43addba09b4930a12c94e691b2c76f P 17294485b7f24e2b9fae71dd3169a336: Time spent starting tablet: real 0.055s	user 0.006s	sys 0.001s
I20260709 12:27:24.938550 17005 raft_consensus.cc:493] T 28bdf20fc71548da87c4558dacc503db P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:24.939391 17005 raft_consensus.cc:515] T 28bdf20fc71548da87c4558dacc503db P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:24.945394 16794 raft_consensus.cc:3060] T cd637126e0044d7996f18e258282a145 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:24.951144 16866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28bdf20fc71548da87c4558dacc503db" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:24.953352 16995 consensus_queue.cc:1048] T 98a96f910b4449f7ba9c875e45090080 P 17294485b7f24e2b9fae71dd3169a336 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:24.955459 16718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28bdf20fc71548da87c4558dacc503db" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8" is_pre_election: true
I20260709 12:27:24.956519 16718 raft_consensus.cc:2393] T 28bdf20fc71548da87c4558dacc503db P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in current term 1: Already voted for candidate 17294485b7f24e2b9fae71dd3169a336 in this term.
I20260709 12:27:24.958943 16759 leader_election.cc:304] T 28bdf20fc71548da87c4558dacc503db P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b; no voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8
I20260709 12:27:24.961985 16989 ts_tablet_manager.cc:1434] T 28c655b68dc545948c67e0977b49e770 P 82f27bcdf252425aad4c4a37d064f68d: Time spent starting tablet: real 0.072s	user 0.007s	sys 0.001s
I20260709 12:27:24.962200 17016 raft_consensus.cc:3060] T 28bdf20fc71548da87c4558dacc503db P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:24.963279 16989 tablet_bootstrap.cc:492] T 6e43addba09b4930a12c94e691b2c76f P 82f27bcdf252425aad4c4a37d064f68d: Bootstrap starting.
I20260709 12:27:24.966248 16792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5085716661498e9f3bfdfa2fc5737a" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b"
I20260709 12:27:24.968173 16792 raft_consensus.cc:3060] T ea5085716661498e9f3bfdfa2fc5737a P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:24.971515 16907 leader_election.cc:304] T 00e5268529b241f184c460704ab9ed3c P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d, 879366e90f5c420588945e0d545017c8; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b
I20260709 12:27:24.973309 16997 raft_consensus.cc:2804] T 00e5268529b241f184c460704ab9ed3c P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:24.973800 16997 raft_consensus.cc:493] T 00e5268529b241f184c460704ab9ed3c P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:24.974179 16997 raft_consensus.cc:3060] T 00e5268529b241f184c460704ab9ed3c P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:24.975941 17005 leader_election.cc:290] T 28bdf20fc71548da87c4558dacc503db P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
I20260709 12:27:24.966789 17069 leader_election.cc:290] T ea5085716661498e9f3bfdfa2fc5737a P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 election: Requested vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:24.987901 16989 tablet_bootstrap.cc:654] T 6e43addba09b4930a12c94e691b2c76f P 82f27bcdf252425aad4c4a37d064f68d: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:24.993021 16718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5085716661498e9f3bfdfa2fc5737a" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8"
I20260709 12:27:24.993779 16718 raft_consensus.cc:3060] T ea5085716661498e9f3bfdfa2fc5737a P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:25.001523 16942 raft_consensus.cc:1275] T 27dda31a8cd1468eb3a824ae026485a3 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Refusing update from remote peer 879366e90f5c420588945e0d545017c8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:27:25.003697 16792 raft_consensus.cc:2468] T ea5085716661498e9f3bfdfa2fc5737a P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82f27bcdf252425aad4c4a37d064f68d in term 1.
I20260709 12:27:25.005640 16908 leader_election.cc:304] T ea5085716661498e9f3bfdfa2fc5737a P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 82f27bcdf252425aad4c4a37d064f68d; no voters: 
I20260709 12:27:25.006620 17069 raft_consensus.cc:2804] T ea5085716661498e9f3bfdfa2fc5737a P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:25.007308 17069 raft_consensus.cc:697] T ea5085716661498e9f3bfdfa2fc5737a P 82f27bcdf252425aad4c4a37d064f68d [term 1 LEADER]: Becoming Leader. State: Replica: 82f27bcdf252425aad4c4a37d064f68d, State: Running, Role: LEADER
I20260709 12:27:25.009197 17069 consensus_queue.cc:237] T ea5085716661498e9f3bfdfa2fc5737a P 82f27bcdf252425aad4c4a37d064f68d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:25.013170 17016 raft_consensus.cc:2749] T 28bdf20fc71548da87c4558dacc503db P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:25.024677 16987 tablet_bootstrap.cc:654] T 27f104a1ba60493ab47f6b876da48d67 P 879366e90f5c420588945e0d545017c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:25.014499 16988 tablet_bootstrap.cc:492] T e628dacc30694988a7c795441df15600 P 17294485b7f24e2b9fae71dd3169a336: Bootstrap starting.
I20260709 12:27:25.026021 17076 consensus_queue.cc:1048] T cd637126e0044d7996f18e258282a145 P 879366e90f5c420588945e0d545017c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:27:25.040959 17075 raft_consensus.cc:493] T 27f104a1ba60493ab47f6b876da48d67 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:25.041608 17075 raft_consensus.cc:515] T 27f104a1ba60493ab47f6b876da48d67 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:25.020417 16718 raft_consensus.cc:2468] T ea5085716661498e9f3bfdfa2fc5737a P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82f27bcdf252425aad4c4a37d064f68d in term 1.
I20260709 12:27:25.049700 16866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f104a1ba60493ab47f6b876da48d67" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:25.050122 17075 leader_election.cc:290] T 27f104a1ba60493ab47f6b876da48d67 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
W20260709 12:27:25.051892 16907 leader_election.cc:343] T 27f104a1ba60493ab47f6b876da48d67 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:25.050127 16988 tablet_bootstrap.cc:654] T e628dacc30694988a7c795441df15600 P 17294485b7f24e2b9fae71dd3169a336: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:25.055995 17089 consensus_queue.cc:1048] T 27dda31a8cd1468eb3a824ae026485a3 P 879366e90f5c420588945e0d545017c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:25.067318 16997 raft_consensus.cc:515] T 00e5268529b241f184c460704ab9ed3c P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:25.069223 16995 consensus_queue.cc:1048] T 98a96f910b4449f7ba9c875e45090080 P 17294485b7f24e2b9fae71dd3169a336 [LEADER]: Connected to new peer: Peer: permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:25.071502 16719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5268529b241f184c460704ab9ed3c" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8"
I20260709 12:27:25.073398 16719 raft_consensus.cc:3060] T 00e5268529b241f184c460704ab9ed3c P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:25.071761 17037 consensus_queue.cc:1048] T cd637126e0044d7996f18e258282a145 P 879366e90f5c420588945e0d545017c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:27:25.077335 16991 tablet_bootstrap.cc:492] T 6e43addba09b4930a12c94e691b2c76f P 3c1aba6ee1d244fd9c0daba722aa0b3b: No bootstrap required, opened a new log
I20260709 12:27:25.078212 16991 ts_tablet_manager.cc:1403] T 6e43addba09b4930a12c94e691b2c76f P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent bootstrapping tablet: real 0.204s	user 0.061s	sys 0.064s
I20260709 12:27:25.079886 16792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5268529b241f184c460704ab9ed3c" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b"
I20260709 12:27:25.071542 16997 leader_election.cc:290] T 00e5268529b241f184c460704ab9ed3c P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 election: Requested vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
W20260709 12:27:25.084970 16908 leader_election.cc:343] T 00e5268529b241f184c460704ab9ed3c P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:25.094322 16988 tablet_bootstrap.cc:492] T e628dacc30694988a7c795441df15600 P 17294485b7f24e2b9fae71dd3169a336: No bootstrap required, opened a new log
I20260709 12:27:25.090466 16991 raft_consensus.cc:359] T 6e43addba09b4930a12c94e691b2c76f P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:25.096637 16991 raft_consensus.cc:385] T 6e43addba09b4930a12c94e691b2c76f P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:25.097069 16991 raft_consensus.cc:740] T 6e43addba09b4930a12c94e691b2c76f P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c1aba6ee1d244fd9c0daba722aa0b3b, State: Initialized, Role: FOLLOWER
I20260709 12:27:25.088207 16718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f104a1ba60493ab47f6b876da48d67" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8" is_pre_election: true
I20260709 12:27:25.097879 16991 consensus_queue.cc:260] T 6e43addba09b4930a12c94e691b2c76f P 3c1aba6ee1d244fd9c0daba722aa0b3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:25.099080 16988 ts_tablet_manager.cc:1403] T e628dacc30694988a7c795441df15600 P 17294485b7f24e2b9fae71dd3169a336: Time spent bootstrapping tablet: real 0.163s	user 0.016s	sys 0.004s
W20260709 12:27:25.106662 16907 leader_election.cc:343] T 27f104a1ba60493ab47f6b876da48d67 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:25.107473 16907 leader_election.cc:304] T 27f104a1ba60493ab47f6b876da48d67 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8
I20260709 12:27:25.108999 17075 raft_consensus.cc:2749] T 27f104a1ba60493ab47f6b876da48d67 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:25.110706 16991 ts_tablet_manager.cc:1434] T 6e43addba09b4930a12c94e691b2c76f P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent starting tablet: real 0.032s	user 0.011s	sys 0.000s
I20260709 12:27:25.112872 16991 tablet_bootstrap.cc:492] T 00e5268529b241f184c460704ab9ed3c P 3c1aba6ee1d244fd9c0daba722aa0b3b: Bootstrap starting.
I20260709 12:27:25.117646 16987 tablet_bootstrap.cc:492] T 27f104a1ba60493ab47f6b876da48d67 P 879366e90f5c420588945e0d545017c8: No bootstrap required, opened a new log
I20260709 12:27:25.121232 16989 tablet_bootstrap.cc:492] T 6e43addba09b4930a12c94e691b2c76f P 82f27bcdf252425aad4c4a37d064f68d: No bootstrap required, opened a new log
I20260709 12:27:25.121680 16987 ts_tablet_manager.cc:1403] T 27f104a1ba60493ab47f6b876da48d67 P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.210s	user 0.024s	sys 0.003s
I20260709 12:27:25.121837 16989 ts_tablet_manager.cc:1403] T 6e43addba09b4930a12c94e691b2c76f P 82f27bcdf252425aad4c4a37d064f68d: Time spent bootstrapping tablet: real 0.159s	user 0.021s	sys 0.033s
I20260709 12:27:25.134626 16988 raft_consensus.cc:359] T e628dacc30694988a7c795441df15600 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:25.135528 16988 raft_consensus.cc:385] T e628dacc30694988a7c795441df15600 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:25.135834 16988 raft_consensus.cc:740] T e628dacc30694988a7c795441df15600 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Initialized, Role: FOLLOWER
I20260709 12:27:25.137037 16997 raft_consensus.cc:493] T 28c655b68dc545948c67e0977b49e770 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:25.137603 16997 raft_consensus.cc:515] T 28c655b68dc545948c67e0977b49e770 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:25.140530 16997 leader_election.cc:290] T 28c655b68dc545948c67e0977b49e770 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:25.142570 16717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c655b68dc545948c67e0977b49e770" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8" is_pre_election: true
I20260709 12:27:25.143687 17016 raft_consensus.cc:493] T 6e43addba09b4930a12c94e691b2c76f P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:25.144342 17016 raft_consensus.cc:515] T 6e43addba09b4930a12c94e691b2c76f P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
W20260709 12:27:25.144860 16907 leader_election.cc:343] T 28c655b68dc545948c67e0977b49e770 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:25.161981 16991 tablet_bootstrap.cc:654] T 00e5268529b241f184c460704ab9ed3c P 3c1aba6ee1d244fd9c0daba722aa0b3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:25.146384 16866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c655b68dc545948c67e0977b49e770" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:25.154384 16989 raft_consensus.cc:359] T 6e43addba09b4930a12c94e691b2c76f P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:25.159518 16987 raft_consensus.cc:359] T 27f104a1ba60493ab47f6b876da48d67 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:25.163491 16987 raft_consensus.cc:385] T 27f104a1ba60493ab47f6b876da48d67 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:25.164103 16987 raft_consensus.cc:740] T 27f104a1ba60493ab47f6b876da48d67 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:25.147220 16988 consensus_queue.cc:260] T e628dacc30694988a7c795441df15600 P 17294485b7f24e2b9fae71dd3169a336 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:25.151235 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e43addba09b4930a12c94e691b2c76f" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:25.163373 16989 raft_consensus.cc:385] T 6e43addba09b4930a12c94e691b2c76f P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:25.165709 16987 consensus_queue.cc:260] T 27f104a1ba60493ab47f6b876da48d67 P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:25.149186 16867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e43addba09b4930a12c94e691b2c76f" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:25.142985 16616 catalog_manager.cc:5697] T ea5085716661498e9f3bfdfa2fc5737a P 82f27bcdf252425aad4c4a37d064f68d reported cstate change: term changed from 0 to 1, leader changed from <none> to 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68). New cstate: current_term: 1 leader_uuid: "82f27bcdf252425aad4c4a37d064f68d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:25.166616 16989 raft_consensus.cc:740] T 6e43addba09b4930a12c94e691b2c76f P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f27bcdf252425aad4c4a37d064f68d, State: Initialized, Role: FOLLOWER
I20260709 12:27:25.147234 17016 leader_election.cc:290] T 6e43addba09b4930a12c94e691b2c76f P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919)
I20260709 12:27:25.149571 16719 raft_consensus.cc:2468] T 00e5268529b241f184c460704ab9ed3c P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82f27bcdf252425aad4c4a37d064f68d in term 1.
I20260709 12:27:25.169446 16987 ts_tablet_manager.cc:1434] T 27f104a1ba60493ab47f6b876da48d67 P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.047s	user 0.010s	sys 0.000s
I20260709 12:27:25.168157 16988 ts_tablet_manager.cc:1434] T e628dacc30694988a7c795441df15600 P 17294485b7f24e2b9fae71dd3169a336: Time spent starting tablet: real 0.067s	user 0.008s	sys 0.006s
I20260709 12:27:25.170923 16987 tablet_bootstrap.cc:492] T e628dacc30694988a7c795441df15600 P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:25.167533 16867 raft_consensus.cc:2468] T 6e43addba09b4930a12c94e691b2c76f P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in term 0.
I20260709 12:27:25.173619 16988 tablet_bootstrap.cc:492] T 27f104a1ba60493ab47f6b876da48d67 P 17294485b7f24e2b9fae71dd3169a336: Bootstrap starting.
I20260709 12:27:25.174978 16759 leader_election.cc:304] T 6e43addba09b4930a12c94e691b2c76f P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 3c1aba6ee1d244fd9c0daba722aa0b3b; no voters: 
W20260709 12:27:25.177034 16907 leader_election.cc:343] T 28c655b68dc545948c67e0977b49e770 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:25.177665 16907 leader_election.cc:304] T 28c655b68dc545948c67e0977b49e770 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8
I20260709 12:27:25.177924 17016 raft_consensus.cc:2804] T 6e43addba09b4930a12c94e691b2c76f P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:25.178429 17016 raft_consensus.cc:493] T 6e43addba09b4930a12c94e691b2c76f P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:25.178778 17016 raft_consensus.cc:3060] T 6e43addba09b4930a12c94e691b2c76f P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:25.169842 16989 consensus_queue.cc:260] T 6e43addba09b4930a12c94e691b2c76f P 82f27bcdf252425aad4c4a37d064f68d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:25.180646 16942 raft_consensus.cc:2468] T 6e43addba09b4930a12c94e691b2c76f P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in term 0.
I20260709 12:27:25.179433 16997 raft_consensus.cc:2749] T 28c655b68dc545948c67e0977b49e770 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:25.186659 16997 consensus_queue.cc:1048] T fd1494eb0dd14dab9a2e4c07812117c2 P 82f27bcdf252425aad4c4a37d064f68d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:27:25.194905 16989 ts_tablet_manager.cc:1434] T 6e43addba09b4930a12c94e691b2c76f P 82f27bcdf252425aad4c4a37d064f68d: Time spent starting tablet: real 0.073s	user 0.011s	sys 0.000s
I20260709 12:27:25.196146 16989 tablet_bootstrap.cc:492] T de72d440fa1641a39aee027ffc0588a3 P 82f27bcdf252425aad4c4a37d064f68d: Bootstrap starting.
I20260709 12:27:25.213430 16907 leader_election.cc:304] T 00e5268529b241f184c460704ab9ed3c P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d, 879366e90f5c420588945e0d545017c8; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b
I20260709 12:27:25.216862 16997 raft_consensus.cc:2804] T 00e5268529b241f184c460704ab9ed3c P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:25.217442 16997 raft_consensus.cc:697] T 00e5268529b241f184c460704ab9ed3c P 82f27bcdf252425aad4c4a37d064f68d [term 1 LEADER]: Becoming Leader. State: Replica: 82f27bcdf252425aad4c4a37d064f68d, State: Running, Role: LEADER
I20260709 12:27:25.218838 16997 consensus_queue.cc:237] T 00e5268529b241f184c460704ab9ed3c P 82f27bcdf252425aad4c4a37d064f68d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:25.257098 16988 tablet_bootstrap.cc:654] T 27f104a1ba60493ab47f6b876da48d67 P 17294485b7f24e2b9fae71dd3169a336: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:25.258211 17075 consensus_queue.cc:1048] T fd1494eb0dd14dab9a2e4c07812117c2 P 82f27bcdf252425aad4c4a37d064f68d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:25.269944 16989 tablet_bootstrap.cc:654] T de72d440fa1641a39aee027ffc0588a3 P 82f27bcdf252425aad4c4a37d064f68d: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:25.286048 16991 tablet_bootstrap.cc:492] T 00e5268529b241f184c460704ab9ed3c P 3c1aba6ee1d244fd9c0daba722aa0b3b: No bootstrap required, opened a new log
I20260709 12:27:25.286743 16991 ts_tablet_manager.cc:1403] T 00e5268529b241f184c460704ab9ed3c P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent bootstrapping tablet: real 0.174s	user 0.034s	sys 0.048s
I20260709 12:27:25.289559 16987 tablet_bootstrap.cc:654] T e628dacc30694988a7c795441df15600 P 879366e90f5c420588945e0d545017c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:25.290735 16991 raft_consensus.cc:359] T 00e5268529b241f184c460704ab9ed3c P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:25.297096 16991 raft_consensus.cc:385] T 00e5268529b241f184c460704ab9ed3c P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:25.297477 16991 raft_consensus.cc:740] T 00e5268529b241f184c460704ab9ed3c P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c1aba6ee1d244fd9c0daba722aa0b3b, State: Initialized, Role: FOLLOWER
I20260709 12:27:25.298239 16991 consensus_queue.cc:260] T 00e5268529b241f184c460704ab9ed3c P 3c1aba6ee1d244fd9c0daba722aa0b3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:25.300571 16991 ts_tablet_manager.cc:1434] T 00e5268529b241f184c460704ab9ed3c P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:27:25.301555 16991 tablet_bootstrap.cc:492] T e628dacc30694988a7c795441df15600 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Bootstrap starting.
I20260709 12:27:25.301647 16988 tablet_bootstrap.cc:492] T 27f104a1ba60493ab47f6b876da48d67 P 17294485b7f24e2b9fae71dd3169a336: No bootstrap required, opened a new log
I20260709 12:27:25.303175 16988 ts_tablet_manager.cc:1403] T 27f104a1ba60493ab47f6b876da48d67 P 17294485b7f24e2b9fae71dd3169a336: Time spent bootstrapping tablet: real 0.130s	user 0.012s	sys 0.002s
I20260709 12:27:25.306442 16988 raft_consensus.cc:359] T 27f104a1ba60493ab47f6b876da48d67 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:25.307343 16988 raft_consensus.cc:385] T 27f104a1ba60493ab47f6b876da48d67 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:25.307703 16988 raft_consensus.cc:740] T 27f104a1ba60493ab47f6b876da48d67 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Initialized, Role: FOLLOWER
I20260709 12:27:25.308648 16988 consensus_queue.cc:260] T 27f104a1ba60493ab47f6b876da48d67 P 17294485b7f24e2b9fae71dd3169a336 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:25.292517 17016 raft_consensus.cc:515] T 6e43addba09b4930a12c94e691b2c76f P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:25.315192 16989 tablet_bootstrap.cc:492] T de72d440fa1641a39aee027ffc0588a3 P 82f27bcdf252425aad4c4a37d064f68d: No bootstrap required, opened a new log
I20260709 12:27:25.316233 16868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e43addba09b4930a12c94e691b2c76f" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336"
I20260709 12:27:25.316680 17016 leader_election.cc:290] T 6e43addba09b4930a12c94e691b2c76f P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 election: Requested vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919)
I20260709 12:27:25.317088 16868 raft_consensus.cc:3060] T 6e43addba09b4930a12c94e691b2c76f P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:25.312839 16988 ts_tablet_manager.cc:1434] T 27f104a1ba60493ab47f6b876da48d67 P 17294485b7f24e2b9fae71dd3169a336: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:27:25.319214 16988 tablet_bootstrap.cc:492] T 28c655b68dc545948c67e0977b49e770 P 17294485b7f24e2b9fae71dd3169a336: Bootstrap starting.
I20260709 12:27:25.315212 16991 tablet_bootstrap.cc:654] T e628dacc30694988a7c795441df15600 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:25.319962 16987 tablet_bootstrap.cc:492] T e628dacc30694988a7c795441df15600 P 879366e90f5c420588945e0d545017c8: No bootstrap required, opened a new log
I20260709 12:27:25.320794 16987 ts_tablet_manager.cc:1403] T e628dacc30694988a7c795441df15600 P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.150s	user 0.017s	sys 0.006s
I20260709 12:27:25.324280 16987 raft_consensus.cc:359] T e628dacc30694988a7c795441df15600 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:25.325285 16987 raft_consensus.cc:385] T e628dacc30694988a7c795441df15600 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:25.324638 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e43addba09b4930a12c94e691b2c76f" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d"
I20260709 12:27:25.325959 16941 raft_consensus.cc:3060] T 6e43addba09b4930a12c94e691b2c76f P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:25.330910 16988 tablet_bootstrap.cc:654] T 28c655b68dc545948c67e0977b49e770 P 17294485b7f24e2b9fae71dd3169a336: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:25.316128 16989 ts_tablet_manager.cc:1403] T de72d440fa1641a39aee027ffc0588a3 P 82f27bcdf252425aad4c4a37d064f68d: Time spent bootstrapping tablet: real 0.120s	user 0.014s	sys 0.024s
I20260709 12:27:25.335464 16989 raft_consensus.cc:359] T de72d440fa1641a39aee027ffc0588a3 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:25.339716 16989 raft_consensus.cc:385] T de72d440fa1641a39aee027ffc0588a3 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:25.339870 16987 raft_consensus.cc:740] T e628dacc30694988a7c795441df15600 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:25.341884 16987 consensus_queue.cc:260] T e628dacc30694988a7c795441df15600 P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:25.340118 16989 raft_consensus.cc:740] T de72d440fa1641a39aee027ffc0588a3 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f27bcdf252425aad4c4a37d064f68d, State: Initialized, Role: FOLLOWER
I20260709 12:27:25.344405 16989 consensus_queue.cc:260] T de72d440fa1641a39aee027ffc0588a3 P 82f27bcdf252425aad4c4a37d064f68d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:25.351429 16989 ts_tablet_manager.cc:1434] T de72d440fa1641a39aee027ffc0588a3 P 82f27bcdf252425aad4c4a37d064f68d: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 12:27:25.354629 16989 tablet_bootstrap.cc:492] T b10d5b4017584d0fb22f9e542d95fcb1 P 82f27bcdf252425aad4c4a37d064f68d: Bootstrap starting.
I20260709 12:27:25.348518 16987 ts_tablet_manager.cc:1434] T e628dacc30694988a7c795441df15600 P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.005s
I20260709 12:27:25.355286 16988 tablet_bootstrap.cc:492] T 28c655b68dc545948c67e0977b49e770 P 17294485b7f24e2b9fae71dd3169a336: No bootstrap required, opened a new log
I20260709 12:27:25.365021 16988 ts_tablet_manager.cc:1403] T 28c655b68dc545948c67e0977b49e770 P 17294485b7f24e2b9fae71dd3169a336: Time spent bootstrapping tablet: real 0.046s	user 0.011s	sys 0.009s
I20260709 12:27:25.365288 16868 raft_consensus.cc:2468] T 6e43addba09b4930a12c94e691b2c76f P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in term 1.
I20260709 12:27:25.365971 17037 raft_consensus.cc:493] T 27f104a1ba60493ab47f6b876da48d67 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:25.366256 16987 tablet_bootstrap.cc:492] T 28c655b68dc545948c67e0977b49e770 P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:25.366564 17037 raft_consensus.cc:515] T 27f104a1ba60493ab47f6b876da48d67 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:25.368822 17037 leader_election.cc:290] T 27f104a1ba60493ab47f6b876da48d67 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919)
I20260709 12:27:25.369076 16988 raft_consensus.cc:359] T 28c655b68dc545948c67e0977b49e770 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:25.369853 16988 raft_consensus.cc:385] T 28c655b68dc545948c67e0977b49e770 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:25.370155 16988 raft_consensus.cc:740] T 28c655b68dc545948c67e0977b49e770 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Initialized, Role: FOLLOWER
I20260709 12:27:25.371006 16988 consensus_queue.cc:260] T 28c655b68dc545948c67e0977b49e770 P 17294485b7f24e2b9fae71dd3169a336 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:25.355199 16941 raft_consensus.cc:2468] T 6e43addba09b4930a12c94e691b2c76f P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in term 1.
I20260709 12:27:25.372587 16759 leader_election.cc:304] T 6e43addba09b4930a12c94e691b2c76f P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 3c1aba6ee1d244fd9c0daba722aa0b3b; no voters: 
W20260709 12:27:25.373912 16665 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:27:25.375130 16988 ts_tablet_manager.cc:1434] T 28c655b68dc545948c67e0977b49e770 P 17294485b7f24e2b9fae71dd3169a336: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:27:25.371637 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f104a1ba60493ab47f6b876da48d67" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:25.374253 16987 tablet_bootstrap.cc:654] T 28c655b68dc545948c67e0977b49e770 P 879366e90f5c420588945e0d545017c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:25.375730 16942 raft_consensus.cc:2468] T 27f104a1ba60493ab47f6b876da48d67 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 0.
I20260709 12:27:25.374236 17016 raft_consensus.cc:2804] T 6e43addba09b4930a12c94e691b2c76f P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:25.377238 17016 raft_consensus.cc:697] T 6e43addba09b4930a12c94e691b2c76f P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 LEADER]: Becoming Leader. State: Replica: 3c1aba6ee1d244fd9c0daba722aa0b3b, State: Running, Role: LEADER
I20260709 12:27:25.378173 17016 consensus_queue.cc:237] T 6e43addba09b4930a12c94e691b2c76f P 3c1aba6ee1d244fd9c0daba722aa0b3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:25.379922 16988 tablet_bootstrap.cc:492] T c5baa0b4140847958c6528b3dbda7617 P 17294485b7f24e2b9fae71dd3169a336: Bootstrap starting.
I20260709 12:27:25.380282 16684 leader_election.cc:304] T 27f104a1ba60493ab47f6b876da48d67 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d, 879366e90f5c420588945e0d545017c8; no voters: 
I20260709 12:27:25.381075 16991 tablet_bootstrap.cc:492] T e628dacc30694988a7c795441df15600 P 3c1aba6ee1d244fd9c0daba722aa0b3b: No bootstrap required, opened a new log
I20260709 12:27:25.381587 16991 ts_tablet_manager.cc:1403] T e628dacc30694988a7c795441df15600 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent bootstrapping tablet: real 0.080s	user 0.017s	sys 0.017s
I20260709 12:27:25.381780 17037 raft_consensus.cc:2804] T 27f104a1ba60493ab47f6b876da48d67 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:25.379390 16616 catalog_manager.cc:5697] T 00e5268529b241f184c460704ab9ed3c P 82f27bcdf252425aad4c4a37d064f68d reported cstate change: term changed from 0 to 1, leader changed from <none> to 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68). New cstate: current_term: 1 leader_uuid: "82f27bcdf252425aad4c4a37d064f68d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:25.385142 16991 raft_consensus.cc:359] T e628dacc30694988a7c795441df15600 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:25.382207 17037 raft_consensus.cc:493] T 27f104a1ba60493ab47f6b876da48d67 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:25.386200 16989 tablet_bootstrap.cc:654] T b10d5b4017584d0fb22f9e542d95fcb1 P 82f27bcdf252425aad4c4a37d064f68d: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:25.387064 16988 tablet_bootstrap.cc:654] T c5baa0b4140847958c6528b3dbda7617 P 17294485b7f24e2b9fae71dd3169a336: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:25.386261 17037 raft_consensus.cc:3060] T 27f104a1ba60493ab47f6b876da48d67 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:25.385877 16991 raft_consensus.cc:385] T e628dacc30694988a7c795441df15600 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:25.389303 16991 raft_consensus.cc:740] T e628dacc30694988a7c795441df15600 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c1aba6ee1d244fd9c0daba722aa0b3b, State: Initialized, Role: FOLLOWER
I20260709 12:27:25.390120 16991 consensus_queue.cc:260] T e628dacc30694988a7c795441df15600 P 3c1aba6ee1d244fd9c0daba722aa0b3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:25.393455 17115 raft_consensus.cc:493] T 27f104a1ba60493ab47f6b876da48d67 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:25.393729 16991 ts_tablet_manager.cc:1434] T e628dacc30694988a7c795441df15600 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.001s
I20260709 12:27:25.393996 17115 raft_consensus.cc:515] T 27f104a1ba60493ab47f6b876da48d67 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:25.394755 16991 tablet_bootstrap.cc:492] T 223b3745452c412581caf058f6b81fe2 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Bootstrap starting.
I20260709 12:27:25.396322 17115 leader_election.cc:290] T 27f104a1ba60493ab47f6b876da48d67 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:25.391742 16987 tablet_bootstrap.cc:492] T 28c655b68dc545948c67e0977b49e770 P 879366e90f5c420588945e0d545017c8: No bootstrap required, opened a new log
I20260709 12:27:25.397224 16987 ts_tablet_manager.cc:1403] T 28c655b68dc545948c67e0977b49e770 P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.000s
I20260709 12:27:25.397856 16868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f104a1ba60493ab47f6b876da48d67" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:25.402324 16987 raft_consensus.cc:359] T 28c655b68dc545948c67e0977b49e770 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:25.403354 16987 raft_consensus.cc:385] T 28c655b68dc545948c67e0977b49e770 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:25.402793 16868 raft_consensus.cc:2468] T 27f104a1ba60493ab47f6b876da48d67 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 0.
I20260709 12:27:25.404076 16987 raft_consensus.cc:740] T 28c655b68dc545948c67e0977b49e770 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:25.405083 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f104a1ba60493ab47f6b876da48d67" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:25.406213 16941 raft_consensus.cc:2468] T 27f104a1ba60493ab47f6b876da48d67 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 0.
I20260709 12:27:25.407027 16987 consensus_queue.cc:260] T 28c655b68dc545948c67e0977b49e770 P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:25.403021 16717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f104a1ba60493ab47f6b876da48d67" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8" is_pre_election: true
I20260709 12:27:25.401659 17037 raft_consensus.cc:515] T 27f104a1ba60493ab47f6b876da48d67 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:25.416862 16987 ts_tablet_manager.cc:1434] T 28c655b68dc545948c67e0977b49e770 P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.019s	user 0.010s	sys 0.000s
I20260709 12:27:25.419730 16987 tablet_bootstrap.cc:492] T c5baa0b4140847958c6528b3dbda7617 P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:25.412951 17115 raft_consensus.cc:493] T e628dacc30694988a7c795441df15600 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:25.421996 16717 raft_consensus.cc:2393] T 27f104a1ba60493ab47f6b876da48d67 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17294485b7f24e2b9fae71dd3169a336 in current term 1: Already voted for candidate 879366e90f5c420588945e0d545017c8 in this term.
I20260709 12:27:25.424510 17037 leader_election.cc:290] T 27f104a1ba60493ab47f6b876da48d67 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 election: Requested vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919)
I20260709 12:27:25.425761 16991 tablet_bootstrap.cc:654] T 223b3745452c412581caf058f6b81fe2 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:25.429069 16833 leader_election.cc:304] T 27f104a1ba60493ab47f6b876da48d67 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 82f27bcdf252425aad4c4a37d064f68d; no voters: 
I20260709 12:27:25.431945 17079 raft_consensus.cc:2804] T 27f104a1ba60493ab47f6b876da48d67 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:25.432376 17079 raft_consensus.cc:493] T 27f104a1ba60493ab47f6b876da48d67 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:25.432720 17079 raft_consensus.cc:3060] T 27f104a1ba60493ab47f6b876da48d67 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:25.429489 17089 raft_consensus.cc:493] T e628dacc30694988a7c795441df15600 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:25.437738 17089 raft_consensus.cc:515] T e628dacc30694988a7c795441df15600 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:25.438437 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f104a1ba60493ab47f6b876da48d67" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d"
I20260709 12:27:25.439087 16942 raft_consensus.cc:3060] T 27f104a1ba60493ab47f6b876da48d67 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:25.440078 16868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f104a1ba60493ab47f6b876da48d67" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336"
I20260709 12:27:25.421988 17115 raft_consensus.cc:515] T e628dacc30694988a7c795441df15600 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:25.451733 16794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e628dacc30694988a7c795441df15600" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
I20260709 12:27:25.452361 16792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e628dacc30694988a7c795441df15600" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
I20260709 12:27:25.452567 16794 raft_consensus.cc:2468] T e628dacc30694988a7c795441df15600 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 0.
I20260709 12:27:25.454804 16719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e628dacc30694988a7c795441df15600" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8" is_pre_election: true
I20260709 12:27:25.455482 16719 raft_consensus.cc:2468] T e628dacc30694988a7c795441df15600 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 0.
I20260709 12:27:25.457060 16685 leader_election.cc:304] T e628dacc30694988a7c795441df15600 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8; no voters: 
I20260709 12:27:25.457983 17076 raft_consensus.cc:2804] T e628dacc30694988a7c795441df15600 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:25.458379 17076 raft_consensus.cc:493] T e628dacc30694988a7c795441df15600 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:25.458761 17076 raft_consensus.cc:3060] T e628dacc30694988a7c795441df15600 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:25.460724 16833 leader_election.cc:304] T e628dacc30694988a7c795441df15600 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b
I20260709 12:27:25.462210 17089 leader_election.cc:290] T e628dacc30694988a7c795441df15600 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
I20260709 12:27:25.445788 17115 leader_election.cc:290] T e628dacc30694988a7c795441df15600 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:25.472654 16867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e628dacc30694988a7c795441df15600" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:25.472880 16995 raft_consensus.cc:2804] T e628dacc30694988a7c795441df15600 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:25.473450 16867 raft_consensus.cc:2468] T e628dacc30694988a7c795441df15600 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 0.
I20260709 12:27:25.474466 16995 raft_consensus.cc:493] T e628dacc30694988a7c795441df15600 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:25.474875 16995 raft_consensus.cc:3060] T e628dacc30694988a7c795441df15600 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:25.477981 17076 raft_consensus.cc:515] T e628dacc30694988a7c795441df15600 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:25.480455 16942 raft_consensus.cc:2468] T 27f104a1ba60493ab47f6b876da48d67 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 1.
I20260709 12:27:25.481740 17115 consensus_queue.cc:1048] T 28bdf20fc71548da87c4558dacc503db P 17294485b7f24e2b9fae71dd3169a336 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:25.484570 16987 tablet_bootstrap.cc:654] T c5baa0b4140847958c6528b3dbda7617 P 879366e90f5c420588945e0d545017c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:25.486081 16988 tablet_bootstrap.cc:492] T c5baa0b4140847958c6528b3dbda7617 P 17294485b7f24e2b9fae71dd3169a336: No bootstrap required, opened a new log
I20260709 12:27:25.487004 16988 ts_tablet_manager.cc:1403] T c5baa0b4140847958c6528b3dbda7617 P 17294485b7f24e2b9fae71dd3169a336: Time spent bootstrapping tablet: real 0.107s	user 0.009s	sys 0.007s
I20260709 12:27:25.486799 17079 raft_consensus.cc:515] T 27f104a1ba60493ab47f6b876da48d67 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:25.489218 16794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e628dacc30694988a7c795441df15600" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b"
I20260709 12:27:25.489584 17076 leader_election.cc:290] T e628dacc30694988a7c795441df15600 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 election: Requested vote from peers 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
I20260709 12:27:25.490125 16794 raft_consensus.cc:3060] T e628dacc30694988a7c795441df15600 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:25.494513 16988 raft_consensus.cc:359] T c5baa0b4140847958c6528b3dbda7617 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:25.495357 16988 raft_consensus.cc:385] T c5baa0b4140847958c6528b3dbda7617 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:25.495708 16988 raft_consensus.cc:740] T c5baa0b4140847958c6528b3dbda7617 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Initialized, Role: FOLLOWER
I20260709 12:27:25.496450 16988 consensus_queue.cc:260] T c5baa0b4140847958c6528b3dbda7617 P 17294485b7f24e2b9fae71dd3169a336 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:25.500901 16868 raft_consensus.cc:2393] T 27f104a1ba60493ab47f6b876da48d67 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 879366e90f5c420588945e0d545017c8 in current term 1: Already voted for candidate 17294485b7f24e2b9fae71dd3169a336 in this term.
I20260709 12:27:25.504119 16989 tablet_bootstrap.cc:492] T b10d5b4017584d0fb22f9e542d95fcb1 P 82f27bcdf252425aad4c4a37d064f68d: No bootstrap required, opened a new log
I20260709 12:27:25.503952 16684 leader_election.cc:304] T 27f104a1ba60493ab47f6b876da48d67 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d, 879366e90f5c420588945e0d545017c8; no voters: 
I20260709 12:27:25.504683 16989 ts_tablet_manager.cc:1403] T b10d5b4017584d0fb22f9e542d95fcb1 P 82f27bcdf252425aad4c4a37d064f68d: Time spent bootstrapping tablet: real 0.150s	user 0.011s	sys 0.018s
I20260709 12:27:25.506104 16867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e628dacc30694988a7c795441df15600" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336"
I20260709 12:27:25.507047 17079 leader_election.cc:290] T 27f104a1ba60493ab47f6b876da48d67 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 election: Requested vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:25.508518 16794 raft_consensus.cc:2468] T e628dacc30694988a7c795441df15600 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 1.
I20260709 12:27:25.508626 16719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f104a1ba60493ab47f6b876da48d67" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8"
I20260709 12:27:25.509718 16719 raft_consensus.cc:2393] T 27f104a1ba60493ab47f6b876da48d67 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 17294485b7f24e2b9fae71dd3169a336 in current term 1: Already voted for candidate 879366e90f5c420588945e0d545017c8 in this term.
I20260709 12:27:25.509820 16685 leader_election.cc:304] T e628dacc30694988a7c795441df15600 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8; no voters: 
I20260709 12:27:25.511114 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f104a1ba60493ab47f6b876da48d67" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d"
I20260709 12:27:25.511994 16942 raft_consensus.cc:2393] T 27f104a1ba60493ab47f6b876da48d67 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 17294485b7f24e2b9fae71dd3169a336 in current term 1: Already voted for candidate 879366e90f5c420588945e0d545017c8 in this term.
I20260709 12:27:25.513446 16833 leader_election.cc:304] T 27f104a1ba60493ab47f6b876da48d67 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336; no voters: 82f27bcdf252425aad4c4a37d064f68d, 879366e90f5c420588945e0d545017c8
I20260709 12:27:25.514678 16989 raft_consensus.cc:359] T b10d5b4017584d0fb22f9e542d95fcb1 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:25.515249 16989 raft_consensus.cc:385] T b10d5b4017584d0fb22f9e542d95fcb1 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:25.515455 16989 raft_consensus.cc:740] T b10d5b4017584d0fb22f9e542d95fcb1 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f27bcdf252425aad4c4a37d064f68d, State: Initialized, Role: FOLLOWER
I20260709 12:27:25.517194 16989 consensus_queue.cc:260] T b10d5b4017584d0fb22f9e542d95fcb1 P 82f27bcdf252425aad4c4a37d064f68d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:25.519399 16989 ts_tablet_manager.cc:1434] T b10d5b4017584d0fb22f9e542d95fcb1 P 82f27bcdf252425aad4c4a37d064f68d: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:27:25.520804 16989 tablet_bootstrap.cc:492] T 223b3745452c412581caf058f6b81fe2 P 82f27bcdf252425aad4c4a37d064f68d: Bootstrap starting.
I20260709 12:27:25.528218 16989 tablet_bootstrap.cc:654] T 223b3745452c412581caf058f6b81fe2 P 82f27bcdf252425aad4c4a37d064f68d: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:25.516561 17076 raft_consensus.cc:2804] T 27f104a1ba60493ab47f6b876da48d67 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:25.528256 17144 raft_consensus.cc:2749] T 27f104a1ba60493ab47f6b876da48d67 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:27:25.529301 16995 raft_consensus.cc:515] T e628dacc30694988a7c795441df15600 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:25.547544 16995 leader_election.cc:290] T e628dacc30694988a7c795441df15600 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 election: Requested vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:25.549077 16867 raft_consensus.cc:2393] T e628dacc30694988a7c795441df15600 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 879366e90f5c420588945e0d545017c8 in current term 1: Already voted for candidate 17294485b7f24e2b9fae71dd3169a336 in this term.
I20260709 12:27:25.530051 17089 raft_consensus.cc:2804] T e628dacc30694988a7c795441df15600 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:25.550427 17089 raft_consensus.cc:697] T e628dacc30694988a7c795441df15600 P 879366e90f5c420588945e0d545017c8 [term 1 LEADER]: Becoming Leader. State: Replica: 879366e90f5c420588945e0d545017c8, State: Running, Role: LEADER
I20260709 12:27:25.551539 16793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e628dacc30694988a7c795441df15600" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b"
I20260709 12:27:25.551397 17089 consensus_queue.cc:237] T e628dacc30694988a7c795441df15600 P 879366e90f5c420588945e0d545017c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:25.532116 17076 raft_consensus.cc:697] T 27f104a1ba60493ab47f6b876da48d67 P 879366e90f5c420588945e0d545017c8 [term 1 LEADER]: Becoming Leader. State: Replica: 879366e90f5c420588945e0d545017c8, State: Running, Role: LEADER
I20260709 12:27:25.554821 17076 consensus_queue.cc:237] T 27f104a1ba60493ab47f6b876da48d67 P 879366e90f5c420588945e0d545017c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:25.552507 16793 raft_consensus.cc:2393] T e628dacc30694988a7c795441df15600 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 17294485b7f24e2b9fae71dd3169a336 in current term 1: Already voted for candidate 879366e90f5c420588945e0d545017c8 in this term.
I20260709 12:27:25.573630 16988 ts_tablet_manager.cc:1434] T c5baa0b4140847958c6528b3dbda7617 P 17294485b7f24e2b9fae71dd3169a336: Time spent starting tablet: real 0.086s	user 0.039s	sys 0.004s
I20260709 12:27:25.576125 16988 tablet_bootstrap.cc:492] T b10d5b4017584d0fb22f9e542d95fcb1 P 17294485b7f24e2b9fae71dd3169a336: Bootstrap starting.
I20260709 12:27:25.577108 16987 tablet_bootstrap.cc:492] T c5baa0b4140847958c6528b3dbda7617 P 879366e90f5c420588945e0d545017c8: No bootstrap required, opened a new log
I20260709 12:27:25.577718 16987 ts_tablet_manager.cc:1403] T c5baa0b4140847958c6528b3dbda7617 P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.160s	user 0.015s	sys 0.012s
W20260709 12:27:25.573760 16833 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37919, user_credentials={real_user=slave}} blocked reactor thread for 60391.7us
I20260709 12:27:25.668455 16997 raft_consensus.cc:493] T de72d440fa1641a39aee027ffc0588a3 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:25.680132 16997 raft_consensus.cc:515] T de72d440fa1641a39aee027ffc0588a3 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:25.682742 16997 leader_election.cc:290] T de72d440fa1641a39aee027ffc0588a3 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
I20260709 12:27:25.686407 16988 tablet_bootstrap.cc:654] T b10d5b4017584d0fb22f9e542d95fcb1 P 17294485b7f24e2b9fae71dd3169a336: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:25.696987 17079 consensus_queue.cc:1048] T 28bdf20fc71548da87c4558dacc503db P 17294485b7f24e2b9fae71dd3169a336 [LEADER]: Connected to new peer: Peer: permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:25.698846 16717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e628dacc30694988a7c795441df15600" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8"
I20260709 12:27:25.531014 16616 catalog_manager.cc:5697] T 6e43addba09b4930a12c94e691b2c76f P 3c1aba6ee1d244fd9c0daba722aa0b3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66). New cstate: current_term: 1 leader_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:25.674419 16991 tablet_bootstrap.cc:492] T 223b3745452c412581caf058f6b81fe2 P 3c1aba6ee1d244fd9c0daba722aa0b3b: No bootstrap required, opened a new log
I20260709 12:27:25.700155 16991 ts_tablet_manager.cc:1403] T 223b3745452c412581caf058f6b81fe2 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent bootstrapping tablet: real 0.306s	user 0.049s	sys 0.026s
I20260709 12:27:25.703675 16793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de72d440fa1641a39aee027ffc0588a3" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
I20260709 12:27:25.703567 16991 raft_consensus.cc:359] T 223b3745452c412581caf058f6b81fe2 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:25.704690 16991 raft_consensus.cc:385] T 223b3745452c412581caf058f6b81fe2 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:25.705010 16991 raft_consensus.cc:740] T 223b3745452c412581caf058f6b81fe2 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c1aba6ee1d244fd9c0daba722aa0b3b, State: Initialized, Role: FOLLOWER
I20260709 12:27:25.705991 16991 consensus_queue.cc:260] T 223b3745452c412581caf058f6b81fe2 P 3c1aba6ee1d244fd9c0daba722aa0b3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
W20260709 12:27:25.707283 16908 leader_election.cc:343] T de72d440fa1641a39aee027ffc0588a3 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:25.673923 16987 raft_consensus.cc:359] T c5baa0b4140847958c6528b3dbda7617 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:25.675223 17075 consensus_queue.cc:1048] T ea5085716661498e9f3bfdfa2fc5737a P 82f27bcdf252425aad4c4a37d064f68d [LEADER]: Connected to new peer: Peer: permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:25.710482 16987 raft_consensus.cc:385] T c5baa0b4140847958c6528b3dbda7617 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:25.710870 16987 raft_consensus.cc:740] T c5baa0b4140847958c6528b3dbda7617 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:25.711782 16987 consensus_queue.cc:260] T c5baa0b4140847958c6528b3dbda7617 P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:25.710757 16991 ts_tablet_manager.cc:1434] T 223b3745452c412581caf058f6b81fe2 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:27:25.713616 16991 tablet_bootstrap.cc:492] T c5baa0b4140847958c6528b3dbda7617 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Bootstrap starting.
I20260709 12:27:25.718830 16987 ts_tablet_manager.cc:1434] T c5baa0b4140847958c6528b3dbda7617 P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.141s	user 0.011s	sys 0.003s
I20260709 12:27:25.719926 16987 tablet_bootstrap.cc:492] T 223b3745452c412581caf058f6b81fe2 P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
W20260709 12:27:25.675881 16907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:39833, user_credentials={real_user=slave}} blocked reactor thread for 85157.3us
W20260709 12:27:25.677603 16685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:43629, user_credentials={real_user=slave}} blocked reactor thread for 89102.1us
I20260709 12:27:25.722564 16867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de72d440fa1641a39aee027ffc0588a3" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:25.678795 17016 raft_consensus.cc:493] T 00e5268529b241f184c460704ab9ed3c P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:25.724478 16614 catalog_manager.cc:5697] T 27f104a1ba60493ab47f6b876da48d67 P 879366e90f5c420588945e0d545017c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 879366e90f5c420588945e0d545017c8 (127.9.116.65). New cstate: current_term: 1 leader_uuid: "879366e90f5c420588945e0d545017c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:25.732758 16991 tablet_bootstrap.cc:654] T c5baa0b4140847958c6528b3dbda7617 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:25.724675 17016 raft_consensus.cc:515] T 00e5268529b241f184c460704ab9ed3c P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:25.737566 16987 tablet_bootstrap.cc:654] T 223b3745452c412581caf058f6b81fe2 P 879366e90f5c420588945e0d545017c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:25.738493 17016 leader_election.cc:290] T 00e5268529b241f184c460704ab9ed3c P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:25.738469 16833 leader_election.cc:304] T e628dacc30694988a7c795441df15600 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8
I20260709 12:27:25.740188 17079 raft_consensus.cc:2749] T e628dacc30694988a7c795441df15600 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:27:25.740945 16717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5268529b241f184c460704ab9ed3c" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8" is_pre_election: true
I20260709 12:27:25.742379 16717 raft_consensus.cc:2393] T 00e5268529b241f184c460704ab9ed3c P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in current term 1: Already voted for candidate 82f27bcdf252425aad4c4a37d064f68d in this term.
I20260709 12:27:25.748538 16792 raft_consensus.cc:3060] T 00e5268529b241f184c460704ab9ed3c P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:25.757530 17037 raft_consensus.cc:493] T 28c655b68dc545948c67e0977b49e770 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:25.758394 17037 raft_consensus.cc:515] T 28c655b68dc545948c67e0977b49e770 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:25.761922 17037 leader_election.cc:290] T 28c655b68dc545948c67e0977b49e770 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919)
I20260709 12:27:25.765131 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e5268529b241f184c460704ab9ed3c" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:25.771165 16759 leader_election.cc:304] T 00e5268529b241f184c460704ab9ed3c P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b; no voters: 82f27bcdf252425aad4c4a37d064f68d, 879366e90f5c420588945e0d545017c8
I20260709 12:27:25.772964 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c655b68dc545948c67e0977b49e770" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:25.774044 16987 tablet_bootstrap.cc:492] T 223b3745452c412581caf058f6b81fe2 P 879366e90f5c420588945e0d545017c8: No bootstrap required, opened a new log
I20260709 12:27:25.774174 16942 raft_consensus.cc:2468] T 28c655b68dc545948c67e0977b49e770 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 0.
I20260709 12:27:25.774940 16987 ts_tablet_manager.cc:1403] T 223b3745452c412581caf058f6b81fe2 P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.055s	user 0.004s	sys 0.009s
W20260709 12:27:25.776717 16907 leader_election.cc:343] T de72d440fa1641a39aee027ffc0588a3 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:25.782034 16907 leader_election.cc:304] T de72d440fa1641a39aee027ffc0588a3 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 17294485b7f24e2b9fae71dd3169a336, 3c1aba6ee1d244fd9c0daba722aa0b3b
I20260709 12:27:25.782455 17132 consensus_queue.cc:1048] T ea5085716661498e9f3bfdfa2fc5737a P 82f27bcdf252425aad4c4a37d064f68d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:25.782977 16997 raft_consensus.cc:2749] T de72d440fa1641a39aee027ffc0588a3 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:25.781292 16988 tablet_bootstrap.cc:492] T b10d5b4017584d0fb22f9e542d95fcb1 P 17294485b7f24e2b9fae71dd3169a336: No bootstrap required, opened a new log
I20260709 12:27:25.787653 16988 ts_tablet_manager.cc:1403] T b10d5b4017584d0fb22f9e542d95fcb1 P 17294485b7f24e2b9fae71dd3169a336: Time spent bootstrapping tablet: real 0.212s	user 0.023s	sys 0.025s
I20260709 12:27:25.793637 16988 raft_consensus.cc:359] T b10d5b4017584d0fb22f9e542d95fcb1 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:25.797277 16988 raft_consensus.cc:385] T b10d5b4017584d0fb22f9e542d95fcb1 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:25.797618 16988 raft_consensus.cc:740] T b10d5b4017584d0fb22f9e542d95fcb1 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Initialized, Role: FOLLOWER
I20260709 12:27:25.798331 16988 consensus_queue.cc:260] T b10d5b4017584d0fb22f9e542d95fcb1 P 17294485b7f24e2b9fae71dd3169a336 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:25.778725 16987 raft_consensus.cc:359] T 223b3745452c412581caf058f6b81fe2 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:25.778818 16867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c655b68dc545948c67e0977b49e770" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:25.799556 16867 raft_consensus.cc:2468] T 28c655b68dc545948c67e0977b49e770 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 0.
I20260709 12:27:25.800333 16991 tablet_bootstrap.cc:492] T c5baa0b4140847958c6528b3dbda7617 P 3c1aba6ee1d244fd9c0daba722aa0b3b: No bootstrap required, opened a new log
I20260709 12:27:25.800915 16991 ts_tablet_manager.cc:1403] T c5baa0b4140847958c6528b3dbda7617 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent bootstrapping tablet: real 0.088s	user 0.041s	sys 0.031s
I20260709 12:27:25.801678 17132 consensus_queue.cc:1048] T 00e5268529b241f184c460704ab9ed3c P 82f27bcdf252425aad4c4a37d064f68d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:25.777493 16684 leader_election.cc:304] T 28c655b68dc545948c67e0977b49e770 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d, 879366e90f5c420588945e0d545017c8; no voters: 
I20260709 12:27:25.795926 17016 raft_consensus.cc:2749] T 00e5268529b241f184c460704ab9ed3c P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:25.779937 16989 tablet_bootstrap.cc:492] T 223b3745452c412581caf058f6b81fe2 P 82f27bcdf252425aad4c4a37d064f68d: No bootstrap required, opened a new log
I20260709 12:27:25.791716 17005 consensus_queue.cc:1048] T 6e43addba09b4930a12c94e691b2c76f P 3c1aba6ee1d244fd9c0daba722aa0b3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:25.804746 16991 raft_consensus.cc:359] T c5baa0b4140847958c6528b3dbda7617 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:25.805670 16991 raft_consensus.cc:385] T c5baa0b4140847958c6528b3dbda7617 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:25.806257 16991 raft_consensus.cc:740] T c5baa0b4140847958c6528b3dbda7617 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c1aba6ee1d244fd9c0daba722aa0b3b, State: Initialized, Role: FOLLOWER
I20260709 12:27:25.804636 16989 ts_tablet_manager.cc:1403] T 223b3745452c412581caf058f6b81fe2 P 82f27bcdf252425aad4c4a37d064f68d: Time spent bootstrapping tablet: real 0.284s	user 0.017s	sys 0.024s
I20260709 12:27:25.807847 16991 consensus_queue.cc:260] T c5baa0b4140847958c6528b3dbda7617 P 3c1aba6ee1d244fd9c0daba722aa0b3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:25.810910 16991 ts_tablet_manager.cc:1434] T c5baa0b4140847958c6528b3dbda7617 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:27:25.811463 16989 raft_consensus.cc:359] T 223b3745452c412581caf058f6b81fe2 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:25.812445 16989 raft_consensus.cc:385] T 223b3745452c412581caf058f6b81fe2 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:25.812587 16991 tablet_bootstrap.cc:492] T de72d440fa1641a39aee027ffc0588a3 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Bootstrap starting.
I20260709 12:27:25.812659 17037 raft_consensus.cc:2804] T 28c655b68dc545948c67e0977b49e770 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:25.813422 16987 raft_consensus.cc:385] T 223b3745452c412581caf058f6b81fe2 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:25.813772 16987 raft_consensus.cc:740] T 223b3745452c412581caf058f6b81fe2 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:25.812770 16989 raft_consensus.cc:740] T 223b3745452c412581caf058f6b81fe2 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f27bcdf252425aad4c4a37d064f68d, State: Initialized, Role: FOLLOWER
I20260709 12:27:25.813436 17037 raft_consensus.cc:493] T 28c655b68dc545948c67e0977b49e770 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:25.814636 16987 consensus_queue.cc:260] T 223b3745452c412581caf058f6b81fe2 P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:25.815650 16989 consensus_queue.cc:260] T 223b3745452c412581caf058f6b81fe2 P 82f27bcdf252425aad4c4a37d064f68d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:25.825300 16987 ts_tablet_manager.cc:1434] T 223b3745452c412581caf058f6b81fe2 P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.050s	user 0.010s	sys 0.001s
I20260709 12:27:25.822738 17148 raft_consensus.cc:493] T c5baa0b4140847958c6528b3dbda7617 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:25.827828 17148 raft_consensus.cc:515] T c5baa0b4140847958c6528b3dbda7617 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:25.815451 17037 raft_consensus.cc:3060] T 28c655b68dc545948c67e0977b49e770 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:25.831251 16987 tablet_bootstrap.cc:492] T 5025c37302bd4a2aa076878e1af90366 P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:25.838083 16988 ts_tablet_manager.cc:1434] T b10d5b4017584d0fb22f9e542d95fcb1 P 17294485b7f24e2b9fae71dd3169a336: Time spent starting tablet: real 0.050s	user 0.008s	sys 0.001s
I20260709 12:27:25.839319 16988 tablet_bootstrap.cc:492] T de72d440fa1641a39aee027ffc0588a3 P 17294485b7f24e2b9fae71dd3169a336: Bootstrap starting.
I20260709 12:27:25.853503 16989 ts_tablet_manager.cc:1434] T 223b3745452c412581caf058f6b81fe2 P 82f27bcdf252425aad4c4a37d064f68d: Time spent starting tablet: real 0.046s	user 0.009s	sys 0.000s
I20260709 12:27:25.854359 17079 raft_consensus.cc:493] T b10d5b4017584d0fb22f9e542d95fcb1 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:25.854328 17075 consensus_queue.cc:1048] T 00e5268529b241f184c460704ab9ed3c P 82f27bcdf252425aad4c4a37d064f68d [LEADER]: Connected to new peer: Peer: permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:25.855334 17079 raft_consensus.cc:515] T b10d5b4017584d0fb22f9e542d95fcb1 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:25.857848 17079 leader_election.cc:290] T b10d5b4017584d0fb22f9e542d95fcb1 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:25.861465 16719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b10d5b4017584d0fb22f9e542d95fcb1" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8" is_pre_election: true
I20260709 12:27:25.862071 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b10d5b4017584d0fb22f9e542d95fcb1" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:25.862735 16941 raft_consensus.cc:2468] T b10d5b4017584d0fb22f9e542d95fcb1 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 0.
I20260709 12:27:25.863241 16989 tablet_bootstrap.cc:492] T 60a8110f7e424463ae56af0646bf4434 P 82f27bcdf252425aad4c4a37d064f68d: Bootstrap starting.
I20260709 12:27:25.863456 17148 leader_election.cc:290] T c5baa0b4140847958c6528b3dbda7617 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:25.868703 16794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5baa0b4140847958c6528b3dbda7617" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
I20260709 12:27:25.870601 16794 raft_consensus.cc:2468] T c5baa0b4140847958c6528b3dbda7617 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 0.
W20260709 12:27:25.870643 16833 leader_election.cc:343] T b10d5b4017584d0fb22f9e542d95fcb1 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:25.872272 16719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5baa0b4140847958c6528b3dbda7617" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8" is_pre_election: true
I20260709 12:27:25.873000 16719 raft_consensus.cc:2468] T c5baa0b4140847958c6528b3dbda7617 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 0.
I20260709 12:27:25.873276 16833 leader_election.cc:304] T b10d5b4017584d0fb22f9e542d95fcb1 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 82f27bcdf252425aad4c4a37d064f68d; no voters: 879366e90f5c420588945e0d545017c8
I20260709 12:27:25.875347 16834 leader_election.cc:304] T c5baa0b4140847958c6528b3dbda7617 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 3c1aba6ee1d244fd9c0daba722aa0b3b; no voters: 
I20260709 12:27:25.877897 16991 tablet_bootstrap.cc:654] T de72d440fa1641a39aee027ffc0588a3 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:25.878103 17016 consensus_queue.cc:1048] T 6e43addba09b4930a12c94e691b2c76f P 3c1aba6ee1d244fd9c0daba722aa0b3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:25.886897 17148 raft_consensus.cc:2804] T b10d5b4017584d0fb22f9e542d95fcb1 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:25.888428 17079 raft_consensus.cc:2804] T c5baa0b4140847958c6528b3dbda7617 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:25.900892 17148 raft_consensus.cc:493] T b10d5b4017584d0fb22f9e542d95fcb1 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:25.907938 17148 raft_consensus.cc:3060] T b10d5b4017584d0fb22f9e542d95fcb1 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:25.904342 17079 raft_consensus.cc:493] T c5baa0b4140847958c6528b3dbda7617 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:25.920743 17079 raft_consensus.cc:3060] T c5baa0b4140847958c6528b3dbda7617 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:25.932581 17037 raft_consensus.cc:515] T 28c655b68dc545948c67e0977b49e770 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:25.958004 16988 tablet_bootstrap.cc:654] T de72d440fa1641a39aee027ffc0588a3 P 17294485b7f24e2b9fae71dd3169a336: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:25.962369 17048 consensus_queue.cc:1048] T 27f104a1ba60493ab47f6b876da48d67 P 879366e90f5c420588945e0d545017c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:27:25.965184 16867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c655b68dc545948c67e0977b49e770" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336"
I20260709 12:27:25.965941 16867 raft_consensus.cc:3060] T 28c655b68dc545948c67e0977b49e770 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:25.969300 16989 tablet_bootstrap.cc:654] T 60a8110f7e424463ae56af0646bf4434 P 82f27bcdf252425aad4c4a37d064f68d: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:25.969452 17079 raft_consensus.cc:515] T c5baa0b4140847958c6528b3dbda7617 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:25.972971 16719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5baa0b4140847958c6528b3dbda7617" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8"
I20260709 12:27:25.973673 16719 raft_consensus.cc:3060] T c5baa0b4140847958c6528b3dbda7617 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:25.978193 17037 leader_election.cc:290] T 28c655b68dc545948c67e0977b49e770 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 election: Requested vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919)
I20260709 12:27:25.979024 17037 consensus_queue.cc:1048] T 27f104a1ba60493ab47f6b876da48d67 P 879366e90f5c420588945e0d545017c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:25.981845 16987 tablet_bootstrap.cc:654] T 5025c37302bd4a2aa076878e1af90366 P 879366e90f5c420588945e0d545017c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:25.983428 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c655b68dc545948c67e0977b49e770" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d"
I20260709 12:27:25.984270 16940 raft_consensus.cc:3060] T 28c655b68dc545948c67e0977b49e770 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:25.988466 17089 raft_consensus.cc:493] T 223b3745452c412581caf058f6b81fe2 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:26.009999 16989 tablet_bootstrap.cc:492] T 60a8110f7e424463ae56af0646bf4434 P 82f27bcdf252425aad4c4a37d064f68d: No bootstrap required, opened a new log
I20260709 12:27:26.013629 16989 ts_tablet_manager.cc:1403] T 60a8110f7e424463ae56af0646bf4434 P 82f27bcdf252425aad4c4a37d064f68d: Time spent bootstrapping tablet: real 0.159s	user 0.018s	sys 0.000s
I20260709 12:27:26.014554 16988 tablet_bootstrap.cc:492] T de72d440fa1641a39aee027ffc0588a3 P 17294485b7f24e2b9fae71dd3169a336: No bootstrap required, opened a new log
I20260709 12:27:26.015810 16988 ts_tablet_manager.cc:1403] T de72d440fa1641a39aee027ffc0588a3 P 17294485b7f24e2b9fae71dd3169a336: Time spent bootstrapping tablet: real 0.177s	user 0.010s	sys 0.010s
I20260709 12:27:26.020285 16793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5baa0b4140847958c6528b3dbda7617" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b"
I20260709 12:27:26.021035 16793 raft_consensus.cc:3060] T c5baa0b4140847958c6528b3dbda7617 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:26.022517 16988 raft_consensus.cc:359] T de72d440fa1641a39aee027ffc0588a3 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:26.023296 16988 raft_consensus.cc:385] T de72d440fa1641a39aee027ffc0588a3 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:26.023665 16988 raft_consensus.cc:740] T de72d440fa1641a39aee027ffc0588a3 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Initialized, Role: FOLLOWER
I20260709 12:27:26.024528 16867 raft_consensus.cc:2468] T 28c655b68dc545948c67e0977b49e770 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 1.
I20260709 12:27:26.024422 16988 consensus_queue.cc:260] T de72d440fa1641a39aee027ffc0588a3 P 17294485b7f24e2b9fae71dd3169a336 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:26.026036 16684 leader_election.cc:304] T 28c655b68dc545948c67e0977b49e770 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8; no voters: 
I20260709 12:27:26.027769 16991 tablet_bootstrap.cc:492] T de72d440fa1641a39aee027ffc0588a3 P 3c1aba6ee1d244fd9c0daba722aa0b3b: No bootstrap required, opened a new log
I20260709 12:27:26.028404 16991 ts_tablet_manager.cc:1403] T de72d440fa1641a39aee027ffc0588a3 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent bootstrapping tablet: real 0.216s	user 0.026s	sys 0.033s
I20260709 12:27:26.016213 17079 leader_election.cc:290] T c5baa0b4140847958c6528b3dbda7617 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 election: Requested vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:26.026258 17148 raft_consensus.cc:515] T b10d5b4017584d0fb22f9e542d95fcb1 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:26.029678 17037 raft_consensus.cc:2804] T 28c655b68dc545948c67e0977b49e770 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:26.040025 17037 raft_consensus.cc:697] T 28c655b68dc545948c67e0977b49e770 P 879366e90f5c420588945e0d545017c8 [term 1 LEADER]: Becoming Leader. State: Replica: 879366e90f5c420588945e0d545017c8, State: Running, Role: LEADER
I20260709 12:27:26.040498 17005 raft_consensus.cc:493] T 223b3745452c412581caf058f6b81fe2 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:26.041172 17005 raft_consensus.cc:515] T 223b3745452c412581caf058f6b81fe2 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:26.043644 17148 leader_election.cc:290] T b10d5b4017584d0fb22f9e542d95fcb1 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 election: Requested vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:26.013026 17089 raft_consensus.cc:515] T 223b3745452c412581caf058f6b81fe2 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:26.026046 16719 raft_consensus.cc:2468] T c5baa0b4140847958c6528b3dbda7617 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 1.
I20260709 12:27:26.045269 16718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b10d5b4017584d0fb22f9e542d95fcb1" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8"
I20260709 12:27:26.040973 17037 consensus_queue.cc:237] T 28c655b68dc545948c67e0977b49e770 P 879366e90f5c420588945e0d545017c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:26.045799 17089 leader_election.cc:290] T 223b3745452c412581caf058f6b81fe2 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:26.046914 16940 raft_consensus.cc:2468] T 28c655b68dc545948c67e0977b49e770 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 1.
I20260709 12:27:26.048056 17005 leader_election.cc:290] T 223b3745452c412581caf058f6b81fe2 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:26.051318 16989 raft_consensus.cc:359] T 60a8110f7e424463ae56af0646bf4434 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:26.052109 16989 raft_consensus.cc:385] T 60a8110f7e424463ae56af0646bf4434 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:26.052887 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "223b3745452c412581caf058f6b81fe2" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:26.036403 16793 raft_consensus.cc:2468] T c5baa0b4140847958c6528b3dbda7617 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 1.
I20260709 12:27:26.053565 16941 raft_consensus.cc:2468] T 223b3745452c412581caf058f6b81fe2 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in term 0.
I20260709 12:27:26.054971 16834 leader_election.cc:304] T c5baa0b4140847958c6528b3dbda7617 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 3c1aba6ee1d244fd9c0daba722aa0b3b; no voters: 
I20260709 12:27:26.055997 16991 raft_consensus.cc:359] T de72d440fa1641a39aee027ffc0588a3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:26.056706 16991 raft_consensus.cc:385] T de72d440fa1641a39aee027ffc0588a3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:26.056977 16991 raft_consensus.cc:740] T de72d440fa1641a39aee027ffc0588a3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c1aba6ee1d244fd9c0daba722aa0b3b, State: Initialized, Role: FOLLOWER
I20260709 12:27:26.057686 16991 consensus_queue.cc:260] T de72d440fa1641a39aee027ffc0588a3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:26.058485 17115 raft_consensus.cc:2804] T c5baa0b4140847958c6528b3dbda7617 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:26.059047 17115 raft_consensus.cc:697] T c5baa0b4140847958c6528b3dbda7617 P 17294485b7f24e2b9fae71dd3169a336 [term 1 LEADER]: Becoming Leader. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Running, Role: LEADER
I20260709 12:27:26.059610 16988 ts_tablet_manager.cc:1434] T de72d440fa1641a39aee027ffc0588a3 P 17294485b7f24e2b9fae71dd3169a336: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.001s
I20260709 12:27:26.060601 16988 tablet_bootstrap.cc:492] T 60a8110f7e424463ae56af0646bf4434 P 17294485b7f24e2b9fae71dd3169a336: Bootstrap starting.
I20260709 12:27:26.061782 16718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "223b3745452c412581caf058f6b81fe2" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8" is_pre_election: true
I20260709 12:27:26.062440 16718 raft_consensus.cc:2468] T 223b3745452c412581caf058f6b81fe2 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in term 0.
I20260709 12:27:26.052397 16989 raft_consensus.cc:740] T 60a8110f7e424463ae56af0646bf4434 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f27bcdf252425aad4c4a37d064f68d, State: Initialized, Role: FOLLOWER
I20260709 12:27:26.065599 16759 leader_election.cc:304] T 223b3745452c412581caf058f6b81fe2 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8; no voters: 
I20260709 12:27:26.066116 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b10d5b4017584d0fb22f9e542d95fcb1" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d"
I20260709 12:27:26.066782 17005 raft_consensus.cc:2804] T 223b3745452c412581caf058f6b81fe2 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:26.066129 16792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "223b3745452c412581caf058f6b81fe2" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
I20260709 12:27:26.067286 17005 raft_consensus.cc:493] T 223b3745452c412581caf058f6b81fe2 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:26.066965 16942 raft_consensus.cc:3060] T b10d5b4017584d0fb22f9e542d95fcb1 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:26.067991 17005 raft_consensus.cc:3060] T 223b3745452c412581caf058f6b81fe2 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:27:26.077967 16833 leader_election.cc:343] T b10d5b4017584d0fb22f9e542d95fcb1 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:26.082201 16987 tablet_bootstrap.cc:492] T 5025c37302bd4a2aa076878e1af90366 P 879366e90f5c420588945e0d545017c8: No bootstrap required, opened a new log
I20260709 12:27:26.083026 16987 ts_tablet_manager.cc:1403] T 5025c37302bd4a2aa076878e1af90366 P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.253s	user 0.022s	sys 0.001s
I20260709 12:27:26.082545 16989 consensus_queue.cc:260] T 60a8110f7e424463ae56af0646bf4434 P 82f27bcdf252425aad4c4a37d064f68d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:26.084425 16991 ts_tablet_manager.cc:1434] T de72d440fa1641a39aee027ffc0588a3 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent starting tablet: real 0.056s	user 0.006s	sys 0.001s
I20260709 12:27:26.085464 16991 tablet_bootstrap.cc:492] T 5025c37302bd4a2aa076878e1af90366 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Bootstrap starting.
I20260709 12:27:26.087255 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "223b3745452c412581caf058f6b81fe2" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:26.087352 17115 consensus_queue.cc:237] T c5baa0b4140847958c6528b3dbda7617 P 17294485b7f24e2b9fae71dd3169a336 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:26.088289 16941 raft_consensus.cc:2468] T 223b3745452c412581caf058f6b81fe2 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 0.
I20260709 12:27:26.103526 16989 ts_tablet_manager.cc:1434] T 60a8110f7e424463ae56af0646bf4434 P 82f27bcdf252425aad4c4a37d064f68d: Time spent starting tablet: real 0.089s	user 0.007s	sys 0.002s
I20260709 12:27:26.105777 16989 tablet_bootstrap.cc:492] T a0409dc146674a39a9ceeeeebc081453 P 82f27bcdf252425aad4c4a37d064f68d: Bootstrap starting.
I20260709 12:27:26.106482 16987 raft_consensus.cc:359] T 5025c37302bd4a2aa076878e1af90366 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:26.107530 16987 raft_consensus.cc:385] T 5025c37302bd4a2aa076878e1af90366 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:26.107941 16987 raft_consensus.cc:740] T 5025c37302bd4a2aa076878e1af90366 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:26.109062 16987 consensus_queue.cc:260] T 5025c37302bd4a2aa076878e1af90366 P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:26.108018 16684 leader_election.cc:304] T 223b3745452c412581caf058f6b81fe2 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d, 879366e90f5c420588945e0d545017c8; no voters: 
I20260709 12:27:26.118240 17037 raft_consensus.cc:2804] T 223b3745452c412581caf058f6b81fe2 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:26.118733 17037 raft_consensus.cc:493] T 223b3745452c412581caf058f6b81fe2 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:26.119107 17037 raft_consensus.cc:3060] T 223b3745452c412581caf058f6b81fe2 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:26.121255 17076 consensus_queue.cc:1048] T e628dacc30694988a7c795441df15600 P 879366e90f5c420588945e0d545017c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:26.123059 16987 ts_tablet_manager.cc:1434] T 5025c37302bd4a2aa076878e1af90366 P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.039s	user 0.004s	sys 0.004s
I20260709 12:27:26.124859 16987 tablet_bootstrap.cc:492] T b10d5b4017584d0fb22f9e542d95fcb1 P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:26.127247 16988 tablet_bootstrap.cc:654] T 60a8110f7e424463ae56af0646bf4434 P 17294485b7f24e2b9fae71dd3169a336: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:26.130502 17005 raft_consensus.cc:515] T 223b3745452c412581caf058f6b81fe2 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:26.137804 16792 raft_consensus.cc:2393] T 223b3745452c412581caf058f6b81fe2 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 879366e90f5c420588945e0d545017c8 in current term 1: Already voted for candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in this term.
I20260709 12:27:26.142777 17076 raft_consensus.cc:493] T 5025c37302bd4a2aa076878e1af90366 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:26.149878 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "223b3745452c412581caf058f6b81fe2" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d"
I20260709 12:27:26.152074 16941 raft_consensus.cc:3060] T 223b3745452c412581caf058f6b81fe2 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:26.157095 16718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "223b3745452c412581caf058f6b81fe2" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8"
I20260709 12:27:26.161693 16991 tablet_bootstrap.cc:654] T 5025c37302bd4a2aa076878e1af90366 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:26.152099 17076 raft_consensus.cc:515] T 5025c37302bd4a2aa076878e1af90366 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:26.167431 17076 leader_election.cc:290] T 5025c37302bd4a2aa076878e1af90366 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
I20260709 12:27:26.167948 16868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5025c37302bd4a2aa076878e1af90366" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:26.168248 16794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5025c37302bd4a2aa076878e1af90366" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
W20260709 12:27:26.169634 16684 leader_election.cc:343] T 5025c37302bd4a2aa076878e1af90366 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:26.171480 16942 raft_consensus.cc:2468] T b10d5b4017584d0fb22f9e542d95fcb1 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 1.
W20260709 12:27:26.171818 16685 leader_election.cc:343] T 5025c37302bd4a2aa076878e1af90366 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:26.155702 17005 leader_election.cc:290] T 223b3745452c412581caf058f6b81fe2 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 election: Requested vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:26.173310 16833 leader_election.cc:304] T b10d5b4017584d0fb22f9e542d95fcb1 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 82f27bcdf252425aad4c4a37d064f68d; no voters: 879366e90f5c420588945e0d545017c8
I20260709 12:27:26.174289 17147 raft_consensus.cc:2804] T b10d5b4017584d0fb22f9e542d95fcb1 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:26.174377 16685 leader_election.cc:304] T 5025c37302bd4a2aa076878e1af90366 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 879366e90f5c420588945e0d545017c8; no voters: 17294485b7f24e2b9fae71dd3169a336, 3c1aba6ee1d244fd9c0daba722aa0b3b
I20260709 12:27:26.174824 17147 raft_consensus.cc:697] T b10d5b4017584d0fb22f9e542d95fcb1 P 17294485b7f24e2b9fae71dd3169a336 [term 1 LEADER]: Becoming Leader. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Running, Role: LEADER
I20260709 12:27:26.175786 17147 consensus_queue.cc:237] T b10d5b4017584d0fb22f9e542d95fcb1 P 17294485b7f24e2b9fae71dd3169a336 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:26.178195 17048 raft_consensus.cc:2749] T 5025c37302bd4a2aa076878e1af90366 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:26.180541 16616 catalog_manager.cc:5697] T e628dacc30694988a7c795441df15600 P 879366e90f5c420588945e0d545017c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 879366e90f5c420588945e0d545017c8 (127.9.116.65). New cstate: current_term: 1 leader_uuid: "879366e90f5c420588945e0d545017c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:26.189420 16989 tablet_bootstrap.cc:654] T a0409dc146674a39a9ceeeeebc081453 P 82f27bcdf252425aad4c4a37d064f68d: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:26.179028 17037 raft_consensus.cc:515] T 223b3745452c412581caf058f6b81fe2 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:26.200857 16718 raft_consensus.cc:2393] T 223b3745452c412581caf058f6b81fe2 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in current term 1: Already voted for candidate 879366e90f5c420588945e0d545017c8 in this term.
I20260709 12:27:26.200994 16941 raft_consensus.cc:2468] T 223b3745452c412581caf058f6b81fe2 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in term 1.
I20260709 12:27:26.203540 16759 leader_election.cc:304] T 223b3745452c412581caf058f6b81fe2 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 82f27bcdf252425aad4c4a37d064f68d; no voters: 
I20260709 12:27:26.204965 17005 raft_consensus.cc:2804] T 223b3745452c412581caf058f6b81fe2 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:26.205492 17005 raft_consensus.cc:697] T 223b3745452c412581caf058f6b81fe2 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 LEADER]: Becoming Leader. State: Replica: 3c1aba6ee1d244fd9c0daba722aa0b3b, State: Running, Role: LEADER
I20260709 12:27:26.206379 17005 consensus_queue.cc:237] T 223b3745452c412581caf058f6b81fe2 P 3c1aba6ee1d244fd9c0daba722aa0b3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:26.210147 16988 tablet_bootstrap.cc:492] T 60a8110f7e424463ae56af0646bf4434 P 17294485b7f24e2b9fae71dd3169a336: No bootstrap required, opened a new log
I20260709 12:27:26.213397 16988 ts_tablet_manager.cc:1403] T 60a8110f7e424463ae56af0646bf4434 P 17294485b7f24e2b9fae71dd3169a336: Time spent bootstrapping tablet: real 0.153s	user 0.015s	sys 0.004s
I20260709 12:27:26.215050 17048 consensus_queue.cc:1048] T e628dacc30694988a7c795441df15600 P 879366e90f5c420588945e0d545017c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:26.216641 16988 raft_consensus.cc:359] T 60a8110f7e424463ae56af0646bf4434 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:26.217427 16988 raft_consensus.cc:385] T 60a8110f7e424463ae56af0646bf4434 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:26.217861 16988 raft_consensus.cc:740] T 60a8110f7e424463ae56af0646bf4434 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Initialized, Role: FOLLOWER
I20260709 12:27:26.219043 16988 consensus_queue.cc:260] T 60a8110f7e424463ae56af0646bf4434 P 17294485b7f24e2b9fae71dd3169a336 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:26.226902 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "223b3745452c412581caf058f6b81fe2" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d"
I20260709 12:27:26.228122 16941 raft_consensus.cc:2393] T 223b3745452c412581caf058f6b81fe2 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 879366e90f5c420588945e0d545017c8 in current term 1: Already voted for candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in this term.
I20260709 12:27:26.232203 16988 ts_tablet_manager.cc:1434] T 60a8110f7e424463ae56af0646bf4434 P 17294485b7f24e2b9fae71dd3169a336: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.001s
I20260709 12:27:26.233155 16988 tablet_bootstrap.cc:492] T b777ccb9937a476590a534fea0428c5c P 17294485b7f24e2b9fae71dd3169a336: Bootstrap starting.
I20260709 12:27:26.224798 17037 leader_election.cc:290] T 223b3745452c412581caf058f6b81fe2 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 election: Requested vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:26.253082 16793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "223b3745452c412581caf058f6b81fe2" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b"
I20260709 12:27:26.256038 16685 leader_election.cc:304] T 223b3745452c412581caf058f6b81fe2 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 879366e90f5c420588945e0d545017c8; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 82f27bcdf252425aad4c4a37d064f68d
I20260709 12:27:26.259205 16988 tablet_bootstrap.cc:654] T b777ccb9937a476590a534fea0428c5c P 17294485b7f24e2b9fae71dd3169a336: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:26.258563 16614 catalog_manager.cc:5697] T c5baa0b4140847958c6528b3dbda7617 P 17294485b7f24e2b9fae71dd3169a336 reported cstate change: term changed from 0 to 1, leader changed from <none> to 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67). New cstate: current_term: 1 leader_uuid: "17294485b7f24e2b9fae71dd3169a336" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:26.266600 16991 tablet_bootstrap.cc:492] T 5025c37302bd4a2aa076878e1af90366 P 3c1aba6ee1d244fd9c0daba722aa0b3b: No bootstrap required, opened a new log
I20260709 12:27:26.268247 16991 ts_tablet_manager.cc:1403] T 5025c37302bd4a2aa076878e1af90366 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent bootstrapping tablet: real 0.183s	user 0.021s	sys 0.014s
I20260709 12:27:26.270416 17048 raft_consensus.cc:2749] T 223b3745452c412581caf058f6b81fe2 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:27:26.274227 16991 raft_consensus.cc:359] T 5025c37302bd4a2aa076878e1af90366 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:26.275559 16991 raft_consensus.cc:385] T 5025c37302bd4a2aa076878e1af90366 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:26.302349 16991 raft_consensus.cc:740] T 5025c37302bd4a2aa076878e1af90366 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c1aba6ee1d244fd9c0daba722aa0b3b, State: Initialized, Role: FOLLOWER
I20260709 12:27:26.303869 16991 consensus_queue.cc:260] T 5025c37302bd4a2aa076878e1af90366 P 3c1aba6ee1d244fd9c0daba722aa0b3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:26.307430 16991 ts_tablet_manager.cc:1434] T 5025c37302bd4a2aa076878e1af90366 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent starting tablet: real 0.039s	user 0.010s	sys 0.000s
I20260709 12:27:26.299619 16987 tablet_bootstrap.cc:654] T b10d5b4017584d0fb22f9e542d95fcb1 P 879366e90f5c420588945e0d545017c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:26.315840 16991 tablet_bootstrap.cc:492] T 60a8110f7e424463ae56af0646bf4434 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Bootstrap starting.
I20260709 12:27:26.323101 17147 raft_consensus.cc:493] T de72d440fa1641a39aee027ffc0588a3 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:26.323920 17147 raft_consensus.cc:515] T de72d440fa1641a39aee027ffc0588a3 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:26.326442 17147 leader_election.cc:290] T de72d440fa1641a39aee027ffc0588a3 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629), 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919)
I20260709 12:27:26.326918 16991 tablet_bootstrap.cc:654] T 60a8110f7e424463ae56af0646bf4434 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:26.330153 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de72d440fa1641a39aee027ffc0588a3" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:26.331274 16941 raft_consensus.cc:2468] T de72d440fa1641a39aee027ffc0588a3 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 0.
I20260709 12:27:26.332852 16833 leader_election.cc:304] T de72d440fa1641a39aee027ffc0588a3 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 82f27bcdf252425aad4c4a37d064f68d; no voters: 
I20260709 12:27:26.334084 17147 raft_consensus.cc:2804] T de72d440fa1641a39aee027ffc0588a3 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:26.334676 17147 raft_consensus.cc:493] T de72d440fa1641a39aee027ffc0588a3 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:26.335147 17147 raft_consensus.cc:3060] T de72d440fa1641a39aee027ffc0588a3 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:26.337924 16616 catalog_manager.cc:5697] T 28c655b68dc545948c67e0977b49e770 P 879366e90f5c420588945e0d545017c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 879366e90f5c420588945e0d545017c8 (127.9.116.65). New cstate: current_term: 1 leader_uuid: "879366e90f5c420588945e0d545017c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:26.340138 16793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de72d440fa1641a39aee027ffc0588a3" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
I20260709 12:27:26.341198 16793 raft_consensus.cc:2468] T de72d440fa1641a39aee027ffc0588a3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 0.
I20260709 12:27:26.365233 17148 raft_consensus.cc:493] T 60a8110f7e424463ae56af0646bf4434 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:26.365310 16988 tablet_bootstrap.cc:492] T b777ccb9937a476590a534fea0428c5c P 17294485b7f24e2b9fae71dd3169a336: No bootstrap required, opened a new log
I20260709 12:27:26.368121 16988 ts_tablet_manager.cc:1403] T b777ccb9937a476590a534fea0428c5c P 17294485b7f24e2b9fae71dd3169a336: Time spent bootstrapping tablet: real 0.135s	user 0.033s	sys 0.037s
I20260709 12:27:26.366398 17148 raft_consensus.cc:515] T 60a8110f7e424463ae56af0646bf4434 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:26.371949 16988 raft_consensus.cc:359] T b777ccb9937a476590a534fea0428c5c P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:26.372463 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a8110f7e424463ae56af0646bf4434" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:26.372772 16988 raft_consensus.cc:385] T b777ccb9937a476590a534fea0428c5c P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:26.373082 16988 raft_consensus.cc:740] T b777ccb9937a476590a534fea0428c5c P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Initialized, Role: FOLLOWER
I20260709 12:27:26.373183 16941 raft_consensus.cc:2468] T 60a8110f7e424463ae56af0646bf4434 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 0.
I20260709 12:27:26.373868 16988 consensus_queue.cc:260] T b777ccb9937a476590a534fea0428c5c P 17294485b7f24e2b9fae71dd3169a336 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:26.375821 16833 leader_election.cc:304] T 60a8110f7e424463ae56af0646bf4434 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 82f27bcdf252425aad4c4a37d064f68d; no voters: 
I20260709 12:27:26.376163 16988 ts_tablet_manager.cc:1434] T b777ccb9937a476590a534fea0428c5c P 17294485b7f24e2b9fae71dd3169a336: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:27:26.376767 17079 raft_consensus.cc:2804] T 60a8110f7e424463ae56af0646bf4434 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:26.377187 16988 tablet_bootstrap.cc:492] T 5025c37302bd4a2aa076878e1af90366 P 17294485b7f24e2b9fae71dd3169a336: Bootstrap starting.
I20260709 12:27:26.377260 17079 raft_consensus.cc:493] T 60a8110f7e424463ae56af0646bf4434 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:26.380396 17079 raft_consensus.cc:3060] T 60a8110f7e424463ae56af0646bf4434 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:26.382812 16793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a8110f7e424463ae56af0646bf4434" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
I20260709 12:27:26.392779 16989 tablet_bootstrap.cc:492] T a0409dc146674a39a9ceeeeebc081453 P 82f27bcdf252425aad4c4a37d064f68d: No bootstrap required, opened a new log
I20260709 12:27:26.393589 16989 ts_tablet_manager.cc:1403] T a0409dc146674a39a9ceeeeebc081453 P 82f27bcdf252425aad4c4a37d064f68d: Time spent bootstrapping tablet: real 0.288s	user 0.044s	sys 0.035s
I20260709 12:27:26.377197 17148 leader_election.cc:290] T 60a8110f7e424463ae56af0646bf4434 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629), 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919)
W20260709 12:27:26.393481 16834 leader_election.cc:343] T 60a8110f7e424463ae56af0646bf4434 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:26.395265 16615 catalog_manager.cc:5697] T b10d5b4017584d0fb22f9e542d95fcb1 P 17294485b7f24e2b9fae71dd3169a336 reported cstate change: term changed from 0 to 1, leader changed from <none> to 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67). New cstate: current_term: 1 leader_uuid: "17294485b7f24e2b9fae71dd3169a336" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:26.397425 16987 tablet_bootstrap.cc:492] T b10d5b4017584d0fb22f9e542d95fcb1 P 879366e90f5c420588945e0d545017c8: No bootstrap required, opened a new log
I20260709 12:27:26.398106 16987 ts_tablet_manager.cc:1403] T b10d5b4017584d0fb22f9e542d95fcb1 P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.274s	user 0.016s	sys 0.005s
I20260709 12:27:26.403224 17147 raft_consensus.cc:515] T de72d440fa1641a39aee027ffc0588a3 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:26.405149 17079 raft_consensus.cc:515] T 60a8110f7e424463ae56af0646bf4434 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:26.408113 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de72d440fa1641a39aee027ffc0588a3" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d"
I20260709 12:27:26.417016 16941 raft_consensus.cc:3060] T de72d440fa1641a39aee027ffc0588a3 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:26.417403 16991 tablet_bootstrap.cc:492] T 60a8110f7e424463ae56af0646bf4434 P 3c1aba6ee1d244fd9c0daba722aa0b3b: No bootstrap required, opened a new log
I20260709 12:27:26.417943 16991 ts_tablet_manager.cc:1403] T 60a8110f7e424463ae56af0646bf4434 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent bootstrapping tablet: real 0.102s	user 0.017s	sys 0.008s
I20260709 12:27:26.422371 16991 raft_consensus.cc:359] T 60a8110f7e424463ae56af0646bf4434 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:26.423455 16991 raft_consensus.cc:385] T 60a8110f7e424463ae56af0646bf4434 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:26.423794 16991 raft_consensus.cc:740] T 60a8110f7e424463ae56af0646bf4434 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c1aba6ee1d244fd9c0daba722aa0b3b, State: Initialized, Role: FOLLOWER
I20260709 12:27:26.424671 16991 consensus_queue.cc:260] T 60a8110f7e424463ae56af0646bf4434 P 3c1aba6ee1d244fd9c0daba722aa0b3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:26.427232 16991 ts_tablet_manager.cc:1434] T 60a8110f7e424463ae56af0646bf4434 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.001s
I20260709 12:27:26.428424 16991 tablet_bootstrap.cc:492] T cfc80a8e57c24a768ebc48dd544a6c80 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Bootstrap starting.
I20260709 12:27:26.409066 17147 leader_election.cc:290] T de72d440fa1641a39aee027ffc0588a3 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 election: Requested vote from peers 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629), 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919)
I20260709 12:27:26.414594 16793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de72d440fa1641a39aee027ffc0588a3" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b"
I20260709 12:27:26.412520 16987 raft_consensus.cc:359] T b10d5b4017584d0fb22f9e542d95fcb1 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:26.429083 16987 raft_consensus.cc:385] T b10d5b4017584d0fb22f9e542d95fcb1 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:26.429636 16987 raft_consensus.cc:740] T b10d5b4017584d0fb22f9e542d95fcb1 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:26.430516 16987 consensus_queue.cc:260] T b10d5b4017584d0fb22f9e542d95fcb1 P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:26.431861 16941 raft_consensus.cc:2468] T de72d440fa1641a39aee027ffc0588a3 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 1.
I20260709 12:27:26.435714 16792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a8110f7e424463ae56af0646bf4434" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b"
I20260709 12:27:26.433285 16988 tablet_bootstrap.cc:654] T 5025c37302bd4a2aa076878e1af90366 P 17294485b7f24e2b9fae71dd3169a336: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:26.436539 16792 raft_consensus.cc:3060] T 60a8110f7e424463ae56af0646bf4434 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:26.434020 17079 leader_election.cc:290] T 60a8110f7e424463ae56af0646bf4434 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 election: Requested vote from peers 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629), 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919)
I20260709 12:27:26.435624 16833 leader_election.cc:304] T de72d440fa1641a39aee027ffc0588a3 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 82f27bcdf252425aad4c4a37d064f68d; no voters: 
I20260709 12:27:26.437610 17147 raft_consensus.cc:2804] T de72d440fa1641a39aee027ffc0588a3 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:26.436004 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a8110f7e424463ae56af0646bf4434" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d"
I20260709 12:27:26.429155 16793 raft_consensus.cc:3060] T de72d440fa1641a39aee027ffc0588a3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:26.438786 17147 raft_consensus.cc:697] T de72d440fa1641a39aee027ffc0588a3 P 17294485b7f24e2b9fae71dd3169a336 [term 1 LEADER]: Becoming Leader. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Running, Role: LEADER
I20260709 12:27:26.442166 17016 raft_consensus.cc:493] T 5025c37302bd4a2aa076878e1af90366 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:26.445773 17016 raft_consensus.cc:515] T 5025c37302bd4a2aa076878e1af90366 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:26.433145 16987 ts_tablet_manager.cc:1434] T b10d5b4017584d0fb22f9e542d95fcb1 P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.035s	user 0.009s	sys 0.001s
I20260709 12:27:26.449479 16989 raft_consensus.cc:359] T a0409dc146674a39a9ceeeeebc081453 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:26.450340 16989 raft_consensus.cc:385] T a0409dc146674a39a9ceeeeebc081453 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:26.450652 16989 raft_consensus.cc:740] T a0409dc146674a39a9ceeeeebc081453 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f27bcdf252425aad4c4a37d064f68d, State: Initialized, Role: FOLLOWER
I20260709 12:27:26.452181 16987 tablet_bootstrap.cc:492] T fe16827e0b4a45baa99739174f92a0f7 P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:26.453370 17016 leader_election.cc:290] T 5025c37302bd4a2aa076878e1af90366 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
I20260709 12:27:26.454564 16718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5025c37302bd4a2aa076878e1af90366" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8" is_pre_election: true
I20260709 12:27:26.454766 17147 consensus_queue.cc:237] T de72d440fa1641a39aee027ffc0588a3 P 17294485b7f24e2b9fae71dd3169a336 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:26.455428 16718 raft_consensus.cc:2468] T 5025c37302bd4a2aa076878e1af90366 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in term 0.
I20260709 12:27:26.457305 16759 leader_election.cc:304] T 5025c37302bd4a2aa076878e1af90366 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8; no voters: 
I20260709 12:27:26.458264 16941 raft_consensus.cc:3060] T 60a8110f7e424463ae56af0646bf4434 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:26.458531 17016 raft_consensus.cc:2804] T 5025c37302bd4a2aa076878e1af90366 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:26.459087 17016 raft_consensus.cc:493] T 5025c37302bd4a2aa076878e1af90366 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:26.459491 17016 raft_consensus.cc:3060] T 5025c37302bd4a2aa076878e1af90366 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:26.460311 16793 raft_consensus.cc:2468] T de72d440fa1641a39aee027ffc0588a3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 1.
I20260709 12:27:26.451470 17048 consensus_queue.cc:1048] T 28c655b68dc545948c67e0977b49e770 P 879366e90f5c420588945e0d545017c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:26.465096 16989 consensus_queue.cc:260] T a0409dc146674a39a9ceeeeebc081453 P 82f27bcdf252425aad4c4a37d064f68d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:26.467859 16614 catalog_manager.cc:5697] T 223b3745452c412581caf058f6b81fe2 P 3c1aba6ee1d244fd9c0daba722aa0b3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66). New cstate: current_term: 1 leader_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:26.471848 16868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5025c37302bd4a2aa076878e1af90366" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:26.473870 16989 ts_tablet_manager.cc:1434] T a0409dc146674a39a9ceeeeebc081453 P 82f27bcdf252425aad4c4a37d064f68d: Time spent starting tablet: real 0.080s	user 0.008s	sys 0.001s
I20260709 12:27:26.475157 16989 tablet_bootstrap.cc:492] T 7b90200ef21f42f1929fbf0051ef5b3e P 82f27bcdf252425aad4c4a37d064f68d: Bootstrap starting.
W20260709 12:27:26.473779 16759 leader_election.cc:343] T 5025c37302bd4a2aa076878e1af90366 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:26.478914 16941 raft_consensus.cc:2468] T 60a8110f7e424463ae56af0646bf4434 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 1.
I20260709 12:27:26.470445 17016 raft_consensus.cc:515] T 5025c37302bd4a2aa076878e1af90366 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:26.501400 16833 leader_election.cc:304] T 60a8110f7e424463ae56af0646bf4434 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 82f27bcdf252425aad4c4a37d064f68d; no voters: 
I20260709 12:27:26.501883 17016 leader_election.cc:290] T 5025c37302bd4a2aa076878e1af90366 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 election: Requested vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
I20260709 12:27:26.490082 16792 raft_consensus.cc:2468] T 60a8110f7e424463ae56af0646bf4434 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 1.
I20260709 12:27:26.502569 17079 raft_consensus.cc:2804] T 60a8110f7e424463ae56af0646bf4434 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:26.503264 17079 raft_consensus.cc:697] T 60a8110f7e424463ae56af0646bf4434 P 17294485b7f24e2b9fae71dd3169a336 [term 1 LEADER]: Becoming Leader. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Running, Role: LEADER
I20260709 12:27:26.495266 16987 tablet_bootstrap.cc:654] T fe16827e0b4a45baa99739174f92a0f7 P 879366e90f5c420588945e0d545017c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:26.504449 17079 consensus_queue.cc:237] T 60a8110f7e424463ae56af0646bf4434 P 17294485b7f24e2b9fae71dd3169a336 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:26.497646 16988 tablet_bootstrap.cc:492] T 5025c37302bd4a2aa076878e1af90366 P 17294485b7f24e2b9fae71dd3169a336: No bootstrap required, opened a new log
I20260709 12:27:26.508816 16718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5025c37302bd4a2aa076878e1af90366" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8"
I20260709 12:27:26.509666 16718 raft_consensus.cc:3060] T 5025c37302bd4a2aa076878e1af90366 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:26.509554 16866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5025c37302bd4a2aa076878e1af90366" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336"
I20260709 12:27:26.508201 16988 ts_tablet_manager.cc:1403] T 5025c37302bd4a2aa076878e1af90366 P 17294485b7f24e2b9fae71dd3169a336: Time spent bootstrapping tablet: real 0.131s	user 0.008s	sys 0.011s
W20260709 12:27:26.519733 16759 leader_election.cc:343] T 5025c37302bd4a2aa076878e1af90366 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:26.523952 16991 tablet_bootstrap.cc:654] T cfc80a8e57c24a768ebc48dd544a6c80 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:26.519517 16988 raft_consensus.cc:359] T 5025c37302bd4a2aa076878e1af90366 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:26.529397 16989 tablet_bootstrap.cc:654] T 7b90200ef21f42f1929fbf0051ef5b3e P 82f27bcdf252425aad4c4a37d064f68d: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:26.529409 16988 raft_consensus.cc:385] T 5025c37302bd4a2aa076878e1af90366 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:26.530467 16988 raft_consensus.cc:740] T 5025c37302bd4a2aa076878e1af90366 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Initialized, Role: FOLLOWER
I20260709 12:27:26.531380 16988 consensus_queue.cc:260] T 5025c37302bd4a2aa076878e1af90366 P 17294485b7f24e2b9fae71dd3169a336 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:26.529989 16718 raft_consensus.cc:2468] T 5025c37302bd4a2aa076878e1af90366 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in term 1.
I20260709 12:27:26.533620 16759 leader_election.cc:304] T 5025c37302bd4a2aa076878e1af90366 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8; no voters: 17294485b7f24e2b9fae71dd3169a336
I20260709 12:27:26.534096 17048 consensus_queue.cc:1048] T 28c655b68dc545948c67e0977b49e770 P 879366e90f5c420588945e0d545017c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:26.535441 17016 raft_consensus.cc:2804] T 5025c37302bd4a2aa076878e1af90366 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:26.536053 17016 raft_consensus.cc:697] T 5025c37302bd4a2aa076878e1af90366 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 LEADER]: Becoming Leader. State: Replica: 3c1aba6ee1d244fd9c0daba722aa0b3b, State: Running, Role: LEADER
I20260709 12:27:26.536994 17016 consensus_queue.cc:237] T 5025c37302bd4a2aa076878e1af90366 P 3c1aba6ee1d244fd9c0daba722aa0b3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:26.534045 16988 ts_tablet_manager.cc:1434] T 5025c37302bd4a2aa076878e1af90366 P 17294485b7f24e2b9fae71dd3169a336: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.004s
I20260709 12:27:26.539952 16988 tablet_bootstrap.cc:492] T fe16827e0b4a45baa99739174f92a0f7 P 17294485b7f24e2b9fae71dd3169a336: Bootstrap starting.
W20260709 12:27:26.543020 16665 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:27:26.547286 16988 tablet_bootstrap.cc:654] T fe16827e0b4a45baa99739174f92a0f7 P 17294485b7f24e2b9fae71dd3169a336: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:26.555608 16615 catalog_manager.cc:5697] T de72d440fa1641a39aee027ffc0588a3 P 17294485b7f24e2b9fae71dd3169a336 reported cstate change: term changed from 0 to 1, leader changed from <none> to 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67). New cstate: current_term: 1 leader_uuid: "17294485b7f24e2b9fae71dd3169a336" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:26.556990 16991 tablet_bootstrap.cc:492] T cfc80a8e57c24a768ebc48dd544a6c80 P 3c1aba6ee1d244fd9c0daba722aa0b3b: No bootstrap required, opened a new log
I20260709 12:27:26.564436 16991 ts_tablet_manager.cc:1403] T cfc80a8e57c24a768ebc48dd544a6c80 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent bootstrapping tablet: real 0.136s	user 0.016s	sys 0.000s
I20260709 12:27:26.567296 16991 raft_consensus.cc:359] T cfc80a8e57c24a768ebc48dd544a6c80 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:26.568030 16991 raft_consensus.cc:385] T cfc80a8e57c24a768ebc48dd544a6c80 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:26.568287 16991 raft_consensus.cc:740] T cfc80a8e57c24a768ebc48dd544a6c80 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c1aba6ee1d244fd9c0daba722aa0b3b, State: Initialized, Role: FOLLOWER
I20260709 12:27:26.569072 16991 consensus_queue.cc:260] T cfc80a8e57c24a768ebc48dd544a6c80 P 3c1aba6ee1d244fd9c0daba722aa0b3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:26.571328 16991 ts_tablet_manager.cc:1434] T cfc80a8e57c24a768ebc48dd544a6c80 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:27:26.572250 16991 tablet_bootstrap.cc:492] T a0409dc146674a39a9ceeeeebc081453 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Bootstrap starting.
I20260709 12:27:26.575176 16616 catalog_manager.cc:5697] T 5025c37302bd4a2aa076878e1af90366 P 3c1aba6ee1d244fd9c0daba722aa0b3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66). New cstate: current_term: 1 leader_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:26.578522 16991 tablet_bootstrap.cc:654] T a0409dc146674a39a9ceeeeebc081453 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:26.559839 16989 tablet_bootstrap.cc:492] T 7b90200ef21f42f1929fbf0051ef5b3e P 82f27bcdf252425aad4c4a37d064f68d: No bootstrap required, opened a new log
I20260709 12:27:26.579977 16989 ts_tablet_manager.cc:1403] T 7b90200ef21f42f1929fbf0051ef5b3e P 82f27bcdf252425aad4c4a37d064f68d: Time spent bootstrapping tablet: real 0.105s	user 0.021s	sys 0.002s
I20260709 12:27:26.560722 16988 tablet_bootstrap.cc:492] T fe16827e0b4a45baa99739174f92a0f7 P 17294485b7f24e2b9fae71dd3169a336: No bootstrap required, opened a new log
I20260709 12:27:26.562829 16987 tablet_bootstrap.cc:492] T fe16827e0b4a45baa99739174f92a0f7 P 879366e90f5c420588945e0d545017c8: No bootstrap required, opened a new log
I20260709 12:27:26.581692 16987 ts_tablet_manager.cc:1403] T fe16827e0b4a45baa99739174f92a0f7 P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.130s	user 0.009s	sys 0.006s
I20260709 12:27:26.583971 16988 ts_tablet_manager.cc:1403] T fe16827e0b4a45baa99739174f92a0f7 P 17294485b7f24e2b9fae71dd3169a336: Time spent bootstrapping tablet: real 0.045s	user 0.011s	sys 0.009s
I20260709 12:27:26.583491 16989 raft_consensus.cc:359] T 7b90200ef21f42f1929fbf0051ef5b3e P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:26.584623 16989 raft_consensus.cc:385] T 7b90200ef21f42f1929fbf0051ef5b3e P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:26.584941 16989 raft_consensus.cc:740] T 7b90200ef21f42f1929fbf0051ef5b3e P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f27bcdf252425aad4c4a37d064f68d, State: Initialized, Role: FOLLOWER
I20260709 12:27:26.585454 16987 raft_consensus.cc:359] T fe16827e0b4a45baa99739174f92a0f7 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:26.585680 16989 consensus_queue.cc:260] T 7b90200ef21f42f1929fbf0051ef5b3e P 82f27bcdf252425aad4c4a37d064f68d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:26.586226 16987 raft_consensus.cc:385] T fe16827e0b4a45baa99739174f92a0f7 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:26.586545 16987 raft_consensus.cc:740] T fe16827e0b4a45baa99739174f92a0f7 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:26.587865 16989 ts_tablet_manager.cc:1434] T 7b90200ef21f42f1929fbf0051ef5b3e P 82f27bcdf252425aad4c4a37d064f68d: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:27:26.587357 16987 consensus_queue.cc:260] T fe16827e0b4a45baa99739174f92a0f7 P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:26.588897 16989 tablet_bootstrap.cc:492] T b777ccb9937a476590a534fea0428c5c P 82f27bcdf252425aad4c4a37d064f68d: Bootstrap starting.
I20260709 12:27:26.592684 16987 ts_tablet_manager.cc:1434] T fe16827e0b4a45baa99739174f92a0f7 P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:27:26.592430 16988 raft_consensus.cc:359] T fe16827e0b4a45baa99739174f92a0f7 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:26.593253 16988 raft_consensus.cc:385] T fe16827e0b4a45baa99739174f92a0f7 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:26.593532 16988 raft_consensus.cc:740] T fe16827e0b4a45baa99739174f92a0f7 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Initialized, Role: FOLLOWER
I20260709 12:27:26.593777 16987 tablet_bootstrap.cc:492] T a0409dc146674a39a9ceeeeebc081453 P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:26.594347 16988 consensus_queue.cc:260] T fe16827e0b4a45baa99739174f92a0f7 P 17294485b7f24e2b9fae71dd3169a336 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:26.595166 17147 consensus_queue.cc:1048] T b10d5b4017584d0fb22f9e542d95fcb1 P 17294485b7f24e2b9fae71dd3169a336 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:26.596541 16988 ts_tablet_manager.cc:1434] T fe16827e0b4a45baa99739174f92a0f7 P 17294485b7f24e2b9fae71dd3169a336: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 12:27:26.597487 16988 tablet_bootstrap.cc:492] T cfc80a8e57c24a768ebc48dd544a6c80 P 17294485b7f24e2b9fae71dd3169a336: Bootstrap starting.
I20260709 12:27:26.600234 16989 tablet_bootstrap.cc:654] T b777ccb9937a476590a534fea0428c5c P 82f27bcdf252425aad4c4a37d064f68d: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:26.603909 16988 tablet_bootstrap.cc:654] T cfc80a8e57c24a768ebc48dd544a6c80 P 17294485b7f24e2b9fae71dd3169a336: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:26.615393 16989 tablet_bootstrap.cc:492] T b777ccb9937a476590a534fea0428c5c P 82f27bcdf252425aad4c4a37d064f68d: No bootstrap required, opened a new log
I20260709 12:27:26.615918 16989 ts_tablet_manager.cc:1403] T b777ccb9937a476590a534fea0428c5c P 82f27bcdf252425aad4c4a37d064f68d: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.002s
I20260709 12:27:26.617442 17069 raft_consensus.cc:493] T 7b90200ef21f42f1929fbf0051ef5b3e P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:26.618224 17069 raft_consensus.cc:515] T 7b90200ef21f42f1929fbf0051ef5b3e P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:26.627743 16615 catalog_manager.cc:5697] T 60a8110f7e424463ae56af0646bf4434 P 17294485b7f24e2b9fae71dd3169a336 reported cstate change: term changed from 0 to 1, leader changed from <none> to 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67). New cstate: current_term: 1 leader_uuid: "17294485b7f24e2b9fae71dd3169a336" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:26.628914 17016 consensus_queue.cc:1048] T 223b3745452c412581caf058f6b81fe2 P 3c1aba6ee1d244fd9c0daba722aa0b3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:26.629937 16718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b90200ef21f42f1929fbf0051ef5b3e" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8" is_pre_election: true
I20260709 12:27:26.630668 16792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b90200ef21f42f1929fbf0051ef5b3e" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
I20260709 12:27:26.631860 16717 raft_consensus.cc:3060] T b10d5b4017584d0fb22f9e542d95fcb1 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:26.633644 17069 leader_election.cc:290] T 7b90200ef21f42f1929fbf0051ef5b3e P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:26.642125 16987 tablet_bootstrap.cc:654] T a0409dc146674a39a9ceeeeebc081453 P 879366e90f5c420588945e0d545017c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:26.643832 16989 raft_consensus.cc:359] T b777ccb9937a476590a534fea0428c5c P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:26.645035 16989 raft_consensus.cc:385] T b777ccb9937a476590a534fea0428c5c P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:27:26.645308 16908 leader_election.cc:343] T 7b90200ef21f42f1929fbf0051ef5b3e P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:27:26.646848 16907 leader_election.cc:343] T 7b90200ef21f42f1929fbf0051ef5b3e P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:26.647351 16907 leader_election.cc:304] T 7b90200ef21f42f1929fbf0051ef5b3e P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8
I20260709 12:27:26.645419 16989 raft_consensus.cc:740] T b777ccb9937a476590a534fea0428c5c P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f27bcdf252425aad4c4a37d064f68d, State: Initialized, Role: FOLLOWER
I20260709 12:27:26.649088 16991 tablet_bootstrap.cc:492] T a0409dc146674a39a9ceeeeebc081453 P 3c1aba6ee1d244fd9c0daba722aa0b3b: No bootstrap required, opened a new log
I20260709 12:27:26.649923 16991 ts_tablet_manager.cc:1403] T a0409dc146674a39a9ceeeeebc081453 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent bootstrapping tablet: real 0.078s	user 0.008s	sys 0.013s
I20260709 12:27:26.653309 16991 raft_consensus.cc:359] T a0409dc146674a39a9ceeeeebc081453 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:26.654237 16991 raft_consensus.cc:385] T a0409dc146674a39a9ceeeeebc081453 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:26.654569 16991 raft_consensus.cc:740] T a0409dc146674a39a9ceeeeebc081453 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c1aba6ee1d244fd9c0daba722aa0b3b, State: Initialized, Role: FOLLOWER
I20260709 12:27:26.654764 17069 raft_consensus.cc:2749] T 7b90200ef21f42f1929fbf0051ef5b3e P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:26.655463 16991 consensus_queue.cc:260] T a0409dc146674a39a9ceeeeebc081453 P 3c1aba6ee1d244fd9c0daba722aa0b3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:26.657054 16989 consensus_queue.cc:260] T b777ccb9937a476590a534fea0428c5c P 82f27bcdf252425aad4c4a37d064f68d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:26.659257 16988 tablet_bootstrap.cc:492] T cfc80a8e57c24a768ebc48dd544a6c80 P 17294485b7f24e2b9fae71dd3169a336: No bootstrap required, opened a new log
I20260709 12:27:26.660645 16988 ts_tablet_manager.cc:1403] T cfc80a8e57c24a768ebc48dd544a6c80 P 17294485b7f24e2b9fae71dd3169a336: Time spent bootstrapping tablet: real 0.063s	user 0.021s	sys 0.015s
I20260709 12:27:26.663275 16991 ts_tablet_manager.cc:1434] T a0409dc146674a39a9ceeeeebc081453 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:27:26.659634 16989 ts_tablet_manager.cc:1434] T b777ccb9937a476590a534fea0428c5c P 82f27bcdf252425aad4c4a37d064f68d: Time spent starting tablet: real 0.043s	user 0.010s	sys 0.000s
I20260709 12:27:26.664547 16991 tablet_bootstrap.cc:492] T 7b90200ef21f42f1929fbf0051ef5b3e P 3c1aba6ee1d244fd9c0daba722aa0b3b: Bootstrap starting.
I20260709 12:27:26.664994 17016 consensus_queue.cc:1048] T 223b3745452c412581caf058f6b81fe2 P 3c1aba6ee1d244fd9c0daba722aa0b3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:26.666380 16987 tablet_bootstrap.cc:492] T a0409dc146674a39a9ceeeeebc081453 P 879366e90f5c420588945e0d545017c8: No bootstrap required, opened a new log
I20260709 12:27:26.666922 16987 ts_tablet_manager.cc:1403] T a0409dc146674a39a9ceeeeebc081453 P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.073s	user 0.010s	sys 0.005s
I20260709 12:27:26.670518 16988 raft_consensus.cc:359] T cfc80a8e57c24a768ebc48dd544a6c80 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:26.671413 16988 raft_consensus.cc:385] T cfc80a8e57c24a768ebc48dd544a6c80 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:26.671764 16988 raft_consensus.cc:740] T cfc80a8e57c24a768ebc48dd544a6c80 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Initialized, Role: FOLLOWER
I20260709 12:27:26.672343 16991 tablet_bootstrap.cc:654] T 7b90200ef21f42f1929fbf0051ef5b3e P 3c1aba6ee1d244fd9c0daba722aa0b3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:26.674180 16988 consensus_queue.cc:260] T cfc80a8e57c24a768ebc48dd544a6c80 P 17294485b7f24e2b9fae71dd3169a336 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:26.676617 16988 ts_tablet_manager.cc:1434] T cfc80a8e57c24a768ebc48dd544a6c80 P 17294485b7f24e2b9fae71dd3169a336: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:27:26.676928 16987 raft_consensus.cc:359] T a0409dc146674a39a9ceeeeebc081453 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:26.677907 16988 tablet_bootstrap.cc:492] T 5868b3bc1ee44923a18d74874a8f3b30 P 17294485b7f24e2b9fae71dd3169a336: Bootstrap starting.
I20260709 12:27:26.678036 16987 raft_consensus.cc:385] T a0409dc146674a39a9ceeeeebc081453 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:26.678542 16987 raft_consensus.cc:740] T a0409dc146674a39a9ceeeeebc081453 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:26.679958 16987 consensus_queue.cc:260] T a0409dc146674a39a9ceeeeebc081453 P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:26.685070 16991 tablet_bootstrap.cc:492] T 7b90200ef21f42f1929fbf0051ef5b3e P 3c1aba6ee1d244fd9c0daba722aa0b3b: No bootstrap required, opened a new log
I20260709 12:27:26.685804 16991 ts_tablet_manager.cc:1403] T 7b90200ef21f42f1929fbf0051ef5b3e P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.008s
I20260709 12:27:26.690025 16988 tablet_bootstrap.cc:654] T 5868b3bc1ee44923a18d74874a8f3b30 P 17294485b7f24e2b9fae71dd3169a336: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:26.689884 16991 raft_consensus.cc:359] T 7b90200ef21f42f1929fbf0051ef5b3e P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:26.690730 16991 raft_consensus.cc:385] T 7b90200ef21f42f1929fbf0051ef5b3e P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:26.691052 16991 raft_consensus.cc:740] T 7b90200ef21f42f1929fbf0051ef5b3e P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c1aba6ee1d244fd9c0daba722aa0b3b, State: Initialized, Role: FOLLOWER
I20260709 12:27:26.691927 16991 consensus_queue.cc:260] T 7b90200ef21f42f1929fbf0051ef5b3e P 3c1aba6ee1d244fd9c0daba722aa0b3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:26.694423 16991 ts_tablet_manager.cc:1434] T 7b90200ef21f42f1929fbf0051ef5b3e P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.001s
I20260709 12:27:26.695421 16991 tablet_bootstrap.cc:492] T fe16827e0b4a45baa99739174f92a0f7 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Bootstrap starting.
I20260709 12:27:26.696993 17115 consensus_queue.cc:1048] T c5baa0b4140847958c6528b3dbda7617 P 17294485b7f24e2b9fae71dd3169a336 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:26.700750 17069 raft_consensus.cc:493] T b777ccb9937a476590a534fea0428c5c P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:26.701362 17069 raft_consensus.cc:515] T b777ccb9937a476590a534fea0428c5c P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:26.702301 16991 tablet_bootstrap.cc:654] T fe16827e0b4a45baa99739174f92a0f7 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:26.702651 16988 tablet_bootstrap.cc:492] T 5868b3bc1ee44923a18d74874a8f3b30 P 17294485b7f24e2b9fae71dd3169a336: No bootstrap required, opened a new log
I20260709 12:27:26.703330 16988 ts_tablet_manager.cc:1403] T 5868b3bc1ee44923a18d74874a8f3b30 P 17294485b7f24e2b9fae71dd3169a336: Time spent bootstrapping tablet: real 0.026s	user 0.018s	sys 0.001s
I20260709 12:27:26.708484 17115 consensus_queue.cc:1048] T c5baa0b4140847958c6528b3dbda7617 P 17294485b7f24e2b9fae71dd3169a336 [LEADER]: Connected to new peer: Peer: permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:26.711702 16988 raft_consensus.cc:359] T 5868b3bc1ee44923a18d74874a8f3b30 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:26.712492 16988 raft_consensus.cc:385] T 5868b3bc1ee44923a18d74874a8f3b30 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:26.712769 16988 raft_consensus.cc:740] T 5868b3bc1ee44923a18d74874a8f3b30 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Initialized, Role: FOLLOWER
I20260709 12:27:26.714555 17115 raft_consensus.cc:493] T cfc80a8e57c24a768ebc48dd544a6c80 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:26.715312 17115 raft_consensus.cc:515] T cfc80a8e57c24a768ebc48dd544a6c80 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:26.716269 16991 tablet_bootstrap.cc:492] T fe16827e0b4a45baa99739174f92a0f7 P 3c1aba6ee1d244fd9c0daba722aa0b3b: No bootstrap required, opened a new log
I20260709 12:27:26.716881 16991 ts_tablet_manager.cc:1403] T fe16827e0b4a45baa99739174f92a0f7 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.003s
I20260709 12:27:26.716589 17148 consensus_queue.cc:1048] T b10d5b4017584d0fb22f9e542d95fcb1 P 17294485b7f24e2b9fae71dd3169a336 [LEADER]: Connected to new peer: Peer: permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:26.718237 17115 leader_election.cc:290] T cfc80a8e57c24a768ebc48dd544a6c80 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629), 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919)
I20260709 12:27:26.719728 16793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc80a8e57c24a768ebc48dd544a6c80" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
I20260709 12:27:26.719874 16988 consensus_queue.cc:260] T 5868b3bc1ee44923a18d74874a8f3b30 P 17294485b7f24e2b9fae71dd3169a336 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:26.720503 16793 raft_consensus.cc:2468] T cfc80a8e57c24a768ebc48dd544a6c80 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 0.
I20260709 12:27:26.720155 16991 raft_consensus.cc:359] T fe16827e0b4a45baa99739174f92a0f7 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:26.721997 16991 raft_consensus.cc:385] T fe16827e0b4a45baa99739174f92a0f7 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:26.722566 16991 raft_consensus.cc:740] T fe16827e0b4a45baa99739174f92a0f7 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c1aba6ee1d244fd9c0daba722aa0b3b, State: Initialized, Role: FOLLOWER
I20260709 12:27:26.723272 16989 tablet_bootstrap.cc:492] T cfc80a8e57c24a768ebc48dd544a6c80 P 82f27bcdf252425aad4c4a37d064f68d: Bootstrap starting.
I20260709 12:27:26.723693 16987 ts_tablet_manager.cc:1434] T a0409dc146674a39a9ceeeeebc081453 P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.056s	user 0.011s	sys 0.000s
I20260709 12:27:26.723531 16991 consensus_queue.cc:260] T fe16827e0b4a45baa99739174f92a0f7 P 3c1aba6ee1d244fd9c0daba722aa0b3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:26.724938 16987 tablet_bootstrap.cc:492] T b777ccb9937a476590a534fea0428c5c P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:26.726429 16991 ts_tablet_manager.cc:1434] T fe16827e0b4a45baa99739174f92a0f7 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:27:26.727527 16991 tablet_bootstrap.cc:492] T 442e0dfc272840f7a14c2232ed65425c P 3c1aba6ee1d244fd9c0daba722aa0b3b: Bootstrap starting.
I20260709 12:27:26.728706 16834 leader_election.cc:304] T cfc80a8e57c24a768ebc48dd544a6c80 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 3c1aba6ee1d244fd9c0daba722aa0b3b; no voters: 
I20260709 12:27:26.729871 17148 raft_consensus.cc:2804] T cfc80a8e57c24a768ebc48dd544a6c80 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:26.730276 17148 raft_consensus.cc:493] T cfc80a8e57c24a768ebc48dd544a6c80 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:26.730682 17148 raft_consensus.cc:3060] T cfc80a8e57c24a768ebc48dd544a6c80 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:26.734438 16988 ts_tablet_manager.cc:1434] T 5868b3bc1ee44923a18d74874a8f3b30 P 17294485b7f24e2b9fae71dd3169a336: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 12:27:26.721194 17069 leader_election.cc:290] T b777ccb9937a476590a534fea0428c5c P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:26.735850 16868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b777ccb9937a476590a534fea0428c5c" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:26.736609 16868 raft_consensus.cc:2468] T b777ccb9937a476590a534fea0428c5c P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82f27bcdf252425aad4c4a37d064f68d in term 0.
I20260709 12:27:26.739167 16991 tablet_bootstrap.cc:654] T 442e0dfc272840f7a14c2232ed65425c P 3c1aba6ee1d244fd9c0daba722aa0b3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:26.739490 17016 raft_consensus.cc:493] T a0409dc146674a39a9ceeeeebc081453 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:26.742853 17016 raft_consensus.cc:515] T a0409dc146674a39a9ceeeeebc081453 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:26.741467 16987 tablet_bootstrap.cc:654] T b777ccb9937a476590a534fea0428c5c P 879366e90f5c420588945e0d545017c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:26.758747 16989 tablet_bootstrap.cc:654] T cfc80a8e57c24a768ebc48dd544a6c80 P 82f27bcdf252425aad4c4a37d064f68d: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:26.758769 16988 tablet_bootstrap.cc:492] T 3649e7bb023a4958a01ad5ecbe446f0f P 17294485b7f24e2b9fae71dd3169a336: Bootstrap starting.
I20260709 12:27:26.762027 16907 leader_election.cc:304] T b777ccb9937a476590a534fea0428c5c P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 82f27bcdf252425aad4c4a37d064f68d; no voters: 
I20260709 12:27:26.765173 17016 leader_election.cc:290] T a0409dc146674a39a9ceeeeebc081453 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:26.765625 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0409dc146674a39a9ceeeeebc081453" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:26.766328 16940 raft_consensus.cc:2468] T a0409dc146674a39a9ceeeeebc081453 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in term 0.
I20260709 12:27:26.767434 17069 raft_consensus.cc:2804] T b777ccb9937a476590a534fea0428c5c P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:26.767557 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc80a8e57c24a768ebc48dd544a6c80" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:26.768193 17069 raft_consensus.cc:493] T b777ccb9937a476590a534fea0428c5c P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:26.768816 17069 raft_consensus.cc:3060] T b777ccb9937a476590a534fea0428c5c P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:27:26.770717 16833 leader_election.cc:343] T cfc80a8e57c24a768ebc48dd544a6c80 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:26.771754 17115 raft_consensus.cc:493] T fe16827e0b4a45baa99739174f92a0f7 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:26.772332 16759 leader_election.cc:304] T a0409dc146674a39a9ceeeeebc081453 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 82f27bcdf252425aad4c4a37d064f68d; no voters: 
I20260709 12:27:26.777160 16715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b777ccb9937a476590a534fea0428c5c" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8" is_pre_election: true
I20260709 12:27:26.778313 17016 raft_consensus.cc:2804] T a0409dc146674a39a9ceeeeebc081453 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:26.778807 17016 raft_consensus.cc:493] T a0409dc146674a39a9ceeeeebc081453 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:26.779192 17016 raft_consensus.cc:3060] T a0409dc146674a39a9ceeeeebc081453 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:26.789376 16988 tablet_bootstrap.cc:654] T 3649e7bb023a4958a01ad5ecbe446f0f P 17294485b7f24e2b9fae71dd3169a336: Neither blocks nor log segments found. Creating new log.
W20260709 12:27:26.793071 16907 leader_election.cc:343] T b777ccb9937a476590a534fea0428c5c P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:26.776513 17115 raft_consensus.cc:515] T fe16827e0b4a45baa99739174f92a0f7 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:26.812351 17148 raft_consensus.cc:515] T cfc80a8e57c24a768ebc48dd544a6c80 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
W20260709 12:27:26.818938 17208 log.cc:927] Time spent T c5baa0b4140847958c6528b3dbda7617 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
W20260709 12:27:26.828054 17207 log.cc:927] Time spent T b10d5b4017584d0fb22f9e542d95fcb1 P 879366e90f5c420588945e0d545017c8: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 12:27:26.833319 17115 leader_election.cc:290] T fe16827e0b4a45baa99739174f92a0f7 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:26.835808 16794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe16827e0b4a45baa99739174f92a0f7" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
I20260709 12:27:26.836606 16794 raft_consensus.cc:2468] T fe16827e0b4a45baa99739174f92a0f7 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 0.
I20260709 12:27:26.838234 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc80a8e57c24a768ebc48dd544a6c80" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d"
I20260709 12:27:26.840250 16987 tablet_bootstrap.cc:492] T b777ccb9937a476590a534fea0428c5c P 879366e90f5c420588945e0d545017c8: No bootstrap required, opened a new log
W20260709 12:27:26.840293 16833 leader_election.cc:343] T cfc80a8e57c24a768ebc48dd544a6c80 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:26.841130 16987 ts_tablet_manager.cc:1403] T b777ccb9937a476590a534fea0428c5c P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.117s	user 0.029s	sys 0.020s
I20260709 12:27:26.791380 16717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0409dc146674a39a9ceeeeebc081453" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8" is_pre_election: true
I20260709 12:27:26.849859 16834 leader_election.cc:304] T fe16827e0b4a45baa99739174f92a0f7 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 3c1aba6ee1d244fd9c0daba722aa0b3b; no voters: 
I20260709 12:27:26.849962 16718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe16827e0b4a45baa99739174f92a0f7" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8" is_pre_election: true
I20260709 12:27:26.851743 17147 raft_consensus.cc:2804] T fe16827e0b4a45baa99739174f92a0f7 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:26.852197 17147 raft_consensus.cc:493] T fe16827e0b4a45baa99739174f92a0f7 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:26.852240 16718 raft_consensus.cc:2468] T fe16827e0b4a45baa99739174f92a0f7 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 0.
I20260709 12:27:26.852603 17147 raft_consensus.cc:3060] T fe16827e0b4a45baa99739174f92a0f7 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:26.854059 16792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc80a8e57c24a768ebc48dd544a6c80" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b"
I20260709 12:27:26.854768 16792 raft_consensus.cc:3060] T cfc80a8e57c24a768ebc48dd544a6c80 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:26.854791 17016 raft_consensus.cc:515] T a0409dc146674a39a9ceeeeebc081453 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:26.856091 16991 tablet_bootstrap.cc:492] T 442e0dfc272840f7a14c2232ed65425c P 3c1aba6ee1d244fd9c0daba722aa0b3b: No bootstrap required, opened a new log
I20260709 12:27:26.856629 16991 ts_tablet_manager.cc:1403] T 442e0dfc272840f7a14c2232ed65425c P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent bootstrapping tablet: real 0.129s	user 0.013s	sys 0.003s
I20260709 12:27:26.861078 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0409dc146674a39a9ceeeeebc081453" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d"
I20260709 12:27:26.861958 16941 raft_consensus.cc:3060] T a0409dc146674a39a9ceeeeebc081453 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:26.840386 17148 leader_election.cc:290] T cfc80a8e57c24a768ebc48dd544a6c80 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 election: Requested vote from peers 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629), 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919)
I20260709 12:27:26.874002 16987 raft_consensus.cc:359] T b777ccb9937a476590a534fea0428c5c P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:26.875859 16987 raft_consensus.cc:385] T b777ccb9937a476590a534fea0428c5c P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:26.876919 16987 raft_consensus.cc:740] T b777ccb9937a476590a534fea0428c5c P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:26.878032 16987 consensus_queue.cc:260] T b777ccb9937a476590a534fea0428c5c P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:26.878926 17147 raft_consensus.cc:515] T fe16827e0b4a45baa99739174f92a0f7 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:26.881670 16987 ts_tablet_manager.cc:1434] T b777ccb9937a476590a534fea0428c5c P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.000s
I20260709 12:27:26.885479 16987 tablet_bootstrap.cc:492] T 7b90200ef21f42f1929fbf0051ef5b3e P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:26.885982 17210 raft_consensus.cc:493] T 7b90200ef21f42f1929fbf0051ef5b3e P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:26.883366 16718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0409dc146674a39a9ceeeeebc081453" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8"
I20260709 12:27:26.887848 17147 leader_election.cc:290] T fe16827e0b4a45baa99739174f92a0f7 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 election: Requested vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:26.883924 17016 leader_election.cc:290] T a0409dc146674a39a9ceeeeebc081453 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 election: Requested vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:26.853394 16717 raft_consensus.cc:2468] T a0409dc146674a39a9ceeeeebc081453 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in term 0.
I20260709 12:27:26.886941 17210 raft_consensus.cc:515] T 7b90200ef21f42f1929fbf0051ef5b3e P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:26.891162 16991 raft_consensus.cc:359] T 442e0dfc272840f7a14c2232ed65425c P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:26.894366 16991 raft_consensus.cc:385] T 442e0dfc272840f7a14c2232ed65425c P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:26.894811 16991 raft_consensus.cc:740] T 442e0dfc272840f7a14c2232ed65425c P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c1aba6ee1d244fd9c0daba722aa0b3b, State: Initialized, Role: FOLLOWER
I20260709 12:27:26.901947 16792 raft_consensus.cc:2468] T cfc80a8e57c24a768ebc48dd544a6c80 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 1.
I20260709 12:27:26.906427 16991 consensus_queue.cc:260] T 442e0dfc272840f7a14c2232ed65425c P 3c1aba6ee1d244fd9c0daba722aa0b3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:26.924495 16834 leader_election.cc:304] T cfc80a8e57c24a768ebc48dd544a6c80 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 3c1aba6ee1d244fd9c0daba722aa0b3b; no voters: 82f27bcdf252425aad4c4a37d064f68d
I20260709 12:27:26.927279 17213 raft_consensus.cc:2804] T cfc80a8e57c24a768ebc48dd544a6c80 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:26.927947 17213 raft_consensus.cc:697] T cfc80a8e57c24a768ebc48dd544a6c80 P 17294485b7f24e2b9fae71dd3169a336 [term 1 LEADER]: Becoming Leader. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Running, Role: LEADER
I20260709 12:27:26.928912 17213 consensus_queue.cc:237] T cfc80a8e57c24a768ebc48dd544a6c80 P 17294485b7f24e2b9fae71dd3169a336 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:26.934408 16941 raft_consensus.cc:2468] T a0409dc146674a39a9ceeeeebc081453 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in term 1.
I20260709 12:27:26.936295 16759 leader_election.cc:304] T a0409dc146674a39a9ceeeeebc081453 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 82f27bcdf252425aad4c4a37d064f68d; no voters: 879366e90f5c420588945e0d545017c8
I20260709 12:27:26.937788 17016 raft_consensus.cc:2804] T a0409dc146674a39a9ceeeeebc081453 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:26.938365 17016 raft_consensus.cc:697] T a0409dc146674a39a9ceeeeebc081453 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 LEADER]: Becoming Leader. State: Replica: 3c1aba6ee1d244fd9c0daba722aa0b3b, State: Running, Role: LEADER
I20260709 12:27:26.939136 16987 tablet_bootstrap.cc:654] T 7b90200ef21f42f1929fbf0051ef5b3e P 879366e90f5c420588945e0d545017c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:26.939303 17016 consensus_queue.cc:237] T a0409dc146674a39a9ceeeeebc081453 P 3c1aba6ee1d244fd9c0daba722aa0b3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:26.941111 16991 ts_tablet_manager.cc:1434] T 442e0dfc272840f7a14c2232ed65425c P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent starting tablet: real 0.084s	user 0.009s	sys 0.001s
I20260709 12:27:26.941856 16717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b90200ef21f42f1929fbf0051ef5b3e" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8" is_pre_election: true
I20260709 12:27:26.947016 16991 tablet_bootstrap.cc:492] T 9067b67140fa48e883d2d240a6046d63 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Bootstrap starting.
I20260709 12:27:26.944392 17210 leader_election.cc:290] T 7b90200ef21f42f1929fbf0051ef5b3e P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:26.950307 17079 raft_consensus.cc:493] T 5025c37302bd4a2aa076878e1af90366 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:26.952360 17079 raft_consensus.cc:515] T 5025c37302bd4a2aa076878e1af90366 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:26.953393 16792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe16827e0b4a45baa99739174f92a0f7" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b"
I20260709 12:27:26.954464 17079 leader_election.cc:290] T 5025c37302bd4a2aa076878e1af90366 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:26.954064 16792 raft_consensus.cc:3060] T fe16827e0b4a45baa99739174f92a0f7 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:26.947976 16988 tablet_bootstrap.cc:492] T 3649e7bb023a4958a01ad5ecbe446f0f P 17294485b7f24e2b9fae71dd3169a336: No bootstrap required, opened a new log
I20260709 12:27:26.962137 16988 ts_tablet_manager.cc:1403] T 3649e7bb023a4958a01ad5ecbe446f0f P 17294485b7f24e2b9fae71dd3169a336: Time spent bootstrapping tablet: real 0.204s	user 0.016s	sys 0.012s
I20260709 12:27:26.945284 16989 tablet_bootstrap.cc:492] T cfc80a8e57c24a768ebc48dd544a6c80 P 82f27bcdf252425aad4c4a37d064f68d: No bootstrap required, opened a new log
I20260709 12:27:26.963186 16989 ts_tablet_manager.cc:1403] T cfc80a8e57c24a768ebc48dd544a6c80 P 82f27bcdf252425aad4c4a37d064f68d: Time spent bootstrapping tablet: real 0.240s	user 0.011s	sys 0.011s
I20260709 12:27:26.965212 16988 raft_consensus.cc:359] T 3649e7bb023a4958a01ad5ecbe446f0f P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:26.960925 16991 tablet_bootstrap.cc:654] T 9067b67140fa48e883d2d240a6046d63 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:26.965974 16988 raft_consensus.cc:385] T 3649e7bb023a4958a01ad5ecbe446f0f P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:27:26.957499 16759 leader_election.cc:343] T 7b90200ef21f42f1929fbf0051ef5b3e P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:26.963488 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b90200ef21f42f1929fbf0051ef5b3e" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:26.966500 16988 raft_consensus.cc:740] T 3649e7bb023a4958a01ad5ecbe446f0f P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Initialized, Role: FOLLOWER
I20260709 12:27:26.966931 16942 raft_consensus.cc:2468] T 7b90200ef21f42f1929fbf0051ef5b3e P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in term 0.
I20260709 12:27:26.956647 17069 raft_consensus.cc:515] T b777ccb9937a476590a534fea0428c5c P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:26.969523 17069 leader_election.cc:290] T b777ccb9937a476590a534fea0428c5c P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 election: Requested vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
W20260709 12:27:26.945042 16833 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:39833, user_credentials={real_user=slave}} blocked reactor thread for 79010.2us
I20260709 12:27:26.970556 16794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5025c37302bd4a2aa076878e1af90366" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
I20260709 12:27:26.971454 16868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b777ccb9937a476590a534fea0428c5c" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336"
I20260709 12:27:26.972182 16868 raft_consensus.cc:3060] T b777ccb9937a476590a534fea0428c5c P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:26.972641 16718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe16827e0b4a45baa99739174f92a0f7" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8"
I20260709 12:27:26.973278 16718 raft_consensus.cc:3060] T fe16827e0b4a45baa99739174f92a0f7 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:26.976346 16717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b777ccb9937a476590a534fea0428c5c" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8"
I20260709 12:27:26.977042 16717 raft_consensus.cc:3060] T b777ccb9937a476590a534fea0428c5c P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:26.978989 16715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5025c37302bd4a2aa076878e1af90366" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8" is_pre_election: true
I20260709 12:27:26.980051 16715 raft_consensus.cc:2393] T 5025c37302bd4a2aa076878e1af90366 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17294485b7f24e2b9fae71dd3169a336 in current term 1: Already voted for candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in this term.
I20260709 12:27:26.993784 16866 raft_consensus.cc:3060] T 5025c37302bd4a2aa076878e1af90366 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:26.994549 16989 raft_consensus.cc:359] T cfc80a8e57c24a768ebc48dd544a6c80 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:26.995317 16989 raft_consensus.cc:385] T cfc80a8e57c24a768ebc48dd544a6c80 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:27.000845 17215 raft_consensus.cc:493] T 5868b3bc1ee44923a18d74874a8f3b30 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:27.001495 17215 raft_consensus.cc:515] T 5868b3bc1ee44923a18d74874a8f3b30 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:27.005553 16989 raft_consensus.cc:740] T cfc80a8e57c24a768ebc48dd544a6c80 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f27bcdf252425aad4c4a37d064f68d, State: Initialized, Role: FOLLOWER
I20260709 12:27:26.970577 16759 leader_election.cc:304] T 7b90200ef21f42f1929fbf0051ef5b3e P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 82f27bcdf252425aad4c4a37d064f68d; no voters: 879366e90f5c420588945e0d545017c8
I20260709 12:27:27.006495 16989 consensus_queue.cc:260] T cfc80a8e57c24a768ebc48dd544a6c80 P 82f27bcdf252425aad4c4a37d064f68d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:27.008360 16868 raft_consensus.cc:2468] T b777ccb9937a476590a534fea0428c5c P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82f27bcdf252425aad4c4a37d064f68d in term 1.
I20260709 12:27:27.009279 17016 raft_consensus.cc:2804] T 7b90200ef21f42f1929fbf0051ef5b3e P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:27.009994 16907 leader_election.cc:304] T b777ccb9937a476590a534fea0428c5c P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 82f27bcdf252425aad4c4a37d064f68d; no voters: 
I20260709 12:27:27.010722 16718 raft_consensus.cc:2468] T fe16827e0b4a45baa99739174f92a0f7 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 1.
I20260709 12:27:27.011063 16997 raft_consensus.cc:2804] T b777ccb9937a476590a534fea0428c5c P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:27.012154 17215 leader_election.cc:290] T 5868b3bc1ee44923a18d74874a8f3b30 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629), 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919)
I20260709 12:27:27.012036 16997 raft_consensus.cc:697] T b777ccb9937a476590a534fea0428c5c P 82f27bcdf252425aad4c4a37d064f68d [term 1 LEADER]: Becoming Leader. State: Replica: 82f27bcdf252425aad4c4a37d064f68d, State: Running, Role: LEADER
I20260709 12:27:27.013500 16997 consensus_queue.cc:237] T b777ccb9937a476590a534fea0428c5c P 82f27bcdf252425aad4c4a37d064f68d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:27.013899 16794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5868b3bc1ee44923a18d74874a8f3b30" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
I20260709 12:27:27.009999 17016 raft_consensus.cc:493] T 7b90200ef21f42f1929fbf0051ef5b3e P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:27.015892 16989 ts_tablet_manager.cc:1434] T cfc80a8e57c24a768ebc48dd544a6c80 P 82f27bcdf252425aad4c4a37d064f68d: Time spent starting tablet: real 0.051s	user 0.004s	sys 0.003s
I20260709 12:27:27.006438 17115 consensus_queue.cc:1048] T de72d440fa1641a39aee027ffc0588a3 P 17294485b7f24e2b9fae71dd3169a336 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:27:27.024103 17016 raft_consensus.cc:3060] T 7b90200ef21f42f1929fbf0051ef5b3e P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:27.024657 16991 tablet_bootstrap.cc:492] T 9067b67140fa48e883d2d240a6046d63 P 3c1aba6ee1d244fd9c0daba722aa0b3b: No bootstrap required, opened a new log
I20260709 12:27:27.018044 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5868b3bc1ee44923a18d74874a8f3b30" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:27.017583 16717 raft_consensus.cc:2468] T b777ccb9937a476590a534fea0428c5c P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82f27bcdf252425aad4c4a37d064f68d in term 1.
I20260709 12:27:27.019759 17210 consensus_queue.cc:1048] T 5025c37302bd4a2aa076878e1af90366 P 3c1aba6ee1d244fd9c0daba722aa0b3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:27.025163 16991 ts_tablet_manager.cc:1403] T 9067b67140fa48e883d2d240a6046d63 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent bootstrapping tablet: real 0.078s	user 0.015s	sys 0.000s
I20260709 12:27:27.025411 16989 tablet_bootstrap.cc:492] T 514ee26ff21e4c08976b6a0397b730fe P 82f27bcdf252425aad4c4a37d064f68d: Bootstrap starting.
I20260709 12:27:27.019341 17215 consensus_queue.cc:1048] T 60a8110f7e424463ae56af0646bf4434 P 17294485b7f24e2b9fae71dd3169a336 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:27:27.021219 16834 leader_election.cc:343] T 5868b3bc1ee44923a18d74874a8f3b30 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:26.967466 16988 consensus_queue.cc:260] T 3649e7bb023a4958a01ad5ecbe446f0f P 17294485b7f24e2b9fae71dd3169a336 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:27.024369 17079 consensus_queue.cc:1048] T de72d440fa1641a39aee027ffc0588a3 P 17294485b7f24e2b9fae71dd3169a336 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:27.028414 16988 ts_tablet_manager.cc:1434] T 3649e7bb023a4958a01ad5ecbe446f0f P 17294485b7f24e2b9fae71dd3169a336: Time spent starting tablet: real 0.066s	user 0.007s	sys 0.000s
I20260709 12:27:27.028129 16991 raft_consensus.cc:359] T 9067b67140fa48e883d2d240a6046d63 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:27.028875 16991 raft_consensus.cc:385] T 9067b67140fa48e883d2d240a6046d63 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:27.029181 16991 raft_consensus.cc:740] T 9067b67140fa48e883d2d240a6046d63 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c1aba6ee1d244fd9c0daba722aa0b3b, State: Initialized, Role: FOLLOWER
I20260709 12:27:27.029512 16988 tablet_bootstrap.cc:492] T 514ee26ff21e4c08976b6a0397b730fe P 17294485b7f24e2b9fae71dd3169a336: Bootstrap starting.
I20260709 12:27:27.033015 16792 raft_consensus.cc:2468] T fe16827e0b4a45baa99739174f92a0f7 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 1.
I20260709 12:27:27.033948 16989 tablet_bootstrap.cc:654] T 514ee26ff21e4c08976b6a0397b730fe P 82f27bcdf252425aad4c4a37d064f68d: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:27.034336 16991 consensus_queue.cc:260] T 9067b67140fa48e883d2d240a6046d63 P 3c1aba6ee1d244fd9c0daba722aa0b3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:27.036924 16834 leader_election.cc:304] T fe16827e0b4a45baa99739174f92a0f7 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 3c1aba6ee1d244fd9c0daba722aa0b3b; no voters: 
I20260709 12:27:27.037593 16991 ts_tablet_manager.cc:1434] T 9067b67140fa48e883d2d240a6046d63 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 12:27:27.037896 17215 raft_consensus.cc:2804] T fe16827e0b4a45baa99739174f92a0f7 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:27.038415 17215 raft_consensus.cc:697] T fe16827e0b4a45baa99739174f92a0f7 P 17294485b7f24e2b9fae71dd3169a336 [term 1 LEADER]: Becoming Leader. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Running, Role: LEADER
I20260709 12:27:27.038682 16991 tablet_bootstrap.cc:492] T 5868b3bc1ee44923a18d74874a8f3b30 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Bootstrap starting.
I20260709 12:27:27.039261 17215 consensus_queue.cc:237] T fe16827e0b4a45baa99739174f92a0f7 P 17294485b7f24e2b9fae71dd3169a336 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:27.023332 16833 leader_election.cc:304] T 5025c37302bd4a2aa076878e1af90366 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8
I20260709 12:27:27.043016 16614 catalog_manager.cc:5697] T a0409dc146674a39a9ceeeeebc081453 P 3c1aba6ee1d244fd9c0daba722aa0b3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66). New cstate: current_term: 1 leader_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:27.048065 17115 raft_consensus.cc:2749] T 5025c37302bd4a2aa076878e1af90366 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:27.046993 17016 raft_consensus.cc:515] T 7b90200ef21f42f1929fbf0051ef5b3e P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:27.056856 16987 tablet_bootstrap.cc:492] T 7b90200ef21f42f1929fbf0051ef5b3e P 879366e90f5c420588945e0d545017c8: No bootstrap required, opened a new log
I20260709 12:27:27.057410 16987 ts_tablet_manager.cc:1403] T 7b90200ef21f42f1929fbf0051ef5b3e P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.172s	user 0.020s	sys 0.004s
I20260709 12:27:27.057205 17016 leader_election.cc:290] T 7b90200ef21f42f1929fbf0051ef5b3e P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 election: Requested vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:27.070436 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b90200ef21f42f1929fbf0051ef5b3e" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d"
I20260709 12:27:27.071165 16942 raft_consensus.cc:3060] T 7b90200ef21f42f1929fbf0051ef5b3e P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:27.072028 16991 tablet_bootstrap.cc:654] T 5868b3bc1ee44923a18d74874a8f3b30 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:27.077677 16616 catalog_manager.cc:5697] T cfc80a8e57c24a768ebc48dd544a6c80 P 17294485b7f24e2b9fae71dd3169a336 reported cstate change: term changed from 0 to 1, leader changed from <none> to 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67). New cstate: current_term: 1 leader_uuid: "17294485b7f24e2b9fae71dd3169a336" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:27.087708 16717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b90200ef21f42f1929fbf0051ef5b3e" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8"
I20260709 12:27:27.104588 17115 consensus_queue.cc:1048] T 60a8110f7e424463ae56af0646bf4434 P 17294485b7f24e2b9fae71dd3169a336 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:27.122067 16987 raft_consensus.cc:359] T 7b90200ef21f42f1929fbf0051ef5b3e P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:27.124270 16987 raft_consensus.cc:385] T 7b90200ef21f42f1929fbf0051ef5b3e P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:27.124617 16987 raft_consensus.cc:740] T 7b90200ef21f42f1929fbf0051ef5b3e P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:27.125411 16987 consensus_queue.cc:260] T 7b90200ef21f42f1929fbf0051ef5b3e P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:27.129591 16987 ts_tablet_manager.cc:1434] T 7b90200ef21f42f1929fbf0051ef5b3e P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.072s	user 0.005s	sys 0.004s
I20260709 12:27:27.130661 16987 tablet_bootstrap.cc:492] T e477f70d4c8d466e9d45e6645e2a2869 P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:27.133235 16717 raft_consensus.cc:3060] T 7b90200ef21f42f1929fbf0051ef5b3e P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:27:27.123481 16833 leader_election.cc:343] T 5868b3bc1ee44923a18d74874a8f3b30 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:27.141752 16614 catalog_manager.cc:5697] T b777ccb9937a476590a534fea0428c5c P 82f27bcdf252425aad4c4a37d064f68d reported cstate change: term changed from 0 to 1, leader changed from <none> to 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68). New cstate: current_term: 1 leader_uuid: "82f27bcdf252425aad4c4a37d064f68d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:27.146121 16991 tablet_bootstrap.cc:492] T 5868b3bc1ee44923a18d74874a8f3b30 P 3c1aba6ee1d244fd9c0daba722aa0b3b: No bootstrap required, opened a new log
I20260709 12:27:27.147012 16991 ts_tablet_manager.cc:1403] T 5868b3bc1ee44923a18d74874a8f3b30 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent bootstrapping tablet: real 0.109s	user 0.016s	sys 0.004s
I20260709 12:27:27.165035 16989 tablet_bootstrap.cc:492] T 514ee26ff21e4c08976b6a0397b730fe P 82f27bcdf252425aad4c4a37d064f68d: No bootstrap required, opened a new log
I20260709 12:27:27.169783 16989 ts_tablet_manager.cc:1403] T 514ee26ff21e4c08976b6a0397b730fe P 82f27bcdf252425aad4c4a37d064f68d: Time spent bootstrapping tablet: real 0.145s	user 0.015s	sys 0.001s
I20260709 12:27:27.173216 16942 raft_consensus.cc:2468] T 7b90200ef21f42f1929fbf0051ef5b3e P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in term 1.
I20260709 12:27:27.148248 16833 leader_election.cc:304] T 5868b3bc1ee44923a18d74874a8f3b30 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 82f27bcdf252425aad4c4a37d064f68d
W20260709 12:27:27.174880 16833 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37919, user_credentials={real_user=slave}} blocked reactor thread for 53433.1us
I20260709 12:27:27.175843 17079 raft_consensus.cc:2749] T 5868b3bc1ee44923a18d74874a8f3b30 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:27.177043 17210 consensus_queue.cc:1048] T 5025c37302bd4a2aa076878e1af90366 P 3c1aba6ee1d244fd9c0daba722aa0b3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:27.178221 16717 raft_consensus.cc:2468] T 7b90200ef21f42f1929fbf0051ef5b3e P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in term 1.
I20260709 12:27:27.199268 16989 raft_consensus.cc:359] T 514ee26ff21e4c08976b6a0397b730fe P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:27.200215 16989 raft_consensus.cc:385] T 514ee26ff21e4c08976b6a0397b730fe P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:27.200515 16989 raft_consensus.cc:740] T 514ee26ff21e4c08976b6a0397b730fe P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f27bcdf252425aad4c4a37d064f68d, State: Initialized, Role: FOLLOWER
I20260709 12:27:27.201413 16989 consensus_queue.cc:260] T 514ee26ff21e4c08976b6a0397b730fe P 82f27bcdf252425aad4c4a37d064f68d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:27.205251 16988 tablet_bootstrap.cc:654] T 514ee26ff21e4c08976b6a0397b730fe P 17294485b7f24e2b9fae71dd3169a336: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:27.211242 16991 raft_consensus.cc:359] T 5868b3bc1ee44923a18d74874a8f3b30 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:27.212178 16991 raft_consensus.cc:385] T 5868b3bc1ee44923a18d74874a8f3b30 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:27.212560 16991 raft_consensus.cc:740] T 5868b3bc1ee44923a18d74874a8f3b30 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c1aba6ee1d244fd9c0daba722aa0b3b, State: Initialized, Role: FOLLOWER
I20260709 12:27:27.214121 16991 consensus_queue.cc:260] T 5868b3bc1ee44923a18d74874a8f3b30 P 3c1aba6ee1d244fd9c0daba722aa0b3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:27.215744 16989 ts_tablet_manager.cc:1434] T 514ee26ff21e4c08976b6a0397b730fe P 82f27bcdf252425aad4c4a37d064f68d: Time spent starting tablet: real 0.045s	user 0.008s	sys 0.001s
I20260709 12:27:27.216023 16987 tablet_bootstrap.cc:654] T e477f70d4c8d466e9d45e6645e2a2869 P 879366e90f5c420588945e0d545017c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:27.217671 16989 tablet_bootstrap.cc:492] T 51d96c645e894c8597652daf12a21cf3 P 82f27bcdf252425aad4c4a37d064f68d: Bootstrap starting.
I20260709 12:27:27.218739 16991 ts_tablet_manager.cc:1434] T 5868b3bc1ee44923a18d74874a8f3b30 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent starting tablet: real 0.070s	user 0.008s	sys 0.000s
I20260709 12:27:27.224622 16991 tablet_bootstrap.cc:492] T e477f70d4c8d466e9d45e6645e2a2869 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Bootstrap starting.
I20260709 12:27:27.213011 16759 leader_election.cc:304] T 7b90200ef21f42f1929fbf0051ef5b3e P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8; no voters: 
W20260709 12:27:27.238996 16759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:39833, user_credentials={real_user=slave}} blocked reactor thread for 48987.4us
I20260709 12:27:27.239216 17210 raft_consensus.cc:2804] T 7b90200ef21f42f1929fbf0051ef5b3e P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:27.240214 17210 raft_consensus.cc:697] T 7b90200ef21f42f1929fbf0051ef5b3e P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 LEADER]: Becoming Leader. State: Replica: 3c1aba6ee1d244fd9c0daba722aa0b3b, State: Running, Role: LEADER
I20260709 12:27:27.241647 17210 consensus_queue.cc:237] T 7b90200ef21f42f1929fbf0051ef5b3e P 3c1aba6ee1d244fd9c0daba722aa0b3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:27.252631 16997 raft_consensus.cc:493] T 514ee26ff21e4c08976b6a0397b730fe P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:27.253468 16997 raft_consensus.cc:515] T 514ee26ff21e4c08976b6a0397b730fe P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:27.237458 16614 catalog_manager.cc:5697] T fe16827e0b4a45baa99739174f92a0f7 P 17294485b7f24e2b9fae71dd3169a336 reported cstate change: term changed from 0 to 1, leader changed from <none> to 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67). New cstate: current_term: 1 leader_uuid: "17294485b7f24e2b9fae71dd3169a336" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:27.270530 16987 tablet_bootstrap.cc:492] T e477f70d4c8d466e9d45e6645e2a2869 P 879366e90f5c420588945e0d545017c8: No bootstrap required, opened a new log
I20260709 12:27:27.271198 16987 ts_tablet_manager.cc:1403] T e477f70d4c8d466e9d45e6645e2a2869 P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.141s	user 0.015s	sys 0.000s
I20260709 12:27:27.274091 16987 raft_consensus.cc:359] T e477f70d4c8d466e9d45e6645e2a2869 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:27.274783 16987 raft_consensus.cc:385] T e477f70d4c8d466e9d45e6645e2a2869 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:27.276777 16868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "514ee26ff21e4c08976b6a0397b730fe" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:27.277329 16987 raft_consensus.cc:740] T e477f70d4c8d466e9d45e6645e2a2869 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:27.278254 16987 consensus_queue.cc:260] T e477f70d4c8d466e9d45e6645e2a2869 P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:27.279011 16997 leader_election.cc:290] T 514ee26ff21e4c08976b6a0397b730fe P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:27.282109 16988 tablet_bootstrap.cc:492] T 514ee26ff21e4c08976b6a0397b730fe P 17294485b7f24e2b9fae71dd3169a336: No bootstrap required, opened a new log
I20260709 12:27:27.282644 16988 ts_tablet_manager.cc:1403] T 514ee26ff21e4c08976b6a0397b730fe P 17294485b7f24e2b9fae71dd3169a336: Time spent bootstrapping tablet: real 0.253s	user 0.021s	sys 0.008s
W20260709 12:27:27.284051 16907 leader_election.cc:343] T 514ee26ff21e4c08976b6a0397b730fe P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:27.289860 16987 ts_tablet_manager.cc:1434] T e477f70d4c8d466e9d45e6645e2a2869 P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.001s
I20260709 12:27:27.290755 16987 tablet_bootstrap.cc:492] T 3649e7bb023a4958a01ad5ecbe446f0f P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:27.293792 16988 raft_consensus.cc:359] T 514ee26ff21e4c08976b6a0397b730fe P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:27.294682 16988 raft_consensus.cc:385] T 514ee26ff21e4c08976b6a0397b730fe P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:27.295007 16988 raft_consensus.cc:740] T 514ee26ff21e4c08976b6a0397b730fe P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Initialized, Role: FOLLOWER
I20260709 12:27:27.295727 16988 consensus_queue.cc:260] T 514ee26ff21e4c08976b6a0397b730fe P 17294485b7f24e2b9fae71dd3169a336 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:27.297646 16988 ts_tablet_manager.cc:1434] T 514ee26ff21e4c08976b6a0397b730fe P 17294485b7f24e2b9fae71dd3169a336: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:27:27.298496 16988 tablet_bootstrap.cc:492] T e477f70d4c8d466e9d45e6645e2a2869 P 17294485b7f24e2b9fae71dd3169a336: Bootstrap starting.
I20260709 12:27:27.299032 16717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "514ee26ff21e4c08976b6a0397b730fe" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8" is_pre_election: true
I20260709 12:27:27.305198 16988 tablet_bootstrap.cc:654] T e477f70d4c8d466e9d45e6645e2a2869 P 17294485b7f24e2b9fae71dd3169a336: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:27.307955 16991 tablet_bootstrap.cc:654] T e477f70d4c8d466e9d45e6645e2a2869 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:27.317327 17212 raft_consensus.cc:493] T 9067b67140fa48e883d2d240a6046d63 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:27.317916 17212 raft_consensus.cc:515] T 9067b67140fa48e883d2d240a6046d63 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:27.319741 16987 tablet_bootstrap.cc:654] T 3649e7bb023a4958a01ad5ecbe446f0f P 879366e90f5c420588945e0d545017c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:27.320730 17212 leader_election.cc:290] T 9067b67140fa48e883d2d240a6046d63 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
I20260709 12:27:27.330088 16715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9067b67140fa48e883d2d240a6046d63" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8" is_pre_election: true
I20260709 12:27:27.333976 16868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9067b67140fa48e883d2d240a6046d63" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
W20260709 12:27:27.328073 16907 leader_election.cc:343] T 514ee26ff21e4c08976b6a0397b730fe P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:27.335995 16907 leader_election.cc:304] T 514ee26ff21e4c08976b6a0397b730fe P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8
I20260709 12:27:27.338333 16997 raft_consensus.cc:2749] T 514ee26ff21e4c08976b6a0397b730fe P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:27:27.337527 16759 leader_election.cc:343] T 9067b67140fa48e883d2d240a6046d63 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:27.347836 16987 tablet_bootstrap.cc:492] T 3649e7bb023a4958a01ad5ecbe446f0f P 879366e90f5c420588945e0d545017c8: No bootstrap required, opened a new log
W20260709 12:27:27.348276 16759 leader_election.cc:343] T 9067b67140fa48e883d2d240a6046d63 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:27.348608 16987 ts_tablet_manager.cc:1403] T 3649e7bb023a4958a01ad5ecbe446f0f P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.058s	user 0.010s	sys 0.008s
I20260709 12:27:27.348814 16759 leader_election.cc:304] T 9067b67140fa48e883d2d240a6046d63 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b; no voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8
I20260709 12:27:27.349870 17210 raft_consensus.cc:2749] T 9067b67140fa48e883d2d240a6046d63 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:27.351272 17016 raft_consensus.cc:493] T 442e0dfc272840f7a14c2232ed65425c P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:27.351962 17016 raft_consensus.cc:515] T 442e0dfc272840f7a14c2232ed65425c P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:27.352497 16987 raft_consensus.cc:359] T 3649e7bb023a4958a01ad5ecbe446f0f P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:27.353214 16987 raft_consensus.cc:385] T 3649e7bb023a4958a01ad5ecbe446f0f P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:27.353484 16987 raft_consensus.cc:740] T 3649e7bb023a4958a01ad5ecbe446f0f P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:27.354144 17016 leader_election.cc:290] T 442e0dfc272840f7a14c2232ed65425c P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:27.363953 17079 raft_consensus.cc:493] T 3649e7bb023a4958a01ad5ecbe446f0f P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:27.354261 16987 consensus_queue.cc:260] T 3649e7bb023a4958a01ad5ecbe446f0f P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:27.371098 17079 raft_consensus.cc:515] T 3649e7bb023a4958a01ad5ecbe446f0f P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:27.375619 16987 ts_tablet_manager.cc:1434] T 3649e7bb023a4958a01ad5ecbe446f0f P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 12:27:27.376214 16989 tablet_bootstrap.cc:654] T 51d96c645e894c8597652daf12a21cf3 P 82f27bcdf252425aad4c4a37d064f68d: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:27.377008 16987 tablet_bootstrap.cc:492] T 9067b67140fa48e883d2d240a6046d63 P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:27.380746 16715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442e0dfc272840f7a14c2232ed65425c" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8" is_pre_election: true
I20260709 12:27:27.383936 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3649e7bb023a4958a01ad5ecbe446f0f" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:27.384984 17079 leader_election.cc:290] T 3649e7bb023a4958a01ad5ecbe446f0f P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:27.385540 16941 raft_consensus.cc:3060] T cfc80a8e57c24a768ebc48dd544a6c80 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:27:27.387413 16833 leader_election.cc:343] T 3649e7bb023a4958a01ad5ecbe446f0f P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:27.393319 16987 tablet_bootstrap.cc:654] T 9067b67140fa48e883d2d240a6046d63 P 879366e90f5c420588945e0d545017c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:27.394277 16616 catalog_manager.cc:5697] T 7b90200ef21f42f1929fbf0051ef5b3e P 3c1aba6ee1d244fd9c0daba722aa0b3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66). New cstate: current_term: 1 leader_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:27.406224 16987 tablet_bootstrap.cc:492] T 9067b67140fa48e883d2d240a6046d63 P 879366e90f5c420588945e0d545017c8: No bootstrap required, opened a new log
I20260709 12:27:27.406977 16987 ts_tablet_manager.cc:1403] T 9067b67140fa48e883d2d240a6046d63 P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.004s
I20260709 12:27:27.407090 16717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3649e7bb023a4958a01ad5ecbe446f0f" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8" is_pre_election: true
I20260709 12:27:27.407954 16717 raft_consensus.cc:2468] T 3649e7bb023a4958a01ad5ecbe446f0f P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 0.
I20260709 12:27:27.409593 16833 leader_election.cc:304] T 3649e7bb023a4958a01ad5ecbe446f0f P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8; no voters: 82f27bcdf252425aad4c4a37d064f68d
I20260709 12:27:27.410573 17079 raft_consensus.cc:2804] T 3649e7bb023a4958a01ad5ecbe446f0f P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:27.411007 17079 raft_consensus.cc:493] T 3649e7bb023a4958a01ad5ecbe446f0f P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:27.411370 17079 raft_consensus.cc:3060] T 3649e7bb023a4958a01ad5ecbe446f0f P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:27.413129 16717 raft_consensus.cc:3060] T a0409dc146674a39a9ceeeeebc081453 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:27:27.416625 16759 leader_election.cc:343] T 442e0dfc272840f7a14c2232ed65425c P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:27.417840 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442e0dfc272840f7a14c2232ed65425c" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:27.423863 16987 raft_consensus.cc:359] T 9067b67140fa48e883d2d240a6046d63 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:27.424829 16987 raft_consensus.cc:385] T 9067b67140fa48e883d2d240a6046d63 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:27.425098 16987 raft_consensus.cc:740] T 9067b67140fa48e883d2d240a6046d63 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:27.425112 16988 tablet_bootstrap.cc:492] T e477f70d4c8d466e9d45e6645e2a2869 P 17294485b7f24e2b9fae71dd3169a336: No bootstrap required, opened a new log
I20260709 12:27:27.425917 16988 ts_tablet_manager.cc:1403] T e477f70d4c8d466e9d45e6645e2a2869 P 17294485b7f24e2b9fae71dd3169a336: Time spent bootstrapping tablet: real 0.128s	user 0.053s	sys 0.067s
I20260709 12:27:27.426625 17079 raft_consensus.cc:515] T 3649e7bb023a4958a01ad5ecbe446f0f P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:27.428797 16987 consensus_queue.cc:260] T 9067b67140fa48e883d2d240a6046d63 P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:27.429098 16988 raft_consensus.cc:359] T e477f70d4c8d466e9d45e6645e2a2869 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:27.429883 16988 raft_consensus.cc:385] T e477f70d4c8d466e9d45e6645e2a2869 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:27.430210 16988 raft_consensus.cc:740] T e477f70d4c8d466e9d45e6645e2a2869 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Initialized, Role: FOLLOWER
W20260709 12:27:27.430655 16759 leader_election.cc:343] T 442e0dfc272840f7a14c2232ed65425c P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:27.432539 16759 leader_election.cc:304] T 442e0dfc272840f7a14c2232ed65425c P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b; no voters: 82f27bcdf252425aad4c4a37d064f68d, 879366e90f5c420588945e0d545017c8
I20260709 12:27:27.433272 16987 ts_tablet_manager.cc:1434] T 9067b67140fa48e883d2d240a6046d63 P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.001s
I20260709 12:27:27.430969 16988 consensus_queue.cc:260] T e477f70d4c8d466e9d45e6645e2a2869 P 17294485b7f24e2b9fae71dd3169a336 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:27.434553 17079 leader_election.cc:290] T 3649e7bb023a4958a01ad5ecbe446f0f P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 election: Requested vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:27.436388 16988 ts_tablet_manager.cc:1434] T e477f70d4c8d466e9d45e6645e2a2869 P 17294485b7f24e2b9fae71dd3169a336: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:27:27.436829 16715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3649e7bb023a4958a01ad5ecbe446f0f" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8"
I20260709 12:27:27.437486 16715 raft_consensus.cc:3060] T 3649e7bb023a4958a01ad5ecbe446f0f P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:27.435724 17016 raft_consensus.cc:2749] T 442e0dfc272840f7a14c2232ed65425c P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:27.431348 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3649e7bb023a4958a01ad5ecbe446f0f" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d"
W20260709 12:27:27.444577 16833 leader_election.cc:343] T 3649e7bb023a4958a01ad5ecbe446f0f P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:27.446806 16988 tablet_bootstrap.cc:492] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 17294485b7f24e2b9fae71dd3169a336: Bootstrap starting.
I20260709 12:27:27.448992 17016 raft_consensus.cc:493] T 5868b3bc1ee44923a18d74874a8f3b30 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:27.449775 17016 raft_consensus.cc:515] T 5868b3bc1ee44923a18d74874a8f3b30 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:27.452186 17016 leader_election.cc:290] T 5868b3bc1ee44923a18d74874a8f3b30 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919)
I20260709 12:27:27.456308 16987 tablet_bootstrap.cc:492] T 514ee26ff21e4c08976b6a0397b730fe P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:27.469183 16997 raft_consensus.cc:493] T cfc80a8e57c24a768ebc48dd544a6c80 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:27.469826 16997 raft_consensus.cc:515] T cfc80a8e57c24a768ebc48dd544a6c80 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:27.472265 16997 leader_election.cc:290] T cfc80a8e57c24a768ebc48dd544a6c80 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
I20260709 12:27:27.473181 17079 consensus_queue.cc:1048] T cfc80a8e57c24a768ebc48dd544a6c80 P 17294485b7f24e2b9fae71dd3169a336 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:27.475453 16988 tablet_bootstrap.cc:654] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 17294485b7f24e2b9fae71dd3169a336: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:27.475276 16794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc80a8e57c24a768ebc48dd544a6c80" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
I20260709 12:27:27.477774 16794 raft_consensus.cc:2468] T cfc80a8e57c24a768ebc48dd544a6c80 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82f27bcdf252425aad4c4a37d064f68d in term 1.
I20260709 12:27:27.479372 16908 leader_election.cc:304] T cfc80a8e57c24a768ebc48dd544a6c80 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 82f27bcdf252425aad4c4a37d064f68d; no voters: 
I20260709 12:27:27.481519 17089 raft_consensus.cc:493] T e477f70d4c8d466e9d45e6645e2a2869 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:27.482033 16989 tablet_bootstrap.cc:492] T 51d96c645e894c8597652daf12a21cf3 P 82f27bcdf252425aad4c4a37d064f68d: No bootstrap required, opened a new log
I20260709 12:27:27.482659 16989 ts_tablet_manager.cc:1403] T 51d96c645e894c8597652daf12a21cf3 P 82f27bcdf252425aad4c4a37d064f68d: Time spent bootstrapping tablet: real 0.266s	user 0.012s	sys 0.007s
I20260709 12:27:27.482089 17089 raft_consensus.cc:515] T e477f70d4c8d466e9d45e6645e2a2869 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:27.482954 16991 tablet_bootstrap.cc:492] T e477f70d4c8d466e9d45e6645e2a2869 P 3c1aba6ee1d244fd9c0daba722aa0b3b: No bootstrap required, opened a new log
I20260709 12:27:27.483425 16991 ts_tablet_manager.cc:1403] T e477f70d4c8d466e9d45e6645e2a2869 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent bootstrapping tablet: real 0.259s	user 0.017s	sys 0.008s
I20260709 12:27:27.485291 16989 raft_consensus.cc:359] T 51d96c645e894c8597652daf12a21cf3 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:27.485889 17089 leader_election.cc:290] T e477f70d4c8d466e9d45e6645e2a2869 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
I20260709 12:27:27.486363 16989 raft_consensus.cc:385] T 51d96c645e894c8597652daf12a21cf3 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:27.487457 16989 raft_consensus.cc:740] T 51d96c645e894c8597652daf12a21cf3 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f27bcdf252425aad4c4a37d064f68d, State: Initialized, Role: FOLLOWER
I20260709 12:27:27.487522 16794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e477f70d4c8d466e9d45e6645e2a2869" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
I20260709 12:27:27.488198 16867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc80a8e57c24a768ebc48dd544a6c80" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:27.488631 16989 consensus_queue.cc:260] T 51d96c645e894c8597652daf12a21cf3 P 82f27bcdf252425aad4c4a37d064f68d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:27.490751 16987 tablet_bootstrap.cc:654] T 514ee26ff21e4c08976b6a0397b730fe P 879366e90f5c420588945e0d545017c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:27.490849 16867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e477f70d4c8d466e9d45e6645e2a2869" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:27.491389 16989 ts_tablet_manager.cc:1434] T 51d96c645e894c8597652daf12a21cf3 P 82f27bcdf252425aad4c4a37d064f68d: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:27:27.491791 16867 raft_consensus.cc:2468] T e477f70d4c8d466e9d45e6645e2a2869 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 0.
I20260709 12:27:27.492530 16989 tablet_bootstrap.cc:492] T 3649e7bb023a4958a01ad5ecbe446f0f P 82f27bcdf252425aad4c4a37d064f68d: Bootstrap starting.
I20260709 12:27:27.486271 16991 raft_consensus.cc:359] T e477f70d4c8d466e9d45e6645e2a2869 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:27.494057 16991 raft_consensus.cc:385] T e477f70d4c8d466e9d45e6645e2a2869 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:27.494391 16991 raft_consensus.cc:740] T e477f70d4c8d466e9d45e6645e2a2869 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c1aba6ee1d244fd9c0daba722aa0b3b, State: Initialized, Role: FOLLOWER
I20260709 12:27:27.495296 16991 consensus_queue.cc:260] T e477f70d4c8d466e9d45e6645e2a2869 P 3c1aba6ee1d244fd9c0daba722aa0b3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:27.494251 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5868b3bc1ee44923a18d74874a8f3b30" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:27.496717 16684 leader_election.cc:304] T e477f70d4c8d466e9d45e6645e2a2869 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8; no voters: 
I20260709 12:27:27.497815 16794 raft_consensus.cc:2468] T e477f70d4c8d466e9d45e6645e2a2869 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 0.
I20260709 12:27:27.498849 16991 ts_tablet_manager.cc:1434] T e477f70d4c8d466e9d45e6645e2a2869 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:27:27.503329 16867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5868b3bc1ee44923a18d74874a8f3b30" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:27.504237 16867 raft_consensus.cc:2468] T 5868b3bc1ee44923a18d74874a8f3b30 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in term 0.
I20260709 12:27:27.506388 17089 raft_consensus.cc:2804] T e477f70d4c8d466e9d45e6645e2a2869 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:27.507017 17089 raft_consensus.cc:493] T e477f70d4c8d466e9d45e6645e2a2869 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:27.508387 16991 tablet_bootstrap.cc:492] T 51d96c645e894c8597652daf12a21cf3 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Bootstrap starting.
I20260709 12:27:27.508595 16759 leader_election.cc:304] T 5868b3bc1ee44923a18d74874a8f3b30 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 3c1aba6ee1d244fd9c0daba722aa0b3b; no voters: 
I20260709 12:27:27.508726 17079 consensus_queue.cc:1048] T fe16827e0b4a45baa99739174f92a0f7 P 17294485b7f24e2b9fae71dd3169a336 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:27.507508 17089 raft_consensus.cc:3060] T e477f70d4c8d466e9d45e6645e2a2869 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:27.517077 17016 raft_consensus.cc:2804] T 5868b3bc1ee44923a18d74874a8f3b30 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:27.524606 17016 raft_consensus.cc:493] T 5868b3bc1ee44923a18d74874a8f3b30 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:27.525221 17016 raft_consensus.cc:3060] T 5868b3bc1ee44923a18d74874a8f3b30 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:27.531875 17048 raft_consensus.cc:493] T 9067b67140fa48e883d2d240a6046d63 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:27.534693 16715 raft_consensus.cc:2468] T 3649e7bb023a4958a01ad5ecbe446f0f P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 1.
I20260709 12:27:27.535189 17048 raft_consensus.cc:515] T 9067b67140fa48e883d2d240a6046d63 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:27.541158 16833 leader_election.cc:304] T 3649e7bb023a4958a01ad5ecbe446f0f P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8; no voters: 82f27bcdf252425aad4c4a37d064f68d
I20260709 12:27:27.551337 17115 raft_consensus.cc:493] T 514ee26ff21e4c08976b6a0397b730fe P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:27.552210 17115 raft_consensus.cc:515] T 514ee26ff21e4c08976b6a0397b730fe P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:27.560525 17079 raft_consensus.cc:2804] T 3649e7bb023a4958a01ad5ecbe446f0f P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:27:27.557686 16759 leader_election.cc:343] T 5868b3bc1ee44923a18d74874a8f3b30 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:27.575654 17016 raft_consensus.cc:515] T 5868b3bc1ee44923a18d74874a8f3b30 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:27.577935 16989 tablet_bootstrap.cc:654] T 3649e7bb023a4958a01ad5ecbe446f0f P 82f27bcdf252425aad4c4a37d064f68d: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:27.586453 16988 tablet_bootstrap.cc:492] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 17294485b7f24e2b9fae71dd3169a336: No bootstrap required, opened a new log
I20260709 12:27:27.587672 16988 ts_tablet_manager.cc:1403] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 17294485b7f24e2b9fae71dd3169a336: Time spent bootstrapping tablet: real 0.141s	user 0.020s	sys 0.014s
I20260709 12:27:27.571928 17069 raft_consensus.cc:2804] T cfc80a8e57c24a768ebc48dd544a6c80 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:27.604477 17016 leader_election.cc:290] T 5868b3bc1ee44923a18d74874a8f3b30 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 election: Requested vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919)
I20260709 12:27:27.622376 17069 raft_consensus.cc:493] T cfc80a8e57c24a768ebc48dd544a6c80 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 17294485b7f24e2b9fae71dd3169a336)
I20260709 12:27:27.623078 17069 raft_consensus.cc:3060] T cfc80a8e57c24a768ebc48dd544a6c80 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:27:27.605126 16759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37919, user_credentials={real_user=slave}} blocked reactor thread for 48446.2us
I20260709 12:27:27.611284 17048 leader_election.cc:290] T 9067b67140fa48e883d2d240a6046d63 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
I20260709 12:27:27.624253 17115 leader_election.cc:290] T 514ee26ff21e4c08976b6a0397b730fe P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:27.639940 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "514ee26ff21e4c08976b6a0397b730fe" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:27.640750 16941 raft_consensus.cc:2468] T 514ee26ff21e4c08976b6a0397b730fe P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 0.
I20260709 12:27:27.641520 16792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9067b67140fa48e883d2d240a6046d63" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
I20260709 12:27:27.642530 17089 raft_consensus.cc:515] T e477f70d4c8d466e9d45e6645e2a2869 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:27.642799 16792 raft_consensus.cc:2468] T 9067b67140fa48e883d2d240a6046d63 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 0.
I20260709 12:27:27.616978 17219 raft_consensus.cc:493] T 51d96c645e894c8597652daf12a21cf3 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:27.654068 16987 tablet_bootstrap.cc:492] T 514ee26ff21e4c08976b6a0397b730fe P 879366e90f5c420588945e0d545017c8: No bootstrap required, opened a new log
I20260709 12:27:27.653895 17219 raft_consensus.cc:515] T 51d96c645e894c8597652daf12a21cf3 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:27.654870 16987 ts_tablet_manager.cc:1403] T 514ee26ff21e4c08976b6a0397b730fe P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.200s	user 0.022s	sys 0.034s
I20260709 12:27:27.657235 16988 raft_consensus.cc:359] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:27.658488 16988 raft_consensus.cc:385] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:27.658886 16988 raft_consensus.cc:740] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Initialized, Role: FOLLOWER
I20260709 12:27:27.659894 16988 consensus_queue.cc:260] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 17294485b7f24e2b9fae71dd3169a336 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:27.667868 16718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "514ee26ff21e4c08976b6a0397b730fe" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8" is_pre_election: true
I20260709 12:27:27.670773 17212 consensus_queue.cc:1048] T a0409dc146674a39a9ceeeeebc081453 P 3c1aba6ee1d244fd9c0daba722aa0b3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:27.674041 16988 ts_tablet_manager.cc:1434] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 17294485b7f24e2b9fae71dd3169a336: Time spent starting tablet: real 0.086s	user 0.010s	sys 0.000s
I20260709 12:27:27.675360 16988 tablet_bootstrap.cc:492] T 9067b67140fa48e883d2d240a6046d63 P 17294485b7f24e2b9fae71dd3169a336: Bootstrap starting.
I20260709 12:27:27.689458 17219 leader_election.cc:290] T 51d96c645e894c8597652daf12a21cf3 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
I20260709 12:27:27.691814 16991 tablet_bootstrap.cc:654] T 51d96c645e894c8597652daf12a21cf3 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:27.692916 16867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5868b3bc1ee44923a18d74874a8f3b30" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336"
I20260709 12:27:27.693778 16867 raft_consensus.cc:3060] T 5868b3bc1ee44923a18d74874a8f3b30 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:27.693457 16987 raft_consensus.cc:359] T 514ee26ff21e4c08976b6a0397b730fe P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:27.694199 16987 raft_consensus.cc:385] T 514ee26ff21e4c08976b6a0397b730fe P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:27.694489 16987 raft_consensus.cc:740] T 514ee26ff21e4c08976b6a0397b730fe P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:27.695269 16987 consensus_queue.cc:260] T 514ee26ff21e4c08976b6a0397b730fe P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:27.711460 16987 ts_tablet_manager.cc:1434] T 514ee26ff21e4c08976b6a0397b730fe P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.056s	user 0.004s	sys 0.004s
I20260709 12:27:27.712985 16987 tablet_bootstrap.cc:492] T 442e0dfc272840f7a14c2232ed65425c P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:27.709005 17079 raft_consensus.cc:697] T 3649e7bb023a4958a01ad5ecbe446f0f P 17294485b7f24e2b9fae71dd3169a336 [term 1 LEADER]: Becoming Leader. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Running, Role: LEADER
I20260709 12:27:27.738905 17079 consensus_queue.cc:237] T 3649e7bb023a4958a01ad5ecbe446f0f P 17294485b7f24e2b9fae71dd3169a336 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:27.743961 17089 leader_election.cc:290] T e477f70d4c8d466e9d45e6645e2a2869 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 election: Requested vote from peers 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
I20260709 12:27:27.728679 16685 leader_election.cc:304] T 9067b67140fa48e883d2d240a6046d63 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8; no voters: 
I20260709 12:27:27.748556 16793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e477f70d4c8d466e9d45e6645e2a2869" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b"
I20260709 12:27:27.749097 16868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9067b67140fa48e883d2d240a6046d63" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:27.749432 16867 raft_consensus.cc:2468] T 5868b3bc1ee44923a18d74874a8f3b30 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in term 1.
I20260709 12:27:27.751545 16759 leader_election.cc:304] T 5868b3bc1ee44923a18d74874a8f3b30 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 3c1aba6ee1d244fd9c0daba722aa0b3b; no voters: 
I20260709 12:27:27.752490 17016 raft_consensus.cc:2804] T 5868b3bc1ee44923a18d74874a8f3b30 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:27.753028 17016 raft_consensus.cc:697] T 5868b3bc1ee44923a18d74874a8f3b30 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 LEADER]: Becoming Leader. State: Replica: 3c1aba6ee1d244fd9c0daba722aa0b3b, State: Running, Role: LEADER
I20260709 12:27:27.716847 17215 consensus_queue.cc:1048] T fe16827e0b4a45baa99739174f92a0f7 P 17294485b7f24e2b9fae71dd3169a336 [LEADER]: Connected to new peer: Peer: permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 12:27:27.753890 17016 consensus_queue.cc:237] T 5868b3bc1ee44923a18d74874a8f3b30 P 3c1aba6ee1d244fd9c0daba722aa0b3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:27.756176 16988 tablet_bootstrap.cc:654] T 9067b67140fa48e883d2d240a6046d63 P 17294485b7f24e2b9fae71dd3169a336: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:27.756522 17069 raft_consensus.cc:515] T cfc80a8e57c24a768ebc48dd544a6c80 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:27.749269 16793 raft_consensus.cc:3060] T e477f70d4c8d466e9d45e6645e2a2869 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:27.757236 16989 tablet_bootstrap.cc:492] T 3649e7bb023a4958a01ad5ecbe446f0f P 82f27bcdf252425aad4c4a37d064f68d: No bootstrap required, opened a new log
I20260709 12:27:27.759284 16989 ts_tablet_manager.cc:1403] T 3649e7bb023a4958a01ad5ecbe446f0f P 82f27bcdf252425aad4c4a37d064f68d: Time spent bootstrapping tablet: real 0.267s	user 0.013s	sys 0.008s
I20260709 12:27:27.760172 17089 raft_consensus.cc:2804] T 9067b67140fa48e883d2d240a6046d63 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:27.780476 17069 leader_election.cc:290] T cfc80a8e57c24a768ebc48dd544a6c80 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 election: Requested vote from peers 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
I20260709 12:27:27.780894 17212 consensus_queue.cc:1048] T 7b90200ef21f42f1929fbf0051ef5b3e P 3c1aba6ee1d244fd9c0daba722aa0b3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:27.785410 16788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc80a8e57c24a768ebc48dd544a6c80" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b"
I20260709 12:27:27.786664 16788 raft_consensus.cc:3060] T cfc80a8e57c24a768ebc48dd544a6c80 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:27.786794 16792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d96c645e894c8597652daf12a21cf3" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
I20260709 12:27:27.789144 17048 raft_consensus.cc:493] T 514ee26ff21e4c08976b6a0397b730fe P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:27.789748 16833 leader_election.cc:304] T 514ee26ff21e4c08976b6a0397b730fe P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 82f27bcdf252425aad4c4a37d064f68d; no voters: 
I20260709 12:27:27.790118 17048 raft_consensus.cc:515] T 514ee26ff21e4c08976b6a0397b730fe P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:27.791787 16718 raft_consensus.cc:2468] T 514ee26ff21e4c08976b6a0397b730fe P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 0.
I20260709 12:27:27.800014 16989 raft_consensus.cc:359] T 3649e7bb023a4958a01ad5ecbe446f0f P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:27.801234 16989 raft_consensus.cc:385] T 3649e7bb023a4958a01ad5ecbe446f0f P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:27.801808 16989 raft_consensus.cc:740] T 3649e7bb023a4958a01ad5ecbe446f0f P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f27bcdf252425aad4c4a37d064f68d, State: Initialized, Role: FOLLOWER
I20260709 12:27:27.802814 16989 consensus_queue.cc:260] T 3649e7bb023a4958a01ad5ecbe446f0f P 82f27bcdf252425aad4c4a37d064f68d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:27.762262 17247 consensus_queue.cc:1048] T cfc80a8e57c24a768ebc48dd544a6c80 P 17294485b7f24e2b9fae71dd3169a336 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.033s
I20260709 12:27:27.792476 17089 raft_consensus.cc:493] T 9067b67140fa48e883d2d240a6046d63 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:27.811945 17048 leader_election.cc:290] T 514ee26ff21e4c08976b6a0397b730fe P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919)
W20260709 12:27:27.818045 16665 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 12:27:27.809801 16908 leader_election.cc:343] T 51d96c645e894c8597652daf12a21cf3 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:27.797070 17215 raft_consensus.cc:2804] T 514ee26ff21e4c08976b6a0397b730fe P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:27.824492 17089 raft_consensus.cc:3060] T 9067b67140fa48e883d2d240a6046d63 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:27.843184 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5868b3bc1ee44923a18d74874a8f3b30" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d"
I20260709 12:27:27.847754 16864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e477f70d4c8d466e9d45e6645e2a2869" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336"
I20260709 12:27:27.848731 16864 raft_consensus.cc:3060] T e477f70d4c8d466e9d45e6645e2a2869 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:27.832866 17215 raft_consensus.cc:493] T 514ee26ff21e4c08976b6a0397b730fe P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:27.860013 17215 raft_consensus.cc:3060] T 514ee26ff21e4c08976b6a0397b730fe P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:27.865662 16864 raft_consensus.cc:2468] T e477f70d4c8d466e9d45e6645e2a2869 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 1.
I20260709 12:27:27.867254 16939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "514ee26ff21e4c08976b6a0397b730fe" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:27.874459 16939 raft_consensus.cc:2468] T 514ee26ff21e4c08976b6a0397b730fe P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 0.
I20260709 12:27:27.877136 16991 tablet_bootstrap.cc:492] T 51d96c645e894c8597652daf12a21cf3 P 3c1aba6ee1d244fd9c0daba722aa0b3b: No bootstrap required, opened a new log
I20260709 12:27:27.877826 16991 ts_tablet_manager.cc:1403] T 51d96c645e894c8597652daf12a21cf3 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent bootstrapping tablet: real 0.370s	user 0.016s	sys 0.013s
I20260709 12:27:27.838167 16989 ts_tablet_manager.cc:1434] T 3649e7bb023a4958a01ad5ecbe446f0f P 82f27bcdf252425aad4c4a37d064f68d: Time spent starting tablet: real 0.078s	user 0.006s	sys 0.002s
W20260709 12:27:27.870149 16684 leader_election.cc:343] T 9067b67140fa48e883d2d240a6046d63 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:27.889585 16989 tablet_bootstrap.cc:492] T 5868b3bc1ee44923a18d74874a8f3b30 P 82f27bcdf252425aad4c4a37d064f68d: Bootstrap starting.
I20260709 12:27:27.916720 16864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "514ee26ff21e4c08976b6a0397b730fe" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:27.919338 16788 raft_consensus.cc:2468] T cfc80a8e57c24a768ebc48dd544a6c80 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82f27bcdf252425aad4c4a37d064f68d in term 2.
I20260709 12:27:27.924412 16991 raft_consensus.cc:359] T 51d96c645e894c8597652daf12a21cf3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:27.925777 16991 raft_consensus.cc:385] T 51d96c645e894c8597652daf12a21cf3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:27.926373 16991 raft_consensus.cc:740] T 51d96c645e894c8597652daf12a21cf3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c1aba6ee1d244fd9c0daba722aa0b3b, State: Initialized, Role: FOLLOWER
W20260709 12:27:27.914234 16684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:38103, user_credentials={real_user=slave}} blocked reactor thread for 44143.8us
I20260709 12:27:27.927114 16991 consensus_queue.cc:260] T 51d96c645e894c8597652daf12a21cf3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:27.931388 16987 tablet_bootstrap.cc:654] T 442e0dfc272840f7a14c2232ed65425c P 879366e90f5c420588945e0d545017c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:27.931936 16684 leader_election.cc:304] T e477f70d4c8d466e9d45e6645e2a2869 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8; no voters: 
W20260709 12:27:27.938293 16833 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37919, user_credentials={real_user=slave}} blocked reactor thread for 147054us
I20260709 12:27:27.930384 16908 leader_election.cc:304] T cfc80a8e57c24a768ebc48dd544a6c80 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 82f27bcdf252425aad4c4a37d064f68d; no voters: 
W20260709 12:27:27.930099 16834 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:43629, user_credentials={real_user=slave}} blocked reactor thread for 172899us
I20260709 12:27:27.954990 17069 raft_consensus.cc:2804] T cfc80a8e57c24a768ebc48dd544a6c80 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:27.955981 16865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d96c645e894c8597652daf12a21cf3" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:27.956403 17069 raft_consensus.cc:697] T cfc80a8e57c24a768ebc48dd544a6c80 P 82f27bcdf252425aad4c4a37d064f68d [term 2 LEADER]: Becoming Leader. State: Replica: 82f27bcdf252425aad4c4a37d064f68d, State: Running, Role: LEADER
I20260709 12:27:27.957682 17076 raft_consensus.cc:2804] T e477f70d4c8d466e9d45e6645e2a2869 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:27.957566 17069 consensus_queue.cc:237] T cfc80a8e57c24a768ebc48dd544a6c80 P 82f27bcdf252425aad4c4a37d064f68d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:27.958324 17076 raft_consensus.cc:697] T e477f70d4c8d466e9d45e6645e2a2869 P 879366e90f5c420588945e0d545017c8 [term 1 LEADER]: Becoming Leader. State: Replica: 879366e90f5c420588945e0d545017c8, State: Running, Role: LEADER
I20260709 12:27:27.958838 16868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc80a8e57c24a768ebc48dd544a6c80" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336"
I20260709 12:27:27.963536 16989 tablet_bootstrap.cc:654] T 5868b3bc1ee44923a18d74874a8f3b30 P 82f27bcdf252425aad4c4a37d064f68d: Neither blocks nor log segments found. Creating new log.
W20260709 12:27:27.982908 16684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:38103, user_credentials={real_user=slave}} blocked reactor thread for 51049.4us
I20260709 12:27:27.959499 17076 consensus_queue.cc:237] T e477f70d4c8d466e9d45e6645e2a2869 P 879366e90f5c420588945e0d545017c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:28.001418 16988 tablet_bootstrap.cc:492] T 9067b67140fa48e883d2d240a6046d63 P 17294485b7f24e2b9fae71dd3169a336: No bootstrap required, opened a new log
I20260709 12:27:28.031826 16988 ts_tablet_manager.cc:1403] T 9067b67140fa48e883d2d240a6046d63 P 17294485b7f24e2b9fae71dd3169a336: Time spent bootstrapping tablet: real 0.357s	user 0.020s	sys 0.016s
I20260709 12:27:27.990969 17215 raft_consensus.cc:515] T 514ee26ff21e4c08976b6a0397b730fe P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:28.010268 16616 catalog_manager.cc:5697] T 3649e7bb023a4958a01ad5ecbe446f0f P 17294485b7f24e2b9fae71dd3169a336 reported cstate change: term changed from 0 to 1, leader changed from <none> to 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67). New cstate: current_term: 1 leader_uuid: "17294485b7f24e2b9fae71dd3169a336" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:28.013882 16991 ts_tablet_manager.cc:1434] T 51d96c645e894c8597652daf12a21cf3 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent starting tablet: real 0.136s	user 0.012s	sys 0.004s
I20260709 12:27:28.014830 17265 consensus_queue.cc:1048] T a0409dc146674a39a9ceeeeebc081453 P 3c1aba6ee1d244fd9c0daba722aa0b3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:27:28.015285 16759 leader_election.cc:343] T 5868b3bc1ee44923a18d74874a8f3b30 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:28.029299 17089 raft_consensus.cc:515] T 9067b67140fa48e883d2d240a6046d63 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:28.021557 17219 consensus_queue.cc:1048] T b777ccb9937a476590a534fea0428c5c P 82f27bcdf252425aad4c4a37d064f68d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:28.023749 16788 raft_consensus.cc:1240] T cfc80a8e57c24a768ebc48dd544a6c80 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Rejecting Update request from peer 17294485b7f24e2b9fae71dd3169a336 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:27:28.033377 16684 leader_election.cc:304] T 514ee26ff21e4c08976b6a0397b730fe P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d, 879366e90f5c420588945e0d545017c8; no voters: 
I20260709 12:27:28.036394 16991 tablet_bootstrap.cc:492] T 62e4e875fd4e4604952120df324e99cb P 3c1aba6ee1d244fd9c0daba722aa0b3b: Bootstrap starting.
W20260709 12:27:28.020634 16907 leader_election.cc:343] T 51d96c645e894c8597652daf12a21cf3 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:28.051929 16793 raft_consensus.cc:2468] T e477f70d4c8d466e9d45e6645e2a2869 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 1.
I20260709 12:27:28.053469 17079 consensus_queue.cc:1059] T cfc80a8e57c24a768ebc48dd544a6c80 P 17294485b7f24e2b9fae71dd3169a336 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:28.054504 17115 raft_consensus.cc:3055] T cfc80a8e57c24a768ebc48dd544a6c80 P 17294485b7f24e2b9fae71dd3169a336 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:28.054895 17115 raft_consensus.cc:740] T cfc80a8e57c24a768ebc48dd544a6c80 P 17294485b7f24e2b9fae71dd3169a336 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Running, Role: LEADER
I20260709 12:27:28.056443 16864 raft_consensus.cc:2393] T 514ee26ff21e4c08976b6a0397b730fe P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 879366e90f5c420588945e0d545017c8 in current term 1: Already voted for candidate 17294485b7f24e2b9fae71dd3169a336 in this term.
I20260709 12:27:28.056097 17115 consensus_queue.cc:260] T cfc80a8e57c24a768ebc48dd544a6c80 P 17294485b7f24e2b9fae71dd3169a336 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:28.057713 17115 raft_consensus.cc:3060] T cfc80a8e57c24a768ebc48dd544a6c80 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:28.059835 16939 raft_consensus.cc:1240] T cfc80a8e57c24a768ebc48dd544a6c80 P 82f27bcdf252425aad4c4a37d064f68d [term 2 LEADER]: Rejecting Update request from peer 17294485b7f24e2b9fae71dd3169a336 for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:28.061810 17089 leader_election.cc:290] T 9067b67140fa48e883d2d240a6046d63 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 election: Requested vote from peers 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
I20260709 12:27:28.054855 16988 raft_consensus.cc:359] T 9067b67140fa48e883d2d240a6046d63 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:28.064792 16988 raft_consensus.cc:385] T 9067b67140fa48e883d2d240a6046d63 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:28.065634 16988 raft_consensus.cc:740] T 9067b67140fa48e883d2d240a6046d63 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Initialized, Role: FOLLOWER
I20260709 12:27:28.067102 16988 consensus_queue.cc:260] T 9067b67140fa48e883d2d240a6046d63 P 17294485b7f24e2b9fae71dd3169a336 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:28.072335 16987 tablet_bootstrap.cc:492] T 442e0dfc272840f7a14c2232ed65425c P 879366e90f5c420588945e0d545017c8: No bootstrap required, opened a new log
I20260709 12:27:28.072463 17215 leader_election.cc:290] T 514ee26ff21e4c08976b6a0397b730fe P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 election: Requested vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:28.043136 16907 leader_election.cc:304] T 51d96c645e894c8597652daf12a21cf3 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 17294485b7f24e2b9fae71dd3169a336, 3c1aba6ee1d244fd9c0daba722aa0b3b
I20260709 12:27:28.073011 16987 ts_tablet_manager.cc:1403] T 442e0dfc272840f7a14c2232ed65425c P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.360s	user 0.033s	sys 0.019s
W20260709 12:27:28.073752 16907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:38103, user_credentials={real_user=slave}} blocked reactor thread for 53194.5us
I20260709 12:27:28.074283 16793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9067b67140fa48e883d2d240a6046d63" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b"
I20260709 12:27:28.074646 17069 raft_consensus.cc:2749] T 51d96c645e894c8597652daf12a21cf3 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:28.074970 16793 raft_consensus.cc:3060] T 9067b67140fa48e883d2d240a6046d63 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:28.072891 17267 raft_consensus.cc:2804] T 514ee26ff21e4c08976b6a0397b730fe P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:28.076860 17267 raft_consensus.cc:493] T 514ee26ff21e4c08976b6a0397b730fe P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:28.077414 17267 raft_consensus.cc:3060] T 514ee26ff21e4c08976b6a0397b730fe P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:28.095964 17265 consensus_queue.cc:1048] T 7b90200ef21f42f1929fbf0051ef5b3e P 3c1aba6ee1d244fd9c0daba722aa0b3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:28.098117 16614 catalog_manager.cc:5697] T 5868b3bc1ee44923a18d74874a8f3b30 P 3c1aba6ee1d244fd9c0daba722aa0b3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66). New cstate: current_term: 1 leader_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:28.100013 17250 consensus_queue.cc:1048] T b777ccb9937a476590a534fea0428c5c P 82f27bcdf252425aad4c4a37d064f68d [LEADER]: Connected to new peer: Peer: permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:28.110970 17265 raft_consensus.cc:493] T 51d96c645e894c8597652daf12a21cf3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:28.111783 17265 raft_consensus.cc:515] T 51d96c645e894c8597652daf12a21cf3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:28.108369 16613 catalog_manager.cc:5697] T cfc80a8e57c24a768ebc48dd544a6c80 P 82f27bcdf252425aad4c4a37d064f68d reported cstate change: term changed from 1 to 2, leader changed from 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67) to 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68). New cstate: current_term: 2 leader_uuid: "82f27bcdf252425aad4c4a37d064f68d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } health_report { overall_health: HEALTHY } } }
W20260709 12:27:28.120301 16833 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:39833, user_credentials={real_user=slave}} blocked reactor thread for 48887.6us
I20260709 12:27:28.126502 17215 raft_consensus.cc:493] T 9067b67140fa48e883d2d240a6046d63 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:28.127740 17215 raft_consensus.cc:515] T 9067b67140fa48e883d2d240a6046d63 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
W20260709 12:27:28.138161 16684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37919, user_credentials={real_user=slave}} blocked reactor thread for 86381.4us
I20260709 12:27:28.115152 17265 leader_election.cc:290] T 51d96c645e894c8597652daf12a21cf3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919)
I20260709 12:27:28.157836 16988 ts_tablet_manager.cc:1434] T 9067b67140fa48e883d2d240a6046d63 P 17294485b7f24e2b9fae71dd3169a336: Time spent starting tablet: real 0.126s	user 0.006s	sys 0.004s
I20260709 12:27:28.158777 16991 tablet_bootstrap.cc:654] T 62e4e875fd4e4604952120df324e99cb P 3c1aba6ee1d244fd9c0daba722aa0b3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:28.159475 16988 tablet_bootstrap.cc:492] T 51d96c645e894c8597652daf12a21cf3 P 17294485b7f24e2b9fae71dd3169a336: Bootstrap starting.
I20260709 12:27:28.151458 16717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "514ee26ff21e4c08976b6a0397b730fe" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8"
I20260709 12:27:28.179039 16987 raft_consensus.cc:359] T 442e0dfc272840f7a14c2232ed65425c P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:28.180111 16987 raft_consensus.cc:385] T 442e0dfc272840f7a14c2232ed65425c P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:28.180495 16987 raft_consensus.cc:740] T 442e0dfc272840f7a14c2232ed65425c P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:28.188540 16793 raft_consensus.cc:2468] T 9067b67140fa48e883d2d240a6046d63 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 1.
I20260709 12:27:28.191504 16989 tablet_bootstrap.cc:492] T 5868b3bc1ee44923a18d74874a8f3b30 P 82f27bcdf252425aad4c4a37d064f68d: No bootstrap required, opened a new log
I20260709 12:27:28.192361 16989 ts_tablet_manager.cc:1403] T 5868b3bc1ee44923a18d74874a8f3b30 P 82f27bcdf252425aad4c4a37d064f68d: Time spent bootstrapping tablet: real 0.307s	user 0.045s	sys 0.038s
I20260709 12:27:28.197170 16685 leader_election.cc:304] T 9067b67140fa48e883d2d240a6046d63 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8; no voters: 
I20260709 12:27:28.198037 16864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9067b67140fa48e883d2d240a6046d63" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336"
I20260709 12:27:28.198546 17048 raft_consensus.cc:2804] T 9067b67140fa48e883d2d240a6046d63 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:28.198820 16864 raft_consensus.cc:3060] T 9067b67140fa48e883d2d240a6046d63 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:28.200394 16989 raft_consensus.cc:359] T 5868b3bc1ee44923a18d74874a8f3b30 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:28.201468 16989 raft_consensus.cc:385] T 5868b3bc1ee44923a18d74874a8f3b30 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:28.201849 16989 raft_consensus.cc:740] T 5868b3bc1ee44923a18d74874a8f3b30 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f27bcdf252425aad4c4a37d064f68d, State: Initialized, Role: FOLLOWER
I20260709 12:27:28.204589 16988 tablet_bootstrap.cc:654] T 51d96c645e894c8597652daf12a21cf3 P 17294485b7f24e2b9fae71dd3169a336: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:28.209681 16989 consensus_queue.cc:260] T 5868b3bc1ee44923a18d74874a8f3b30 P 82f27bcdf252425aad4c4a37d064f68d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:28.212423 16939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "514ee26ff21e4c08976b6a0397b730fe" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d"
I20260709 12:27:28.213178 16939 raft_consensus.cc:3060] T 514ee26ff21e4c08976b6a0397b730fe P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:28.213557 16989 ts_tablet_manager.cc:1434] T 5868b3bc1ee44923a18d74874a8f3b30 P 82f27bcdf252425aad4c4a37d064f68d: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.003s
I20260709 12:27:28.215283 16989 tablet_bootstrap.cc:492] T 442e0dfc272840f7a14c2232ed65425c P 82f27bcdf252425aad4c4a37d064f68d: Bootstrap starting.
I20260709 12:27:28.221716 17219 raft_consensus.cc:493] T 3649e7bb023a4958a01ad5ecbe446f0f P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:28.222541 17219 raft_consensus.cc:515] T 3649e7bb023a4958a01ad5ecbe446f0f P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:28.227411 17219 leader_election.cc:290] T 3649e7bb023a4958a01ad5ecbe446f0f P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:28.227962 17213 raft_consensus.cc:493] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:28.232193 17213 raft_consensus.cc:515] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:28.244681 16987 consensus_queue.cc:260] T 442e0dfc272840f7a14c2232ed65425c P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:28.234167 16718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3649e7bb023a4958a01ad5ecbe446f0f" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8" is_pre_election: true
I20260709 12:27:28.258713 16865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3649e7bb023a4958a01ad5ecbe446f0f" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:28.265702 16867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d96c645e894c8597652daf12a21cf3" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:28.269201 17267 raft_consensus.cc:515] T 514ee26ff21e4c08976b6a0397b730fe P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:28.272032 16717 raft_consensus.cc:2393] T 514ee26ff21e4c08976b6a0397b730fe P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 17294485b7f24e2b9fae71dd3169a336 in current term 1: Already voted for candidate 879366e90f5c420588945e0d545017c8 in this term.
I20260709 12:27:28.272189 17213 leader_election.cc:290] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:28.276448 16938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d96c645e894c8597652daf12a21cf3" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:28.277467 16938 raft_consensus.cc:2468] T 51d96c645e894c8597652daf12a21cf3 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in term 0.
I20260709 12:27:28.277882 16991 tablet_bootstrap.cc:492] T 62e4e875fd4e4604952120df324e99cb P 3c1aba6ee1d244fd9c0daba722aa0b3b: No bootstrap required, opened a new log
I20260709 12:27:28.278398 16991 ts_tablet_manager.cc:1403] T 62e4e875fd4e4604952120df324e99cb P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent bootstrapping tablet: real 0.243s	user 0.020s	sys 0.015s
W20260709 12:27:28.295281 16759 leader_election.cc:343] T 51d96c645e894c8597652daf12a21cf3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:28.297048 16987 ts_tablet_manager.cc:1434] T 442e0dfc272840f7a14c2232ed65425c P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.224s	user 0.010s	sys 0.002s
I20260709 12:27:28.248564 17215 leader_election.cc:290] T 9067b67140fa48e883d2d240a6046d63 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:28.298354 16987 tablet_bootstrap.cc:492] T 62e4e875fd4e4604952120df324e99cb P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:28.324257 16718 raft_consensus.cc:2393] T 3649e7bb023a4958a01ad5ecbe446f0f P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 82f27bcdf252425aad4c4a37d064f68d in current term 1: Already voted for candidate 17294485b7f24e2b9fae71dd3169a336 in this term.
I20260709 12:27:28.340940 16991 raft_consensus.cc:359] T 62e4e875fd4e4604952120df324e99cb P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:28.341938 16991 raft_consensus.cc:385] T 62e4e875fd4e4604952120df324e99cb P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:28.343544 16991 raft_consensus.cc:740] T 62e4e875fd4e4604952120df324e99cb P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c1aba6ee1d244fd9c0daba722aa0b3b, State: Initialized, Role: FOLLOWER
I20260709 12:27:28.344683 16991 consensus_queue.cc:260] T 62e4e875fd4e4604952120df324e99cb P 3c1aba6ee1d244fd9c0daba722aa0b3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:28.363804 16991 ts_tablet_manager.cc:1434] T 62e4e875fd4e4604952120df324e99cb P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent starting tablet: real 0.085s	user 0.009s	sys 0.003s
I20260709 12:27:28.317523 17266 consensus_queue.cc:1048] T 5868b3bc1ee44923a18d74874a8f3b30 P 3c1aba6ee1d244fd9c0daba722aa0b3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.039s
I20260709 12:27:28.368299 16991 tablet_bootstrap.cc:492] T c220555f395e46d4be83f2b16f9691ef P 3c1aba6ee1d244fd9c0daba722aa0b3b: Bootstrap starting.
I20260709 12:27:28.366482 16989 tablet_bootstrap.cc:654] T 442e0dfc272840f7a14c2232ed65425c P 82f27bcdf252425aad4c4a37d064f68d: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:28.351763 16867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "514ee26ff21e4c08976b6a0397b730fe" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336"
I20260709 12:27:28.391655 16713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9067b67140fa48e883d2d240a6046d63" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8" is_pre_election: true
I20260709 12:27:28.398195 16935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f2b93e5d2045a5a0cd1f9b5806a133" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:28.391315 16793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9067b67140fa48e883d2d240a6046d63" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
I20260709 12:27:28.413240 16793 raft_consensus.cc:2393] T 9067b67140fa48e883d2d240a6046d63 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17294485b7f24e2b9fae71dd3169a336 in current term 1: Already voted for candidate 879366e90f5c420588945e0d545017c8 in this term.
I20260709 12:27:28.418267 16867 raft_consensus.cc:2393] T 514ee26ff21e4c08976b6a0397b730fe P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 879366e90f5c420588945e0d545017c8 in current term 1: Already voted for candidate 17294485b7f24e2b9fae71dd3169a336 in this term.
I20260709 12:27:28.381429 17267 leader_election.cc:290] T 514ee26ff21e4c08976b6a0397b730fe P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 election: Requested vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919)
I20260709 12:27:28.359530 17048 raft_consensus.cc:697] T 9067b67140fa48e883d2d240a6046d63 P 879366e90f5c420588945e0d545017c8 [term 1 LEADER]: Becoming Leader. State: Replica: 879366e90f5c420588945e0d545017c8, State: Running, Role: LEADER
I20260709 12:27:28.426156 16987 tablet_bootstrap.cc:654] T 62e4e875fd4e4604952120df324e99cb P 879366e90f5c420588945e0d545017c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:28.425220 16759 leader_election.cc:304] T 51d96c645e894c8597652daf12a21cf3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 82f27bcdf252425aad4c4a37d064f68d; no voters: 17294485b7f24e2b9fae71dd3169a336
I20260709 12:27:28.432157 17265 raft_consensus.cc:2804] T 51d96c645e894c8597652daf12a21cf3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:28.451344 17265 raft_consensus.cc:493] T 51d96c645e894c8597652daf12a21cf3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:28.451831 17265 raft_consensus.cc:3060] T 51d96c645e894c8597652daf12a21cf3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:28.452950 16989 tablet_bootstrap.cc:492] T 442e0dfc272840f7a14c2232ed65425c P 82f27bcdf252425aad4c4a37d064f68d: No bootstrap required, opened a new log
I20260709 12:27:28.453554 16989 ts_tablet_manager.cc:1403] T 442e0dfc272840f7a14c2232ed65425c P 82f27bcdf252425aad4c4a37d064f68d: Time spent bootstrapping tablet: real 0.239s	user 0.013s	sys 0.006s
I20260709 12:27:28.454560 16864 raft_consensus.cc:2468] T 9067b67140fa48e883d2d240a6046d63 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 1.
I20260709 12:27:28.459391 16989 raft_consensus.cc:359] T 442e0dfc272840f7a14c2232ed65425c P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:28.462893 16989 raft_consensus.cc:385] T 442e0dfc272840f7a14c2232ed65425c P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:28.463908 16907 leader_election.cc:304] T 3649e7bb023a4958a01ad5ecbe446f0f P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8
W20260709 12:27:28.466367 16833 leader_election.cc:343] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:28.467082 17250 raft_consensus.cc:3060] T 3649e7bb023a4958a01ad5ecbe446f0f P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:28.476290 16989 raft_consensus.cc:740] T 442e0dfc272840f7a14c2232ed65425c P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f27bcdf252425aad4c4a37d064f68d, State: Initialized, Role: FOLLOWER
I20260709 12:27:28.477288 16989 consensus_queue.cc:260] T 442e0dfc272840f7a14c2232ed65425c P 82f27bcdf252425aad4c4a37d064f68d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:28.470369 16988 tablet_bootstrap.cc:492] T 51d96c645e894c8597652daf12a21cf3 P 17294485b7f24e2b9fae71dd3169a336: No bootstrap required, opened a new log
I20260709 12:27:28.479087 16988 ts_tablet_manager.cc:1403] T 51d96c645e894c8597652daf12a21cf3 P 17294485b7f24e2b9fae71dd3169a336: Time spent bootstrapping tablet: real 0.320s	user 0.063s	sys 0.064s
I20260709 12:27:28.487109 16989 ts_tablet_manager.cc:1434] T 442e0dfc272840f7a14c2232ed65425c P 82f27bcdf252425aad4c4a37d064f68d: Time spent starting tablet: real 0.033s	user 0.010s	sys 0.000s
I20260709 12:27:28.490588 16939 raft_consensus.cc:2468] T 514ee26ff21e4c08976b6a0397b730fe P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 1.
I20260709 12:27:28.476269 16938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "514ee26ff21e4c08976b6a0397b730fe" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d"
I20260709 12:27:28.429440 16715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f2b93e5d2045a5a0cd1f9b5806a133" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8" is_pre_election: true
I20260709 12:27:28.492156 16615 catalog_manager.cc:5697] T e477f70d4c8d466e9d45e6645e2a2869 P 879366e90f5c420588945e0d545017c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 879366e90f5c420588945e0d545017c8 (127.9.116.65). New cstate: current_term: 1 leader_uuid: "879366e90f5c420588945e0d545017c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:28.495849 16989 tablet_bootstrap.cc:492] T 62e4e875fd4e4604952120df324e99cb P 82f27bcdf252425aad4c4a37d064f68d: Bootstrap starting.
I20260709 12:27:28.500487 16991 tablet_bootstrap.cc:654] T c220555f395e46d4be83f2b16f9691ef P 3c1aba6ee1d244fd9c0daba722aa0b3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:28.499245 16988 raft_consensus.cc:359] T 51d96c645e894c8597652daf12a21cf3 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:28.504518 16988 raft_consensus.cc:385] T 51d96c645e894c8597652daf12a21cf3 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:28.504923 16987 tablet_bootstrap.cc:492] T 62e4e875fd4e4604952120df324e99cb P 879366e90f5c420588945e0d545017c8: No bootstrap required, opened a new log
I20260709 12:27:28.504895 16988 raft_consensus.cc:740] T 51d96c645e894c8597652daf12a21cf3 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Initialized, Role: FOLLOWER
I20260709 12:27:28.505975 16987 ts_tablet_manager.cc:1403] T 62e4e875fd4e4604952120df324e99cb P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.208s	user 0.018s	sys 0.008s
I20260709 12:27:28.509455 16938 raft_consensus.cc:2393] T 514ee26ff21e4c08976b6a0397b730fe P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 879366e90f5c420588945e0d545017c8 in current term 1: Already voted for candidate 17294485b7f24e2b9fae71dd3169a336 in this term.
I20260709 12:27:28.510146 16792 raft_consensus.cc:1275] T cfc80a8e57c24a768ebc48dd544a6c80 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Refusing update from remote peer 82f27bcdf252425aad4c4a37d064f68d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:28.515944 17265 raft_consensus.cc:515] T 51d96c645e894c8597652daf12a21cf3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
W20260709 12:27:28.520568 16833 leader_election.cc:343] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:28.521085 16833 leader_election.cc:304] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336; no voters: 82f27bcdf252425aad4c4a37d064f68d, 879366e90f5c420588945e0d545017c8
I20260709 12:27:28.520977 17215 consensus_queue.cc:1048] T 3649e7bb023a4958a01ad5ecbe446f0f P 17294485b7f24e2b9fae71dd3169a336 [LEADER]: Connected to new peer: Peer: permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:28.522025 17265 leader_election.cc:290] T 51d96c645e894c8597652daf12a21cf3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 election: Requested vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919)
I20260709 12:27:28.430359 17048 consensus_queue.cc:237] T 9067b67140fa48e883d2d240a6046d63 P 879366e90f5c420588945e0d545017c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:28.525488 16863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d96c645e894c8597652daf12a21cf3" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336"
I20260709 12:27:28.528347 16988 consensus_queue.cc:260] T 51d96c645e894c8597652daf12a21cf3 P 17294485b7f24e2b9fae71dd3169a336 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:28.535647 17259 raft_consensus.cc:2749] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:28.543972 16988 ts_tablet_manager.cc:1434] T 51d96c645e894c8597652daf12a21cf3 P 17294485b7f24e2b9fae71dd3169a336: Time spent starting tablet: real 0.065s	user 0.009s	sys 0.000s
I20260709 12:27:28.547639 16988 tablet_bootstrap.cc:492] T c220555f395e46d4be83f2b16f9691ef P 17294485b7f24e2b9fae71dd3169a336: Bootstrap starting.
I20260709 12:27:28.529788 16863 raft_consensus.cc:3060] T 51d96c645e894c8597652daf12a21cf3 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:28.553854 17250 raft_consensus.cc:2749] T 3649e7bb023a4958a01ad5ecbe446f0f P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:28.560705 17244 raft_consensus.cc:493] T 442e0dfc272840f7a14c2232ed65425c P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:28.560897 17250 consensus_queue.cc:1048] T cfc80a8e57c24a768ebc48dd544a6c80 P 82f27bcdf252425aad4c4a37d064f68d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:28.561410 17244 raft_consensus.cc:515] T 442e0dfc272840f7a14c2232ed65425c P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:28.563898 16833 leader_election.cc:304] T 514ee26ff21e4c08976b6a0397b730fe P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 82f27bcdf252425aad4c4a37d064f68d; no voters: 879366e90f5c420588945e0d545017c8
I20260709 12:27:28.564814 17259 raft_consensus.cc:2804] T 514ee26ff21e4c08976b6a0397b730fe P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:28.565287 17259 raft_consensus.cc:697] T 514ee26ff21e4c08976b6a0397b730fe P 17294485b7f24e2b9fae71dd3169a336 [term 1 LEADER]: Becoming Leader. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Running, Role: LEADER
I20260709 12:27:28.566541 17259 consensus_queue.cc:237] T 514ee26ff21e4c08976b6a0397b730fe P 17294485b7f24e2b9fae71dd3169a336 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:28.568606 17267 consensus_queue.cc:1048] T e477f70d4c8d466e9d45e6645e2a2869 P 879366e90f5c420588945e0d545017c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:28.591658 16684 leader_election.cc:304] T 514ee26ff21e4c08976b6a0397b730fe P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 879366e90f5c420588945e0d545017c8; no voters: 17294485b7f24e2b9fae71dd3169a336, 82f27bcdf252425aad4c4a37d064f68d
I20260709 12:27:28.599210 16937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442e0dfc272840f7a14c2232ed65425c" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:28.600456 16937 raft_consensus.cc:2468] T 442e0dfc272840f7a14c2232ed65425c P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 0.
I20260709 12:27:28.607196 16989 tablet_bootstrap.cc:654] T 62e4e875fd4e4604952120df324e99cb P 82f27bcdf252425aad4c4a37d064f68d: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:28.609447 17048 raft_consensus.cc:2749] T 514ee26ff21e4c08976b6a0397b730fe P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:27:28.619513 16684 leader_election.cc:304] T 442e0dfc272840f7a14c2232ed65425c P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d, 879366e90f5c420588945e0d545017c8; no voters: 
I20260709 12:27:28.626951 17268 raft_consensus.cc:2804] T 442e0dfc272840f7a14c2232ed65425c P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:28.627368 17268 raft_consensus.cc:493] T 442e0dfc272840f7a14c2232ed65425c P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:28.615329 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d96c645e894c8597652daf12a21cf3" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d"
I20260709 12:27:28.632330 16941 raft_consensus.cc:3060] T 51d96c645e894c8597652daf12a21cf3 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:28.618235 16987 raft_consensus.cc:359] T 62e4e875fd4e4604952120df324e99cb P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:28.636464 16987 raft_consensus.cc:385] T 62e4e875fd4e4604952120df324e99cb P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:28.636726 16987 raft_consensus.cc:740] T 62e4e875fd4e4604952120df324e99cb P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:28.644450 16988 tablet_bootstrap.cc:654] T c220555f395e46d4be83f2b16f9691ef P 17294485b7f24e2b9fae71dd3169a336: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:28.637430 16987 consensus_queue.cc:260] T 62e4e875fd4e4604952120df324e99cb P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:28.616416 16937 raft_consensus.cc:3060] T 5868b3bc1ee44923a18d74874a8f3b30 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:28.680763 16987 ts_tablet_manager.cc:1434] T 62e4e875fd4e4604952120df324e99cb P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.174s	user 0.007s	sys 0.001s
I20260709 12:27:28.686806 16987 tablet_bootstrap.cc:492] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:28.668126 17268 raft_consensus.cc:3060] T 442e0dfc272840f7a14c2232ed65425c P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:28.700230 17244 leader_election.cc:290] T 442e0dfc272840f7a14c2232ed65425c P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:28.701421 16991 tablet_bootstrap.cc:492] T c220555f395e46d4be83f2b16f9691ef P 3c1aba6ee1d244fd9c0daba722aa0b3b: No bootstrap required, opened a new log
I20260709 12:27:28.701989 16991 ts_tablet_manager.cc:1403] T c220555f395e46d4be83f2b16f9691ef P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent bootstrapping tablet: real 0.337s	user 0.019s	sys 0.015s
W20260709 12:27:28.668901 16907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:39833, user_credentials={real_user=slave}} blocked reactor thread for 52932.1us
I20260709 12:27:28.614362 17215 consensus_queue.cc:1048] T 3649e7bb023a4958a01ad5ecbe446f0f P 17294485b7f24e2b9fae71dd3169a336 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.070s
W20260709 12:27:28.706586 17291 log.cc:927] Time spent T b777ccb9937a476590a534fea0428c5c P 82f27bcdf252425aad4c4a37d064f68d: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:27:28.707947 17267 consensus_queue.cc:1048] T e477f70d4c8d466e9d45e6645e2a2869 P 879366e90f5c420588945e0d545017c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:28.712713 17265 raft_consensus.cc:493] T 62e4e875fd4e4604952120df324e99cb P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:28.713477 17265 raft_consensus.cc:515] T 62e4e875fd4e4604952120df324e99cb P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:28.717861 16941 raft_consensus.cc:2468] T 51d96c645e894c8597652daf12a21cf3 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in term 1.
I20260709 12:27:28.731330 16792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442e0dfc272840f7a14c2232ed65425c" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
I20260709 12:27:28.735035 16792 raft_consensus.cc:2468] T 442e0dfc272840f7a14c2232ed65425c P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 0.
I20260709 12:27:28.738894 17265 leader_election.cc:290] T 62e4e875fd4e4604952120df324e99cb P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:28.741938 16716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e4e875fd4e4604952120df324e99cb" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8" is_pre_election: true
I20260709 12:27:28.742763 16716 raft_consensus.cc:2468] T 62e4e875fd4e4604952120df324e99cb P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in term 0.
I20260709 12:27:28.742875 16863 raft_consensus.cc:2468] T 51d96c645e894c8597652daf12a21cf3 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in term 1.
I20260709 12:27:28.748806 16759 leader_election.cc:304] T 62e4e875fd4e4604952120df324e99cb P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8; no voters: 
I20260709 12:27:28.763801 16991 raft_consensus.cc:359] T c220555f395e46d4be83f2b16f9691ef P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:28.766993 16991 raft_consensus.cc:385] T c220555f395e46d4be83f2b16f9691ef P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:28.773743 16991 raft_consensus.cc:740] T c220555f395e46d4be83f2b16f9691ef P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c1aba6ee1d244fd9c0daba722aa0b3b, State: Initialized, Role: FOLLOWER
I20260709 12:27:28.760717 16759 leader_election.cc:304] T 51d96c645e894c8597652daf12a21cf3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 82f27bcdf252425aad4c4a37d064f68d; no voters: 
I20260709 12:27:28.796164 16991 consensus_queue.cc:260] T c220555f395e46d4be83f2b16f9691ef P 3c1aba6ee1d244fd9c0daba722aa0b3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:28.797345 17016 raft_consensus.cc:2804] T 51d96c645e894c8597652daf12a21cf3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:28.756381 17263 raft_consensus.cc:2804] T 62e4e875fd4e4604952120df324e99cb P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:28.856197 16991 ts_tablet_manager.cc:1434] T c220555f395e46d4be83f2b16f9691ef P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent starting tablet: real 0.154s	user 0.017s	sys 0.014s
I20260709 12:27:28.858057 16991 tablet_bootstrap.cc:492] T 5f88e29c7ffd4b3b856561ee240cdd43 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Bootstrap starting.
I20260709 12:27:28.805383 17263 raft_consensus.cc:493] T 62e4e875fd4e4604952120df324e99cb P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:28.858755 16938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e4e875fd4e4604952120df324e99cb" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
W20260709 12:27:28.809926 16685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:43629, user_credentials={real_user=slave}} blocked reactor thread for 49650us
I20260709 12:27:28.871325 16863 raft_consensus.cc:1275] T cfc80a8e57c24a768ebc48dd544a6c80 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Refusing update from remote peer 82f27bcdf252425aad4c4a37d064f68d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:28.871667 16991 tablet_bootstrap.cc:654] T 5f88e29c7ffd4b3b856561ee240cdd43 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:28.913197 17016 raft_consensus.cc:697] T 51d96c645e894c8597652daf12a21cf3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 LEADER]: Becoming Leader. State: Replica: 3c1aba6ee1d244fd9c0daba722aa0b3b, State: Running, Role: LEADER
I20260709 12:27:28.918013 17016 consensus_queue.cc:237] T 51d96c645e894c8597652daf12a21cf3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:28.929984 16989 tablet_bootstrap.cc:492] T 62e4e875fd4e4604952120df324e99cb P 82f27bcdf252425aad4c4a37d064f68d: No bootstrap required, opened a new log
I20260709 12:27:28.930754 16989 ts_tablet_manager.cc:1403] T 62e4e875fd4e4604952120df324e99cb P 82f27bcdf252425aad4c4a37d064f68d: Time spent bootstrapping tablet: real 0.443s	user 0.031s	sys 0.010s
I20260709 12:27:28.933359 16987 tablet_bootstrap.cc:654] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 879366e90f5c420588945e0d545017c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:28.937467 17266 raft_consensus.cc:493] T c220555f395e46d4be83f2b16f9691ef P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:28.938113 17266 raft_consensus.cc:515] T c220555f395e46d4be83f2b16f9691ef P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:28.864727 17263 raft_consensus.cc:3060] T 62e4e875fd4e4604952120df324e99cb P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:28.959364 17310 consensus_queue.cc:1048] T cfc80a8e57c24a768ebc48dd544a6c80 P 82f27bcdf252425aad4c4a37d064f68d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:28.987275 16989 raft_consensus.cc:359] T 62e4e875fd4e4604952120df324e99cb P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:28.988387 16989 raft_consensus.cc:385] T 62e4e875fd4e4604952120df324e99cb P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:28.959430 17268 raft_consensus.cc:515] T 442e0dfc272840f7a14c2232ed65425c P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:28.988792 16989 raft_consensus.cc:740] T 62e4e875fd4e4604952120df324e99cb P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f27bcdf252425aad4c4a37d064f68d, State: Initialized, Role: FOLLOWER
I20260709 12:27:28.995455 16989 consensus_queue.cc:260] T 62e4e875fd4e4604952120df324e99cb P 82f27bcdf252425aad4c4a37d064f68d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:29.002969 17249 consensus_queue.cc:1048] T 9067b67140fa48e883d2d240a6046d63 P 879366e90f5c420588945e0d545017c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 12:27:29.000434 17250 raft_consensus.cc:493] T 5868b3bc1ee44923a18d74874a8f3b30 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:29.027365 17293 log.cc:927] Time spent T 5868b3bc1ee44923a18d74874a8f3b30 P 17294485b7f24e2b9fae71dd3169a336: Append to log took a long time: real 0.221s	user 0.001s	sys 0.003s
I20260709 12:27:29.032891 16989 ts_tablet_manager.cc:1434] T 62e4e875fd4e4604952120df324e99cb P 82f27bcdf252425aad4c4a37d064f68d: Time spent starting tablet: real 0.102s	user 0.009s	sys 0.001s
I20260709 12:27:29.036536 16989 tablet_bootstrap.cc:492] T c220555f395e46d4be83f2b16f9691ef P 82f27bcdf252425aad4c4a37d064f68d: Bootstrap starting.
I20260709 12:27:29.029544 16863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c220555f395e46d4be83f2b16f9691ef" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:29.048648 16991 tablet_bootstrap.cc:492] T 5f88e29c7ffd4b3b856561ee240cdd43 P 3c1aba6ee1d244fd9c0daba722aa0b3b: No bootstrap required, opened a new log
I20260709 12:27:29.062593 16991 ts_tablet_manager.cc:1403] T 5f88e29c7ffd4b3b856561ee240cdd43 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent bootstrapping tablet: real 0.205s	user 0.027s	sys 0.018s
I20260709 12:27:29.080946 17268 leader_election.cc:290] T 442e0dfc272840f7a14c2232ed65425c P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 election: Requested vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:29.081461 16939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c220555f395e46d4be83f2b16f9691ef" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:29.026011 17250 raft_consensus.cc:515] T 5868b3bc1ee44923a18d74874a8f3b30 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:29.066046 17266 leader_election.cc:290] T c220555f395e46d4be83f2b16f9691ef P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919)
W20260709 12:27:29.103406 16759 leader_election.cc:343] T c220555f395e46d4be83f2b16f9691ef P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:29.119948 16989 tablet_bootstrap.cc:654] T c220555f395e46d4be83f2b16f9691ef P 82f27bcdf252425aad4c4a37d064f68d: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:29.121860 16991 raft_consensus.cc:359] T 5f88e29c7ffd4b3b856561ee240cdd43 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:29.122694 16991 raft_consensus.cc:385] T 5f88e29c7ffd4b3b856561ee240cdd43 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:29.122965 16991 raft_consensus.cc:740] T 5f88e29c7ffd4b3b856561ee240cdd43 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c1aba6ee1d244fd9c0daba722aa0b3b, State: Initialized, Role: FOLLOWER
I20260709 12:27:29.123754 16991 consensus_queue.cc:260] T 5f88e29c7ffd4b3b856561ee240cdd43 P 3c1aba6ee1d244fd9c0daba722aa0b3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:29.124094 16792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442e0dfc272840f7a14c2232ed65425c" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b"
I20260709 12:27:29.124733 16792 raft_consensus.cc:3060] T 442e0dfc272840f7a14c2232ed65425c P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:29.134613 16613 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45712 (request call id 54) took 1036 ms. Trace:
I20260709 12:27:29.140942 16991 ts_tablet_manager.cc:1434] T 5f88e29c7ffd4b3b856561ee240cdd43 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent starting tablet: real 0.078s	user 0.007s	sys 0.001s
I20260709 12:27:29.142648 16991 tablet_bootstrap.cc:492] T 2f737ece325c44c58194725a82923014 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Bootstrap starting.
I20260709 12:27:29.146055 17263 raft_consensus.cc:515] T 62e4e875fd4e4604952120df324e99cb P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:29.155030 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442e0dfc272840f7a14c2232ed65425c" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d"
I20260709 12:27:29.156016 16941 raft_consensus.cc:3060] T 442e0dfc272840f7a14c2232ed65425c P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:29.135278 16613 rpcz_store.cc:276] 0709 12:27:28.097960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:28.098298 (+   338us) service_pool.cc:224] Handling call
0709 12:27:29.134523 (+1036225us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:28.433443 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:28.434018 (+   575us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:28.434052 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:27:28.434069 (+    17us) tablet.cc:662] Decoding operations
0709 12:27:28.434395 (+   326us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:28.434450 (+    55us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:28.434479 (+    29us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:27:28.434673 (+   194us) tablet.cc:701] Row locks acquired
0709 12:27:28.434689 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:27:28.434823 (+   134us) write_op.cc:270] Start()
0709 12:27:28.434931 (+   108us) write_op.cc:276] Timestamp: P: 1783600048434775 usec, L: 0
0709 12:27:28.434950 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:27:28.446169 (+ 11219us) log.cc:844] Serialized 537 byte log entry
0709 12:27:28.836001 (+389832us) op_driver.cc:464] REPLICATION: finished
0709 12:27:28.866979 (+ 30978us) write_op.cc:301] APPLY: starting
0709 12:27:28.867119 (+   140us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:28.867244 (+   125us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:28.867415 (+   171us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:28.867738 (+   323us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:28.867940 (+   202us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:27:28.867994 (+    54us) write_op.cc:312] APPLY: finished
0709 12:27:28.868443 (+   449us) log.cc:844] Serialized 22 byte log entry
0709 12:27:28.868700 (+   257us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:28.868973 (+   273us) write_op.cc:454] Released schema lock
0709 12:27:28.869027 (+    54us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":25445,"apply.run_cpu_time_us":2667,"apply.run_wall_time_us":2667,"mutex_wait_us":14854,"num_ops":1,"prepare.queue_time_us":308057,"prepare.run_cpu_time_us":2627,"prepare.run_wall_time_us":28629,"replication_time_us":372469}]]}
I20260709 12:27:29.167476 16988 tablet_bootstrap.cc:492] T c220555f395e46d4be83f2b16f9691ef P 17294485b7f24e2b9fae71dd3169a336: No bootstrap required, opened a new log
I20260709 12:27:29.168289 16988 ts_tablet_manager.cc:1403] T c220555f395e46d4be83f2b16f9691ef P 17294485b7f24e2b9fae71dd3169a336: Time spent bootstrapping tablet: real 0.621s	user 0.035s	sys 0.032s
W20260709 12:27:29.169232 16759 leader_election.cc:343] T 62e4e875fd4e4604952120df324e99cb P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:29.172269 16941 raft_consensus.cc:2468] T 442e0dfc272840f7a14c2232ed65425c P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 1.
I20260709 12:27:29.178314 16833 leader_election.cc:304] T 9067b67140fa48e883d2d240a6046d63 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8
W20260709 12:27:29.174722 16759 leader_election.cc:343] T c220555f395e46d4be83f2b16f9691ef P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:29.185359 16759 leader_election.cc:304] T c220555f395e46d4be83f2b16f9691ef P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b; no voters: 17294485b7f24e2b9fae71dd3169a336, 82f27bcdf252425aad4c4a37d064f68d
I20260709 12:27:29.195441 16988 raft_consensus.cc:359] T c220555f395e46d4be83f2b16f9691ef P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:29.204988 16988 raft_consensus.cc:385] T c220555f395e46d4be83f2b16f9691ef P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:29.205576 16988 raft_consensus.cc:740] T c220555f395e46d4be83f2b16f9691ef P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Initialized, Role: FOLLOWER
I20260709 12:27:29.217638 16987 tablet_bootstrap.cc:492] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 879366e90f5c420588945e0d545017c8: No bootstrap required, opened a new log
I20260709 12:27:29.218600 16987 ts_tablet_manager.cc:1403] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.532s	user 0.031s	sys 0.002s
I20260709 12:27:29.186784 17265 consensus_queue.cc:1048] T 5868b3bc1ee44923a18d74874a8f3b30 P 3c1aba6ee1d244fd9c0daba722aa0b3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.034s
I20260709 12:27:29.197217 17257 raft_consensus.cc:2749] T 9067b67140fa48e883d2d240a6046d63 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:29.232033 17264 raft_consensus.cc:2749] T c220555f395e46d4be83f2b16f9691ef P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:29.232164 16991 tablet_bootstrap.cc:654] T 2f737ece325c44c58194725a82923014 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:29.182878 17215 consensus_queue.cc:1048] T 514ee26ff21e4c08976b6a0397b730fe P 17294485b7f24e2b9fae71dd3169a336 [LEADER]: Connected to new peer: Peer: permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.032s
I20260709 12:27:29.240760 16988 consensus_queue.cc:260] T c220555f395e46d4be83f2b16f9691ef P 17294485b7f24e2b9fae71dd3169a336 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:29.248380 17069 raft_consensus.cc:493] T 62e4e875fd4e4604952120df324e99cb P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:29.257382 16988 ts_tablet_manager.cc:1434] T c220555f395e46d4be83f2b16f9691ef P 17294485b7f24e2b9fae71dd3169a336: Time spent starting tablet: real 0.089s	user 0.008s	sys 0.005s
I20260709 12:27:29.259827 16987 raft_consensus.cc:359] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:29.260848 16987 raft_consensus.cc:385] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:29.261144 16987 raft_consensus.cc:740] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:29.254007 17263 leader_election.cc:290] T 62e4e875fd4e4604952120df324e99cb P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 election: Requested vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:29.265159 16987 consensus_queue.cc:260] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:29.267017 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e4e875fd4e4604952120df324e99cb" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d"
I20260709 12:27:29.253858 17069 raft_consensus.cc:515] T 62e4e875fd4e4604952120df324e99cb P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:29.269493 16987 ts_tablet_manager.cc:1434] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.005s
I20260709 12:27:29.270267 17069 leader_election.cc:290] T 62e4e875fd4e4604952120df324e99cb P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:29.270787 16987 tablet_bootstrap.cc:492] T 5f88e29c7ffd4b3b856561ee240cdd43 P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:29.271039 16941 raft_consensus.cc:3060] T 62e4e875fd4e4604952120df324e99cb P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:29.278594 16988 tablet_bootstrap.cc:492] T 51ebab30b5104589803b75a1b48c5aa2 P 17294485b7f24e2b9fae71dd3169a336: Bootstrap starting.
I20260709 12:27:29.278839 16987 tablet_bootstrap.cc:654] T 5f88e29c7ffd4b3b856561ee240cdd43 P 879366e90f5c420588945e0d545017c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:29.282893 16788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e4e875fd4e4604952120df324e99cb" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
I20260709 12:27:29.291637 16941 raft_consensus.cc:2468] T 62e4e875fd4e4604952120df324e99cb P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in term 1.
I20260709 12:27:29.309415 16684 leader_election.cc:304] T 442e0dfc272840f7a14c2232ed65425c P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d, 879366e90f5c420588945e0d545017c8; no voters: 
I20260709 12:27:29.319574 16788 raft_consensus.cc:2393] T 62e4e875fd4e4604952120df324e99cb P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 82f27bcdf252425aad4c4a37d064f68d in current term 1: Already voted for candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in this term.
I20260709 12:27:29.279484 16792 raft_consensus.cc:2468] T 442e0dfc272840f7a14c2232ed65425c P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 1.
I20260709 12:27:29.333397 16989 tablet_bootstrap.cc:492] T c220555f395e46d4be83f2b16f9691ef P 82f27bcdf252425aad4c4a37d064f68d: No bootstrap required, opened a new log
I20260709 12:27:29.334194 16989 ts_tablet_manager.cc:1403] T c220555f395e46d4be83f2b16f9691ef P 82f27bcdf252425aad4c4a37d064f68d: Time spent bootstrapping tablet: real 0.298s	user 0.020s	sys 0.047s
W20260709 12:27:29.354765 16684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37919, user_credentials={real_user=slave}} blocked reactor thread for 49254us
I20260709 12:27:29.363391 17279 raft_consensus.cc:2804] T 442e0dfc272840f7a14c2232ed65425c P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:29.363966 17279 raft_consensus.cc:697] T 442e0dfc272840f7a14c2232ed65425c P 879366e90f5c420588945e0d545017c8 [term 1 LEADER]: Becoming Leader. State: Replica: 879366e90f5c420588945e0d545017c8, State: Running, Role: LEADER
I20260709 12:27:29.364835 17279 consensus_queue.cc:237] T 442e0dfc272840f7a14c2232ed65425c P 879366e90f5c420588945e0d545017c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:29.368193 17249 consensus_queue.cc:1048] T 9067b67140fa48e883d2d240a6046d63 P 879366e90f5c420588945e0d545017c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:29.369315 16989 raft_consensus.cc:359] T c220555f395e46d4be83f2b16f9691ef P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:29.370199 16989 raft_consensus.cc:385] T c220555f395e46d4be83f2b16f9691ef P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:29.370463 16989 raft_consensus.cc:740] T c220555f395e46d4be83f2b16f9691ef P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f27bcdf252425aad4c4a37d064f68d, State: Initialized, Role: FOLLOWER
W20260709 12:27:29.336668 16834 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:43629, user_credentials={real_user=slave}} blocked reactor thread for 146332us
I20260709 12:27:29.375711 16759 leader_election.cc:304] T 62e4e875fd4e4604952120df324e99cb P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 82f27bcdf252425aad4c4a37d064f68d; no voters: 
I20260709 12:27:29.371152 16989 consensus_queue.cc:260] T c220555f395e46d4be83f2b16f9691ef P 82f27bcdf252425aad4c4a37d064f68d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:29.370869 17250 leader_election.cc:290] T 5868b3bc1ee44923a18d74874a8f3b30 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
I20260709 12:27:29.392652 16614 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45692 (request call id 45) took 1297 ms. Trace:
I20260709 12:27:29.381243 17264 raft_consensus.cc:2804] T 62e4e875fd4e4604952120df324e99cb P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:29.405268 16989 ts_tablet_manager.cc:1434] T c220555f395e46d4be83f2b16f9691ef P 82f27bcdf252425aad4c4a37d064f68d: Time spent starting tablet: real 0.071s	user 0.008s	sys 0.002s
I20260709 12:27:29.406805 16989 tablet_bootstrap.cc:492] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d: Bootstrap starting.
I20260709 12:27:29.407873 16862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5868b3bc1ee44923a18d74874a8f3b30" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:29.409641 16791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5868b3bc1ee44923a18d74874a8f3b30" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
I20260709 12:27:29.400553 16719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e4e875fd4e4604952120df324e99cb" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8" is_pre_election: true
I20260709 12:27:29.425086 16719 raft_consensus.cc:2468] T 62e4e875fd4e4604952120df324e99cb P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82f27bcdf252425aad4c4a37d064f68d in term 0.
I20260709 12:27:29.433789 16719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e4e875fd4e4604952120df324e99cb" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8"
I20260709 12:27:29.434481 16719 raft_consensus.cc:3060] T 62e4e875fd4e4604952120df324e99cb P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:29.436987 17267 raft_consensus.cc:493] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:29.437592 17267 raft_consensus.cc:515] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:29.393627 16614 rpcz_store.cc:276] 0709 12:27:28.095041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:28.095210 (+   169us) service_pool.cc:224] Handling call
0709 12:27:29.392505 (+1297295us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:28.430699 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:28.431243 (+   544us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:28.431272 (+    29us) write_op.cc:435] Acquired schema lock
0709 12:27:28.431292 (+    20us) tablet.cc:662] Decoding operations
0709 12:27:28.431660 (+   368us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:28.431705 (+    45us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:28.431733 (+    28us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:27:28.431992 (+   259us) tablet.cc:701] Row locks acquired
0709 12:27:28.432020 (+    28us) write_op.cc:260] PREPARE: finished
0709 12:27:28.432148 (+   128us) write_op.cc:270] Start()
0709 12:27:28.432268 (+   120us) write_op.cc:276] Timestamp: P: 1783600048432104 usec, L: 0
0709 12:27:28.432287 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:27:28.433038 (+   751us) log.cc:844] Serialized 537 byte log entry
0709 12:27:28.592832 (+159794us) op_driver.cc:464] REPLICATION: finished
0709 12:27:28.824950 (+232118us) write_op.cc:301] APPLY: starting
0709 12:27:29.045739 (+220789us) spinlock_profiling.cc:243] Waited 5.54 ms on lock 0x7b54000ae028. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f759b2449e1 00007f759b24364c 00007f75988d3e10 00007f75988bf97c 00007f75988c3d61 00007f75988c3d19 00007f75988c3ca9 00007f75988c3c71 00007f75988c2e9d 0000000000388634 0000000000388479
0709 12:27:29.065181 (+ 19442us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:29.076418 (+ 11237us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:29.076452 (+    34us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:29.076754 (+   302us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:29.076958 (+   204us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:27:29.077006 (+    48us) write_op.cc:312] APPLY: finished
0709 12:27:29.077294 (+   288us) log.cc:844] Serialized 22 byte log entry
0709 12:27:29.077516 (+   222us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:29.077617 (+   101us) write_op.cc:454] Released schema lock
0709 12:27:29.077665 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:29.078128 (+   463us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:29.078158 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":66324,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":205008,"apply.run_cpu_time_us":6242,"apply.run_wall_time_us":253174,"num_ops":1,"prepare.queue_time_us":329499,"prepare.run_cpu_time_us":2615,"prepare.run_wall_time_us":2614,"replication_time_us":142599,"spinlock_wait_cycles":12749056,"thread_start_us":162603,"threads_started":1}]]}
I20260709 12:27:29.439384 16987 tablet_bootstrap.cc:492] T 5f88e29c7ffd4b3b856561ee240cdd43 P 879366e90f5c420588945e0d545017c8: No bootstrap required, opened a new log
I20260709 12:27:29.441135 16987 ts_tablet_manager.cc:1403] T 5f88e29c7ffd4b3b856561ee240cdd43 P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.171s	user 0.024s	sys 0.018s
I20260709 12:27:29.413563 17264 raft_consensus.cc:697] T 62e4e875fd4e4604952120df324e99cb P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 LEADER]: Becoming Leader. State: Replica: 3c1aba6ee1d244fd9c0daba722aa0b3b, State: Running, Role: LEADER
I20260709 12:27:29.448851 17264 consensus_queue.cc:237] T 62e4e875fd4e4604952120df324e99cb P 3c1aba6ee1d244fd9c0daba722aa0b3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:29.452673 16987 raft_consensus.cc:359] T 5f88e29c7ffd4b3b856561ee240cdd43 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:29.453557 16987 raft_consensus.cc:385] T 5f88e29c7ffd4b3b856561ee240cdd43 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:29.453899 16987 raft_consensus.cc:740] T 5f88e29c7ffd4b3b856561ee240cdd43 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:29.454609 16987 consensus_queue.cc:260] T 5f88e29c7ffd4b3b856561ee240cdd43 P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:29.446935 16907 leader_election.cc:304] T 5868b3bc1ee44923a18d74874a8f3b30 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 17294485b7f24e2b9fae71dd3169a336, 3c1aba6ee1d244fd9c0daba722aa0b3b
I20260709 12:27:29.491063 16987 ts_tablet_manager.cc:1434] T 5f88e29c7ffd4b3b856561ee240cdd43 P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.001s
I20260709 12:27:29.493233 16987 tablet_bootstrap.cc:492] T 2f737ece325c44c58194725a82923014 P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:29.501360 16988 tablet_bootstrap.cc:654] T 51ebab30b5104589803b75a1b48c5aa2 P 17294485b7f24e2b9fae71dd3169a336: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:29.486505 17267 leader_election.cc:290] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919)
W20260709 12:27:29.525553 16684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:38103, user_credentials={real_user=slave}} blocked reactor thread for 124164us
I20260709 12:27:29.532634 17257 consensus_queue.cc:1048] T 514ee26ff21e4c08976b6a0397b730fe P 17294485b7f24e2b9fae71dd3169a336 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:29.535084 16907 leader_election.cc:304] T 62e4e875fd4e4604952120df324e99cb P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d, 879366e90f5c420588945e0d545017c8; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b
I20260709 12:27:29.535369 16862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f2b93e5d2045a5a0cd1f9b5806a133" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:29.537875 16862 raft_consensus.cc:2468] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 0.
I20260709 12:27:29.543651 16991 tablet_bootstrap.cc:492] T 2f737ece325c44c58194725a82923014 P 3c1aba6ee1d244fd9c0daba722aa0b3b: No bootstrap required, opened a new log
I20260709 12:27:29.544550 16991 ts_tablet_manager.cc:1403] T 2f737ece325c44c58194725a82923014 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent bootstrapping tablet: real 0.402s	user 0.024s	sys 0.016s
I20260709 12:27:29.548167 16684 leader_election.cc:304] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8; no voters: 
I20260709 12:27:29.552790 16988 tablet_bootstrap.cc:492] T 51ebab30b5104589803b75a1b48c5aa2 P 17294485b7f24e2b9fae71dd3169a336: No bootstrap required, opened a new log
I20260709 12:27:29.556365 17279 raft_consensus.cc:2804] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:29.556882 17279 raft_consensus.cc:493] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:29.557222 17279 raft_consensus.cc:3060] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:29.539301 17219 raft_consensus.cc:2749] T 5868b3bc1ee44923a18d74874a8f3b30 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:29.568605 17315 raft_consensus.cc:493] T 5f88e29c7ffd4b3b856561ee240cdd43 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:29.569644 17302 raft_consensus.cc:493] T c220555f395e46d4be83f2b16f9691ef P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:29.569502 17315 raft_consensus.cc:515] T 5f88e29c7ffd4b3b856561ee240cdd43 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:29.570449 17302 raft_consensus.cc:515] T c220555f395e46d4be83f2b16f9691ef P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:29.572643 17302 leader_election.cc:290] T c220555f395e46d4be83f2b16f9691ef P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
I20260709 12:27:29.576577 17315 leader_election.cc:290] T 5f88e29c7ffd4b3b856561ee240cdd43 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
I20260709 12:27:29.545674 17250 raft_consensus.cc:2764] T 62e4e875fd4e4604952120df324e99cb P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:27:29.591676 16868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c220555f395e46d4be83f2b16f9691ef" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:29.592528 16868 raft_consensus.cc:2468] T c220555f395e46d4be83f2b16f9691ef P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82f27bcdf252425aad4c4a37d064f68d in term 0.
I20260709 12:27:29.594197 16866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f88e29c7ffd4b3b856561ee240cdd43" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:29.595094 16907 leader_election.cc:304] T c220555f395e46d4be83f2b16f9691ef P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 82f27bcdf252425aad4c4a37d064f68d; no voters: 
I20260709 12:27:29.595523 16715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f88e29c7ffd4b3b856561ee240cdd43" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8" is_pre_election: true
I20260709 12:27:29.596211 16715 raft_consensus.cc:2468] T 5f88e29c7ffd4b3b856561ee240cdd43 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in term 0.
I20260709 12:27:29.597589 16759 leader_election.cc:304] T 5f88e29c7ffd4b3b856561ee240cdd43 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8; no voters: 
I20260709 12:27:29.598645 17245 raft_consensus.cc:2804] T c220555f395e46d4be83f2b16f9691ef P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:27:29.598904 16759 leader_election.cc:343] T 5f88e29c7ffd4b3b856561ee240cdd43 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:29.599124 17245 raft_consensus.cc:493] T c220555f395e46d4be83f2b16f9691ef P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:29.599937 17265 raft_consensus.cc:2804] T 5f88e29c7ffd4b3b856561ee240cdd43 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:29.600378 17265 raft_consensus.cc:493] T 5f88e29c7ffd4b3b856561ee240cdd43 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:29.600759 17265 raft_consensus.cc:3060] T 5f88e29c7ffd4b3b856561ee240cdd43 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:29.603003 16938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f2b93e5d2045a5a0cd1f9b5806a133" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:29.606995 16792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c220555f395e46d4be83f2b16f9691ef" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
I20260709 12:27:29.607795 16792 raft_consensus.cc:2468] T c220555f395e46d4be83f2b16f9691ef P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82f27bcdf252425aad4c4a37d064f68d in term 0.
I20260709 12:27:29.615512 17210 consensus_queue.cc:1048] T 51d96c645e894c8597652daf12a21cf3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:29.635066 16614 catalog_manager.cc:5697] T 514ee26ff21e4c08976b6a0397b730fe P 17294485b7f24e2b9fae71dd3169a336 reported cstate change: term changed from 0 to 1, leader changed from <none> to 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67). New cstate: current_term: 1 leader_uuid: "17294485b7f24e2b9fae71dd3169a336" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:29.636590 16988 ts_tablet_manager.cc:1403] T 51ebab30b5104589803b75a1b48c5aa2 P 17294485b7f24e2b9fae71dd3169a336: Time spent bootstrapping tablet: real 0.358s	user 0.016s	sys 0.000s
I20260709 12:27:29.599493 17245 raft_consensus.cc:3060] T c220555f395e46d4be83f2b16f9691ef P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:29.623311 17265 raft_consensus.cc:515] T 5f88e29c7ffd4b3b856561ee240cdd43 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:29.684774 16987 tablet_bootstrap.cc:700] T 2f737ece325c44c58194725a82923014 P 879366e90f5c420588945e0d545017c8: Time spent opening tablet: real 0.117s	user 0.001s	sys 0.000s
I20260709 12:27:29.685969 16987 tablet_bootstrap.cc:654] T 2f737ece325c44c58194725a82923014 P 879366e90f5c420588945e0d545017c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:29.696126 16989 tablet_bootstrap.cc:654] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d: Neither blocks nor log segments found. Creating new log.
W20260709 12:27:29.704950 16684 leader_election.cc:343] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:27:29.738629 16665 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 12:27:29.755620 17336 log.cc:927] Time spent T 9067b67140fa48e883d2d240a6046d63 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:27:29.762769 16988 raft_consensus.cc:359] T 51ebab30b5104589803b75a1b48c5aa2 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:29.763895 16988 raft_consensus.cc:385] T 51ebab30b5104589803b75a1b48c5aa2 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:29.767884 16988 raft_consensus.cc:740] T 51ebab30b5104589803b75a1b48c5aa2 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Initialized, Role: FOLLOWER
I20260709 12:27:29.783782 16988 consensus_queue.cc:260] T 51ebab30b5104589803b75a1b48c5aa2 P 17294485b7f24e2b9fae71dd3169a336 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:29.768347 16719 raft_consensus.cc:2468] T 62e4e875fd4e4604952120df324e99cb P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in term 1.
I20260709 12:27:29.800865 17265 leader_election.cc:290] T 5f88e29c7ffd4b3b856561ee240cdd43 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 election: Requested vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
I20260709 12:27:29.811012 16867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f88e29c7ffd4b3b856561ee240cdd43" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336"
I20260709 12:27:29.826265 16714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f88e29c7ffd4b3b856561ee240cdd43" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8"
I20260709 12:27:29.835350 16991 raft_consensus.cc:359] T 2f737ece325c44c58194725a82923014 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:29.851436 17016 consensus_queue.cc:1048] T 51d96c645e894c8597652daf12a21cf3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:29.858263 16991 raft_consensus.cc:385] T 2f737ece325c44c58194725a82923014 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:29.858855 16991 raft_consensus.cc:740] T 2f737ece325c44c58194725a82923014 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c1aba6ee1d244fd9c0daba722aa0b3b, State: Initialized, Role: FOLLOWER
W20260709 12:27:29.860143 16759 leader_election.cc:343] T 5f88e29c7ffd4b3b856561ee240cdd43 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:29.860221 16991 consensus_queue.cc:260] T 2f737ece325c44c58194725a82923014 P 3c1aba6ee1d244fd9c0daba722aa0b3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:29.806896 17279 raft_consensus.cc:515] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:29.879328 16988 ts_tablet_manager.cc:1434] T 51ebab30b5104589803b75a1b48c5aa2 P 17294485b7f24e2b9fae71dd3169a336: Time spent starting tablet: real 0.240s	user 0.010s	sys 0.000s
I20260709 12:27:29.873113 16714 raft_consensus.cc:3060] T 5f88e29c7ffd4b3b856561ee240cdd43 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:29.941669 16987 tablet_bootstrap.cc:492] T 2f737ece325c44c58194725a82923014 P 879366e90f5c420588945e0d545017c8: No bootstrap required, opened a new log
I20260709 12:27:29.959540 16987 ts_tablet_manager.cc:1403] T 2f737ece325c44c58194725a82923014 P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.467s	user 0.038s	sys 0.057s
I20260709 12:27:29.959862 16988 tablet_bootstrap.cc:492] T 5f88e29c7ffd4b3b856561ee240cdd43 P 17294485b7f24e2b9fae71dd3169a336: Bootstrap starting.
I20260709 12:27:29.968264 16987 raft_consensus.cc:359] T 2f737ece325c44c58194725a82923014 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:29.969062 16987 raft_consensus.cc:385] T 2f737ece325c44c58194725a82923014 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:29.932565 16863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f2b93e5d2045a5a0cd1f9b5806a133" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336"
I20260709 12:27:29.929242 17279 leader_election.cc:290] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 election: Requested vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919)
I20260709 12:27:29.969362 16987 raft_consensus.cc:740] T 2f737ece325c44c58194725a82923014 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:29.973852 16989 tablet_bootstrap.cc:492] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d: No bootstrap required, opened a new log
I20260709 12:27:29.974568 16989 ts_tablet_manager.cc:1403] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d: Time spent bootstrapping tablet: real 0.568s	user 0.057s	sys 0.022s
I20260709 12:27:29.973920 16987 consensus_queue.cc:260] T 2f737ece325c44c58194725a82923014 P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:29.941213 16939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f2b93e5d2045a5a0cd1f9b5806a133" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d"
I20260709 12:27:29.977743 16863 raft_consensus.cc:3060] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:29.983395 17346 consensus_queue.cc:1048] T 442e0dfc272840f7a14c2232ed65425c P 879366e90f5c420588945e0d545017c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:29.880194 17245 raft_consensus.cc:515] T c220555f395e46d4be83f2b16f9691ef P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:29.992432 16989 raft_consensus.cc:359] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:29.994787 16991 ts_tablet_manager.cc:1434] T 2f737ece325c44c58194725a82923014 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent starting tablet: real 0.450s	user 0.016s	sys 0.004s
I20260709 12:27:29.997155 16987 ts_tablet_manager.cc:1434] T 2f737ece325c44c58194725a82923014 P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.037s	user 0.004s	sys 0.004s
I20260709 12:27:30.003702 16987 tablet_bootstrap.cc:492] T 51ebab30b5104589803b75a1b48c5aa2 P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:30.003778 16989 raft_consensus.cc:385] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:29.911060 17210 consensus_queue.cc:1048] T 62e4e875fd4e4604952120df324e99cb P 3c1aba6ee1d244fd9c0daba722aa0b3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.061s
I20260709 12:27:30.006367 17245 leader_election.cc:290] T c220555f395e46d4be83f2b16f9691ef P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 election: Requested vote from peers 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
I20260709 12:27:29.997306 17346 consensus_queue.cc:1048] T 442e0dfc272840f7a14c2232ed65425c P 879366e90f5c420588945e0d545017c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:30.008826 16991 tablet_bootstrap.cc:492] T f5345dc6d3b946e0bb9220acf126cf59 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Bootstrap starting.
I20260709 12:27:30.009678 16989 raft_consensus.cc:740] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f27bcdf252425aad4c4a37d064f68d, State: Initialized, Role: FOLLOWER
I20260709 12:27:30.015918 16989 consensus_queue.cc:260] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:30.016604 16868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c220555f395e46d4be83f2b16f9691ef" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336"
I20260709 12:27:30.017329 16868 raft_consensus.cc:3060] T c220555f395e46d4be83f2b16f9691ef P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:30.019150 16989 ts_tablet_manager.cc:1434] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d: Time spent starting tablet: real 0.044s	user 0.010s	sys 0.000s
I20260709 12:27:30.020300 16989 tablet_bootstrap.cc:492] T 2f737ece325c44c58194725a82923014 P 82f27bcdf252425aad4c4a37d064f68d: Bootstrap starting.
I20260709 12:27:30.020862 17288 raft_consensus.cc:493] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:30.021445 17288 raft_consensus.cc:515] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:30.032603 16868 raft_consensus.cc:2468] T c220555f395e46d4be83f2b16f9691ef P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82f27bcdf252425aad4c4a37d064f68d in term 1.
I20260709 12:27:30.035728 16939 raft_consensus.cc:3060] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:30.046489 16991 tablet_bootstrap.cc:654] T f5345dc6d3b946e0bb9220acf126cf59 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:30.047667 16866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f2b93e5d2045a5a0cd1f9b5806a133" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:30.038180 16714 raft_consensus.cc:2468] T 5f88e29c7ffd4b3b856561ee240cdd43 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in term 1.
I20260709 12:27:30.049074 16907 leader_election.cc:304] T c220555f395e46d4be83f2b16f9691ef P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 82f27bcdf252425aad4c4a37d064f68d; no voters: 
I20260709 12:27:30.050208 17288 leader_election.cc:290] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:30.051121 17288 raft_consensus.cc:2804] T c220555f395e46d4be83f2b16f9691ef P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:30.049196 17213 raft_consensus.cc:493] T 51ebab30b5104589803b75a1b48c5aa2 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:30.058312 17213 raft_consensus.cc:515] T 51ebab30b5104589803b75a1b48c5aa2 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:30.058758 16716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f2b93e5d2045a5a0cd1f9b5806a133" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8" is_pre_election: true
I20260709 12:27:30.059978 16716 raft_consensus.cc:2393] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 82f27bcdf252425aad4c4a37d064f68d in current term 1: Already voted for candidate 879366e90f5c420588945e0d545017c8 in this term.
I20260709 12:27:30.061816 17213 leader_election.cc:290] T 51ebab30b5104589803b75a1b48c5aa2 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:30.062642 16988 tablet_bootstrap.cc:654] T 5f88e29c7ffd4b3b856561ee240cdd43 P 17294485b7f24e2b9fae71dd3169a336: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:30.068749 16792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c220555f395e46d4be83f2b16f9691ef" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b"
I20260709 12:27:30.069486 16792 raft_consensus.cc:3060] T c220555f395e46d4be83f2b16f9691ef P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:30.070094 16989 tablet_bootstrap.cc:654] T 2f737ece325c44c58194725a82923014 P 82f27bcdf252425aad4c4a37d064f68d: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:30.073307 17288 raft_consensus.cc:697] T c220555f395e46d4be83f2b16f9691ef P 82f27bcdf252425aad4c4a37d064f68d [term 1 LEADER]: Becoming Leader. State: Replica: 82f27bcdf252425aad4c4a37d064f68d, State: Running, Role: LEADER
I20260709 12:27:30.089206 17288 consensus_queue.cc:237] T c220555f395e46d4be83f2b16f9691ef P 82f27bcdf252425aad4c4a37d064f68d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:30.074626 16907 leader_election.cc:304] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8
I20260709 12:27:30.071450 17303 raft_consensus.cc:493] T 2f737ece325c44c58194725a82923014 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:30.077121 16716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ebab30b5104589803b75a1b48c5aa2" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8" is_pre_election: true
W20260709 12:27:30.113768 16833 leader_election.cc:343] T 51ebab30b5104589803b75a1b48c5aa2 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:30.127014 16991 tablet_bootstrap.cc:492] T f5345dc6d3b946e0bb9220acf126cf59 P 3c1aba6ee1d244fd9c0daba722aa0b3b: No bootstrap required, opened a new log
I20260709 12:27:30.127764 16991 ts_tablet_manager.cc:1403] T f5345dc6d3b946e0bb9220acf126cf59 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent bootstrapping tablet: real 0.124s	user 0.018s	sys 0.003s
I20260709 12:27:30.131378 16991 raft_consensus.cc:359] T f5345dc6d3b946e0bb9220acf126cf59 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:30.132913 16991 raft_consensus.cc:385] T f5345dc6d3b946e0bb9220acf126cf59 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:30.133244 16991 raft_consensus.cc:740] T f5345dc6d3b946e0bb9220acf126cf59 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c1aba6ee1d244fd9c0daba722aa0b3b, State: Initialized, Role: FOLLOWER
I20260709 12:27:30.136965 16991 consensus_queue.cc:260] T f5345dc6d3b946e0bb9220acf126cf59 P 3c1aba6ee1d244fd9c0daba722aa0b3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:30.138334 16759 leader_election.cc:304] T 5f88e29c7ffd4b3b856561ee240cdd43 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8; no voters: 17294485b7f24e2b9fae71dd3169a336
I20260709 12:27:30.116171 17303 raft_consensus.cc:515] T 2f737ece325c44c58194725a82923014 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:30.151089 16988 tablet_bootstrap.cc:492] T 5f88e29c7ffd4b3b856561ee240cdd43 P 17294485b7f24e2b9fae71dd3169a336: No bootstrap required, opened a new log
I20260709 12:27:30.151844 16988 ts_tablet_manager.cc:1403] T 5f88e29c7ffd4b3b856561ee240cdd43 P 17294485b7f24e2b9fae71dd3169a336: Time spent bootstrapping tablet: real 0.192s	user 0.017s	sys 0.002s
I20260709 12:27:30.152522 17303 leader_election.cc:290] T 2f737ece325c44c58194725a82923014 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:30.145880 17315 raft_consensus.cc:2804] T 5f88e29c7ffd4b3b856561ee240cdd43 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:30.153906 17315 raft_consensus.cc:697] T 5f88e29c7ffd4b3b856561ee240cdd43 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 LEADER]: Becoming Leader. State: Replica: 3c1aba6ee1d244fd9c0daba722aa0b3b, State: Running, Role: LEADER
I20260709 12:27:30.154247 17212 consensus_queue.cc:1048] T 62e4e875fd4e4604952120df324e99cb P 3c1aba6ee1d244fd9c0daba722aa0b3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:30.154946 17315 consensus_queue.cc:237] T 5f88e29c7ffd4b3b856561ee240cdd43 P 3c1aba6ee1d244fd9c0daba722aa0b3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:30.159360 16988 raft_consensus.cc:359] T 5f88e29c7ffd4b3b856561ee240cdd43 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:30.161686 16988 raft_consensus.cc:385] T 5f88e29c7ffd4b3b856561ee240cdd43 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:30.162025 16988 raft_consensus.cc:740] T 5f88e29c7ffd4b3b856561ee240cdd43 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Initialized, Role: FOLLOWER
I20260709 12:27:30.132273 16937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ebab30b5104589803b75a1b48c5aa2" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:30.162820 16988 consensus_queue.cc:260] T 5f88e29c7ffd4b3b856561ee240cdd43 P 17294485b7f24e2b9fae71dd3169a336 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:30.164822 16988 ts_tablet_manager.cc:1434] T 5f88e29c7ffd4b3b856561ee240cdd43 P 17294485b7f24e2b9fae71dd3169a336: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:27:30.165877 16988 tablet_bootstrap.cc:492] T b6f178076e7f4c7bb41b4853bacbfc4e P 17294485b7f24e2b9fae71dd3169a336: Bootstrap starting.
W20260709 12:27:30.168248 16833 leader_election.cc:343] T 51ebab30b5104589803b75a1b48c5aa2 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:30.169092 16833 leader_election.cc:304] T 51ebab30b5104589803b75a1b48c5aa2 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336; no voters: 82f27bcdf252425aad4c4a37d064f68d, 879366e90f5c420588945e0d545017c8
I20260709 12:27:30.169312 16991 ts_tablet_manager.cc:1434] T f5345dc6d3b946e0bb9220acf126cf59 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.001s
I20260709 12:27:30.171983 16991 tablet_bootstrap.cc:492] T b6f178076e7f4c7bb41b4853bacbfc4e P 3c1aba6ee1d244fd9c0daba722aa0b3b: Bootstrap starting.
I20260709 12:27:30.172055 16987 tablet_bootstrap.cc:654] T 51ebab30b5104589803b75a1b48c5aa2 P 879366e90f5c420588945e0d545017c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:30.173264 16937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f737ece325c44c58194725a82923014" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
W20260709 12:27:30.175144 16759 leader_election.cc:343] T 2f737ece325c44c58194725a82923014 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:30.147029 16863 raft_consensus.cc:2468] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 1.
I20260709 12:27:30.174700 17257 raft_consensus.cc:2749] T 51ebab30b5104589803b75a1b48c5aa2 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:27:30.183655 17353 log.cc:927] Time spent T 442e0dfc272840f7a14c2232ed65425c P 3c1aba6ee1d244fd9c0daba722aa0b3b: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 12:27:30.191612 16991 tablet_bootstrap.cc:654] T b6f178076e7f4c7bb41b4853bacbfc4e P 3c1aba6ee1d244fd9c0daba722aa0b3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:30.193647 17257 raft_consensus.cc:493] T 5f88e29c7ffd4b3b856561ee240cdd43 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:30.194398 17257 raft_consensus.cc:515] T 5f88e29c7ffd4b3b856561ee240cdd43 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:30.197422 17257 leader_election.cc:290] T 5f88e29c7ffd4b3b856561ee240cdd43 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:30.197470 17210 raft_consensus.cc:493] T f5345dc6d3b946e0bb9220acf126cf59 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:30.200106 16719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f88e29c7ffd4b3b856561ee240cdd43" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8" is_pre_election: true
I20260709 12:27:30.201313 16719 raft_consensus.cc:2393] T 5f88e29c7ffd4b3b856561ee240cdd43 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17294485b7f24e2b9fae71dd3169a336 in current term 1: Already voted for candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in this term.
I20260709 12:27:30.201879 16714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f737ece325c44c58194725a82923014" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8" is_pre_election: true
I20260709 12:27:30.202682 16714 raft_consensus.cc:2468] T 2f737ece325c44c58194725a82923014 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in term 0.
I20260709 12:27:30.201718 16791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f88e29c7ffd4b3b856561ee240cdd43" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
I20260709 12:27:30.203347 16684 leader_election.cc:304] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8; no voters: 
I20260709 12:27:30.204936 17346 raft_consensus.cc:2804] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:30.205541 17346 raft_consensus.cc:697] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 879366e90f5c420588945e0d545017c8 [term 1 LEADER]: Becoming Leader. State: Replica: 879366e90f5c420588945e0d545017c8, State: Running, Role: LEADER
I20260709 12:27:30.206689 17346 consensus_queue.cc:237] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 879366e90f5c420588945e0d545017c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:30.199453 17210 raft_consensus.cc:515] T f5345dc6d3b946e0bb9220acf126cf59 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:30.213442 17210 leader_election.cc:290] T f5345dc6d3b946e0bb9220acf126cf59 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919)
I20260709 12:27:30.214905 16833 leader_election.cc:304] T 5f88e29c7ffd4b3b856561ee240cdd43 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8
I20260709 12:27:30.218811 16792 raft_consensus.cc:2468] T c220555f395e46d4be83f2b16f9691ef P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82f27bcdf252425aad4c4a37d064f68d in term 1.
I20260709 12:27:30.225871 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5345dc6d3b946e0bb9220acf126cf59" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:30.225871 16868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5345dc6d3b946e0bb9220acf126cf59" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:30.227180 16988 tablet_bootstrap.cc:654] T b6f178076e7f4c7bb41b4853bacbfc4e P 17294485b7f24e2b9fae71dd3169a336: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:30.228259 17325 raft_consensus.cc:3060] T 5f88e29c7ffd4b3b856561ee240cdd43 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:30.230636 16616 catalog_manager.cc:5697] T 442e0dfc272840f7a14c2232ed65425c P 879366e90f5c420588945e0d545017c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 879366e90f5c420588945e0d545017c8 (127.9.116.65). New cstate: current_term: 1 leader_uuid: "879366e90f5c420588945e0d545017c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:30.238306 16989 tablet_bootstrap.cc:492] T 2f737ece325c44c58194725a82923014 P 82f27bcdf252425aad4c4a37d064f68d: No bootstrap required, opened a new log
I20260709 12:27:30.240111 16759 leader_election.cc:304] T 2f737ece325c44c58194725a82923014 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8; no voters: 82f27bcdf252425aad4c4a37d064f68d
I20260709 12:27:30.254599 16989 ts_tablet_manager.cc:1403] T 2f737ece325c44c58194725a82923014 P 82f27bcdf252425aad4c4a37d064f68d: Time spent bootstrapping tablet: real 0.235s	user 0.027s	sys 0.021s
I20260709 12:27:30.254809 17315 raft_consensus.cc:2804] T 2f737ece325c44c58194725a82923014 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:30.255903 17315 raft_consensus.cc:493] T 2f737ece325c44c58194725a82923014 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:30.255079 16616 catalog_manager.cc:5697] T 9067b67140fa48e883d2d240a6046d63 P 879366e90f5c420588945e0d545017c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 879366e90f5c420588945e0d545017c8 (127.9.116.65). New cstate: current_term: 1 leader_uuid: "879366e90f5c420588945e0d545017c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:30.256480 17315 raft_consensus.cc:3060] T 2f737ece325c44c58194725a82923014 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:27:30.263064 16759 leader_election.cc:343] T f5345dc6d3b946e0bb9220acf126cf59 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:30.266317 16989 raft_consensus.cc:359] T 2f737ece325c44c58194725a82923014 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:30.267179 16989 raft_consensus.cc:385] T 2f737ece325c44c58194725a82923014 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:30.267459 16989 raft_consensus.cc:740] T 2f737ece325c44c58194725a82923014 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f27bcdf252425aad4c4a37d064f68d, State: Initialized, Role: FOLLOWER
I20260709 12:27:30.262781 16939 raft_consensus.cc:2468] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 1.
I20260709 12:27:30.268391 16989 consensus_queue.cc:260] T 2f737ece325c44c58194725a82923014 P 82f27bcdf252425aad4c4a37d064f68d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:30.270706 17245 raft_consensus.cc:2749] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:27:30.265745 16759 leader_election.cc:343] T f5345dc6d3b946e0bb9220acf126cf59 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:30.272240 16759 leader_election.cc:304] T f5345dc6d3b946e0bb9220acf126cf59 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b; no voters: 17294485b7f24e2b9fae71dd3169a336, 82f27bcdf252425aad4c4a37d064f68d
I20260709 12:27:30.273032 17210 raft_consensus.cc:2749] T f5345dc6d3b946e0bb9220acf126cf59 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:30.279115 16989 ts_tablet_manager.cc:1434] T 2f737ece325c44c58194725a82923014 P 82f27bcdf252425aad4c4a37d064f68d: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 12:27:30.283303 16989 tablet_bootstrap.cc:492] T 51ebab30b5104589803b75a1b48c5aa2 P 82f27bcdf252425aad4c4a37d064f68d: Bootstrap starting.
I20260709 12:27:30.302564 16989 tablet_bootstrap.cc:654] T 51ebab30b5104589803b75a1b48c5aa2 P 82f27bcdf252425aad4c4a37d064f68d: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:30.311525 17069 raft_consensus.cc:493] T 2f737ece325c44c58194725a82923014 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:30.316105 17069 raft_consensus.cc:515] T 2f737ece325c44c58194725a82923014 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:30.319181 17069 leader_election.cc:290] T 2f737ece325c44c58194725a82923014 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:30.319561 16714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f737ece325c44c58194725a82923014" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8" is_pre_election: true
I20260709 12:27:30.320464 16714 raft_consensus.cc:2468] T 2f737ece325c44c58194725a82923014 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82f27bcdf252425aad4c4a37d064f68d in term 0.
I20260709 12:27:30.324671 16907 leader_election.cc:304] T 2f737ece325c44c58194725a82923014 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d, 879366e90f5c420588945e0d545017c8; no voters: 
I20260709 12:27:30.329154 17325 raft_consensus.cc:2749] T 5f88e29c7ffd4b3b856561ee240cdd43 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:30.344095 16792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f737ece325c44c58194725a82923014" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
I20260709 12:27:30.346611 17069 raft_consensus.cc:2804] T 2f737ece325c44c58194725a82923014 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:30.357580 16613 catalog_manager.cc:5697] T 51d96c645e894c8597652daf12a21cf3 P 3c1aba6ee1d244fd9c0daba722aa0b3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66). New cstate: current_term: 1 leader_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:30.376531 16987 tablet_bootstrap.cc:492] T 51ebab30b5104589803b75a1b48c5aa2 P 879366e90f5c420588945e0d545017c8: No bootstrap required, opened a new log
I20260709 12:27:30.378480 16987 ts_tablet_manager.cc:1403] T 51ebab30b5104589803b75a1b48c5aa2 P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.375s	user 0.021s	sys 0.019s
I20260709 12:27:30.382800 16613 catalog_manager.cc:5697] T 62e4e875fd4e4604952120df324e99cb P 3c1aba6ee1d244fd9c0daba722aa0b3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66). New cstate: current_term: 1 leader_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:30.366010 17069 raft_consensus.cc:493] T 2f737ece325c44c58194725a82923014 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:30.394704 17069 raft_consensus.cc:3060] T 2f737ece325c44c58194725a82923014 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:30.413071 16988 tablet_bootstrap.cc:492] T b6f178076e7f4c7bb41b4853bacbfc4e P 17294485b7f24e2b9fae71dd3169a336: No bootstrap required, opened a new log
I20260709 12:27:30.413630 16988 ts_tablet_manager.cc:1403] T b6f178076e7f4c7bb41b4853bacbfc4e P 17294485b7f24e2b9fae71dd3169a336: Time spent bootstrapping tablet: real 0.248s	user 0.013s	sys 0.022s
I20260709 12:27:30.414703 16991 tablet_bootstrap.cc:492] T b6f178076e7f4c7bb41b4853bacbfc4e P 3c1aba6ee1d244fd9c0daba722aa0b3b: No bootstrap required, opened a new log
I20260709 12:27:30.415311 16991 ts_tablet_manager.cc:1403] T b6f178076e7f4c7bb41b4853bacbfc4e P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent bootstrapping tablet: real 0.245s	user 0.023s	sys 0.021s
I20260709 12:27:30.426743 16991 raft_consensus.cc:359] T b6f178076e7f4c7bb41b4853bacbfc4e P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:30.427826 16991 raft_consensus.cc:385] T b6f178076e7f4c7bb41b4853bacbfc4e P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:30.428213 16991 raft_consensus.cc:740] T b6f178076e7f4c7bb41b4853bacbfc4e P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c1aba6ee1d244fd9c0daba722aa0b3b, State: Initialized, Role: FOLLOWER
I20260709 12:27:30.433137 16988 raft_consensus.cc:359] T b6f178076e7f4c7bb41b4853bacbfc4e P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:30.434031 16988 raft_consensus.cc:385] T b6f178076e7f4c7bb41b4853bacbfc4e P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:30.434291 16988 raft_consensus.cc:740] T b6f178076e7f4c7bb41b4853bacbfc4e P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Initialized, Role: FOLLOWER
I20260709 12:27:30.435113 16988 consensus_queue.cc:260] T b6f178076e7f4c7bb41b4853bacbfc4e P 17294485b7f24e2b9fae71dd3169a336 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:30.442276 16614 catalog_manager.cc:5697] T c220555f395e46d4be83f2b16f9691ef P 82f27bcdf252425aad4c4a37d064f68d reported cstate change: term changed from 0 to 1, leader changed from <none> to 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68). New cstate: current_term: 1 leader_uuid: "82f27bcdf252425aad4c4a37d064f68d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:30.445894 16987 raft_consensus.cc:359] T 51ebab30b5104589803b75a1b48c5aa2 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:30.446990 16987 raft_consensus.cc:385] T 51ebab30b5104589803b75a1b48c5aa2 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:30.447316 16987 raft_consensus.cc:740] T 51ebab30b5104589803b75a1b48c5aa2 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:30.429250 16991 consensus_queue.cc:260] T b6f178076e7f4c7bb41b4853bacbfc4e P 3c1aba6ee1d244fd9c0daba722aa0b3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:30.448397 16987 consensus_queue.cc:260] T 51ebab30b5104589803b75a1b48c5aa2 P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:30.451208 16991 ts_tablet_manager.cc:1434] T b6f178076e7f4c7bb41b4853bacbfc4e P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 12:27:30.409893 17315 raft_consensus.cc:515] T 2f737ece325c44c58194725a82923014 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:30.452301 16991 tablet_bootstrap.cc:492] T 29fcc4f156a54ca4b54a4a11e2cee973 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Bootstrap starting.
I20260709 12:27:30.452435 16792 raft_consensus.cc:2393] T 2f737ece325c44c58194725a82923014 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 82f27bcdf252425aad4c4a37d064f68d in current term 1: Already voted for candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in this term.
I20260709 12:27:30.453431 17315 leader_election.cc:290] T 2f737ece325c44c58194725a82923014 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 election: Requested vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:30.455503 16939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f737ece325c44c58194725a82923014" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d"
I20260709 12:27:30.458197 16714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f737ece325c44c58194725a82923014" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8"
I20260709 12:27:30.460762 16714 raft_consensus.cc:3060] T 2f737ece325c44c58194725a82923014 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:30.461134 17069 raft_consensus.cc:515] T 2f737ece325c44c58194725a82923014 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:30.460021 16989 tablet_bootstrap.cc:492] T 51ebab30b5104589803b75a1b48c5aa2 P 82f27bcdf252425aad4c4a37d064f68d: No bootstrap required, opened a new log
I20260709 12:27:30.462320 16989 ts_tablet_manager.cc:1403] T 51ebab30b5104589803b75a1b48c5aa2 P 82f27bcdf252425aad4c4a37d064f68d: Time spent bootstrapping tablet: real 0.179s	user 0.031s	sys 0.006s
I20260709 12:27:30.477669 16987 ts_tablet_manager.cc:1434] T 51ebab30b5104589803b75a1b48c5aa2 P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.098s	user 0.008s	sys 0.000s
I20260709 12:27:30.478885 16987 tablet_bootstrap.cc:492] T 3e78004b8cc14ac6b93c857cbdd63329 P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:30.463030 16939 raft_consensus.cc:2393] T 2f737ece325c44c58194725a82923014 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in current term 1: Already voted for candidate 82f27bcdf252425aad4c4a37d064f68d in this term.
I20260709 12:27:30.464461 17069 leader_election.cc:290] T 2f737ece325c44c58194725a82923014 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 election: Requested vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:30.465891 16988 ts_tablet_manager.cc:1434] T b6f178076e7f4c7bb41b4853bacbfc4e P 17294485b7f24e2b9fae71dd3169a336: Time spent starting tablet: real 0.052s	user 0.008s	sys 0.000s
I20260709 12:27:30.467072 16791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f737ece325c44c58194725a82923014" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b"
I20260709 12:27:30.473675 16716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f737ece325c44c58194725a82923014" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8"
I20260709 12:27:30.482576 16615 catalog_manager.cc:5697] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 879366e90f5c420588945e0d545017c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 879366e90f5c420588945e0d545017c8 (127.9.116.65). New cstate: current_term: 1 leader_uuid: "879366e90f5c420588945e0d545017c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:30.482678 16791 raft_consensus.cc:2393] T 2f737ece325c44c58194725a82923014 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 82f27bcdf252425aad4c4a37d064f68d in current term 1: Already voted for candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in this term.
I20260709 12:27:30.486817 16908 leader_election.cc:304] T 2f737ece325c44c58194725a82923014 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8
I20260709 12:27:30.489136 17069 raft_consensus.cc:2749] T 2f737ece325c44c58194725a82923014 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:27:30.491467 16988 tablet_bootstrap.cc:492] T f5345dc6d3b946e0bb9220acf126cf59 P 17294485b7f24e2b9fae71dd3169a336: Bootstrap starting.
I20260709 12:27:30.504868 16991 tablet_bootstrap.cc:654] T 29fcc4f156a54ca4b54a4a11e2cee973 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:30.506771 16714 raft_consensus.cc:2468] T 2f737ece325c44c58194725a82923014 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in term 1.
I20260709 12:27:30.512535 16759 leader_election.cc:304] T 2f737ece325c44c58194725a82923014 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8; no voters: 82f27bcdf252425aad4c4a37d064f68d
I20260709 12:27:30.513724 17315 raft_consensus.cc:2804] T 2f737ece325c44c58194725a82923014 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:30.514274 17315 raft_consensus.cc:697] T 2f737ece325c44c58194725a82923014 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 LEADER]: Becoming Leader. State: Replica: 3c1aba6ee1d244fd9c0daba722aa0b3b, State: Running, Role: LEADER
I20260709 12:27:30.515762 16987 tablet_bootstrap.cc:654] T 3e78004b8cc14ac6b93c857cbdd63329 P 879366e90f5c420588945e0d545017c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:30.515147 17315 consensus_queue.cc:237] T 2f737ece325c44c58194725a82923014 P 3c1aba6ee1d244fd9c0daba722aa0b3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:30.524350 16988 tablet_bootstrap.cc:654] T f5345dc6d3b946e0bb9220acf126cf59 P 17294485b7f24e2b9fae71dd3169a336: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:30.509784 16989 raft_consensus.cc:359] T 51ebab30b5104589803b75a1b48c5aa2 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:30.531993 16989 raft_consensus.cc:385] T 51ebab30b5104589803b75a1b48c5aa2 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:30.532467 16989 raft_consensus.cc:740] T 51ebab30b5104589803b75a1b48c5aa2 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f27bcdf252425aad4c4a37d064f68d, State: Initialized, Role: FOLLOWER
I20260709 12:27:30.533455 16989 consensus_queue.cc:260] T 51ebab30b5104589803b75a1b48c5aa2 P 82f27bcdf252425aad4c4a37d064f68d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:30.539870 16989 ts_tablet_manager.cc:1434] T 51ebab30b5104589803b75a1b48c5aa2 P 82f27bcdf252425aad4c4a37d064f68d: Time spent starting tablet: real 0.061s	user 0.009s	sys 0.000s
I20260709 12:27:30.542750 16987 tablet_bootstrap.cc:492] T 3e78004b8cc14ac6b93c857cbdd63329 P 879366e90f5c420588945e0d545017c8: No bootstrap required, opened a new log
I20260709 12:27:30.543697 16987 ts_tablet_manager.cc:1403] T 3e78004b8cc14ac6b93c857cbdd63329 P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.065s	user 0.013s	sys 0.000s
I20260709 12:27:30.547364 16987 raft_consensus.cc:359] T 3e78004b8cc14ac6b93c857cbdd63329 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:30.548357 16987 raft_consensus.cc:385] T 3e78004b8cc14ac6b93c857cbdd63329 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:30.548745 16987 raft_consensus.cc:740] T 3e78004b8cc14ac6b93c857cbdd63329 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:30.549063 16991 tablet_bootstrap.cc:492] T 29fcc4f156a54ca4b54a4a11e2cee973 P 3c1aba6ee1d244fd9c0daba722aa0b3b: No bootstrap required, opened a new log
I20260709 12:27:30.549777 16991 ts_tablet_manager.cc:1403] T 29fcc4f156a54ca4b54a4a11e2cee973 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent bootstrapping tablet: real 0.098s	user 0.012s	sys 0.000s
I20260709 12:27:30.549665 16987 consensus_queue.cc:260] T 3e78004b8cc14ac6b93c857cbdd63329 P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:30.553793 16989 tablet_bootstrap.cc:492] T 6a86fc21ef0044bb91dd271c9a019336 P 82f27bcdf252425aad4c4a37d064f68d: Bootstrap starting.
I20260709 12:27:30.553974 16991 raft_consensus.cc:359] T 29fcc4f156a54ca4b54a4a11e2cee973 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:30.554702 16991 raft_consensus.cc:385] T 29fcc4f156a54ca4b54a4a11e2cee973 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:30.554975 16991 raft_consensus.cc:740] T 29fcc4f156a54ca4b54a4a11e2cee973 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c1aba6ee1d244fd9c0daba722aa0b3b, State: Initialized, Role: FOLLOWER
I20260709 12:27:30.556470 16991 consensus_queue.cc:260] T 29fcc4f156a54ca4b54a4a11e2cee973 P 3c1aba6ee1d244fd9c0daba722aa0b3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:30.559058 16988 tablet_bootstrap.cc:492] T f5345dc6d3b946e0bb9220acf126cf59 P 17294485b7f24e2b9fae71dd3169a336: No bootstrap required, opened a new log
I20260709 12:27:30.559686 16988 ts_tablet_manager.cc:1403] T f5345dc6d3b946e0bb9220acf126cf59 P 17294485b7f24e2b9fae71dd3169a336: Time spent bootstrapping tablet: real 0.069s	user 0.013s	sys 0.000s
I20260709 12:27:30.561898 16987 ts_tablet_manager.cc:1434] T 3e78004b8cc14ac6b93c857cbdd63329 P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:27:30.562539 16988 raft_consensus.cc:359] T f5345dc6d3b946e0bb9220acf126cf59 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:30.563308 16988 raft_consensus.cc:385] T f5345dc6d3b946e0bb9220acf126cf59 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:30.563642 16988 raft_consensus.cc:740] T f5345dc6d3b946e0bb9220acf126cf59 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Initialized, Role: FOLLOWER
I20260709 12:27:30.564838 16989 tablet_bootstrap.cc:654] T 6a86fc21ef0044bb91dd271c9a019336 P 82f27bcdf252425aad4c4a37d064f68d: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:30.564527 16988 consensus_queue.cc:260] T f5345dc6d3b946e0bb9220acf126cf59 P 17294485b7f24e2b9fae71dd3169a336 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:30.566870 16988 ts_tablet_manager.cc:1434] T f5345dc6d3b946e0bb9220acf126cf59 P 17294485b7f24e2b9fae71dd3169a336: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:27:30.567896 16988 tablet_bootstrap.cc:492] T 29fcc4f156a54ca4b54a4a11e2cee973 P 17294485b7f24e2b9fae71dd3169a336: Bootstrap starting.
I20260709 12:27:30.563020 16987 tablet_bootstrap.cc:492] T 6a86fc21ef0044bb91dd271c9a019336 P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:30.573518 16613 catalog_manager.cc:5697] T 5f88e29c7ffd4b3b856561ee240cdd43 P 3c1aba6ee1d244fd9c0daba722aa0b3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66). New cstate: current_term: 1 leader_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:30.574940 16987 tablet_bootstrap.cc:654] T 6a86fc21ef0044bb91dd271c9a019336 P 879366e90f5c420588945e0d545017c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:30.580581 17212 consensus_queue.cc:1048] T 5f88e29c7ffd4b3b856561ee240cdd43 P 3c1aba6ee1d244fd9c0daba722aa0b3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:30.589951 16991 ts_tablet_manager.cc:1434] T 29fcc4f156a54ca4b54a4a11e2cee973 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.001s
I20260709 12:27:30.591241 16991 tablet_bootstrap.cc:492] T ce37f3e8575c4b8e88935db231644a27 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Bootstrap starting.
I20260709 12:27:30.591322 16987 tablet_bootstrap.cc:492] T 6a86fc21ef0044bb91dd271c9a019336 P 879366e90f5c420588945e0d545017c8: No bootstrap required, opened a new log
I20260709 12:27:30.593263 16987 ts_tablet_manager.cc:1403] T 6a86fc21ef0044bb91dd271c9a019336 P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.004s
I20260709 12:27:30.596510 17249 consensus_queue.cc:1048] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 879366e90f5c420588945e0d545017c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:30.602715 16988 tablet_bootstrap.cc:654] T 29fcc4f156a54ca4b54a4a11e2cee973 P 17294485b7f24e2b9fae71dd3169a336: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:30.605660 16987 raft_consensus.cc:359] T 6a86fc21ef0044bb91dd271c9a019336 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:30.606437 16987 raft_consensus.cc:385] T 6a86fc21ef0044bb91dd271c9a019336 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:30.606714 16987 raft_consensus.cc:740] T 6a86fc21ef0044bb91dd271c9a019336 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:30.607656 16987 consensus_queue.cc:260] T 6a86fc21ef0044bb91dd271c9a019336 P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:30.614379 16991 tablet_bootstrap.cc:654] T ce37f3e8575c4b8e88935db231644a27 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:30.619565 16987 ts_tablet_manager.cc:1434] T 6a86fc21ef0044bb91dd271c9a019336 P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 12:27:30.620729 16987 tablet_bootstrap.cc:492] T ce37f3e8575c4b8e88935db231644a27 P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:30.638677 16989 tablet_bootstrap.cc:492] T 6a86fc21ef0044bb91dd271c9a019336 P 82f27bcdf252425aad4c4a37d064f68d: No bootstrap required, opened a new log
I20260709 12:27:30.644258 16989 ts_tablet_manager.cc:1403] T 6a86fc21ef0044bb91dd271c9a019336 P 82f27bcdf252425aad4c4a37d064f68d: Time spent bootstrapping tablet: real 0.090s	user 0.019s	sys 0.007s
I20260709 12:27:30.652611 17210 consensus_queue.cc:1048] T 5f88e29c7ffd4b3b856561ee240cdd43 P 3c1aba6ee1d244fd9c0daba722aa0b3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:30.662088 16989 raft_consensus.cc:359] T 6a86fc21ef0044bb91dd271c9a019336 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:30.663098 16989 raft_consensus.cc:385] T 6a86fc21ef0044bb91dd271c9a019336 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:30.663396 16989 raft_consensus.cc:740] T 6a86fc21ef0044bb91dd271c9a019336 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f27bcdf252425aad4c4a37d064f68d, State: Initialized, Role: FOLLOWER
I20260709 12:27:30.658829 17248 raft_consensus.cc:493] T b6f178076e7f4c7bb41b4853bacbfc4e P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:30.664083 17248 raft_consensus.cc:515] T b6f178076e7f4c7bb41b4853bacbfc4e P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:30.669163 16792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f178076e7f4c7bb41b4853bacbfc4e" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
I20260709 12:27:30.670395 16792 raft_consensus.cc:2468] T b6f178076e7f4c7bb41b4853bacbfc4e P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 0.
I20260709 12:27:30.671335 17248 leader_election.cc:290] T b6f178076e7f4c7bb41b4853bacbfc4e P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:30.672502 16834 leader_election.cc:304] T b6f178076e7f4c7bb41b4853bacbfc4e P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 3c1aba6ee1d244fd9c0daba722aa0b3b; no voters: 
I20260709 12:27:30.673749 17069 consensus_queue.cc:1048] T c220555f395e46d4be83f2b16f9691ef P 82f27bcdf252425aad4c4a37d064f68d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:30.675184 17325 raft_consensus.cc:2804] T b6f178076e7f4c7bb41b4853bacbfc4e P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:30.675640 17325 raft_consensus.cc:493] T b6f178076e7f4c7bb41b4853bacbfc4e P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:30.675978 17325 raft_consensus.cc:3060] T b6f178076e7f4c7bb41b4853bacbfc4e P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:30.674091 17347 consensus_queue.cc:1048] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 879366e90f5c420588945e0d545017c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:30.680212 16716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f178076e7f4c7bb41b4853bacbfc4e" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8" is_pre_election: true
I20260709 12:27:30.682307 16989 consensus_queue.cc:260] T 6a86fc21ef0044bb91dd271c9a019336 P 82f27bcdf252425aad4c4a37d064f68d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
W20260709 12:27:30.684764 16833 leader_election.cc:343] T b6f178076e7f4c7bb41b4853bacbfc4e P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:30.689364 17288 consensus_queue.cc:1048] T c220555f395e46d4be83f2b16f9691ef P 82f27bcdf252425aad4c4a37d064f68d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:27:30.701380 16987 tablet_bootstrap.cc:654] T ce37f3e8575c4b8e88935db231644a27 P 879366e90f5c420588945e0d545017c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:30.704496 17248 raft_consensus.cc:493] T f5345dc6d3b946e0bb9220acf126cf59 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:30.705586 17248 raft_consensus.cc:515] T f5345dc6d3b946e0bb9220acf126cf59 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:30.685045 16989 ts_tablet_manager.cc:1434] T 6a86fc21ef0044bb91dd271c9a019336 P 82f27bcdf252425aad4c4a37d064f68d: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.000s
I20260709 12:27:30.709671 16989 tablet_bootstrap.cc:492] T f5345dc6d3b946e0bb9220acf126cf59 P 82f27bcdf252425aad4c4a37d064f68d: Bootstrap starting.
I20260709 12:27:30.722568 16613 catalog_manager.cc:5697] T 2f737ece325c44c58194725a82923014 P 3c1aba6ee1d244fd9c0daba722aa0b3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66). New cstate: current_term: 1 leader_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:30.738452 17279 raft_consensus.cc:493] T 51ebab30b5104589803b75a1b48c5aa2 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:30.747805 17279 raft_consensus.cc:515] T 51ebab30b5104589803b75a1b48c5aa2 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:30.750414 17279 leader_election.cc:290] T 51ebab30b5104589803b75a1b48c5aa2 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919)
I20260709 12:27:30.751689 17212 raft_consensus.cc:493] T 29fcc4f156a54ca4b54a4a11e2cee973 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:30.752317 17212 raft_consensus.cc:515] T 29fcc4f156a54ca4b54a4a11e2cee973 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:30.754529 17212 leader_election.cc:290] T 29fcc4f156a54ca4b54a4a11e2cee973 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919)
I20260709 12:27:30.756810 16988 tablet_bootstrap.cc:492] T 29fcc4f156a54ca4b54a4a11e2cee973 P 17294485b7f24e2b9fae71dd3169a336: No bootstrap required, opened a new log
I20260709 12:27:30.757485 16988 ts_tablet_manager.cc:1403] T 29fcc4f156a54ca4b54a4a11e2cee973 P 17294485b7f24e2b9fae71dd3169a336: Time spent bootstrapping tablet: real 0.190s	user 0.010s	sys 0.023s
I20260709 12:27:30.761026 16867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ebab30b5104589803b75a1b48c5aa2" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:30.761554 16988 raft_consensus.cc:359] T 29fcc4f156a54ca4b54a4a11e2cee973 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:30.762508 16988 raft_consensus.cc:385] T 29fcc4f156a54ca4b54a4a11e2cee973 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:30.762843 16988 raft_consensus.cc:740] T 29fcc4f156a54ca4b54a4a11e2cee973 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Initialized, Role: FOLLOWER
I20260709 12:27:30.763392 16939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29fcc4f156a54ca4b54a4a11e2cee973" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:30.763947 16988 consensus_queue.cc:260] T 29fcc4f156a54ca4b54a4a11e2cee973 P 17294485b7f24e2b9fae71dd3169a336 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:30.765678 16866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29fcc4f156a54ca4b54a4a11e2cee973" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:30.766700 16866 raft_consensus.cc:2468] T 29fcc4f156a54ca4b54a4a11e2cee973 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in term 0.
I20260709 12:27:30.767230 16988 ts_tablet_manager.cc:1434] T 29fcc4f156a54ca4b54a4a11e2cee973 P 17294485b7f24e2b9fae71dd3169a336: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:27:30.769071 16988 tablet_bootstrap.cc:492] T b86527b8a77848629c50a32e2534f7ba P 17294485b7f24e2b9fae71dd3169a336: Bootstrap starting.
I20260709 12:27:30.770581 16792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5345dc6d3b946e0bb9220acf126cf59" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
I20260709 12:27:30.771363 16792 raft_consensus.cc:2468] T f5345dc6d3b946e0bb9220acf126cf59 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 0.
I20260709 12:27:30.761917 16867 raft_consensus.cc:2468] T 51ebab30b5104589803b75a1b48c5aa2 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 0.
I20260709 12:27:30.775104 16834 leader_election.cc:304] T f5345dc6d3b946e0bb9220acf126cf59 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 3c1aba6ee1d244fd9c0daba722aa0b3b; no voters: 
W20260709 12:27:30.777026 16759 leader_election.cc:343] T 29fcc4f156a54ca4b54a4a11e2cee973 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:30.804986 16759 leader_election.cc:304] T 29fcc4f156a54ca4b54a4a11e2cee973 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 3c1aba6ee1d244fd9c0daba722aa0b3b; no voters: 82f27bcdf252425aad4c4a37d064f68d
I20260709 12:27:30.777207 17257 raft_consensus.cc:2804] T f5345dc6d3b946e0bb9220acf126cf59 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:30.821230 16684 leader_election.cc:304] T 51ebab30b5104589803b75a1b48c5aa2 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8; no voters: 
I20260709 12:27:30.815531 17210 raft_consensus.cc:2804] T 29fcc4f156a54ca4b54a4a11e2cee973 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:30.816761 17257 raft_consensus.cc:493] T f5345dc6d3b946e0bb9220acf126cf59 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:30.830588 17249 raft_consensus.cc:2804] T 51ebab30b5104589803b75a1b48c5aa2 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:30.833344 17210 raft_consensus.cc:493] T 29fcc4f156a54ca4b54a4a11e2cee973 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:30.836560 17257 raft_consensus.cc:3060] T f5345dc6d3b946e0bb9220acf126cf59 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:30.861982 17210 raft_consensus.cc:3060] T 29fcc4f156a54ca4b54a4a11e2cee973 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:30.872413 16991 tablet_bootstrap.cc:492] T ce37f3e8575c4b8e88935db231644a27 P 3c1aba6ee1d244fd9c0daba722aa0b3b: No bootstrap required, opened a new log
I20260709 12:27:30.873003 16991 ts_tablet_manager.cc:1403] T ce37f3e8575c4b8e88935db231644a27 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent bootstrapping tablet: real 0.282s	user 0.036s	sys 0.033s
I20260709 12:27:30.865335 17325 raft_consensus.cc:515] T b6f178076e7f4c7bb41b4853bacbfc4e P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:30.846957 17249 raft_consensus.cc:493] T 51ebab30b5104589803b75a1b48c5aa2 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:30.878567 17249 raft_consensus.cc:3060] T 51ebab30b5104589803b75a1b48c5aa2 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:30.879966 17346 raft_consensus.cc:493] T 3e78004b8cc14ac6b93c857cbdd63329 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:30.880589 17346 raft_consensus.cc:515] T 3e78004b8cc14ac6b93c857cbdd63329 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:30.886137 16991 raft_consensus.cc:359] T ce37f3e8575c4b8e88935db231644a27 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:30.887387 16939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e78004b8cc14ac6b93c857cbdd63329" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:30.887729 16991 raft_consensus.cc:385] T ce37f3e8575c4b8e88935db231644a27 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:30.888321 16862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e78004b8cc14ac6b93c857cbdd63329" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:30.888672 16988 tablet_bootstrap.cc:654] T b86527b8a77848629c50a32e2534f7ba P 17294485b7f24e2b9fae71dd3169a336: Neither blocks nor log segments found. Creating new log.
W20260709 12:27:30.889855 16684 leader_election.cc:343] T 3e78004b8cc14ac6b93c857cbdd63329 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:27:30.891007 16684 leader_election.cc:343] T 3e78004b8cc14ac6b93c857cbdd63329 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:30.891476 16684 leader_election.cc:304] T 3e78004b8cc14ac6b93c857cbdd63329 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 879366e90f5c420588945e0d545017c8; no voters: 17294485b7f24e2b9fae71dd3169a336, 82f27bcdf252425aad4c4a37d064f68d
I20260709 12:27:30.878031 17325 leader_election.cc:290] T b6f178076e7f4c7bb41b4853bacbfc4e P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 election: Requested vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:30.888288 16991 raft_consensus.cc:740] T ce37f3e8575c4b8e88935db231644a27 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c1aba6ee1d244fd9c0daba722aa0b3b, State: Initialized, Role: FOLLOWER
I20260709 12:27:30.892869 17279 raft_consensus.cc:2749] T 3e78004b8cc14ac6b93c857cbdd63329 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:30.894327 16991 consensus_queue.cc:260] T ce37f3e8575c4b8e88935db231644a27 P 3c1aba6ee1d244fd9c0daba722aa0b3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:30.897902 16991 ts_tablet_manager.cc:1434] T ce37f3e8575c4b8e88935db231644a27 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 12:27:30.892876 16987 tablet_bootstrap.cc:492] T ce37f3e8575c4b8e88935db231644a27 P 879366e90f5c420588945e0d545017c8: No bootstrap required, opened a new log
I20260709 12:27:30.898540 16989 tablet_bootstrap.cc:654] T f5345dc6d3b946e0bb9220acf126cf59 P 82f27bcdf252425aad4c4a37d064f68d: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:30.883205 17346 leader_election.cc:290] T 3e78004b8cc14ac6b93c857cbdd63329 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919)
I20260709 12:27:30.914899 16987 ts_tablet_manager.cc:1403] T ce37f3e8575c4b8e88935db231644a27 P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.294s	user 0.002s	sys 0.022s
W20260709 12:27:30.921360 16833 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37919, user_credentials={real_user=slave}} blocked reactor thread for 107543us
I20260709 12:27:30.926548 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5345dc6d3b946e0bb9220acf126cf59" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:30.928162 16991 tablet_bootstrap.cc:492] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Bootstrap starting.
W20260709 12:27:30.980738 16759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37919, user_credentials={real_user=slave}} blocked reactor thread for 113367us
W20260709 12:27:31.063994 16833 leader_election.cc:343] T f5345dc6d3b946e0bb9220acf126cf59 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:31.080904 16989 tablet_bootstrap.cc:492] T f5345dc6d3b946e0bb9220acf126cf59 P 82f27bcdf252425aad4c4a37d064f68d: No bootstrap required, opened a new log
I20260709 12:27:31.081519 16989 ts_tablet_manager.cc:1403] T f5345dc6d3b946e0bb9220acf126cf59 P 82f27bcdf252425aad4c4a37d064f68d: Time spent bootstrapping tablet: real 0.372s	user 0.011s	sys 0.006s
I20260709 12:27:31.075222 17403 raft_consensus.cc:493] T 6a86fc21ef0044bb91dd271c9a019336 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:31.069061 17248 leader_election.cc:290] T f5345dc6d3b946e0bb9220acf126cf59 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629), 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919)
I20260709 12:27:31.100299 17403 raft_consensus.cc:515] T 6a86fc21ef0044bb91dd271c9a019336 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:31.124424 17403 leader_election.cc:290] T 6a86fc21ef0044bb91dd271c9a019336 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:31.125010 17403 raft_consensus.cc:493] T 51ebab30b5104589803b75a1b48c5aa2 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:31.125677 17403 raft_consensus.cc:515] T 51ebab30b5104589803b75a1b48c5aa2 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:31.113003 16714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f178076e7f4c7bb41b4853bacbfc4e" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8"
I20260709 12:27:31.159435 17403 leader_election.cc:290] T 51ebab30b5104589803b75a1b48c5aa2 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:31.164840 17210 raft_consensus.cc:515] T 29fcc4f156a54ca4b54a4a11e2cee973 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:31.173637 16991 tablet_bootstrap.cc:654] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:31.184734 17210 leader_election.cc:290] T 29fcc4f156a54ca4b54a4a11e2cee973 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 election: Requested vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919)
I20260709 12:27:31.172135 16792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f178076e7f4c7bb41b4853bacbfc4e" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b"
I20260709 12:27:31.208313 16792 raft_consensus.cc:3060] T b6f178076e7f4c7bb41b4853bacbfc4e P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:31.192957 16987 raft_consensus.cc:359] T ce37f3e8575c4b8e88935db231644a27 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:31.193397 16938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ebab30b5104589803b75a1b48c5aa2" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:31.195061 16988 tablet_bootstrap.cc:492] T b86527b8a77848629c50a32e2534f7ba P 17294485b7f24e2b9fae71dd3169a336: No bootstrap required, opened a new log
I20260709 12:27:31.212503 16988 ts_tablet_manager.cc:1403] T b86527b8a77848629c50a32e2534f7ba P 17294485b7f24e2b9fae71dd3169a336: Time spent bootstrapping tablet: real 0.444s	user 0.011s	sys 0.008s
I20260709 12:27:31.198987 17249 raft_consensus.cc:515] T 51ebab30b5104589803b75a1b48c5aa2 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:31.163111 17257 raft_consensus.cc:515] T f5345dc6d3b946e0bb9220acf126cf59 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:31.210901 16987 raft_consensus.cc:385] T ce37f3e8575c4b8e88935db231644a27 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:31.235734 16987 raft_consensus.cc:740] T ce37f3e8575c4b8e88935db231644a27 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:31.238747 16987 consensus_queue.cc:260] T ce37f3e8575c4b8e88935db231644a27 P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
W20260709 12:27:31.246471 16907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:38103, user_credentials={real_user=slave}} blocked reactor thread for 197349us
I20260709 12:27:31.275144 16792 raft_consensus.cc:2468] T b6f178076e7f4c7bb41b4853bacbfc4e P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 1.
I20260709 12:27:31.305827 16987 ts_tablet_manager.cc:1434] T ce37f3e8575c4b8e88935db231644a27 P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.388s	user 0.012s	sys 0.011s
W20260709 12:27:31.308943 16684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:38103, user_credentials={real_user=slave}} blocked reactor thread for 176031us
I20260709 12:27:31.238404 16938 raft_consensus.cc:2468] T 51ebab30b5104589803b75a1b48c5aa2 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 0.
I20260709 12:27:31.320886 16834 leader_election.cc:304] T b6f178076e7f4c7bb41b4853bacbfc4e P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 3c1aba6ee1d244fd9c0daba722aa0b3b; no voters: 
I20260709 12:27:31.332077 17248 raft_consensus.cc:2804] T b6f178076e7f4c7bb41b4853bacbfc4e P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:31.332774 17248 raft_consensus.cc:697] T b6f178076e7f4c7bb41b4853bacbfc4e P 17294485b7f24e2b9fae71dd3169a336 [term 1 LEADER]: Becoming Leader. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Running, Role: LEADER
I20260709 12:27:31.333827 17248 consensus_queue.cc:237] T b6f178076e7f4c7bb41b4853bacbfc4e P 17294485b7f24e2b9fae71dd3169a336 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:31.322391 16863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ebab30b5104589803b75a1b48c5aa2" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:31.338351 16793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5345dc6d3b946e0bb9220acf126cf59" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b"
I20260709 12:27:31.321909 16988 raft_consensus.cc:359] T b86527b8a77848629c50a32e2534f7ba P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:31.340410 16988 raft_consensus.cc:385] T b86527b8a77848629c50a32e2534f7ba P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:31.340859 16988 raft_consensus.cc:740] T b86527b8a77848629c50a32e2534f7ba P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Initialized, Role: FOLLOWER
I20260709 12:27:31.322808 16989 raft_consensus.cc:359] T f5345dc6d3b946e0bb9220acf126cf59 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:31.341794 16989 raft_consensus.cc:385] T f5345dc6d3b946e0bb9220acf126cf59 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:31.342212 16989 raft_consensus.cc:740] T f5345dc6d3b946e0bb9220acf126cf59 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f27bcdf252425aad4c4a37d064f68d, State: Initialized, Role: FOLLOWER
I20260709 12:27:31.327064 17257 leader_election.cc:290] T f5345dc6d3b946e0bb9220acf126cf59 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 election: Requested vote from peers 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629), 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919)
I20260709 12:27:31.329234 17249 leader_election.cc:290] T 51ebab30b5104589803b75a1b48c5aa2 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 election: Requested vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919)
I20260709 12:27:31.349601 16988 consensus_queue.cc:260] T b86527b8a77848629c50a32e2534f7ba P 17294485b7f24e2b9fae71dd3169a336 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:31.353518 16988 ts_tablet_manager.cc:1434] T b86527b8a77848629c50a32e2534f7ba P 17294485b7f24e2b9fae71dd3169a336: Time spent starting tablet: real 0.141s	user 0.006s	sys 0.003s
I20260709 12:27:31.354570 16988 tablet_bootstrap.cc:492] T 3e78004b8cc14ac6b93c857cbdd63329 P 17294485b7f24e2b9fae71dd3169a336: Bootstrap starting.
I20260709 12:27:31.342772 16792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a86fc21ef0044bb91dd271c9a019336" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
I20260709 12:27:31.343686 16793 raft_consensus.cc:3060] T f5345dc6d3b946e0bb9220acf126cf59 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:31.348664 16863 raft_consensus.cc:2468] T 51ebab30b5104589803b75a1b48c5aa2 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82f27bcdf252425aad4c4a37d064f68d in term 0.
I20260709 12:27:31.378727 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29fcc4f156a54ca4b54a4a11e2cee973" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d"
W20260709 12:27:31.352504 16685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:43629, user_credentials={real_user=slave}} blocked reactor thread for 181683us
I20260709 12:27:31.374243 17388 raft_consensus.cc:493] T ce37f3e8575c4b8e88935db231644a27 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:31.453913 16759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37919, user_credentials={real_user=slave}} blocked reactor thread for 72569.5us
I20260709 12:27:31.468050 16907 leader_election.cc:304] T 51ebab30b5104589803b75a1b48c5aa2 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 82f27bcdf252425aad4c4a37d064f68d; no voters: 
I20260709 12:27:31.452370 17249 raft_consensus.cc:493] T 6a86fc21ef0044bb91dd271c9a019336 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:31.480521 16759 leader_election.cc:343] T 29fcc4f156a54ca4b54a4a11e2cee973 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:31.489645 16934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ebab30b5104589803b75a1b48c5aa2" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d"
W20260709 12:27:31.491942 16908 leader_election.cc:343] T 6a86fc21ef0044bb91dd271c9a019336 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:31.492002 16991 tablet_bootstrap.cc:492] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 3c1aba6ee1d244fd9c0daba722aa0b3b: No bootstrap required, opened a new log
I20260709 12:27:31.493172 16991 ts_tablet_manager.cc:1403] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent bootstrapping tablet: real 0.570s	user 0.043s	sys 0.053s
I20260709 12:27:31.465467 16714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a86fc21ef0044bb91dd271c9a019336" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8" is_pre_election: true
I20260709 12:27:31.475083 17069 raft_consensus.cc:2804] T 51ebab30b5104589803b75a1b48c5aa2 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:31.462935 17388 raft_consensus.cc:515] T ce37f3e8575c4b8e88935db231644a27 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:31.515066 17388 leader_election.cc:290] T ce37f3e8575c4b8e88935db231644a27 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
I20260709 12:27:31.516557 16866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ebab30b5104589803b75a1b48c5aa2" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336"
I20260709 12:27:31.517378 16866 raft_consensus.cc:3060] T 51ebab30b5104589803b75a1b48c5aa2 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:31.519910 17257 raft_consensus.cc:493] T b86527b8a77848629c50a32e2534f7ba P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:31.520128 16987 tablet_bootstrap.cc:492] T b6f178076e7f4c7bb41b4853bacbfc4e P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:31.520512 17257 raft_consensus.cc:515] T b86527b8a77848629c50a32e2534f7ba P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:31.509145 17069 raft_consensus.cc:493] T 51ebab30b5104589803b75a1b48c5aa2 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:31.532745 17069 raft_consensus.cc:3060] T 51ebab30b5104589803b75a1b48c5aa2 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:31.541635 16793 raft_consensus.cc:2468] T f5345dc6d3b946e0bb9220acf126cf59 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 1.
I20260709 12:27:31.543242 16834 leader_election.cc:304] T f5345dc6d3b946e0bb9220acf126cf59 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 3c1aba6ee1d244fd9c0daba722aa0b3b; no voters: 
I20260709 12:27:31.544344 17389 raft_consensus.cc:2804] T f5345dc6d3b946e0bb9220acf126cf59 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:31.544523 16866 raft_consensus.cc:2468] T 51ebab30b5104589803b75a1b48c5aa2 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 1.
I20260709 12:27:31.544910 17389 raft_consensus.cc:697] T f5345dc6d3b946e0bb9220acf126cf59 P 17294485b7f24e2b9fae71dd3169a336 [term 1 LEADER]: Becoming Leader. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Running, Role: LEADER
I20260709 12:27:31.546186 17389 consensus_queue.cc:237] T f5345dc6d3b946e0bb9220acf126cf59 P 17294485b7f24e2b9fae71dd3169a336 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:31.547972 17257 leader_election.cc:290] T b86527b8a77848629c50a32e2534f7ba P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:31.549314 16991 raft_consensus.cc:359] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:31.550367 16991 raft_consensus.cc:385] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:31.550690 16991 raft_consensus.cc:740] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c1aba6ee1d244fd9c0daba722aa0b3b, State: Initialized, Role: FOLLOWER
I20260709 12:27:31.551926 16716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ebab30b5104589803b75a1b48c5aa2" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8" is_pre_election: true
I20260709 12:27:31.553087 16716 raft_consensus.cc:2393] T 51ebab30b5104589803b75a1b48c5aa2 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 82f27bcdf252425aad4c4a37d064f68d in current term 1: Already voted for candidate 879366e90f5c420588945e0d545017c8 in this term.
I20260709 12:27:31.552824 16991 consensus_queue.cc:260] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:31.554889 16988 tablet_bootstrap.cc:654] T 3e78004b8cc14ac6b93c857cbdd63329 P 17294485b7f24e2b9fae71dd3169a336: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:31.495324 17249 raft_consensus.cc:515] T 6a86fc21ef0044bb91dd271c9a019336 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:31.556461 16714 raft_consensus.cc:2468] T 6a86fc21ef0044bb91dd271c9a019336 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82f27bcdf252425aad4c4a37d064f68d in term 0.
I20260709 12:27:31.557746 17249 leader_election.cc:290] T 6a86fc21ef0044bb91dd271c9a019336 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:31.570364 16991 ts_tablet_manager.cc:1434] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent starting tablet: real 0.077s	user 0.009s	sys 0.000s
I20260709 12:27:31.576824 16991 tablet_bootstrap.cc:492] T 6a86fc21ef0044bb91dd271c9a019336 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Bootstrap starting.
I20260709 12:27:31.568029 17212 consensus_queue.cc:1048] T 2f737ece325c44c58194725a82923014 P 3c1aba6ee1d244fd9c0daba722aa0b3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:27:31.581647 16989 consensus_queue.cc:260] T f5345dc6d3b946e0bb9220acf126cf59 P 82f27bcdf252425aad4c4a37d064f68d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
W20260709 12:27:31.584676 16833 leader_election.cc:343] T b6f178076e7f4c7bb41b4853bacbfc4e P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:31.594666 16938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5345dc6d3b946e0bb9220acf126cf59" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d"
I20260709 12:27:31.590410 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86527b8a77848629c50a32e2534f7ba" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:31.674398 16938 raft_consensus.cc:3060] T f5345dc6d3b946e0bb9220acf126cf59 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:31.591544 16989 ts_tablet_manager.cc:1434] T f5345dc6d3b946e0bb9220acf126cf59 P 82f27bcdf252425aad4c4a37d064f68d: Time spent starting tablet: real 0.510s	user 0.030s	sys 0.017s
W20260709 12:27:31.680835 16989 ts_tablet_manager.cc:1467] T f5345dc6d3b946e0bb9220acf126cf59 P 82f27bcdf252425aad4c4a37d064f68d: Tablet startup took 598ms
I20260709 12:27:31.584666 16991 tablet_bootstrap.cc:654] T 6a86fc21ef0044bb91dd271c9a019336 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:31.584877 17069 raft_consensus.cc:515] T 51ebab30b5104589803b75a1b48c5aa2 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:31.599045 16988 tablet_bootstrap.cc:492] T 3e78004b8cc14ac6b93c857cbdd63329 P 17294485b7f24e2b9fae71dd3169a336: No bootstrap required, opened a new log
I20260709 12:27:31.705847 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a86fc21ef0044bb91dd271c9a019336" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:31.708105 16942 raft_consensus.cc:2468] T 6a86fc21ef0044bb91dd271c9a019336 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 0.
W20260709 12:27:31.714775 16665 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:27:31.598440 16987 tablet_bootstrap.cc:654] T b6f178076e7f4c7bb41b4853bacbfc4e P 879366e90f5c420588945e0d545017c8: Neither blocks nor log segments found. Creating new log.
W20260709 12:27:31.727682 16833 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:39833, user_credentials={real_user=slave}} blocked reactor thread for 86772.2us
I20260709 12:27:31.738023 16718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce37f3e8575c4b8e88935db231644a27" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8" is_pre_election: true
I20260709 12:27:31.739943 16934 raft_consensus.cc:2393] T 51ebab30b5104589803b75a1b48c5aa2 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 879366e90f5c420588945e0d545017c8 in current term 1: Already voted for candidate 82f27bcdf252425aad4c4a37d064f68d in this term.
I20260709 12:27:31.727530 16684 leader_election.cc:304] T 6a86fc21ef0044bb91dd271c9a019336 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d, 879366e90f5c420588945e0d545017c8; no voters: 
I20260709 12:27:31.739843 16718 raft_consensus.cc:2468] T ce37f3e8575c4b8e88935db231644a27 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in term 0.
I20260709 12:27:31.743165 17249 raft_consensus.cc:2804] T 6a86fc21ef0044bb91dd271c9a019336 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:31.744293 17249 raft_consensus.cc:493] T 6a86fc21ef0044bb91dd271c9a019336 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:31.687168 16989 ts_tablet_manager.cc:1469] T f5345dc6d3b946e0bb9220acf126cf59 P 82f27bcdf252425aad4c4a37d064f68d: Trace:
0709 12:27:23.291021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:23.291212 (+   191us) service_pool.cc:224] Handling call
0709 12:27:23.293815 (+  2603us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:27:23.293912 (+    97us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:27:23.414058 (+120146us) tablet_metadata.cc:665] Metadata flushed
0709 12:27:23.515522 (+101464us) tablet_replica.cc:206] Creating consensus instance
0709 12:27:23.577868 (+ 62346us) inbound_call.cc:177] Queueing success response
0709 12:27:30.709126 (+7131258us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:27:31.082034 (+372908us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:27:31.320259 (+238225us) tablet_replica.cc:261] Starting instrumentation
0709 12:27:31.321033 (+   774us) tablet_replica.cc:280] Starting consensus
0709 12:27:31.581241 (+260208us) spinlock_profiling.cc:243] Waited 7.36 ms on lock 0x7b4c0020d700. stack: 00007f7591d69343 00007f7591d69240 00007f75916f81d4 00007f759b436304 00007f759b436299 00007f7593154a20 00007f7593165a29 00007f759312b644 00007f7593152f2d 00007f7593152b93 00007f7594e8318b 00007f7594e83cb5 00007f7594e7ef30 00007f7594e7dc40 00007f759887ab2e 00007f7599e9cd8a
Metrics: {"raft.queue_time_us":3209,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":97,"spinlock_wait_cycles":16928768,"tablet-open.queue_time_us":7148964}
I20260709 12:27:31.745087 17249 raft_consensus.cc:3060] T 6a86fc21ef0044bb91dd271c9a019336 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:31.752408 16718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86527b8a77848629c50a32e2534f7ba" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8" is_pre_election: true
W20260709 12:27:31.756891 16833 leader_election.cc:343] T b86527b8a77848629c50a32e2534f7ba P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:31.759245 16866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29fcc4f156a54ca4b54a4a11e2cee973" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336"
I20260709 12:27:31.760279 16866 raft_consensus.cc:3060] T 29fcc4f156a54ca4b54a4a11e2cee973 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:31.764878 16867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce37f3e8575c4b8e88935db231644a27" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:31.768392 17392 raft_consensus.cc:493] T 52538067157143b2abd4656a4bbb9442 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3c1aba6ee1d244fd9c0daba722aa0b3b)
I20260709 12:27:31.769809 17392 raft_consensus.cc:515] T 52538067157143b2abd4656a4bbb9442 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:31.780323 16988 ts_tablet_manager.cc:1403] T 3e78004b8cc14ac6b93c857cbdd63329 P 17294485b7f24e2b9fae71dd3169a336: Time spent bootstrapping tablet: real 0.426s	user 0.019s	sys 0.018s
I20260709 12:27:31.841898 16989 tablet_bootstrap.cc:492] T 3e78004b8cc14ac6b93c857cbdd63329 P 82f27bcdf252425aad4c4a37d064f68d: Bootstrap starting.
I20260709 12:27:31.848143 16938 raft_consensus.cc:2468] T f5345dc6d3b946e0bb9220acf126cf59 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 1.
I20260709 12:27:31.850780 17069 leader_election.cc:290] T 51ebab30b5104589803b75a1b48c5aa2 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 election: Requested vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:31.887236 16684 leader_election.cc:304] T 51ebab30b5104589803b75a1b48c5aa2 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8; no voters: 
I20260709 12:27:31.888873 16866 raft_consensus.cc:2468] T 29fcc4f156a54ca4b54a4a11e2cee973 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in term 1.
I20260709 12:27:31.880699 17392 leader_election.cc:290] T 52538067157143b2abd4656a4bbb9442 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:31.899377 17212 raft_consensus.cc:493] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:31.900840 17416 raft_consensus.cc:2804] T 51ebab30b5104589803b75a1b48c5aa2 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:31.900952 17212 raft_consensus.cc:515] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:31.902796 16991 tablet_bootstrap.cc:492] T 6a86fc21ef0044bb91dd271c9a019336 P 3c1aba6ee1d244fd9c0daba722aa0b3b: No bootstrap required, opened a new log
I20260709 12:27:31.903823 16991 ts_tablet_manager.cc:1403] T 6a86fc21ef0044bb91dd271c9a019336 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent bootstrapping tablet: real 0.332s	user 0.019s	sys 0.002s
I20260709 12:27:31.904691 17249 raft_consensus.cc:515] T 6a86fc21ef0044bb91dd271c9a019336 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:31.905022 16792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a86fc21ef0044bb91dd271c9a019336" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
I20260709 12:27:31.905658 17212 leader_election.cc:290] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:31.902876 17416 raft_consensus.cc:697] T 51ebab30b5104589803b75a1b48c5aa2 P 879366e90f5c420588945e0d545017c8 [term 1 LEADER]: Becoming Leader. State: Replica: 879366e90f5c420588945e0d545017c8, State: Running, Role: LEADER
I20260709 12:27:31.913473 17416 consensus_queue.cc:237] T 51ebab30b5104589803b75a1b48c5aa2 P 879366e90f5c420588945e0d545017c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:31.914685 16987 tablet_bootstrap.cc:492] T b6f178076e7f4c7bb41b4853bacbfc4e P 879366e90f5c420588945e0d545017c8: No bootstrap required, opened a new log
I20260709 12:27:31.915555 16987 ts_tablet_manager.cc:1403] T b6f178076e7f4c7bb41b4853bacbfc4e P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.396s	user 0.015s	sys 0.016s
I20260709 12:27:31.922391 16988 raft_consensus.cc:359] T 3e78004b8cc14ac6b93c857cbdd63329 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:31.923697 16988 raft_consensus.cc:385] T 3e78004b8cc14ac6b93c857cbdd63329 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:31.924059 16988 raft_consensus.cc:740] T 3e78004b8cc14ac6b93c857cbdd63329 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Initialized, Role: FOLLOWER
I20260709 12:27:31.924938 16988 consensus_queue.cc:260] T 3e78004b8cc14ac6b93c857cbdd63329 P 17294485b7f24e2b9fae71dd3169a336 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:31.925004 16991 raft_consensus.cc:359] T 6a86fc21ef0044bb91dd271c9a019336 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:31.931777 16991 raft_consensus.cc:385] T 6a86fc21ef0044bb91dd271c9a019336 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:31.943768 16991 raft_consensus.cc:740] T 6a86fc21ef0044bb91dd271c9a019336 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c1aba6ee1d244fd9c0daba722aa0b3b, State: Initialized, Role: FOLLOWER
I20260709 12:27:31.944061 16717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ebab30b5104589803b75a1b48c5aa2" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8"
I20260709 12:27:31.938836 16716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52538067157143b2abd4656a4bbb9442" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8" is_pre_election: true
W20260709 12:27:31.952019 16685 leader_election.cc:343] T 6a86fc21ef0044bb91dd271c9a019336 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:31.954067 16794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a86fc21ef0044bb91dd271c9a019336" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b"
I20260709 12:27:31.951428 16991 consensus_queue.cc:260] T 6a86fc21ef0044bb91dd271c9a019336 P 3c1aba6ee1d244fd9c0daba722aa0b3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:31.955526 16907 leader_election.cc:304] T 6a86fc21ef0044bb91dd271c9a019336 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d, 879366e90f5c420588945e0d545017c8; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b
I20260709 12:27:31.959880 17288 raft_consensus.cc:2804] T 6a86fc21ef0044bb91dd271c9a019336 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:31.960915 17288 raft_consensus.cc:493] T 6a86fc21ef0044bb91dd271c9a019336 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:31.961306 16991 ts_tablet_manager.cc:1434] T 6a86fc21ef0044bb91dd271c9a019336 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent starting tablet: real 0.057s	user 0.009s	sys 0.001s
I20260709 12:27:31.961473 17288 raft_consensus.cc:3060] T 6a86fc21ef0044bb91dd271c9a019336 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:31.962894 16991 tablet_bootstrap.cc:492] T f29cf6eb18e842c3a5aa62d8fae53279 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Bootstrap starting.
I20260709 12:27:31.926731 16792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52538067157143b2abd4656a4bbb9442" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
I20260709 12:27:31.933964 16987 raft_consensus.cc:359] T b6f178076e7f4c7bb41b4853bacbfc4e P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:31.956379 16794 raft_consensus.cc:3060] T 6a86fc21ef0044bb91dd271c9a019336 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:31.967880 16987 raft_consensus.cc:385] T b6f178076e7f4c7bb41b4853bacbfc4e P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:31.971084 16934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1e8d1852ae457db7e3be5b6957f1b3" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:31.973995 16987 raft_consensus.cc:740] T b6f178076e7f4c7bb41b4853bacbfc4e P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:31.975443 16987 consensus_queue.cc:260] T b6f178076e7f4c7bb41b4853bacbfc4e P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:31.977505 16868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ebab30b5104589803b75a1b48c5aa2" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336"
I20260709 12:27:31.980686 16868 raft_consensus.cc:2393] T 51ebab30b5104589803b75a1b48c5aa2 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 82f27bcdf252425aad4c4a37d064f68d in current term 1: Already voted for candidate 879366e90f5c420588945e0d545017c8 in this term.
I20260709 12:27:31.981802 17210 consensus_queue.cc:1048] T 2f737ece325c44c58194725a82923014 P 3c1aba6ee1d244fd9c0daba722aa0b3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:31.984095 16987 ts_tablet_manager.cc:1434] T b6f178076e7f4c7bb41b4853bacbfc4e P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.068s	user 0.009s	sys 0.000s
I20260709 12:27:31.991991 17257 consensus_queue.cc:1048] T b6f178076e7f4c7bb41b4853bacbfc4e P 17294485b7f24e2b9fae71dd3169a336 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:31.915516 17249 leader_election.cc:290] T 6a86fc21ef0044bb91dd271c9a019336 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 election: Requested vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:31.999639 16716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1e8d1852ae457db7e3be5b6957f1b3" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8" is_pre_election: true
I20260709 12:27:31.968626 16988 ts_tablet_manager.cc:1434] T 3e78004b8cc14ac6b93c857cbdd63329 P 17294485b7f24e2b9fae71dd3169a336: Time spent starting tablet: real 0.174s	user 0.009s	sys 0.002s
W20260709 12:27:31.977928 16833 leader_election.cc:343] T b86527b8a77848629c50a32e2534f7ba P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:32.003655 16833 leader_election.cc:304] T b86527b8a77848629c50a32e2534f7ba P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336; no voters: 82f27bcdf252425aad4c4a37d064f68d, 879366e90f5c420588945e0d545017c8
I20260709 12:27:31.992211 16989 tablet_bootstrap.cc:654] T 3e78004b8cc14ac6b93c857cbdd63329 P 82f27bcdf252425aad4c4a37d064f68d: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:32.006264 16987 tablet_bootstrap.cc:492] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:32.013521 17257 raft_consensus.cc:2749] T b86527b8a77848629c50a32e2534f7ba P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:32.019060 16794 raft_consensus.cc:2468] T 6a86fc21ef0044bb91dd271c9a019336 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 1.
I20260709 12:27:32.031421 17416 raft_consensus.cc:493] T b6f178076e7f4c7bb41b4853bacbfc4e P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:32.043331 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a86fc21ef0044bb91dd271c9a019336" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d"
W20260709 12:27:32.053871 16833 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:39833, user_credentials={real_user=slave}} blocked reactor thread for 76023.3us
I20260709 12:27:32.049253 17257 raft_consensus.cc:493] T 3e78004b8cc14ac6b93c857cbdd63329 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:32.050788 17416 raft_consensus.cc:515] T b6f178076e7f4c7bb41b4853bacbfc4e P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:32.066582 17257 raft_consensus.cc:515] T 3e78004b8cc14ac6b93c857cbdd63329 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:32.068288 17416 leader_election.cc:290] T b6f178076e7f4c7bb41b4853bacbfc4e P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
I20260709 12:27:32.075059 17248 consensus_queue.cc:1048] T f5345dc6d3b946e0bb9220acf126cf59 P 17294485b7f24e2b9fae71dd3169a336 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:32.080415 16791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f178076e7f4c7bb41b4853bacbfc4e" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
W20260709 12:27:32.082214 16684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37919, user_credentials={real_user=slave}} blocked reactor thread for 47070.9us
I20260709 12:27:32.069712 17257 leader_election.cc:290] T 3e78004b8cc14ac6b93c857cbdd63329 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:32.069471 16759 leader_election.cc:304] T ce37f3e8575c4b8e88935db231644a27 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8; no voters: 
W20260709 12:27:32.097100 16759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:39833, user_credentials={real_user=slave}} blocked reactor thread for 66340.4us
I20260709 12:27:32.069847 16833 leader_election.cc:304] T 52538067157143b2abd4656a4bbb9442 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8
I20260709 12:27:32.072661 17288 raft_consensus.cc:515] T 6a86fc21ef0044bb91dd271c9a019336 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:32.099867 16988 tablet_bootstrap.cc:492] T f29cf6eb18e842c3a5aa62d8fae53279 P 17294485b7f24e2b9fae71dd3169a336: Bootstrap starting.
I20260709 12:27:32.101985 17257 raft_consensus.cc:2749] T 52538067157143b2abd4656a4bbb9442 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:27:32.103420 16759 leader_election.cc:343] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:27:32.104544 16759 leader_election.cc:343] T ce37f3e8575c4b8e88935db231644a27 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:32.111698 17210 raft_consensus.cc:2804] T ce37f3e8575c4b8e88935db231644a27 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:32.112321 17210 raft_consensus.cc:493] T ce37f3e8575c4b8e88935db231644a27 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:32.112803 17210 raft_consensus.cc:3060] T ce37f3e8575c4b8e88935db231644a27 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:32.120576 16938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e78004b8cc14ac6b93c857cbdd63329" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:32.121702 17288 leader_election.cc:290] T 6a86fc21ef0044bb91dd271c9a019336 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 election: Requested vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:32.124032 16941 raft_consensus.cc:2393] T 6a86fc21ef0044bb91dd271c9a019336 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 879366e90f5c420588945e0d545017c8 in current term 1: Already voted for candidate 82f27bcdf252425aad4c4a37d064f68d in this term.
I20260709 12:27:32.111421 16991 tablet_bootstrap.cc:654] T f29cf6eb18e842c3a5aa62d8fae53279 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:32.126586 16717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e78004b8cc14ac6b93c857cbdd63329" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8" is_pre_election: true
I20260709 12:27:32.127691 16717 raft_consensus.cc:2468] T 3e78004b8cc14ac6b93c857cbdd63329 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 0.
I20260709 12:27:32.124089 16716 raft_consensus.cc:3060] T b6f178076e7f4c7bb41b4853bacbfc4e P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:32.127677 16793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a86fc21ef0044bb91dd271c9a019336" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b"
I20260709 12:27:32.145884 16907 leader_election.cc:304] T 51ebab30b5104589803b75a1b48c5aa2 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8
W20260709 12:27:32.150647 16759 leader_election.cc:343] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:27:32.152520 16833 leader_election.cc:343] T 3e78004b8cc14ac6b93c857cbdd63329 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:32.153615 17399 raft_consensus.cc:2749] T 51ebab30b5104589803b75a1b48c5aa2 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:27:32.158936 16862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f178076e7f4c7bb41b4853bacbfc4e" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:32.161239 17248 consensus_queue.cc:1048] T f5345dc6d3b946e0bb9220acf126cf59 P 17294485b7f24e2b9fae71dd3169a336 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:32.158962 16987 tablet_bootstrap.cc:654] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 879366e90f5c420588945e0d545017c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:32.151108 16759 leader_election.cc:304] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b; no voters: 82f27bcdf252425aad4c4a37d064f68d, 879366e90f5c420588945e0d545017c8
I20260709 12:27:32.158999 16685 leader_election.cc:304] T 6a86fc21ef0044bb91dd271c9a019336 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8; no voters: 
I20260709 12:27:32.170667 16714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a86fc21ef0044bb91dd271c9a019336" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8"
I20260709 12:27:32.171438 17249 raft_consensus.cc:2804] T 6a86fc21ef0044bb91dd271c9a019336 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:32.172272 17249 raft_consensus.cc:697] T 6a86fc21ef0044bb91dd271c9a019336 P 879366e90f5c420588945e0d545017c8 [term 1 LEADER]: Becoming Leader. State: Replica: 879366e90f5c420588945e0d545017c8, State: Running, Role: LEADER
I20260709 12:27:32.173384 17249 consensus_queue.cc:237] T 6a86fc21ef0044bb91dd271c9a019336 P 879366e90f5c420588945e0d545017c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:32.185652 16989 tablet_bootstrap.cc:492] T 3e78004b8cc14ac6b93c857cbdd63329 P 82f27bcdf252425aad4c4a37d064f68d: No bootstrap required, opened a new log
I20260709 12:27:32.186656 16989 ts_tablet_manager.cc:1403] T 3e78004b8cc14ac6b93c857cbdd63329 P 82f27bcdf252425aad4c4a37d064f68d: Time spent bootstrapping tablet: real 0.346s	user 0.022s	sys 0.029s
I20260709 12:27:32.189973 16833 leader_election.cc:304] T 3e78004b8cc14ac6b93c857cbdd63329 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8; no voters: 82f27bcdf252425aad4c4a37d064f68d
I20260709 12:27:32.195024 17387 raft_consensus.cc:2749] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:32.215870 16684 leader_election.cc:304] T b6f178076e7f4c7bb41b4853bacbfc4e P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 879366e90f5c420588945e0d545017c8; no voters: 17294485b7f24e2b9fae71dd3169a336, 3c1aba6ee1d244fd9c0daba722aa0b3b
I20260709 12:27:32.232826 16991 tablet_bootstrap.cc:492] T f29cf6eb18e842c3a5aa62d8fae53279 P 3c1aba6ee1d244fd9c0daba722aa0b3b: No bootstrap required, opened a new log
I20260709 12:27:32.233727 16991 ts_tablet_manager.cc:1403] T f29cf6eb18e842c3a5aa62d8fae53279 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent bootstrapping tablet: real 0.271s	user 0.025s	sys 0.015s
I20260709 12:27:32.237859 16991 raft_consensus.cc:359] T f29cf6eb18e842c3a5aa62d8fae53279 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:32.238917 16991 raft_consensus.cc:385] T f29cf6eb18e842c3a5aa62d8fae53279 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:32.243309 16987 tablet_bootstrap.cc:492] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 879366e90f5c420588945e0d545017c8: No bootstrap required, opened a new log
I20260709 12:27:32.244285 16987 ts_tablet_manager.cc:1403] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.244s	user 0.021s	sys 0.000s
I20260709 12:27:32.212880 17392 raft_consensus.cc:2804] T 3e78004b8cc14ac6b93c857cbdd63329 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:32.239287 16991 raft_consensus.cc:740] T f29cf6eb18e842c3a5aa62d8fae53279 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c1aba6ee1d244fd9c0daba722aa0b3b, State: Initialized, Role: FOLLOWER
I20260709 12:27:32.218223 17325 consensus_queue.cc:1048] T b6f178076e7f4c7bb41b4853bacbfc4e P 17294485b7f24e2b9fae71dd3169a336 [LEADER]: Connected to new peer: Peer: permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
W20260709 12:27:32.258460 16759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37919, user_credentials={real_user=slave}} blocked reactor thread for 68512.8us
I20260709 12:27:32.254174 17392 raft_consensus.cc:493] T 3e78004b8cc14ac6b93c857cbdd63329 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:32.268474 16991 consensus_queue.cc:260] T f29cf6eb18e842c3a5aa62d8fae53279 P 3c1aba6ee1d244fd9c0daba722aa0b3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:32.273412 17436 raft_consensus.cc:2749] T b6f178076e7f4c7bb41b4853bacbfc4e P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:32.277062 16989 raft_consensus.cc:359] T 3e78004b8cc14ac6b93c857cbdd63329 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:32.277900 16989 raft_consensus.cc:385] T 3e78004b8cc14ac6b93c857cbdd63329 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:32.278215 16989 raft_consensus.cc:740] T 3e78004b8cc14ac6b93c857cbdd63329 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f27bcdf252425aad4c4a37d064f68d, State: Initialized, Role: FOLLOWER
I20260709 12:27:32.286805 16988 tablet_bootstrap.cc:654] T f29cf6eb18e842c3a5aa62d8fae53279 P 17294485b7f24e2b9fae71dd3169a336: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:32.290223 16991 ts_tablet_manager.cc:1434] T f29cf6eb18e842c3a5aa62d8fae53279 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent starting tablet: real 0.056s	user 0.006s	sys 0.004s
I20260709 12:27:32.292853 16989 consensus_queue.cc:260] T 3e78004b8cc14ac6b93c857cbdd63329 P 82f27bcdf252425aad4c4a37d064f68d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:32.290875 16987 raft_consensus.cc:359] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:32.269613 17392 raft_consensus.cc:3060] T 3e78004b8cc14ac6b93c857cbdd63329 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:32.294947 16759 leader_election.cc:304] T 29fcc4f156a54ca4b54a4a11e2cee973 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 3c1aba6ee1d244fd9c0daba722aa0b3b; no voters: 82f27bcdf252425aad4c4a37d064f68d
I20260709 12:27:32.299817 16987 raft_consensus.cc:385] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:32.300697 16987 raft_consensus.cc:740] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:32.299823 17210 raft_consensus.cc:515] T ce37f3e8575c4b8e88935db231644a27 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:32.317298 17210 leader_election.cc:290] T ce37f3e8575c4b8e88935db231644a27 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 election: Requested vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
W20260709 12:27:32.325279 16759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:38103, user_credentials={real_user=slave}} blocked reactor thread for 60208.2us
I20260709 12:27:32.327240 17212 raft_consensus.cc:2804] T 29fcc4f156a54ca4b54a4a11e2cee973 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:32.327980 17212 raft_consensus.cc:697] T 29fcc4f156a54ca4b54a4a11e2cee973 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 LEADER]: Becoming Leader. State: Replica: 3c1aba6ee1d244fd9c0daba722aa0b3b, State: Running, Role: LEADER
I20260709 12:27:32.329408 17212 consensus_queue.cc:237] T 29fcc4f156a54ca4b54a4a11e2cee973 P 3c1aba6ee1d244fd9c0daba722aa0b3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:32.336659 16987 consensus_queue.cc:260] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:32.341076 16613 catalog_manager.cc:5697] T 51ebab30b5104589803b75a1b48c5aa2 P 879366e90f5c420588945e0d545017c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 879366e90f5c420588945e0d545017c8 (127.9.116.65). New cstate: current_term: 1 leader_uuid: "879366e90f5c420588945e0d545017c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: HEALTHY } } }
W20260709 12:27:32.357890 16684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37919, user_credentials={real_user=slave}} blocked reactor thread for 107716us
I20260709 12:27:32.375381 16989 ts_tablet_manager.cc:1434] T 3e78004b8cc14ac6b93c857cbdd63329 P 82f27bcdf252425aad4c4a37d064f68d: Time spent starting tablet: real 0.188s	user 0.008s	sys 0.002s
I20260709 12:27:32.377588 16863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce37f3e8575c4b8e88935db231644a27" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336"
I20260709 12:27:32.379248 16991 tablet_bootstrap.cc:492] T 6e89df746e0c49d184637314ce87045a P 3c1aba6ee1d244fd9c0daba722aa0b3b: Bootstrap starting.
I20260709 12:27:32.380792 16989 tablet_bootstrap.cc:492] T 29fcc4f156a54ca4b54a4a11e2cee973 P 82f27bcdf252425aad4c4a37d064f68d: Bootstrap starting.
I20260709 12:27:32.384395 16987 ts_tablet_manager.cc:1434] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.140s	user 0.011s	sys 0.003s
I20260709 12:27:32.435449 16719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce37f3e8575c4b8e88935db231644a27" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8"
I20260709 12:27:32.436280 16719 raft_consensus.cc:3060] T ce37f3e8575c4b8e88935db231644a27 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:32.448031 16719 raft_consensus.cc:2468] T ce37f3e8575c4b8e88935db231644a27 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in term 1.
I20260709 12:27:32.479357 16991 tablet_bootstrap.cc:654] T 6e89df746e0c49d184637314ce87045a P 3c1aba6ee1d244fd9c0daba722aa0b3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:32.487910 16907 leader_election.cc:304] T 6a86fc21ef0044bb91dd271c9a019336 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8
I20260709 12:27:32.489763 17410 raft_consensus.cc:2749] T 6a86fc21ef0044bb91dd271c9a019336 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:27:32.490314 16987 tablet_bootstrap.cc:492] T b86527b8a77848629c50a32e2534f7ba P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:32.497025 16988 tablet_bootstrap.cc:492] T f29cf6eb18e842c3a5aa62d8fae53279 P 17294485b7f24e2b9fae71dd3169a336: No bootstrap required, opened a new log
I20260709 12:27:32.497869 16988 ts_tablet_manager.cc:1403] T f29cf6eb18e842c3a5aa62d8fae53279 P 17294485b7f24e2b9fae71dd3169a336: Time spent bootstrapping tablet: real 0.436s	user 0.037s	sys 0.025s
I20260709 12:27:32.506567 17415 consensus_queue.cc:1048] T 51ebab30b5104589803b75a1b48c5aa2 P 879366e90f5c420588945e0d545017c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:32.511977 16614 catalog_manager.cc:5697] T f5345dc6d3b946e0bb9220acf126cf59 P 82f27bcdf252425aad4c4a37d064f68d reported cstate change: term changed from 0 to 1, leader changed from <none> to 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67). New cstate: current_term: 1 leader_uuid: "17294485b7f24e2b9fae71dd3169a336" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } }
I20260709 12:27:32.526376 17279 raft_consensus.cc:493] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:32.527256 17279 raft_consensus.cc:515] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:32.531163 17279 leader_election.cc:290] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:32.515018 17392 raft_consensus.cc:515] T 3e78004b8cc14ac6b93c857cbdd63329 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:32.538816 16988 raft_consensus.cc:359] T f29cf6eb18e842c3a5aa62d8fae53279 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:32.580410 16988 raft_consensus.cc:385] T f29cf6eb18e842c3a5aa62d8fae53279 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:32.581516 16988 raft_consensus.cc:740] T f29cf6eb18e842c3a5aa62d8fae53279 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Initialized, Role: FOLLOWER
I20260709 12:27:32.582566 16988 consensus_queue.cc:260] T f29cf6eb18e842c3a5aa62d8fae53279 P 17294485b7f24e2b9fae71dd3169a336 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:32.595214 16793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1e8d1852ae457db7e3be5b6957f1b3" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
W20260709 12:27:32.607122 16759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37919, user_credentials={real_user=slave}} blocked reactor thread for 271823us
I20260709 12:27:32.610276 16989 tablet_bootstrap.cc:654] T 29fcc4f156a54ca4b54a4a11e2cee973 P 82f27bcdf252425aad4c4a37d064f68d: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:32.615356 16793 raft_consensus.cc:2468] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 0.
I20260709 12:27:32.617141 16685 leader_election.cc:304] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8; no voters: 
I20260709 12:27:32.618036 17249 raft_consensus.cc:2804] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:32.618440 17249 raft_consensus.cc:493] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:32.618803 17249 raft_consensus.cc:3060] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:32.623041 17392 leader_election.cc:290] T 3e78004b8cc14ac6b93c857cbdd63329 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 election: Requested vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:32.630779 16987 tablet_bootstrap.cc:654] T b86527b8a77848629c50a32e2534f7ba P 879366e90f5c420588945e0d545017c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:32.634274 16718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e78004b8cc14ac6b93c857cbdd63329" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8"
I20260709 12:27:32.635143 16718 raft_consensus.cc:3060] T 3e78004b8cc14ac6b93c857cbdd63329 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:32.634634 17249 raft_consensus.cc:515] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:32.644618 16988 ts_tablet_manager.cc:1434] T f29cf6eb18e842c3a5aa62d8fae53279 P 17294485b7f24e2b9fae71dd3169a336: Time spent starting tablet: real 0.146s	user 0.008s	sys 0.004s
I20260709 12:27:32.645860 16988 tablet_bootstrap.cc:492] T ce37f3e8575c4b8e88935db231644a27 P 17294485b7f24e2b9fae71dd3169a336: Bootstrap starting.
I20260709 12:27:32.646926 17249 leader_election.cc:290] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 election: Requested vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:32.647231 16793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1e8d1852ae457db7e3be5b6957f1b3" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b"
I20260709 12:27:32.648322 16793 raft_consensus.cc:3060] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:27:32.645737 16759 leader_election.cc:343] T ce37f3e8575c4b8e88935db231644a27 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:32.659792 16934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e78004b8cc14ac6b93c857cbdd63329" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d"
I20260709 12:27:32.660579 16934 raft_consensus.cc:3060] T 3e78004b8cc14ac6b93c857cbdd63329 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:32.666934 16759 leader_election.cc:304] T ce37f3e8575c4b8e88935db231644a27 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8; no voters: 17294485b7f24e2b9fae71dd3169a336
I20260709 12:27:32.667359 16935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1e8d1852ae457db7e3be5b6957f1b3" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:32.668080 17446 raft_consensus.cc:2804] T ce37f3e8575c4b8e88935db231644a27 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:32.668623 17446 raft_consensus.cc:697] T ce37f3e8575c4b8e88935db231644a27 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 LEADER]: Becoming Leader. State: Replica: 3c1aba6ee1d244fd9c0daba722aa0b3b, State: Running, Role: LEADER
I20260709 12:27:32.669703 17446 consensus_queue.cc:237] T ce37f3e8575c4b8e88935db231644a27 P 3c1aba6ee1d244fd9c0daba722aa0b3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:32.676841 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1e8d1852ae457db7e3be5b6957f1b3" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d"
W20260709 12:27:32.681610 16684 leader_election.cc:343] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:32.684646 16991 tablet_bootstrap.cc:492] T 6e89df746e0c49d184637314ce87045a P 3c1aba6ee1d244fd9c0daba722aa0b3b: No bootstrap required, opened a new log
I20260709 12:27:32.685286 16991 ts_tablet_manager.cc:1403] T 6e89df746e0c49d184637314ce87045a P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent bootstrapping tablet: real 0.380s	user 0.018s	sys 0.016s
W20260709 12:27:32.689102 16684 leader_election.cc:343] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:32.683113 16718 raft_consensus.cc:2468] T 3e78004b8cc14ac6b93c857cbdd63329 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 1.
I20260709 12:27:32.691779 17248 raft_consensus.cc:493] T f29cf6eb18e842c3a5aa62d8fae53279 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:32.687942 17249 consensus_queue.cc:1048] T 51ebab30b5104589803b75a1b48c5aa2 P 879366e90f5c420588945e0d545017c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:27:32.697962 16793 raft_consensus.cc:2468] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 1.
I20260709 12:27:32.699868 16685 leader_election.cc:304] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8; no voters: 82f27bcdf252425aad4c4a37d064f68d
I20260709 12:27:32.700886 17210 raft_consensus.cc:493] T f29cf6eb18e842c3a5aa62d8fae53279 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:32.701485 17210 raft_consensus.cc:515] T f29cf6eb18e842c3a5aa62d8fae53279 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:32.695555 17248 raft_consensus.cc:515] T f29cf6eb18e842c3a5aa62d8fae53279 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:32.705955 17248 leader_election.cc:290] T f29cf6eb18e842c3a5aa62d8fae53279 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629), 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919)
I20260709 12:27:32.692211 17279 consensus_queue.cc:1048] T 6a86fc21ef0044bb91dd271c9a019336 P 879366e90f5c420588945e0d545017c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 12:27:32.708048 17440 raft_consensus.cc:2804] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:32.708932 17440 raft_consensus.cc:697] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 879366e90f5c420588945e0d545017c8 [term 1 LEADER]: Becoming Leader. State: Replica: 879366e90f5c420588945e0d545017c8, State: Running, Role: LEADER
I20260709 12:27:32.709959 17440 consensus_queue.cc:237] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 879366e90f5c420588945e0d545017c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:32.715431 17210 leader_election.cc:290] T f29cf6eb18e842c3a5aa62d8fae53279 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919)
I20260709 12:27:32.732008 16868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f29cf6eb18e842c3a5aa62d8fae53279" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:32.733027 16868 raft_consensus.cc:2468] T f29cf6eb18e842c3a5aa62d8fae53279 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in term 0.
I20260709 12:27:32.734323 16935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f29cf6eb18e842c3a5aa62d8fae53279" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
W20260709 12:27:32.740809 16833 leader_election.cc:343] T f29cf6eb18e842c3a5aa62d8fae53279 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:32.745018 16794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f29cf6eb18e842c3a5aa62d8fae53279" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
I20260709 12:27:32.745875 16794 raft_consensus.cc:2468] T f29cf6eb18e842c3a5aa62d8fae53279 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 0.
I20260709 12:27:32.743255 16833 leader_election.cc:304] T 3e78004b8cc14ac6b93c857cbdd63329 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8; no voters: 
I20260709 12:27:32.754704 16759 leader_election.cc:304] T f29cf6eb18e842c3a5aa62d8fae53279 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 3c1aba6ee1d244fd9c0daba722aa0b3b; no voters: 
I20260709 12:27:32.755034 16834 leader_election.cc:304] T f29cf6eb18e842c3a5aa62d8fae53279 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 3c1aba6ee1d244fd9c0daba722aa0b3b; no voters: 82f27bcdf252425aad4c4a37d064f68d
I20260709 12:27:32.757340 17386 raft_consensus.cc:2804] T f29cf6eb18e842c3a5aa62d8fae53279 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:32.762764 17386 raft_consensus.cc:493] T f29cf6eb18e842c3a5aa62d8fae53279 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:32.763180 17386 raft_consensus.cc:3060] T f29cf6eb18e842c3a5aa62d8fae53279 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:32.759330 17249 consensus_queue.cc:1048] T 6a86fc21ef0044bb91dd271c9a019336 P 879366e90f5c420588945e0d545017c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:32.766757 16988 tablet_bootstrap.cc:654] T ce37f3e8575c4b8e88935db231644a27 P 17294485b7f24e2b9fae71dd3169a336: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:32.767832 16939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f29cf6eb18e842c3a5aa62d8fae53279" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
W20260709 12:27:32.833425 16834 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.66:43629, user_credentials={real_user=slave}} blocked reactor thread for 83412.4us
W20260709 12:27:32.836589 16833 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:39833, user_credentials={real_user=slave}} blocked reactor thread for 93410.5us
W20260709 12:27:32.837491 16759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37919, user_credentials={real_user=slave}} blocked reactor thread for 63803.1us
I20260709 12:27:32.839236 17257 raft_consensus.cc:2804] T f29cf6eb18e842c3a5aa62d8fae53279 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:32.839695 16991 raft_consensus.cc:359] T 6e89df746e0c49d184637314ce87045a P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:32.834539 16934 raft_consensus.cc:2468] T 3e78004b8cc14ac6b93c857cbdd63329 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 1.
I20260709 12:27:32.845248 16991 raft_consensus.cc:385] T 6e89df746e0c49d184637314ce87045a P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:32.845759 16991 raft_consensus.cc:740] T 6e89df746e0c49d184637314ce87045a P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c1aba6ee1d244fd9c0daba722aa0b3b, State: Initialized, Role: FOLLOWER
I20260709 12:27:32.861292 16991 consensus_queue.cc:260] T 6e89df746e0c49d184637314ce87045a P 3c1aba6ee1d244fd9c0daba722aa0b3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:32.869586 16989 tablet_bootstrap.cc:492] T 29fcc4f156a54ca4b54a4a11e2cee973 P 82f27bcdf252425aad4c4a37d064f68d: No bootstrap required, opened a new log
I20260709 12:27:32.870254 16989 ts_tablet_manager.cc:1403] T 29fcc4f156a54ca4b54a4a11e2cee973 P 82f27bcdf252425aad4c4a37d064f68d: Time spent bootstrapping tablet: real 0.490s	user 0.031s	sys 0.001s
I20260709 12:27:32.871325 16987 tablet_bootstrap.cc:492] T b86527b8a77848629c50a32e2534f7ba P 879366e90f5c420588945e0d545017c8: No bootstrap required, opened a new log
I20260709 12:27:32.871986 16987 ts_tablet_manager.cc:1403] T b86527b8a77848629c50a32e2534f7ba P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.382s	user 0.018s	sys 0.002s
I20260709 12:27:32.874586 17386 raft_consensus.cc:515] T f29cf6eb18e842c3a5aa62d8fae53279 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:32.846616 17408 raft_consensus.cc:2804] T 3e78004b8cc14ac6b93c857cbdd63329 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:32.847522 17257 raft_consensus.cc:493] T f29cf6eb18e842c3a5aa62d8fae53279 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:32.885666 16684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:38103, user_credentials={real_user=slave}} blocked reactor thread for 54702.9us
I20260709 12:27:32.891076 16991 ts_tablet_manager.cc:1434] T 6e89df746e0c49d184637314ce87045a P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent starting tablet: real 0.205s	user 0.014s	sys 0.005s
I20260709 12:27:32.892457 16991 tablet_bootstrap.cc:492] T 8eaf179090b14105b52c4701d5599216 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Bootstrap starting.
I20260709 12:27:32.899457 16987 raft_consensus.cc:359] T b86527b8a77848629c50a32e2534f7ba P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:32.900380 16987 raft_consensus.cc:385] T b86527b8a77848629c50a32e2534f7ba P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:32.900676 16987 raft_consensus.cc:740] T b86527b8a77848629c50a32e2534f7ba P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:32.901932 16987 consensus_queue.cc:260] T b86527b8a77848629c50a32e2534f7ba P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:32.905200 17408 raft_consensus.cc:697] T 3e78004b8cc14ac6b93c857cbdd63329 P 17294485b7f24e2b9fae71dd3169a336 [term 1 LEADER]: Becoming Leader. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Running, Role: LEADER
I20260709 12:27:32.906538 17408 consensus_queue.cc:237] T 3e78004b8cc14ac6b93c857cbdd63329 P 17294485b7f24e2b9fae71dd3169a336 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:32.915019 16989 raft_consensus.cc:359] T 29fcc4f156a54ca4b54a4a11e2cee973 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:32.916311 16989 raft_consensus.cc:385] T 29fcc4f156a54ca4b54a4a11e2cee973 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:32.918185 16989 raft_consensus.cc:740] T 29fcc4f156a54ca4b54a4a11e2cee973 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f27bcdf252425aad4c4a37d064f68d, State: Initialized, Role: FOLLOWER
I20260709 12:27:32.911996 17257 raft_consensus.cc:3060] T f29cf6eb18e842c3a5aa62d8fae53279 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:32.924676 16987 ts_tablet_manager.cc:1434] T b86527b8a77848629c50a32e2534f7ba P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.052s	user 0.002s	sys 0.008s
I20260709 12:27:32.930985 17386 leader_election.cc:290] T f29cf6eb18e842c3a5aa62d8fae53279 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 election: Requested vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919)
I20260709 12:27:32.944775 16987 tablet_bootstrap.cc:492] T 6e89df746e0c49d184637314ce87045a P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:32.920454 16989 consensus_queue.cc:260] T 29fcc4f156a54ca4b54a4a11e2cee973 P 82f27bcdf252425aad4c4a37d064f68d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:32.957813 17257 raft_consensus.cc:515] T f29cf6eb18e842c3a5aa62d8fae53279 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:32.961179 17257 leader_election.cc:290] T f29cf6eb18e842c3a5aa62d8fae53279 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 election: Requested vote from peers 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629), 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919)
I20260709 12:27:32.962977 16793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f29cf6eb18e842c3a5aa62d8fae53279" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b"
I20260709 12:27:32.964174 16793 raft_consensus.cc:2393] T f29cf6eb18e842c3a5aa62d8fae53279 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 17294485b7f24e2b9fae71dd3169a336 in current term 1: Already voted for candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in this term.
W20260709 12:27:32.967291 16759 consensus_peers.cc:597] T 29fcc4f156a54ca4b54a4a11e2cee973 P 3c1aba6ee1d244fd9c0daba722aa0b3b -> Peer 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919): Couldn't send request to peer 82f27bcdf252425aad4c4a37d064f68d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:32.968021 16759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37919, user_credentials={real_user=slave}} blocked reactor thread for 100644us
I20260709 12:27:32.977464 17069 raft_consensus.cc:493] T 29fcc4f156a54ca4b54a4a11e2cee973 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:32.978413 17069 raft_consensus.cc:515] T 29fcc4f156a54ca4b54a4a11e2cee973 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:32.979787 16938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f29cf6eb18e842c3a5aa62d8fae53279" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d"
I20260709 12:27:32.981973 16866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f29cf6eb18e842c3a5aa62d8fae53279" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336"
I20260709 12:27:32.982594 16934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f29cf6eb18e842c3a5aa62d8fae53279" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d"
I20260709 12:27:32.983055 16866 raft_consensus.cc:2393] T f29cf6eb18e842c3a5aa62d8fae53279 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in current term 1: Already voted for candidate 17294485b7f24e2b9fae71dd3169a336 in this term.
I20260709 12:27:32.983916 17069 leader_election.cc:290] T 29fcc4f156a54ca4b54a4a11e2cee973 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
I20260709 12:27:32.986253 16866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29fcc4f156a54ca4b54a4a11e2cee973" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:32.986675 16793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29fcc4f156a54ca4b54a4a11e2cee973" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
W20260709 12:27:32.988827 16833 leader_election.cc:343] T f29cf6eb18e842c3a5aa62d8fae53279 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:32.989312 16833 leader_election.cc:304] T f29cf6eb18e842c3a5aa62d8fae53279 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 82f27bcdf252425aad4c4a37d064f68d
I20260709 12:27:32.991289 17397 raft_consensus.cc:493] T b86527b8a77848629c50a32e2534f7ba P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:32.992120 17389 raft_consensus.cc:2749] T f29cf6eb18e842c3a5aa62d8fae53279 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:27:32.991962 17397 raft_consensus.cc:515] T b86527b8a77848629c50a32e2534f7ba P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:32.987246 16866 raft_consensus.cc:2393] T 29fcc4f156a54ca4b54a4a11e2cee973 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 82f27bcdf252425aad4c4a37d064f68d in current term 1: Already voted for candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in this term.
I20260709 12:27:32.998701 16989 ts_tablet_manager.cc:1434] T 29fcc4f156a54ca4b54a4a11e2cee973 P 82f27bcdf252425aad4c4a37d064f68d: Time spent starting tablet: real 0.128s	user 0.012s	sys 0.000s
I20260709 12:27:33.019474 16907 leader_election.cc:304] T 29fcc4f156a54ca4b54a4a11e2cee973 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 17294485b7f24e2b9fae71dd3169a336, 3c1aba6ee1d244fd9c0daba722aa0b3b
I20260709 12:27:33.021066 16989 tablet_bootstrap.cc:492] T b86527b8a77848629c50a32e2534f7ba P 82f27bcdf252425aad4c4a37d064f68d: Bootstrap starting.
I20260709 12:27:33.022465 17399 raft_consensus.cc:3060] T 29fcc4f156a54ca4b54a4a11e2cee973 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:33.006278 17386 consensus_queue.cc:1048] T 29fcc4f156a54ca4b54a4a11e2cee973 P 3c1aba6ee1d244fd9c0daba722aa0b3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:33.015520 17397 leader_election.cc:290] T b86527b8a77848629c50a32e2534f7ba P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919)
I20260709 12:27:33.006089 16862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86527b8a77848629c50a32e2534f7ba" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:33.031951 16987 tablet_bootstrap.cc:654] T 6e89df746e0c49d184637314ce87045a P 879366e90f5c420588945e0d545017c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:33.029110 16862 raft_consensus.cc:2468] T b86527b8a77848629c50a32e2534f7ba P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 0.
I20260709 12:27:33.041846 16991 tablet_bootstrap.cc:654] T 8eaf179090b14105b52c4701d5599216 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:33.043033 16684 leader_election.cc:304] T b86527b8a77848629c50a32e2534f7ba P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8; no voters: 
I20260709 12:27:33.053944 16988 tablet_bootstrap.cc:492] T ce37f3e8575c4b8e88935db231644a27 P 17294485b7f24e2b9fae71dd3169a336: No bootstrap required, opened a new log
I20260709 12:27:33.054584 16988 ts_tablet_manager.cc:1403] T ce37f3e8575c4b8e88935db231644a27 P 17294485b7f24e2b9fae71dd3169a336: Time spent bootstrapping tablet: real 0.409s	user 0.014s	sys 0.007s
I20260709 12:27:33.057657 16988 raft_consensus.cc:359] T ce37f3e8575c4b8e88935db231644a27 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:33.058369 16988 raft_consensus.cc:385] T ce37f3e8575c4b8e88935db231644a27 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:33.049742 17397 raft_consensus.cc:2804] T b86527b8a77848629c50a32e2534f7ba P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:33.058152 16939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86527b8a77848629c50a32e2534f7ba" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:33.059202 17397 raft_consensus.cc:493] T b86527b8a77848629c50a32e2534f7ba P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:33.062753 17397 raft_consensus.cc:3060] T b86527b8a77848629c50a32e2534f7ba P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:27:33.063040 16684 leader_election.cc:343] T b86527b8a77848629c50a32e2534f7ba P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:33.058676 16988 raft_consensus.cc:740] T ce37f3e8575c4b8e88935db231644a27 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Initialized, Role: FOLLOWER
W20260709 12:27:33.071355 16759 leader_election.cc:343] T f29cf6eb18e842c3a5aa62d8fae53279 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:27:33.078269 16759 leader_election.cc:343] T f29cf6eb18e842c3a5aa62d8fae53279 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:33.077708 16616 catalog_manager.cc:5697] T b6f178076e7f4c7bb41b4853bacbfc4e P 3c1aba6ee1d244fd9c0daba722aa0b3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67). New cstate: current_term: 1 leader_uuid: "17294485b7f24e2b9fae71dd3169a336" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } }
I20260709 12:27:33.079033 16759 leader_election.cc:304] T f29cf6eb18e842c3a5aa62d8fae53279 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b; no voters: 17294485b7f24e2b9fae71dd3169a336, 82f27bcdf252425aad4c4a37d064f68d
I20260709 12:27:33.083758 16988 consensus_queue.cc:260] T ce37f3e8575c4b8e88935db231644a27 P 17294485b7f24e2b9fae71dd3169a336 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:33.088747 17446 raft_consensus.cc:493] T 6e89df746e0c49d184637314ce87045a P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:33.089557 17446 raft_consensus.cc:515] T 6e89df746e0c49d184637314ce87045a P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:33.096640 17386 raft_consensus.cc:2749] T f29cf6eb18e842c3a5aa62d8fae53279 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:27:33.104050 17446 leader_election.cc:290] T 6e89df746e0c49d184637314ce87045a P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
I20260709 12:27:33.108464 16988 ts_tablet_manager.cc:1434] T ce37f3e8575c4b8e88935db231644a27 P 17294485b7f24e2b9fae71dd3169a336: Time spent starting tablet: real 0.054s	user 0.011s	sys 0.001s
I20260709 12:27:33.110057 16988 tablet_bootstrap.cc:492] T 3d614e06fd2c40189161e22ad9217e5d P 17294485b7f24e2b9fae71dd3169a336: Bootstrap starting.
I20260709 12:27:33.110625 17399 raft_consensus.cc:2749] T 29fcc4f156a54ca4b54a4a11e2cee973 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:33.111855 16987 tablet_bootstrap.cc:492] T 6e89df746e0c49d184637314ce87045a P 879366e90f5c420588945e0d545017c8: No bootstrap required, opened a new log
I20260709 12:27:33.128835 16987 ts_tablet_manager.cc:1403] T 6e89df746e0c49d184637314ce87045a P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.184s	user 0.011s	sys 0.006s
I20260709 12:27:33.132148 16866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e89df746e0c49d184637314ce87045a" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:33.140576 17397 raft_consensus.cc:515] T b86527b8a77848629c50a32e2534f7ba P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:33.143658 17397 leader_election.cc:290] T b86527b8a77848629c50a32e2534f7ba P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 election: Requested vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919)
I20260709 12:27:33.145790 16989 tablet_bootstrap.cc:654] T b86527b8a77848629c50a32e2534f7ba P 82f27bcdf252425aad4c4a37d064f68d: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:33.145942 16939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86527b8a77848629c50a32e2534f7ba" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d"
I20260709 12:27:33.147845 16719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e89df746e0c49d184637314ce87045a" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8" is_pre_election: true
W20260709 12:27:33.148265 16684 leader_election.cc:343] T b86527b8a77848629c50a32e2534f7ba P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:27:33.154711 16759 leader_election.cc:343] T 6e89df746e0c49d184637314ce87045a P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:33.160653 16988 tablet_bootstrap.cc:654] T 3d614e06fd2c40189161e22ad9217e5d P 17294485b7f24e2b9fae71dd3169a336: Neither blocks nor log segments found. Creating new log.
W20260709 12:27:33.170293 16759 leader_election.cc:343] T 6e89df746e0c49d184637314ce87045a P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:33.170842 16759 leader_election.cc:304] T 6e89df746e0c49d184637314ce87045a P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b; no voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8
I20260709 12:27:33.173359 17387 raft_consensus.cc:2749] T 6e89df746e0c49d184637314ce87045a P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:33.176509 16862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86527b8a77848629c50a32e2534f7ba" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336"
I20260709 12:27:33.177239 16862 raft_consensus.cc:3060] T b86527b8a77848629c50a32e2534f7ba P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:33.193528 16987 raft_consensus.cc:359] T 6e89df746e0c49d184637314ce87045a P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:33.194391 16987 raft_consensus.cc:385] T 6e89df746e0c49d184637314ce87045a P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:33.194728 16987 raft_consensus.cc:740] T 6e89df746e0c49d184637314ce87045a P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
W20260709 12:27:33.198439 16665 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:27:33.200260 16987 consensus_queue.cc:260] T 6e89df746e0c49d184637314ce87045a P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:33.204355 17386 consensus_queue.cc:1048] T ce37f3e8575c4b8e88935db231644a27 P 3c1aba6ee1d244fd9c0daba722aa0b3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:33.207625 16991 tablet_bootstrap.cc:492] T 8eaf179090b14105b52c4701d5599216 P 3c1aba6ee1d244fd9c0daba722aa0b3b: No bootstrap required, opened a new log
I20260709 12:27:33.208243 16991 ts_tablet_manager.cc:1403] T 8eaf179090b14105b52c4701d5599216 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent bootstrapping tablet: real 0.316s	user 0.022s	sys 0.011s
I20260709 12:27:33.229876 16988 tablet_bootstrap.cc:492] T 3d614e06fd2c40189161e22ad9217e5d P 17294485b7f24e2b9fae71dd3169a336: No bootstrap required, opened a new log
I20260709 12:27:33.230726 16988 ts_tablet_manager.cc:1403] T 3d614e06fd2c40189161e22ad9217e5d P 17294485b7f24e2b9fae71dd3169a336: Time spent bootstrapping tablet: real 0.121s	user 0.017s	sys 0.018s
I20260709 12:27:33.221979 16991 raft_consensus.cc:359] T 8eaf179090b14105b52c4701d5599216 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:33.232121 16987 ts_tablet_manager.cc:1434] T 6e89df746e0c49d184637314ce87045a P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.103s	user 0.009s	sys 0.002s
I20260709 12:27:33.232401 16991 raft_consensus.cc:385] T 8eaf179090b14105b52c4701d5599216 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:33.232764 16991 raft_consensus.cc:740] T 8eaf179090b14105b52c4701d5599216 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c1aba6ee1d244fd9c0daba722aa0b3b, State: Initialized, Role: FOLLOWER
I20260709 12:27:33.233584 16987 tablet_bootstrap.cc:492] T a4252af16e15424399c32c789c8e6c23 P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:33.235423 16613 catalog_manager.cc:5697] T 6a86fc21ef0044bb91dd271c9a019336 P 879366e90f5c420588945e0d545017c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 879366e90f5c420588945e0d545017c8 (127.9.116.65). New cstate: current_term: 1 leader_uuid: "879366e90f5c420588945e0d545017c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:33.239991 16868 raft_consensus.cc:3060] T ce37f3e8575c4b8e88935db231644a27 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:33.234964 16862 raft_consensus.cc:2468] T b86527b8a77848629c50a32e2534f7ba P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 1.
I20260709 12:27:33.239691 16988 raft_consensus.cc:359] T 3d614e06fd2c40189161e22ad9217e5d P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:33.241922 16988 raft_consensus.cc:385] T 3d614e06fd2c40189161e22ad9217e5d P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:33.241111 16613 catalog_manager.cc:5697] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 879366e90f5c420588945e0d545017c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 879366e90f5c420588945e0d545017c8 (127.9.116.65). New cstate: current_term: 1 leader_uuid: "879366e90f5c420588945e0d545017c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:33.242273 16988 raft_consensus.cc:740] T 3d614e06fd2c40189161e22ad9217e5d P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Initialized, Role: FOLLOWER
I20260709 12:27:33.243781 16988 consensus_queue.cc:260] T 3d614e06fd2c40189161e22ad9217e5d P 17294485b7f24e2b9fae71dd3169a336 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:33.245677 16988 ts_tablet_manager.cc:1434] T 3d614e06fd2c40189161e22ad9217e5d P 17294485b7f24e2b9fae71dd3169a336: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:27:33.247190 16988 tablet_bootstrap.cc:492] T a4252af16e15424399c32c789c8e6c23 P 17294485b7f24e2b9fae71dd3169a336: Bootstrap starting.
I20260709 12:27:33.254067 16988 tablet_bootstrap.cc:654] T a4252af16e15424399c32c789c8e6c23 P 17294485b7f24e2b9fae71dd3169a336: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:33.251626 16989 tablet_bootstrap.cc:492] T b86527b8a77848629c50a32e2534f7ba P 82f27bcdf252425aad4c4a37d064f68d: No bootstrap required, opened a new log
I20260709 12:27:33.266309 16989 ts_tablet_manager.cc:1403] T b86527b8a77848629c50a32e2534f7ba P 82f27bcdf252425aad4c4a37d064f68d: Time spent bootstrapping tablet: real 0.246s	user 0.018s	sys 0.005s
I20260709 12:27:33.267002 16684 leader_election.cc:304] T b86527b8a77848629c50a32e2534f7ba P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8; no voters: 82f27bcdf252425aad4c4a37d064f68d
I20260709 12:27:33.273396 17442 raft_consensus.cc:2804] T b86527b8a77848629c50a32e2534f7ba P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:33.274091 17442 raft_consensus.cc:697] T b86527b8a77848629c50a32e2534f7ba P 879366e90f5c420588945e0d545017c8 [term 1 LEADER]: Becoming Leader. State: Replica: 879366e90f5c420588945e0d545017c8, State: Running, Role: LEADER
I20260709 12:27:33.236482 16991 consensus_queue.cc:260] T 8eaf179090b14105b52c4701d5599216 P 3c1aba6ee1d244fd9c0daba722aa0b3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:33.275331 17442 consensus_queue.cc:237] T b86527b8a77848629c50a32e2534f7ba P 879366e90f5c420588945e0d545017c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
W20260709 12:27:33.282939 16684 consensus_peers.cc:597] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 879366e90f5c420588945e0d545017c8 -> Peer 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919): Couldn't send request to peer 82f27bcdf252425aad4c4a37d064f68d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:33.284777 16989 raft_consensus.cc:359] T b86527b8a77848629c50a32e2534f7ba P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:33.286123 16989 raft_consensus.cc:385] T b86527b8a77848629c50a32e2534f7ba P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:33.286482 16989 raft_consensus.cc:740] T b86527b8a77848629c50a32e2534f7ba P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f27bcdf252425aad4c4a37d064f68d, State: Initialized, Role: FOLLOWER
I20260709 12:27:33.287763 16989 consensus_queue.cc:260] T b86527b8a77848629c50a32e2534f7ba P 82f27bcdf252425aad4c4a37d064f68d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:33.291646 16991 ts_tablet_manager.cc:1434] T 8eaf179090b14105b52c4701d5599216 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent starting tablet: real 0.083s	user 0.007s	sys 0.002s
I20260709 12:27:33.305263 16989 ts_tablet_manager.cc:1434] T b86527b8a77848629c50a32e2534f7ba P 82f27bcdf252425aad4c4a37d064f68d: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 12:27:33.308786 16991 tablet_bootstrap.cc:492] T f39dd87ef56a40e2bf56704b2815a619 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Bootstrap starting.
I20260709 12:27:33.310009 16615 catalog_manager.cc:5697] T 29fcc4f156a54ca4b54a4a11e2cee973 P 3c1aba6ee1d244fd9c0daba722aa0b3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66). New cstate: current_term: 1 leader_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:33.314700 16615 catalog_manager.cc:5697] T ce37f3e8575c4b8e88935db231644a27 P 3c1aba6ee1d244fd9c0daba722aa0b3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66). New cstate: current_term: 1 leader_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:33.315819 16987 tablet_bootstrap.cc:654] T a4252af16e15424399c32c789c8e6c23 P 879366e90f5c420588945e0d545017c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:33.318624 16989 tablet_bootstrap.cc:492] T f29cf6eb18e842c3a5aa62d8fae53279 P 82f27bcdf252425aad4c4a37d064f68d: Bootstrap starting.
I20260709 12:27:33.322813 17257 raft_consensus.cc:493] T 3d614e06fd2c40189161e22ad9217e5d P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:33.340726 17257 raft_consensus.cc:515] T 3d614e06fd2c40189161e22ad9217e5d P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:33.343405 17257 leader_election.cc:290] T 3d614e06fd2c40189161e22ad9217e5d P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:33.347218 16719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d614e06fd2c40189161e22ad9217e5d" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8" is_pre_election: true
I20260709 12:27:33.347911 16991 tablet_bootstrap.cc:654] T f39dd87ef56a40e2bf56704b2815a619 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Neither blocks nor log segments found. Creating new log.
W20260709 12:27:33.355542 16833 leader_election.cc:343] T 3d614e06fd2c40189161e22ad9217e5d P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:33.346057 16939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d614e06fd2c40189161e22ad9217e5d" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:33.345786 17397 consensus_queue.cc:1048] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 879366e90f5c420588945e0d545017c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
W20260709 12:27:33.358887 16833 leader_election.cc:343] T 3d614e06fd2c40189161e22ad9217e5d P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:33.359381 16833 leader_election.cc:304] T 3d614e06fd2c40189161e22ad9217e5d P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336; no voters: 82f27bcdf252425aad4c4a37d064f68d, 879366e90f5c420588945e0d545017c8
I20260709 12:27:33.360605 17389 raft_consensus.cc:2749] T 3d614e06fd2c40189161e22ad9217e5d P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:33.350975 16989 tablet_bootstrap.cc:654] T f29cf6eb18e842c3a5aa62d8fae53279 P 82f27bcdf252425aad4c4a37d064f68d: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:33.374493 17257 consensus_queue.cc:1048] T 3e78004b8cc14ac6b93c857cbdd63329 P 17294485b7f24e2b9fae71dd3169a336 [LEADER]: Connected to new peer: Peer: permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:33.377127 16988 tablet_bootstrap.cc:492] T a4252af16e15424399c32c789c8e6c23 P 17294485b7f24e2b9fae71dd3169a336: No bootstrap required, opened a new log
I20260709 12:27:33.377471 17408 raft_consensus.cc:493] T ce37f3e8575c4b8e88935db231644a27 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:33.377897 16988 ts_tablet_manager.cc:1403] T a4252af16e15424399c32c789c8e6c23 P 17294485b7f24e2b9fae71dd3169a336: Time spent bootstrapping tablet: real 0.131s	user 0.025s	sys 0.011s
I20260709 12:27:33.378183 17408 raft_consensus.cc:515] T ce37f3e8575c4b8e88935db231644a27 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:33.391757 17397 raft_consensus.cc:493] T 6e89df746e0c49d184637314ce87045a P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:33.392663 17397 raft_consensus.cc:515] T 6e89df746e0c49d184637314ce87045a P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:33.393494 16718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce37f3e8575c4b8e88935db231644a27" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8" is_pre_election: true
I20260709 12:27:33.395118 17408 leader_election.cc:290] T ce37f3e8575c4b8e88935db231644a27 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:33.396642 16791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce37f3e8575c4b8e88935db231644a27" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
I20260709 12:27:33.415449 16868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e89df746e0c49d184637314ce87045a" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:33.414837 16988 raft_consensus.cc:359] T a4252af16e15424399c32c789c8e6c23 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:33.417794 16988 raft_consensus.cc:385] T a4252af16e15424399c32c789c8e6c23 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:33.418171 16988 raft_consensus.cc:740] T a4252af16e15424399c32c789c8e6c23 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Initialized, Role: FOLLOWER
I20260709 12:27:33.419183 16987 tablet_bootstrap.cc:492] T a4252af16e15424399c32c789c8e6c23 P 879366e90f5c420588945e0d545017c8: No bootstrap required, opened a new log
W20260709 12:27:33.419123 16684 leader_election.cc:343] T 6e89df746e0c49d184637314ce87045a P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:33.419888 16987 ts_tablet_manager.cc:1403] T a4252af16e15424399c32c789c8e6c23 P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.187s	user 0.012s	sys 0.011s
I20260709 12:27:33.395228 17397 leader_election.cc:290] T 6e89df746e0c49d184637314ce87045a P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
I20260709 12:27:33.422080 16834 leader_election.cc:304] T ce37f3e8575c4b8e88935db231644a27 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8
I20260709 12:27:33.420511 16988 consensus_queue.cc:260] T a4252af16e15424399c32c789c8e6c23 P 17294485b7f24e2b9fae71dd3169a336 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:33.391878 17446 consensus_queue.cc:1048] T ce37f3e8575c4b8e88935db231644a27 P 3c1aba6ee1d244fd9c0daba722aa0b3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.026s
I20260709 12:27:33.427836 17389 raft_consensus.cc:2749] T ce37f3e8575c4b8e88935db231644a27 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:33.440805 16791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e89df746e0c49d184637314ce87045a" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
I20260709 12:27:33.441834 16791 raft_consensus.cc:2468] T 6e89df746e0c49d184637314ce87045a P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 0.
I20260709 12:27:33.449250 16685 leader_election.cc:304] T 6e89df746e0c49d184637314ce87045a P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8; no voters: 17294485b7f24e2b9fae71dd3169a336
I20260709 12:27:33.455432 16991 tablet_bootstrap.cc:492] T f39dd87ef56a40e2bf56704b2815a619 P 3c1aba6ee1d244fd9c0daba722aa0b3b: No bootstrap required, opened a new log
I20260709 12:27:33.456997 16991 ts_tablet_manager.cc:1403] T f39dd87ef56a40e2bf56704b2815a619 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent bootstrapping tablet: real 0.164s	user 0.016s	sys 0.006s
I20260709 12:27:33.452759 17442 raft_consensus.cc:2804] T 6e89df746e0c49d184637314ce87045a P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:33.471015 17442 raft_consensus.cc:493] T 6e89df746e0c49d184637314ce87045a P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:33.476311 17442 raft_consensus.cc:3060] T 6e89df746e0c49d184637314ce87045a P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:33.478616 16987 raft_consensus.cc:359] T a4252af16e15424399c32c789c8e6c23 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:33.480708 16987 raft_consensus.cc:385] T a4252af16e15424399c32c789c8e6c23 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:33.481097 16987 raft_consensus.cc:740] T a4252af16e15424399c32c789c8e6c23 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:33.484896 16987 consensus_queue.cc:260] T a4252af16e15424399c32c789c8e6c23 P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:33.487510 16991 raft_consensus.cc:359] T f39dd87ef56a40e2bf56704b2815a619 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:33.488456 16987 ts_tablet_manager.cc:1434] T a4252af16e15424399c32c789c8e6c23 P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.067s	user 0.006s	sys 0.002s
I20260709 12:27:33.488832 16991 raft_consensus.cc:385] T f39dd87ef56a40e2bf56704b2815a619 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:33.489241 16991 raft_consensus.cc:740] T f39dd87ef56a40e2bf56704b2815a619 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c1aba6ee1d244fd9c0daba722aa0b3b, State: Initialized, Role: FOLLOWER
I20260709 12:27:33.496793 16988 ts_tablet_manager.cc:1434] T a4252af16e15424399c32c789c8e6c23 P 17294485b7f24e2b9fae71dd3169a336: Time spent starting tablet: real 0.118s	user 0.014s	sys 0.013s
I20260709 12:27:33.497485 16991 consensus_queue.cc:260] T f39dd87ef56a40e2bf56704b2815a619 P 3c1aba6ee1d244fd9c0daba722aa0b3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:33.523321 16991 ts_tablet_manager.cc:1434] T f39dd87ef56a40e2bf56704b2815a619 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent starting tablet: real 0.066s	user 0.009s	sys 0.002s
I20260709 12:27:33.528712 17442 raft_consensus.cc:515] T 6e89df746e0c49d184637314ce87045a P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:33.533047 16988 tablet_bootstrap.cc:492] T 6e89df746e0c49d184637314ce87045a P 17294485b7f24e2b9fae71dd3169a336: Bootstrap starting.
W20260709 12:27:33.553383 16684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37919, user_credentials={real_user=slave}} blocked reactor thread for 47734.1us
I20260709 12:27:33.574051 16989 tablet_bootstrap.cc:492] T f29cf6eb18e842c3a5aa62d8fae53279 P 82f27bcdf252425aad4c4a37d064f68d: No bootstrap required, opened a new log
I20260709 12:27:33.574891 16989 ts_tablet_manager.cc:1403] T f29cf6eb18e842c3a5aa62d8fae53279 P 82f27bcdf252425aad4c4a37d064f68d: Time spent bootstrapping tablet: real 0.257s	user 0.017s	sys 0.009s
I20260709 12:27:33.588340 16991 tablet_bootstrap.cc:492] T a4252af16e15424399c32c789c8e6c23 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Bootstrap starting.
I20260709 12:27:33.598434 16989 raft_consensus.cc:359] T f29cf6eb18e842c3a5aa62d8fae53279 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:33.604554 16989 raft_consensus.cc:385] T f29cf6eb18e842c3a5aa62d8fae53279 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:27:33.604988 17479 log.cc:927] Time spent T 3e78004b8cc14ac6b93c857cbdd63329 P 879366e90f5c420588945e0d545017c8: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 12:27:33.605077 16989 raft_consensus.cc:740] T f29cf6eb18e842c3a5aa62d8fae53279 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f27bcdf252425aad4c4a37d064f68d, State: Initialized, Role: FOLLOWER
I20260709 12:27:33.606493 16989 consensus_queue.cc:260] T f29cf6eb18e842c3a5aa62d8fae53279 P 82f27bcdf252425aad4c4a37d064f68d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:33.613518 16987 tablet_bootstrap.cc:492] T 8eaf179090b14105b52c4701d5599216 P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:33.612771 16614 catalog_manager.cc:5697] T 3e78004b8cc14ac6b93c857cbdd63329 P 17294485b7f24e2b9fae71dd3169a336 reported cstate change: term changed from 0 to 1, leader changed from <none> to 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67). New cstate: current_term: 1 leader_uuid: "17294485b7f24e2b9fae71dd3169a336" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:33.616767 17460 raft_consensus.cc:493] T 8eaf179090b14105b52c4701d5599216 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:33.580305 17439 consensus_queue.cc:1048] T 3e78004b8cc14ac6b93c857cbdd63329 P 17294485b7f24e2b9fae71dd3169a336 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.054s
I20260709 12:27:33.634728 16862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e89df746e0c49d184637314ce87045a" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336"
I20260709 12:27:33.621430 17442 leader_election.cc:290] T 6e89df746e0c49d184637314ce87045a P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 election: Requested vote from peers 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
I20260709 12:27:33.617321 17460 raft_consensus.cc:515] T 8eaf179090b14105b52c4701d5599216 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:33.640250 17460 leader_election.cc:290] T 8eaf179090b14105b52c4701d5599216 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:33.640761 16793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e89df746e0c49d184637314ce87045a" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b"
I20260709 12:27:33.641873 16793 raft_consensus.cc:3060] T 6e89df746e0c49d184637314ce87045a P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:27:33.644153 16684 leader_election.cc:343] T 6e89df746e0c49d184637314ce87045a P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:33.649605 16989 ts_tablet_manager.cc:1434] T f29cf6eb18e842c3a5aa62d8fae53279 P 82f27bcdf252425aad4c4a37d064f68d: Time spent starting tablet: real 0.074s	user 0.008s	sys 0.002s
I20260709 12:27:33.651845 16989 tablet_bootstrap.cc:492] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 82f27bcdf252425aad4c4a37d064f68d: Bootstrap starting.
I20260709 12:27:33.658912 16989 tablet_bootstrap.cc:654] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 82f27bcdf252425aad4c4a37d064f68d: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:33.662050 16793 raft_consensus.cc:2468] T 6e89df746e0c49d184637314ce87045a P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 1.
W20260709 12:27:33.674849 16759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:39833, user_credentials={real_user=slave}} blocked reactor thread for 72524.4us
I20260709 12:27:33.674872 16613 catalog_manager.cc:5697] T b86527b8a77848629c50a32e2534f7ba P 879366e90f5c420588945e0d545017c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 879366e90f5c420588945e0d545017c8 (127.9.116.65). New cstate: current_term: 1 leader_uuid: "879366e90f5c420588945e0d545017c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:33.676090 16685 leader_election.cc:304] T 6e89df746e0c49d184637314ce87045a P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8; no voters: 17294485b7f24e2b9fae71dd3169a336
I20260709 12:27:33.676033 16988 tablet_bootstrap.cc:654] T 6e89df746e0c49d184637314ce87045a P 17294485b7f24e2b9fae71dd3169a336: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:33.687296 17488 raft_consensus.cc:2804] T 6e89df746e0c49d184637314ce87045a P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:33.688145 17488 raft_consensus.cc:697] T 6e89df746e0c49d184637314ce87045a P 879366e90f5c420588945e0d545017c8 [term 1 LEADER]: Becoming Leader. State: Replica: 879366e90f5c420588945e0d545017c8, State: Running, Role: LEADER
I20260709 12:27:33.689133 17488 consensus_queue.cc:237] T 6e89df746e0c49d184637314ce87045a P 879366e90f5c420588945e0d545017c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:33.702376 16987 tablet_bootstrap.cc:654] T 8eaf179090b14105b52c4701d5599216 P 879366e90f5c420588945e0d545017c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:33.703897 16936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eaf179090b14105b52c4701d5599216" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:33.705957 16716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eaf179090b14105b52c4701d5599216" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8" is_pre_election: true
I20260709 12:27:33.707078 16991 tablet_bootstrap.cc:654] T a4252af16e15424399c32c789c8e6c23 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:33.758459 17450 raft_consensus.cc:493] T b86527b8a77848629c50a32e2534f7ba P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:33.735895 17415 raft_consensus.cc:493] T a4252af16e15424399c32c789c8e6c23 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:33.760979 16759 leader_election.cc:343] T 8eaf179090b14105b52c4701d5599216 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:33.774721 17491 raft_consensus.cc:493] T f39dd87ef56a40e2bf56704b2815a619 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:33.775383 17491 raft_consensus.cc:515] T f39dd87ef56a40e2bf56704b2815a619 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:33.777670 17491 leader_election.cc:290] T f39dd87ef56a40e2bf56704b2815a619 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919)
W20260709 12:27:33.779417 16759 leader_election.cc:343] T 8eaf179090b14105b52c4701d5599216 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:33.779913 16759 leader_election.cc:304] T 8eaf179090b14105b52c4701d5599216 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b; no voters: 82f27bcdf252425aad4c4a37d064f68d, 879366e90f5c420588945e0d545017c8
I20260709 12:27:33.783818 17387 raft_consensus.cc:2749] T 8eaf179090b14105b52c4701d5599216 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:33.790336 16991 tablet_bootstrap.cc:492] T a4252af16e15424399c32c789c8e6c23 P 3c1aba6ee1d244fd9c0daba722aa0b3b: No bootstrap required, opened a new log
I20260709 12:27:33.790988 16991 ts_tablet_manager.cc:1403] T a4252af16e15424399c32c789c8e6c23 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent bootstrapping tablet: real 0.215s	user 0.009s	sys 0.016s
I20260709 12:27:33.773211 17415 raft_consensus.cc:515] T a4252af16e15424399c32c789c8e6c23 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:33.804418 16868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f39dd87ef56a40e2bf56704b2815a619" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:33.759100 17450 raft_consensus.cc:515] T b86527b8a77848629c50a32e2534f7ba P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:33.810338 17490 raft_consensus.cc:493] T a4252af16e15424399c32c789c8e6c23 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:33.811053 17490 raft_consensus.cc:515] T a4252af16e15424399c32c789c8e6c23 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:33.831537 16988 tablet_bootstrap.cc:492] T 6e89df746e0c49d184637314ce87045a P 17294485b7f24e2b9fae71dd3169a336: No bootstrap required, opened a new log
I20260709 12:27:33.832262 16988 ts_tablet_manager.cc:1403] T 6e89df746e0c49d184637314ce87045a P 17294485b7f24e2b9fae71dd3169a336: Time spent bootstrapping tablet: real 0.313s	user 0.017s	sys 0.014s
W20260709 12:27:33.857780 16907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:38103, user_credentials={real_user=slave}} blocked reactor thread for 104445us
W20260709 12:27:33.865216 16759 leader_election.cc:343] T f39dd87ef56a40e2bf56704b2815a619 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:33.891594 16936 raft_consensus.cc:3060] T b86527b8a77848629c50a32e2534f7ba P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:33.896850 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f39dd87ef56a40e2bf56704b2815a619" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:33.948920 16988 raft_consensus.cc:359] T 6e89df746e0c49d184637314ce87045a P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:33.949839 16988 raft_consensus.cc:385] T 6e89df746e0c49d184637314ce87045a P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:33.950171 16988 raft_consensus.cc:740] T 6e89df746e0c49d184637314ce87045a P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Initialized, Role: FOLLOWER
I20260709 12:27:33.950654 17450 leader_election.cc:290] T b86527b8a77848629c50a32e2534f7ba P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:33.954916 17490 leader_election.cc:290] T a4252af16e15424399c32c789c8e6c23 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:33.958668 16868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86527b8a77848629c50a32e2534f7ba" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:33.959834 16868 raft_consensus.cc:2393] T b86527b8a77848629c50a32e2534f7ba P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 82f27bcdf252425aad4c4a37d064f68d in current term 1: Already voted for candidate 879366e90f5c420588945e0d545017c8 in this term.
I20260709 12:27:33.961426 16987 tablet_bootstrap.cc:492] T 8eaf179090b14105b52c4701d5599216 P 879366e90f5c420588945e0d545017c8: No bootstrap required, opened a new log
I20260709 12:27:33.961997 16987 ts_tablet_manager.cc:1403] T 8eaf179090b14105b52c4701d5599216 P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.349s	user 0.015s	sys 0.011s
I20260709 12:27:33.962869 16989 tablet_bootstrap.cc:492] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 82f27bcdf252425aad4c4a37d064f68d: No bootstrap required, opened a new log
I20260709 12:27:33.963382 16989 ts_tablet_manager.cc:1403] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 82f27bcdf252425aad4c4a37d064f68d: Time spent bootstrapping tablet: real 0.312s	user 0.011s	sys 0.013s
I20260709 12:27:33.965384 16991 raft_consensus.cc:359] T a4252af16e15424399c32c789c8e6c23 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:33.954955 17415 leader_election.cc:290] T a4252af16e15424399c32c789c8e6c23 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
I20260709 12:27:33.984570 16991 raft_consensus.cc:385] T a4252af16e15424399c32c789c8e6c23 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:33.985045 16991 raft_consensus.cc:740] T a4252af16e15424399c32c789c8e6c23 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c1aba6ee1d244fd9c0daba722aa0b3b, State: Initialized, Role: FOLLOWER
I20260709 12:27:33.950963 16988 consensus_queue.cc:260] T 6e89df746e0c49d184637314ce87045a P 17294485b7f24e2b9fae71dd3169a336 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:33.988252 16718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4252af16e15424399c32c789c8e6c23" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8" is_pre_election: true
I20260709 12:27:33.989634 16718 raft_consensus.cc:2468] T a4252af16e15424399c32c789c8e6c23 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 0.
I20260709 12:27:33.985915 16991 consensus_queue.cc:260] T a4252af16e15424399c32c789c8e6c23 P 3c1aba6ee1d244fd9c0daba722aa0b3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:33.997380 16988 ts_tablet_manager.cc:1434] T 6e89df746e0c49d184637314ce87045a P 17294485b7f24e2b9fae71dd3169a336: Time spent starting tablet: real 0.165s	user 0.010s	sys 0.008s
I20260709 12:27:33.999037 16988 tablet_bootstrap.cc:492] T f39dd87ef56a40e2bf56704b2815a619 P 17294485b7f24e2b9fae71dd3169a336: Bootstrap starting.
W20260709 12:27:33.976979 16759 leader_election.cc:343] T f39dd87ef56a40e2bf56704b2815a619 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:34.007911 16759 leader_election.cc:304] T f39dd87ef56a40e2bf56704b2815a619 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b; no voters: 17294485b7f24e2b9fae71dd3169a336, 82f27bcdf252425aad4c4a37d064f68d
I20260709 12:27:33.973076 16987 raft_consensus.cc:359] T 8eaf179090b14105b52c4701d5599216 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:34.009130 16987 raft_consensus.cc:385] T 8eaf179090b14105b52c4701d5599216 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:34.009483 16987 raft_consensus.cc:740] T 8eaf179090b14105b52c4701d5599216 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:34.010221 16987 consensus_queue.cc:260] T 8eaf179090b14105b52c4701d5599216 P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:34.010852 16833 leader_election.cc:304] T a4252af16e15424399c32c789c8e6c23 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8; no voters: 
I20260709 12:27:34.012043 17389 raft_consensus.cc:2804] T a4252af16e15424399c32c789c8e6c23 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:34.012566 17389 raft_consensus.cc:493] T a4252af16e15424399c32c789c8e6c23 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:34.013012 17389 raft_consensus.cc:3060] T a4252af16e15424399c32c789c8e6c23 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:34.012807 16987 ts_tablet_manager.cc:1434] T 8eaf179090b14105b52c4701d5599216 P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.001s
I20260709 12:27:34.014564 16987 tablet_bootstrap.cc:492] T 7562feb416f84f0b948343356153d8d2 P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
W20260709 12:27:34.022534 16759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37919, user_credentials={real_user=slave}} blocked reactor thread for 45582.2us
I20260709 12:27:34.023785 16791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4252af16e15424399c32c789c8e6c23" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
I20260709 12:27:34.024286 17387 raft_consensus.cc:2749] T f39dd87ef56a40e2bf56704b2815a619 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:34.024806 16791 raft_consensus.cc:2468] T a4252af16e15424399c32c789c8e6c23 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 0.
I20260709 12:27:34.027777 16791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4252af16e15424399c32c789c8e6c23" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
I20260709 12:27:34.028535 16791 raft_consensus.cc:2468] T a4252af16e15424399c32c789c8e6c23 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 0.
I20260709 12:27:34.028077 16991 ts_tablet_manager.cc:1434] T a4252af16e15424399c32c789c8e6c23 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent starting tablet: real 0.237s	user 0.012s	sys 0.007s
I20260709 12:27:34.038867 16991 tablet_bootstrap.cc:492] T a8a632c738e94b26a8352a68a42a0670 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Bootstrap starting.
I20260709 12:27:34.048977 16991 tablet_bootstrap.cc:654] T a8a632c738e94b26a8352a68a42a0670 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:34.067098 16987 tablet_bootstrap.cc:654] T 7562feb416f84f0b948343356153d8d2 P 879366e90f5c420588945e0d545017c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:34.071473 16988 tablet_bootstrap.cc:654] T f39dd87ef56a40e2bf56704b2815a619 P 17294485b7f24e2b9fae71dd3169a336: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:34.078797 16991 tablet_bootstrap.cc:492] T a8a632c738e94b26a8352a68a42a0670 P 3c1aba6ee1d244fd9c0daba722aa0b3b: No bootstrap required, opened a new log
I20260709 12:27:34.079355 16991 ts_tablet_manager.cc:1403] T a8a632c738e94b26a8352a68a42a0670 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent bootstrapping tablet: real 0.041s	user 0.016s	sys 0.000s
I20260709 12:27:34.081944 16685 leader_election.cc:304] T a4252af16e15424399c32c789c8e6c23 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8; no voters: 
I20260709 12:27:34.082618 16991 raft_consensus.cc:359] T a8a632c738e94b26a8352a68a42a0670 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:34.083280 17397 raft_consensus.cc:2804] T a4252af16e15424399c32c789c8e6c23 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:34.083438 16991 raft_consensus.cc:385] T a8a632c738e94b26a8352a68a42a0670 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:34.083889 17397 raft_consensus.cc:493] T a4252af16e15424399c32c789c8e6c23 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:34.088331 17397 raft_consensus.cc:3060] T a4252af16e15424399c32c789c8e6c23 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:34.091769 16987 tablet_bootstrap.cc:492] T 7562feb416f84f0b948343356153d8d2 P 879366e90f5c420588945e0d545017c8: No bootstrap required, opened a new log
I20260709 12:27:34.096691 16991 raft_consensus.cc:740] T a8a632c738e94b26a8352a68a42a0670 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c1aba6ee1d244fd9c0daba722aa0b3b, State: Initialized, Role: FOLLOWER
W20260709 12:27:34.099660 16908 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:43629, user_credentials={real_user=slave}} blocked reactor thread for 89534.8us
I20260709 12:27:34.101277 16989 raft_consensus.cc:359] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:34.108845 16987 ts_tablet_manager.cc:1403] T 7562feb416f84f0b948343356153d8d2 P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.095s	user 0.012s	sys 0.001s
I20260709 12:27:34.109018 16989 raft_consensus.cc:385] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:34.102818 17397 raft_consensus.cc:515] T a4252af16e15424399c32c789c8e6c23 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:34.109102 16991 consensus_queue.cc:260] T a8a632c738e94b26a8352a68a42a0670 P 3c1aba6ee1d244fd9c0daba722aa0b3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:34.110112 16989 raft_consensus.cc:740] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f27bcdf252425aad4c4a37d064f68d, State: Initialized, Role: FOLLOWER
I20260709 12:27:34.110846 16989 consensus_queue.cc:260] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 82f27bcdf252425aad4c4a37d064f68d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:34.113050 16989 ts_tablet_manager.cc:1434] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 82f27bcdf252425aad4c4a37d064f68d: Time spent starting tablet: real 0.133s	user 0.004s	sys 0.002s
I20260709 12:27:34.114670 16988 tablet_bootstrap.cc:492] T f39dd87ef56a40e2bf56704b2815a619 P 17294485b7f24e2b9fae71dd3169a336: No bootstrap required, opened a new log
I20260709 12:27:34.115243 16988 ts_tablet_manager.cc:1403] T f39dd87ef56a40e2bf56704b2815a619 P 17294485b7f24e2b9fae71dd3169a336: Time spent bootstrapping tablet: real 0.117s	user 0.010s	sys 0.003s
I20260709 12:27:34.110888 17450 raft_consensus.cc:493] T f29cf6eb18e842c3a5aa62d8fae53279 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:34.116950 17450 raft_consensus.cc:515] T f29cf6eb18e842c3a5aa62d8fae53279 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:34.118687 16988 raft_consensus.cc:359] T f39dd87ef56a40e2bf56704b2815a619 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:34.122177 16987 raft_consensus.cc:359] T 7562feb416f84f0b948343356153d8d2 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:34.123353 16987 raft_consensus.cc:385] T 7562feb416f84f0b948343356153d8d2 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:34.123723 16987 raft_consensus.cc:740] T 7562feb416f84f0b948343356153d8d2 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:34.123764 17450 leader_election.cc:290] T f29cf6eb18e842c3a5aa62d8fae53279 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
I20260709 12:27:34.124583 17397 leader_election.cc:290] T a4252af16e15424399c32c789c8e6c23 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 election: Requested vote from peers 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
I20260709 12:27:34.124764 16987 consensus_queue.cc:260] T 7562feb416f84f0b948343356153d8d2 P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:34.119894 16989 tablet_bootstrap.cc:492] T 8eaf179090b14105b52c4701d5599216 P 82f27bcdf252425aad4c4a37d064f68d: Bootstrap starting.
I20260709 12:27:34.127919 16987 ts_tablet_manager.cc:1434] T 7562feb416f84f0b948343356153d8d2 P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 12:27:34.129308 16987 tablet_bootstrap.cc:492] T 3d614e06fd2c40189161e22ad9217e5d P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
W20260709 12:27:34.130023 16684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:38103, user_credentials={real_user=slave}} blocked reactor thread for 130211us
I20260709 12:27:34.119529 16988 raft_consensus.cc:385] T f39dd87ef56a40e2bf56704b2815a619 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:34.131837 16988 raft_consensus.cc:740] T f39dd87ef56a40e2bf56704b2815a619 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Initialized, Role: FOLLOWER
I20260709 12:27:34.135553 16791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4252af16e15424399c32c789c8e6c23" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b"
I20260709 12:27:34.136260 16791 raft_consensus.cc:3060] T a4252af16e15424399c32c789c8e6c23 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:34.132856 16988 consensus_queue.cc:260] T f39dd87ef56a40e2bf56704b2815a619 P 17294485b7f24e2b9fae71dd3169a336 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:34.139604 16987 tablet_bootstrap.cc:654] T 3d614e06fd2c40189161e22ad9217e5d P 879366e90f5c420588945e0d545017c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:34.150063 16991 ts_tablet_manager.cc:1434] T a8a632c738e94b26a8352a68a42a0670 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Time spent starting tablet: real 0.070s	user 0.004s	sys 0.003s
I20260709 12:27:34.152360 17488 consensus_queue.cc:1048] T b86527b8a77848629c50a32e2534f7ba P 879366e90f5c420588945e0d545017c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:34.154580 17257 raft_consensus.cc:493] T f39dd87ef56a40e2bf56704b2815a619 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:34.155174 17257 raft_consensus.cc:515] T f39dd87ef56a40e2bf56704b2815a619 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:34.157446 17257 leader_election.cc:290] T f39dd87ef56a40e2bf56704b2815a619 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629), 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919)
I20260709 12:27:34.158344 16868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4252af16e15424399c32c789c8e6c23" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:34.161681 16793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f39dd87ef56a40e2bf56704b2815a619" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
I20260709 12:27:34.162526 16793 raft_consensus.cc:2468] T f39dd87ef56a40e2bf56704b2815a619 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 0.
I20260709 12:27:34.166909 16834 leader_election.cc:304] T f39dd87ef56a40e2bf56704b2815a619 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 3c1aba6ee1d244fd9c0daba722aa0b3b; no voters: 
I20260709 12:27:34.173056 16789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f29cf6eb18e842c3a5aa62d8fae53279" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
I20260709 12:27:34.174513 16789 raft_consensus.cc:2393] T f29cf6eb18e842c3a5aa62d8fae53279 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 82f27bcdf252425aad4c4a37d064f68d in current term 1: Already voted for candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in this term.
I20260709 12:27:34.176137 17490 raft_consensus.cc:2804] T f39dd87ef56a40e2bf56704b2815a619 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:34.176750 17490 raft_consensus.cc:493] T f39dd87ef56a40e2bf56704b2815a619 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:34.177269 17490 raft_consensus.cc:3060] T f39dd87ef56a40e2bf56704b2815a619 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:27:34.187922 16907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:38103, user_credentials={real_user=slave}} blocked reactor thread for 76828.1us
I20260709 12:27:34.192763 16862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f29cf6eb18e842c3a5aa62d8fae53279" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:34.193838 16862 raft_consensus.cc:2393] T f29cf6eb18e842c3a5aa62d8fae53279 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 82f27bcdf252425aad4c4a37d064f68d in current term 1: Already voted for candidate 17294485b7f24e2b9fae71dd3169a336 in this term.
I20260709 12:27:34.194200 16864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4252af16e15424399c32c789c8e6c23" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336"
I20260709 12:27:34.204183 17488 consensus_queue.cc:1048] T b86527b8a77848629c50a32e2534f7ba P 879366e90f5c420588945e0d545017c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:34.204185 16714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86527b8a77848629c50a32e2534f7ba" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8" is_pre_election: true
W20260709 12:27:34.211647 16759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:39833, user_credentials={real_user=slave}} blocked reactor thread for 76433us
I20260709 12:27:34.218138 16988 ts_tablet_manager.cc:1434] T f39dd87ef56a40e2bf56704b2815a619 P 17294485b7f24e2b9fae71dd3169a336: Time spent starting tablet: real 0.103s	user 0.009s	sys 0.000s
I20260709 12:27:34.219319 16988 tablet_bootstrap.cc:492] T 7562feb416f84f0b948343356153d8d2 P 17294485b7f24e2b9fae71dd3169a336: Bootstrap starting.
I20260709 12:27:34.221930 16791 raft_consensus.cc:2468] T a4252af16e15424399c32c789c8e6c23 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 1.
I20260709 12:27:34.225167 16685 leader_election.cc:304] T a4252af16e15424399c32c789c8e6c23 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8; no voters: 17294485b7f24e2b9fae71dd3169a336
I20260709 12:27:34.226310 17488 raft_consensus.cc:2804] T a4252af16e15424399c32c789c8e6c23 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:34.226819 17488 raft_consensus.cc:697] T a4252af16e15424399c32c789c8e6c23 P 879366e90f5c420588945e0d545017c8 [term 1 LEADER]: Becoming Leader. State: Replica: 879366e90f5c420588945e0d545017c8, State: Running, Role: LEADER
I20260709 12:27:34.227690 17488 consensus_queue.cc:237] T a4252af16e15424399c32c789c8e6c23 P 879366e90f5c420588945e0d545017c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:34.229910 16989 tablet_bootstrap.cc:654] T 8eaf179090b14105b52c4701d5599216 P 82f27bcdf252425aad4c4a37d064f68d: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:34.230751 17397 consensus_queue.cc:1048] T 6e89df746e0c49d184637314ce87045a P 879366e90f5c420588945e0d545017c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:34.104444 17389 raft_consensus.cc:515] T a4252af16e15424399c32c789c8e6c23 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:34.237628 16868 raft_consensus.cc:2393] T a4252af16e15424399c32c789c8e6c23 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 879366e90f5c420588945e0d545017c8 in current term 1: Already voted for candidate 17294485b7f24e2b9fae71dd3169a336 in this term.
I20260709 12:27:34.238659 17389 leader_election.cc:290] T a4252af16e15424399c32c789c8e6c23 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 election: Requested vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:34.248397 16867 raft_consensus.cc:3060] T 6e89df746e0c49d184637314ce87045a P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:34.278100 17415 consensus_queue.cc:1048] T 6e89df746e0c49d184637314ce87045a P 879366e90f5c420588945e0d545017c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:34.279564 16907 leader_election.cc:304] T b86527b8a77848629c50a32e2534f7ba P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8
I20260709 12:27:34.286209 16792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4252af16e15424399c32c789c8e6c23" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b"
I20260709 12:27:34.287418 16792 raft_consensus.cc:2393] T a4252af16e15424399c32c789c8e6c23 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 17294485b7f24e2b9fae71dd3169a336 in current term 1: Already voted for candidate 879366e90f5c420588945e0d545017c8 in this term.
I20260709 12:27:34.294953 16615 catalog_manager.cc:5697] T 6e89df746e0c49d184637314ce87045a P 879366e90f5c420588945e0d545017c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 879366e90f5c420588945e0d545017c8 (127.9.116.65). New cstate: current_term: 1 leader_uuid: "879366e90f5c420588945e0d545017c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } health_report { overall_health: UNKNOWN } } }
W20260709 12:27:34.310864 16665 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:27:34.326582 16719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4252af16e15424399c32c789c8e6c23" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8"
W20260709 12:27:34.356487 16907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:39833, user_credentials={real_user=slave}} blocked reactor thread for 76991us
I20260709 12:27:34.373155 17394 raft_consensus.cc:493] T a8a632c738e94b26a8352a68a42a0670 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:34.380576 17496 raft_consensus.cc:2749] T b86527b8a77848629c50a32e2534f7ba P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:34.386274 17394 raft_consensus.cc:515] T a8a632c738e94b26a8352a68a42a0670 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:34.440640 17415 raft_consensus.cc:493] T 7562feb416f84f0b948343356153d8d2 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:34.441907 17415 raft_consensus.cc:515] T 7562feb416f84f0b948343356153d8d2 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:34.445639 17415 leader_election.cc:290] T 7562feb416f84f0b948343356153d8d2 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919)
I20260709 12:27:34.447232 16867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7562feb416f84f0b948343356153d8d2" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
W20260709 12:27:34.451243 16684 leader_election.cc:343] T 7562feb416f84f0b948343356153d8d2 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:34.455672 17496 raft_consensus.cc:493] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:34.458181 17496 raft_consensus.cc:515] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:34.467547 16941 raft_consensus.cc:3060] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:34.501010 16907 leader_election.cc:304] T f29cf6eb18e842c3a5aa62d8fae53279 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 17294485b7f24e2b9fae71dd3169a336, 3c1aba6ee1d244fd9c0daba722aa0b3b
I20260709 12:27:34.495271 17394 leader_election.cc:290] T a8a632c738e94b26a8352a68a42a0670 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:34.538578 17519 raft_consensus.cc:3060] T f29cf6eb18e842c3a5aa62d8fae53279 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:27:34.557216 16759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:39833, user_credentials={real_user=slave}} blocked reactor thread for 61119.3us
W20260709 12:27:34.560132 17510 log.cc:927] Time spent T b86527b8a77848629c50a32e2534f7ba P 82f27bcdf252425aad4c4a37d064f68d: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 12:27:34.568216 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7562feb416f84f0b948343356153d8d2" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:34.576040 16988 tablet_bootstrap.cc:654] T 7562feb416f84f0b948343356153d8d2 P 17294485b7f24e2b9fae71dd3169a336: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:34.578994 17496 leader_election.cc:290] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
W20260709 12:27:34.601763 16908 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:43629, user_credentials={real_user=slave}} blocked reactor thread for 64370.2us
I20260709 12:27:34.631789 16989 tablet_bootstrap.cc:492] T 8eaf179090b14105b52c4701d5599216 P 82f27bcdf252425aad4c4a37d064f68d: No bootstrap required, opened a new log
I20260709 12:27:34.632633 16989 ts_tablet_manager.cc:1403] T 8eaf179090b14105b52c4701d5599216 P 82f27bcdf252425aad4c4a37d064f68d: Time spent bootstrapping tablet: real 0.513s	user 0.016s	sys 0.000s
I20260709 12:27:34.628875 16936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f39dd87ef56a40e2bf56704b2815a619" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
W20260709 12:27:34.652146 16684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:38103, user_credentials={real_user=slave}} blocked reactor thread for 62544.7us
I20260709 12:27:34.675448 16833 leader_election.cc:304] T a4252af16e15424399c32c789c8e6c23 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8
W20260709 12:27:34.727195 16907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:38103, user_credentials={real_user=slave}} blocked reactor thread for 226306us
I20260709 12:27:34.666069 17490 raft_consensus.cc:515] T f39dd87ef56a40e2bf56704b2815a619 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
W20260709 12:27:34.727499 16685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:43629, user_credentials={real_user=slave}} blocked reactor thread for 185251us
I20260709 12:27:34.746912 16987 tablet_bootstrap.cc:492] T 3d614e06fd2c40189161e22ad9217e5d P 879366e90f5c420588945e0d545017c8: No bootstrap required, opened a new log
I20260709 12:27:34.748412 16987 ts_tablet_manager.cc:1403] T 3d614e06fd2c40189161e22ad9217e5d P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.620s	user 0.073s	sys 0.164s
W20260709 12:27:34.775162 16833 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:39833, user_credentials={real_user=slave}} blocked reactor thread for 60427.6us
W20260709 12:27:34.784453 17451 log.cc:927] Time spent T 00000000000000000000000000000000 P 6ab0b5a8a05748e0b6c4b2e058a40dc4: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:27:34.785120 17484 raft_consensus.cc:2749] T a4252af16e15424399c32c789c8e6c23 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:27:34.807509 16988 tablet_bootstrap.cc:492] T 7562feb416f84f0b948343356153d8d2 P 17294485b7f24e2b9fae71dd3169a336: No bootstrap required, opened a new log
I20260709 12:27:34.811115 16988 ts_tablet_manager.cc:1403] T 7562feb416f84f0b948343356153d8d2 P 17294485b7f24e2b9fae71dd3169a336: Time spent bootstrapping tablet: real 0.592s	user 0.020s	sys 0.028s
I20260709 12:27:34.807265 17526 raft_consensus.cc:493] T 8eaf179090b14105b52c4701d5599216 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:34.825098 17490 leader_election.cc:290] T f39dd87ef56a40e2bf56704b2815a619 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 election: Requested vote from peers 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629), 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919)
I20260709 12:27:34.930809 16988 raft_consensus.cc:359] T 7562feb416f84f0b948343356153d8d2 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:34.937870 16988 raft_consensus.cc:385] T 7562feb416f84f0b948343356153d8d2 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:34.938252 16988 raft_consensus.cc:740] T 7562feb416f84f0b948343356153d8d2 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Initialized, Role: FOLLOWER
I20260709 12:27:34.938961 16988 consensus_queue.cc:260] T 7562feb416f84f0b948343356153d8d2 P 17294485b7f24e2b9fae71dd3169a336 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:34.819506 16789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1e8d1852ae457db7e3be5b6957f1b3" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
I20260709 12:27:34.929757 17526 raft_consensus.cc:515] T 8eaf179090b14105b52c4701d5599216 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:34.947110 17526 leader_election.cc:290] T 8eaf179090b14105b52c4701d5599216 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:34.951646 16987 raft_consensus.cc:359] T 3d614e06fd2c40189161e22ad9217e5d P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:34.952459 16987 raft_consensus.cc:385] T 3d614e06fd2c40189161e22ad9217e5d P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:34.952756 16987 raft_consensus.cc:740] T 3d614e06fd2c40189161e22ad9217e5d P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:34.953449 16987 consensus_queue.cc:260] T 3d614e06fd2c40189161e22ad9217e5d P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:34.969069 16987 ts_tablet_manager.cc:1434] T 3d614e06fd2c40189161e22ad9217e5d P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.220s	user 0.009s	sys 0.001s
I20260709 12:27:34.988869 16988 ts_tablet_manager.cc:1434] T 7562feb416f84f0b948343356153d8d2 P 17294485b7f24e2b9fae71dd3169a336: Time spent starting tablet: real 0.177s	user 0.008s	sys 0.000s
I20260709 12:27:34.991217 16789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f39dd87ef56a40e2bf56704b2815a619" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b"
I20260709 12:27:35.007179 16789 raft_consensus.cc:3060] T f39dd87ef56a40e2bf56704b2815a619 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:35.011716 16989 raft_consensus.cc:359] T 8eaf179090b14105b52c4701d5599216 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:35.012988 16989 raft_consensus.cc:385] T 8eaf179090b14105b52c4701d5599216 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:35.013474 16989 raft_consensus.cc:740] T 8eaf179090b14105b52c4701d5599216 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f27bcdf252425aad4c4a37d064f68d, State: Initialized, Role: FOLLOWER
I20260709 12:27:35.014467 16989 consensus_queue.cc:260] T 8eaf179090b14105b52c4701d5599216 P 82f27bcdf252425aad4c4a37d064f68d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:35.001672 17519 raft_consensus.cc:2749] T f29cf6eb18e842c3a5aa62d8fae53279 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:27:35.020862 16684 leader_election.cc:343] T 7562feb416f84f0b948343356153d8d2 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:35.026300 16684 leader_election.cc:304] T 7562feb416f84f0b948343356153d8d2 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 879366e90f5c420588945e0d545017c8; no voters: 17294485b7f24e2b9fae71dd3169a336, 82f27bcdf252425aad4c4a37d064f68d
I20260709 12:27:35.027376 16989 ts_tablet_manager.cc:1434] T 8eaf179090b14105b52c4701d5599216 P 82f27bcdf252425aad4c4a37d064f68d: Time spent starting tablet: real 0.394s	user 0.008s	sys 0.003s
I20260709 12:27:35.037374 17534 raft_consensus.cc:2749] T 7562feb416f84f0b948343356153d8d2 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:27:35.039963 16907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:39833, user_credentials={real_user=slave}} blocked reactor thread for 283523us
I20260709 12:27:35.057391 16719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8a632c738e94b26a8352a68a42a0670" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8" is_pre_election: true
I20260709 12:27:35.071758 16789 raft_consensus.cc:2468] T f39dd87ef56a40e2bf56704b2815a619 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 1.
I20260709 12:27:35.075171 16934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8a632c738e94b26a8352a68a42a0670" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:35.093472 16989 tablet_bootstrap.cc:492] T f39dd87ef56a40e2bf56704b2815a619 P 82f27bcdf252425aad4c4a37d064f68d: Bootstrap starting.
I20260709 12:27:35.102535 17530 consensus_queue.cc:1048] T a4252af16e15424399c32c789c8e6c23 P 879366e90f5c420588945e0d545017c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:35.080634 16717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1e8d1852ae457db7e3be5b6957f1b3" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8" is_pre_election: true
W20260709 12:27:35.121819 16833 leader_election.cc:343] T f39dd87ef56a40e2bf56704b2815a619 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:35.130077 17486 raft_consensus.cc:493] T 3d614e06fd2c40189161e22ad9217e5d P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:35.153717 16987 tablet_bootstrap.cc:492] T a8a632c738e94b26a8352a68a42a0670 P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:35.153357 17486 raft_consensus.cc:515] T 3d614e06fd2c40189161e22ad9217e5d P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:35.135283 16834 leader_election.cc:304] T f39dd87ef56a40e2bf56704b2815a619 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 3c1aba6ee1d244fd9c0daba722aa0b3b; no voters: 
I20260709 12:27:35.157420 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f39dd87ef56a40e2bf56704b2815a619" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d"
I20260709 12:27:35.157903 17439 raft_consensus.cc:2804] T f39dd87ef56a40e2bf56704b2815a619 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:35.158456 17439 raft_consensus.cc:697] T f39dd87ef56a40e2bf56704b2815a619 P 17294485b7f24e2b9fae71dd3169a336 [term 1 LEADER]: Becoming Leader. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Running, Role: LEADER
I20260709 12:27:35.158561 17408 raft_consensus.cc:493] T 7562feb416f84f0b948343356153d8d2 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:35.158789 16908 leader_election.cc:304] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8
I20260709 12:27:35.159106 17408 raft_consensus.cc:515] T 7562feb416f84f0b948343356153d8d2 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:35.159428 17439 consensus_queue.cc:237] T f39dd87ef56a40e2bf56704b2815a619 P 17294485b7f24e2b9fae71dd3169a336 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:35.161810 17408 leader_election.cc:290] T 7562feb416f84f0b948343356153d8d2 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:35.162365 17408 raft_consensus.cc:493] T 3d614e06fd2c40189161e22ad9217e5d P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:35.162485 17486 leader_election.cc:290] T 3d614e06fd2c40189161e22ad9217e5d P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919)
I20260709 12:27:35.162843 17408 raft_consensus.cc:515] T 3d614e06fd2c40189161e22ad9217e5d P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:35.159519 17450 raft_consensus.cc:2749] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:35.127538 16989 tablet_bootstrap.cc:654] T f39dd87ef56a40e2bf56704b2815a619 P 82f27bcdf252425aad4c4a37d064f68d: Neither blocks nor log segments found. Creating new log.
W20260709 12:27:35.138167 16759 leader_election.cc:343] T a8a632c738e94b26a8352a68a42a0670 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:27:35.195189 16759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37919, user_credentials={real_user=slave}} blocked reactor thread for 57053.5us
W20260709 12:27:35.201092 16833 leader_election.cc:343] T f39dd87ef56a40e2bf56704b2815a619 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:35.151051 16789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eaf179090b14105b52c4701d5599216" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
W20260709 12:27:35.202893 16759 leader_election.cc:343] T a8a632c738e94b26a8352a68a42a0670 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:35.210386 16759 leader_election.cc:304] T a8a632c738e94b26a8352a68a42a0670 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b; no voters: 82f27bcdf252425aad4c4a37d064f68d, 879366e90f5c420588945e0d545017c8
I20260709 12:27:35.208743 16936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7562feb416f84f0b948343356153d8d2" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:35.214044 16938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d614e06fd2c40189161e22ad9217e5d" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:35.216826 16789 raft_consensus.cc:2468] T 8eaf179090b14105b52c4701d5599216 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 0.
I20260709 12:27:35.218391 17408 leader_election.cc:290] T 3d614e06fd2c40189161e22ad9217e5d P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
W20260709 12:27:35.227145 16833 leader_election.cc:343] T 7562feb416f84f0b948343356153d8d2 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:35.226320 17386 raft_consensus.cc:2749] T a8a632c738e94b26a8352a68a42a0670 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:35.232069 16939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d614e06fd2c40189161e22ad9217e5d" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:35.233125 16868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d614e06fd2c40189161e22ad9217e5d" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:35.233786 16868 raft_consensus.cc:2468] T 3d614e06fd2c40189161e22ad9217e5d P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 0.
I20260709 12:27:35.233815 17408 raft_consensus.cc:493] T f29cf6eb18e842c3a5aa62d8fae53279 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:35.234803 17408 raft_consensus.cc:515] T f29cf6eb18e842c3a5aa62d8fae53279 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
W20260709 12:27:35.236743 16833 leader_election.cc:343] T 3d614e06fd2c40189161e22ad9217e5d P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:27:35.248699 16684 leader_election.cc:343] T 3d614e06fd2c40189161e22ad9217e5d P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:35.242858 16615 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45682 (request call id 60) took 1057 ms. Trace:
I20260709 12:27:35.253201 16684 leader_election.cc:304] T 3d614e06fd2c40189161e22ad9217e5d P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8; no voters: 82f27bcdf252425aad4c4a37d064f68d
I20260709 12:27:35.253563 16685 leader_election.cc:304] T 8eaf179090b14105b52c4701d5599216 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8; no voters: 
I20260709 12:27:35.260349 16717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7562feb416f84f0b948343356153d8d2" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8" is_pre_election: true
I20260709 12:27:35.261170 16717 raft_consensus.cc:2468] T 7562feb416f84f0b948343356153d8d2 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 0.
I20260709 12:27:35.262274 16714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d614e06fd2c40189161e22ad9217e5d" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8" is_pre_election: true
I20260709 12:27:35.263019 16714 raft_consensus.cc:2468] T 3d614e06fd2c40189161e22ad9217e5d P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 0.
I20260709 12:27:35.263978 17526 raft_consensus.cc:2804] T 3d614e06fd2c40189161e22ad9217e5d P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:35.264096 17534 raft_consensus.cc:2804] T 8eaf179090b14105b52c4701d5599216 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:35.264598 17526 raft_consensus.cc:493] T 3d614e06fd2c40189161e22ad9217e5d P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:35.264643 17534 raft_consensus.cc:493] T 8eaf179090b14105b52c4701d5599216 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:35.268419 16833 leader_election.cc:304] T 7562feb416f84f0b948343356153d8d2 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8; no voters: 82f27bcdf252425aad4c4a37d064f68d
I20260709 12:27:35.273267 16833 leader_election.cc:304] T 3d614e06fd2c40189161e22ad9217e5d P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8; no voters: 82f27bcdf252425aad4c4a37d064f68d
I20260709 12:27:35.265523 17526 raft_consensus.cc:3060] T 3d614e06fd2c40189161e22ad9217e5d P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:35.283885 17520 raft_consensus.cc:2804] T 3d614e06fd2c40189161e22ad9217e5d P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:35.284430 17520 raft_consensus.cc:493] T 3d614e06fd2c40189161e22ad9217e5d P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:35.284812 17520 raft_consensus.cc:3060] T 3d614e06fd2c40189161e22ad9217e5d P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:35.270013 17534 raft_consensus.cc:3060] T 8eaf179090b14105b52c4701d5599216 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:35.267048 17415 consensus_queue.cc:1048] T a4252af16e15424399c32c789c8e6c23 P 879366e90f5c420588945e0d545017c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 12:27:35.297991 16790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f29cf6eb18e842c3a5aa62d8fae53279" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
I20260709 12:27:35.299368 16790 raft_consensus.cc:2468] T f29cf6eb18e842c3a5aa62d8fae53279 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 1.
I20260709 12:27:35.300817 16834 leader_election.cc:304] T f29cf6eb18e842c3a5aa62d8fae53279 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 3c1aba6ee1d244fd9c0daba722aa0b3b; no voters: 
I20260709 12:27:35.301787 17257 raft_consensus.cc:2804] T f29cf6eb18e842c3a5aa62d8fae53279 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:35.303520 17533 raft_consensus.cc:2804] T 7562feb416f84f0b948343356153d8d2 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:35.297984 17408 leader_election.cc:290] T f29cf6eb18e842c3a5aa62d8fae53279 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629), 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919)
I20260709 12:27:35.249536 16615 rpcz_store.cc:276] 0709 12:27:34.180622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:34.181661 (+  1039us) service_pool.cc:224] Handling call
0709 12:27:35.237584 (+1055923us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:34.425397 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:34.426207 (+   810us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:34.426255 (+    48us) write_op.cc:435] Acquired schema lock
0709 12:27:34.426282 (+    27us) tablet.cc:662] Decoding operations
0709 12:27:34.427099 (+   817us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:34.427242 (+   143us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:34.427292 (+    50us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:27:34.427548 (+   256us) tablet.cc:701] Row locks acquired
0709 12:27:34.471836 (+ 44288us) write_op.cc:260] PREPARE: finished
0709 12:27:34.488959 (+ 17123us) write_op.cc:270] Start()
0709 12:27:34.499065 (+ 10106us) write_op.cc:276] Timestamp: P: 1783600054488869 usec, L: 0
0709 12:27:34.507459 (+  8394us) op_driver.cc:348] REPLICATION: starting
0709 12:27:34.653492 (+146033us) log.cc:844] Serialized 537 byte log entry
0709 12:27:34.972263 (+318771us) op_driver.cc:464] REPLICATION: finished
0709 12:27:35.133230 (+160967us) write_op.cc:301] APPLY: starting
0709 12:27:35.133333 (+   103us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:35.133429 (+    96us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:35.133587 (+   158us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:35.133836 (+   249us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:35.133998 (+   162us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:27:35.134047 (+    49us) write_op.cc:312] APPLY: finished
0709 12:27:35.134239 (+   192us) log.cc:844] Serialized 22 byte log entry
0709 12:27:35.142659 (+  8420us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:35.142762 (+   103us) write_op.cc:454] Released schema lock
0709 12:27:35.142814 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:35.143277 (+   463us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:35.143308 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":81269,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":131860,"apply.run_cpu_time_us":1896,"apply.run_wall_time_us":10011,"num_ops":1,"prepare.queue_time_us":118395,"prepare.run_cpu_time_us":5388,"prepare.run_wall_time_us":240190,"replication_time_us":426202,"thread_start_us":143513,"threads_started":2}]]}
I20260709 12:27:35.304764 16987 tablet_bootstrap.cc:654] T a8a632c738e94b26a8352a68a42a0670 P 879366e90f5c420588945e0d545017c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:35.305074 17257 raft_consensus.cc:493] T f29cf6eb18e842c3a5aa62d8fae53279 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:35.309150 17533 raft_consensus.cc:493] T 7562feb416f84f0b948343356153d8d2 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:35.309360 17257 raft_consensus.cc:3060] T f29cf6eb18e842c3a5aa62d8fae53279 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:35.309701 17533 raft_consensus.cc:3060] T 7562feb416f84f0b948343356153d8d2 P 17294485b7f24e2b9fae71dd3169a336 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:35.312206 16989 tablet_bootstrap.cc:492] T f39dd87ef56a40e2bf56704b2815a619 P 82f27bcdf252425aad4c4a37d064f68d: No bootstrap required, opened a new log
I20260709 12:27:35.312796 16989 ts_tablet_manager.cc:1403] T f39dd87ef56a40e2bf56704b2815a619 P 82f27bcdf252425aad4c4a37d064f68d: Time spent bootstrapping tablet: real 0.230s	user 0.023s	sys 0.012s
I20260709 12:27:35.319097 16939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f29cf6eb18e842c3a5aa62d8fae53279" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:35.319634 16937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eaf179090b14105b52c4701d5599216" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:35.319887 16939 raft_consensus.cc:2468] T f29cf6eb18e842c3a5aa62d8fae53279 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 1.
I20260709 12:27:35.320420 16937 raft_consensus.cc:2468] T 8eaf179090b14105b52c4701d5599216 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 0.
I20260709 12:27:35.319747 16989 raft_consensus.cc:359] T f39dd87ef56a40e2bf56704b2815a619 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:35.324242 16989 raft_consensus.cc:385] T f39dd87ef56a40e2bf56704b2815a619 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:35.324551 16989 raft_consensus.cc:740] T f39dd87ef56a40e2bf56704b2815a619 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f27bcdf252425aad4c4a37d064f68d, State: Initialized, Role: FOLLOWER
I20260709 12:27:35.325838 16989 consensus_queue.cc:260] T f39dd87ef56a40e2bf56704b2815a619 P 82f27bcdf252425aad4c4a37d064f68d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:35.321867 17257 raft_consensus.cc:515] T f29cf6eb18e842c3a5aa62d8fae53279 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:35.331676 16789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f29cf6eb18e842c3a5aa62d8fae53279" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b"
I20260709 12:27:35.332398 16789 raft_consensus.cc:3060] T f29cf6eb18e842c3a5aa62d8fae53279 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:35.334883 16989 ts_tablet_manager.cc:1434] T f39dd87ef56a40e2bf56704b2815a619 P 82f27bcdf252425aad4c4a37d064f68d: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.000s
I20260709 12:27:35.337568 16989 tablet_bootstrap.cc:492] T 3d614e06fd2c40189161e22ad9217e5d P 82f27bcdf252425aad4c4a37d064f68d: Bootstrap starting.
I20260709 12:27:35.346935 17257 leader_election.cc:290] T f29cf6eb18e842c3a5aa62d8fae53279 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 election: Requested vote from peers 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629), 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919)
I20260709 12:27:35.356984 17526 raft_consensus.cc:515] T 3d614e06fd2c40189161e22ad9217e5d P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:35.356330 16789 raft_consensus.cc:2468] T f29cf6eb18e842c3a5aa62d8fae53279 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 2.
I20260709 12:27:35.359405 16834 leader_election.cc:304] T f29cf6eb18e842c3a5aa62d8fae53279 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 3c1aba6ee1d244fd9c0daba722aa0b3b; no voters: 
I20260709 12:27:35.338958 17520 raft_consensus.cc:515] T 3d614e06fd2c40189161e22ad9217e5d P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:35.363197 17257 raft_consensus.cc:2804] T f29cf6eb18e842c3a5aa62d8fae53279 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:35.384413 17533 raft_consensus.cc:515] T 7562feb416f84f0b948343356153d8d2 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:35.392396 17257 raft_consensus.cc:697] T f29cf6eb18e842c3a5aa62d8fae53279 P 17294485b7f24e2b9fae71dd3169a336 [term 2 LEADER]: Becoming Leader. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Running, Role: LEADER
I20260709 12:27:35.355279 17534 raft_consensus.cc:515] T 8eaf179090b14105b52c4701d5599216 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:35.382877 16937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f29cf6eb18e842c3a5aa62d8fae53279" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d"
I20260709 12:27:35.387496 17526 leader_election.cc:290] T 3d614e06fd2c40189161e22ad9217e5d P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 election: Requested vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919)
I20260709 12:27:35.388746 16989 tablet_bootstrap.cc:654] T 3d614e06fd2c40189161e22ad9217e5d P 82f27bcdf252425aad4c4a37d064f68d: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:35.393533 17533 leader_election.cc:290] T 7562feb416f84f0b948343356153d8d2 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 election: Requested vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:35.399992 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eaf179090b14105b52c4701d5599216" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d"
I20260709 12:27:35.401371 16937 raft_consensus.cc:3060] T f29cf6eb18e842c3a5aa62d8fae53279 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:35.407785 16942 raft_consensus.cc:3060] T 8eaf179090b14105b52c4701d5599216 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:35.412106 16714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7562feb416f84f0b948343356153d8d2" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8"
I20260709 12:27:35.412854 16714 raft_consensus.cc:3060] T 7562feb416f84f0b948343356153d8d2 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:35.394755 17534 leader_election.cc:290] T 8eaf179090b14105b52c4701d5599216 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 election: Requested vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:35.405149 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7562feb416f84f0b948343356153d8d2" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d"
I20260709 12:27:35.402463 16864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d614e06fd2c40189161e22ad9217e5d" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336"
I20260709 12:27:35.415604 16864 raft_consensus.cc:2393] T 3d614e06fd2c40189161e22ad9217e5d P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 879366e90f5c420588945e0d545017c8 in current term 1: Already voted for candidate 17294485b7f24e2b9fae71dd3169a336 in this term.
I20260709 12:27:35.401080 16788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eaf179090b14105b52c4701d5599216" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b"
I20260709 12:27:35.417302 16788 raft_consensus.cc:3060] T 8eaf179090b14105b52c4701d5599216 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:35.402127 16939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d614e06fd2c40189161e22ad9217e5d" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d"
W20260709 12:27:35.422665 16684 leader_election.cc:343] T 3d614e06fd2c40189161e22ad9217e5d P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:35.423283 16684 leader_election.cc:304] T 3d614e06fd2c40189161e22ad9217e5d P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 879366e90f5c420588945e0d545017c8; no voters: 17294485b7f24e2b9fae71dd3169a336, 82f27bcdf252425aad4c4a37d064f68d
I20260709 12:27:35.428058 17526 raft_consensus.cc:2749] T 3d614e06fd2c40189161e22ad9217e5d P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 12:27:35.429965 16833 leader_election.cc:343] T 7562feb416f84f0b948343356153d8d2 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:35.431921 16613 catalog_manager.cc:5697] T f39dd87ef56a40e2bf56704b2815a619 P 17294485b7f24e2b9fae71dd3169a336 reported cstate change: term changed from 0 to 1, leader changed from <none> to 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67). New cstate: current_term: 1 leader_uuid: "17294485b7f24e2b9fae71dd3169a336" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:35.438596 16987 tablet_bootstrap.cc:492] T a8a632c738e94b26a8352a68a42a0670 P 879366e90f5c420588945e0d545017c8: No bootstrap required, opened a new log
I20260709 12:27:35.439168 16987 ts_tablet_manager.cc:1403] T a8a632c738e94b26a8352a68a42a0670 P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.286s	user 0.017s	sys 0.002s
W20260709 12:27:35.434903 16665 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:27:35.442499 17520 leader_election.cc:290] T 3d614e06fd2c40189161e22ad9217e5d P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 election: Requested vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:35.393422 17257 consensus_queue.cc:237] T f29cf6eb18e842c3a5aa62d8fae53279 P 17294485b7f24e2b9fae71dd3169a336 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:35.443706 16987 raft_consensus.cc:359] T a8a632c738e94b26a8352a68a42a0670 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:35.444998 16987 raft_consensus.cc:385] T a8a632c738e94b26a8352a68a42a0670 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:35.445449 16987 raft_consensus.cc:740] T a8a632c738e94b26a8352a68a42a0670 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:35.446439 16987 consensus_queue.cc:260] T a8a632c738e94b26a8352a68a42a0670 P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:35.436226 16613 catalog_manager.cc:5697] T a4252af16e15424399c32c789c8e6c23 P 17294485b7f24e2b9fae71dd3169a336 reported cstate change: term changed from 0 to 1, leader changed from <none> to 879366e90f5c420588945e0d545017c8 (127.9.116.65). New cstate: current_term: 1 leader_uuid: "879366e90f5c420588945e0d545017c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } }
I20260709 12:27:35.450707 16939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d614e06fd2c40189161e22ad9217e5d" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d"
I20260709 12:27:35.452950 17535 raft_consensus.cc:493] T a8a632c738e94b26a8352a68a42a0670 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:35.453660 16987 ts_tablet_manager.cc:1434] T a8a632c738e94b26a8352a68a42a0670 P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 12:27:35.453567 17535 raft_consensus.cc:515] T a8a632c738e94b26a8352a68a42a0670 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:35.459625 16714 raft_consensus.cc:2468] T 7562feb416f84f0b948343356153d8d2 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 1.
I20260709 12:27:35.461026 16718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d614e06fd2c40189161e22ad9217e5d" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8"
I20260709 12:27:35.461843 16718 raft_consensus.cc:2393] T 3d614e06fd2c40189161e22ad9217e5d P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 17294485b7f24e2b9fae71dd3169a336 in current term 1: Already voted for candidate 879366e90f5c420588945e0d545017c8 in this term.
I20260709 12:27:35.461395 16937 raft_consensus.cc:2468] T f29cf6eb18e842c3a5aa62d8fae53279 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 2.
W20260709 12:27:35.457739 16833 leader_election.cc:343] T 3d614e06fd2c40189161e22ad9217e5d P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:35.468768 16833 leader_election.cc:304] T 7562feb416f84f0b948343356153d8d2 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8; no voters: 82f27bcdf252425aad4c4a37d064f68d
I20260709 12:27:35.492915 17520 raft_consensus.cc:2804] T 7562feb416f84f0b948343356153d8d2 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:27:35.538587 16833 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37919, user_credentials={real_user=slave}} blocked reactor thread for 53645.6us
I20260709 12:27:35.539686 16833 leader_election.cc:304] T 3d614e06fd2c40189161e22ad9217e5d P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336; no voters: 82f27bcdf252425aad4c4a37d064f68d, 879366e90f5c420588945e0d545017c8
I20260709 12:27:35.544445 16942 raft_consensus.cc:2468] T 8eaf179090b14105b52c4701d5599216 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 1.
I20260709 12:27:35.541501 17520 raft_consensus.cc:697] T 7562feb416f84f0b948343356153d8d2 P 17294485b7f24e2b9fae71dd3169a336 [term 1 LEADER]: Becoming Leader. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Running, Role: LEADER
I20260709 12:27:35.551752 17533 raft_consensus.cc:2749] T 3d614e06fd2c40189161e22ad9217e5d P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:27:35.552421 17520 consensus_queue.cc:237] T 7562feb416f84f0b948343356153d8d2 P 17294485b7f24e2b9fae71dd3169a336 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:35.570457 16684 leader_election.cc:304] T 8eaf179090b14105b52c4701d5599216 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d, 879366e90f5c420588945e0d545017c8; no voters: 
I20260709 12:27:35.559989 17535 leader_election.cc:290] T a8a632c738e94b26a8352a68a42a0670 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:35.592212 17397 raft_consensus.cc:2804] T 8eaf179090b14105b52c4701d5599216 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:35.643823 16989 tablet_bootstrap.cc:492] T 3d614e06fd2c40189161e22ad9217e5d P 82f27bcdf252425aad4c4a37d064f68d: No bootstrap required, opened a new log
I20260709 12:27:35.644948 16989 ts_tablet_manager.cc:1403] T 3d614e06fd2c40189161e22ad9217e5d P 82f27bcdf252425aad4c4a37d064f68d: Time spent bootstrapping tablet: real 0.308s	user 0.010s	sys 0.015s
I20260709 12:27:35.661089 17397 raft_consensus.cc:697] T 8eaf179090b14105b52c4701d5599216 P 879366e90f5c420588945e0d545017c8 [term 1 LEADER]: Becoming Leader. State: Replica: 879366e90f5c420588945e0d545017c8, State: Running, Role: LEADER
I20260709 12:27:35.662333 17397 consensus_queue.cc:237] T 8eaf179090b14105b52c4701d5599216 P 879366e90f5c420588945e0d545017c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:35.667550 16989 raft_consensus.cc:359] T 3d614e06fd2c40189161e22ad9217e5d P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:35.693642 16989 raft_consensus.cc:385] T 3d614e06fd2c40189161e22ad9217e5d P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:35.694000 16989 raft_consensus.cc:740] T 3d614e06fd2c40189161e22ad9217e5d P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f27bcdf252425aad4c4a37d064f68d, State: Initialized, Role: FOLLOWER
I20260709 12:27:35.695081 16989 consensus_queue.cc:260] T 3d614e06fd2c40189161e22ad9217e5d P 82f27bcdf252425aad4c4a37d064f68d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
W20260709 12:27:35.736804 16759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:38103, user_credentials={real_user=slave}} blocked reactor thread for 80553.4us
I20260709 12:27:35.713048 16788 raft_consensus.cc:2468] T 8eaf179090b14105b52c4701d5599216 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 1.
I20260709 12:27:35.740720 16939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8a632c738e94b26a8352a68a42a0670" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:35.736624 16792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8a632c738e94b26a8352a68a42a0670" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
I20260709 12:27:35.751236 16792 raft_consensus.cc:2468] T a8a632c738e94b26a8352a68a42a0670 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 0.
W20260709 12:27:35.756749 16907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:38103, user_credentials={real_user=slave}} blocked reactor thread for 90850.1us
I20260709 12:27:35.749269 17450 raft_consensus.cc:493] T f39dd87ef56a40e2bf56704b2815a619 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:35.754467 17480 raft_consensus.cc:493] T cfc80a8e57c24a768ebc48dd544a6c80 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 82f27bcdf252425aad4c4a37d064f68d)
I20260709 12:27:35.779925 17450 raft_consensus.cc:515] T f39dd87ef56a40e2bf56704b2815a619 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
W20260709 12:27:35.795632 17550 log.cc:927] Time spent T a4252af16e15424399c32c789c8e6c23 P 3c1aba6ee1d244fd9c0daba722aa0b3b: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:27:35.816951 16989 ts_tablet_manager.cc:1434] T 3d614e06fd2c40189161e22ad9217e5d P 82f27bcdf252425aad4c4a37d064f68d: Time spent starting tablet: real 0.172s	user 0.021s	sys 0.016s
I20260709 12:27:35.819428 16685 leader_election.cc:304] T a8a632c738e94b26a8352a68a42a0670 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8; no voters: 
I20260709 12:27:35.849439 16942 raft_consensus.cc:3060] T f39dd87ef56a40e2bf56704b2815a619 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:35.851115 16989 tablet_bootstrap.cc:492] T 7562feb416f84f0b948343356153d8d2 P 82f27bcdf252425aad4c4a37d064f68d: Bootstrap starting.
I20260709 12:27:35.813191 17450 leader_election.cc:290] T f39dd87ef56a40e2bf56704b2815a619 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
I20260709 12:27:35.869379 16863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f39dd87ef56a40e2bf56704b2815a619" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:35.848114 17527 raft_consensus.cc:2804] T a8a632c738e94b26a8352a68a42a0670 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:35.872597 17527 raft_consensus.cc:493] T a8a632c738e94b26a8352a68a42a0670 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:35.873118 17527 raft_consensus.cc:3060] T a8a632c738e94b26a8352a68a42a0670 P 879366e90f5c420588945e0d545017c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:35.806375 17480 raft_consensus.cc:515] T cfc80a8e57c24a768ebc48dd544a6c80 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:35.877359 16792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc80a8e57c24a768ebc48dd544a6c80" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
I20260709 12:27:35.880141 16793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f39dd87ef56a40e2bf56704b2815a619" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
W20260709 12:27:35.883526 16684 leader_election.cc:343] T a8a632c738e94b26a8352a68a42a0670 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:35.883879 16793 raft_consensus.cc:2393] T f39dd87ef56a40e2bf56704b2815a619 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 82f27bcdf252425aad4c4a37d064f68d in current term 1: Already voted for candidate 17294485b7f24e2b9fae71dd3169a336 in this term.
I20260709 12:27:35.894106 16908 leader_election.cc:304] T f39dd87ef56a40e2bf56704b2815a619 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 17294485b7f24e2b9fae71dd3169a336, 3c1aba6ee1d244fd9c0daba722aa0b3b
I20260709 12:27:35.899109 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc80a8e57c24a768ebc48dd544a6c80" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
W20260709 12:27:35.911114 16759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:39833, user_credentials={real_user=slave}} blocked reactor thread for 43834.9us
I20260709 12:27:35.911960 16833 leader_election.cc:304] T cfc80a8e57c24a768ebc48dd544a6c80 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 82f27bcdf252425aad4c4a37d064f68d
I20260709 12:27:35.888237 17480 leader_election.cc:290] T cfc80a8e57c24a768ebc48dd544a6c80 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629), 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919)
I20260709 12:27:35.918473 17389 raft_consensus.cc:2749] T cfc80a8e57c24a768ebc48dd544a6c80 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:35.908645 17566 consensus_queue.cc:1048] T f39dd87ef56a40e2bf56704b2815a619 P 17294485b7f24e2b9fae71dd3169a336 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20260709 12:27:35.967526 17497 raft_consensus.cc:2749] T f39dd87ef56a40e2bf56704b2815a619 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:35.983328 17557 raft_consensus.cc:493] T 3d614e06fd2c40189161e22ad9217e5d P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:35.984052 17557 raft_consensus.cc:515] T 3d614e06fd2c40189161e22ad9217e5d P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:35.987082 17516 consensus_queue.cc:1048] T f39dd87ef56a40e2bf56704b2815a619 P 17294485b7f24e2b9fae71dd3169a336 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:35.988824 17557 leader_election.cc:290] T 3d614e06fd2c40189161e22ad9217e5d P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:36.005882 16868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d614e06fd2c40189161e22ad9217e5d" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:36.006723 16714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d614e06fd2c40189161e22ad9217e5d" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8" is_pre_election: true
I20260709 12:27:36.007041 16868 raft_consensus.cc:2393] T 3d614e06fd2c40189161e22ad9217e5d P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 82f27bcdf252425aad4c4a37d064f68d in current term 1: Already voted for candidate 17294485b7f24e2b9fae71dd3169a336 in this term.
I20260709 12:27:36.016222 16989 tablet_bootstrap.cc:654] T 7562feb416f84f0b948343356153d8d2 P 82f27bcdf252425aad4c4a37d064f68d: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:36.021330 16714 raft_consensus.cc:2393] T 3d614e06fd2c40189161e22ad9217e5d P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 82f27bcdf252425aad4c4a37d064f68d in current term 1: Already voted for candidate 879366e90f5c420588945e0d545017c8 in this term.
I20260709 12:27:36.026677 17527 raft_consensus.cc:515] T a8a632c738e94b26a8352a68a42a0670 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:36.032871 17527 leader_election.cc:290] T a8a632c738e94b26a8352a68a42a0670 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 election: Requested vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:36.036821 16907 leader_election.cc:304] T 3d614e06fd2c40189161e22ad9217e5d P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8
I20260709 12:27:36.038655 16933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8a632c738e94b26a8352a68a42a0670" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d"
I20260709 12:27:36.038918 17559 raft_consensus.cc:3060] T 3d614e06fd2c40189161e22ad9217e5d P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:36.048444 17559 raft_consensus.cc:2749] T 3d614e06fd2c40189161e22ad9217e5d P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:36.048928 16789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8a632c738e94b26a8352a68a42a0670" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b"
I20260709 12:27:36.050034 16789 raft_consensus.cc:3060] T a8a632c738e94b26a8352a68a42a0670 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:36.049013 17521 consensus_queue.cc:1048] T 7562feb416f84f0b948343356153d8d2 P 17294485b7f24e2b9fae71dd3169a336 [LEADER]: Connected to new peer: Peer: permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:27:36.060920 16793 raft_consensus.cc:1275] T f29cf6eb18e842c3a5aa62d8fae53279 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Refusing update from remote peer 17294485b7f24e2b9fae71dd3169a336: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:27:36.062992 17533 consensus_queue.cc:1048] T f29cf6eb18e842c3a5aa62d8fae53279 P 17294485b7f24e2b9fae71dd3169a336 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:27:36.058535 16684 leader_election.cc:343] T a8a632c738e94b26a8352a68a42a0670 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:36.097508 16789 raft_consensus.cc:2468] T a8a632c738e94b26a8352a68a42a0670 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 1.
I20260709 12:27:36.108510 16685 leader_election.cc:304] T a8a632c738e94b26a8352a68a42a0670 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8; no voters: 82f27bcdf252425aad4c4a37d064f68d
I20260709 12:27:36.111121 17486 raft_consensus.cc:2804] T a8a632c738e94b26a8352a68a42a0670 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:36.111878 17486 raft_consensus.cc:697] T a8a632c738e94b26a8352a68a42a0670 P 879366e90f5c420588945e0d545017c8 [term 1 LEADER]: Becoming Leader. State: Replica: 879366e90f5c420588945e0d545017c8, State: Running, Role: LEADER
I20260709 12:27:36.112749 17486 consensus_queue.cc:237] T a8a632c738e94b26a8352a68a42a0670 P 879366e90f5c420588945e0d545017c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:36.132359 16989 tablet_bootstrap.cc:492] T 7562feb416f84f0b948343356153d8d2 P 82f27bcdf252425aad4c4a37d064f68d: No bootstrap required, opened a new log
I20260709 12:27:36.133080 16989 ts_tablet_manager.cc:1403] T 7562feb416f84f0b948343356153d8d2 P 82f27bcdf252425aad4c4a37d064f68d: Time spent bootstrapping tablet: real 0.283s	user 0.014s	sys 0.008s
I20260709 12:27:36.152220 16989 raft_consensus.cc:359] T 7562feb416f84f0b948343356153d8d2 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:36.152998 16989 raft_consensus.cc:385] T 7562feb416f84f0b948343356153d8d2 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:36.153293 16989 raft_consensus.cc:740] T 7562feb416f84f0b948343356153d8d2 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f27bcdf252425aad4c4a37d064f68d, State: Initialized, Role: FOLLOWER
I20260709 12:27:36.157500 16989 consensus_queue.cc:260] T 7562feb416f84f0b948343356153d8d2 P 82f27bcdf252425aad4c4a37d064f68d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:36.196025 16989 ts_tablet_manager.cc:1434] T 7562feb416f84f0b948343356153d8d2 P 82f27bcdf252425aad4c4a37d064f68d: Time spent starting tablet: real 0.063s	user 0.008s	sys 0.001s
I20260709 12:27:36.197649 16989 tablet_bootstrap.cc:492] T a8a632c738e94b26a8352a68a42a0670 P 82f27bcdf252425aad4c4a37d064f68d: Bootstrap starting.
I20260709 12:27:36.207957 16989 tablet_bootstrap.cc:654] T a8a632c738e94b26a8352a68a42a0670 P 82f27bcdf252425aad4c4a37d064f68d: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:36.221226 16933 raft_consensus.cc:1275] T f29cf6eb18e842c3a5aa62d8fae53279 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Refusing update from remote peer 17294485b7f24e2b9fae71dd3169a336: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:27:36.230854 16938 raft_consensus.cc:3060] T 7562feb416f84f0b948343356153d8d2 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:36.260051 17480 consensus_queue.cc:1048] T f29cf6eb18e842c3a5aa62d8fae53279 P 17294485b7f24e2b9fae71dd3169a336 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.035s
W20260709 12:27:36.316097 16684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:38103, user_credentials={real_user=slave}} blocked reactor thread for 45756.1us
I20260709 12:27:36.352905 17536 consensus_queue.cc:1048] T 8eaf179090b14105b52c4701d5599216 P 879366e90f5c420588945e0d545017c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:36.395959 17490 consensus_queue.cc:1048] T 7562feb416f84f0b948343356153d8d2 P 17294485b7f24e2b9fae71dd3169a336 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:36.408277 16989 tablet_bootstrap.cc:492] T a8a632c738e94b26a8352a68a42a0670 P 82f27bcdf252425aad4c4a37d064f68d: No bootstrap required, opened a new log
I20260709 12:27:36.409374 16989 ts_tablet_manager.cc:1403] T a8a632c738e94b26a8352a68a42a0670 P 82f27bcdf252425aad4c4a37d064f68d: Time spent bootstrapping tablet: real 0.212s	user 0.021s	sys 0.058s
I20260709 12:27:36.414383 16989 raft_consensus.cc:359] T a8a632c738e94b26a8352a68a42a0670 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:36.418408 16989 raft_consensus.cc:385] T a8a632c738e94b26a8352a68a42a0670 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:36.418741 16989 raft_consensus.cc:740] T a8a632c738e94b26a8352a68a42a0670 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f27bcdf252425aad4c4a37d064f68d, State: Initialized, Role: FOLLOWER
I20260709 12:27:36.419512 16989 consensus_queue.cc:260] T a8a632c738e94b26a8352a68a42a0670 P 82f27bcdf252425aad4c4a37d064f68d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:36.493274 17528 consensus_queue.cc:1048] T 8eaf179090b14105b52c4701d5599216 P 879366e90f5c420588945e0d545017c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:36.504055 16989 ts_tablet_manager.cc:1434] T a8a632c738e94b26a8352a68a42a0670 P 82f27bcdf252425aad4c4a37d064f68d: Time spent starting tablet: real 0.094s	user 0.005s	sys 0.006s
I20260709 12:27:36.509156 16615 catalog_manager.cc:5697] T f29cf6eb18e842c3a5aa62d8fae53279 P 3c1aba6ee1d244fd9c0daba722aa0b3b reported cstate change: term changed from 0 to 2, leader changed from <none> to 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67). New cstate: current_term: 2 leader_uuid: "17294485b7f24e2b9fae71dd3169a336" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } }
W20260709 12:27:36.549325 17588 log.cc:927] Time spent T 8eaf179090b14105b52c4701d5599216 P 82f27bcdf252425aad4c4a37d064f68d: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 12:27:36.527197 17528 consensus_queue.cc:1048] T a8a632c738e94b26a8352a68a42a0670 P 879366e90f5c420588945e0d545017c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.034s
I20260709 12:27:36.621634 17492 raft_consensus.cc:493] T a8a632c738e94b26a8352a68a42a0670 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:36.621636 16665 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:27:36.622323 17492 raft_consensus.cc:515] T a8a632c738e94b26a8352a68a42a0670 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:36.628706 17492 leader_election.cc:290] T a8a632c738e94b26a8352a68a42a0670 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:36.635681 16788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8a632c738e94b26a8352a68a42a0670" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
I20260709 12:27:36.640033 16716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8a632c738e94b26a8352a68a42a0670" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8" is_pre_election: true
I20260709 12:27:36.654203 16907 leader_election.cc:304] T a8a632c738e94b26a8352a68a42a0670 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8
I20260709 12:27:36.655140 17492 raft_consensus.cc:2749] T a8a632c738e94b26a8352a68a42a0670 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:36.682776 16933 raft_consensus.cc:3060] T a8a632c738e94b26a8352a68a42a0670 P 82f27bcdf252425aad4c4a37d064f68d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:36.692651 16614 catalog_manager.cc:5697] T 7562feb416f84f0b948343356153d8d2 P 17294485b7f24e2b9fae71dd3169a336 reported cstate change: term changed from 0 to 1, leader changed from <none> to 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67). New cstate: current_term: 1 leader_uuid: "17294485b7f24e2b9fae71dd3169a336" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:36.701723 17527 consensus_queue.cc:1048] T a8a632c738e94b26a8352a68a42a0670 P 879366e90f5c420588945e0d545017c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:36.732268 16613 catalog_manager.cc:5697] T 8eaf179090b14105b52c4701d5599216 P 82f27bcdf252425aad4c4a37d064f68d reported cstate change: term changed from 0 to 1, leader changed from <none> to 879366e90f5c420588945e0d545017c8 (127.9.116.65). New cstate: current_term: 1 leader_uuid: "879366e90f5c420588945e0d545017c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } }
W20260709 12:27:36.742100 16759 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.9.116.126:46577, user_credentials={real_user=slave}} blocked reactor thread for 49114.2us
I20260709 12:27:36.754472 16616 catalog_manager.cc:5697] T a8a632c738e94b26a8352a68a42a0670 P 879366e90f5c420588945e0d545017c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 879366e90f5c420588945e0d545017c8 (127.9.116.65). New cstate: current_term: 1 leader_uuid: "879366e90f5c420588945e0d545017c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:37.016764 17535 raft_consensus.cc:493] T 3d614e06fd2c40189161e22ad9217e5d P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:37.017411 17535 raft_consensus.cc:515] T 3d614e06fd2c40189161e22ad9217e5d P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:37.020581 17535 leader_election.cc:290] T 3d614e06fd2c40189161e22ad9217e5d P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919)
I20260709 12:27:37.026587 16863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d614e06fd2c40189161e22ad9217e5d" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:37.027456 16863 raft_consensus.cc:2468] T 3d614e06fd2c40189161e22ad9217e5d P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 1.
I20260709 12:27:37.028887 16935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d614e06fd2c40189161e22ad9217e5d" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:37.029644 16935 raft_consensus.cc:2468] T 3d614e06fd2c40189161e22ad9217e5d P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 1.
I20260709 12:27:37.030061 16684 leader_election.cc:304] T 3d614e06fd2c40189161e22ad9217e5d P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8; no voters: 
I20260709 12:27:37.030813 17536 raft_consensus.cc:2804] T 3d614e06fd2c40189161e22ad9217e5d P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:37.031203 17536 raft_consensus.cc:493] T 3d614e06fd2c40189161e22ad9217e5d P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:37.031546 17536 raft_consensus.cc:3060] T 3d614e06fd2c40189161e22ad9217e5d P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:37.037923 17536 raft_consensus.cc:515] T 3d614e06fd2c40189161e22ad9217e5d P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:37.039847 17536 leader_election.cc:290] T 3d614e06fd2c40189161e22ad9217e5d P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 2 election: Requested vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919)
I20260709 12:27:37.040719 16863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d614e06fd2c40189161e22ad9217e5d" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336"
I20260709 12:27:37.041131 16935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d614e06fd2c40189161e22ad9217e5d" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d"
I20260709 12:27:37.041664 16863 raft_consensus.cc:3060] T 3d614e06fd2c40189161e22ad9217e5d P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:37.041759 16935 raft_consensus.cc:3060] T 3d614e06fd2c40189161e22ad9217e5d P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:37.048271 16863 raft_consensus.cc:2468] T 3d614e06fd2c40189161e22ad9217e5d P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 2.
I20260709 12:27:37.049433 16684 leader_election.cc:304] T 3d614e06fd2c40189161e22ad9217e5d P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8; no voters: 
I20260709 12:27:37.049640 16935 raft_consensus.cc:2468] T 3d614e06fd2c40189161e22ad9217e5d P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 2.
I20260709 12:27:37.050141 17536 raft_consensus.cc:2804] T 3d614e06fd2c40189161e22ad9217e5d P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:37.050737 17536 raft_consensus.cc:697] T 3d614e06fd2c40189161e22ad9217e5d P 879366e90f5c420588945e0d545017c8 [term 2 LEADER]: Becoming Leader. State: Replica: 879366e90f5c420588945e0d545017c8, State: Running, Role: LEADER
I20260709 12:27:37.051867 17536 consensus_queue.cc:237] T 3d614e06fd2c40189161e22ad9217e5d P 879366e90f5c420588945e0d545017c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:37.063077 16613 catalog_manager.cc:5697] T 3d614e06fd2c40189161e22ad9217e5d P 879366e90f5c420588945e0d545017c8 reported cstate change: term changed from 0 to 2, leader changed from <none> to 879366e90f5c420588945e0d545017c8 (127.9.116.65). New cstate: current_term: 2 leader_uuid: "879366e90f5c420588945e0d545017c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:37.602125 16935 raft_consensus.cc:1275] T 3d614e06fd2c40189161e22ad9217e5d P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Refusing update from remote peer 879366e90f5c420588945e0d545017c8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:27:37.605746 17535 consensus_queue.cc:1048] T 3d614e06fd2c40189161e22ad9217e5d P 879366e90f5c420588945e0d545017c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:37.631349 16863 raft_consensus.cc:1275] T 3d614e06fd2c40189161e22ad9217e5d P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Refusing update from remote peer 879366e90f5c420588945e0d545017c8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:27:37.636984 17536 consensus_queue.cc:1048] T 3d614e06fd2c40189161e22ad9217e5d P 879366e90f5c420588945e0d545017c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:37.825371  9681 tablet_server.cc:179] TabletServer@127.9.116.65:0 shutting down...
W20260709 12:27:37.830300 16759 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 67 similar messages]
W20260709 12:27:37.838263 16759 consensus_peers.cc:597] T d6811cd94dfd44149e1329e919d82f0f P 3c1aba6ee1d244fd9c0daba722aa0b3b -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:37.853636 16833 consensus_peers.cc:597] T 3e78004b8cc14ac6b93c857cbdd63329 P 17294485b7f24e2b9fae71dd3169a336 -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:37.884047  9681 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:37.885279  9681 tablet_replica.cc:333] T a8a632c738e94b26a8352a68a42a0670 P 879366e90f5c420588945e0d545017c8: stopping tablet replica
I20260709 12:27:37.886350  9681 raft_consensus.cc:2243] T a8a632c738e94b26a8352a68a42a0670 P 879366e90f5c420588945e0d545017c8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:37.887413  9681 raft_consensus.cc:2272] T a8a632c738e94b26a8352a68a42a0670 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:37.889513  9681 tablet_replica.cc:333] T a4252af16e15424399c32c789c8e6c23 P 879366e90f5c420588945e0d545017c8: stopping tablet replica
I20260709 12:27:37.890345  9681 raft_consensus.cc:2243] T a4252af16e15424399c32c789c8e6c23 P 879366e90f5c420588945e0d545017c8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:37.891088  9681 raft_consensus.cc:2272] T a4252af16e15424399c32c789c8e6c23 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:37.893420  9681 tablet_replica.cc:333] T 6a86fc21ef0044bb91dd271c9a019336 P 879366e90f5c420588945e0d545017c8: stopping tablet replica
I20260709 12:27:37.894279  9681 raft_consensus.cc:2243] T 6a86fc21ef0044bb91dd271c9a019336 P 879366e90f5c420588945e0d545017c8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:37.895275  9681 raft_consensus.cc:2272] T 6a86fc21ef0044bb91dd271c9a019336 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:37.897974  9681 tablet_replica.cc:333] T 3e78004b8cc14ac6b93c857cbdd63329 P 879366e90f5c420588945e0d545017c8: stopping tablet replica
I20260709 12:27:37.898744  9681 raft_consensus.cc:2243] T 3e78004b8cc14ac6b93c857cbdd63329 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:37.899260  9681 raft_consensus.cc:2272] T 3e78004b8cc14ac6b93c857cbdd63329 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:37.902029  9681 tablet_replica.cc:333] T 51ebab30b5104589803b75a1b48c5aa2 P 879366e90f5c420588945e0d545017c8: stopping tablet replica
I20260709 12:27:37.902979  9681 raft_consensus.cc:2243] T 51ebab30b5104589803b75a1b48c5aa2 P 879366e90f5c420588945e0d545017c8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:37.904064  9681 raft_consensus.cc:2272] T 51ebab30b5104589803b75a1b48c5aa2 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:37.907002  9681 tablet_replica.cc:333] T 8eaf179090b14105b52c4701d5599216 P 879366e90f5c420588945e0d545017c8: stopping tablet replica
I20260709 12:27:37.907802  9681 raft_consensus.cc:2243] T 8eaf179090b14105b52c4701d5599216 P 879366e90f5c420588945e0d545017c8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:37.908828  9681 raft_consensus.cc:2272] T 8eaf179090b14105b52c4701d5599216 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:37.910115 16907 consensus_peers.cc:597] T fbafe39b79894737b395f95013bc6c86 P 82f27bcdf252425aad4c4a37d064f68d -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:37.910818  9681 tablet_replica.cc:333] T 5f88e29c7ffd4b3b856561ee240cdd43 P 879366e90f5c420588945e0d545017c8: stopping tablet replica
I20260709 12:27:37.912290  9681 raft_consensus.cc:2243] T 5f88e29c7ffd4b3b856561ee240cdd43 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:37.913204  9681 raft_consensus.cc:2272] T 5f88e29c7ffd4b3b856561ee240cdd43 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:37.915858 16833 consensus_peers.cc:597] T 3649e7bb023a4958a01ad5ecbe446f0f P 17294485b7f24e2b9fae71dd3169a336 -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:37.916482  9681 tablet_replica.cc:333] T 7562feb416f84f0b948343356153d8d2 P 879366e90f5c420588945e0d545017c8: stopping tablet replica
I20260709 12:27:37.917520  9681 raft_consensus.cc:2243] T 7562feb416f84f0b948343356153d8d2 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:37.918085  9681 raft_consensus.cc:2272] T 7562feb416f84f0b948343356153d8d2 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:37.921347  9681 tablet_replica.cc:333] T 442e0dfc272840f7a14c2232ed65425c P 879366e90f5c420588945e0d545017c8: stopping tablet replica
W20260709 12:27:37.921603 16833 consensus_peers.cc:597] T fe16827e0b4a45baa99739174f92a0f7 P 17294485b7f24e2b9fae71dd3169a336 -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:37.922235  9681 raft_consensus.cc:2243] T 442e0dfc272840f7a14c2232ed65425c P 879366e90f5c420588945e0d545017c8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:37.923507  9681 raft_consensus.cc:2272] T 442e0dfc272840f7a14c2232ed65425c P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:37.926447  9681 tablet_replica.cc:333] T 62e4e875fd4e4604952120df324e99cb P 879366e90f5c420588945e0d545017c8: stopping tablet replica
I20260709 12:27:37.927235  9681 raft_consensus.cc:2243] T 62e4e875fd4e4604952120df324e99cb P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:37.927832  9681 raft_consensus.cc:2272] T 62e4e875fd4e4604952120df324e99cb P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:37.930526  9681 tablet_replica.cc:333] T 3649e7bb023a4958a01ad5ecbe446f0f P 879366e90f5c420588945e0d545017c8: stopping tablet replica
I20260709 12:27:37.931384  9681 raft_consensus.cc:2243] T 3649e7bb023a4958a01ad5ecbe446f0f P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:37.932044  9681 raft_consensus.cc:2272] T 3649e7bb023a4958a01ad5ecbe446f0f P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:37.936226  9681 tablet_replica.cc:333] T 3d614e06fd2c40189161e22ad9217e5d P 879366e90f5c420588945e0d545017c8: stopping tablet replica
I20260709 12:27:37.937178  9681 raft_consensus.cc:2243] T 3d614e06fd2c40189161e22ad9217e5d P 879366e90f5c420588945e0d545017c8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:37.938169  9681 raft_consensus.cc:2272] T 3d614e06fd2c40189161e22ad9217e5d P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:37.942504  9681 tablet_replica.cc:333] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 879366e90f5c420588945e0d545017c8: stopping tablet replica
I20260709 12:27:37.943446  9681 raft_consensus.cc:2243] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 879366e90f5c420588945e0d545017c8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:37.944434  9681 raft_consensus.cc:2272] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:37.946887  9681 tablet_replica.cc:333] T e477f70d4c8d466e9d45e6645e2a2869 P 879366e90f5c420588945e0d545017c8: stopping tablet replica
I20260709 12:27:37.947731  9681 raft_consensus.cc:2243] T e477f70d4c8d466e9d45e6645e2a2869 P 879366e90f5c420588945e0d545017c8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:37.948680  9681 raft_consensus.cc:2272] T e477f70d4c8d466e9d45e6645e2a2869 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:37.950740  9681 tablet_replica.cc:333] T 6e89df746e0c49d184637314ce87045a P 879366e90f5c420588945e0d545017c8: stopping tablet replica
I20260709 12:27:37.951406  9681 raft_consensus.cc:2243] T 6e89df746e0c49d184637314ce87045a P 879366e90f5c420588945e0d545017c8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:37.952570  9681 raft_consensus.cc:2272] T 6e89df746e0c49d184637314ce87045a P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:37.955529  9681 tablet_replica.cc:333] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 879366e90f5c420588945e0d545017c8: stopping tablet replica
I20260709 12:27:37.956508  9681 raft_consensus.cc:2243] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 879366e90f5c420588945e0d545017c8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:37.957533  9681 raft_consensus.cc:2272] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:37.959867  9681 tablet_replica.cc:333] T 27dda31a8cd1468eb3a824ae026485a3 P 879366e90f5c420588945e0d545017c8: stopping tablet replica
I20260709 12:27:37.960551  9681 raft_consensus.cc:2243] T 27dda31a8cd1468eb3a824ae026485a3 P 879366e90f5c420588945e0d545017c8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:37.961596  9681 raft_consensus.cc:2272] T 27dda31a8cd1468eb3a824ae026485a3 P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:37.964190  9681 tablet_replica.cc:333] T b777ccb9937a476590a534fea0428c5c P 879366e90f5c420588945e0d545017c8: stopping tablet replica
I20260709 12:27:37.964865  9681 raft_consensus.cc:2243] T b777ccb9937a476590a534fea0428c5c P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:37.965323  9681 raft_consensus.cc:2272] T b777ccb9937a476590a534fea0428c5c P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:37.967314  9681 tablet_replica.cc:333] T 28c655b68dc545948c67e0977b49e770 P 879366e90f5c420588945e0d545017c8: stopping tablet replica
I20260709 12:27:37.968144  9681 raft_consensus.cc:2243] T 28c655b68dc545948c67e0977b49e770 P 879366e90f5c420588945e0d545017c8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:37.969161  9681 raft_consensus.cc:2272] T 28c655b68dc545948c67e0977b49e770 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:37.972100  9681 tablet_replica.cc:333] T 5025c37302bd4a2aa076878e1af90366 P 879366e90f5c420588945e0d545017c8: stopping tablet replica
I20260709 12:27:37.973071  9681 raft_consensus.cc:2243] T 5025c37302bd4a2aa076878e1af90366 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:37.973783  9681 raft_consensus.cc:2272] T 5025c37302bd4a2aa076878e1af90366 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:37.977329  9681 tablet_replica.cc:333] T ce37f3e8575c4b8e88935db231644a27 P 879366e90f5c420588945e0d545017c8: stopping tablet replica
I20260709 12:27:37.978060  9681 raft_consensus.cc:2243] T ce37f3e8575c4b8e88935db231644a27 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:37.978637  9681 raft_consensus.cc:2272] T ce37f3e8575c4b8e88935db231644a27 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:37.981173  9681 tablet_replica.cc:333] T 223b3745452c412581caf058f6b81fe2 P 879366e90f5c420588945e0d545017c8: stopping tablet replica
I20260709 12:27:37.981894  9681 raft_consensus.cc:2243] T 223b3745452c412581caf058f6b81fe2 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:37.982470  9681 raft_consensus.cc:2272] T 223b3745452c412581caf058f6b81fe2 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:37.985034  9681 tablet_replica.cc:333] T 2f737ece325c44c58194725a82923014 P 879366e90f5c420588945e0d545017c8: stopping tablet replica
I20260709 12:27:37.985730  9681 raft_consensus.cc:2243] T 2f737ece325c44c58194725a82923014 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:37.986289  9681 raft_consensus.cc:2272] T 2f737ece325c44c58194725a82923014 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:37.989301  9681 tablet_replica.cc:333] T b10d5b4017584d0fb22f9e542d95fcb1 P 879366e90f5c420588945e0d545017c8: stopping tablet replica
I20260709 12:27:37.990105  9681 raft_consensus.cc:2243] T b10d5b4017584d0fb22f9e542d95fcb1 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:37.990711  9681 raft_consensus.cc:2272] T b10d5b4017584d0fb22f9e542d95fcb1 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:37.993314 16759 consensus_peers.cc:597] T 62e4e875fd4e4604952120df324e99cb P 3c1aba6ee1d244fd9c0daba722aa0b3b -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:37.994019  9681 tablet_replica.cc:333] T 27f104a1ba60493ab47f6b876da48d67 P 879366e90f5c420588945e0d545017c8: stopping tablet replica
I20260709 12:27:37.995193  9681 raft_consensus.cc:2243] T 27f104a1ba60493ab47f6b876da48d67 P 879366e90f5c420588945e0d545017c8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:37.996335  9681 raft_consensus.cc:2272] T 27f104a1ba60493ab47f6b876da48d67 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:37.999311  9681 tablet_replica.cc:333] T e628dacc30694988a7c795441df15600 P 879366e90f5c420588945e0d545017c8: stopping tablet replica
I20260709 12:27:38.000041  9681 raft_consensus.cc:2243] T e628dacc30694988a7c795441df15600 P 879366e90f5c420588945e0d545017c8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:38.001127  9681 raft_consensus.cc:2272] T e628dacc30694988a7c795441df15600 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:38.003827  9681 tablet_replica.cc:333] T fe16827e0b4a45baa99739174f92a0f7 P 879366e90f5c420588945e0d545017c8: stopping tablet replica
I20260709 12:27:38.004884  9681 raft_consensus.cc:2243] T fe16827e0b4a45baa99739174f92a0f7 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:38.005476  9681 raft_consensus.cc:2272] T fe16827e0b4a45baa99739174f92a0f7 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:38.008605 16759 consensus_peers.cc:597] T a0409dc146674a39a9ceeeeebc081453 P 3c1aba6ee1d244fd9c0daba722aa0b3b -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:38.008895  9681 tablet_replica.cc:333] T c5baa0b4140847958c6528b3dbda7617 P 879366e90f5c420588945e0d545017c8: stopping tablet replica
I20260709 12:27:38.009855  9681 raft_consensus.cc:2243] T c5baa0b4140847958c6528b3dbda7617 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:38.010490  9681 raft_consensus.cc:2272] T c5baa0b4140847958c6528b3dbda7617 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:38.013509  9681 tablet_replica.cc:333] T 00e5268529b241f184c460704ab9ed3c P 879366e90f5c420588945e0d545017c8: stopping tablet replica
I20260709 12:27:38.014642  9681 raft_consensus.cc:2243] T 00e5268529b241f184c460704ab9ed3c P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:27:38.014870 16907 consensus_peers.cc:597] T b777ccb9937a476590a534fea0428c5c P 82f27bcdf252425aad4c4a37d064f68d -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:38.015226  9681 raft_consensus.cc:2272] T 00e5268529b241f184c460704ab9ed3c P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:38.017407 16759 consensus_peers.cc:597] T 2f737ece325c44c58194725a82923014 P 3c1aba6ee1d244fd9c0daba722aa0b3b -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:38.017992  9681 tablet_replica.cc:333] T ea5085716661498e9f3bfdfa2fc5737a P 879366e90f5c420588945e0d545017c8: stopping tablet replica
I20260709 12:27:38.019079  9681 raft_consensus.cc:2243] T ea5085716661498e9f3bfdfa2fc5737a P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:38.019671  9681 raft_consensus.cc:2272] T ea5085716661498e9f3bfdfa2fc5737a P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:38.021936 16833 consensus_peers.cc:597] T c5baa0b4140847958c6528b3dbda7617 P 17294485b7f24e2b9fae71dd3169a336 -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:38.022742  9681 tablet_replica.cc:333] T 6916ee6a900c46508c98006aa85fe2d9 P 879366e90f5c420588945e0d545017c8: stopping tablet replica
I20260709 12:27:38.023979  9681 raft_consensus.cc:2243] T 6916ee6a900c46508c98006aa85fe2d9 P 879366e90f5c420588945e0d545017c8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:38.025449  9681 raft_consensus.cc:2272] T 6916ee6a900c46508c98006aa85fe2d9 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:38.028046  9681 tablet_replica.cc:333] T 288d05b8017c4e0f8cd40048647aecae P 879366e90f5c420588945e0d545017c8: stopping tablet replica
I20260709 12:27:38.028698  9681 raft_consensus.cc:2243] T 288d05b8017c4e0f8cd40048647aecae P 879366e90f5c420588945e0d545017c8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:38.029639  9681 raft_consensus.cc:2272] T 288d05b8017c4e0f8cd40048647aecae P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:38.033382  9681 tablet_replica.cc:333] T d6811cd94dfd44149e1329e919d82f0f P 879366e90f5c420588945e0d545017c8: stopping tablet replica
I20260709 12:27:38.034513  9681 raft_consensus.cc:2243] T d6811cd94dfd44149e1329e919d82f0f P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:38.035351  9681 raft_consensus.cc:2272] T d6811cd94dfd44149e1329e919d82f0f P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:38.038213 16833 consensus_peers.cc:597] T 7562feb416f84f0b948343356153d8d2 P 17294485b7f24e2b9fae71dd3169a336 -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:38.039314  9681 tablet_replica.cc:333] T cd637126e0044d7996f18e258282a145 P 879366e90f5c420588945e0d545017c8: stopping tablet replica
W20260709 12:27:38.040122 16759 consensus_peers.cc:597] T 52538067157143b2abd4656a4bbb9442 P 3c1aba6ee1d244fd9c0daba722aa0b3b -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:38.040376  9681 raft_consensus.cc:2243] T cd637126e0044d7996f18e258282a145 P 879366e90f5c420588945e0d545017c8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:38.041432  9681 raft_consensus.cc:2272] T cd637126e0044d7996f18e258282a145 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:38.044040  9681 tablet_replica.cc:333] T 514ee26ff21e4c08976b6a0397b730fe P 879366e90f5c420588945e0d545017c8: stopping tablet replica
I20260709 12:27:38.044667  9681 raft_consensus.cc:2243] T 514ee26ff21e4c08976b6a0397b730fe P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:38.045145  9681 raft_consensus.cc:2272] T 514ee26ff21e4c08976b6a0397b730fe P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:38.045375 16833 consensus_peers.cc:597] T 98a96f910b4449f7ba9c875e45090080 P 17294485b7f24e2b9fae71dd3169a336 -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:38.047322  9681 tablet_replica.cc:333] T 7b90200ef21f42f1929fbf0051ef5b3e P 879366e90f5c420588945e0d545017c8: stopping tablet replica
I20260709 12:27:38.048027  9681 raft_consensus.cc:2243] T 7b90200ef21f42f1929fbf0051ef5b3e P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:38.048506  9681 raft_consensus.cc:2272] T 7b90200ef21f42f1929fbf0051ef5b3e P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:38.050776  9681 tablet_replica.cc:333] T 9067b67140fa48e883d2d240a6046d63 P 879366e90f5c420588945e0d545017c8: stopping tablet replica
I20260709 12:27:38.051417  9681 raft_consensus.cc:2243] T 9067b67140fa48e883d2d240a6046d63 P 879366e90f5c420588945e0d545017c8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:38.052291  9681 raft_consensus.cc:2272] T 9067b67140fa48e883d2d240a6046d63 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:38.054352  9681 tablet_replica.cc:333] T 28bdf20fc71548da87c4558dacc503db P 879366e90f5c420588945e0d545017c8: stopping tablet replica
I20260709 12:27:38.055038  9681 raft_consensus.cc:2243] T 28bdf20fc71548da87c4558dacc503db P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:38.055539  9681 raft_consensus.cc:2272] T 28bdf20fc71548da87c4558dacc503db P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:38.058763  9681 tablet_replica.cc:333] T b86527b8a77848629c50a32e2534f7ba P 879366e90f5c420588945e0d545017c8: stopping tablet replica
I20260709 12:27:38.059690  9681 raft_consensus.cc:2243] T b86527b8a77848629c50a32e2534f7ba P 879366e90f5c420588945e0d545017c8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:38.060801  9681 raft_consensus.cc:2272] T b86527b8a77848629c50a32e2534f7ba P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:38.061477 16907 consensus_peers.cc:597] T ea5085716661498e9f3bfdfa2fc5737a P 82f27bcdf252425aad4c4a37d064f68d -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:38.063400  9681 tablet_replica.cc:333] T 98a96f910b4449f7ba9c875e45090080 P 879366e90f5c420588945e0d545017c8: stopping tablet replica
I20260709 12:27:38.064569  9681 raft_consensus.cc:2243] T 98a96f910b4449f7ba9c875e45090080 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:38.065361  9681 raft_consensus.cc:2272] T 98a96f910b4449f7ba9c875e45090080 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:38.068222  9681 tablet_replica.cc:333] T a0409dc146674a39a9ceeeeebc081453 P 879366e90f5c420588945e0d545017c8: stopping tablet replica
I20260709 12:27:38.069011  9681 raft_consensus.cc:2243] T a0409dc146674a39a9ceeeeebc081453 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:38.069475  9681 raft_consensus.cc:2272] T a0409dc146674a39a9ceeeeebc081453 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:38.071513  9681 tablet_replica.cc:333] T b6f178076e7f4c7bb41b4853bacbfc4e P 879366e90f5c420588945e0d545017c8: stopping tablet replica
I20260709 12:27:38.072381  9681 raft_consensus.cc:2243] T b6f178076e7f4c7bb41b4853bacbfc4e P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:38.072949  9681 raft_consensus.cc:2272] T b6f178076e7f4c7bb41b4853bacbfc4e P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:38.075238  9681 tablet_replica.cc:333] T 840a644e56054e13bfd7585fa064120c P 879366e90f5c420588945e0d545017c8: stopping tablet replica
I20260709 12:27:38.075877  9681 raft_consensus.cc:2243] T 840a644e56054e13bfd7585fa064120c P 879366e90f5c420588945e0d545017c8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:38.077253  9681 raft_consensus.cc:2272] T 840a644e56054e13bfd7585fa064120c P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:38.080775  9681 tablet_replica.cc:333] T fbafe39b79894737b395f95013bc6c86 P 879366e90f5c420588945e0d545017c8: stopping tablet replica
I20260709 12:27:38.081609  9681 raft_consensus.cc:2243] T fbafe39b79894737b395f95013bc6c86 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:38.082536  9681 raft_consensus.cc:2272] T fbafe39b79894737b395f95013bc6c86 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:38.085525  9681 tablet_replica.cc:333] T 52538067157143b2abd4656a4bbb9442 P 879366e90f5c420588945e0d545017c8: stopping tablet replica
I20260709 12:27:38.086163  9681 raft_consensus.cc:2243] T 52538067157143b2abd4656a4bbb9442 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:38.086650  9681 raft_consensus.cc:2272] T 52538067157143b2abd4656a4bbb9442 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:38.091527 16759 consensus_peers.cc:597] T 5025c37302bd4a2aa076878e1af90366 P 3c1aba6ee1d244fd9c0daba722aa0b3b -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:38.125568 16833 consensus_peers.cc:597] T 28bdf20fc71548da87c4558dacc503db P 17294485b7f24e2b9fae71dd3169a336 -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:38.183364  9681 tablet_server.cc:196] TabletServer@127.9.116.65:0 shutdown complete.
W20260709 12:27:38.219056 16833 consensus_peers.cc:597] T b6f178076e7f4c7bb41b4853bacbfc4e P 17294485b7f24e2b9fae71dd3169a336 -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:38.224134 16759 consensus_peers.cc:597] T 223b3745452c412581caf058f6b81fe2 P 3c1aba6ee1d244fd9c0daba722aa0b3b -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:38.226025 16907 consensus_peers.cc:597] T 00e5268529b241f184c460704ab9ed3c P 82f27bcdf252425aad4c4a37d064f68d -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:38.248159 16833 consensus_peers.cc:597] T b10d5b4017584d0fb22f9e542d95fcb1 P 17294485b7f24e2b9fae71dd3169a336 -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:38.275657 16759 consensus_peers.cc:597] T 5f88e29c7ffd4b3b856561ee240cdd43 P 3c1aba6ee1d244fd9c0daba722aa0b3b -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:38.279211 16759 consensus_peers.cc:597] T 7b90200ef21f42f1929fbf0051ef5b3e P 3c1aba6ee1d244fd9c0daba722aa0b3b -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:38.292977 16759 consensus_peers.cc:597] T ce37f3e8575c4b8e88935db231644a27 P 3c1aba6ee1d244fd9c0daba722aa0b3b -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:38.297608  9681 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:38.307708 17615 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:38.308020 17616 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:38.323392  9681 server_base.cc:1061] running on GCE node
W20260709 12:27:38.324023 17618 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:38.327172 16833 consensus_peers.cc:597] T 514ee26ff21e4c08976b6a0397b730fe P 17294485b7f24e2b9fae71dd3169a336 -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:38.329675  9681 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:38.329977  9681 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:38.330127  9681 hybrid_clock.cc:648] HybridClock initialized: now 1783600058330115 us; error 0 us; skew 500 ppm
I20260709 12:27:38.330708  9681 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:38.334870  9681 webserver.cc:533] Webserver started at http://127.9.116.65:43467/ using document root <none> and password file <none>
I20260709 12:27:38.335853  9681 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:38.336153  9681 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:27:38.341984  9681 fs_manager.cc:714] Time spent opening directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:27:38.364267 17624 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:38.368626  9681 fs_manager.cc:730] Time spent opening block manager: real 0.017s	user 0.005s	sys 0.001s
I20260709 12:27:38.369130  9681 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599781984018-9681-0/minicluster-data/ts-0-root
uuid: "879366e90f5c420588945e0d545017c8"
format_stamp: "Formatted at 2026-07-09 12:27:20 on dist-test-slave-zk51"
I20260709 12:27:38.369665  9681 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599781984018-9681-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599781984018-9681-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599781984018-9681-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:38.403113  9681 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:38.404637  9681 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:38.406817  9681 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:27:38.413183 17631 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
I20260709 12:27:38.809264  9681 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 12:27:38.809665  9681 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.398s	user 0.011s	sys 0.000s
I20260709 12:27:38.810400  9681 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 12:27:38.827993 17631 tablet_bootstrap.cc:492] T 223b3745452c412581caf058f6b81fe2 P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:38.847564 17631 tablet_bootstrap.cc:492] T 223b3745452c412581caf058f6b81fe2 P 879366e90f5c420588945e0d545017c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:38.848830 17631 tablet_bootstrap.cc:492] T 223b3745452c412581caf058f6b81fe2 P 879366e90f5c420588945e0d545017c8: Bootstrap complete.
I20260709 12:27:38.849977 17631 ts_tablet_manager.cc:1403] T 223b3745452c412581caf058f6b81fe2 P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.004s
I20260709 12:27:38.852972 17631 raft_consensus.cc:359] T 223b3745452c412581caf058f6b81fe2 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:38.853683 17631 raft_consensus.cc:740] T 223b3745452c412581caf058f6b81fe2 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:38.854668 17631 consensus_queue.cc:260] T 223b3745452c412581caf058f6b81fe2 P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:38.878036 17631 ts_tablet_manager.cc:1434] T 223b3745452c412581caf058f6b81fe2 P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.028s	user 0.010s	sys 0.011s
I20260709 12:27:38.878970 17631 tablet_bootstrap.cc:492] T 5025c37302bd4a2aa076878e1af90366 P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:38.906508 17562 raft_consensus.cc:493] T a4252af16e15424399c32c789c8e6c23 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:38.907675 17562 raft_consensus.cc:515] T a4252af16e15424399c32c789c8e6c23 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:38.910058 17631 tablet_bootstrap.cc:492] T 5025c37302bd4a2aa076878e1af90366 P 879366e90f5c420588945e0d545017c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:38.910633 17562 leader_election.cc:290] T a4252af16e15424399c32c789c8e6c23 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
I20260709 12:27:38.911422 17631 tablet_bootstrap.cc:492] T 5025c37302bd4a2aa076878e1af90366 P 879366e90f5c420588945e0d545017c8: Bootstrap complete.
I20260709 12:27:38.912338 17631 ts_tablet_manager.cc:1403] T 5025c37302bd4a2aa076878e1af90366 P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.034s	user 0.013s	sys 0.015s
I20260709 12:27:38.914623 17613 raft_consensus.cc:493] T 6916ee6a900c46508c98006aa85fe2d9 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:38.915110 17631 raft_consensus.cc:359] T 5025c37302bd4a2aa076878e1af90366 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:38.915942 17631 raft_consensus.cc:740] T 5025c37302bd4a2aa076878e1af90366 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:38.915290 17613 raft_consensus.cc:515] T 6916ee6a900c46508c98006aa85fe2d9 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:38.916669 17631 consensus_queue.cc:260] T 5025c37302bd4a2aa076878e1af90366 P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
W20260709 12:27:38.917958 16759 leader_election.cc:336] T a4252af16e15424399c32c789c8e6c23 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:38.918648 17631 ts_tablet_manager.cc:1434] T 5025c37302bd4a2aa076878e1af90366 P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:27:38.919793 17631 tablet_bootstrap.cc:492] T 52538067157143b2abd4656a4bbb9442 P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:38.920404 16789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6916ee6a900c46508c98006aa85fe2d9" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
I20260709 12:27:38.918704 17613 leader_election.cc:290] T 6916ee6a900c46508c98006aa85fe2d9 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
W20260709 12:27:38.924881 16907 leader_election.cc:336] T 6916ee6a900c46508c98006aa85fe2d9 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:38.925374 16907 leader_election.cc:304] T 6916ee6a900c46508c98006aa85fe2d9 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8
I20260709 12:27:38.926316 17613 raft_consensus.cc:2749] T 6916ee6a900c46508c98006aa85fe2d9 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:38.931484 16867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4252af16e15424399c32c789c8e6c23" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:38.933566 16759 leader_election.cc:304] T a4252af16e15424399c32c789c8e6c23 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b; no voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8
I20260709 12:27:38.935058 17562 raft_consensus.cc:2749] T a4252af16e15424399c32c789c8e6c23 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:38.941542 17631 tablet_bootstrap.cc:492] T 52538067157143b2abd4656a4bbb9442 P 879366e90f5c420588945e0d545017c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:38.942657 17631 tablet_bootstrap.cc:492] T 52538067157143b2abd4656a4bbb9442 P 879366e90f5c420588945e0d545017c8: Bootstrap complete.
I20260709 12:27:38.943773 17631 ts_tablet_manager.cc:1403] T 52538067157143b2abd4656a4bbb9442 P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.024s	user 0.020s	sys 0.000s
I20260709 12:27:38.948348 17631 raft_consensus.cc:359] T 52538067157143b2abd4656a4bbb9442 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:38.949234 17631 raft_consensus.cc:740] T 52538067157143b2abd4656a4bbb9442 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:38.950008 17631 consensus_queue.cc:260] T 52538067157143b2abd4656a4bbb9442 P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:38.954602 17631 ts_tablet_manager.cc:1434] T 52538067157143b2abd4656a4bbb9442 P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:27:38.955554 17631 tablet_bootstrap.cc:492] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:38.969825 17631 tablet_bootstrap.cc:492] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 879366e90f5c420588945e0d545017c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:38.970733 17631 tablet_bootstrap.cc:492] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 879366e90f5c420588945e0d545017c8: Bootstrap complete.
I20260709 12:27:38.971313 17631 ts_tablet_manager.cc:1403] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.016s	user 0.003s	sys 0.007s
I20260709 12:27:38.973405 17631 raft_consensus.cc:359] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:38.973958 17631 raft_consensus.cc:740] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:38.974568 17631 consensus_queue.cc:260] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:38.976024 17631 ts_tablet_manager.cc:1434] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.004s	user 0.005s	sys 0.003s
I20260709 12:27:38.976825 17631 tablet_bootstrap.cc:492] T e477f70d4c8d466e9d45e6645e2a2869 P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:38.999538 17613 raft_consensus.cc:493] T 288d05b8017c4e0f8cd40048647aecae P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:39.000626 17631 tablet_bootstrap.cc:492] T e477f70d4c8d466e9d45e6645e2a2869 P 879366e90f5c420588945e0d545017c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:39.000180 17613 raft_consensus.cc:515] T 288d05b8017c4e0f8cd40048647aecae P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:39.001679 17631 tablet_bootstrap.cc:492] T e477f70d4c8d466e9d45e6645e2a2869 P 879366e90f5c420588945e0d545017c8: Bootstrap complete.
I20260709 12:27:39.002403 17631 ts_tablet_manager.cc:1403] T e477f70d4c8d466e9d45e6645e2a2869 P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.008s
I20260709 12:27:39.007036 17631 raft_consensus.cc:359] T e477f70d4c8d466e9d45e6645e2a2869 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:39.007812 17631 raft_consensus.cc:740] T e477f70d4c8d466e9d45e6645e2a2869 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:39.008491 17631 consensus_queue.cc:260] T e477f70d4c8d466e9d45e6645e2a2869 P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:39.010397 17631 ts_tablet_manager.cc:1434] T e477f70d4c8d466e9d45e6645e2a2869 P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:27:39.011373 17631 tablet_bootstrap.cc:492] T 6916ee6a900c46508c98006aa85fe2d9 P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:39.022894 17613 leader_election.cc:290] T 288d05b8017c4e0f8cd40048647aecae P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:39.026003 16867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "288d05b8017c4e0f8cd40048647aecae" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
W20260709 12:27:39.033464 16907 leader_election.cc:336] T 288d05b8017c4e0f8cd40048647aecae P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:39.034082 16907 leader_election.cc:304] T 288d05b8017c4e0f8cd40048647aecae P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8
I20260709 12:27:39.034900 17634 raft_consensus.cc:2749] T 288d05b8017c4e0f8cd40048647aecae P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:39.033648 17631 tablet_bootstrap.cc:492] T 6916ee6a900c46508c98006aa85fe2d9 P 879366e90f5c420588945e0d545017c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:39.037519 17631 tablet_bootstrap.cc:492] T 6916ee6a900c46508c98006aa85fe2d9 P 879366e90f5c420588945e0d545017c8: Bootstrap complete.
I20260709 12:27:39.038460 17631 ts_tablet_manager.cc:1403] T 6916ee6a900c46508c98006aa85fe2d9 P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.027s	user 0.015s	sys 0.008s
I20260709 12:27:39.043413 17631 raft_consensus.cc:359] T 6916ee6a900c46508c98006aa85fe2d9 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:39.044472 17631 raft_consensus.cc:740] T 6916ee6a900c46508c98006aa85fe2d9 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:39.045259 17631 consensus_queue.cc:260] T 6916ee6a900c46508c98006aa85fe2d9 P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:39.047675 17634 raft_consensus.cc:493] T 27dda31a8cd1468eb3a824ae026485a3 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:39.048913 17631 ts_tablet_manager.cc:1434] T 6916ee6a900c46508c98006aa85fe2d9 P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.003s
I20260709 12:27:39.048547 17634 raft_consensus.cc:515] T 27dda31a8cd1468eb3a824ae026485a3 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:39.050293 17631 tablet_bootstrap.cc:492] T cd637126e0044d7996f18e258282a145 P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:39.051795 17634 leader_election.cc:290] T 27dda31a8cd1468eb3a824ae026485a3 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
I20260709 12:27:39.054378 16867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27dda31a8cd1468eb3a824ae026485a3" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:39.058849 17620 raft_consensus.cc:493] T 27f104a1ba60493ab47f6b876da48d67 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:39.059478 17620 raft_consensus.cc:515] T 27f104a1ba60493ab47f6b876da48d67 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
W20260709 12:27:39.060012 16907 leader_election.cc:336] T 27dda31a8cd1468eb3a824ae026485a3 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:39.060508 16907 leader_election.cc:304] T 27dda31a8cd1468eb3a824ae026485a3 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8
I20260709 12:27:39.062216 17634 raft_consensus.cc:2749] T 27dda31a8cd1468eb3a824ae026485a3 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:39.062870 17613 raft_consensus.cc:493] T 8eaf179090b14105b52c4701d5599216 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:39.063510 17613 raft_consensus.cc:515] T 8eaf179090b14105b52c4701d5599216 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:39.069705 16789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eaf179090b14105b52c4701d5599216" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
I20260709 12:27:39.070688 17634 raft_consensus.cc:493] T 27f104a1ba60493ab47f6b876da48d67 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:39.071425 17634 raft_consensus.cc:515] T 27f104a1ba60493ab47f6b876da48d67 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:39.073693 17634 leader_election.cc:290] T 27f104a1ba60493ab47f6b876da48d67 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:39.075862 16935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f104a1ba60493ab47f6b876da48d67" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:39.076629 16935 raft_consensus.cc:2468] T 27f104a1ba60493ab47f6b876da48d67 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 1.
I20260709 12:27:39.068194 17613 leader_election.cc:290] T 8eaf179090b14105b52c4701d5599216 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:39.078557 17620 leader_election.cc:290] T 27f104a1ba60493ab47f6b876da48d67 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:39.080464 16833 leader_election.cc:304] T 27f104a1ba60493ab47f6b876da48d67 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 82f27bcdf252425aad4c4a37d064f68d; no voters: 
I20260709 12:27:39.082016 17620 raft_consensus.cc:2804] T 27f104a1ba60493ab47f6b876da48d67 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:39.082583 17620 raft_consensus.cc:493] T 27f104a1ba60493ab47f6b876da48d67 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:39.083495 17620 raft_consensus.cc:3060] T 27f104a1ba60493ab47f6b876da48d67 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:39.087693 16867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f104a1ba60493ab47f6b876da48d67" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
W20260709 12:27:39.088763 16833 leader_election.cc:336] T 27f104a1ba60493ab47f6b876da48d67 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:39.093071 17631 tablet_bootstrap.cc:492] T cd637126e0044d7996f18e258282a145 P 879366e90f5c420588945e0d545017c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:39.096825 17631 tablet_bootstrap.cc:492] T cd637126e0044d7996f18e258282a145 P 879366e90f5c420588945e0d545017c8: Bootstrap complete.
W20260709 12:27:39.095423 16907 leader_election.cc:336] T 8eaf179090b14105b52c4701d5599216 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:39.097442 16907 leader_election.cc:304] T 8eaf179090b14105b52c4701d5599216 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8
I20260709 12:27:39.098317 17613 raft_consensus.cc:2749] T 8eaf179090b14105b52c4701d5599216 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:39.103087 17631 ts_tablet_manager.cc:1403] T cd637126e0044d7996f18e258282a145 P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.053s	user 0.016s	sys 0.007s
I20260709 12:27:39.104471 17210 raft_consensus.cc:493] T 8eaf179090b14105b52c4701d5599216 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:39.099138 17620 raft_consensus.cc:515] T 27f104a1ba60493ab47f6b876da48d67 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:39.105311 17210 raft_consensus.cc:515] T 8eaf179090b14105b52c4701d5599216 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:39.105931 16867 raft_consensus.cc:2393] T 27f104a1ba60493ab47f6b876da48d67 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 82f27bcdf252425aad4c4a37d064f68d in current term 2: Already voted for candidate 17294485b7f24e2b9fae71dd3169a336 in this term.
I20260709 12:27:39.106643 17631 raft_consensus.cc:359] T cd637126e0044d7996f18e258282a145 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:39.107823 17210 leader_election.cc:290] T 8eaf179090b14105b52c4701d5599216 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:39.107708 17631 raft_consensus.cc:740] T cd637126e0044d7996f18e258282a145 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:39.109774 17631 consensus_queue.cc:260] T cd637126e0044d7996f18e258282a145 P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
W20260709 12:27:39.105305 16907 leader_election.cc:336] T 27f104a1ba60493ab47f6b876da48d67 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:39.112547 16907 leader_election.cc:304] T 27f104a1ba60493ab47f6b876da48d67 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8
I20260709 12:27:39.113554 17613 raft_consensus.cc:3060] T 27f104a1ba60493ab47f6b876da48d67 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:27:39.115209 16759 leader_election.cc:336] T 8eaf179090b14105b52c4701d5599216 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:39.116943 17620 leader_election.cc:290] T 27f104a1ba60493ab47f6b876da48d67 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 election: Requested vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:39.117636 17620 raft_consensus.cc:493] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:39.116665 16937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f104a1ba60493ab47f6b876da48d67" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d"
I20260709 12:27:39.118541 16935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eaf179090b14105b52c4701d5599216" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:39.116642 17516 raft_consensus.cc:493] T 27dda31a8cd1468eb3a824ae026485a3 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:39.119299 16935 raft_consensus.cc:2468] T 8eaf179090b14105b52c4701d5599216 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in term 1.
I20260709 12:27:39.119414 17516 raft_consensus.cc:515] T 27dda31a8cd1468eb3a824ae026485a3 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:39.121441 17634 raft_consensus.cc:493] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:39.122169 17516 leader_election.cc:290] T 27dda31a8cd1468eb3a824ae026485a3 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919)
I20260709 12:27:39.121979 17634 raft_consensus.cc:515] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:39.125761 17634 leader_election.cc:290] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:39.126228 16789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1e8d1852ae457db7e3be5b6957f1b3" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
I20260709 12:27:39.131350 17613 raft_consensus.cc:2749] T 27f104a1ba60493ab47f6b876da48d67 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:27:39.132851 16833 leader_election.cc:336] T 27f104a1ba60493ab47f6b876da48d67 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:39.133292 16935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27dda31a8cd1468eb3a824ae026485a3" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:39.134191 16935 raft_consensus.cc:2468] T 27dda31a8cd1468eb3a824ae026485a3 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 2.
I20260709 12:27:39.135018 17631 ts_tablet_manager.cc:1434] T cd637126e0044d7996f18e258282a145 P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.031s	user 0.004s	sys 0.003s
I20260709 12:27:39.136221 17631 tablet_bootstrap.cc:492] T 7562feb416f84f0b948343356153d8d2 P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
W20260709 12:27:39.139659 16907 leader_election.cc:336] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:39.140443 16907 leader_election.cc:304] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8
I20260709 12:27:39.141285 17613 raft_consensus.cc:2749] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:39.143452 17516 raft_consensus.cc:493] T e477f70d4c8d466e9d45e6645e2a2869 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:39.144500 17613 raft_consensus.cc:493] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:39.144635 17605 raft_consensus.cc:493] T 51ebab30b5104589803b75a1b48c5aa2 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:39.145290 17605 raft_consensus.cc:515] T 51ebab30b5104589803b75a1b48c5aa2 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:39.148087 17605 leader_election.cc:290] T 51ebab30b5104589803b75a1b48c5aa2 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:39.147154 17516 raft_consensus.cc:515] T e477f70d4c8d466e9d45e6645e2a2869 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:39.148777 17605 raft_consensus.cc:493] T 3d614e06fd2c40189161e22ad9217e5d P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:39.149358 17605 raft_consensus.cc:515] T 3d614e06fd2c40189161e22ad9217e5d P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:39.145292 17613 raft_consensus.cc:515] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:39.153609 16789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e477f70d4c8d466e9d45e6645e2a2869" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
I20260709 12:27:39.153981 17613 leader_election.cc:290] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:39.154946 17605 leader_election.cc:290] T 3d614e06fd2c40189161e22ad9217e5d P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:39.157290 17516 leader_election.cc:290] T e477f70d4c8d466e9d45e6645e2a2869 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:39.159929 16867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f2b93e5d2045a5a0cd1f9b5806a133" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:39.162403 17516 raft_consensus.cc:493] T 6e89df746e0c49d184637314ce87045a P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:39.163497 17516 raft_consensus.cc:515] T 6e89df746e0c49d184637314ce87045a P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:39.164438 17634 raft_consensus.cc:493] T 442e0dfc272840f7a14c2232ed65425c P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:39.168363 17634 raft_consensus.cc:515] T 442e0dfc272840f7a14c2232ed65425c P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:39.171111 17634 leader_election.cc:290] T 442e0dfc272840f7a14c2232ed65425c P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:39.167045 17210 raft_consensus.cc:493] T cd637126e0044d7996f18e258282a145 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:39.171917 17210 raft_consensus.cc:515] T cd637126e0044d7996f18e258282a145 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:39.172477 16789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442e0dfc272840f7a14c2232ed65425c" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
I20260709 12:27:39.173936 17210 leader_election.cc:290] T cd637126e0044d7996f18e258282a145 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
I20260709 12:27:39.175833 17567 raft_consensus.cc:493] T 3d614e06fd2c40189161e22ad9217e5d P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:39.176630 17567 raft_consensus.cc:515] T 3d614e06fd2c40189161e22ad9217e5d P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:39.178887  9681 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 12:27:39.179243  9681 ts_tablet_manager.cc:595] Time spent register tablets: real 0.369s	user 0.352s	sys 0.004s
I20260709 12:27:39.180253 16935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ebab30b5104589803b75a1b48c5aa2" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:39.181857 16933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d614e06fd2c40189161e22ad9217e5d" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:39.182622 16933 raft_consensus.cc:2468] T 3d614e06fd2c40189161e22ad9217e5d P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 2.
I20260709 12:27:39.179383 17567 leader_election.cc:290] T 3d614e06fd2c40189161e22ad9217e5d P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:39.179463 16833 leader_election.cc:304] T 27dda31a8cd1468eb3a824ae026485a3 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 82f27bcdf252425aad4c4a37d064f68d; no voters: 
I20260709 12:27:39.186214 17605 raft_consensus.cc:2804] T 27dda31a8cd1468eb3a824ae026485a3 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:39.187541 17634 raft_consensus.cc:493] T 51ebab30b5104589803b75a1b48c5aa2 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:39.188468 17210 raft_consensus.cc:493] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:39.186690 17605 raft_consensus.cc:493] T 27dda31a8cd1468eb3a824ae026485a3 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:39.189260 17605 raft_consensus.cc:3060] T 27dda31a8cd1468eb3a824ae026485a3 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:39.189224 17210 raft_consensus.cc:515] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:39.191107 17562 raft_consensus.cc:493] T 6e89df746e0c49d184637314ce87045a P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:39.188412 17634 raft_consensus.cc:515] T 51ebab30b5104589803b75a1b48c5aa2 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:39.191676 17562 raft_consensus.cc:515] T 6e89df746e0c49d184637314ce87045a P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:39.192452 17613 raft_consensus.cc:493] T a8a632c738e94b26a8352a68a42a0670 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:39.193058 17613 raft_consensus.cc:515] T a8a632c738e94b26a8352a68a42a0670 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:39.193838 17562 leader_election.cc:290] T 6e89df746e0c49d184637314ce87045a P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
I20260709 12:27:39.196506 17613 leader_election.cc:290] T a8a632c738e94b26a8352a68a42a0670 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:39.118140 17620 raft_consensus.cc:515] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:39.197185 16789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8a632c738e94b26a8352a68a42a0670" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
I20260709 12:27:39.198505 17210 leader_election.cc:290] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
W20260709 12:27:39.199108 16759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:39833, user_credentials={real_user=slave}} blocked reactor thread for 81812.3us
I20260709 12:27:39.201200 16867 raft_consensus.cc:2468] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82f27bcdf252425aad4c4a37d064f68d in term 1.
I20260709 12:27:39.204542 17210 raft_consensus.cc:493] T 840a644e56054e13bfd7585fa064120c P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:39.205142 17210 raft_consensus.cc:515] T 840a644e56054e13bfd7585fa064120c P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:39.206329 17634 leader_election.cc:290] T 51ebab30b5104589803b75a1b48c5aa2 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:39.207154 17210 leader_election.cc:290] T 840a644e56054e13bfd7585fa064120c P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
W20260709 12:27:39.186242 16833 leader_election.cc:336] T 27dda31a8cd1468eb3a824ae026485a3 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:39.211822 16833 leader_election.cc:304] T 3d614e06fd2c40189161e22ad9217e5d P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 82f27bcdf252425aad4c4a37d064f68d; no voters: 
I20260709 12:27:39.212728 16789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e89df746e0c49d184637314ce87045a" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
I20260709 12:27:39.213773 16789 raft_consensus.cc:2468] T 6e89df746e0c49d184637314ce87045a P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 1.
I20260709 12:27:39.214206 17631 tablet_bootstrap.cc:492] T 7562feb416f84f0b948343356153d8d2 P 879366e90f5c420588945e0d545017c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:39.214478 17516 leader_election.cc:290] T 6e89df746e0c49d184637314ce87045a P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:39.215382 17631 tablet_bootstrap.cc:492] T 7562feb416f84f0b948343356153d8d2 P 879366e90f5c420588945e0d545017c8: Bootstrap complete.
I20260709 12:27:39.223732 17631 ts_tablet_manager.cc:1403] T 7562feb416f84f0b948343356153d8d2 P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.088s	user 0.018s	sys 0.004s
I20260709 12:27:39.217273 16834 leader_election.cc:304] T 6e89df746e0c49d184637314ce87045a P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 3c1aba6ee1d244fd9c0daba722aa0b3b; no voters: 
I20260709 12:27:39.218060 17647 raft_consensus.cc:2804] T 3d614e06fd2c40189161e22ad9217e5d P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:39.219597 16933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f2b93e5d2045a5a0cd1f9b5806a133" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:39.226341 16933 raft_consensus.cc:2468] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 1.
I20260709 12:27:39.227332 17516 raft_consensus.cc:2804] T 6e89df746e0c49d184637314ce87045a P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:39.227871 17647 raft_consensus.cc:493] T 3d614e06fd2c40189161e22ad9217e5d P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:39.228096 16868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ebab30b5104589803b75a1b48c5aa2" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:39.231441 16868 raft_consensus.cc:2468] T 51ebab30b5104589803b75a1b48c5aa2 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82f27bcdf252425aad4c4a37d064f68d in term 1.
I20260709 12:27:39.229336 16867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d614e06fd2c40189161e22ad9217e5d" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:39.232949 17647 raft_consensus.cc:3060] T 3d614e06fd2c40189161e22ad9217e5d P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:39.233633 17631 raft_consensus.cc:359] T 7562feb416f84f0b948343356153d8d2 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:39.234397 17631 raft_consensus.cc:740] T 7562feb416f84f0b948343356153d8d2 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
W20260709 12:27:39.225317 16907 leader_election.cc:336] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:39.230089 17605 raft_consensus.cc:515] T 27dda31a8cd1468eb3a824ae026485a3 P 17294485b7f24e2b9fae71dd3169a336 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
W20260709 12:27:39.230424 16833 leader_election.cc:336] T 51ebab30b5104589803b75a1b48c5aa2 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:39.237777 17562 raft_consensus.cc:493] T e628dacc30694988a7c795441df15600 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:39.238205 16833 leader_election.cc:304] T 51ebab30b5104589803b75a1b48c5aa2 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336; no voters: 82f27bcdf252425aad4c4a37d064f68d, 879366e90f5c420588945e0d545017c8
I20260709 12:27:39.231554 17646 raft_consensus.cc:493] T b86527b8a77848629c50a32e2534f7ba P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:39.240672 17646 raft_consensus.cc:515] T b86527b8a77848629c50a32e2534f7ba P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:39.243724 17562 raft_consensus.cc:515] T e628dacc30694988a7c795441df15600 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:39.245338 17649 raft_consensus.cc:493] T a4252af16e15424399c32c789c8e6c23 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:39.245973 17649 raft_consensus.cc:515] T a4252af16e15424399c32c789c8e6c23 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:39.246934 17643 raft_consensus.cc:2749] T 51ebab30b5104589803b75a1b48c5aa2 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:39.247444 17562 leader_election.cc:290] T e628dacc30694988a7c795441df15600 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
W20260709 12:27:39.250351 16833 leader_election.cc:336] T e477f70d4c8d466e9d45e6645e2a2869 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:39.247920 17605 leader_election.cc:290] T 27dda31a8cd1468eb3a824ae026485a3 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 3 election: Requested vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919)
I20260709 12:27:39.250981 16833 leader_election.cc:304] T e477f70d4c8d466e9d45e6645e2a2869 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8
I20260709 12:27:39.230250 17210 raft_consensus.cc:493] T e477f70d4c8d466e9d45e6645e2a2869 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 879366e90f5c420588945e0d545017c8)
W20260709 12:27:39.252343 16833 leader_election.cc:336] T 3d614e06fd2c40189161e22ad9217e5d P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:39.251181 17516 raft_consensus.cc:493] T 6e89df746e0c49d184637314ce87045a P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:39.253021 17516 raft_consensus.cc:3060] T 6e89df746e0c49d184637314ce87045a P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:39.235163 17631 consensus_queue.cc:260] T 7562feb416f84f0b948343356153d8d2 P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:39.253793 17620 leader_election.cc:290] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:39.255255 17620 raft_consensus.cc:493] T 288d05b8017c4e0f8cd40048647aecae P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:39.255924 17620 raft_consensus.cc:515] T 288d05b8017c4e0f8cd40048647aecae P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:39.248466 17646 leader_election.cc:290] T b86527b8a77848629c50a32e2534f7ba P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:39.219421 16937 raft_consensus.cc:2468] T 27f104a1ba60493ab47f6b876da48d67 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 2.
I20260709 12:27:39.257664 17634 raft_consensus.cc:493] T 28c655b68dc545948c67e0977b49e770 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:39.258289 17634 raft_consensus.cc:515] T 28c655b68dc545948c67e0977b49e770 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:39.252020 17210 raft_consensus.cc:515] T e477f70d4c8d466e9d45e6645e2a2869 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:39.258307 17631 ts_tablet_manager.cc:1434] T 7562feb416f84f0b948343356153d8d2 P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 12:27:39.261582 17631 tablet_bootstrap.cc:492] T 62e4e875fd4e4604952120df324e99cb P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:39.264302 16907 leader_election.cc:304] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 82f27bcdf252425aad4c4a37d064f68d; no voters: 879366e90f5c420588945e0d545017c8
I20260709 12:27:39.267103 17567 raft_consensus.cc:493] T 6a86fc21ef0044bb91dd271c9a019336 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:39.273041 17567 raft_consensus.cc:515] T 6a86fc21ef0044bb91dd271c9a019336 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:39.274562 17649 leader_election.cc:290] T a4252af16e15424399c32c789c8e6c23 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:39.271364 16935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86527b8a77848629c50a32e2534f7ba" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:39.272202 16933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27dda31a8cd1468eb3a824ae026485a3" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d"
I20260709 12:27:39.276448 16789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4252af16e15424399c32c789c8e6c23" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
I20260709 12:27:39.276985 17620 leader_election.cc:290] T 288d05b8017c4e0f8cd40048647aecae P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:39.277274 16789 raft_consensus.cc:2468] T a4252af16e15424399c32c789c8e6c23 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 1.
I20260709 12:27:39.276981 16933 raft_consensus.cc:3060] T 27dda31a8cd1468eb3a824ae026485a3 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:39.279098 16834 leader_election.cc:304] T a4252af16e15424399c32c789c8e6c23 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 3c1aba6ee1d244fd9c0daba722aa0b3b; no voters: 
I20260709 12:27:39.284494 17567 leader_election.cc:290] T 6a86fc21ef0044bb91dd271c9a019336 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:39.260387 17634 leader_election.cc:290] T 28c655b68dc545948c67e0977b49e770 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:39.288028 16863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e89df746e0c49d184637314ce87045a" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:39.290570 16790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a86fc21ef0044bb91dd271c9a019336" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
I20260709 12:27:39.260366 17210 leader_election.cc:290] T e477f70d4c8d466e9d45e6645e2a2869 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
I20260709 12:27:39.285512 16868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd637126e0044d7996f18e258282a145" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:39.288269 16833 leader_election.cc:304] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 82f27bcdf252425aad4c4a37d064f68d; no voters: 
I20260709 12:27:39.293491 17632 raft_consensus.cc:493] T a8a632c738e94b26a8352a68a42a0670 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:39.294584 17646 raft_consensus.cc:2804] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:39.294338 17632 raft_consensus.cc:515] T a8a632c738e94b26a8352a68a42a0670 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:39.295094 17646 raft_consensus.cc:493] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:39.295516 17646 raft_consensus.cc:3060] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:39.297626 17605 raft_consensus.cc:2804] T a4252af16e15424399c32c789c8e6c23 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:39.298049 17605 raft_consensus.cc:493] T a4252af16e15424399c32c789c8e6c23 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:39.298424 17605 raft_consensus.cc:3060] T a4252af16e15424399c32c789c8e6c23 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:39.252532 17643 raft_consensus.cc:2749] T e477f70d4c8d466e9d45e6645e2a2869 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:39.285094 17613 raft_consensus.cc:493] T b86527b8a77848629c50a32e2534f7ba P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:39.304381 17613 raft_consensus.cc:515] T b86527b8a77848629c50a32e2534f7ba P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:39.306314 16833 leader_election.cc:304] T 27f104a1ba60493ab47f6b876da48d67 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 82f27bcdf252425aad4c4a37d064f68d; no voters: 879366e90f5c420588945e0d545017c8
I20260709 12:27:39.307596 17567 raft_consensus.cc:2804] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:39.307679 17652 raft_consensus.cc:2804] T 27f104a1ba60493ab47f6b876da48d67 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:39.308070 17567 raft_consensus.cc:493] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:39.308039 17562 raft_consensus.cc:493] T 442e0dfc272840f7a14c2232ed65425c P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:39.308712 17567 raft_consensus.cc:3060] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:39.308840 17652 raft_consensus.cc:697] T 27f104a1ba60493ab47f6b876da48d67 P 17294485b7f24e2b9fae71dd3169a336 [term 2 LEADER]: Becoming Leader. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Running, Role: LEADER
I20260709 12:27:39.309516 17562 raft_consensus.cc:515] T 442e0dfc272840f7a14c2232ed65425c P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:39.309880 17652 consensus_queue.cc:237] T 27f104a1ba60493ab47f6b876da48d67 P 17294485b7f24e2b9fae71dd3169a336 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
W20260709 12:27:39.311362 16833 leader_election.cc:336] T 6e89df746e0c49d184637314ce87045a P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:39.312354 17562 leader_election.cc:290] T 442e0dfc272840f7a14c2232ed65425c P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:39.313982 17632 leader_election.cc:290] T a8a632c738e94b26a8352a68a42a0670 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:39.321867 17613 leader_election.cc:290] T b86527b8a77848629c50a32e2534f7ba P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:39.273347 16759 leader_election.cc:304] T 8eaf179090b14105b52c4701d5599216 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 82f27bcdf252425aad4c4a37d064f68d; no voters: 879366e90f5c420588945e0d545017c8
I20260709 12:27:39.323002 16935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "288d05b8017c4e0f8cd40048647aecae" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:39.324045 16935 raft_consensus.cc:2468] T 288d05b8017c4e0f8cd40048647aecae P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 1.
I20260709 12:27:39.324188 16933 raft_consensus.cc:2468] T 27dda31a8cd1468eb3a824ae026485a3 P 82f27bcdf252425aad4c4a37d064f68d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 3.
W20260709 12:27:39.324542 16759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37919, user_credentials={real_user=slave}} blocked reactor thread for 51326.6us
W20260709 12:27:39.311761 16907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:38103, user_credentials={real_user=slave}} blocked reactor thread for 47588.4us
I20260709 12:27:39.325618 17632 raft_consensus.cc:2804] T 8eaf179090b14105b52c4701d5599216 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:39.327304 17632 raft_consensus.cc:493] T 8eaf179090b14105b52c4701d5599216 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:39.327837 17567 raft_consensus.cc:515] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:39.327965 17632 raft_consensus.cc:3060] T 8eaf179090b14105b52c4701d5599216 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:39.329332 16907 leader_election.cc:304] T 51ebab30b5104589803b75a1b48c5aa2 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 82f27bcdf252425aad4c4a37d064f68d; no voters: 
I20260709 12:27:39.331357 17634 raft_consensus.cc:2804] T 51ebab30b5104589803b75a1b48c5aa2 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:39.331777 17634 raft_consensus.cc:493] T 51ebab30b5104589803b75a1b48c5aa2 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:39.332129 17634 raft_consensus.cc:3060] T 51ebab30b5104589803b75a1b48c5aa2 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:39.333127 17647 raft_consensus.cc:515] T 3d614e06fd2c40189161e22ad9217e5d P 17294485b7f24e2b9fae71dd3169a336 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:39.334290 16867 raft_consensus.cc:2393] T 3d614e06fd2c40189161e22ad9217e5d P 17294485b7f24e2b9fae71dd3169a336 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 82f27bcdf252425aad4c4a37d064f68d in current term 3: Already voted for candidate 17294485b7f24e2b9fae71dd3169a336 in this term.
I20260709 12:27:39.314615 17646 raft_consensus.cc:515] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:39.343421 16861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86527b8a77848629c50a32e2534f7ba" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:39.344184 16861 raft_consensus.cc:2468] T b86527b8a77848629c50a32e2534f7ba P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82f27bcdf252425aad4c4a37d064f68d in term 1.
I20260709 12:27:39.344849 17210 raft_consensus.cc:493] T 9067b67140fa48e883d2d240a6046d63 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:39.345531 16867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c655b68dc545948c67e0977b49e770" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:39.345477 17210 raft_consensus.cc:515] T 9067b67140fa48e883d2d240a6046d63 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:39.347957 17634 raft_consensus.cc:515] T 51ebab30b5104589803b75a1b48c5aa2 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:39.348830 17210 leader_election.cc:290] T 9067b67140fa48e883d2d240a6046d63 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
I20260709 12:27:39.350301 17634 leader_election.cc:290] T 51ebab30b5104589803b75a1b48c5aa2 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 election: Requested vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:39.352203 17646 leader_election.cc:290] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 election: Requested vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:39.355624 16867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f2b93e5d2045a5a0cd1f9b5806a133" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336"
I20260709 12:27:39.356894 16867 raft_consensus.cc:2393] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 82f27bcdf252425aad4c4a37d064f68d in current term 2: Already voted for candidate 17294485b7f24e2b9fae71dd3169a336 in this term.
W20260709 12:27:39.356112 16833 leader_election.cc:336] T 27dda31a8cd1468eb3a824ae026485a3 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
W20260709 12:27:39.360239 16833 leader_election.cc:336] T b86527b8a77848629c50a32e2534f7ba P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:39.360709 16833 leader_election.cc:304] T b86527b8a77848629c50a32e2534f7ba P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336; no voters: 82f27bcdf252425aad4c4a37d064f68d, 879366e90f5c420588945e0d545017c8
I20260709 12:27:39.361632 17650 raft_consensus.cc:2749] T b86527b8a77848629c50a32e2534f7ba P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:27:39.361819 16833 leader_election.cc:336] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:39.330116 17567 leader_election.cc:290] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 election: Requested vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:39.367415 17650 raft_consensus.cc:493] T 840a644e56054e13bfd7585fa064120c P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:39.368165 17650 raft_consensus.cc:515] T 840a644e56054e13bfd7585fa064120c P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:39.371937 16789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840a644e56054e13bfd7585fa064120c" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
I20260709 12:27:39.372733 16789 raft_consensus.cc:2468] T 840a644e56054e13bfd7585fa064120c P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 1.
I20260709 12:27:39.373817 17646 raft_consensus.cc:493] T cd637126e0044d7996f18e258282a145 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:39.374348 16834 leader_election.cc:304] T 840a644e56054e13bfd7585fa064120c P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 3c1aba6ee1d244fd9c0daba722aa0b3b; no voters: 
I20260709 12:27:39.374426 17646 raft_consensus.cc:515] T cd637126e0044d7996f18e258282a145 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:39.375417 17620 raft_consensus.cc:2804] T 840a644e56054e13bfd7585fa064120c P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:39.376132 17620 raft_consensus.cc:493] T 840a644e56054e13bfd7585fa064120c P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:39.376682 17620 raft_consensus.cc:3060] T 840a644e56054e13bfd7585fa064120c P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:39.307089 17516 raft_consensus.cc:515] T 6e89df746e0c49d184637314ce87045a P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:39.377091 17646 leader_election.cc:290] T cd637126e0044d7996f18e258282a145 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:39.378131 16863 raft_consensus.cc:2393] T 6e89df746e0c49d184637314ce87045a P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in current term 2: Already voted for candidate 17294485b7f24e2b9fae71dd3169a336 in this term.
I20260709 12:27:39.382789 16867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840a644e56054e13bfd7585fa064120c" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:39.368166 16907 leader_election.cc:304] T b86527b8a77848629c50a32e2534f7ba P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 82f27bcdf252425aad4c4a37d064f68d; no voters: 
I20260709 12:27:39.387467 16935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1e8d1852ae457db7e3be5b6957f1b3" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:39.388695 17634 raft_consensus.cc:2804] T b86527b8a77848629c50a32e2534f7ba P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:39.388721 16935 raft_consensus.cc:2468] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in term 1.
I20260709 12:27:39.389338 17634 raft_consensus.cc:493] T b86527b8a77848629c50a32e2534f7ba P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:39.389927 17634 raft_consensus.cc:3060] T b86527b8a77848629c50a32e2534f7ba P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:39.394966 17646 raft_consensus.cc:493] T 28c655b68dc545948c67e0977b49e770 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:39.395665 17631 tablet_bootstrap.cc:492] T 62e4e875fd4e4604952120df324e99cb P 879366e90f5c420588945e0d545017c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:27:39.398264 16907 leader_election.cc:336] T 442e0dfc272840f7a14c2232ed65425c P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:39.398692 16907 leader_election.cc:304] T 442e0dfc272840f7a14c2232ed65425c P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8
I20260709 12:27:39.400182 17613 raft_consensus.cc:2749] T 442e0dfc272840f7a14c2232ed65425c P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:27:39.401453 16907 leader_election.cc:336] T 3d614e06fd2c40189161e22ad9217e5d P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:39.401873 16907 leader_election.cc:304] T 3d614e06fd2c40189161e22ad9217e5d P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8
I20260709 12:27:39.397750 17646 raft_consensus.cc:515] T 28c655b68dc545948c67e0977b49e770 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:39.404348 17646 leader_election.cc:290] T 28c655b68dc545948c67e0977b49e770 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:39.404896 17631 tablet_bootstrap.cc:492] T 62e4e875fd4e4604952120df324e99cb P 879366e90f5c420588945e0d545017c8: Bootstrap complete.
I20260709 12:27:39.405740 17631 ts_tablet_manager.cc:1403] T 62e4e875fd4e4604952120df324e99cb P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.145s	user 0.012s	sys 0.007s
W20260709 12:27:39.406759 16907 leader_election.cc:336] T a8a632c738e94b26a8352a68a42a0670 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:39.407187 16863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e477f70d4c8d466e9d45e6645e2a2869" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:39.407451 16907 leader_election.cc:304] T a8a632c738e94b26a8352a68a42a0670 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8
I20260709 12:27:39.407827 16863 raft_consensus.cc:2468] T e477f70d4c8d466e9d45e6645e2a2869 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in term 1.
W20260709 12:27:39.408569 16907 leader_election.cc:336] T 51ebab30b5104589803b75a1b48c5aa2 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:39.352228 17647 leader_election.cc:290] T 3d614e06fd2c40189161e22ad9217e5d P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 3 election: Requested vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:39.412946 16861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e628dacc30694988a7c795441df15600" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:39.413465 16863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ebab30b5104589803b75a1b48c5aa2" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336"
I20260709 12:27:39.424782 16863 raft_consensus.cc:3060] T 51ebab30b5104589803b75a1b48c5aa2 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:39.413033 17613 raft_consensus.cc:3060] T 3d614e06fd2c40189161e22ad9217e5d P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:39.412930 17567 raft_consensus.cc:2749] T a8a632c738e94b26a8352a68a42a0670 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:39.433079 16935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442e0dfc272840f7a14c2232ed65425c" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:39.434556 17605 raft_consensus.cc:515] T a4252af16e15424399c32c789c8e6c23 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:39.385905 17650 leader_election.cc:290] T 840a644e56054e13bfd7585fa064120c P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:39.440791 17613 raft_consensus.cc:2749] T 3d614e06fd2c40189161e22ad9217e5d P 82f27bcdf252425aad4c4a37d064f68d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:39.416917 17632 raft_consensus.cc:515] T 8eaf179090b14105b52c4701d5599216 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:39.418468 17634 raft_consensus.cc:515] T b86527b8a77848629c50a32e2534f7ba P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:39.443010 17632 leader_election.cc:290] T 8eaf179090b14105b52c4701d5599216 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 2 election: Requested vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:39.443994 17634 leader_election.cc:290] T b86527b8a77848629c50a32e2534f7ba P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 election: Requested vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:39.444226 17516 leader_election.cc:290] T 6e89df746e0c49d184637314ce87045a P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 election: Requested vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:39.420137 17631 raft_consensus.cc:359] T 62e4e875fd4e4604952120df324e99cb P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:39.445186 17631 raft_consensus.cc:740] T 62e4e875fd4e4604952120df324e99cb P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:39.444936 16790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4252af16e15424399c32c789c8e6c23" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b"
I20260709 12:27:39.445956 17605 leader_election.cc:290] T a4252af16e15424399c32c789c8e6c23 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 election: Requested vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:39.446164 16790 raft_consensus.cc:3060] T a4252af16e15424399c32c789c8e6c23 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:39.421470 17620 raft_consensus.cc:515] T 840a644e56054e13bfd7585fa064120c P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:39.422992 16789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd637126e0044d7996f18e258282a145" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
I20260709 12:27:39.450065 16789 raft_consensus.cc:2468] T cd637126e0044d7996f18e258282a145 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 1.
I20260709 12:27:39.426452 16833 leader_election.cc:304] T 288d05b8017c4e0f8cd40048647aecae P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 82f27bcdf252425aad4c4a37d064f68d; no voters: 
I20260709 12:27:39.434742 16935 raft_consensus.cc:2468] T 442e0dfc272840f7a14c2232ed65425c P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in term 1.
I20260709 12:27:39.437338 16933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8a632c738e94b26a8352a68a42a0670" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:39.451462 16788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840a644e56054e13bfd7585fa064120c" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b"
I20260709 12:27:39.451498 16833 leader_election.cc:304] T 27dda31a8cd1468eb3a824ae026485a3 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 82f27bcdf252425aad4c4a37d064f68d; no voters: 879366e90f5c420588945e0d545017c8
I20260709 12:27:39.451978 16933 raft_consensus.cc:2468] T a8a632c738e94b26a8352a68a42a0670 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in term 1.
I20260709 12:27:39.452227 17620 leader_election.cc:290] T 840a644e56054e13bfd7585fa064120c P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 election: Requested vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:39.452420 16788 raft_consensus.cc:3060] T 840a644e56054e13bfd7585fa064120c P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:39.452873 17620 raft_consensus.cc:2804] T 27dda31a8cd1468eb3a824ae026485a3 P 17294485b7f24e2b9fae71dd3169a336 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:39.453413 17620 raft_consensus.cc:697] T 27dda31a8cd1468eb3a824ae026485a3 P 17294485b7f24e2b9fae71dd3169a336 [term 3 LEADER]: Becoming Leader. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Running, Role: LEADER
I20260709 12:27:39.451715 17516 raft_consensus.cc:2804] T 288d05b8017c4e0f8cd40048647aecae P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:39.454066 17516 raft_consensus.cc:493] T 288d05b8017c4e0f8cd40048647aecae P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:39.454447 17516 raft_consensus.cc:3060] T 288d05b8017c4e0f8cd40048647aecae P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:39.454566 17620 consensus_queue.cc:237] T 27dda31a8cd1468eb3a824ae026485a3 P 17294485b7f24e2b9fae71dd3169a336 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:39.439678 16863 raft_consensus.cc:2468] T 51ebab30b5104589803b75a1b48c5aa2 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82f27bcdf252425aad4c4a37d064f68d in term 2.
I20260709 12:27:39.447768 16792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e89df746e0c49d184637314ce87045a" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b"
I20260709 12:27:39.446507 17631 consensus_queue.cc:260] T 62e4e875fd4e4604952120df324e99cb P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:39.448704 17605 raft_consensus.cc:493] T 9067b67140fa48e883d2d240a6046d63 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:39.449544 16867 raft_consensus.cc:2393] T 840a644e56054e13bfd7585fa064120c P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in current term 2: Already voted for candidate 17294485b7f24e2b9fae71dd3169a336 in this term.
I20260709 12:27:39.451488 16834 leader_election.cc:304] T cd637126e0044d7996f18e258282a145 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 3c1aba6ee1d244fd9c0daba722aa0b3b; no voters: 
W20260709 12:27:39.415067 16759 leader_election.cc:336] T cd637126e0044d7996f18e258282a145 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
W20260709 12:27:39.438290 16907 leader_election.cc:336] T 28c655b68dc545948c67e0977b49e770 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:39.460035 16792 raft_consensus.cc:3060] T 6e89df746e0c49d184637314ce87045a P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:39.462695 16759 leader_election.cc:304] T cd637126e0044d7996f18e258282a145 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b; no voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8
I20260709 12:27:39.462781 16907 leader_election.cc:304] T 28c655b68dc545948c67e0977b49e770 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8
W20260709 12:27:39.464083 16907 leader_election.cc:336] T 6a86fc21ef0044bb91dd271c9a019336 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:39.464514 17613 raft_consensus.cc:2749] T 28c655b68dc545948c67e0977b49e770 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:27:39.466187 16759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:39833, user_credentials={real_user=slave}} blocked reactor thread for 51121us
I20260709 12:27:39.464519 16907 leader_election.cc:304] T 6a86fc21ef0044bb91dd271c9a019336 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8
W20260709 12:27:39.467031 16759 leader_election.cc:336] T 6e89df746e0c49d184637314ce87045a P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
W20260709 12:27:39.468288 16907 leader_election.cc:336] T b86527b8a77848629c50a32e2534f7ba P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
W20260709 12:27:39.468411 16759 leader_election.cc:336] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
W20260709 12:27:39.469137 16907 leader_election.cc:336] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
W20260709 12:27:39.469367 16759 leader_election.cc:336] T 840a644e56054e13bfd7585fa064120c P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:39.470153 17634 raft_consensus.cc:2749] T 6a86fc21ef0044bb91dd271c9a019336 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:39.467051 17632 raft_consensus.cc:2749] T cd637126e0044d7996f18e258282a145 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:39.469587 16907 leader_election.cc:304] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8
I20260709 12:27:39.472343 17634 raft_consensus.cc:2749] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:27:39.472523 16792 raft_consensus.cc:2468] T 6e89df746e0c49d184637314ce87045a P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 2.
I20260709 12:27:39.474088 16788 raft_consensus.cc:2468] T 840a644e56054e13bfd7585fa064120c P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 2.
I20260709 12:27:39.479852 17605 raft_consensus.cc:515] T 9067b67140fa48e883d2d240a6046d63 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:39.489401 17647 raft_consensus.cc:2804] T cd637126e0044d7996f18e258282a145 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:39.489956 17647 raft_consensus.cc:493] T cd637126e0044d7996f18e258282a145 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:39.491168 16907 leader_election.cc:304] T 51ebab30b5104589803b75a1b48c5aa2 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 82f27bcdf252425aad4c4a37d064f68d; no voters: 
I20260709 12:27:39.491374 16867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86527b8a77848629c50a32e2534f7ba" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336"
I20260709 12:27:39.490327 17647 raft_consensus.cc:3060] T cd637126e0044d7996f18e258282a145 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:39.493295 16867 raft_consensus.cc:3060] T b86527b8a77848629c50a32e2534f7ba P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:39.490284 16834 leader_election.cc:304] T 6e89df746e0c49d184637314ce87045a P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 3c1aba6ee1d244fd9c0daba722aa0b3b; no voters: 
I20260709 12:27:39.495267 16834 leader_election.cc:304] T 840a644e56054e13bfd7585fa064120c P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 3c1aba6ee1d244fd9c0daba722aa0b3b; no voters: 
I20260709 12:27:39.496979 17631 ts_tablet_manager.cc:1434] T 62e4e875fd4e4604952120df324e99cb P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.091s	user 0.009s	sys 0.001s
I20260709 12:27:39.498304 17631 tablet_bootstrap.cc:492] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:39.500927 17643 raft_consensus.cc:2804] T 6e89df746e0c49d184637314ce87045a P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:39.501897 17210 raft_consensus.cc:493] T 6916ee6a900c46508c98006aa85fe2d9 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 879366e90f5c420588945e0d545017c8)
W20260709 12:27:39.502115 16907 leader_election.cc:336] T 51ebab30b5104589803b75a1b48c5aa2 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:39.502631 17210 raft_consensus.cc:515] T 6916ee6a900c46508c98006aa85fe2d9 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:39.506708 16867 raft_consensus.cc:2468] T b86527b8a77848629c50a32e2534f7ba P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82f27bcdf252425aad4c4a37d064f68d in term 2.
W20260709 12:27:39.509975 16833 leader_election.cc:336] T a4252af16e15424399c32c789c8e6c23 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:39.509184 16907 leader_election.cc:304] T b86527b8a77848629c50a32e2534f7ba P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 82f27bcdf252425aad4c4a37d064f68d; no voters: 
I20260709 12:27:39.493574 17634 raft_consensus.cc:2804] T 51ebab30b5104589803b75a1b48c5aa2 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:39.507836 17649 raft_consensus.cc:2804] T 840a644e56054e13bfd7585fa064120c P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:39.537111 16935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f2b93e5d2045a5a0cd1f9b5806a133" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d"
I20260709 12:27:39.562559 17649 raft_consensus.cc:697] T 840a644e56054e13bfd7585fa064120c P 17294485b7f24e2b9fae71dd3169a336 [term 2 LEADER]: Becoming Leader. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Running, Role: LEADER
I20260709 12:27:39.563378 16935 raft_consensus.cc:2393] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 17294485b7f24e2b9fae71dd3169a336 in current term 2: Already voted for candidate 82f27bcdf252425aad4c4a37d064f68d in this term.
I20260709 12:27:39.532277 17210 leader_election.cc:290] T 6916ee6a900c46508c98006aa85fe2d9 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919)
I20260709 12:27:39.565259 17605 leader_election.cc:290] T 9067b67140fa48e883d2d240a6046d63 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:39.564282 17649 consensus_queue.cc:237] T 840a644e56054e13bfd7585fa064120c P 17294485b7f24e2b9fae71dd3169a336 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:39.512212 16937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d614e06fd2c40189161e22ad9217e5d" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d"
W20260709 12:27:39.568694 16833 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:39833, user_credentials={real_user=slave}} blocked reactor thread for 58759us
W20260709 12:27:39.569411 16833 leader_election.cc:336] T 288d05b8017c4e0f8cd40048647aecae P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:39.532366 17643 raft_consensus.cc:697] T 6e89df746e0c49d184637314ce87045a P 17294485b7f24e2b9fae71dd3169a336 [term 2 LEADER]: Becoming Leader. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Running, Role: LEADER
I20260709 12:27:39.572105 17634 raft_consensus.cc:697] T 51ebab30b5104589803b75a1b48c5aa2 P 82f27bcdf252425aad4c4a37d064f68d [term 2 LEADER]: Becoming Leader. State: Replica: 82f27bcdf252425aad4c4a37d064f68d, State: Running, Role: LEADER
I20260709 12:27:39.572641 17643 consensus_queue.cc:237] T 6e89df746e0c49d184637314ce87045a P 17294485b7f24e2b9fae71dd3169a336 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:39.573258 17634 consensus_queue.cc:237] T 51ebab30b5104589803b75a1b48c5aa2 P 82f27bcdf252425aad4c4a37d064f68d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:39.537633 16790 raft_consensus.cc:2468] T a4252af16e15424399c32c789c8e6c23 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 2.
I20260709 12:27:39.509059 17562 raft_consensus.cc:493] T 6a86fc21ef0044bb91dd271c9a019336 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:39.576167 16834 leader_election.cc:304] T a4252af16e15424399c32c789c8e6c23 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 3c1aba6ee1d244fd9c0daba722aa0b3b; no voters: 
I20260709 12:27:39.577082 17567 raft_consensus.cc:2804] T b86527b8a77848629c50a32e2534f7ba P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:39.577704 17567 raft_consensus.cc:697] T b86527b8a77848629c50a32e2534f7ba P 82f27bcdf252425aad4c4a37d064f68d [term 2 LEADER]: Becoming Leader. State: Replica: 82f27bcdf252425aad4c4a37d064f68d, State: Running, Role: LEADER
I20260709 12:27:39.575925 17562 raft_consensus.cc:515] T 6a86fc21ef0044bb91dd271c9a019336 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:39.578532 17567 consensus_queue.cc:237] T b86527b8a77848629c50a32e2534f7ba P 82f27bcdf252425aad4c4a37d064f68d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:39.577001 16789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9067b67140fa48e883d2d240a6046d63" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
I20260709 12:27:39.580175 16789 raft_consensus.cc:2468] T 9067b67140fa48e883d2d240a6046d63 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 1.
I20260709 12:27:39.581319 17562 leader_election.cc:290] T 6a86fc21ef0044bb91dd271c9a019336 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:39.581781 16937 raft_consensus.cc:2468] T 3d614e06fd2c40189161e22ad9217e5d P 82f27bcdf252425aad4c4a37d064f68d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 3.
I20260709 12:27:39.582006 16834 leader_election.cc:304] T 9067b67140fa48e883d2d240a6046d63 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 3c1aba6ee1d244fd9c0daba722aa0b3b; no voters: 
W20260709 12:27:39.584874 16907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:38103, user_credentials={real_user=slave}} blocked reactor thread for 75869.5us
I20260709 12:27:39.589285 17516 raft_consensus.cc:515] T 288d05b8017c4e0f8cd40048647aecae P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
W20260709 12:27:39.589977 16907 leader_election.cc:336] T b86527b8a77848629c50a32e2534f7ba P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
W20260709 12:27:39.590622 16759 leader_election.cc:336] T e628dacc30694988a7c795441df15600 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:39.586447 17646 raft_consensus.cc:2804] T a4252af16e15424399c32c789c8e6c23 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:27:39.592792 16759 leader_election.cc:336] T e477f70d4c8d466e9d45e6645e2a2869 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
W20260709 12:27:39.595681 16759 leader_election.cc:336] T 442e0dfc272840f7a14c2232ed65425c P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
W20260709 12:27:39.596700 16759 leader_election.cc:336] T a8a632c738e94b26a8352a68a42a0670 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:39.593686 17646 raft_consensus.cc:697] T a4252af16e15424399c32c789c8e6c23 P 17294485b7f24e2b9fae71dd3169a336 [term 2 LEADER]: Becoming Leader. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Running, Role: LEADER
I20260709 12:27:39.597343 16935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eaf179090b14105b52c4701d5599216" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d"
I20260709 12:27:39.599750 17516 leader_election.cc:290] T 288d05b8017c4e0f8cd40048647aecae P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 election: Requested vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
W20260709 12:27:39.597141 16759 leader_election.cc:336] T 9067b67140fa48e883d2d240a6046d63 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:39.598410 17646 consensus_queue.cc:237] T a4252af16e15424399c32c789c8e6c23 P 17294485b7f24e2b9fae71dd3169a336 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:39.605216 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c655b68dc545948c67e0977b49e770" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:39.606033 16942 raft_consensus.cc:2468] T 28c655b68dc545948c67e0977b49e770 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 1.
I20260709 12:27:39.599822 16935 raft_consensus.cc:3060] T 8eaf179090b14105b52c4701d5599216 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:39.608338 17665 raft_consensus.cc:2804] T 9067b67140fa48e883d2d240a6046d63 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:39.608945 17665 raft_consensus.cc:493] T 9067b67140fa48e883d2d240a6046d63 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:39.611532 17665 raft_consensus.cc:3060] T 9067b67140fa48e883d2d240a6046d63 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:39.614099 16933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6916ee6a900c46508c98006aa85fe2d9" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:39.615484 16933 raft_consensus.cc:2468] T 6916ee6a900c46508c98006aa85fe2d9 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in term 1.
I20260709 12:27:39.626273 17631 tablet_bootstrap.cc:492] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 879366e90f5c420588945e0d545017c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:39.628005 17631 tablet_bootstrap.cc:492] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 879366e90f5c420588945e0d545017c8: Bootstrap complete.
I20260709 12:27:39.628768 17631 ts_tablet_manager.cc:1403] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.131s	user 0.018s	sys 0.008s
I20260709 12:27:39.630897 16935 raft_consensus.cc:2468] T 8eaf179090b14105b52c4701d5599216 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in term 2.
I20260709 12:27:39.631561 17631 raft_consensus.cc:359] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:39.601310 17647 raft_consensus.cc:515] T cd637126e0044d7996f18e258282a145 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:39.634307 17647 leader_election.cc:290] T cd637126e0044d7996f18e258282a145 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 election: Requested vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:39.635751 16789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd637126e0044d7996f18e258282a145" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b"
I20260709 12:27:39.632351 17631 raft_consensus.cc:740] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:39.637820 16789 raft_consensus.cc:3060] T cd637126e0044d7996f18e258282a145 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:39.640013 17631 consensus_queue.cc:260] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:39.647194 17631 ts_tablet_manager.cc:1434] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.001s
I20260709 12:27:39.648190 17631 tablet_bootstrap.cc:492] T e628dacc30694988a7c795441df15600 P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:39.649598 16933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a86fc21ef0044bb91dd271c9a019336" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:39.650616 16933 raft_consensus.cc:2468] T 6a86fc21ef0044bb91dd271c9a019336 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in term 1.
I20260709 12:27:39.651638 16759 leader_election.cc:304] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 82f27bcdf252425aad4c4a37d064f68d; no voters: 879366e90f5c420588945e0d545017c8
I20260709 12:27:39.655943 17667 raft_consensus.cc:2804] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:39.656522 17667 raft_consensus.cc:493] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:39.657372 17667 raft_consensus.cc:3060] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:39.664037 16613 catalog_manager.cc:5697] T 27f104a1ba60493ab47f6b876da48d67 P 17294485b7f24e2b9fae71dd3169a336 reported cstate change: term changed from 1 to 2, leader changed from 879366e90f5c420588945e0d545017c8 (127.9.116.65) to 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67). New cstate: current_term: 2 leader_uuid: "17294485b7f24e2b9fae71dd3169a336" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:39.672518 16759 leader_election.cc:304] T 442e0dfc272840f7a14c2232ed65425c P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 82f27bcdf252425aad4c4a37d064f68d; no voters: 879366e90f5c420588945e0d545017c8
I20260709 12:27:39.673954 17666 raft_consensus.cc:2804] T 442e0dfc272840f7a14c2232ed65425c P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:39.674258 16759 leader_election.cc:304] T a8a632c738e94b26a8352a68a42a0670 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 82f27bcdf252425aad4c4a37d064f68d; no voters: 879366e90f5c420588945e0d545017c8
I20260709 12:27:39.674635 17666 raft_consensus.cc:493] T 442e0dfc272840f7a14c2232ed65425c P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:39.675205 17666 raft_consensus.cc:3060] T 442e0dfc272840f7a14c2232ed65425c P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:39.675406 17562 raft_consensus.cc:2804] T a8a632c738e94b26a8352a68a42a0670 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:39.676069 17562 raft_consensus.cc:493] T a8a632c738e94b26a8352a68a42a0670 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:39.676437 17562 raft_consensus.cc:3060] T a8a632c738e94b26a8352a68a42a0670 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:39.689433 16789 raft_consensus.cc:2468] T cd637126e0044d7996f18e258282a145 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 2.
I20260709 12:27:39.691347 16834 leader_election.cc:304] T cd637126e0044d7996f18e258282a145 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 3c1aba6ee1d244fd9c0daba722aa0b3b; no voters: 
I20260709 12:27:39.692374 17647 raft_consensus.cc:2804] T cd637126e0044d7996f18e258282a145 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:39.692916 17647 raft_consensus.cc:697] T cd637126e0044d7996f18e258282a145 P 17294485b7f24e2b9fae71dd3169a336 [term 2 LEADER]: Becoming Leader. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Running, Role: LEADER
I20260709 12:27:39.693877 17647 consensus_queue.cc:237] T cd637126e0044d7996f18e258282a145 P 17294485b7f24e2b9fae71dd3169a336 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:39.710457 17562 raft_consensus.cc:515] T a8a632c738e94b26a8352a68a42a0670 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
W20260709 12:27:39.717716 16759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37919, user_credentials={real_user=slave}} blocked reactor thread for 43558.6us
I20260709 12:27:39.763242 16867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9067b67140fa48e883d2d240a6046d63" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:39.714769 17562 leader_election.cc:290] T a8a632c738e94b26a8352a68a42a0670 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 2 election: Requested vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:39.755168 17667 raft_consensus.cc:515] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
W20260709 12:27:39.776907 16833 leader_election.cc:336] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
W20260709 12:27:39.777624 16833 leader_election.cc:336] T 3d614e06fd2c40189161e22ad9217e5d P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
W20260709 12:27:39.778083 16833 leader_election.cc:336] T 840a644e56054e13bfd7585fa064120c P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:39.780203 16759 leader_election.cc:304] T 6916ee6a900c46508c98006aa85fe2d9 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 82f27bcdf252425aad4c4a37d064f68d; no voters: 
I20260709 12:27:39.781997 17632 raft_consensus.cc:2804] T 6916ee6a900c46508c98006aa85fe2d9 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:39.782862 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "288d05b8017c4e0f8cd40048647aecae" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d"
I20260709 12:27:39.783823 16942 raft_consensus.cc:3060] T 288d05b8017c4e0f8cd40048647aecae P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:39.782441 17632 raft_consensus.cc:493] T 6916ee6a900c46508c98006aa85fe2d9 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:39.768656 17647 raft_consensus.cc:493] T e628dacc30694988a7c795441df15600 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:39.782675 17667 leader_election.cc:290] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 2 election: Requested vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:39.790946 17632 raft_consensus.cc:3060] T 6916ee6a900c46508c98006aa85fe2d9 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:39.791500 17647 raft_consensus.cc:515] T e628dacc30694988a7c795441df15600 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:39.794651 17647 leader_election.cc:290] T e628dacc30694988a7c795441df15600 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:39.800006 16789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e628dacc30694988a7c795441df15600" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
I20260709 12:27:39.804862 16789 raft_consensus.cc:2468] T e628dacc30694988a7c795441df15600 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 1.
I20260709 12:27:39.795504 17631 tablet_bootstrap.cc:492] T e628dacc30694988a7c795441df15600 P 879366e90f5c420588945e0d545017c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:39.807204 16834 leader_election.cc:304] T e628dacc30694988a7c795441df15600 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 3c1aba6ee1d244fd9c0daba722aa0b3b; no voters: 
I20260709 12:27:39.756685 17666 raft_consensus.cc:515] T 442e0dfc272840f7a14c2232ed65425c P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:39.814005 17631 tablet_bootstrap.cc:492] T e628dacc30694988a7c795441df15600 P 879366e90f5c420588945e0d545017c8: Bootstrap complete.
I20260709 12:27:39.814901 17631 ts_tablet_manager.cc:1403] T e628dacc30694988a7c795441df15600 P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.167s	user 0.029s	sys 0.008s
W20260709 12:27:39.815119 17672 log.cc:927] Time spent T b86527b8a77848629c50a32e2534f7ba P 82f27bcdf252425aad4c4a37d064f68d: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 12:27:39.816668 17677 log.cc:927] Time spent T cd637126e0044d7996f18e258282a145 P 17294485b7f24e2b9fae71dd3169a336: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:27:39.810985 17649 raft_consensus.cc:2804] T e628dacc30694988a7c795441df15600 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:39.810323 16759 leader_election.cc:304] T 8eaf179090b14105b52c4701d5599216 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 82f27bcdf252425aad4c4a37d064f68d; no voters: 
I20260709 12:27:39.770263 17665 raft_consensus.cc:515] T 9067b67140fa48e883d2d240a6046d63 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:39.818800 17210 raft_consensus.cc:2804] T 8eaf179090b14105b52c4701d5599216 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:39.819692 17210 raft_consensus.cc:697] T 8eaf179090b14105b52c4701d5599216 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 LEADER]: Becoming Leader. State: Replica: 3c1aba6ee1d244fd9c0daba722aa0b3b, State: Running, Role: LEADER
I20260709 12:27:39.817745 17631 raft_consensus.cc:359] T e628dacc30694988a7c795441df15600 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:39.824029 17631 raft_consensus.cc:740] T e628dacc30694988a7c795441df15600 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:39.817651 17649 raft_consensus.cc:493] T e628dacc30694988a7c795441df15600 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:39.825477 17631 consensus_queue.cc:260] T e628dacc30694988a7c795441df15600 P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:39.827486 17649 raft_consensus.cc:3060] T e628dacc30694988a7c795441df15600 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:39.827708 17666 leader_election.cc:290] T 442e0dfc272840f7a14c2232ed65425c P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 2 election: Requested vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:39.827981 17665 leader_election.cc:290] T 9067b67140fa48e883d2d240a6046d63 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 election: Requested vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:39.829003 16867 raft_consensus.cc:2393] T 9067b67140fa48e883d2d240a6046d63 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in current term 2: Already voted for candidate 17294485b7f24e2b9fae71dd3169a336 in this term.
I20260709 12:27:39.831537 16790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9067b67140fa48e883d2d240a6046d63" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b"
I20260709 12:27:39.832455 16790 raft_consensus.cc:3060] T 9067b67140fa48e883d2d240a6046d63 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:39.835419 16833 leader_election.cc:304] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336; no voters: 82f27bcdf252425aad4c4a37d064f68d, 879366e90f5c420588945e0d545017c8
I20260709 12:27:39.820749 17210 consensus_queue.cc:237] T 8eaf179090b14105b52c4701d5599216 P 3c1aba6ee1d244fd9c0daba722aa0b3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:39.836830 17631 ts_tablet_manager.cc:1434] T e628dacc30694988a7c795441df15600 P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.003s
I20260709 12:27:39.825700 16759 leader_election.cc:304] T 6a86fc21ef0044bb91dd271c9a019336 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 82f27bcdf252425aad4c4a37d064f68d; no voters: 
I20260709 12:27:39.841588 17667 raft_consensus.cc:2804] T 6a86fc21ef0044bb91dd271c9a019336 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:39.836360 17632 raft_consensus.cc:515] T 6916ee6a900c46508c98006aa85fe2d9 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:39.842129 17667 raft_consensus.cc:493] T 6a86fc21ef0044bb91dd271c9a019336 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:39.842687 17667 raft_consensus.cc:3060] T 6a86fc21ef0044bb91dd271c9a019336 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:39.844317 17632 leader_election.cc:290] T 6916ee6a900c46508c98006aa85fe2d9 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 2 election: Requested vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919)
I20260709 12:27:39.844606 16942 raft_consensus.cc:2468] T 288d05b8017c4e0f8cd40048647aecae P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 2.
I20260709 12:27:39.837849 17631 tablet_bootstrap.cc:492] T 3649e7bb023a4958a01ad5ecbe446f0f P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:39.838225 17620 raft_consensus.cc:2749] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:27:39.847362 16759 leader_election.cc:336] T 8eaf179090b14105b52c4701d5599216 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:39.848869 17649 raft_consensus.cc:515] T e628dacc30694988a7c795441df15600 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:39.839313 16833 leader_election.cc:304] T 3d614e06fd2c40189161e22ad9217e5d P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 82f27bcdf252425aad4c4a37d064f68d; no voters: 879366e90f5c420588945e0d545017c8
I20260709 12:27:39.851125 16790 raft_consensus.cc:2468] T 9067b67140fa48e883d2d240a6046d63 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 2.
I20260709 12:27:39.852669 16789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e628dacc30694988a7c795441df15600" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b"
I20260709 12:27:39.853327 16789 raft_consensus.cc:3060] T e628dacc30694988a7c795441df15600 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:39.853689 16834 leader_election.cc:304] T 9067b67140fa48e883d2d240a6046d63 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 3c1aba6ee1d244fd9c0daba722aa0b3b; no voters: 
I20260709 12:27:39.854506 17646 raft_consensus.cc:2804] T 9067b67140fa48e883d2d240a6046d63 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:39.855069 17646 raft_consensus.cc:697] T 9067b67140fa48e883d2d240a6046d63 P 17294485b7f24e2b9fae71dd3169a336 [term 2 LEADER]: Becoming Leader. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Running, Role: LEADER
I20260709 12:27:39.856112 17646 consensus_queue.cc:237] T 9067b67140fa48e883d2d240a6046d63 P 17294485b7f24e2b9fae71dd3169a336 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:39.860340 16935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8a632c738e94b26a8352a68a42a0670" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d"
I20260709 12:27:39.860895 16789 raft_consensus.cc:2468] T e628dacc30694988a7c795441df15600 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 2.
I20260709 12:27:39.861208 16935 raft_consensus.cc:3060] T a8a632c738e94b26a8352a68a42a0670 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:39.862434 16933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1e8d1852ae457db7e3be5b6957f1b3" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d"
I20260709 12:27:39.863699 16933 raft_consensus.cc:3060] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:39.867528 16937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442e0dfc272840f7a14c2232ed65425c" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d"
I20260709 12:27:39.868463 16937 raft_consensus.cc:3060] T 442e0dfc272840f7a14c2232ed65425c P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:39.870376 16834 leader_election.cc:304] T e628dacc30694988a7c795441df15600 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 3c1aba6ee1d244fd9c0daba722aa0b3b; no voters: 
I20260709 12:27:39.871336 17646 raft_consensus.cc:2804] T e628dacc30694988a7c795441df15600 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:39.871770 16759 leader_election.cc:304] T 6e89df746e0c49d184637314ce87045a P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b; no voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8
I20260709 12:27:39.872028 17646 raft_consensus.cc:697] T e628dacc30694988a7c795441df15600 P 17294485b7f24e2b9fae71dd3169a336 [term 2 LEADER]: Becoming Leader. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Running, Role: LEADER
I20260709 12:27:39.873214 17682 raft_consensus.cc:2749] T 6e89df746e0c49d184637314ce87045a P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:39.851961 17620 raft_consensus.cc:2804] T 3d614e06fd2c40189161e22ad9217e5d P 17294485b7f24e2b9fae71dd3169a336 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:39.875010 17620 raft_consensus.cc:697] T 3d614e06fd2c40189161e22ad9217e5d P 17294485b7f24e2b9fae71dd3169a336 [term 3 LEADER]: Becoming Leader. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Running, Role: LEADER
I20260709 12:27:39.874552 17646 consensus_queue.cc:237] T e628dacc30694988a7c795441df15600 P 17294485b7f24e2b9fae71dd3169a336 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:39.875912 17620 consensus_queue.cc:237] T 3d614e06fd2c40189161e22ad9217e5d P 17294485b7f24e2b9fae71dd3169a336 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:39.877853 16759 leader_election.cc:304] T e477f70d4c8d466e9d45e6645e2a2869 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 3c1aba6ee1d244fd9c0daba722aa0b3b; no voters: 879366e90f5c420588945e0d545017c8
I20260709 12:27:39.878758 17682 raft_consensus.cc:2804] T e477f70d4c8d466e9d45e6645e2a2869 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:39.879190 17682 raft_consensus.cc:493] T e477f70d4c8d466e9d45e6645e2a2869 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:39.879643 17682 raft_consensus.cc:3060] T e477f70d4c8d466e9d45e6645e2a2869 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:39.855175 16616 catalog_manager.cc:5697] T 51ebab30b5104589803b75a1b48c5aa2 P 82f27bcdf252425aad4c4a37d064f68d reported cstate change: term changed from 1 to 2, leader changed from 879366e90f5c420588945e0d545017c8 (127.9.116.65) to 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68). New cstate: current_term: 2 leader_uuid: "82f27bcdf252425aad4c4a37d064f68d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: UNKNOWN } } }
W20260709 12:27:39.884280 16833 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37919, user_credentials={real_user=slave}} blocked reactor thread for 45067us
I20260709 12:27:39.884908 16937 raft_consensus.cc:2468] T 442e0dfc272840f7a14c2232ed65425c P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in term 2.
I20260709 12:27:39.885421 16833 leader_election.cc:304] T 28c655b68dc545948c67e0977b49e770 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 82f27bcdf252425aad4c4a37d064f68d; no voters: 
I20260709 12:27:39.886490 16933 raft_consensus.cc:2468] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in term 2.
I20260709 12:27:39.887269 17647 raft_consensus.cc:2804] T 28c655b68dc545948c67e0977b49e770 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:39.891904 17647 raft_consensus.cc:493] T 28c655b68dc545948c67e0977b49e770 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:39.892448 17647 raft_consensus.cc:3060] T 28c655b68dc545948c67e0977b49e770 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:39.894104 16759 leader_election.cc:304] T e628dacc30694988a7c795441df15600 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b; no voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8
I20260709 12:27:39.896113 17666 raft_consensus.cc:2749] T e628dacc30694988a7c795441df15600 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:39.896565 16759 leader_election.cc:304] T 840a644e56054e13bfd7585fa064120c P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b; no voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8
I20260709 12:27:39.897342 17666 raft_consensus.cc:2749] T 840a644e56054e13bfd7585fa064120c P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:39.900789 17647 raft_consensus.cc:515] T 28c655b68dc545948c67e0977b49e770 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:39.902740 16937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6916ee6a900c46508c98006aa85fe2d9" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d"
I20260709 12:27:39.902926 17682 raft_consensus.cc:515] T e477f70d4c8d466e9d45e6645e2a2869 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
W20260709 12:27:39.904480 16759 leader_election.cc:336] T 6916ee6a900c46508c98006aa85fe2d9 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
W20260709 12:27:39.905303 16759 leader_election.cc:336] T 6a86fc21ef0044bb91dd271c9a019336 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:39.905541 17682 leader_election.cc:290] T e477f70d4c8d466e9d45e6645e2a2869 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 2 election: Requested vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
I20260709 12:27:39.890663 17649 leader_election.cc:290] T e628dacc30694988a7c795441df15600 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 election: Requested vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:39.903455 16937 raft_consensus.cc:3060] T 6916ee6a900c46508c98006aa85fe2d9 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:39.911118 16833 leader_election.cc:304] T 288d05b8017c4e0f8cd40048647aecae P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 82f27bcdf252425aad4c4a37d064f68d; no voters: 
I20260709 12:27:39.912106 17650 raft_consensus.cc:2804] T 288d05b8017c4e0f8cd40048647aecae P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:39.912642 17650 raft_consensus.cc:697] T 288d05b8017c4e0f8cd40048647aecae P 17294485b7f24e2b9fae71dd3169a336 [term 2 LEADER]: Becoming Leader. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Running, Role: LEADER
I20260709 12:27:39.913677 17650 consensus_queue.cc:237] T 288d05b8017c4e0f8cd40048647aecae P 17294485b7f24e2b9fae71dd3169a336 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:39.915927 16937 raft_consensus.cc:2468] T 6916ee6a900c46508c98006aa85fe2d9 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in term 2.
I20260709 12:27:39.918078 17647 leader_election.cc:290] T 28c655b68dc545948c67e0977b49e770 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 election: Requested vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:39.922199 16759 leader_election.cc:304] T 442e0dfc272840f7a14c2232ed65425c P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 82f27bcdf252425aad4c4a37d064f68d; no voters: 
I20260709 12:27:39.923401 17210 raft_consensus.cc:2804] T 442e0dfc272840f7a14c2232ed65425c P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:39.924263 17210 raft_consensus.cc:697] T 442e0dfc272840f7a14c2232ed65425c P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 LEADER]: Becoming Leader. State: Replica: 3c1aba6ee1d244fd9c0daba722aa0b3b, State: Running, Role: LEADER
I20260709 12:27:39.923763 16759 leader_election.cc:304] T 6916ee6a900c46508c98006aa85fe2d9 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 82f27bcdf252425aad4c4a37d064f68d; no voters: 
I20260709 12:27:39.925324 17210 consensus_queue.cc:237] T 442e0dfc272840f7a14c2232ed65425c P 3c1aba6ee1d244fd9c0daba722aa0b3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:39.925698 17682 raft_consensus.cc:2804] T 6916ee6a900c46508c98006aa85fe2d9 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:39.925457 17667 raft_consensus.cc:515] T 6a86fc21ef0044bb91dd271c9a019336 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:39.926457 17682 raft_consensus.cc:697] T 6916ee6a900c46508c98006aa85fe2d9 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 LEADER]: Becoming Leader. State: Replica: 3c1aba6ee1d244fd9c0daba722aa0b3b, State: Running, Role: LEADER
I20260709 12:27:39.927678 17682 consensus_queue.cc:237] T 6916ee6a900c46508c98006aa85fe2d9 P 3c1aba6ee1d244fd9c0daba722aa0b3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:39.932333 16759 leader_election.cc:304] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 82f27bcdf252425aad4c4a37d064f68d; no voters: 
I20260709 12:27:39.935129 17666 raft_consensus.cc:2804] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:39.935732 17666 raft_consensus.cc:697] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 LEADER]: Becoming Leader. State: Replica: 3c1aba6ee1d244fd9c0daba722aa0b3b, State: Running, Role: LEADER
I20260709 12:27:39.936616 17666 consensus_queue.cc:237] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:39.941107 17667 leader_election.cc:290] T 6a86fc21ef0044bb91dd271c9a019336 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 2 election: Requested vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:39.895191 16935 raft_consensus.cc:2468] T a8a632c738e94b26a8352a68a42a0670 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in term 2.
W20260709 12:27:39.935168 16833 leader_election.cc:336] T 9067b67140fa48e883d2d240a6046d63 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
W20260709 12:27:39.947943 16833 leader_election.cc:336] T 288d05b8017c4e0f8cd40048647aecae P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:39.950536 16759 leader_election.cc:304] T a8a632c738e94b26a8352a68a42a0670 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 82f27bcdf252425aad4c4a37d064f68d; no voters: 
I20260709 12:27:39.958730 17210 raft_consensus.cc:2804] T a8a632c738e94b26a8352a68a42a0670 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:39.959328 17210 raft_consensus.cc:697] T a8a632c738e94b26a8352a68a42a0670 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 LEADER]: Becoming Leader. State: Replica: 3c1aba6ee1d244fd9c0daba722aa0b3b, State: Running, Role: LEADER
I20260709 12:27:39.960592 17210 consensus_queue.cc:237] T a8a632c738e94b26a8352a68a42a0670 P 3c1aba6ee1d244fd9c0daba722aa0b3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
W20260709 12:27:39.961094 16759 leader_election.cc:336] T a8a632c738e94b26a8352a68a42a0670 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
W20260709 12:27:39.966440 16759 leader_election.cc:336] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
W20260709 12:27:39.968159 16759 leader_election.cc:336] T 442e0dfc272840f7a14c2232ed65425c P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:39.970435 16935 raft_consensus.cc:1275] T 27f104a1ba60493ab47f6b876da48d67 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Refusing update from remote peer 17294485b7f24e2b9fae71dd3169a336: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:39.972530 16861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e477f70d4c8d466e9d45e6645e2a2869" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336"
I20260709 12:27:39.976737 16861 raft_consensus.cc:3060] T e477f70d4c8d466e9d45e6645e2a2869 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:27:39.977136 16759 leader_election.cc:336] T 6916ee6a900c46508c98006aa85fe2d9 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:39.984150 16933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a86fc21ef0044bb91dd271c9a019336" candidate_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d"
I20260709 12:27:39.985003 16933 raft_consensus.cc:3060] T 6a86fc21ef0044bb91dd271c9a019336 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:27:39.974531 16833 leader_election.cc:336] T cd637126e0044d7996f18e258282a145 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
W20260709 12:27:39.991904 16833 consensus_peers.cc:597] T 27f104a1ba60493ab47f6b876da48d67 P 17294485b7f24e2b9fae71dd3169a336 -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:39.992512 16833 leader_election.cc:336] T e628dacc30694988a7c795441df15600 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
W20260709 12:27:39.994969 16833 leader_election.cc:336] T cd637126e0044d7996f18e258282a145 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:39.978319 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c655b68dc545948c67e0977b49e770" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d"
I20260709 12:27:39.998871 16942 raft_consensus.cc:3060] T 28c655b68dc545948c67e0977b49e770 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:27:39.999456 16759 leader_election.cc:336] T e477f70d4c8d466e9d45e6645e2a2869 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:40.002662 16861 raft_consensus.cc:2468] T e477f70d4c8d466e9d45e6645e2a2869 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in term 2.
W20260709 12:27:40.010640 16833 leader_election.cc:336] T 28c655b68dc545948c67e0977b49e770 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:40.011340 16613 catalog_manager.cc:5697] T 8eaf179090b14105b52c4701d5599216 P 3c1aba6ee1d244fd9c0daba722aa0b3b reported cstate change: term changed from 1 to 2, leader changed from 879366e90f5c420588945e0d545017c8 (127.9.116.65) to 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66). New cstate: current_term: 2 leader_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } health_report { overall_health: HEALTHY } } }
W20260709 12:27:40.025539 16833 leader_election.cc:336] T 6e89df746e0c49d184637314ce87045a P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:40.026226 17631 tablet_bootstrap.cc:492] T 3649e7bb023a4958a01ad5ecbe446f0f P 879366e90f5c420588945e0d545017c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:40.034668 17631 tablet_bootstrap.cc:492] T 3649e7bb023a4958a01ad5ecbe446f0f P 879366e90f5c420588945e0d545017c8: Bootstrap complete.
I20260709 12:27:40.043459 16616 catalog_manager.cc:5697] T b86527b8a77848629c50a32e2534f7ba P 82f27bcdf252425aad4c4a37d064f68d reported cstate change: term changed from 1 to 2, leader changed from 879366e90f5c420588945e0d545017c8 (127.9.116.65) to 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68). New cstate: current_term: 2 leader_uuid: "82f27bcdf252425aad4c4a37d064f68d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:40.073833 16789 raft_consensus.cc:1275] T 6e89df746e0c49d184637314ce87045a P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Refusing update from remote peer 17294485b7f24e2b9fae71dd3169a336: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:40.055652 16933 raft_consensus.cc:2468] T 6a86fc21ef0044bb91dd271c9a019336 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in term 2.
I20260709 12:27:40.056542 16942 raft_consensus.cc:2468] T 28c655b68dc545948c67e0977b49e770 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 2.
I20260709 12:27:40.027523 16759 leader_election.cc:304] T 9067b67140fa48e883d2d240a6046d63 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b; no voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8
W20260709 12:27:40.076202 16759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:38103, user_credentials={real_user=slave}} blocked reactor thread for 59997.2us
W20260709 12:27:40.077003 16759 leader_election.cc:336] T 6a86fc21ef0044bb91dd271c9a019336 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
W20260709 12:27:40.068538 16907 consensus_peers.cc:597] T 51ebab30b5104589803b75a1b48c5aa2 P 82f27bcdf252425aad4c4a37d064f68d -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:40.076563 17650 consensus_queue.cc:1048] T 6e89df746e0c49d184637314ce87045a P 17294485b7f24e2b9fae71dd3169a336 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:40.078773 17682 raft_consensus.cc:2749] T 9067b67140fa48e883d2d240a6046d63 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:40.079066 17631 ts_tablet_manager.cc:1403] T 3649e7bb023a4958a01ad5ecbe446f0f P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.241s	user 0.020s	sys 0.011s
W20260709 12:27:40.026530 16833 leader_election.cc:336] T a4252af16e15424399c32c789c8e6c23 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
W20260709 12:27:40.079921 16833 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:39833, user_credentials={real_user=slave}} blocked reactor thread for 53429us
W20260709 12:27:40.080396 16833 leader_election.cc:336] T 840a644e56054e13bfd7585fa064120c P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:40.082789 17631 raft_consensus.cc:359] T 3649e7bb023a4958a01ad5ecbe446f0f P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:40.083457 17631 raft_consensus.cc:740] T 3649e7bb023a4958a01ad5ecbe446f0f P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:40.084359 17631 consensus_queue.cc:260] T 3649e7bb023a4958a01ad5ecbe446f0f P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:40.093948 16759 leader_election.cc:304] T e477f70d4c8d466e9d45e6645e2a2869 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 3c1aba6ee1d244fd9c0daba722aa0b3b; no voters: 879366e90f5c420588945e0d545017c8
I20260709 12:27:40.094817 17667 raft_consensus.cc:2804] T e477f70d4c8d466e9d45e6645e2a2869 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:40.095315 17667 raft_consensus.cc:697] T e477f70d4c8d466e9d45e6645e2a2869 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 LEADER]: Becoming Leader. State: Replica: 3c1aba6ee1d244fd9c0daba722aa0b3b, State: Running, Role: LEADER
W20260709 12:27:40.096154 16907 consensus_peers.cc:597] T b86527b8a77848629c50a32e2534f7ba P 82f27bcdf252425aad4c4a37d064f68d -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:40.096289 17667 consensus_queue.cc:237] T e477f70d4c8d466e9d45e6645e2a2869 P 3c1aba6ee1d244fd9c0daba722aa0b3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:40.098368 16759 leader_election.cc:304] T 6a86fc21ef0044bb91dd271c9a019336 P 3c1aba6ee1d244fd9c0daba722aa0b3b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 82f27bcdf252425aad4c4a37d064f68d; no voters: 879366e90f5c420588945e0d545017c8
I20260709 12:27:40.100405 16933 raft_consensus.cc:1275] T 27dda31a8cd1468eb3a824ae026485a3 P 82f27bcdf252425aad4c4a37d064f68d [term 3 FOLLOWER]: Refusing update from remote peer 17294485b7f24e2b9fae71dd3169a336: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:27:40.096746 16861 raft_consensus.cc:1275] T 51ebab30b5104589803b75a1b48c5aa2 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Refusing update from remote peer 82f27bcdf252425aad4c4a37d064f68d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:40.104789 17210 raft_consensus.cc:2804] T 6a86fc21ef0044bb91dd271c9a019336 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:40.105923 17210 raft_consensus.cc:697] T 6a86fc21ef0044bb91dd271c9a019336 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 LEADER]: Becoming Leader. State: Replica: 3c1aba6ee1d244fd9c0daba722aa0b3b, State: Running, Role: LEADER
I20260709 12:27:40.107154 17210 consensus_queue.cc:237] T 6a86fc21ef0044bb91dd271c9a019336 P 3c1aba6ee1d244fd9c0daba722aa0b3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:40.115689 17646 consensus_queue.cc:1048] T 27f104a1ba60493ab47f6b876da48d67 P 17294485b7f24e2b9fae71dd3169a336 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:40.118758 17613 consensus_queue.cc:1048] T 51ebab30b5104589803b75a1b48c5aa2 P 82f27bcdf252425aad4c4a37d064f68d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:40.122295 16616 catalog_manager.cc:5697] T 442e0dfc272840f7a14c2232ed65425c P 3c1aba6ee1d244fd9c0daba722aa0b3b reported cstate change: term changed from 1 to 2, leader changed from 879366e90f5c420588945e0d545017c8 (127.9.116.65) to 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66). New cstate: current_term: 2 leader_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:40.128125 16616 catalog_manager.cc:5697] T 6916ee6a900c46508c98006aa85fe2d9 P 3c1aba6ee1d244fd9c0daba722aa0b3b reported cstate change: term changed from 1 to 2, leader changed from 879366e90f5c420588945e0d545017c8 (127.9.116.65) to 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66). New cstate: current_term: 2 leader_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:40.144481 16790 raft_consensus.cc:1275] T cd637126e0044d7996f18e258282a145 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Refusing update from remote peer 17294485b7f24e2b9fae71dd3169a336: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:40.140923 16616 catalog_manager.cc:5697] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 3c1aba6ee1d244fd9c0daba722aa0b3b reported cstate change: term changed from 1 to 2, leader changed from 879366e90f5c420588945e0d545017c8 (127.9.116.65) to 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66). New cstate: current_term: 2 leader_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:40.147912 17650 consensus_queue.cc:1048] T cd637126e0044d7996f18e258282a145 P 17294485b7f24e2b9fae71dd3169a336 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:40.149402 17631 ts_tablet_manager.cc:1434] T 3649e7bb023a4958a01ad5ecbe446f0f P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.070s	user 0.005s	sys 0.004s
I20260709 12:27:40.150734 16616 catalog_manager.cc:5697] T a8a632c738e94b26a8352a68a42a0670 P 3c1aba6ee1d244fd9c0daba722aa0b3b reported cstate change: term changed from 1 to 2, leader changed from 879366e90f5c420588945e0d545017c8 (127.9.116.65) to 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66). New cstate: current_term: 2 leader_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:40.165014 17646 consensus_queue.cc:1048] T 27dda31a8cd1468eb3a824ae026485a3 P 17294485b7f24e2b9fae71dd3169a336 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:40.166106 16833 leader_election.cc:304] T 28c655b68dc545948c67e0977b49e770 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 82f27bcdf252425aad4c4a37d064f68d; no voters: 
I20260709 12:27:40.169909 17650 raft_consensus.cc:2804] T 28c655b68dc545948c67e0977b49e770 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:40.170828 17650 raft_consensus.cc:697] T 28c655b68dc545948c67e0977b49e770 P 17294485b7f24e2b9fae71dd3169a336 [term 2 LEADER]: Becoming Leader. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Running, Role: LEADER
I20260709 12:27:40.172293 17650 consensus_queue.cc:237] T 28c655b68dc545948c67e0977b49e770 P 17294485b7f24e2b9fae71dd3169a336 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:40.177515 17631 tablet_bootstrap.cc:492] T 00e5268529b241f184c460704ab9ed3c P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
W20260709 12:27:40.167735 16833 leader_election.cc:336] T 9067b67140fa48e883d2d240a6046d63 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
W20260709 12:27:40.193770 16833 leader_election.cc:336] T e628dacc30694988a7c795441df15600 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
W20260709 12:27:40.194970 16833 leader_election.cc:336] T 28c655b68dc545948c67e0977b49e770 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:40.224076 17636 raft_consensus.cc:493] T 6916ee6a900c46508c98006aa85fe2d9 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:40.224979 17636 raft_consensus.cc:515] T 6916ee6a900c46508c98006aa85fe2d9 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:40.226904 16792 raft_consensus.cc:1275] T a4252af16e15424399c32c789c8e6c23 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Refusing update from remote peer 17294485b7f24e2b9fae71dd3169a336: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:40.230842 17649 consensus_queue.cc:1048] T a4252af16e15424399c32c789c8e6c23 P 17294485b7f24e2b9fae71dd3169a336 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:40.232388 17725 raft_consensus.cc:493] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:40.236821 16861 raft_consensus.cc:1275] T b86527b8a77848629c50a32e2534f7ba P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Refusing update from remote peer 82f27bcdf252425aad4c4a37d064f68d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:40.243201 17725 raft_consensus.cc:515] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:40.246218 17725 leader_election.cc:290] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
W20260709 12:27:40.248926 16833 consensus_peers.cc:597] T 27dda31a8cd1468eb3a824ae026485a3 P 17294485b7f24e2b9fae71dd3169a336 -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:40.255259 16789 raft_consensus.cc:1275] T 840a644e56054e13bfd7585fa064120c P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Refusing update from remote peer 17294485b7f24e2b9fae71dd3169a336: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:40.241035 17636 leader_election.cc:290] T 6916ee6a900c46508c98006aa85fe2d9 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:40.257351 17649 consensus_queue.cc:1048] T 840a644e56054e13bfd7585fa064120c P 17294485b7f24e2b9fae71dd3169a336 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:40.261910 17634 consensus_queue.cc:1048] T b86527b8a77848629c50a32e2534f7ba P 82f27bcdf252425aad4c4a37d064f68d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:27:40.277230 16833 consensus_peers.cc:597] T a4252af16e15424399c32c789c8e6c23 P 17294485b7f24e2b9fae71dd3169a336 -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:40.339968 16613 catalog_manager.cc:5697] T e477f70d4c8d466e9d45e6645e2a2869 P 3c1aba6ee1d244fd9c0daba722aa0b3b reported cstate change: term changed from 1 to 2, leader changed from 879366e90f5c420588945e0d545017c8 (127.9.116.65) to 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66). New cstate: current_term: 2 leader_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } health_report { overall_health: UNKNOWN } } }
W20260709 12:27:40.341557 16833 consensus_peers.cc:597] T 6e89df746e0c49d184637314ce87045a P 17294485b7f24e2b9fae71dd3169a336 -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:40.363714 16833 consensus_peers.cc:597] T 3e78004b8cc14ac6b93c857cbdd63329 P 17294485b7f24e2b9fae71dd3169a336 -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:40.386644 16942 raft_consensus.cc:1275] T 288d05b8017c4e0f8cd40048647aecae P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Refusing update from remote peer 17294485b7f24e2b9fae71dd3169a336: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:27:40.419780 16907 consensus_peers.cc:597] T fbafe39b79894737b395f95013bc6c86 P 82f27bcdf252425aad4c4a37d064f68d -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:40.368131 16759 consensus_peers.cc:597] T 8eaf179090b14105b52c4701d5599216 P 3c1aba6ee1d244fd9c0daba722aa0b3b -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:40.421306 16759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:39833, user_credentials={real_user=slave}} blocked reactor thread for 53264us
I20260709 12:27:40.425418 16933 raft_consensus.cc:1275] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Refusing update from remote peer 3c1aba6ee1d244fd9c0daba722aa0b3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:40.358300 17636 raft_consensus.cc:493] T 5025c37302bd4a2aa076878e1af90366 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:40.430943 16790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6916ee6a900c46508c98006aa85fe2d9" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
I20260709 12:27:40.431123 17725 raft_consensus.cc:493] T 52538067157143b2abd4656a4bbb9442 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:40.431905 17725 raft_consensus.cc:515] T 52538067157143b2abd4656a4bbb9442 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:40.433790 16790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1e8d1852ae457db7e3be5b6957f1b3" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
I20260709 12:27:40.434791 17725 leader_election.cc:290] T 52538067157143b2abd4656a4bbb9442 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
I20260709 12:27:40.367498 16613 catalog_manager.cc:5697] T 6e89df746e0c49d184637314ce87045a P 3c1aba6ee1d244fd9c0daba722aa0b3b reported cstate change: term changed from 1 to 2, leader changed from 879366e90f5c420588945e0d545017c8 (127.9.116.65) to 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67). New cstate: current_term: 2 leader_uuid: "17294485b7f24e2b9fae71dd3169a336" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } }
I20260709 12:27:40.429319 17636 raft_consensus.cc:515] T 5025c37302bd4a2aa076878e1af90366 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:40.437593 16938 raft_consensus.cc:1275] T 8eaf179090b14105b52c4701d5599216 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Refusing update from remote peer 3c1aba6ee1d244fd9c0daba722aa0b3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:40.436455 16613 catalog_manager.cc:5697] T 6a86fc21ef0044bb91dd271c9a019336 P 3c1aba6ee1d244fd9c0daba722aa0b3b reported cstate change: term changed from 1 to 2, leader changed from 879366e90f5c420588945e0d545017c8 (127.9.116.65) to 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66). New cstate: current_term: 2 leader_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:40.436998 17650 consensus_queue.cc:1048] T 288d05b8017c4e0f8cd40048647aecae P 17294485b7f24e2b9fae71dd3169a336 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:27:40.440963 16613 catalog_manager.cc:5697] T cd637126e0044d7996f18e258282a145 P 3c1aba6ee1d244fd9c0daba722aa0b3b reported cstate change: term changed from 1 to 2, leader changed from 879366e90f5c420588945e0d545017c8 (127.9.116.65) to 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67). New cstate: current_term: 2 leader_uuid: "17294485b7f24e2b9fae71dd3169a336" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } }
I20260709 12:27:40.438211 16933 raft_consensus.cc:1275] T 6916ee6a900c46508c98006aa85fe2d9 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Refusing update from remote peer 3c1aba6ee1d244fd9c0daba722aa0b3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:40.448851 16790 raft_consensus.cc:1275] T 9067b67140fa48e883d2d240a6046d63 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Refusing update from remote peer 17294485b7f24e2b9fae71dd3169a336: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:40.451166 17646 consensus_queue.cc:1048] T 9067b67140fa48e883d2d240a6046d63 P 17294485b7f24e2b9fae71dd3169a336 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:40.456334 16789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52538067157143b2abd4656a4bbb9442" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
I20260709 12:27:40.458155 16789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5025c37302bd4a2aa076878e1af90366" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
I20260709 12:27:40.439136 17636 leader_election.cc:290] T 5025c37302bd4a2aa076878e1af90366 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
I20260709 12:27:40.463693 16616 catalog_manager.cc:5697] T 27dda31a8cd1468eb3a824ae026485a3 P 17294485b7f24e2b9fae71dd3169a336 reported cstate change: term changed from 2 to 3, leader changed from 879366e90f5c420588945e0d545017c8 (127.9.116.65) to 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67). New cstate: current_term: 3 leader_uuid: "17294485b7f24e2b9fae71dd3169a336" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:40.466312 16933 raft_consensus.cc:1275] T 442e0dfc272840f7a14c2232ed65425c P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Refusing update from remote peer 3c1aba6ee1d244fd9c0daba722aa0b3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:40.466856 16616 catalog_manager.cc:5697] T 840a644e56054e13bfd7585fa064120c P 17294485b7f24e2b9fae71dd3169a336 reported cstate change: term changed from 1 to 2, leader changed from 879366e90f5c420588945e0d545017c8 (127.9.116.65) to 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67). New cstate: current_term: 2 leader_uuid: "17294485b7f24e2b9fae71dd3169a336" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:40.470093 16616 catalog_manager.cc:5697] T a4252af16e15424399c32c789c8e6c23 P 17294485b7f24e2b9fae71dd3169a336 reported cstate change: term changed from 1 to 2, leader changed from 879366e90f5c420588945e0d545017c8 (127.9.116.65) to 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67). New cstate: current_term: 2 leader_uuid: "17294485b7f24e2b9fae71dd3169a336" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:40.471655 16938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1e8d1852ae457db7e3be5b6957f1b3" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:40.472708 16938 raft_consensus.cc:2393] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 879366e90f5c420588945e0d545017c8 in current term 2: Already voted for candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in this term.
I20260709 12:27:40.472155 16616 catalog_manager.cc:5697] T 288d05b8017c4e0f8cd40048647aecae P 17294485b7f24e2b9fae71dd3169a336 reported cstate change: term changed from 1 to 2, leader changed from 879366e90f5c420588945e0d545017c8 (127.9.116.65) to 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67). New cstate: current_term: 2 leader_uuid: "17294485b7f24e2b9fae71dd3169a336" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:40.473995 16616 catalog_manager.cc:5697] T e628dacc30694988a7c795441df15600 P 17294485b7f24e2b9fae71dd3169a336 reported cstate change: term changed from 1 to 2, leader changed from 879366e90f5c420588945e0d545017c8 (127.9.116.65) to 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67). New cstate: current_term: 2 leader_uuid: "17294485b7f24e2b9fae71dd3169a336" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:40.476483 17627 leader_election.cc:304] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 879366e90f5c420588945e0d545017c8; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 82f27bcdf252425aad4c4a37d064f68d
I20260709 12:27:40.482699 17725 raft_consensus.cc:3060] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:40.482612 16616 catalog_manager.cc:5697] T 9067b67140fa48e883d2d240a6046d63 P 17294485b7f24e2b9fae71dd3169a336 reported cstate change: term changed from 1 to 2, leader changed from 879366e90f5c420588945e0d545017c8 (127.9.116.65) to 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67). New cstate: current_term: 2 leader_uuid: "17294485b7f24e2b9fae71dd3169a336" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:40.488791 16616 catalog_manager.cc:5697] T 3d614e06fd2c40189161e22ad9217e5d P 17294485b7f24e2b9fae71dd3169a336 reported cstate change: term changed from 2 to 3, leader changed from 879366e90f5c420588945e0d545017c8 (127.9.116.65) to 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67). New cstate: current_term: 3 leader_uuid: "17294485b7f24e2b9fae71dd3169a336" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:40.495128 17725 raft_consensus.cc:2749] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:40.495774 17636 raft_consensus.cc:493] T 223b3745452c412581caf058f6b81fe2 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:40.498859 17636 raft_consensus.cc:515] T 223b3745452c412581caf058f6b81fe2 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:40.480638 16933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6916ee6a900c46508c98006aa85fe2d9" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:40.501518 16933 raft_consensus.cc:2393] T 6916ee6a900c46508c98006aa85fe2d9 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 879366e90f5c420588945e0d545017c8 in current term 2: Already voted for candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in this term.
I20260709 12:27:40.507423 16938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "223b3745452c412581caf058f6b81fe2" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:40.511384 17627 leader_election.cc:304] T 6916ee6a900c46508c98006aa85fe2d9 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 879366e90f5c420588945e0d545017c8; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 82f27bcdf252425aad4c4a37d064f68d
W20260709 12:27:40.513778 16833 consensus_peers.cc:597] T 840a644e56054e13bfd7585fa064120c P 17294485b7f24e2b9fae71dd3169a336 -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:40.517616 17636 leader_election.cc:290] T 223b3745452c412581caf058f6b81fe2 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:40.519035 17636 raft_consensus.cc:3060] T 6916ee6a900c46508c98006aa85fe2d9 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:40.520270 16790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "223b3745452c412581caf058f6b81fe2" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
I20260709 12:27:40.521039 17667 consensus_queue.cc:1048] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:40.523730 17628 leader_election.cc:304] T 223b3745452c412581caf058f6b81fe2 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 879366e90f5c420588945e0d545017c8; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 82f27bcdf252425aad4c4a37d064f68d
I20260709 12:27:40.524408 17667 consensus_queue.cc:1048] T 8eaf179090b14105b52c4701d5599216 P 3c1aba6ee1d244fd9c0daba722aa0b3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:40.526379 17725 raft_consensus.cc:2749] T 223b3745452c412581caf058f6b81fe2 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:27:40.514715 16833 consensus_peers.cc:597] T cd637126e0044d7996f18e258282a145 P 17294485b7f24e2b9fae71dd3169a336 -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:40.527041 17667 consensus_queue.cc:1048] T 6916ee6a900c46508c98006aa85fe2d9 P 3c1aba6ee1d244fd9c0daba722aa0b3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:40.533005 17682 consensus_queue.cc:1048] T 442e0dfc272840f7a14c2232ed65425c P 3c1aba6ee1d244fd9c0daba722aa0b3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:40.546082 16933 raft_consensus.cc:1275] T 3d614e06fd2c40189161e22ad9217e5d P 82f27bcdf252425aad4c4a37d064f68d [term 3 FOLLOWER]: Refusing update from remote peer 17294485b7f24e2b9fae71dd3169a336: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:27:40.546239 16907 consensus_peers.cc:597] T b777ccb9937a476590a534fea0428c5c P 82f27bcdf252425aad4c4a37d064f68d -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:40.548560 16759 consensus_peers.cc:597] T 6916ee6a900c46508c98006aa85fe2d9 P 3c1aba6ee1d244fd9c0daba722aa0b3b -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:40.549225 16759 consensus_peers.cc:597] T 442e0dfc272840f7a14c2232ed65425c P 3c1aba6ee1d244fd9c0daba722aa0b3b -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:40.549691 16759 consensus_peers.cc:597] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 3c1aba6ee1d244fd9c0daba722aa0b3b -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:40.565342 17631 tablet_bootstrap.cc:492] T 00e5268529b241f184c460704ab9ed3c P 879366e90f5c420588945e0d545017c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:40.573668 17631 tablet_bootstrap.cc:492] T 00e5268529b241f184c460704ab9ed3c P 879366e90f5c420588945e0d545017c8: Bootstrap complete.
I20260709 12:27:40.574424 17631 ts_tablet_manager.cc:1403] T 00e5268529b241f184c460704ab9ed3c P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.397s	user 0.069s	sys 0.048s
I20260709 12:27:40.575208 17636 raft_consensus.cc:2749] T 6916ee6a900c46508c98006aa85fe2d9 P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:40.588117 17631 raft_consensus.cc:359] T 00e5268529b241f184c460704ab9ed3c P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:40.589777 17631 raft_consensus.cc:740] T 00e5268529b241f184c460704ab9ed3c P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:40.592973 16935 raft_consensus.cc:1275] T 6a86fc21ef0044bb91dd271c9a019336 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Refusing update from remote peer 3c1aba6ee1d244fd9c0daba722aa0b3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:27:40.596053 16907 consensus_peers.cc:597] T 00e5268529b241f184c460704ab9ed3c P 82f27bcdf252425aad4c4a37d064f68d -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:40.604713 17631 consensus_queue.cc:260] T 00e5268529b241f184c460704ab9ed3c P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:40.607316 17741 raft_consensus.cc:493] T cd637126e0044d7996f18e258282a145 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:40.608246 17741 raft_consensus.cc:515] T cd637126e0044d7996f18e258282a145 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:40.610634 17631 ts_tablet_manager.cc:1434] T 00e5268529b241f184c460704ab9ed3c P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.036s	user 0.011s	sys 0.001s
I20260709 12:27:40.612526 17636 raft_consensus.cc:493] T 7562feb416f84f0b948343356153d8d2 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:40.613447 17636 raft_consensus.cc:515] T 7562feb416f84f0b948343356153d8d2 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:40.618227 17636 leader_election.cc:290] T 7562feb416f84f0b948343356153d8d2 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919)
I20260709 12:27:40.619513 17631 tablet_bootstrap.cc:492] T 3e78004b8cc14ac6b93c857cbdd63329 P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:40.623860 17636 raft_consensus.cc:493] T 62e4e875fd4e4604952120df324e99cb P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:40.624334 16790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd637126e0044d7996f18e258282a145" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
I20260709 12:27:40.625303 17636 raft_consensus.cc:515] T 62e4e875fd4e4604952120df324e99cb P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:40.628839 17741 leader_election.cc:290] T cd637126e0044d7996f18e258282a145 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
I20260709 12:27:40.641729 16790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e4e875fd4e4604952120df324e99cb" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
W20260709 12:27:40.644829 16759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:38103, user_credentials={real_user=slave}} blocked reactor thread for 53342.9us
I20260709 12:27:40.639494 17636 leader_election.cc:290] T 62e4e875fd4e4604952120df324e99cb P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
W20260709 12:27:40.653678 16907 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.9.116.126:46577, user_credentials={real_user=slave}} blocked reactor thread for 55921.2us
I20260709 12:27:40.672080 16790 raft_consensus.cc:1275] T e628dacc30694988a7c795441df15600 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Refusing update from remote peer 17294485b7f24e2b9fae71dd3169a336: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:40.678442 17650 consensus_queue.cc:1048] T e628dacc30694988a7c795441df15600 P 17294485b7f24e2b9fae71dd3169a336 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:40.686173 17636 raft_consensus.cc:493] T e477f70d4c8d466e9d45e6645e2a2869 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:40.686816 17636 raft_consensus.cc:515] T e477f70d4c8d466e9d45e6645e2a2869 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:40.692221 16938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7562feb416f84f0b948343356153d8d2" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:40.693055 17636 leader_election.cc:290] T e477f70d4c8d466e9d45e6645e2a2869 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
I20260709 12:27:40.694031 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e4e875fd4e4604952120df324e99cb" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:40.697079 17627 leader_election.cc:304] T 62e4e875fd4e4604952120df324e99cb P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 879366e90f5c420588945e0d545017c8; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 82f27bcdf252425aad4c4a37d064f68d
I20260709 12:27:40.698626 17636 raft_consensus.cc:2749] T 62e4e875fd4e4604952120df324e99cb P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:40.701421 16935 raft_consensus.cc:1275] T 28c655b68dc545948c67e0977b49e770 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Refusing update from remote peer 17294485b7f24e2b9fae71dd3169a336: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:40.706918 17631 tablet_bootstrap.cc:492] T 3e78004b8cc14ac6b93c857cbdd63329 P 879366e90f5c420588945e0d545017c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:40.708621 17631 tablet_bootstrap.cc:492] T 3e78004b8cc14ac6b93c857cbdd63329 P 879366e90f5c420588945e0d545017c8: Bootstrap complete.
I20260709 12:27:40.709654 17631 ts_tablet_manager.cc:1403] T 3e78004b8cc14ac6b93c857cbdd63329 P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.098s	user 0.026s	sys 0.009s
I20260709 12:27:40.711625 16789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e477f70d4c8d466e9d45e6645e2a2869" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
I20260709 12:27:40.713752 17631 raft_consensus.cc:359] T 3e78004b8cc14ac6b93c857cbdd63329 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:40.714775 17631 raft_consensus.cc:740] T 3e78004b8cc14ac6b93c857cbdd63329 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:40.716197 17631 consensus_queue.cc:260] T 3e78004b8cc14ac6b93c857cbdd63329 P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:40.719251 17631 ts_tablet_manager.cc:1434] T 3e78004b8cc14ac6b93c857cbdd63329 P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:27:40.720901 17631 tablet_bootstrap.cc:492] T fe16827e0b4a45baa99739174f92a0f7 P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:40.739286 17650 consensus_queue.cc:1048] T 3d614e06fd2c40189161e22ad9217e5d P 17294485b7f24e2b9fae71dd3169a336 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:40.753648 17650 consensus_queue.cc:1048] T 28c655b68dc545948c67e0977b49e770 P 17294485b7f24e2b9fae71dd3169a336 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:40.755546 17631 tablet_bootstrap.cc:492] T fe16827e0b4a45baa99739174f92a0f7 P 879366e90f5c420588945e0d545017c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:40.757125 17631 tablet_bootstrap.cc:492] T fe16827e0b4a45baa99739174f92a0f7 P 879366e90f5c420588945e0d545017c8: Bootstrap complete.
I20260709 12:27:40.758139 17631 ts_tablet_manager.cc:1403] T fe16827e0b4a45baa99739174f92a0f7 P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.038s	user 0.022s	sys 0.008s
I20260709 12:27:40.762454 17631 raft_consensus.cc:359] T fe16827e0b4a45baa99739174f92a0f7 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:40.767275 17631 raft_consensus.cc:740] T fe16827e0b4a45baa99739174f92a0f7 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:40.768589 17666 consensus_queue.cc:1048] T 6a86fc21ef0044bb91dd271c9a019336 P 3c1aba6ee1d244fd9c0daba722aa0b3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:40.769733 17631 consensus_queue.cc:260] T fe16827e0b4a45baa99739174f92a0f7 P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:40.773010 16942 raft_consensus.cc:1275] T a8a632c738e94b26a8352a68a42a0670 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Refusing update from remote peer 3c1aba6ee1d244fd9c0daba722aa0b3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:27:40.774039 16833 consensus_peers.cc:597] T 3d614e06fd2c40189161e22ad9217e5d P 17294485b7f24e2b9fae71dd3169a336 -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:40.774645 17631 ts_tablet_manager.cc:1434] T fe16827e0b4a45baa99739174f92a0f7 P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
W20260709 12:27:40.775146 16833 consensus_peers.cc:597] T 288d05b8017c4e0f8cd40048647aecae P 17294485b7f24e2b9fae71dd3169a336 -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:40.775842 17631 tablet_bootstrap.cc:492] T b6f178076e7f4c7bb41b4853bacbfc4e P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
W20260709 12:27:40.778952 16759 consensus_peers.cc:597] T 6a86fc21ef0044bb91dd271c9a019336 P 3c1aba6ee1d244fd9c0daba722aa0b3b -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:40.786662 16833 consensus_peers.cc:597] T 9067b67140fa48e883d2d240a6046d63 P 17294485b7f24e2b9fae71dd3169a336 -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:40.788146 16759 consensus_peers.cc:597] T e477f70d4c8d466e9d45e6645e2a2869 P 3c1aba6ee1d244fd9c0daba722aa0b3b -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:40.788343 16833 consensus_peers.cc:597] T 7562feb416f84f0b948343356153d8d2 P 17294485b7f24e2b9fae71dd3169a336 -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:40.790307 16833 consensus_peers.cc:597] T e628dacc30694988a7c795441df15600 P 17294485b7f24e2b9fae71dd3169a336 -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:40.794183 16833 consensus_peers.cc:597] T fe16827e0b4a45baa99739174f92a0f7 P 17294485b7f24e2b9fae71dd3169a336 -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:40.794623 16833 consensus_peers.cc:597] T 3649e7bb023a4958a01ad5ecbe446f0f P 17294485b7f24e2b9fae71dd3169a336 -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:40.802205 16867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52538067157143b2abd4656a4bbb9442" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:40.803889 16868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7562feb416f84f0b948343356153d8d2" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
W20260709 12:27:40.798240 16907 consensus_peers.cc:597] T ea5085716661498e9f3bfdfa2fc5737a P 82f27bcdf252425aad4c4a37d064f68d -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:40.803478 16863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5025c37302bd4a2aa076878e1af90366" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:40.805557 16861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd637126e0044d7996f18e258282a145" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
W20260709 12:27:40.816911 16759 consensus_peers.cc:597] T 62e4e875fd4e4604952120df324e99cb P 3c1aba6ee1d244fd9c0daba722aa0b3b -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:40.817593 16866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e477f70d4c8d466e9d45e6645e2a2869" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:40.818727 16866 raft_consensus.cc:2393] T e477f70d4c8d466e9d45e6645e2a2869 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 879366e90f5c420588945e0d545017c8 in current term 2: Already voted for candidate 3c1aba6ee1d244fd9c0daba722aa0b3b in this term.
W20260709 12:27:40.819439 16759 consensus_peers.cc:597] T 2f737ece325c44c58194725a82923014 P 3c1aba6ee1d244fd9c0daba722aa0b3b -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:40.819940 16759 consensus_peers.cc:597] T 5025c37302bd4a2aa076878e1af90366 P 3c1aba6ee1d244fd9c0daba722aa0b3b -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:40.829032 17627 leader_election.cc:304] T 52538067157143b2abd4656a4bbb9442 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 879366e90f5c420588945e0d545017c8; no voters: 17294485b7f24e2b9fae71dd3169a336, 3c1aba6ee1d244fd9c0daba722aa0b3b
I20260709 12:27:40.830367 17636 raft_consensus.cc:2749] T 52538067157143b2abd4656a4bbb9442 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:40.831679 17627 leader_election.cc:304] T 7562feb416f84f0b948343356153d8d2 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 879366e90f5c420588945e0d545017c8; no voters: 17294485b7f24e2b9fae71dd3169a336, 82f27bcdf252425aad4c4a37d064f68d
I20260709 12:27:40.832146 16866 raft_consensus.cc:1275] T e477f70d4c8d466e9d45e6645e2a2869 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Refusing update from remote peer 3c1aba6ee1d244fd9c0daba722aa0b3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:40.833199 17636 raft_consensus.cc:2749] T 7562feb416f84f0b948343356153d8d2 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:40.834645 17666 consensus_queue.cc:1048] T a8a632c738e94b26a8352a68a42a0670 P 3c1aba6ee1d244fd9c0daba722aa0b3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:40.834825 17627 leader_election.cc:304] T 5025c37302bd4a2aa076878e1af90366 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 879366e90f5c420588945e0d545017c8; no voters: 17294485b7f24e2b9fae71dd3169a336, 3c1aba6ee1d244fd9c0daba722aa0b3b
I20260709 12:27:40.836577 17627 leader_election.cc:304] T cd637126e0044d7996f18e258282a145 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 879366e90f5c420588945e0d545017c8; no voters: 17294485b7f24e2b9fae71dd3169a336, 3c1aba6ee1d244fd9c0daba722aa0b3b
I20260709 12:27:40.837183 17636 raft_consensus.cc:2749] T 5025c37302bd4a2aa076878e1af90366 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:27:40.838617 16833 consensus_peers.cc:597] T 98a96f910b4449f7ba9c875e45090080 P 17294485b7f24e2b9fae71dd3169a336 -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:40.839145 17636 raft_consensus.cc:2749] T cd637126e0044d7996f18e258282a145 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:27:40.839324 16833 consensus_peers.cc:597] T 28c655b68dc545948c67e0977b49e770 P 17294485b7f24e2b9fae71dd3169a336 -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:40.840142 17631 tablet_bootstrap.cc:492] T b6f178076e7f4c7bb41b4853bacbfc4e P 879366e90f5c420588945e0d545017c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:40.833999 16616 catalog_manager.cc:5697] T 28c655b68dc545948c67e0977b49e770 P 17294485b7f24e2b9fae71dd3169a336 reported cstate change: term changed from 1 to 2, leader changed from 879366e90f5c420588945e0d545017c8 (127.9.116.65) to 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67). New cstate: current_term: 2 leader_uuid: "17294485b7f24e2b9fae71dd3169a336" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:40.841138 17631 tablet_bootstrap.cc:492] T b6f178076e7f4c7bb41b4853bacbfc4e P 879366e90f5c420588945e0d545017c8: Bootstrap complete.
I20260709 12:27:40.841872 17627 leader_election.cc:304] T e477f70d4c8d466e9d45e6645e2a2869 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 879366e90f5c420588945e0d545017c8; no voters: 17294485b7f24e2b9fae71dd3169a336, 3c1aba6ee1d244fd9c0daba722aa0b3b
I20260709 12:27:40.860109 17636 raft_consensus.cc:3060] T e477f70d4c8d466e9d45e6645e2a2869 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:40.862484 17667 consensus_queue.cc:1048] T e477f70d4c8d466e9d45e6645e2a2869 P 3c1aba6ee1d244fd9c0daba722aa0b3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:40.868846 17636 raft_consensus.cc:2749] T e477f70d4c8d466e9d45e6645e2a2869 P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:40.841823 17631 ts_tablet_manager.cc:1403] T b6f178076e7f4c7bb41b4853bacbfc4e P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.066s	user 0.017s	sys 0.003s
W20260709 12:27:40.881389 16759 consensus_peers.cc:597] T a8a632c738e94b26a8352a68a42a0670 P 3c1aba6ee1d244fd9c0daba722aa0b3b -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:40.884945 16759 consensus_peers.cc:597] T 5f88e29c7ffd4b3b856561ee240cdd43 P 3c1aba6ee1d244fd9c0daba722aa0b3b -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:40.886104 16759 consensus_peers.cc:597] T 52538067157143b2abd4656a4bbb9442 P 3c1aba6ee1d244fd9c0daba722aa0b3b -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:40.887539 17631 raft_consensus.cc:359] T b6f178076e7f4c7bb41b4853bacbfc4e P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:40.896378 17631 raft_consensus.cc:740] T b6f178076e7f4c7bb41b4853bacbfc4e P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:40.898401 17631 consensus_queue.cc:260] T b6f178076e7f4c7bb41b4853bacbfc4e P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:40.901412 17631 ts_tablet_manager.cc:1434] T b6f178076e7f4c7bb41b4853bacbfc4e P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:27:40.902318 17631 tablet_bootstrap.cc:492] T 98a96f910b4449f7ba9c875e45090080 P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
W20260709 12:27:40.920348 16759 consensus_peers.cc:597] T d6811cd94dfd44149e1329e919d82f0f P 3c1aba6ee1d244fd9c0daba722aa0b3b -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:40.945003 17631 tablet_bootstrap.cc:492] T 98a96f910b4449f7ba9c875e45090080 P 879366e90f5c420588945e0d545017c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:40.946178 17631 tablet_bootstrap.cc:492] T 98a96f910b4449f7ba9c875e45090080 P 879366e90f5c420588945e0d545017c8: Bootstrap complete.
I20260709 12:27:40.947273 17631 ts_tablet_manager.cc:1403] T 98a96f910b4449f7ba9c875e45090080 P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.045s	user 0.012s	sys 0.003s
W20260709 12:27:40.951325 16759 consensus_peers.cc:597] T ce37f3e8575c4b8e88935db231644a27 P 3c1aba6ee1d244fd9c0daba722aa0b3b -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:40.959332 17636 raft_consensus.cc:493] T e628dacc30694988a7c795441df15600 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:40.959969 17636 raft_consensus.cc:515] T e628dacc30694988a7c795441df15600 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:40.962100 17636 leader_election.cc:290] T e628dacc30694988a7c795441df15600 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
I20260709 12:27:40.962742 16789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e628dacc30694988a7c795441df15600" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" is_pre_election: true
I20260709 12:27:40.979007 17631 raft_consensus.cc:359] T 98a96f910b4449f7ba9c875e45090080 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:40.979838 17631 raft_consensus.cc:740] T 98a96f910b4449f7ba9c875e45090080 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:40.982095 17631 consensus_queue.cc:260] T 98a96f910b4449f7ba9c875e45090080 P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:40.984597 17631 ts_tablet_manager.cc:1434] T 98a96f910b4449f7ba9c875e45090080 P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.000s
I20260709 12:27:40.985627 17631 tablet_bootstrap.cc:492] T 28c655b68dc545948c67e0977b49e770 P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:41.004256 16866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e628dacc30694988a7c795441df15600" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:41.009811 17631 tablet_bootstrap.cc:492] T 28c655b68dc545948c67e0977b49e770 P 879366e90f5c420588945e0d545017c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:41.011376 17631 tablet_bootstrap.cc:492] T 28c655b68dc545948c67e0977b49e770 P 879366e90f5c420588945e0d545017c8: Bootstrap complete.
I20260709 12:27:41.012411 17631 ts_tablet_manager.cc:1403] T 28c655b68dc545948c67e0977b49e770 P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.027s	user 0.020s	sys 0.003s
I20260709 12:27:41.015507 17631 raft_consensus.cc:359] T 28c655b68dc545948c67e0977b49e770 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:41.016264 17631 raft_consensus.cc:740] T 28c655b68dc545948c67e0977b49e770 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:41.016903 17627 leader_election.cc:304] T e628dacc30694988a7c795441df15600 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 879366e90f5c420588945e0d545017c8; no voters: 17294485b7f24e2b9fae71dd3169a336, 3c1aba6ee1d244fd9c0daba722aa0b3b
I20260709 12:27:41.017794 17636 raft_consensus.cc:2749] T e628dacc30694988a7c795441df15600 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:41.017949 17779 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.116.65:39833 every 8 connection(s)
I20260709 12:27:41.017118 17631 consensus_queue.cc:260] T 28c655b68dc545948c67e0977b49e770 P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:41.017794  9681 rpc_server.cc:307] RPC server started. Bound to: 127.9.116.65:39833
I20260709 12:27:41.021341 17631 ts_tablet_manager.cc:1434] T 28c655b68dc545948c67e0977b49e770 P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:27:41.022238 17631 tablet_bootstrap.cc:492] T 514ee26ff21e4c08976b6a0397b730fe P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
W20260709 12:27:41.047955 16833 consensus_peers.cc:597] T c5baa0b4140847958c6528b3dbda7617 P 17294485b7f24e2b9fae71dd3169a336 -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:41.048846 16833 consensus_peers.cc:597] T 28bdf20fc71548da87c4558dacc503db P 17294485b7f24e2b9fae71dd3169a336 -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:41.049571 16833 consensus_peers.cc:597] T b10d5b4017584d0fb22f9e542d95fcb1 P 17294485b7f24e2b9fae71dd3169a336 -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:41.069167 16759 consensus_peers.cc:597] T a0409dc146674a39a9ceeeeebc081453 P 3c1aba6ee1d244fd9c0daba722aa0b3b -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:41.074165 17781 heartbeater.cc:344] Connected to a master server at 127.9.116.126:46577
I20260709 12:27:41.074617 17781 heartbeater.cc:461] Registering TS with master...
I20260709 12:27:41.075551 17781 heartbeater.cc:507] Master 127.9.116.126:46577 requested a full tablet report, sending...
I20260709 12:27:41.076665 17631 tablet_bootstrap.cc:492] T 514ee26ff21e4c08976b6a0397b730fe P 879366e90f5c420588945e0d545017c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:41.077704 17631 tablet_bootstrap.cc:492] T 514ee26ff21e4c08976b6a0397b730fe P 879366e90f5c420588945e0d545017c8: Bootstrap complete.
I20260709 12:27:41.078332 17631 ts_tablet_manager.cc:1403] T 514ee26ff21e4c08976b6a0397b730fe P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.056s	user 0.030s	sys 0.020s
I20260709 12:27:41.081002 17631 raft_consensus.cc:359] T 514ee26ff21e4c08976b6a0397b730fe P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:41.081687 17631 raft_consensus.cc:740] T 514ee26ff21e4c08976b6a0397b730fe P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:41.082245 17631 consensus_queue.cc:260] T 514ee26ff21e4c08976b6a0397b730fe P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:41.084180 17631 ts_tablet_manager.cc:1434] T 514ee26ff21e4c08976b6a0397b730fe P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:27:41.085239 17631 tablet_bootstrap.cc:492] T 442e0dfc272840f7a14c2232ed65425c P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:41.099148 16613 ts_manager.cc:194] Re-registered known tserver with Master: 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:41.102161 17631 tablet_bootstrap.cc:492] T 442e0dfc272840f7a14c2232ed65425c P 879366e90f5c420588945e0d545017c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:41.103366 17631 tablet_bootstrap.cc:492] T 442e0dfc272840f7a14c2232ed65425c P 879366e90f5c420588945e0d545017c8: Bootstrap complete.
I20260709 12:27:41.104494 17631 ts_tablet_manager.cc:1403] T 442e0dfc272840f7a14c2232ed65425c P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.000s
I20260709 12:27:41.108899 17631 raft_consensus.cc:359] T 442e0dfc272840f7a14c2232ed65425c P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:41.110383 17631 raft_consensus.cc:740] T 442e0dfc272840f7a14c2232ed65425c P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:41.111189 17631 consensus_queue.cc:260] T 442e0dfc272840f7a14c2232ed65425c P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:41.113540 17631 ts_tablet_manager.cc:1434] T 442e0dfc272840f7a14c2232ed65425c P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:27:41.114446 17631 tablet_bootstrap.cc:492] T 28bdf20fc71548da87c4558dacc503db P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:41.134213 17631 tablet_bootstrap.cc:492] T 28bdf20fc71548da87c4558dacc503db P 879366e90f5c420588945e0d545017c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:41.135020 17631 tablet_bootstrap.cc:492] T 28bdf20fc71548da87c4558dacc503db P 879366e90f5c420588945e0d545017c8: Bootstrap complete.
I20260709 12:27:41.135634 17631 ts_tablet_manager.cc:1403] T 28bdf20fc71548da87c4558dacc503db P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.003s
I20260709 12:27:41.137893 17631 raft_consensus.cc:359] T 28bdf20fc71548da87c4558dacc503db P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:41.138556 17631 raft_consensus.cc:740] T 28bdf20fc71548da87c4558dacc503db P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:41.139235 17631 consensus_queue.cc:260] T 28bdf20fc71548da87c4558dacc503db P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:41.141290 17631 ts_tablet_manager.cc:1434] T 28bdf20fc71548da87c4558dacc503db P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:27:41.142139 17631 tablet_bootstrap.cc:492] T 5f88e29c7ffd4b3b856561ee240cdd43 P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:41.151482 16613 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42986
I20260709 12:27:41.157097 17781 heartbeater.cc:499] Master 127.9.116.126:46577 was elected leader, sending a full tablet report...
I20260709 12:27:41.167243 17631 tablet_bootstrap.cc:492] T 5f88e29c7ffd4b3b856561ee240cdd43 P 879366e90f5c420588945e0d545017c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:41.168227 17631 tablet_bootstrap.cc:492] T 5f88e29c7ffd4b3b856561ee240cdd43 P 879366e90f5c420588945e0d545017c8: Bootstrap complete.
I20260709 12:27:41.168833 17631 ts_tablet_manager.cc:1403] T 5f88e29c7ffd4b3b856561ee240cdd43 P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.027s	user 0.020s	sys 0.004s
I20260709 12:27:41.171103 17631 raft_consensus.cc:359] T 5f88e29c7ffd4b3b856561ee240cdd43 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:41.171954 17631 raft_consensus.cc:740] T 5f88e29c7ffd4b3b856561ee240cdd43 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:41.172788 17631 consensus_queue.cc:260] T 5f88e29c7ffd4b3b856561ee240cdd43 P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:41.174631 17631 ts_tablet_manager.cc:1434] T 5f88e29c7ffd4b3b856561ee240cdd43 P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:27:41.175437 17631 tablet_bootstrap.cc:492] T c5baa0b4140847958c6528b3dbda7617 P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:41.193419 17710 raft_consensus.cc:3060] T cd637126e0044d7996f18e258282a145 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:41.262982 17631 tablet_bootstrap.cc:492] T c5baa0b4140847958c6528b3dbda7617 P 879366e90f5c420588945e0d545017c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:41.264060 17631 tablet_bootstrap.cc:492] T c5baa0b4140847958c6528b3dbda7617 P 879366e90f5c420588945e0d545017c8: Bootstrap complete.
I20260709 12:27:41.264835 17631 ts_tablet_manager.cc:1403] T c5baa0b4140847958c6528b3dbda7617 P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.090s	user 0.029s	sys 0.055s
I20260709 12:27:41.267196 17718 raft_consensus.cc:3060] T e628dacc30694988a7c795441df15600 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:41.268306 17631 raft_consensus.cc:359] T c5baa0b4140847958c6528b3dbda7617 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:41.269294 17631 raft_consensus.cc:740] T c5baa0b4140847958c6528b3dbda7617 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:41.270257 17631 consensus_queue.cc:260] T c5baa0b4140847958c6528b3dbda7617 P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:41.273917 17631 ts_tablet_manager.cc:1434] T c5baa0b4140847958c6528b3dbda7617 P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.005s
I20260709 12:27:41.275048 17631 tablet_bootstrap.cc:492] T 51ebab30b5104589803b75a1b48c5aa2 P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:41.294672 17712 raft_consensus.cc:3060] T 28c655b68dc545948c67e0977b49e770 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:41.305145 17631 tablet_bootstrap.cc:492] T 51ebab30b5104589803b75a1b48c5aa2 P 879366e90f5c420588945e0d545017c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:41.306267 17631 tablet_bootstrap.cc:492] T 51ebab30b5104589803b75a1b48c5aa2 P 879366e90f5c420588945e0d545017c8: Bootstrap complete.
I20260709 12:27:41.306982 17631 ts_tablet_manager.cc:1403] T 51ebab30b5104589803b75a1b48c5aa2 P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.032s	user 0.014s	sys 0.012s
I20260709 12:27:41.309613 17631 raft_consensus.cc:359] T 51ebab30b5104589803b75a1b48c5aa2 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:41.310297 17631 raft_consensus.cc:740] T 51ebab30b5104589803b75a1b48c5aa2 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:41.310985 17631 consensus_queue.cc:260] T 51ebab30b5104589803b75a1b48c5aa2 P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:41.313596 17631 ts_tablet_manager.cc:1434] T 51ebab30b5104589803b75a1b48c5aa2 P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 12:27:41.317756 17631 tablet_bootstrap.cc:492] T b777ccb9937a476590a534fea0428c5c P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:41.333819 17634 raft_consensus.cc:493] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:41.334510 17634 raft_consensus.cc:515] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:41.337060 17634 leader_election.cc:290] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:41.340371 16866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f2b93e5d2045a5a0cd1f9b5806a133" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336" is_pre_election: true
I20260709 12:27:41.341243 16866 raft_consensus.cc:2468] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82f27bcdf252425aad4c4a37d064f68d in term 2.
I20260709 12:27:41.342973 16907 leader_election.cc:304] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 82f27bcdf252425aad4c4a37d064f68d; no voters: 
I20260709 12:27:41.344624 17718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f2b93e5d2045a5a0cd1f9b5806a133" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8" is_pre_election: true
I20260709 12:27:41.345638 17718 raft_consensus.cc:2468] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82f27bcdf252425aad4c4a37d064f68d in term 1.
I20260709 12:27:41.354136 17613 raft_consensus.cc:2804] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:41.354712 17613 raft_consensus.cc:493] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:41.355192 17613 raft_consensus.cc:3060] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:41.364589 17631 tablet_bootstrap.cc:492] T b777ccb9937a476590a534fea0428c5c P 879366e90f5c420588945e0d545017c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:41.364655 17613 raft_consensus.cc:515] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:41.365855 17631 tablet_bootstrap.cc:492] T b777ccb9937a476590a534fea0428c5c P 879366e90f5c420588945e0d545017c8: Bootstrap complete.
I20260709 12:27:41.366559 17631 ts_tablet_manager.cc:1403] T b777ccb9937a476590a534fea0428c5c P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.049s	user 0.023s	sys 0.012s
I20260709 12:27:41.367091 17613 leader_election.cc:290] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 election: Requested vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:41.368654 17718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f2b93e5d2045a5a0cd1f9b5806a133" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "879366e90f5c420588945e0d545017c8"
I20260709 12:27:41.369231 17718 raft_consensus.cc:3060] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:27:41.369302 17631 raft_consensus.cc:359] T b777ccb9937a476590a534fea0428c5c P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:41.370100 17631 raft_consensus.cc:740] T b777ccb9937a476590a534fea0428c5c P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:41.370818 17631 consensus_queue.cc:260] T b777ccb9937a476590a534fea0428c5c P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:41.371985 16866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f2b93e5d2045a5a0cd1f9b5806a133" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17294485b7f24e2b9fae71dd3169a336"
I20260709 12:27:41.372627 16866 raft_consensus.cc:3060] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:41.373739 17631 ts_tablet_manager.cc:1434] T b777ccb9937a476590a534fea0428c5c P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:27:41.374608 17631 tablet_bootstrap.cc:492] T ea5085716661498e9f3bfdfa2fc5737a P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:41.379103 16866 raft_consensus.cc:2468] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 17294485b7f24e2b9fae71dd3169a336 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82f27bcdf252425aad4c4a37d064f68d in term 3.
I20260709 12:27:41.381008 16907 leader_election.cc:304] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 82f27bcdf252425aad4c4a37d064f68d; no voters: 
I20260709 12:27:41.384680 17613 raft_consensus.cc:2804] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:41.385615 17613 raft_consensus.cc:697] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d [term 3 LEADER]: Becoming Leader. State: Replica: 82f27bcdf252425aad4c4a37d064f68d, State: Running, Role: LEADER
I20260709 12:27:41.386996 17718 raft_consensus.cc:2468] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 879366e90f5c420588945e0d545017c8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82f27bcdf252425aad4c4a37d064f68d in term 3.
I20260709 12:27:41.386744 17613 consensus_queue.cc:237] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:41.393265 17631 tablet_bootstrap.cc:492] T ea5085716661498e9f3bfdfa2fc5737a P 879366e90f5c420588945e0d545017c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:41.394378 17631 tablet_bootstrap.cc:492] T ea5085716661498e9f3bfdfa2fc5737a P 879366e90f5c420588945e0d545017c8: Bootstrap complete.
I20260709 12:27:41.395285 17631 ts_tablet_manager.cc:1403] T ea5085716661498e9f3bfdfa2fc5737a P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.021s	user 0.019s	sys 0.000s
W20260709 12:27:41.396036 16759 consensus_peers.cc:597] T 7b90200ef21f42f1929fbf0051ef5b3e P 3c1aba6ee1d244fd9c0daba722aa0b3b -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:41.397877 17631 raft_consensus.cc:359] T ea5085716661498e9f3bfdfa2fc5737a P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:41.398646 17631 raft_consensus.cc:740] T ea5085716661498e9f3bfdfa2fc5737a P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:41.399338 17631 consensus_queue.cc:260] T ea5085716661498e9f3bfdfa2fc5737a P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:41.401499 17631 ts_tablet_manager.cc:1434] T ea5085716661498e9f3bfdfa2fc5737a P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:27:41.403126 17631 tablet_bootstrap.cc:492] T d6811cd94dfd44149e1329e919d82f0f P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:41.402300 16613 catalog_manager.cc:5697] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d reported cstate change: term changed from 1 to 3, leader changed from 879366e90f5c420588945e0d545017c8 (127.9.116.65) to 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68). New cstate: current_term: 3 leader_uuid: "82f27bcdf252425aad4c4a37d064f68d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:41.439079 17631 tablet_bootstrap.cc:492] T d6811cd94dfd44149e1329e919d82f0f P 879366e90f5c420588945e0d545017c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:41.440143 17631 tablet_bootstrap.cc:492] T d6811cd94dfd44149e1329e919d82f0f P 879366e90f5c420588945e0d545017c8: Bootstrap complete.
I20260709 12:27:41.441556 17631 ts_tablet_manager.cc:1403] T d6811cd94dfd44149e1329e919d82f0f P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.039s	user 0.025s	sys 0.004s
I20260709 12:27:41.444607 17631 raft_consensus.cc:359] T d6811cd94dfd44149e1329e919d82f0f P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:41.445318 17631 raft_consensus.cc:740] T d6811cd94dfd44149e1329e919d82f0f P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:41.446020 17631 consensus_queue.cc:260] T d6811cd94dfd44149e1329e919d82f0f P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:41.449859 17631 ts_tablet_manager.cc:1434] T d6811cd94dfd44149e1329e919d82f0f P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:27:41.450718 17631 tablet_bootstrap.cc:492] T 3d614e06fd2c40189161e22ad9217e5d P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:41.456995 17718 raft_consensus.cc:3060] T 442e0dfc272840f7a14c2232ed65425c P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:41.472800 17631 tablet_bootstrap.cc:492] T 3d614e06fd2c40189161e22ad9217e5d P 879366e90f5c420588945e0d545017c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:41.473860 17631 tablet_bootstrap.cc:492] T 3d614e06fd2c40189161e22ad9217e5d P 879366e90f5c420588945e0d545017c8: Bootstrap complete.
I20260709 12:27:41.474633 17631 ts_tablet_manager.cc:1403] T 3d614e06fd2c40189161e22ad9217e5d P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.024s	user 0.020s	sys 0.000s
I20260709 12:27:41.477303 17631 raft_consensus.cc:359] T 3d614e06fd2c40189161e22ad9217e5d P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:41.478008 17631 raft_consensus.cc:740] T 3d614e06fd2c40189161e22ad9217e5d P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:41.478659 17631 consensus_queue.cc:260] T 3d614e06fd2c40189161e22ad9217e5d P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:41.481379 17631 ts_tablet_manager.cc:1434] T 3d614e06fd2c40189161e22ad9217e5d P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:27:41.483052 17631 tablet_bootstrap.cc:492] T 840a644e56054e13bfd7585fa064120c P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:41.518652 17631 tablet_bootstrap.cc:492] T 840a644e56054e13bfd7585fa064120c P 879366e90f5c420588945e0d545017c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:41.520128 17631 tablet_bootstrap.cc:492] T 840a644e56054e13bfd7585fa064120c P 879366e90f5c420588945e0d545017c8: Bootstrap complete.
I20260709 12:27:41.520951 17631 ts_tablet_manager.cc:1403] T 840a644e56054e13bfd7585fa064120c P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.039s	user 0.020s	sys 0.011s
I20260709 12:27:41.524184 17631 raft_consensus.cc:359] T 840a644e56054e13bfd7585fa064120c P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:41.525007 17631 raft_consensus.cc:740] T 840a644e56054e13bfd7585fa064120c P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:41.525796 17631 consensus_queue.cc:260] T 840a644e56054e13bfd7585fa064120c P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:41.529492 17631 ts_tablet_manager.cc:1434] T 840a644e56054e13bfd7585fa064120c P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:27:41.530443 17631 tablet_bootstrap.cc:492] T 288d05b8017c4e0f8cd40048647aecae P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:41.551991 17631 tablet_bootstrap.cc:492] T 288d05b8017c4e0f8cd40048647aecae P 879366e90f5c420588945e0d545017c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:41.553054 17631 tablet_bootstrap.cc:492] T 288d05b8017c4e0f8cd40048647aecae P 879366e90f5c420588945e0d545017c8: Bootstrap complete.
I20260709 12:27:41.553658 17631 ts_tablet_manager.cc:1403] T 288d05b8017c4e0f8cd40048647aecae P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.000s
I20260709 12:27:41.555889 17631 raft_consensus.cc:359] T 288d05b8017c4e0f8cd40048647aecae P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:41.556401 17631 raft_consensus.cc:740] T 288d05b8017c4e0f8cd40048647aecae P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:41.557025 17631 consensus_queue.cc:260] T 288d05b8017c4e0f8cd40048647aecae P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:41.558869 17631 ts_tablet_manager.cc:1434] T 288d05b8017c4e0f8cd40048647aecae P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:27:41.560331 17631 tablet_bootstrap.cc:492] T 7b90200ef21f42f1929fbf0051ef5b3e P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:41.681746 17631 tablet_bootstrap.cc:492] T 7b90200ef21f42f1929fbf0051ef5b3e P 879366e90f5c420588945e0d545017c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:41.687677 17631 tablet_bootstrap.cc:492] T 7b90200ef21f42f1929fbf0051ef5b3e P 879366e90f5c420588945e0d545017c8: Bootstrap complete.
I20260709 12:27:41.689007 17631 ts_tablet_manager.cc:1403] T 7b90200ef21f42f1929fbf0051ef5b3e P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.129s	user 0.025s	sys 0.016s
I20260709 12:27:41.700502 17631 raft_consensus.cc:359] T 7b90200ef21f42f1929fbf0051ef5b3e P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:41.704401 17631 raft_consensus.cc:740] T 7b90200ef21f42f1929fbf0051ef5b3e P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:41.705761 17631 consensus_queue.cc:260] T 7b90200ef21f42f1929fbf0051ef5b3e P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:41.711369 17631 ts_tablet_manager.cc:1434] T 7b90200ef21f42f1929fbf0051ef5b3e P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.022s	user 0.011s	sys 0.000s
I20260709 12:27:41.767521 17631 tablet_bootstrap.cc:492] T 6a86fc21ef0044bb91dd271c9a019336 P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:41.770957 17709 raft_consensus.cc:3060] T 51ebab30b5104589803b75a1b48c5aa2 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:41.801384 17718 raft_consensus.cc:3060] T 840a644e56054e13bfd7585fa064120c P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:41.805660 17631 tablet_bootstrap.cc:492] T 6a86fc21ef0044bb91dd271c9a019336 P 879366e90f5c420588945e0d545017c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:41.806758 17631 tablet_bootstrap.cc:492] T 6a86fc21ef0044bb91dd271c9a019336 P 879366e90f5c420588945e0d545017c8: Bootstrap complete.
I20260709 12:27:41.807431 17631 ts_tablet_manager.cc:1403] T 6a86fc21ef0044bb91dd271c9a019336 P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.040s	user 0.021s	sys 0.006s
I20260709 12:27:41.811201 17631 raft_consensus.cc:359] T 6a86fc21ef0044bb91dd271c9a019336 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:41.813618 17631 raft_consensus.cc:740] T 6a86fc21ef0044bb91dd271c9a019336 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:41.814620 17631 consensus_queue.cc:260] T 6a86fc21ef0044bb91dd271c9a019336 P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:41.817445 17631 ts_tablet_manager.cc:1434] T 6a86fc21ef0044bb91dd271c9a019336 P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:27:41.818595 17631 tablet_bootstrap.cc:492] T 6e89df746e0c49d184637314ce87045a P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
W20260709 12:27:41.947839 16833 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37919, user_credentials={real_user=slave}} blocked reactor thread for 138876us
I20260709 12:27:41.942909 17712 raft_consensus.cc:1275] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 879366e90f5c420588945e0d545017c8 [term 3 FOLLOWER]: Refusing update from remote peer 82f27bcdf252425aad4c4a37d064f68d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:27:42.044710 16833 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:39833, user_credentials={real_user=slave}} blocked reactor thread for 78845.5us
W20260709 12:27:42.050698 16907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:39833, user_credentials={real_user=slave}} blocked reactor thread for 47118.8us
I20260709 12:27:42.111354 17710 raft_consensus.cc:3060] T 6a86fc21ef0044bb91dd271c9a019336 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:27:42.121230 16908 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.66:43629, user_credentials={real_user=slave}} blocked reactor thread for 52518.4us
I20260709 12:27:42.122351 17631 tablet_bootstrap.cc:492] T 6e89df746e0c49d184637314ce87045a P 879366e90f5c420588945e0d545017c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:42.124181 17631 tablet_bootstrap.cc:492] T 6e89df746e0c49d184637314ce87045a P 879366e90f5c420588945e0d545017c8: Bootstrap complete.
I20260709 12:27:42.136119 17718 raft_consensus.cc:3060] T 3d614e06fd2c40189161e22ad9217e5d P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:42.153970 17631 ts_tablet_manager.cc:1403] T 6e89df746e0c49d184637314ce87045a P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.336s	user 0.021s	sys 0.015s
I20260709 12:27:42.158895 17826 consensus_queue.cc:1048] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d [LEADER]: Connected to new peer: Peer: permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:27:42.168205 17631 raft_consensus.cc:359] T 6e89df746e0c49d184637314ce87045a P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:42.169275 17631 raft_consensus.cc:740] T 6e89df746e0c49d184637314ce87045a P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:42.173893 17712 raft_consensus.cc:3060] T 288d05b8017c4e0f8cd40048647aecae P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:42.199914 16867 raft_consensus.cc:1275] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 17294485b7f24e2b9fae71dd3169a336 [term 3 FOLLOWER]: Refusing update from remote peer 82f27bcdf252425aad4c4a37d064f68d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:27:42.219779 17631 consensus_queue.cc:260] T 6e89df746e0c49d184637314ce87045a P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:42.232988 17631 ts_tablet_manager.cc:1434] T 6e89df746e0c49d184637314ce87045a P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.078s	user 0.009s	sys 0.000s
I20260709 12:27:42.229242 17834 consensus_queue.cc:1048] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:42.335819 17631 tablet_bootstrap.cc:492] T a8a632c738e94b26a8352a68a42a0670 P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
W20260709 12:27:42.386651 16833 consensus_peers.cc:597] T a4252af16e15424399c32c789c8e6c23 P 17294485b7f24e2b9fae71dd3169a336 -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:42.403383 17631 tablet_bootstrap.cc:492] T a8a632c738e94b26a8352a68a42a0670 P 879366e90f5c420588945e0d545017c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:42.427707 17631 tablet_bootstrap.cc:492] T a8a632c738e94b26a8352a68a42a0670 P 879366e90f5c420588945e0d545017c8: Bootstrap complete.
I20260709 12:27:42.433763 17631 ts_tablet_manager.cc:1403] T a8a632c738e94b26a8352a68a42a0670 P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.098s	user 0.028s	sys 0.000s
I20260709 12:27:42.445618 17631 raft_consensus.cc:359] T a8a632c738e94b26a8352a68a42a0670 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:42.446377 17631 raft_consensus.cc:740] T a8a632c738e94b26a8352a68a42a0670 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:42.447263 17631 consensus_queue.cc:260] T a8a632c738e94b26a8352a68a42a0670 P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:42.458498 17631 ts_tablet_manager.cc:1434] T a8a632c738e94b26a8352a68a42a0670 P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 12:27:42.459724 17631 tablet_bootstrap.cc:492] T 9067b67140fa48e883d2d240a6046d63 P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:42.477349 17631 tablet_bootstrap.cc:492] T 9067b67140fa48e883d2d240a6046d63 P 879366e90f5c420588945e0d545017c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:42.478348 17631 tablet_bootstrap.cc:492] T 9067b67140fa48e883d2d240a6046d63 P 879366e90f5c420588945e0d545017c8: Bootstrap complete.
I20260709 12:27:42.479032 17631 ts_tablet_manager.cc:1403] T 9067b67140fa48e883d2d240a6046d63 P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.003s
I20260709 12:27:42.482049 17631 raft_consensus.cc:359] T 9067b67140fa48e883d2d240a6046d63 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:42.482793 17631 raft_consensus.cc:740] T 9067b67140fa48e883d2d240a6046d63 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:42.483482 17631 consensus_queue.cc:260] T 9067b67140fa48e883d2d240a6046d63 P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:42.485759 17631 ts_tablet_manager.cc:1434] T 9067b67140fa48e883d2d240a6046d63 P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:27:42.486712 17631 tablet_bootstrap.cc:492] T 27dda31a8cd1468eb3a824ae026485a3 P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:42.503818 17631 tablet_bootstrap.cc:492] T 27dda31a8cd1468eb3a824ae026485a3 P 879366e90f5c420588945e0d545017c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:42.505281 17631 tablet_bootstrap.cc:492] T 27dda31a8cd1468eb3a824ae026485a3 P 879366e90f5c420588945e0d545017c8: Bootstrap complete.
I20260709 12:27:42.506209 17631 ts_tablet_manager.cc:1403] T 27dda31a8cd1468eb3a824ae026485a3 P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.000s
I20260709 12:27:42.508930 17631 raft_consensus.cc:359] T 27dda31a8cd1468eb3a824ae026485a3 P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:42.509503 17631 raft_consensus.cc:740] T 27dda31a8cd1468eb3a824ae026485a3 P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:42.510138 17631 consensus_queue.cc:260] T 27dda31a8cd1468eb3a824ae026485a3 P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:42.512528 17631 ts_tablet_manager.cc:1434] T 27dda31a8cd1468eb3a824ae026485a3 P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:27:42.516414 17631 tablet_bootstrap.cc:492] T a4252af16e15424399c32c789c8e6c23 P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:42.536365 17631 tablet_bootstrap.cc:492] T a4252af16e15424399c32c789c8e6c23 P 879366e90f5c420588945e0d545017c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:42.537256 17631 tablet_bootstrap.cc:492] T a4252af16e15424399c32c789c8e6c23 P 879366e90f5c420588945e0d545017c8: Bootstrap complete.
I20260709 12:27:42.537900 17631 ts_tablet_manager.cc:1403] T a4252af16e15424399c32c789c8e6c23 P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.022s	user 0.002s	sys 0.015s
I20260709 12:27:42.541075 17631 raft_consensus.cc:359] T a4252af16e15424399c32c789c8e6c23 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:42.542160 17631 raft_consensus.cc:740] T a4252af16e15424399c32c789c8e6c23 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:42.543073 17631 consensus_queue.cc:260] T a4252af16e15424399c32c789c8e6c23 P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:42.551146 17631 ts_tablet_manager.cc:1434] T a4252af16e15424399c32c789c8e6c23 P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:27:42.552217 17631 tablet_bootstrap.cc:492] T a0409dc146674a39a9ceeeeebc081453 P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
W20260709 12:27:42.555696 16833 consensus_peers.cc:597] T 27f104a1ba60493ab47f6b876da48d67 P 17294485b7f24e2b9fae71dd3169a336 -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:42.593415 17631 tablet_bootstrap.cc:492] T a0409dc146674a39a9ceeeeebc081453 P 879366e90f5c420588945e0d545017c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:27:42.597312 16907 consensus_peers.cc:597] T b86527b8a77848629c50a32e2534f7ba P 82f27bcdf252425aad4c4a37d064f68d -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:42.598426 17631 tablet_bootstrap.cc:492] T a0409dc146674a39a9ceeeeebc081453 P 879366e90f5c420588945e0d545017c8: Bootstrap complete.
I20260709 12:27:42.599210 17631 ts_tablet_manager.cc:1403] T a0409dc146674a39a9ceeeeebc081453 P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.047s	user 0.017s	sys 0.005s
I20260709 12:27:42.603641 17631 raft_consensus.cc:359] T a0409dc146674a39a9ceeeeebc081453 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:42.604547 17631 raft_consensus.cc:740] T a0409dc146674a39a9ceeeeebc081453 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:42.605581 17631 consensus_queue.cc:260] T a0409dc146674a39a9ceeeeebc081453 P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:42.607457 17631 ts_tablet_manager.cc:1434] T a0409dc146674a39a9ceeeeebc081453 P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 12:27:42.609716 17631 tablet_bootstrap.cc:492] T ce37f3e8575c4b8e88935db231644a27 P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:42.632582 17710 raft_consensus.cc:3060] T 6e89df746e0c49d184637314ce87045a P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:42.651436 17631 tablet_bootstrap.cc:492] T ce37f3e8575c4b8e88935db231644a27 P 879366e90f5c420588945e0d545017c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:42.653017 17631 tablet_bootstrap.cc:492] T ce37f3e8575c4b8e88935db231644a27 P 879366e90f5c420588945e0d545017c8: Bootstrap complete.
I20260709 12:27:42.653805 17631 ts_tablet_manager.cc:1403] T ce37f3e8575c4b8e88935db231644a27 P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.044s	user 0.016s	sys 0.005s
I20260709 12:27:42.657634 17631 raft_consensus.cc:359] T ce37f3e8575c4b8e88935db231644a27 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:42.658330 17631 raft_consensus.cc:740] T ce37f3e8575c4b8e88935db231644a27 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:42.659184 17631 consensus_queue.cc:260] T ce37f3e8575c4b8e88935db231644a27 P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:42.663362 17631 ts_tablet_manager.cc:1434] T ce37f3e8575c4b8e88935db231644a27 P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.006s
I20260709 12:27:42.665937 17631 tablet_bootstrap.cc:492] T 8eaf179090b14105b52c4701d5599216 P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:42.677846 17710 raft_consensus.cc:3060] T 27dda31a8cd1468eb3a824ae026485a3 P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:42.686461 17631 tablet_bootstrap.cc:492] T 8eaf179090b14105b52c4701d5599216 P 879366e90f5c420588945e0d545017c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:42.687552 17631 tablet_bootstrap.cc:492] T 8eaf179090b14105b52c4701d5599216 P 879366e90f5c420588945e0d545017c8: Bootstrap complete.
I20260709 12:27:42.688360 17631 ts_tablet_manager.cc:1403] T 8eaf179090b14105b52c4701d5599216 P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.011s
I20260709 12:27:42.691679 17631 raft_consensus.cc:359] T 8eaf179090b14105b52c4701d5599216 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:42.692394 17631 raft_consensus.cc:740] T 8eaf179090b14105b52c4701d5599216 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:42.693115 17631 consensus_queue.cc:260] T 8eaf179090b14105b52c4701d5599216 P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:42.695466 17631 ts_tablet_manager.cc:1434] T 8eaf179090b14105b52c4701d5599216 P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:27:42.696408 17631 tablet_bootstrap.cc:492] T 2f737ece325c44c58194725a82923014 P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:42.713941 17631 tablet_bootstrap.cc:492] T 2f737ece325c44c58194725a82923014 P 879366e90f5c420588945e0d545017c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:42.714968 17631 tablet_bootstrap.cc:492] T 2f737ece325c44c58194725a82923014 P 879366e90f5c420588945e0d545017c8: Bootstrap complete.
I20260709 12:27:42.715716 17631 ts_tablet_manager.cc:1403] T 2f737ece325c44c58194725a82923014 P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.019s	user 0.019s	sys 0.000s
I20260709 12:27:42.718613 17631 raft_consensus.cc:359] T 2f737ece325c44c58194725a82923014 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:42.719275 17631 raft_consensus.cc:740] T 2f737ece325c44c58194725a82923014 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:42.720034 17631 consensus_queue.cc:260] T 2f737ece325c44c58194725a82923014 P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:42.723188 17631 ts_tablet_manager.cc:1434] T 2f737ece325c44c58194725a82923014 P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:27:42.724328 17631 tablet_bootstrap.cc:492] T 27f104a1ba60493ab47f6b876da48d67 P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:42.735765 17710 raft_consensus.cc:3060] T a8a632c738e94b26a8352a68a42a0670 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:42.750056 17631 tablet_bootstrap.cc:492] T 27f104a1ba60493ab47f6b876da48d67 P 879366e90f5c420588945e0d545017c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:42.751791 17631 tablet_bootstrap.cc:492] T 27f104a1ba60493ab47f6b876da48d67 P 879366e90f5c420588945e0d545017c8: Bootstrap complete.
I20260709 12:27:42.752516 17631 ts_tablet_manager.cc:1403] T 27f104a1ba60493ab47f6b876da48d67 P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.028s	user 0.021s	sys 0.004s
I20260709 12:27:42.755192 17631 raft_consensus.cc:359] T 27f104a1ba60493ab47f6b876da48d67 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:42.755829 17631 raft_consensus.cc:740] T 27f104a1ba60493ab47f6b876da48d67 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:42.756502 17631 consensus_queue.cc:260] T 27f104a1ba60493ab47f6b876da48d67 P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:42.758610 17631 ts_tablet_manager.cc:1434] T 27f104a1ba60493ab47f6b876da48d67 P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:27:42.759824 17631 tablet_bootstrap.cc:492] T b86527b8a77848629c50a32e2534f7ba P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:42.780542 17631 tablet_bootstrap.cc:492] T b86527b8a77848629c50a32e2534f7ba P 879366e90f5c420588945e0d545017c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:42.781872 17631 tablet_bootstrap.cc:492] T b86527b8a77848629c50a32e2534f7ba P 879366e90f5c420588945e0d545017c8: Bootstrap complete.
I20260709 12:27:42.782655 17631 ts_tablet_manager.cc:1403] T b86527b8a77848629c50a32e2534f7ba P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.003s
I20260709 12:27:42.786286 17631 raft_consensus.cc:359] T b86527b8a77848629c50a32e2534f7ba P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:42.787077 17631 raft_consensus.cc:740] T b86527b8a77848629c50a32e2534f7ba P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:42.787961 17631 consensus_queue.cc:260] T b86527b8a77848629c50a32e2534f7ba P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:42.790398 17631 ts_tablet_manager.cc:1434] T b86527b8a77848629c50a32e2534f7ba P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.007s	user 0.009s	sys 0.000s
I20260709 12:27:42.791388 17631 tablet_bootstrap.cc:492] T fbafe39b79894737b395f95013bc6c86 P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:42.853863 17631 tablet_bootstrap.cc:492] T fbafe39b79894737b395f95013bc6c86 P 879366e90f5c420588945e0d545017c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:42.854952 17631 tablet_bootstrap.cc:492] T fbafe39b79894737b395f95013bc6c86 P 879366e90f5c420588945e0d545017c8: Bootstrap complete.
I20260709 12:27:42.855680 17631 ts_tablet_manager.cc:1403] T fbafe39b79894737b395f95013bc6c86 P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.065s	user 0.018s	sys 0.021s
I20260709 12:27:42.858498 17631 raft_consensus.cc:359] T fbafe39b79894737b395f95013bc6c86 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:42.859526 17631 raft_consensus.cc:740] T fbafe39b79894737b395f95013bc6c86 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:42.860571 17631 consensus_queue.cc:260] T fbafe39b79894737b395f95013bc6c86 P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:42.864111 17631 ts_tablet_manager.cc:1434] T fbafe39b79894737b395f95013bc6c86 P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 12:27:42.867436 17631 tablet_bootstrap.cc:492] T b10d5b4017584d0fb22f9e542d95fcb1 P 879366e90f5c420588945e0d545017c8: Bootstrap starting.
I20260709 12:27:42.906168 17705 raft_consensus.cc:3060] T 9067b67140fa48e883d2d240a6046d63 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:42.913686 17631 tablet_bootstrap.cc:492] T b10d5b4017584d0fb22f9e542d95fcb1 P 879366e90f5c420588945e0d545017c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:42.915158 17631 tablet_bootstrap.cc:492] T b10d5b4017584d0fb22f9e542d95fcb1 P 879366e90f5c420588945e0d545017c8: Bootstrap complete.
I20260709 12:27:42.915966 17631 ts_tablet_manager.cc:1403] T b10d5b4017584d0fb22f9e542d95fcb1 P 879366e90f5c420588945e0d545017c8: Time spent bootstrapping tablet: real 0.049s	user 0.028s	sys 0.012s
I20260709 12:27:42.920701 17631 raft_consensus.cc:359] T b10d5b4017584d0fb22f9e542d95fcb1 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:42.921501 17631 raft_consensus.cc:740] T b10d5b4017584d0fb22f9e542d95fcb1 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879366e90f5c420588945e0d545017c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:42.922474 17631 consensus_queue.cc:260] T b10d5b4017584d0fb22f9e542d95fcb1 P 879366e90f5c420588945e0d545017c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:42.925128 17631 ts_tablet_manager.cc:1434] T b10d5b4017584d0fb22f9e542d95fcb1 P 879366e90f5c420588945e0d545017c8: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:27:42.965694 17705 raft_consensus.cc:3060] T a4252af16e15424399c32c789c8e6c23 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:43.037720 17705 raft_consensus.cc:3060] T 8eaf179090b14105b52c4701d5599216 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:43.065449 17710 raft_consensus.cc:3060] T b86527b8a77848629c50a32e2534f7ba P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:43.119475 17710 raft_consensus.cc:3060] T 27f104a1ba60493ab47f6b876da48d67 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:51.065261  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:51.133289 16867 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e78004b8cc14ac6b93c857cbdd63329"
dest_uuid: "17294485b7f24e2b9fae71dd3169a336"
mode: GRACEFUL
new_leader_uuid: "879366e90f5c420588945e0d545017c8"
 from {username='slave'} at 127.0.0.1:60950
I20260709 12:27:51.134163 16867 raft_consensus.cc:606] T 3e78004b8cc14ac6b93c857cbdd63329 P 17294485b7f24e2b9fae71dd3169a336 [term 1 LEADER]: Received request to transfer leadership to TS 879366e90f5c420588945e0d545017c8
I20260709 12:27:51.154361 16792 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "51d96c645e894c8597652daf12a21cf3"
dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b"
mode: GRACEFUL
new_leader_uuid: "82f27bcdf252425aad4c4a37d064f68d"
 from {username='slave'} at 127.0.0.1:51760
I20260709 12:27:51.154981 16792 raft_consensus.cc:606] T 51d96c645e894c8597652daf12a21cf3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 LEADER]: Received request to transfer leadership to TS 82f27bcdf252425aad4c4a37d064f68d
I20260709 12:27:51.157733 16867 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6e89df746e0c49d184637314ce87045a"
dest_uuid: "17294485b7f24e2b9fae71dd3169a336"
mode: GRACEFUL
new_leader_uuid: "879366e90f5c420588945e0d545017c8"
 from {username='slave'} at 127.0.0.1:60950
I20260709 12:27:51.158295 16867 raft_consensus.cc:606] T 6e89df746e0c49d184637314ce87045a P 17294485b7f24e2b9fae71dd3169a336 [term 2 LEADER]: Received request to transfer leadership to TS 879366e90f5c420588945e0d545017c8
I20260709 12:27:51.160799 16867 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a4252af16e15424399c32c789c8e6c23"
dest_uuid: "17294485b7f24e2b9fae71dd3169a336"
mode: GRACEFUL
new_leader_uuid: "879366e90f5c420588945e0d545017c8"
 from {username='slave'} at 127.0.0.1:60950
I20260709 12:27:51.161284 16867 raft_consensus.cc:606] T a4252af16e15424399c32c789c8e6c23 P 17294485b7f24e2b9fae71dd3169a336 [term 2 LEADER]: Received request to transfer leadership to TS 879366e90f5c420588945e0d545017c8
I20260709 12:27:51.163905 16867 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b6f178076e7f4c7bb41b4853bacbfc4e"
dest_uuid: "17294485b7f24e2b9fae71dd3169a336"
mode: GRACEFUL
new_leader_uuid: "879366e90f5c420588945e0d545017c8"
 from {username='slave'} at 127.0.0.1:60950
I20260709 12:27:51.164422 16867 raft_consensus.cc:606] T b6f178076e7f4c7bb41b4853bacbfc4e P 17294485b7f24e2b9fae71dd3169a336 [term 1 LEADER]: Received request to transfer leadership to TS 879366e90f5c420588945e0d545017c8
I20260709 12:27:51.167107 16867 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f39dd87ef56a40e2bf56704b2815a619"
dest_uuid: "17294485b7f24e2b9fae71dd3169a336"
mode: GRACEFUL
new_leader_uuid: "82f27bcdf252425aad4c4a37d064f68d"
 from {username='slave'} at 127.0.0.1:60950
I20260709 12:27:51.167737 16867 raft_consensus.cc:606] T f39dd87ef56a40e2bf56704b2815a619 P 17294485b7f24e2b9fae71dd3169a336 [term 1 LEADER]: Received request to transfer leadership to TS 82f27bcdf252425aad4c4a37d064f68d
I20260709 12:27:51.169147  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:27:51.171038  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:51.172219  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:51.172910 17871 raft_consensus.cc:993] T 51d96c645e894c8597652daf12a21cf3 P 3c1aba6ee1d244fd9c0daba722aa0b3b: : Instructing follower 82f27bcdf252425aad4c4a37d064f68d to start an election
I20260709 12:27:51.174551 17875 raft_consensus.cc:1081] T 51d96c645e894c8597652daf12a21cf3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 LEADER]: Signalling peer 82f27bcdf252425aad4c4a37d064f68d to start an election
I20260709 12:27:51.176203 16935 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "51d96c645e894c8597652daf12a21cf3"
dest_uuid: "82f27bcdf252425aad4c4a37d064f68d"
 from {username='slave'} at 127.0.0.1:35074
I20260709 12:27:51.176717 16935 raft_consensus.cc:493] T 51d96c645e894c8597652daf12a21cf3 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:51.177121 16935 raft_consensus.cc:3060] T 51d96c645e894c8597652daf12a21cf3 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:51.185407 16935 raft_consensus.cc:515] T 51d96c645e894c8597652daf12a21cf3 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:51.190163 16792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d96c645e894c8597652daf12a21cf3" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b"
I20260709 12:27:51.190526 16867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d96c645e894c8597652daf12a21cf3" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "17294485b7f24e2b9fae71dd3169a336"
I20260709 12:27:51.190896 16792 raft_consensus.cc:3055] T 51d96c645e894c8597652daf12a21cf3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:51.191216 16867 raft_consensus.cc:3060] T 51d96c645e894c8597652daf12a21cf3 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:51.191287 16792 raft_consensus.cc:740] T 51d96c645e894c8597652daf12a21cf3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3c1aba6ee1d244fd9c0daba722aa0b3b, State: Running, Role: LEADER
I20260709 12:27:51.192632 16792 consensus_queue.cc:260] T 51d96c645e894c8597652daf12a21cf3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:51.193814 16792 raft_consensus.cc:3060] T 51d96c645e894c8597652daf12a21cf3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:51.208288 16935 leader_election.cc:290] T 51d96c645e894c8597652daf12a21cf3 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 election: Requested vote from peers 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
I20260709 12:27:51.212116 16867 raft_consensus.cc:2468] T 51d96c645e894c8597652daf12a21cf3 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82f27bcdf252425aad4c4a37d064f68d in term 2.
I20260709 12:27:51.213604 16907 leader_election.cc:304] T 51d96c645e894c8597652daf12a21cf3 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 82f27bcdf252425aad4c4a37d064f68d; no voters: 
I20260709 12:27:51.214340 17834 raft_consensus.cc:2804] T 51d96c645e894c8597652daf12a21cf3 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:51.214784 17834 raft_consensus.cc:697] T 51d96c645e894c8597652daf12a21cf3 P 82f27bcdf252425aad4c4a37d064f68d [term 2 LEADER]: Becoming Leader. State: Replica: 82f27bcdf252425aad4c4a37d064f68d, State: Running, Role: LEADER
I20260709 12:27:51.215759 17834 consensus_queue.cc:237] T 51d96c645e894c8597652daf12a21cf3 P 82f27bcdf252425aad4c4a37d064f68d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:51.216636 16792 raft_consensus.cc:2468] T 51d96c645e894c8597652daf12a21cf3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82f27bcdf252425aad4c4a37d064f68d in term 2.
I20260709 12:27:51.254588 16616 catalog_manager.cc:5697] T 51d96c645e894c8597652daf12a21cf3 P 82f27bcdf252425aad4c4a37d064f68d reported cstate change: term changed from 1 to 2, leader changed from 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66) to 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68). New cstate: current_term: 2 leader_uuid: "82f27bcdf252425aad4c4a37d064f68d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:51.269035 17868 raft_consensus.cc:993] T 3e78004b8cc14ac6b93c857cbdd63329 P 17294485b7f24e2b9fae71dd3169a336: : Instructing follower 879366e90f5c420588945e0d545017c8 to start an election
I20260709 12:27:51.269675 17869 raft_consensus.cc:1081] T 3e78004b8cc14ac6b93c857cbdd63329 P 17294485b7f24e2b9fae71dd3169a336 [term 1 LEADER]: Signalling peer 879366e90f5c420588945e0d545017c8 to start an election
I20260709 12:27:51.271896 17710 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3e78004b8cc14ac6b93c857cbdd63329"
dest_uuid: "879366e90f5c420588945e0d545017c8"
 from {username='slave'} at 127.0.0.1:38168
I20260709 12:27:51.273670 17710 raft_consensus.cc:493] T 3e78004b8cc14ac6b93c857cbdd63329 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:51.274344 17710 raft_consensus.cc:3060] T 3e78004b8cc14ac6b93c857cbdd63329 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:51.288192 17710 raft_consensus.cc:515] T 3e78004b8cc14ac6b93c857cbdd63329 P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:51.290812 17710 leader_election.cc:290] T 3e78004b8cc14ac6b93c857cbdd63329 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 2 election: Requested vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919)
I20260709 12:27:51.291941 16866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e78004b8cc14ac6b93c857cbdd63329" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "17294485b7f24e2b9fae71dd3169a336"
I20260709 12:27:51.292820 16938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e78004b8cc14ac6b93c857cbdd63329" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "82f27bcdf252425aad4c4a37d064f68d"
I20260709 12:27:51.293452 16938 raft_consensus.cc:3060] T 3e78004b8cc14ac6b93c857cbdd63329 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:51.292865 16866 raft_consensus.cc:3055] T 3e78004b8cc14ac6b93c857cbdd63329 P 17294485b7f24e2b9fae71dd3169a336 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:51.294250 16866 raft_consensus.cc:740] T 3e78004b8cc14ac6b93c857cbdd63329 P 17294485b7f24e2b9fae71dd3169a336 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Running, Role: LEADER
I20260709 12:27:51.295449 16866 consensus_queue.cc:260] T 3e78004b8cc14ac6b93c857cbdd63329 P 17294485b7f24e2b9fae71dd3169a336 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:51.297573 16866 raft_consensus.cc:3060] T 3e78004b8cc14ac6b93c857cbdd63329 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:51.300559 16938 raft_consensus.cc:2468] T 3e78004b8cc14ac6b93c857cbdd63329 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 2.
I20260709 12:27:51.302277 17627 leader_election.cc:304] T 3e78004b8cc14ac6b93c857cbdd63329 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d, 879366e90f5c420588945e0d545017c8; no voters: 
I20260709 12:27:51.307233 17885 raft_consensus.cc:2804] T 3e78004b8cc14ac6b93c857cbdd63329 P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:51.307646 16866 raft_consensus.cc:2468] T 3e78004b8cc14ac6b93c857cbdd63329 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 2.
I20260709 12:27:51.318471 17885 raft_consensus.cc:697] T 3e78004b8cc14ac6b93c857cbdd63329 P 879366e90f5c420588945e0d545017c8 [term 2 LEADER]: Becoming Leader. State: Replica: 879366e90f5c420588945e0d545017c8, State: Running, Role: LEADER
I20260709 12:27:51.319641 17885 consensus_queue.cc:237] T 3e78004b8cc14ac6b93c857cbdd63329 P 879366e90f5c420588945e0d545017c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:51.332886 16616 catalog_manager.cc:5697] T 3e78004b8cc14ac6b93c857cbdd63329 P 879366e90f5c420588945e0d545017c8 reported cstate change: term changed from 1 to 2, leader changed from 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67) to 879366e90f5c420588945e0d545017c8 (127.9.116.65). New cstate: current_term: 2 leader_uuid: "879366e90f5c420588945e0d545017c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:51.336968 17868 raft_consensus.cc:993] T a4252af16e15424399c32c789c8e6c23 P 17294485b7f24e2b9fae71dd3169a336: : Instructing follower 879366e90f5c420588945e0d545017c8 to start an election
I20260709 12:27:51.337881 17821 raft_consensus.cc:1081] T a4252af16e15424399c32c789c8e6c23 P 17294485b7f24e2b9fae71dd3169a336 [term 2 LEADER]: Signalling peer 879366e90f5c420588945e0d545017c8 to start an election
I20260709 12:27:51.341777 17710 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a4252af16e15424399c32c789c8e6c23"
dest_uuid: "879366e90f5c420588945e0d545017c8"
 from {username='slave'} at 127.0.0.1:38168
I20260709 12:27:51.344126 17710 raft_consensus.cc:493] T a4252af16e15424399c32c789c8e6c23 P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:51.344794 17710 raft_consensus.cc:3060] T a4252af16e15424399c32c789c8e6c23 P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:51.351357 17888 raft_consensus.cc:993] T f39dd87ef56a40e2bf56704b2815a619 P 17294485b7f24e2b9fae71dd3169a336: : Instructing follower 82f27bcdf252425aad4c4a37d064f68d to start an election
I20260709 12:27:51.352012 17869 raft_consensus.cc:1081] T f39dd87ef56a40e2bf56704b2815a619 P 17294485b7f24e2b9fae71dd3169a336 [term 1 LEADER]: Signalling peer 82f27bcdf252425aad4c4a37d064f68d to start an election
I20260709 12:27:51.356359 17710 raft_consensus.cc:515] T a4252af16e15424399c32c789c8e6c23 P 879366e90f5c420588945e0d545017c8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:51.358598 17710 leader_election.cc:290] T a4252af16e15424399c32c789c8e6c23 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 3 election: Requested vote from peers 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
I20260709 12:27:51.359563 16790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4252af16e15424399c32c789c8e6c23" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b"
I20260709 12:27:51.360296 16790 raft_consensus.cc:3060] T a4252af16e15424399c32c789c8e6c23 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:51.361553 16866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4252af16e15424399c32c789c8e6c23" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "17294485b7f24e2b9fae71dd3169a336"
I20260709 12:27:51.362216 16866 raft_consensus.cc:3055] T a4252af16e15424399c32c789c8e6c23 P 17294485b7f24e2b9fae71dd3169a336 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:51.362493 16866 raft_consensus.cc:740] T a4252af16e15424399c32c789c8e6c23 P 17294485b7f24e2b9fae71dd3169a336 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Running, Role: LEADER
I20260709 12:27:51.363422 16866 consensus_queue.cc:260] T a4252af16e15424399c32c789c8e6c23 P 17294485b7f24e2b9fae71dd3169a336 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:51.364698 16866 raft_consensus.cc:3060] T a4252af16e15424399c32c789c8e6c23 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:51.366056 16938 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f39dd87ef56a40e2bf56704b2815a619"
dest_uuid: "82f27bcdf252425aad4c4a37d064f68d"
 from {username='slave'} at 127.0.0.1:35062
I20260709 12:27:51.366670 16938 raft_consensus.cc:493] T f39dd87ef56a40e2bf56704b2815a619 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:51.366995 16938 raft_consensus.cc:3060] T f39dd87ef56a40e2bf56704b2815a619 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:51.377554 16866 raft_consensus.cc:2468] T a4252af16e15424399c32c789c8e6c23 P 17294485b7f24e2b9fae71dd3169a336 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 3.
I20260709 12:27:51.379249 17627 leader_election.cc:304] T a4252af16e15424399c32c789c8e6c23 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8; no voters: 
I20260709 12:27:51.380669 17885 raft_consensus.cc:2804] T a4252af16e15424399c32c789c8e6c23 P 879366e90f5c420588945e0d545017c8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:51.381410 17885 raft_consensus.cc:697] T a4252af16e15424399c32c789c8e6c23 P 879366e90f5c420588945e0d545017c8 [term 3 LEADER]: Becoming Leader. State: Replica: 879366e90f5c420588945e0d545017c8, State: Running, Role: LEADER
I20260709 12:27:51.382501 17885 consensus_queue.cc:237] T a4252af16e15424399c32c789c8e6c23 P 879366e90f5c420588945e0d545017c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:51.383981 16938 raft_consensus.cc:515] T f39dd87ef56a40e2bf56704b2815a619 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:51.384625 16790 raft_consensus.cc:2468] T a4252af16e15424399c32c789c8e6c23 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 3.
I20260709 12:27:51.386101 17869 raft_consensus.cc:993] T 6e89df746e0c49d184637314ce87045a P 17294485b7f24e2b9fae71dd3169a336: : Instructing follower 879366e90f5c420588945e0d545017c8 to start an election
I20260709 12:27:51.386636 17821 raft_consensus.cc:1081] T 6e89df746e0c49d184637314ce87045a P 17294485b7f24e2b9fae71dd3169a336 [term 2 LEADER]: Signalling peer 879366e90f5c420588945e0d545017c8 to start an election
I20260709 12:27:51.386994 16790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f39dd87ef56a40e2bf56704b2815a619" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b"
I20260709 12:27:51.387672 16790 raft_consensus.cc:3060] T f39dd87ef56a40e2bf56704b2815a619 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:51.388247 16938 leader_election.cc:290] T f39dd87ef56a40e2bf56704b2815a619 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 election: Requested vote from peers 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
I20260709 12:27:51.388695 17710 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6e89df746e0c49d184637314ce87045a"
dest_uuid: "879366e90f5c420588945e0d545017c8"
 from {username='slave'} at 127.0.0.1:38168
I20260709 12:27:51.389309 17710 raft_consensus.cc:493] T 6e89df746e0c49d184637314ce87045a P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:51.389681 17710 raft_consensus.cc:3060] T 6e89df746e0c49d184637314ce87045a P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:51.395234 16790 raft_consensus.cc:2468] T f39dd87ef56a40e2bf56704b2815a619 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82f27bcdf252425aad4c4a37d064f68d in term 2.
I20260709 12:27:51.398411 17710 raft_consensus.cc:515] T 6e89df746e0c49d184637314ce87045a P 879366e90f5c420588945e0d545017c8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:51.401156 17710 leader_election.cc:290] T 6e89df746e0c49d184637314ce87045a P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 3 election: Requested vote from peers 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
I20260709 12:27:51.388665 16866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f39dd87ef56a40e2bf56704b2815a619" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "17294485b7f24e2b9fae71dd3169a336"
I20260709 12:27:51.401961 16866 raft_consensus.cc:3055] T f39dd87ef56a40e2bf56704b2815a619 P 17294485b7f24e2b9fae71dd3169a336 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:51.402101 16792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e89df746e0c49d184637314ce87045a" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b"
I20260709 12:27:51.402313 16866 raft_consensus.cc:740] T f39dd87ef56a40e2bf56704b2815a619 P 17294485b7f24e2b9fae71dd3169a336 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Running, Role: LEADER
I20260709 12:27:51.402688 16792 raft_consensus.cc:3060] T 6e89df746e0c49d184637314ce87045a P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:51.402876 17869 raft_consensus.cc:993] T b6f178076e7f4c7bb41b4853bacbfc4e P 17294485b7f24e2b9fae71dd3169a336: : Instructing follower 879366e90f5c420588945e0d545017c8 to start an election
I20260709 12:27:51.403661 17869 raft_consensus.cc:1081] T b6f178076e7f4c7bb41b4853bacbfc4e P 17294485b7f24e2b9fae71dd3169a336 [term 1 LEADER]: Signalling peer 879366e90f5c420588945e0d545017c8 to start an election
I20260709 12:27:51.403467 16866 consensus_queue.cc:260] T f39dd87ef56a40e2bf56704b2815a619 P 17294485b7f24e2b9fae71dd3169a336 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:51.403975 16867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e89df746e0c49d184637314ce87045a" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "17294485b7f24e2b9fae71dd3169a336"
I20260709 12:27:51.404716 16867 raft_consensus.cc:3055] T 6e89df746e0c49d184637314ce87045a P 17294485b7f24e2b9fae71dd3169a336 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:51.405151 16867 raft_consensus.cc:740] T 6e89df746e0c49d184637314ce87045a P 17294485b7f24e2b9fae71dd3169a336 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Running, Role: LEADER
I20260709 12:27:51.405300 16866 raft_consensus.cc:3060] T f39dd87ef56a40e2bf56704b2815a619 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:51.406000 16867 consensus_queue.cc:260] T 6e89df746e0c49d184637314ce87045a P 17294485b7f24e2b9fae71dd3169a336 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:51.407248 16867 raft_consensus.cc:3060] T 6e89df746e0c49d184637314ce87045a P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:51.408373 17710 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b6f178076e7f4c7bb41b4853bacbfc4e"
dest_uuid: "879366e90f5c420588945e0d545017c8"
 from {username='slave'} at 127.0.0.1:38168
I20260709 12:27:51.408957 17710 raft_consensus.cc:493] T b6f178076e7f4c7bb41b4853bacbfc4e P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:51.396644 16908 leader_election.cc:304] T f39dd87ef56a40e2bf56704b2815a619 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 82f27bcdf252425aad4c4a37d064f68d; no voters: 
I20260709 12:27:51.409327 17710 raft_consensus.cc:3060] T b6f178076e7f4c7bb41b4853bacbfc4e P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:51.409818 17834 raft_consensus.cc:2804] T f39dd87ef56a40e2bf56704b2815a619 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:51.410259 17834 raft_consensus.cc:697] T f39dd87ef56a40e2bf56704b2815a619 P 82f27bcdf252425aad4c4a37d064f68d [term 2 LEADER]: Becoming Leader. State: Replica: 82f27bcdf252425aad4c4a37d064f68d, State: Running, Role: LEADER
I20260709 12:27:51.407734 16616 catalog_manager.cc:5697] T a4252af16e15424399c32c789c8e6c23 P 879366e90f5c420588945e0d545017c8 reported cstate change: term changed from 2 to 3, leader changed from 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67) to 879366e90f5c420588945e0d545017c8 (127.9.116.65). New cstate: current_term: 3 leader_uuid: "879366e90f5c420588945e0d545017c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:51.411087 17834 consensus_queue.cc:237] T f39dd87ef56a40e2bf56704b2815a619 P 82f27bcdf252425aad4c4a37d064f68d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:51.420769 17710 raft_consensus.cc:515] T b6f178076e7f4c7bb41b4853bacbfc4e P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:51.424201 17710 leader_election.cc:290] T b6f178076e7f4c7bb41b4853bacbfc4e P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 2 election: Requested vote from peers 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
I20260709 12:27:51.425416 16790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f178076e7f4c7bb41b4853bacbfc4e" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b"
I20260709 12:27:51.426334 16790 raft_consensus.cc:3060] T b6f178076e7f4c7bb41b4853bacbfc4e P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:51.426931 16863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f178076e7f4c7bb41b4853bacbfc4e" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "17294485b7f24e2b9fae71dd3169a336"
I20260709 12:27:51.427764 16863 raft_consensus.cc:3055] T b6f178076e7f4c7bb41b4853bacbfc4e P 17294485b7f24e2b9fae71dd3169a336 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:51.428067 16863 raft_consensus.cc:740] T b6f178076e7f4c7bb41b4853bacbfc4e P 17294485b7f24e2b9fae71dd3169a336 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Running, Role: LEADER
I20260709 12:27:51.429134 16863 consensus_queue.cc:260] T b6f178076e7f4c7bb41b4853bacbfc4e P 17294485b7f24e2b9fae71dd3169a336 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:51.430788 16863 raft_consensus.cc:3060] T b6f178076e7f4c7bb41b4853bacbfc4e P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:51.439509 16792 raft_consensus.cc:2468] T 6e89df746e0c49d184637314ce87045a P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 3.
I20260709 12:27:51.438969 16616 catalog_manager.cc:5697] T f39dd87ef56a40e2bf56704b2815a619 P 82f27bcdf252425aad4c4a37d064f68d reported cstate change: term changed from 1 to 2, leader changed from 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67) to 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68). New cstate: current_term: 2 leader_uuid: "82f27bcdf252425aad4c4a37d064f68d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:51.441435 17628 leader_election.cc:304] T 6e89df746e0c49d184637314ce87045a P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8; no voters: 
I20260709 12:27:51.442656 17885 raft_consensus.cc:2804] T 6e89df746e0c49d184637314ce87045a P 879366e90f5c420588945e0d545017c8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:51.442732 16866 raft_consensus.cc:2468] T f39dd87ef56a40e2bf56704b2815a619 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82f27bcdf252425aad4c4a37d064f68d in term 2.
I20260709 12:27:51.443282 17885 raft_consensus.cc:697] T 6e89df746e0c49d184637314ce87045a P 879366e90f5c420588945e0d545017c8 [term 3 LEADER]: Becoming Leader. State: Replica: 879366e90f5c420588945e0d545017c8, State: Running, Role: LEADER
I20260709 12:27:51.444532 17885 consensus_queue.cc:237] T 6e89df746e0c49d184637314ce87045a P 879366e90f5c420588945e0d545017c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:51.450032 16863 raft_consensus.cc:2468] T b6f178076e7f4c7bb41b4853bacbfc4e P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 2.
I20260709 12:27:51.451700 17627 leader_election.cc:304] T b6f178076e7f4c7bb41b4853bacbfc4e P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8; no voters: 
I20260709 12:27:51.452766 17886 raft_consensus.cc:2804] T b6f178076e7f4c7bb41b4853bacbfc4e P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:51.464196 16867 raft_consensus.cc:2468] T 6e89df746e0c49d184637314ce87045a P 17294485b7f24e2b9fae71dd3169a336 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 3.
I20260709 12:27:51.469626 17886 raft_consensus.cc:697] T b6f178076e7f4c7bb41b4853bacbfc4e P 879366e90f5c420588945e0d545017c8 [term 2 LEADER]: Becoming Leader. State: Replica: 879366e90f5c420588945e0d545017c8, State: Running, Role: LEADER
I20260709 12:27:51.471230 17886 consensus_queue.cc:237] T b6f178076e7f4c7bb41b4853bacbfc4e P 879366e90f5c420588945e0d545017c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:51.472949 16790 raft_consensus.cc:2468] T b6f178076e7f4c7bb41b4853bacbfc4e P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 2.
I20260709 12:27:51.494117 16616 catalog_manager.cc:5697] T 6e89df746e0c49d184637314ce87045a P 879366e90f5c420588945e0d545017c8 reported cstate change: term changed from 2 to 3, leader changed from 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67) to 879366e90f5c420588945e0d545017c8 (127.9.116.65). New cstate: current_term: 3 leader_uuid: "879366e90f5c420588945e0d545017c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:51.496317 16616 catalog_manager.cc:5697] T b6f178076e7f4c7bb41b4853bacbfc4e P 879366e90f5c420588945e0d545017c8 reported cstate change: term changed from 1 to 2, leader changed from 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67) to 879366e90f5c420588945e0d545017c8 (127.9.116.65). New cstate: current_term: 2 leader_uuid: "879366e90f5c420588945e0d545017c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:51.714360 16790 raft_consensus.cc:1275] T 51d96c645e894c8597652daf12a21cf3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Refusing update from remote peer 82f27bcdf252425aad4c4a37d064f68d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:51.716320 17873 consensus_queue.cc:1048] T 51d96c645e894c8597652daf12a21cf3 P 82f27bcdf252425aad4c4a37d064f68d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:51.734593 16867 raft_consensus.cc:1275] T 51d96c645e894c8597652daf12a21cf3 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Refusing update from remote peer 82f27bcdf252425aad4c4a37d064f68d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:51.738508 17898 consensus_queue.cc:1048] T 51d96c645e894c8597652daf12a21cf3 P 82f27bcdf252425aad4c4a37d064f68d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:51.743206 16867 raft_consensus.cc:1275] T 3e78004b8cc14ac6b93c857cbdd63329 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Refusing update from remote peer 879366e90f5c420588945e0d545017c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:51.745467 17886 consensus_queue.cc:1048] T 3e78004b8cc14ac6b93c857cbdd63329 P 879366e90f5c420588945e0d545017c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:51.804895 16938 raft_consensus.cc:1275] T 3e78004b8cc14ac6b93c857cbdd63329 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Refusing update from remote peer 879366e90f5c420588945e0d545017c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:51.809137 17893 consensus_queue.cc:1048] T 3e78004b8cc14ac6b93c857cbdd63329 P 879366e90f5c420588945e0d545017c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:51.822497 16867 raft_consensus.cc:1275] T f39dd87ef56a40e2bf56704b2815a619 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Refusing update from remote peer 82f27bcdf252425aad4c4a37d064f68d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:51.824515 17834 consensus_queue.cc:1048] T f39dd87ef56a40e2bf56704b2815a619 P 82f27bcdf252425aad4c4a37d064f68d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:51.843540 16790 raft_consensus.cc:1275] T f39dd87ef56a40e2bf56704b2815a619 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Refusing update from remote peer 82f27bcdf252425aad4c4a37d064f68d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:51.846117 17834 consensus_queue.cc:1048] T f39dd87ef56a40e2bf56704b2815a619 P 82f27bcdf252425aad4c4a37d064f68d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:51.865993 16790 raft_consensus.cc:1275] T a4252af16e15424399c32c789c8e6c23 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 3 FOLLOWER]: Refusing update from remote peer 879366e90f5c420588945e0d545017c8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:51.867630 17893 consensus_queue.cc:1048] T a4252af16e15424399c32c789c8e6c23 P 879366e90f5c420588945e0d545017c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:51.886183 16867 raft_consensus.cc:1275] T 6e89df746e0c49d184637314ce87045a P 17294485b7f24e2b9fae71dd3169a336 [term 3 FOLLOWER]: Refusing update from remote peer 879366e90f5c420588945e0d545017c8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:51.887924 17893 consensus_queue.cc:1048] T 6e89df746e0c49d184637314ce87045a P 879366e90f5c420588945e0d545017c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:51.891742 16792 raft_consensus.cc:1275] T 6e89df746e0c49d184637314ce87045a P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 3 FOLLOWER]: Refusing update from remote peer 879366e90f5c420588945e0d545017c8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:51.892132 16789 raft_consensus.cc:1275] T b6f178076e7f4c7bb41b4853bacbfc4e P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Refusing update from remote peer 879366e90f5c420588945e0d545017c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:51.895622 17885 consensus_queue.cc:1048] T 6e89df746e0c49d184637314ce87045a P 879366e90f5c420588945e0d545017c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:51.896476 17893 consensus_queue.cc:1048] T b6f178076e7f4c7bb41b4853bacbfc4e P 879366e90f5c420588945e0d545017c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:51.932509 16867 raft_consensus.cc:1275] T a4252af16e15424399c32c789c8e6c23 P 17294485b7f24e2b9fae71dd3169a336 [term 3 FOLLOWER]: Refusing update from remote peer 879366e90f5c420588945e0d545017c8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:51.941293 17885 consensus_queue.cc:1048] T a4252af16e15424399c32c789c8e6c23 P 879366e90f5c420588945e0d545017c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:51.941934 16863 raft_consensus.cc:1275] T b6f178076e7f4c7bb41b4853bacbfc4e P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Refusing update from remote peer 879366e90f5c420588945e0d545017c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:51.954397 17910 consensus_queue.cc:1048] T b6f178076e7f4c7bb41b4853bacbfc4e P 879366e90f5c420588945e0d545017c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:52.236621  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:27:52.410373 16759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.68:37919, user_credentials={real_user=slave}} blocked reactor thread for 97617.8us
I20260709 12:27:52.501432 16867 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "28bdf20fc71548da87c4558dacc503db"
dest_uuid: "17294485b7f24e2b9fae71dd3169a336"
mode: GRACEFUL
new_leader_uuid: "879366e90f5c420588945e0d545017c8"
 from {username='slave'} at 127.0.0.1:60950
I20260709 12:27:52.502370 16867 raft_consensus.cc:606] T 28bdf20fc71548da87c4558dacc503db P 17294485b7f24e2b9fae71dd3169a336 [term 1 LEADER]: Received request to transfer leadership to TS 879366e90f5c420588945e0d545017c8
I20260709 12:27:52.508523 16789 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "29fcc4f156a54ca4b54a4a11e2cee973"
dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b"
mode: GRACEFUL
new_leader_uuid: "82f27bcdf252425aad4c4a37d064f68d"
 from {username='slave'} at 127.0.0.1:51760
I20260709 12:27:52.509274 16789 raft_consensus.cc:606] T 29fcc4f156a54ca4b54a4a11e2cee973 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 LEADER]: Received request to transfer leadership to TS 82f27bcdf252425aad4c4a37d064f68d
I20260709 12:27:52.513131 16867 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3649e7bb023a4958a01ad5ecbe446f0f"
dest_uuid: "17294485b7f24e2b9fae71dd3169a336"
mode: GRACEFUL
new_leader_uuid: "879366e90f5c420588945e0d545017c8"
 from {username='slave'} at 127.0.0.1:60950
I20260709 12:27:52.513785 16867 raft_consensus.cc:606] T 3649e7bb023a4958a01ad5ecbe446f0f P 17294485b7f24e2b9fae71dd3169a336 [term 1 LEADER]: Received request to transfer leadership to TS 879366e90f5c420588945e0d545017c8
I20260709 12:27:52.516938 16867 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3d614e06fd2c40189161e22ad9217e5d"
dest_uuid: "17294485b7f24e2b9fae71dd3169a336"
mode: GRACEFUL
new_leader_uuid: "879366e90f5c420588945e0d545017c8"
 from {username='slave'} at 127.0.0.1:60950
I20260709 12:27:52.517573 16867 raft_consensus.cc:606] T 3d614e06fd2c40189161e22ad9217e5d P 17294485b7f24e2b9fae71dd3169a336 [term 3 LEADER]: Received request to transfer leadership to TS 879366e90f5c420588945e0d545017c8
I20260709 12:27:52.520859 16867 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b10d5b4017584d0fb22f9e542d95fcb1"
dest_uuid: "17294485b7f24e2b9fae71dd3169a336"
mode: GRACEFUL
new_leader_uuid: "879366e90f5c420588945e0d545017c8"
 from {username='slave'} at 127.0.0.1:60950
I20260709 12:27:52.521636 16867 raft_consensus.cc:606] T b10d5b4017584d0fb22f9e542d95fcb1 P 17294485b7f24e2b9fae71dd3169a336 [term 1 LEADER]: Received request to transfer leadership to TS 879366e90f5c420588945e0d545017c8
I20260709 12:27:52.526607 16867 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de72d440fa1641a39aee027ffc0588a3"
dest_uuid: "17294485b7f24e2b9fae71dd3169a336"
mode: GRACEFUL
new_leader_uuid: "82f27bcdf252425aad4c4a37d064f68d"
 from {username='slave'} at 127.0.0.1:60950
I20260709 12:27:52.527300 16867 raft_consensus.cc:606] T de72d440fa1641a39aee027ffc0588a3 P 17294485b7f24e2b9fae71dd3169a336 [term 1 LEADER]: Received request to transfer leadership to TS 82f27bcdf252425aad4c4a37d064f68d
I20260709 12:27:52.530560  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:27:52.532780  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:52.533861  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:52.766587 17920 raft_consensus.cc:993] T 28bdf20fc71548da87c4558dacc503db P 17294485b7f24e2b9fae71dd3169a336: : Instructing follower 879366e90f5c420588945e0d545017c8 to start an election
I20260709 12:27:52.767277 17920 raft_consensus.cc:1081] T 28bdf20fc71548da87c4558dacc503db P 17294485b7f24e2b9fae71dd3169a336 [term 1 LEADER]: Signalling peer 879366e90f5c420588945e0d545017c8 to start an election
I20260709 12:27:52.770150 17705 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "28bdf20fc71548da87c4558dacc503db"
dest_uuid: "879366e90f5c420588945e0d545017c8"
 from {username='slave'} at 127.0.0.1:38168
I20260709 12:27:52.770936 17705 raft_consensus.cc:493] T 28bdf20fc71548da87c4558dacc503db P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:52.771447 17705 raft_consensus.cc:3060] T 28bdf20fc71548da87c4558dacc503db P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:52.780462 17705 raft_consensus.cc:515] T 28bdf20fc71548da87c4558dacc503db P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:52.783715 17705 leader_election.cc:290] T 28bdf20fc71548da87c4558dacc503db P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 2 election: Requested vote from peers 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
I20260709 12:27:52.784592 16789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28bdf20fc71548da87c4558dacc503db" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b"
I20260709 12:27:52.786008 16789 raft_consensus.cc:3060] T 28bdf20fc71548da87c4558dacc503db P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:52.787130 16867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28bdf20fc71548da87c4558dacc503db" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "17294485b7f24e2b9fae71dd3169a336"
I20260709 12:27:52.787963 16867 raft_consensus.cc:3055] T 28bdf20fc71548da87c4558dacc503db P 17294485b7f24e2b9fae71dd3169a336 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:52.788269 16867 raft_consensus.cc:740] T 28bdf20fc71548da87c4558dacc503db P 17294485b7f24e2b9fae71dd3169a336 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Running, Role: LEADER
I20260709 12:27:52.789551 16867 consensus_queue.cc:260] T 28bdf20fc71548da87c4558dacc503db P 17294485b7f24e2b9fae71dd3169a336 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:52.791208 16867 raft_consensus.cc:3060] T 28bdf20fc71548da87c4558dacc503db P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:52.794646 16789 raft_consensus.cc:2468] T 28bdf20fc71548da87c4558dacc503db P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 2.
I20260709 12:27:52.796573 17628 leader_election.cc:304] T 28bdf20fc71548da87c4558dacc503db P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8; no voters: 
I20260709 12:27:52.797767 17914 raft_consensus.cc:2804] T 28bdf20fc71548da87c4558dacc503db P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:52.798372 17914 raft_consensus.cc:697] T 28bdf20fc71548da87c4558dacc503db P 879366e90f5c420588945e0d545017c8 [term 2 LEADER]: Becoming Leader. State: Replica: 879366e90f5c420588945e0d545017c8, State: Running, Role: LEADER
I20260709 12:27:52.799499 17914 consensus_queue.cc:237] T 28bdf20fc71548da87c4558dacc503db P 879366e90f5c420588945e0d545017c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:52.804590 16867 raft_consensus.cc:2468] T 28bdf20fc71548da87c4558dacc503db P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 2.
I20260709 12:27:52.826273 17923 raft_consensus.cc:993] T 29fcc4f156a54ca4b54a4a11e2cee973 P 3c1aba6ee1d244fd9c0daba722aa0b3b: : Instructing follower 82f27bcdf252425aad4c4a37d064f68d to start an election
I20260709 12:27:52.826861 17923 raft_consensus.cc:1081] T 29fcc4f156a54ca4b54a4a11e2cee973 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 LEADER]: Signalling peer 82f27bcdf252425aad4c4a37d064f68d to start an election
I20260709 12:27:52.831458 16935 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "29fcc4f156a54ca4b54a4a11e2cee973"
dest_uuid: "82f27bcdf252425aad4c4a37d064f68d"
 from {username='slave'} at 127.0.0.1:35074
I20260709 12:27:52.832002 16935 raft_consensus.cc:493] T 29fcc4f156a54ca4b54a4a11e2cee973 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:52.832300 16935 raft_consensus.cc:3060] T 29fcc4f156a54ca4b54a4a11e2cee973 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:52.832463 16615 catalog_manager.cc:5697] T 28bdf20fc71548da87c4558dacc503db P 879366e90f5c420588945e0d545017c8 reported cstate change: term changed from 1 to 2, leader changed from 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67) to 879366e90f5c420588945e0d545017c8 (127.9.116.65). New cstate: current_term: 2 leader_uuid: "879366e90f5c420588945e0d545017c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:52.842285 16935 raft_consensus.cc:515] T 29fcc4f156a54ca4b54a4a11e2cee973 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:52.845260 16935 leader_election.cc:290] T 29fcc4f156a54ca4b54a4a11e2cee973 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 election: Requested vote from peers 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
I20260709 12:27:52.846065 16789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29fcc4f156a54ca4b54a4a11e2cee973" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b"
I20260709 12:27:52.846735 16789 raft_consensus.cc:3055] T 29fcc4f156a54ca4b54a4a11e2cee973 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:52.847048 16789 raft_consensus.cc:740] T 29fcc4f156a54ca4b54a4a11e2cee973 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3c1aba6ee1d244fd9c0daba722aa0b3b, State: Running, Role: LEADER
I20260709 12:27:52.848277 16789 consensus_queue.cc:260] T 29fcc4f156a54ca4b54a4a11e2cee973 P 3c1aba6ee1d244fd9c0daba722aa0b3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:52.848306 16867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29fcc4f156a54ca4b54a4a11e2cee973" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "17294485b7f24e2b9fae71dd3169a336"
I20260709 12:27:52.850410 16867 raft_consensus.cc:3060] T 29fcc4f156a54ca4b54a4a11e2cee973 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:52.850579 16789 raft_consensus.cc:3060] T 29fcc4f156a54ca4b54a4a11e2cee973 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:52.860491 16789 raft_consensus.cc:2468] T 29fcc4f156a54ca4b54a4a11e2cee973 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82f27bcdf252425aad4c4a37d064f68d in term 2.
I20260709 12:27:52.861663 16908 leader_election.cc:304] T 29fcc4f156a54ca4b54a4a11e2cee973 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 82f27bcdf252425aad4c4a37d064f68d; no voters: 
I20260709 12:27:52.863240 17898 raft_consensus.cc:2804] T 29fcc4f156a54ca4b54a4a11e2cee973 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:52.863863 17898 raft_consensus.cc:697] T 29fcc4f156a54ca4b54a4a11e2cee973 P 82f27bcdf252425aad4c4a37d064f68d [term 2 LEADER]: Becoming Leader. State: Replica: 82f27bcdf252425aad4c4a37d064f68d, State: Running, Role: LEADER
I20260709 12:27:52.864349 16867 raft_consensus.cc:2468] T 29fcc4f156a54ca4b54a4a11e2cee973 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82f27bcdf252425aad4c4a37d064f68d in term 2.
I20260709 12:27:52.865240 17898 consensus_queue.cc:237] T 29fcc4f156a54ca4b54a4a11e2cee973 P 82f27bcdf252425aad4c4a37d064f68d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:52.877942 16615 catalog_manager.cc:5697] T 29fcc4f156a54ca4b54a4a11e2cee973 P 82f27bcdf252425aad4c4a37d064f68d reported cstate change: term changed from 1 to 2, leader changed from 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66) to 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68). New cstate: current_term: 2 leader_uuid: "82f27bcdf252425aad4c4a37d064f68d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:52.878664 17821 raft_consensus.cc:993] T 3649e7bb023a4958a01ad5ecbe446f0f P 17294485b7f24e2b9fae71dd3169a336: : Instructing follower 879366e90f5c420588945e0d545017c8 to start an election
I20260709 12:27:52.879694 17919 raft_consensus.cc:1081] T 3649e7bb023a4958a01ad5ecbe446f0f P 17294485b7f24e2b9fae71dd3169a336 [term 1 LEADER]: Signalling peer 879366e90f5c420588945e0d545017c8 to start an election
I20260709 12:27:52.882361 17705 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3649e7bb023a4958a01ad5ecbe446f0f"
dest_uuid: "879366e90f5c420588945e0d545017c8"
 from {username='slave'} at 127.0.0.1:38168
I20260709 12:27:52.883052 17705 raft_consensus.cc:493] T 3649e7bb023a4958a01ad5ecbe446f0f P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:52.883476 17705 raft_consensus.cc:3060] T 3649e7bb023a4958a01ad5ecbe446f0f P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:52.897869 17705 raft_consensus.cc:515] T 3649e7bb023a4958a01ad5ecbe446f0f P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:52.899199 17921 raft_consensus.cc:993] T de72d440fa1641a39aee027ffc0588a3 P 17294485b7f24e2b9fae71dd3169a336: : Instructing follower 82f27bcdf252425aad4c4a37d064f68d to start an election
I20260709 12:27:52.899830 17921 raft_consensus.cc:1081] T de72d440fa1641a39aee027ffc0588a3 P 17294485b7f24e2b9fae71dd3169a336 [term 1 LEADER]: Signalling peer 82f27bcdf252425aad4c4a37d064f68d to start an election
I20260709 12:27:52.903906 16935 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "de72d440fa1641a39aee027ffc0588a3"
dest_uuid: "82f27bcdf252425aad4c4a37d064f68d"
 from {username='slave'} at 127.0.0.1:35062
I20260709 12:27:52.904131 17705 leader_election.cc:290] T 3649e7bb023a4958a01ad5ecbe446f0f P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 2 election: Requested vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919)
I20260709 12:27:52.904901 16938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3649e7bb023a4958a01ad5ecbe446f0f" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "82f27bcdf252425aad4c4a37d064f68d"
I20260709 12:27:52.906002 16935 raft_consensus.cc:493] T de72d440fa1641a39aee027ffc0588a3 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:52.906183 16938 raft_consensus.cc:3060] T 3649e7bb023a4958a01ad5ecbe446f0f P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:52.906517 16935 raft_consensus.cc:3060] T de72d440fa1641a39aee027ffc0588a3 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:52.907759 17921 raft_consensus.cc:993] T b10d5b4017584d0fb22f9e542d95fcb1 P 17294485b7f24e2b9fae71dd3169a336: : Instructing follower 879366e90f5c420588945e0d545017c8 to start an election
I20260709 12:27:52.910386 17925 raft_consensus.cc:1081] T b10d5b4017584d0fb22f9e542d95fcb1 P 17294485b7f24e2b9fae71dd3169a336 [term 1 LEADER]: Signalling peer 879366e90f5c420588945e0d545017c8 to start an election
I20260709 12:27:52.910429 17920 raft_consensus.cc:993] T 3d614e06fd2c40189161e22ad9217e5d P 17294485b7f24e2b9fae71dd3169a336: : Instructing follower 879366e90f5c420588945e0d545017c8 to start an election
I20260709 12:27:52.912489 17925 raft_consensus.cc:1081] T 3d614e06fd2c40189161e22ad9217e5d P 17294485b7f24e2b9fae71dd3169a336 [term 3 LEADER]: Signalling peer 879366e90f5c420588945e0d545017c8 to start an election
I20260709 12:27:52.913246 16867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3649e7bb023a4958a01ad5ecbe446f0f" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "17294485b7f24e2b9fae71dd3169a336"
I20260709 12:27:52.914176 16867 raft_consensus.cc:3055] T 3649e7bb023a4958a01ad5ecbe446f0f P 17294485b7f24e2b9fae71dd3169a336 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:52.914654 16867 raft_consensus.cc:740] T 3649e7bb023a4958a01ad5ecbe446f0f P 17294485b7f24e2b9fae71dd3169a336 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Running, Role: LEADER
I20260709 12:27:52.915562 16867 consensus_queue.cc:260] T 3649e7bb023a4958a01ad5ecbe446f0f P 17294485b7f24e2b9fae71dd3169a336 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:52.918247 16867 raft_consensus.cc:3060] T 3649e7bb023a4958a01ad5ecbe446f0f P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:52.921586 17705 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b10d5b4017584d0fb22f9e542d95fcb1"
dest_uuid: "879366e90f5c420588945e0d545017c8"
 from {username='slave'} at 127.0.0.1:38168
I20260709 12:27:52.922770 17705 raft_consensus.cc:493] T b10d5b4017584d0fb22f9e542d95fcb1 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:52.923731 17705 raft_consensus.cc:3060] T b10d5b4017584d0fb22f9e542d95fcb1 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:52.923871 17708 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3d614e06fd2c40189161e22ad9217e5d"
dest_uuid: "879366e90f5c420588945e0d545017c8"
 from {username='slave'} at 127.0.0.1:38168
I20260709 12:27:52.924722 17708 raft_consensus.cc:493] T 3d614e06fd2c40189161e22ad9217e5d P 879366e90f5c420588945e0d545017c8 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:52.925187 17708 raft_consensus.cc:3060] T 3d614e06fd2c40189161e22ad9217e5d P 879366e90f5c420588945e0d545017c8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:52.930549 16938 raft_consensus.cc:2468] T 3649e7bb023a4958a01ad5ecbe446f0f P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 2.
I20260709 12:27:52.931685 16867 raft_consensus.cc:2468] T 3649e7bb023a4958a01ad5ecbe446f0f P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 2.
I20260709 12:27:52.936549 17627 leader_election.cc:304] T 3649e7bb023a4958a01ad5ecbe446f0f P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d, 879366e90f5c420588945e0d545017c8; no voters: 
W20260709 12:27:52.986565 17627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.68:37919, user_credentials={real_user=slave}} blocked reactor thread for 50239.7us
I20260709 12:27:52.987746 17914 raft_consensus.cc:2804] T 3649e7bb023a4958a01ad5ecbe446f0f P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:52.988452 17914 raft_consensus.cc:697] T 3649e7bb023a4958a01ad5ecbe446f0f P 879366e90f5c420588945e0d545017c8 [term 2 LEADER]: Becoming Leader. State: Replica: 879366e90f5c420588945e0d545017c8, State: Running, Role: LEADER
I20260709 12:27:52.989598 17914 consensus_queue.cc:237] T 3649e7bb023a4958a01ad5ecbe446f0f P 879366e90f5c420588945e0d545017c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:52.978111 17705 raft_consensus.cc:515] T b10d5b4017584d0fb22f9e542d95fcb1 P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:52.980697 16935 raft_consensus.cc:515] T de72d440fa1641a39aee027ffc0588a3 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:52.994220 17705 leader_election.cc:290] T b10d5b4017584d0fb22f9e542d95fcb1 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 2 election: Requested vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919)
I20260709 12:27:52.995906 16935 leader_election.cc:290] T de72d440fa1641a39aee027ffc0588a3 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 election: Requested vote from peers 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
I20260709 12:27:53.012305 16792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de72d440fa1641a39aee027ffc0588a3" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b"
I20260709 12:27:53.013067 16792 raft_consensus.cc:3060] T de72d440fa1641a39aee027ffc0588a3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:53.016301 16861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b10d5b4017584d0fb22f9e542d95fcb1" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "17294485b7f24e2b9fae71dd3169a336"
I20260709 12:27:53.017335 16861 raft_consensus.cc:3055] T b10d5b4017584d0fb22f9e542d95fcb1 P 17294485b7f24e2b9fae71dd3169a336 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:53.017704 16861 raft_consensus.cc:740] T b10d5b4017584d0fb22f9e542d95fcb1 P 17294485b7f24e2b9fae71dd3169a336 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Running, Role: LEADER
I20260709 12:27:53.018769 16861 consensus_queue.cc:260] T b10d5b4017584d0fb22f9e542d95fcb1 P 17294485b7f24e2b9fae71dd3169a336 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:53.030655 16867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de72d440fa1641a39aee027ffc0588a3" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "17294485b7f24e2b9fae71dd3169a336"
I20260709 12:27:53.031760 16867 raft_consensus.cc:3055] T de72d440fa1641a39aee027ffc0588a3 P 17294485b7f24e2b9fae71dd3169a336 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:53.032248 16867 raft_consensus.cc:740] T de72d440fa1641a39aee027ffc0588a3 P 17294485b7f24e2b9fae71dd3169a336 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Running, Role: LEADER
I20260709 12:27:53.033176 16867 consensus_queue.cc:260] T de72d440fa1641a39aee027ffc0588a3 P 17294485b7f24e2b9fae71dd3169a336 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:53.037966 16867 raft_consensus.cc:3060] T de72d440fa1641a39aee027ffc0588a3 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:53.038148 17708 raft_consensus.cc:515] T 3d614e06fd2c40189161e22ad9217e5d P 879366e90f5c420588945e0d545017c8 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:53.042163 16861 raft_consensus.cc:3060] T b10d5b4017584d0fb22f9e542d95fcb1 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:53.045284 16615 catalog_manager.cc:5697] T 3649e7bb023a4958a01ad5ecbe446f0f P 879366e90f5c420588945e0d545017c8 reported cstate change: term changed from 1 to 2, leader changed from 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67) to 879366e90f5c420588945e0d545017c8 (127.9.116.65). New cstate: current_term: 2 leader_uuid: "879366e90f5c420588945e0d545017c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:53.052253 17708 leader_election.cc:290] T 3d614e06fd2c40189161e22ad9217e5d P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 4 election: Requested vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919)
I20260709 12:27:53.054823 16866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d614e06fd2c40189161e22ad9217e5d" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "17294485b7f24e2b9fae71dd3169a336"
I20260709 12:27:53.055639 16866 raft_consensus.cc:3055] T 3d614e06fd2c40189161e22ad9217e5d P 17294485b7f24e2b9fae71dd3169a336 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:53.055969 16866 raft_consensus.cc:740] T 3d614e06fd2c40189161e22ad9217e5d P 17294485b7f24e2b9fae71dd3169a336 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Running, Role: LEADER
I20260709 12:27:53.056998 16866 consensus_queue.cc:260] T 3d614e06fd2c40189161e22ad9217e5d P 17294485b7f24e2b9fae71dd3169a336 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:53.058094 16867 raft_consensus.cc:2468] T de72d440fa1641a39aee027ffc0588a3 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82f27bcdf252425aad4c4a37d064f68d in term 2.
I20260709 12:27:53.058826 16866 raft_consensus.cc:3060] T 3d614e06fd2c40189161e22ad9217e5d P 17294485b7f24e2b9fae71dd3169a336 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:53.055965 16938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b10d5b4017584d0fb22f9e542d95fcb1" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "82f27bcdf252425aad4c4a37d064f68d"
I20260709 12:27:53.060451 16938 raft_consensus.cc:3060] T b10d5b4017584d0fb22f9e542d95fcb1 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:53.067390 16792 raft_consensus.cc:2468] T de72d440fa1641a39aee027ffc0588a3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82f27bcdf252425aad4c4a37d064f68d in term 2.
I20260709 12:27:53.067519 16935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d614e06fd2c40189161e22ad9217e5d" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "82f27bcdf252425aad4c4a37d064f68d"
I20260709 12:27:53.069103 16908 leader_election.cc:304] T de72d440fa1641a39aee027ffc0588a3 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 82f27bcdf252425aad4c4a37d064f68d; no voters: 
I20260709 12:27:53.069795 16935 raft_consensus.cc:3060] T 3d614e06fd2c40189161e22ad9217e5d P 82f27bcdf252425aad4c4a37d064f68d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:53.070169 17924 raft_consensus.cc:2804] T de72d440fa1641a39aee027ffc0588a3 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:53.070708 17924 raft_consensus.cc:697] T de72d440fa1641a39aee027ffc0588a3 P 82f27bcdf252425aad4c4a37d064f68d [term 2 LEADER]: Becoming Leader. State: Replica: 82f27bcdf252425aad4c4a37d064f68d, State: Running, Role: LEADER
I20260709 12:27:53.071887 17924 consensus_queue.cc:237] T de72d440fa1641a39aee027ffc0588a3 P 82f27bcdf252425aad4c4a37d064f68d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:53.074294 16938 raft_consensus.cc:2468] T b10d5b4017584d0fb22f9e542d95fcb1 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 2.
I20260709 12:27:53.080183 17627 leader_election.cc:304] T b10d5b4017584d0fb22f9e542d95fcb1 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d, 879366e90f5c420588945e0d545017c8; no voters: 
I20260709 12:27:53.081295 16866 raft_consensus.cc:2468] T 3d614e06fd2c40189161e22ad9217e5d P 17294485b7f24e2b9fae71dd3169a336 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 4.
I20260709 12:27:53.083895 16861 raft_consensus.cc:2468] T b10d5b4017584d0fb22f9e542d95fcb1 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 2.
I20260709 12:27:53.084621 16935 raft_consensus.cc:2468] T 3d614e06fd2c40189161e22ad9217e5d P 82f27bcdf252425aad4c4a37d064f68d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 4.
I20260709 12:27:53.085227 17914 raft_consensus.cc:2804] T b10d5b4017584d0fb22f9e542d95fcb1 P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:53.085803 17914 raft_consensus.cc:697] T b10d5b4017584d0fb22f9e542d95fcb1 P 879366e90f5c420588945e0d545017c8 [term 2 LEADER]: Becoming Leader. State: Replica: 879366e90f5c420588945e0d545017c8, State: Running, Role: LEADER
I20260709 12:27:53.086731 17914 consensus_queue.cc:237] T b10d5b4017584d0fb22f9e542d95fcb1 P 879366e90f5c420588945e0d545017c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:53.096542 17627 leader_election.cc:304] T 3d614e06fd2c40189161e22ad9217e5d P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8; no voters: 
I20260709 12:27:53.097661 17914 raft_consensus.cc:2804] T 3d614e06fd2c40189161e22ad9217e5d P 879366e90f5c420588945e0d545017c8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:53.098490 17914 raft_consensus.cc:697] T 3d614e06fd2c40189161e22ad9217e5d P 879366e90f5c420588945e0d545017c8 [term 4 LEADER]: Becoming Leader. State: Replica: 879366e90f5c420588945e0d545017c8, State: Running, Role: LEADER
I20260709 12:27:53.099431 17914 consensus_queue.cc:237] T 3d614e06fd2c40189161e22ad9217e5d P 879366e90f5c420588945e0d545017c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:53.104511 16615 catalog_manager.cc:5697] T b10d5b4017584d0fb22f9e542d95fcb1 P 879366e90f5c420588945e0d545017c8 reported cstate change: term changed from 1 to 2, leader changed from 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67) to 879366e90f5c420588945e0d545017c8 (127.9.116.65). New cstate: current_term: 2 leader_uuid: "879366e90f5c420588945e0d545017c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:53.111769 16616 catalog_manager.cc:5697] T de72d440fa1641a39aee027ffc0588a3 P 82f27bcdf252425aad4c4a37d064f68d reported cstate change: term changed from 1 to 2, leader changed from 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67) to 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68). New cstate: current_term: 2 leader_uuid: "82f27bcdf252425aad4c4a37d064f68d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:53.127936 16616 catalog_manager.cc:5697] T 3d614e06fd2c40189161e22ad9217e5d P 879366e90f5c420588945e0d545017c8 reported cstate change: term changed from 3 to 4, leader changed from 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67) to 879366e90f5c420588945e0d545017c8 (127.9.116.65). New cstate: current_term: 4 leader_uuid: "879366e90f5c420588945e0d545017c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:53.180141 16861 raft_consensus.cc:1275] T 28bdf20fc71548da87c4558dacc503db P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Refusing update from remote peer 879366e90f5c420588945e0d545017c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:53.181727 17914 consensus_queue.cc:1048] T 28bdf20fc71548da87c4558dacc503db P 879366e90f5c420588945e0d545017c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:53.199936 16792 raft_consensus.cc:1275] T 28bdf20fc71548da87c4558dacc503db P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Refusing update from remote peer 879366e90f5c420588945e0d545017c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:53.202111 17914 consensus_queue.cc:1048] T 28bdf20fc71548da87c4558dacc503db P 879366e90f5c420588945e0d545017c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:27:53.293808 16792 raft_consensus.cc:1275] T 29fcc4f156a54ca4b54a4a11e2cee973 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Refusing update from remote peer 82f27bcdf252425aad4c4a37d064f68d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:53.296073 17898 consensus_queue.cc:1048] T 29fcc4f156a54ca4b54a4a11e2cee973 P 82f27bcdf252425aad4c4a37d064f68d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:53.310233 16861 raft_consensus.cc:1275] T 29fcc4f156a54ca4b54a4a11e2cee973 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Refusing update from remote peer 82f27bcdf252425aad4c4a37d064f68d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:53.311951 17924 consensus_queue.cc:1048] T 29fcc4f156a54ca4b54a4a11e2cee973 P 82f27bcdf252425aad4c4a37d064f68d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:53.479303 16935 raft_consensus.cc:1275] T 3649e7bb023a4958a01ad5ecbe446f0f P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Refusing update from remote peer 879366e90f5c420588945e0d545017c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:53.480726 17914 consensus_queue.cc:1048] T 3649e7bb023a4958a01ad5ecbe446f0f P 879366e90f5c420588945e0d545017c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:53.498032 16866 raft_consensus.cc:1275] T 3649e7bb023a4958a01ad5ecbe446f0f P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Refusing update from remote peer 879366e90f5c420588945e0d545017c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:53.502342 16866 raft_consensus.cc:1275] T de72d440fa1641a39aee027ffc0588a3 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Refusing update from remote peer 82f27bcdf252425aad4c4a37d064f68d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:53.502636 16792 raft_consensus.cc:1275] T de72d440fa1641a39aee027ffc0588a3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Refusing update from remote peer 82f27bcdf252425aad4c4a37d064f68d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:53.504437 17898 consensus_queue.cc:1048] T de72d440fa1641a39aee027ffc0588a3 P 82f27bcdf252425aad4c4a37d064f68d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:53.504434 17946 consensus_queue.cc:1048] T 3649e7bb023a4958a01ad5ecbe446f0f P 879366e90f5c420588945e0d545017c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:53.505455 17924 consensus_queue.cc:1048] T de72d440fa1641a39aee027ffc0588a3 P 82f27bcdf252425aad4c4a37d064f68d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:53.529157 16861 raft_consensus.cc:1275] T 3d614e06fd2c40189161e22ad9217e5d P 17294485b7f24e2b9fae71dd3169a336 [term 4 FOLLOWER]: Refusing update from remote peer 879366e90f5c420588945e0d545017c8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:27:53.554452 17915 consensus_queue.cc:1048] T 3d614e06fd2c40189161e22ad9217e5d P 879366e90f5c420588945e0d545017c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:53.557915 16935 raft_consensus.cc:1275] T b10d5b4017584d0fb22f9e542d95fcb1 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Refusing update from remote peer 879366e90f5c420588945e0d545017c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:53.569182 17946 consensus_queue.cc:1048] T b10d5b4017584d0fb22f9e542d95fcb1 P 879366e90f5c420588945e0d545017c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:53.592085  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:53.593276 16938 raft_consensus.cc:1275] T 3d614e06fd2c40189161e22ad9217e5d P 82f27bcdf252425aad4c4a37d064f68d [term 4 FOLLOWER]: Refusing update from remote peer 879366e90f5c420588945e0d545017c8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:27:53.601671 16861 raft_consensus.cc:1275] T b10d5b4017584d0fb22f9e542d95fcb1 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Refusing update from remote peer 879366e90f5c420588945e0d545017c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:53.604799 17915 consensus_queue.cc:1048] T 3d614e06fd2c40189161e22ad9217e5d P 879366e90f5c420588945e0d545017c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:53.605304 17914 consensus_queue.cc:1048] T b10d5b4017584d0fb22f9e542d95fcb1 P 879366e90f5c420588945e0d545017c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:53.722685 16792 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "223b3745452c412581caf058f6b81fe2"
dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b"
mode: GRACEFUL
new_leader_uuid: "879366e90f5c420588945e0d545017c8"
 from {username='slave'} at 127.0.0.1:51760
I20260709 12:27:53.723351 16792 raft_consensus.cc:606] T 223b3745452c412581caf058f6b81fe2 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 LEADER]: Received request to transfer leadership to TS 879366e90f5c420588945e0d545017c8
I20260709 12:27:53.727147 16792 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5025c37302bd4a2aa076878e1af90366"
dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b"
mode: GRACEFUL
new_leader_uuid: "879366e90f5c420588945e0d545017c8"
 from {username='slave'} at 127.0.0.1:51760
I20260709 12:27:53.728120 16792 raft_consensus.cc:606] T 5025c37302bd4a2aa076878e1af90366 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 LEADER]: Received request to transfer leadership to TS 879366e90f5c420588945e0d545017c8
I20260709 12:27:53.731200 16792 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "52538067157143b2abd4656a4bbb9442"
dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b"
mode: GRACEFUL
new_leader_uuid: "879366e90f5c420588945e0d545017c8"
 from {username='slave'} at 127.0.0.1:51760
I20260709 12:27:53.731933 16792 raft_consensus.cc:606] T 52538067157143b2abd4656a4bbb9442 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 LEADER]: Received request to transfer leadership to TS 879366e90f5c420588945e0d545017c8
I20260709 12:27:53.735523 16792 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a86fc21ef0044bb91dd271c9a019336"
dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b"
mode: GRACEFUL
new_leader_uuid: "879366e90f5c420588945e0d545017c8"
 from {username='slave'} at 127.0.0.1:51760
I20260709 12:27:53.736311 16792 raft_consensus.cc:606] T 6a86fc21ef0044bb91dd271c9a019336 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 LEADER]: Received request to transfer leadership to TS 879366e90f5c420588945e0d545017c8
I20260709 12:27:53.740192 16866 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f29cf6eb18e842c3a5aa62d8fae53279"
dest_uuid: "17294485b7f24e2b9fae71dd3169a336"
mode: GRACEFUL
new_leader_uuid: "82f27bcdf252425aad4c4a37d064f68d"
 from {username='slave'} at 127.0.0.1:60950
I20260709 12:27:53.740774 16866 raft_consensus.cc:606] T f29cf6eb18e842c3a5aa62d8fae53279 P 17294485b7f24e2b9fae71dd3169a336 [term 2 LEADER]: Received request to transfer leadership to TS 82f27bcdf252425aad4c4a37d064f68d
I20260709 12:27:53.742363  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:27:53.744509  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:53.745288  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:53.750306 17956 raft_consensus.cc:993] T 6a86fc21ef0044bb91dd271c9a019336 P 3c1aba6ee1d244fd9c0daba722aa0b3b: : Instructing follower 879366e90f5c420588945e0d545017c8 to start an election
I20260709 12:27:53.750995 17956 raft_consensus.cc:1081] T 6a86fc21ef0044bb91dd271c9a019336 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 LEADER]: Signalling peer 879366e90f5c420588945e0d545017c8 to start an election
I20260709 12:27:53.753202 17708 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6a86fc21ef0044bb91dd271c9a019336"
dest_uuid: "879366e90f5c420588945e0d545017c8"
 from {username='slave'} at 127.0.0.1:38178
I20260709 12:27:53.754436 17708 raft_consensus.cc:493] T 6a86fc21ef0044bb91dd271c9a019336 P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:53.755110 17708 raft_consensus.cc:3060] T 6a86fc21ef0044bb91dd271c9a019336 P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:53.766228 17708 raft_consensus.cc:515] T 6a86fc21ef0044bb91dd271c9a019336 P 879366e90f5c420588945e0d545017c8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:53.770248 17708 leader_election.cc:290] T 6a86fc21ef0044bb91dd271c9a019336 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 3 election: Requested vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:53.770147 16935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a86fc21ef0044bb91dd271c9a019336" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "82f27bcdf252425aad4c4a37d064f68d"
I20260709 12:27:53.771064 16935 raft_consensus.cc:3060] T 6a86fc21ef0044bb91dd271c9a019336 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:53.777154 17932 raft_consensus.cc:993] T f29cf6eb18e842c3a5aa62d8fae53279 P 17294485b7f24e2b9fae71dd3169a336: : Instructing follower 82f27bcdf252425aad4c4a37d064f68d to start an election
I20260709 12:27:53.777889 17821 raft_consensus.cc:1081] T f29cf6eb18e842c3a5aa62d8fae53279 P 17294485b7f24e2b9fae71dd3169a336 [term 2 LEADER]: Signalling peer 82f27bcdf252425aad4c4a37d064f68d to start an election
I20260709 12:27:53.779934 16938 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f29cf6eb18e842c3a5aa62d8fae53279"
dest_uuid: "82f27bcdf252425aad4c4a37d064f68d"
 from {username='slave'} at 127.0.0.1:35062
I20260709 12:27:53.780619 16938 raft_consensus.cc:493] T f29cf6eb18e842c3a5aa62d8fae53279 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:53.781299 16938 raft_consensus.cc:3060] T f29cf6eb18e842c3a5aa62d8fae53279 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:53.782241 16792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a86fc21ef0044bb91dd271c9a019336" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b"
I20260709 12:27:53.783021 16792 raft_consensus.cc:3055] T 6a86fc21ef0044bb91dd271c9a019336 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:53.783334 16792 raft_consensus.cc:740] T 6a86fc21ef0044bb91dd271c9a019336 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3c1aba6ee1d244fd9c0daba722aa0b3b, State: Running, Role: LEADER
I20260709 12:27:53.784332 16792 consensus_queue.cc:260] T 6a86fc21ef0044bb91dd271c9a019336 P 3c1aba6ee1d244fd9c0daba722aa0b3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:53.785578 16792 raft_consensus.cc:3060] T 6a86fc21ef0044bb91dd271c9a019336 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:53.781543 16935 raft_consensus.cc:2468] T 6a86fc21ef0044bb91dd271c9a019336 P 82f27bcdf252425aad4c4a37d064f68d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 3.
I20260709 12:27:53.790274 17627 leader_election.cc:304] T 6a86fc21ef0044bb91dd271c9a019336 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d, 879366e90f5c420588945e0d545017c8; no voters: 
I20260709 12:27:53.791213 17915 raft_consensus.cc:2804] T 6a86fc21ef0044bb91dd271c9a019336 P 879366e90f5c420588945e0d545017c8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:53.791908 17915 raft_consensus.cc:697] T 6a86fc21ef0044bb91dd271c9a019336 P 879366e90f5c420588945e0d545017c8 [term 3 LEADER]: Becoming Leader. State: Replica: 879366e90f5c420588945e0d545017c8, State: Running, Role: LEADER
I20260709 12:27:53.793151 17915 consensus_queue.cc:237] T 6a86fc21ef0044bb91dd271c9a019336 P 879366e90f5c420588945e0d545017c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:53.800696 16792 raft_consensus.cc:2468] T 6a86fc21ef0044bb91dd271c9a019336 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 3.
I20260709 12:27:53.806456 16938 raft_consensus.cc:515] T f29cf6eb18e842c3a5aa62d8fae53279 P 82f27bcdf252425aad4c4a37d064f68d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:53.825927 16938 leader_election.cc:290] T f29cf6eb18e842c3a5aa62d8fae53279 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 election: Requested vote from peers 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
I20260709 12:27:53.827240 16792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f29cf6eb18e842c3a5aa62d8fae53279" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b"
I20260709 12:27:53.827483 16866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f29cf6eb18e842c3a5aa62d8fae53279" candidate_uuid: "82f27bcdf252425aad4c4a37d064f68d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "17294485b7f24e2b9fae71dd3169a336"
I20260709 12:27:53.827932 16792 raft_consensus.cc:3060] T f29cf6eb18e842c3a5aa62d8fae53279 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:53.828111 16866 raft_consensus.cc:3055] T f29cf6eb18e842c3a5aa62d8fae53279 P 17294485b7f24e2b9fae71dd3169a336 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:53.828506 16866 raft_consensus.cc:740] T f29cf6eb18e842c3a5aa62d8fae53279 P 17294485b7f24e2b9fae71dd3169a336 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Running, Role: LEADER
I20260709 12:27:53.829322 16866 consensus_queue.cc:260] T f29cf6eb18e842c3a5aa62d8fae53279 P 17294485b7f24e2b9fae71dd3169a336 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:53.830381 16866 raft_consensus.cc:3060] T f29cf6eb18e842c3a5aa62d8fae53279 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:53.838929 16792 raft_consensus.cc:2468] T f29cf6eb18e842c3a5aa62d8fae53279 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82f27bcdf252425aad4c4a37d064f68d in term 3.
I20260709 12:27:53.839911 16866 raft_consensus.cc:2468] T f29cf6eb18e842c3a5aa62d8fae53279 P 17294485b7f24e2b9fae71dd3169a336 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82f27bcdf252425aad4c4a37d064f68d in term 3.
I20260709 12:27:53.840396 16908 leader_election.cc:304] T f29cf6eb18e842c3a5aa62d8fae53279 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 82f27bcdf252425aad4c4a37d064f68d; no voters: 
I20260709 12:27:53.847079 17898 raft_consensus.cc:2804] T f29cf6eb18e842c3a5aa62d8fae53279 P 82f27bcdf252425aad4c4a37d064f68d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:53.847988 17898 raft_consensus.cc:697] T f29cf6eb18e842c3a5aa62d8fae53279 P 82f27bcdf252425aad4c4a37d064f68d [term 3 LEADER]: Becoming Leader. State: Replica: 82f27bcdf252425aad4c4a37d064f68d, State: Running, Role: LEADER
I20260709 12:27:53.849120 17898 consensus_queue.cc:237] T f29cf6eb18e842c3a5aa62d8fae53279 P 82f27bcdf252425aad4c4a37d064f68d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:53.854115 17955 raft_consensus.cc:993] T 52538067157143b2abd4656a4bbb9442 P 3c1aba6ee1d244fd9c0daba722aa0b3b: : Instructing follower 879366e90f5c420588945e0d545017c8 to start an election
I20260709 12:27:53.854722 17955 raft_consensus.cc:1081] T 52538067157143b2abd4656a4bbb9442 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 LEADER]: Signalling peer 879366e90f5c420588945e0d545017c8 to start an election
I20260709 12:27:53.856786 17710 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "52538067157143b2abd4656a4bbb9442"
dest_uuid: "879366e90f5c420588945e0d545017c8"
 from {username='slave'} at 127.0.0.1:38178
I20260709 12:27:53.857447 17710 raft_consensus.cc:493] T 52538067157143b2abd4656a4bbb9442 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:53.857851 17710 raft_consensus.cc:3060] T 52538067157143b2abd4656a4bbb9442 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:53.857465 16613 catalog_manager.cc:5697] T 6a86fc21ef0044bb91dd271c9a019336 P 879366e90f5c420588945e0d545017c8 reported cstate change: term changed from 2 to 3, leader changed from 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66) to 879366e90f5c420588945e0d545017c8 (127.9.116.65). New cstate: current_term: 3 leader_uuid: "879366e90f5c420588945e0d545017c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:53.867810 17710 raft_consensus.cc:515] T 52538067157143b2abd4656a4bbb9442 P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:53.869824 17710 leader_election.cc:290] T 52538067157143b2abd4656a4bbb9442 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 2 election: Requested vote from peers 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
I20260709 12:27:53.871807 16790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52538067157143b2abd4656a4bbb9442" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b"
I20260709 12:27:53.872560 16790 raft_consensus.cc:3055] T 52538067157143b2abd4656a4bbb9442 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:53.872869 16790 raft_consensus.cc:740] T 52538067157143b2abd4656a4bbb9442 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3c1aba6ee1d244fd9c0daba722aa0b3b, State: Running, Role: LEADER
I20260709 12:27:53.873652 16790 consensus_queue.cc:260] T 52538067157143b2abd4656a4bbb9442 P 3c1aba6ee1d244fd9c0daba722aa0b3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:53.874429 16861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52538067157143b2abd4656a4bbb9442" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "17294485b7f24e2b9fae71dd3169a336"
I20260709 12:27:53.875082 16861 raft_consensus.cc:3060] T 52538067157143b2abd4656a4bbb9442 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:53.874835 16790 raft_consensus.cc:3060] T 52538067157143b2abd4656a4bbb9442 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:53.882660 16614 catalog_manager.cc:5697] T f29cf6eb18e842c3a5aa62d8fae53279 P 82f27bcdf252425aad4c4a37d064f68d reported cstate change: term changed from 2 to 3, leader changed from 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67) to 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68). New cstate: current_term: 3 leader_uuid: "82f27bcdf252425aad4c4a37d064f68d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:53.886627 16790 raft_consensus.cc:2468] T 52538067157143b2abd4656a4bbb9442 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 2.
I20260709 12:27:53.884521 16861 raft_consensus.cc:2468] T 52538067157143b2abd4656a4bbb9442 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 2.
I20260709 12:27:53.888260 17628 leader_election.cc:304] T 52538067157143b2abd4656a4bbb9442 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8; no voters: 
I20260709 12:27:53.889312 17915 raft_consensus.cc:2804] T 52538067157143b2abd4656a4bbb9442 P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:53.890002 17915 raft_consensus.cc:697] T 52538067157143b2abd4656a4bbb9442 P 879366e90f5c420588945e0d545017c8 [term 2 LEADER]: Becoming Leader. State: Replica: 879366e90f5c420588945e0d545017c8, State: Running, Role: LEADER
I20260709 12:27:53.890938 17915 consensus_queue.cc:237] T 52538067157143b2abd4656a4bbb9442 P 879366e90f5c420588945e0d545017c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:53.903442 16614 catalog_manager.cc:5697] T 52538067157143b2abd4656a4bbb9442 P 879366e90f5c420588945e0d545017c8 reported cstate change: term changed from 1 to 2, leader changed from 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66) to 879366e90f5c420588945e0d545017c8 (127.9.116.65). New cstate: current_term: 2 leader_uuid: "879366e90f5c420588945e0d545017c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:54.245539 17964 raft_consensus.cc:993] T 5025c37302bd4a2aa076878e1af90366 P 3c1aba6ee1d244fd9c0daba722aa0b3b: : Instructing follower 879366e90f5c420588945e0d545017c8 to start an election
I20260709 12:27:54.246248 17955 raft_consensus.cc:1081] T 5025c37302bd4a2aa076878e1af90366 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 LEADER]: Signalling peer 879366e90f5c420588945e0d545017c8 to start an election
I20260709 12:27:54.249140 16792 raft_consensus.cc:1275] T 6a86fc21ef0044bb91dd271c9a019336 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 3 FOLLOWER]: Refusing update from remote peer 879366e90f5c420588945e0d545017c8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:54.248355 17708 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5025c37302bd4a2aa076878e1af90366"
dest_uuid: "879366e90f5c420588945e0d545017c8"
 from {username='slave'} at 127.0.0.1:38178
I20260709 12:27:54.250488 17708 raft_consensus.cc:493] T 5025c37302bd4a2aa076878e1af90366 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:54.250913 17708 raft_consensus.cc:3060] T 5025c37302bd4a2aa076878e1af90366 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:54.250945 17963 consensus_queue.cc:1048] T 6a86fc21ef0044bb91dd271c9a019336 P 879366e90f5c420588945e0d545017c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:54.259469 17708 raft_consensus.cc:515] T 5025c37302bd4a2aa076878e1af90366 P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:54.263185 16790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5025c37302bd4a2aa076878e1af90366" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b"
I20260709 12:27:54.264304 16790 raft_consensus.cc:3055] T 5025c37302bd4a2aa076878e1af90366 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:54.267357 16861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5025c37302bd4a2aa076878e1af90366" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "17294485b7f24e2b9fae71dd3169a336"
I20260709 12:27:54.268690 16861 raft_consensus.cc:3060] T 5025c37302bd4a2aa076878e1af90366 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:54.262784 17708 leader_election.cc:290] T 5025c37302bd4a2aa076878e1af90366 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 2 election: Requested vote from peers 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
I20260709 12:27:54.264688 16790 raft_consensus.cc:740] T 5025c37302bd4a2aa076878e1af90366 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3c1aba6ee1d244fd9c0daba722aa0b3b, State: Running, Role: LEADER
I20260709 12:27:54.286801 16790 consensus_queue.cc:260] T 5025c37302bd4a2aa076878e1af90366 P 3c1aba6ee1d244fd9c0daba722aa0b3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:54.288609 16790 raft_consensus.cc:3060] T 5025c37302bd4a2aa076878e1af90366 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:54.297614 16861 raft_consensus.cc:2468] T 5025c37302bd4a2aa076878e1af90366 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 2.
I20260709 12:27:54.310750 17964 raft_consensus.cc:993] T 223b3745452c412581caf058f6b81fe2 P 3c1aba6ee1d244fd9c0daba722aa0b3b: : Instructing follower 879366e90f5c420588945e0d545017c8 to start an election
I20260709 12:27:54.311365 17964 raft_consensus.cc:1081] T 223b3745452c412581caf058f6b81fe2 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 LEADER]: Signalling peer 879366e90f5c420588945e0d545017c8 to start an election
I20260709 12:27:54.313426 17627 leader_election.cc:304] T 5025c37302bd4a2aa076878e1af90366 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8; no voters: 
I20260709 12:27:54.314388 17914 raft_consensus.cc:2804] T 5025c37302bd4a2aa076878e1af90366 P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:54.315121 17914 raft_consensus.cc:697] T 5025c37302bd4a2aa076878e1af90366 P 879366e90f5c420588945e0d545017c8 [term 2 LEADER]: Becoming Leader. State: Replica: 879366e90f5c420588945e0d545017c8, State: Running, Role: LEADER
I20260709 12:27:54.316124 17914 consensus_queue.cc:237] T 5025c37302bd4a2aa076878e1af90366 P 879366e90f5c420588945e0d545017c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:54.316634 17710 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "223b3745452c412581caf058f6b81fe2"
dest_uuid: "879366e90f5c420588945e0d545017c8"
 from {username='slave'} at 127.0.0.1:38178
I20260709 12:27:54.317260 17710 raft_consensus.cc:493] T 223b3745452c412581caf058f6b81fe2 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:54.317623 17710 raft_consensus.cc:3060] T 223b3745452c412581caf058f6b81fe2 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:54.323894 16790 raft_consensus.cc:2468] T 5025c37302bd4a2aa076878e1af90366 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 2.
I20260709 12:27:54.325872 16861 raft_consensus.cc:1275] T 52538067157143b2abd4656a4bbb9442 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Refusing update from remote peer 879366e90f5c420588945e0d545017c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:54.331629 17963 consensus_queue.cc:1048] T 52538067157143b2abd4656a4bbb9442 P 879366e90f5c420588945e0d545017c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:54.333930 17710 raft_consensus.cc:515] T 223b3745452c412581caf058f6b81fe2 P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:54.336866 17710 leader_election.cc:290] T 223b3745452c412581caf058f6b81fe2 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 2 election: Requested vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:54.338204 16790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "223b3745452c412581caf058f6b81fe2" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b"
I20260709 12:27:54.339221 16790 raft_consensus.cc:3055] T 223b3745452c412581caf058f6b81fe2 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:54.346915 16790 raft_consensus.cc:740] T 223b3745452c412581caf058f6b81fe2 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3c1aba6ee1d244fd9c0daba722aa0b3b, State: Running, Role: LEADER
I20260709 12:27:54.347815 16935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "223b3745452c412581caf058f6b81fe2" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "82f27bcdf252425aad4c4a37d064f68d"
I20260709 12:27:54.348466 16935 raft_consensus.cc:3060] T 223b3745452c412581caf058f6b81fe2 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:54.345278 16613 catalog_manager.cc:5697] T 5025c37302bd4a2aa076878e1af90366 P 879366e90f5c420588945e0d545017c8 reported cstate change: term changed from 1 to 2, leader changed from 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66) to 879366e90f5c420588945e0d545017c8 (127.9.116.65). New cstate: current_term: 2 leader_uuid: "879366e90f5c420588945e0d545017c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:54.347870 16941 raft_consensus.cc:1275] T 6a86fc21ef0044bb91dd271c9a019336 P 82f27bcdf252425aad4c4a37d064f68d [term 3 FOLLOWER]: Refusing update from remote peer 879366e90f5c420588945e0d545017c8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:54.359751 17914 consensus_queue.cc:1048] T 6a86fc21ef0044bb91dd271c9a019336 P 879366e90f5c420588945e0d545017c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:54.365865 16935 raft_consensus.cc:2468] T 223b3745452c412581caf058f6b81fe2 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 2.
I20260709 12:27:54.347755 16790 consensus_queue.cc:260] T 223b3745452c412581caf058f6b81fe2 P 3c1aba6ee1d244fd9c0daba722aa0b3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:54.367112 16790 raft_consensus.cc:3060] T 223b3745452c412581caf058f6b81fe2 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:54.367343 17627 leader_election.cc:304] T 223b3745452c412581caf058f6b81fe2 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d, 879366e90f5c420588945e0d545017c8; no voters: 
I20260709 12:27:54.369756 17914 raft_consensus.cc:2804] T 223b3745452c412581caf058f6b81fe2 P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:54.370267 17914 raft_consensus.cc:697] T 223b3745452c412581caf058f6b81fe2 P 879366e90f5c420588945e0d545017c8 [term 2 LEADER]: Becoming Leader. State: Replica: 879366e90f5c420588945e0d545017c8, State: Running, Role: LEADER
I20260709 12:27:54.371413 17914 consensus_queue.cc:237] T 223b3745452c412581caf058f6b81fe2 P 879366e90f5c420588945e0d545017c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:54.378340 16866 raft_consensus.cc:1275] T f29cf6eb18e842c3a5aa62d8fae53279 P 17294485b7f24e2b9fae71dd3169a336 [term 3 FOLLOWER]: Refusing update from remote peer 82f27bcdf252425aad4c4a37d064f68d: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:27:54.392046 16792 raft_consensus.cc:1275] T 52538067157143b2abd4656a4bbb9442 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Refusing update from remote peer 879366e90f5c420588945e0d545017c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:54.394649 17963 consensus_queue.cc:1048] T 52538067157143b2abd4656a4bbb9442 P 879366e90f5c420588945e0d545017c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:54.394696 17951 consensus_queue.cc:1048] T f29cf6eb18e842c3a5aa62d8fae53279 P 82f27bcdf252425aad4c4a37d064f68d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:27:54.404702 16790 raft_consensus.cc:2468] T 223b3745452c412581caf058f6b81fe2 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 2.
I20260709 12:27:54.424839 16790 raft_consensus.cc:1275] T f29cf6eb18e842c3a5aa62d8fae53279 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 3 FOLLOWER]: Refusing update from remote peer 82f27bcdf252425aad4c4a37d064f68d: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:27:54.425305 16615 catalog_manager.cc:5697] T 223b3745452c412581caf058f6b81fe2 P 879366e90f5c420588945e0d545017c8 reported cstate change: term changed from 1 to 2, leader changed from 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66) to 879366e90f5c420588945e0d545017c8 (127.9.116.65). New cstate: current_term: 2 leader_uuid: "879366e90f5c420588945e0d545017c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:54.429159 17951 consensus_queue.cc:1048] T f29cf6eb18e842c3a5aa62d8fae53279 P 82f27bcdf252425aad4c4a37d064f68d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:54.766568 16935 raft_consensus.cc:1275] T 223b3745452c412581caf058f6b81fe2 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Refusing update from remote peer 879366e90f5c420588945e0d545017c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:54.768646 17915 consensus_queue.cc:1048] T 223b3745452c412581caf058f6b81fe2 P 879366e90f5c420588945e0d545017c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:54.780718 16792 raft_consensus.cc:1275] T 223b3745452c412581caf058f6b81fe2 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Refusing update from remote peer 879366e90f5c420588945e0d545017c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:54.783037 17915 consensus_queue.cc:1048] T 223b3745452c412581caf058f6b81fe2 P 879366e90f5c420588945e0d545017c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:54.810098  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:54.831805 16867 raft_consensus.cc:1275] T 5025c37302bd4a2aa076878e1af90366 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Refusing update from remote peer 879366e90f5c420588945e0d545017c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:54.833153 17915 consensus_queue.cc:1048] T 5025c37302bd4a2aa076878e1af90366 P 879366e90f5c420588945e0d545017c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:54.836184 16790 raft_consensus.cc:1275] T 5025c37302bd4a2aa076878e1af90366 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Refusing update from remote peer 879366e90f5c420588945e0d545017c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:54.839548 17915 consensus_queue.cc:1048] T 5025c37302bd4a2aa076878e1af90366 P 879366e90f5c420588945e0d545017c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:54.932036 16935 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a4f2b93e5d2045a5a0cd1f9b5806a133"
dest_uuid: "82f27bcdf252425aad4c4a37d064f68d"
mode: GRACEFUL
new_leader_uuid: "879366e90f5c420588945e0d545017c8"
 from {username='slave'} at 127.0.0.1:33050
I20260709 12:27:54.932711 16935 raft_consensus.cc:606] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d [term 3 LEADER]: Received request to transfer leadership to TS 879366e90f5c420588945e0d545017c8
I20260709 12:27:54.935773 16789 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8a632c738e94b26a8352a68a42a0670"
dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b"
mode: GRACEFUL
new_leader_uuid: "879366e90f5c420588945e0d545017c8"
 from {username='slave'} at 127.0.0.1:51760
I20260709 12:27:54.936446 16789 raft_consensus.cc:606] T a8a632c738e94b26a8352a68a42a0670 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 LEADER]: Received request to transfer leadership to TS 879366e90f5c420588945e0d545017c8
I20260709 12:27:54.938316  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:27:54.940620  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:54.941634  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:54.955674 17955 raft_consensus.cc:993] T a8a632c738e94b26a8352a68a42a0670 P 3c1aba6ee1d244fd9c0daba722aa0b3b: : Instructing follower 879366e90f5c420588945e0d545017c8 to start an election
I20260709 12:27:54.957120 17955 raft_consensus.cc:1081] T a8a632c738e94b26a8352a68a42a0670 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 LEADER]: Signalling peer 879366e90f5c420588945e0d545017c8 to start an election
I20260709 12:27:54.959408 17708 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a8a632c738e94b26a8352a68a42a0670"
dest_uuid: "879366e90f5c420588945e0d545017c8"
 from {username='slave'} at 127.0.0.1:38178
I20260709 12:27:54.959983 17708 raft_consensus.cc:493] T a8a632c738e94b26a8352a68a42a0670 P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:54.960310 17708 raft_consensus.cc:3060] T a8a632c738e94b26a8352a68a42a0670 P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:54.971647 17708 raft_consensus.cc:515] T a8a632c738e94b26a8352a68a42a0670 P 879366e90f5c420588945e0d545017c8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:54.973852 17708 leader_election.cc:290] T a8a632c738e94b26a8352a68a42a0670 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 3 election: Requested vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:54.974988 16935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8a632c738e94b26a8352a68a42a0670" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "82f27bcdf252425aad4c4a37d064f68d"
I20260709 12:27:54.976408 16935 raft_consensus.cc:3060] T a8a632c738e94b26a8352a68a42a0670 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:54.974898 16789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8a632c738e94b26a8352a68a42a0670" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b"
I20260709 12:27:54.977303 16789 raft_consensus.cc:3055] T a8a632c738e94b26a8352a68a42a0670 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:54.977629 16789 raft_consensus.cc:740] T a8a632c738e94b26a8352a68a42a0670 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3c1aba6ee1d244fd9c0daba722aa0b3b, State: Running, Role: LEADER
I20260709 12:27:54.978387 16789 consensus_queue.cc:260] T a8a632c738e94b26a8352a68a42a0670 P 3c1aba6ee1d244fd9c0daba722aa0b3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:54.979691 16789 raft_consensus.cc:3060] T a8a632c738e94b26a8352a68a42a0670 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:54.983589 16935 raft_consensus.cc:2468] T a8a632c738e94b26a8352a68a42a0670 P 82f27bcdf252425aad4c4a37d064f68d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 3.
I20260709 12:27:54.985145 17627 leader_election.cc:304] T a8a632c738e94b26a8352a68a42a0670 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d, 879366e90f5c420588945e0d545017c8; no voters: 
I20260709 12:27:54.986052 17914 raft_consensus.cc:2804] T a8a632c738e94b26a8352a68a42a0670 P 879366e90f5c420588945e0d545017c8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:54.986522 17914 raft_consensus.cc:697] T a8a632c738e94b26a8352a68a42a0670 P 879366e90f5c420588945e0d545017c8 [term 3 LEADER]: Becoming Leader. State: Replica: 879366e90f5c420588945e0d545017c8, State: Running, Role: LEADER
I20260709 12:27:54.987772 17914 consensus_queue.cc:237] T a8a632c738e94b26a8352a68a42a0670 P 879366e90f5c420588945e0d545017c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:54.989108 16789 raft_consensus.cc:2468] T a8a632c738e94b26a8352a68a42a0670 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 3.
I20260709 12:27:55.001869 16614 catalog_manager.cc:5697] T a8a632c738e94b26a8352a68a42a0670 P 879366e90f5c420588945e0d545017c8 reported cstate change: term changed from 2 to 3, leader changed from 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66) to 879366e90f5c420588945e0d545017c8 (127.9.116.65). New cstate: current_term: 3 leader_uuid: "879366e90f5c420588945e0d545017c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:55.378698 17990 raft_consensus.cc:993] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d: : Instructing follower 879366e90f5c420588945e0d545017c8 to start an election
I20260709 12:27:55.379346 17924 raft_consensus.cc:1081] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d [term 3 LEADER]: Signalling peer 879366e90f5c420588945e0d545017c8 to start an election
I20260709 12:27:55.381554 17710 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a4f2b93e5d2045a5a0cd1f9b5806a133"
dest_uuid: "879366e90f5c420588945e0d545017c8"
 from {username='slave'} at 127.0.0.1:38194
I20260709 12:27:55.382185 17710 raft_consensus.cc:493] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 879366e90f5c420588945e0d545017c8 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:55.382952 17710 raft_consensus.cc:3060] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 879366e90f5c420588945e0d545017c8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:55.391009 17710 raft_consensus.cc:515] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 879366e90f5c420588945e0d545017c8 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:55.393131 17710 leader_election.cc:290] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 4 election: Requested vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919)
I20260709 12:27:55.394304 16867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f2b93e5d2045a5a0cd1f9b5806a133" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "17294485b7f24e2b9fae71dd3169a336"
I20260709 12:27:55.394708 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f2b93e5d2045a5a0cd1f9b5806a133" candidate_uuid: "879366e90f5c420588945e0d545017c8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "82f27bcdf252425aad4c4a37d064f68d"
I20260709 12:27:55.395057 16867 raft_consensus.cc:3060] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 17294485b7f24e2b9fae71dd3169a336 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:55.395320 16941 raft_consensus.cc:3055] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:55.395669 16941 raft_consensus.cc:740] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 82f27bcdf252425aad4c4a37d064f68d, State: Running, Role: LEADER
I20260709 12:27:55.396487 16941 consensus_queue.cc:260] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:55.397835 16941 raft_consensus.cc:3060] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:55.404384 16867 raft_consensus.cc:2468] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 17294485b7f24e2b9fae71dd3169a336 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 4.
I20260709 12:27:55.405529 16790 raft_consensus.cc:1275] T a8a632c738e94b26a8352a68a42a0670 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 3 FOLLOWER]: Refusing update from remote peer 879366e90f5c420588945e0d545017c8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:55.406430 17627 leader_election.cc:304] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 879366e90f5c420588945e0d545017c8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8; no voters: 
I20260709 12:27:55.406893 16941 raft_consensus.cc:2468] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 879366e90f5c420588945e0d545017c8 in term 4.
I20260709 12:27:55.407738 17963 consensus_queue.cc:1048] T a8a632c738e94b26a8352a68a42a0670 P 879366e90f5c420588945e0d545017c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:55.407826 17914 raft_consensus.cc:2804] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 879366e90f5c420588945e0d545017c8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:55.412024 17914 raft_consensus.cc:697] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 879366e90f5c420588945e0d545017c8 [term 4 LEADER]: Becoming Leader. State: Replica: 879366e90f5c420588945e0d545017c8, State: Running, Role: LEADER
I20260709 12:27:55.413323 17914 consensus_queue.cc:237] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 879366e90f5c420588945e0d545017c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:55.414600 16941 raft_consensus.cc:1275] T a8a632c738e94b26a8352a68a42a0670 P 82f27bcdf252425aad4c4a37d064f68d [term 3 FOLLOWER]: Refusing update from remote peer 879366e90f5c420588945e0d545017c8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:55.416267 17963 consensus_queue.cc:1048] T a8a632c738e94b26a8352a68a42a0670 P 879366e90f5c420588945e0d545017c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:55.463652 16613 catalog_manager.cc:5697] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 879366e90f5c420588945e0d545017c8 reported cstate change: term changed from 3 to 4, leader changed from 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68) to 879366e90f5c420588945e0d545017c8 (127.9.116.65). New cstate: current_term: 4 leader_uuid: "879366e90f5c420588945e0d545017c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:55.911099 16861 raft_consensus.cc:1275] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 17294485b7f24e2b9fae71dd3169a336 [term 4 FOLLOWER]: Refusing update from remote peer 879366e90f5c420588945e0d545017c8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:27:55.913882 17914 consensus_queue.cc:1048] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 879366e90f5c420588945e0d545017c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:55.926733 16941 raft_consensus.cc:1275] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d [term 4 FOLLOWER]: Refusing update from remote peer 879366e90f5c420588945e0d545017c8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:27:55.935200 17914 consensus_queue.cc:1048] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 879366e90f5c420588945e0d545017c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:56.001643  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:56.053543  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:56.055105  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:56.055800  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:56.102798  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:56.152653  9681 tablet_server.cc:179] TabletServer@127.9.116.65:39833 shutting down...
I20260709 12:27:56.191529  9681 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:56.192873  9681 tablet_replica.cc:333] stopping tablet replica
W20260709 12:27:56.194152 16759 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 240 similar messages]
I20260709 12:27:56.194253  9681 raft_consensus.cc:2243] T fbafe39b79894737b395f95013bc6c86 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.195370  9681 raft_consensus.cc:2272] T fbafe39b79894737b395f95013bc6c86 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:56.200044 16759 consensus_peers.cc:597] T 7b90200ef21f42f1929fbf0051ef5b3e P 3c1aba6ee1d244fd9c0daba722aa0b3b -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:56.200332  9681 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:56.201617  9681 raft_consensus.cc:2243] T b10d5b4017584d0fb22f9e542d95fcb1 P 879366e90f5c420588945e0d545017c8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:56.202934  9681 raft_consensus.cc:2272] T b10d5b4017584d0fb22f9e542d95fcb1 P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.205726  9681 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:56.206475  9681 raft_consensus.cc:2243] T 2f737ece325c44c58194725a82923014 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.206914  9681 raft_consensus.cc:2272] T 2f737ece325c44c58194725a82923014 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.210026  9681 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:56.210867  9681 raft_consensus.cc:2243] T a0409dc146674a39a9ceeeeebc081453 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.211364  9681 raft_consensus.cc:2272] T a0409dc146674a39a9ceeeeebc081453 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.214447  9681 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:56.215245  9681 raft_consensus.cc:2243] T a4252af16e15424399c32c789c8e6c23 P 879366e90f5c420588945e0d545017c8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:27:56.216490  9681 raft_consensus.cc:2272] T a4252af16e15424399c32c789c8e6c23 P 879366e90f5c420588945e0d545017c8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.220677  9681 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:56.221978  9681 raft_consensus.cc:2243] T a8a632c738e94b26a8352a68a42a0670 P 879366e90f5c420588945e0d545017c8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:27:56.223069  9681 raft_consensus.cc:2272] T a8a632c738e94b26a8352a68a42a0670 P 879366e90f5c420588945e0d545017c8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.230670  9681 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:56.231743  9681 raft_consensus.cc:2243] T 6a86fc21ef0044bb91dd271c9a019336 P 879366e90f5c420588945e0d545017c8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:27:56.233088  9681 raft_consensus.cc:2272] T 6a86fc21ef0044bb91dd271c9a019336 P 879366e90f5c420588945e0d545017c8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.236217  9681 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:56.237032  9681 raft_consensus.cc:2243] T ea5085716661498e9f3bfdfa2fc5737a P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.237761  9681 raft_consensus.cc:2272] T ea5085716661498e9f3bfdfa2fc5737a P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.242642  9681 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:56.243399  9681 raft_consensus.cc:2243] T 51ebab30b5104589803b75a1b48c5aa2 P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.244380  9681 raft_consensus.cc:2272] T 51ebab30b5104589803b75a1b48c5aa2 P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:56.245129 16907 consensus_peers.cc:597] T 51ebab30b5104589803b75a1b48c5aa2 P 82f27bcdf252425aad4c4a37d064f68d -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:56.247177  9681 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:56.248001  9681 raft_consensus.cc:2243] T 8eaf179090b14105b52c4701d5599216 P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.248500  9681 raft_consensus.cc:2272] T 8eaf179090b14105b52c4701d5599216 P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.250667  9681 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:56.251281  9681 raft_consensus.cc:2243] T 5f88e29c7ffd4b3b856561ee240cdd43 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.251757  9681 raft_consensus.cc:2272] T 5f88e29c7ffd4b3b856561ee240cdd43 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.254973  9681 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:56.255678  9681 raft_consensus.cc:2243] T 7b90200ef21f42f1929fbf0051ef5b3e P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.256153  9681 raft_consensus.cc:2272] T 7b90200ef21f42f1929fbf0051ef5b3e P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.259297  9681 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:56.260202  9681 raft_consensus.cc:2243] T 514ee26ff21e4c08976b6a0397b730fe P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.260805  9681 raft_consensus.cc:2272] T 514ee26ff21e4c08976b6a0397b730fe P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.264854  9681 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:56.265676  9681 raft_consensus.cc:2243] T 5025c37302bd4a2aa076878e1af90366 P 879366e90f5c420588945e0d545017c8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:56.266825  9681 raft_consensus.cc:2272] T 5025c37302bd4a2aa076878e1af90366 P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:56.267236 16833 consensus_peers.cc:597] T 514ee26ff21e4c08976b6a0397b730fe P 17294485b7f24e2b9fae71dd3169a336 -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:56.269555  9681 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:56.270303  9681 raft_consensus.cc:2243] T 28c655b68dc545948c67e0977b49e770 P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.270835  9681 raft_consensus.cc:2272] T 28c655b68dc545948c67e0977b49e770 P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.273557  9681 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:56.274223  9681 raft_consensus.cc:2243] T 9067b67140fa48e883d2d240a6046d63 P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.274799  9681 raft_consensus.cc:2272] T 9067b67140fa48e883d2d240a6046d63 P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.278836  9681 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:56.279688  9681 raft_consensus.cc:2243] T 28bdf20fc71548da87c4558dacc503db P 879366e90f5c420588945e0d545017c8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:56.280721  9681 raft_consensus.cc:2272] T 28bdf20fc71548da87c4558dacc503db P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.284596  9681 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:56.285640  9681 raft_consensus.cc:2243] T b86527b8a77848629c50a32e2534f7ba P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.286264  9681 raft_consensus.cc:2272] T b86527b8a77848629c50a32e2534f7ba P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:56.287250 16833 consensus_peers.cc:597] T 28c655b68dc545948c67e0977b49e770 P 17294485b7f24e2b9fae71dd3169a336 -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:56.289448  9681 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:56.290387  9681 raft_consensus.cc:2243] T 98a96f910b4449f7ba9c875e45090080 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.290901  9681 raft_consensus.cc:2272] T 98a96f910b4449f7ba9c875e45090080 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.294422  9681 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:56.295981  9681 raft_consensus.cc:2243] T c5baa0b4140847958c6528b3dbda7617 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.296744  9681 raft_consensus.cc:2272] T c5baa0b4140847958c6528b3dbda7617 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.300721  9681 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:56.301687  9681 raft_consensus.cc:2243] T 840a644e56054e13bfd7585fa064120c P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.302412  9681 raft_consensus.cc:2272] T 840a644e56054e13bfd7585fa064120c P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.306044  9681 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:56.307363  9681 raft_consensus.cc:2243] T b6f178076e7f4c7bb41b4853bacbfc4e P 879366e90f5c420588945e0d545017c8 [term 2 LEADER]: Raft consensus shutting down.
W20260709 12:27:56.307802 16833 consensus_peers.cc:597] T 7562feb416f84f0b948343356153d8d2 P 17294485b7f24e2b9fae71dd3169a336 -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:56.308516  9681 raft_consensus.cc:2272] T b6f178076e7f4c7bb41b4853bacbfc4e P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:56.310541 16833 consensus_peers.cc:597] T 288d05b8017c4e0f8cd40048647aecae P 17294485b7f24e2b9fae71dd3169a336 -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:56.311978  9681 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:56.312754  9681 raft_consensus.cc:2243] T fe16827e0b4a45baa99739174f92a0f7 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.313295  9681 raft_consensus.cc:2272] T fe16827e0b4a45baa99739174f92a0f7 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.316926  9681 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:56.318349  9681 raft_consensus.cc:2243] T 00e5268529b241f184c460704ab9ed3c P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.319288  9681 raft_consensus.cc:2272] T 00e5268529b241f184c460704ab9ed3c P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.324149  9681 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:56.325263  9681 raft_consensus.cc:2243] T 7562feb416f84f0b948343356153d8d2 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.325935  9681 raft_consensus.cc:2272] T 7562feb416f84f0b948343356153d8d2 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:56.327301 16833 consensus_peers.cc:597] T 98a96f910b4449f7ba9c875e45090080 P 17294485b7f24e2b9fae71dd3169a336 -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:56.329777  9681 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:56.330921  9681 raft_consensus.cc:2243] T 442e0dfc272840f7a14c2232ed65425c P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.331626  9681 raft_consensus.cc:2272] T 442e0dfc272840f7a14c2232ed65425c P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:56.333340 16759 consensus_peers.cc:597] T a0409dc146674a39a9ceeeeebc081453 P 3c1aba6ee1d244fd9c0daba722aa0b3b -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:56.334172 16833 consensus_peers.cc:597] T 27dda31a8cd1468eb3a824ae026485a3 P 17294485b7f24e2b9fae71dd3169a336 -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:56.335067  9681 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:56.335897  9681 raft_consensus.cc:2243] T 3d614e06fd2c40189161e22ad9217e5d P 879366e90f5c420588945e0d545017c8 [term 4 LEADER]: Raft consensus shutting down.
W20260709 12:27:56.335952 16759 consensus_peers.cc:597] T 5f88e29c7ffd4b3b856561ee240cdd43 P 3c1aba6ee1d244fd9c0daba722aa0b3b -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:56.336835  9681 raft_consensus.cc:2272] T 3d614e06fd2c40189161e22ad9217e5d P 879366e90f5c420588945e0d545017c8 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:56.336997 16907 consensus_peers.cc:597] T ea5085716661498e9f3bfdfa2fc5737a P 82f27bcdf252425aad4c4a37d064f68d -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:56.337728 16759 consensus_peers.cc:597] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 3c1aba6ee1d244fd9c0daba722aa0b3b -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:56.339272  9681 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:56.340204  9681 raft_consensus.cc:2243] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.340845  9681 raft_consensus.cc:2272] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:56.343746 16759 consensus_peers.cc:597] T e477f70d4c8d466e9d45e6645e2a2869 P 3c1aba6ee1d244fd9c0daba722aa0b3b -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:56.343924  9681 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:56.346058  9681 raft_consensus.cc:2243] T e477f70d4c8d466e9d45e6645e2a2869 P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.346699  9681 raft_consensus.cc:2272] T e477f70d4c8d466e9d45e6645e2a2869 P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.349763  9681 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:56.350692  9681 raft_consensus.cc:2243] T 27dda31a8cd1468eb3a824ae026485a3 P 879366e90f5c420588945e0d545017c8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.351248  9681 raft_consensus.cc:2272] T 27dda31a8cd1468eb3a824ae026485a3 P 879366e90f5c420588945e0d545017c8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.354755  9681 tablet_replica.cc:333] stopping tablet replica
W20260709 12:27:56.354956 16759 consensus_peers.cc:597] T 442e0dfc272840f7a14c2232ed65425c P 3c1aba6ee1d244fd9c0daba722aa0b3b -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:56.355901  9681 raft_consensus.cc:2243] T 6e89df746e0c49d184637314ce87045a P 879366e90f5c420588945e0d545017c8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:27:56.357235  9681 raft_consensus.cc:2272] T 6e89df746e0c49d184637314ce87045a P 879366e90f5c420588945e0d545017c8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.360948  9681 tablet_replica.cc:333] stopping tablet replica
W20260709 12:27:56.361498 16759 consensus_peers.cc:597] T d6811cd94dfd44149e1329e919d82f0f P 3c1aba6ee1d244fd9c0daba722aa0b3b -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:56.361833  9681 raft_consensus.cc:2243] T b777ccb9937a476590a534fea0428c5c P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:27:56.362201 16833 consensus_peers.cc:597] T 27f104a1ba60493ab47f6b876da48d67 P 17294485b7f24e2b9fae71dd3169a336 -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:56.362578  9681 raft_consensus.cc:2272] T b777ccb9937a476590a534fea0428c5c P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.365123  9681 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:56.365947  9681 raft_consensus.cc:2243] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 879366e90f5c420588945e0d545017c8 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:27:56.366942  9681 raft_consensus.cc:2272] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 879366e90f5c420588945e0d545017c8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.369935  9681 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:56.370566  9681 raft_consensus.cc:2243] T 288d05b8017c4e0f8cd40048647aecae P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.371035  9681 raft_consensus.cc:2272] T 288d05b8017c4e0f8cd40048647aecae P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.373448  9681 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:56.374063  9681 raft_consensus.cc:2243] T d6811cd94dfd44149e1329e919d82f0f P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.374493  9681 raft_consensus.cc:2272] T d6811cd94dfd44149e1329e919d82f0f P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.376688  9681 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:56.377517  9681 raft_consensus.cc:2243] T 6916ee6a900c46508c98006aa85fe2d9 P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.378209  9681 raft_consensus.cc:2272] T 6916ee6a900c46508c98006aa85fe2d9 P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.381085  9681 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:56.381910  9681 raft_consensus.cc:2243] T 3649e7bb023a4958a01ad5ecbe446f0f P 879366e90f5c420588945e0d545017c8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:56.382822  9681 raft_consensus.cc:2272] T 3649e7bb023a4958a01ad5ecbe446f0f P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.386130  9681 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:56.386710  9681 raft_consensus.cc:2243] T 62e4e875fd4e4604952120df324e99cb P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.387166  9681 raft_consensus.cc:2272] T 62e4e875fd4e4604952120df324e99cb P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.390129  9681 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:56.390885  9681 raft_consensus.cc:2243] T 3e78004b8cc14ac6b93c857cbdd63329 P 879366e90f5c420588945e0d545017c8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:56.392164  9681 raft_consensus.cc:2272] T 3e78004b8cc14ac6b93c857cbdd63329 P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:56.392732 16833 consensus_peers.cc:597] T cd637126e0044d7996f18e258282a145 P 17294485b7f24e2b9fae71dd3169a336 -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:56.394457  9681 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:56.395223  9681 raft_consensus.cc:2243] T 27f104a1ba60493ab47f6b876da48d67 P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.395802  9681 raft_consensus.cc:2272] T 27f104a1ba60493ab47f6b876da48d67 P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.398594  9681 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:56.399179  9681 raft_consensus.cc:2243] T e628dacc30694988a7c795441df15600 P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.399832  9681 raft_consensus.cc:2272] T e628dacc30694988a7c795441df15600 P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.402304  9681 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:56.402912  9681 raft_consensus.cc:2243] T 52538067157143b2abd4656a4bbb9442 P 879366e90f5c420588945e0d545017c8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:56.404135  9681 raft_consensus.cc:2272] T 52538067157143b2abd4656a4bbb9442 P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.406395  9681 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:56.406970  9681 raft_consensus.cc:2243] T cd637126e0044d7996f18e258282a145 P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.407473  9681 raft_consensus.cc:2272] T cd637126e0044d7996f18e258282a145 P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.409614  9681 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:56.410153  9681 raft_consensus.cc:2243] T ce37f3e8575c4b8e88935db231644a27 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.410552  9681 raft_consensus.cc:2272] T ce37f3e8575c4b8e88935db231644a27 P 879366e90f5c420588945e0d545017c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.413008  9681 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:56.413626  9681 raft_consensus.cc:2243] T 223b3745452c412581caf058f6b81fe2 P 879366e90f5c420588945e0d545017c8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:56.414536  9681 raft_consensus.cc:2272] T 223b3745452c412581caf058f6b81fe2 P 879366e90f5c420588945e0d545017c8 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:56.442304 16759 consensus_peers.cc:597] T 62e4e875fd4e4604952120df324e99cb P 3c1aba6ee1d244fd9c0daba722aa0b3b -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:56.463438 16907 consensus_peers.cc:597] T fbafe39b79894737b395f95013bc6c86 P 82f27bcdf252425aad4c4a37d064f68d -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:56.475069 16833 consensus_peers.cc:597] T 9067b67140fa48e883d2d240a6046d63 P 17294485b7f24e2b9fae71dd3169a336 -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:56.480261 16833 consensus_peers.cc:597] T 840a644e56054e13bfd7585fa064120c P 17294485b7f24e2b9fae71dd3169a336 -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:56.480479 16907 consensus_peers.cc:597] T 00e5268529b241f184c460704ab9ed3c P 82f27bcdf252425aad4c4a37d064f68d -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:56.482151 16759 consensus_peers.cc:597] T 8eaf179090b14105b52c4701d5599216 P 3c1aba6ee1d244fd9c0daba722aa0b3b -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:56.484136 16759 consensus_peers.cc:597] T 6916ee6a900c46508c98006aa85fe2d9 P 3c1aba6ee1d244fd9c0daba722aa0b3b -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:56.509052 16833 consensus_peers.cc:597] T fe16827e0b4a45baa99739174f92a0f7 P 17294485b7f24e2b9fae71dd3169a336 -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:56.515827 16833 consensus_peers.cc:597] T c5baa0b4140847958c6528b3dbda7617 P 17294485b7f24e2b9fae71dd3169a336 -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:56.520416  9681 tablet_server.cc:196] TabletServer@127.9.116.65:39833 shutdown complete.
W20260709 12:27:56.531551 16833 consensus_peers.cc:597] T e628dacc30694988a7c795441df15600 P 17294485b7f24e2b9fae71dd3169a336 -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:56.541848 16907 consensus_peers.cc:597] T b777ccb9937a476590a534fea0428c5c P 82f27bcdf252425aad4c4a37d064f68d -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:56.586216 16759 consensus_peers.cc:597] T ce37f3e8575c4b8e88935db231644a27 P 3c1aba6ee1d244fd9c0daba722aa0b3b -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:56.628614 16759 consensus_peers.cc:597] T 2f737ece325c44c58194725a82923014 P 3c1aba6ee1d244fd9c0daba722aa0b3b -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:56.649179  9681 tablet_server.cc:179] TabletServer@127.9.116.66:0 shutting down...
W20260709 12:27:56.660458 16908 consensus_peers.cc:597] T f39dd87ef56a40e2bf56704b2815a619 P 82f27bcdf252425aad4c4a37d064f68d -> Peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Couldn't send request to peer 3c1aba6ee1d244fd9c0daba722aa0b3b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:56.679397 16908 consensus_peers.cc:597] T fbafe39b79894737b395f95013bc6c86 P 82f27bcdf252425aad4c4a37d064f68d -> Peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Couldn't send request to peer 3c1aba6ee1d244fd9c0daba722aa0b3b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:56.683733 16834 consensus_peers.cc:597] T e628dacc30694988a7c795441df15600 P 17294485b7f24e2b9fae71dd3169a336 -> Peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Couldn't send request to peer 3c1aba6ee1d244fd9c0daba722aa0b3b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:56.689460 16908 consensus_peers.cc:597] T fd1494eb0dd14dab9a2e4c07812117c2 P 82f27bcdf252425aad4c4a37d064f68d -> Peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Couldn't send request to peer 3c1aba6ee1d244fd9c0daba722aa0b3b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:56.706468 16907 consensus_peers.cc:597] T b86527b8a77848629c50a32e2534f7ba P 82f27bcdf252425aad4c4a37d064f68d -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:56.710623 16908 consensus_peers.cc:597] T 29fcc4f156a54ca4b54a4a11e2cee973 P 82f27bcdf252425aad4c4a37d064f68d -> Peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Couldn't send request to peer 3c1aba6ee1d244fd9c0daba722aa0b3b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:56.726374  9681 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:56.728888  9681 tablet_replica.cc:333] T a8a632c738e94b26a8352a68a42a0670 P 3c1aba6ee1d244fd9c0daba722aa0b3b: stopping tablet replica
I20260709 12:27:56.730194  9681 raft_consensus.cc:2243] T a8a632c738e94b26a8352a68a42a0670 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.730911  9681 raft_consensus.cc:2272] T a8a632c738e94b26a8352a68a42a0670 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.734706  9681 tablet_replica.cc:333] T a4252af16e15424399c32c789c8e6c23 P 3c1aba6ee1d244fd9c0daba722aa0b3b: stopping tablet replica
I20260709 12:27:56.735847  9681 raft_consensus.cc:2243] T a4252af16e15424399c32c789c8e6c23 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 12:27:56.736477 16908 consensus_peers.cc:597] T 00e5268529b241f184c460704ab9ed3c P 82f27bcdf252425aad4c4a37d064f68d -> Peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Couldn't send request to peer 3c1aba6ee1d244fd9c0daba722aa0b3b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:56.736579  9681 raft_consensus.cc:2272] T a4252af16e15424399c32c789c8e6c23 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.740422  9681 tablet_replica.cc:333] T 6e89df746e0c49d184637314ce87045a P 3c1aba6ee1d244fd9c0daba722aa0b3b: stopping tablet replica
I20260709 12:27:56.741376  9681 raft_consensus.cc:2243] T 6e89df746e0c49d184637314ce87045a P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.742046  9681 raft_consensus.cc:2272] T 6e89df746e0c49d184637314ce87045a P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.745271  9681 tablet_replica.cc:333] T f29cf6eb18e842c3a5aa62d8fae53279 P 3c1aba6ee1d244fd9c0daba722aa0b3b: stopping tablet replica
I20260709 12:27:56.746122  9681 raft_consensus.cc:2243] T f29cf6eb18e842c3a5aa62d8fae53279 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.746692  9681 raft_consensus.cc:2272] T f29cf6eb18e842c3a5aa62d8fae53279 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.749310  9681 tablet_replica.cc:333] T 6a86fc21ef0044bb91dd271c9a019336 P 3c1aba6ee1d244fd9c0daba722aa0b3b: stopping tablet replica
I20260709 12:27:56.750052  9681 raft_consensus.cc:2243] T 6a86fc21ef0044bb91dd271c9a019336 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.750613  9681 raft_consensus.cc:2272] T 6a86fc21ef0044bb91dd271c9a019336 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.753516  9681 tablet_replica.cc:333] T f5345dc6d3b946e0bb9220acf126cf59 P 3c1aba6ee1d244fd9c0daba722aa0b3b: stopping tablet replica
I20260709 12:27:56.754346  9681 raft_consensus.cc:2243] T f5345dc6d3b946e0bb9220acf126cf59 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.754930  9681 raft_consensus.cc:2272] T f5345dc6d3b946e0bb9220acf126cf59 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.757925  9681 tablet_replica.cc:333] T 2f737ece325c44c58194725a82923014 P 3c1aba6ee1d244fd9c0daba722aa0b3b: stopping tablet replica
I20260709 12:27:56.758646  9681 raft_consensus.cc:2243] T 2f737ece325c44c58194725a82923014 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:56.759713  9681 raft_consensus.cc:2272] T 2f737ece325c44c58194725a82923014 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.762287  9681 tablet_replica.cc:333] T 8eaf179090b14105b52c4701d5599216 P 3c1aba6ee1d244fd9c0daba722aa0b3b: stopping tablet replica
I20260709 12:27:56.763002  9681 raft_consensus.cc:2243] T 8eaf179090b14105b52c4701d5599216 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:56.764083  9681 raft_consensus.cc:2272] T 8eaf179090b14105b52c4701d5599216 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.766630  9681 tablet_replica.cc:333] T 5f88e29c7ffd4b3b856561ee240cdd43 P 3c1aba6ee1d244fd9c0daba722aa0b3b: stopping tablet replica
I20260709 12:27:56.767781  9681 raft_consensus.cc:2243] T 5f88e29c7ffd4b3b856561ee240cdd43 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:56.768831  9681 raft_consensus.cc:2272] T 5f88e29c7ffd4b3b856561ee240cdd43 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.771724  9681 tablet_replica.cc:333] T 62e4e875fd4e4604952120df324e99cb P 3c1aba6ee1d244fd9c0daba722aa0b3b: stopping tablet replica
I20260709 12:27:56.772791  9681 raft_consensus.cc:2243] T 62e4e875fd4e4604952120df324e99cb P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:56.774149  9681 raft_consensus.cc:2272] T 62e4e875fd4e4604952120df324e99cb P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.777681  9681 tablet_replica.cc:333] T f39dd87ef56a40e2bf56704b2815a619 P 3c1aba6ee1d244fd9c0daba722aa0b3b: stopping tablet replica
I20260709 12:27:56.778362  9681 raft_consensus.cc:2243] T f39dd87ef56a40e2bf56704b2815a619 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.778914  9681 raft_consensus.cc:2272] T f39dd87ef56a40e2bf56704b2815a619 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.782317  9681 tablet_replica.cc:333] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 3c1aba6ee1d244fd9c0daba722aa0b3b: stopping tablet replica
I20260709 12:27:56.783133  9681 raft_consensus.cc:2243] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:56.784300  9681 raft_consensus.cc:2272] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.787493  9681 tablet_replica.cc:333] T e477f70d4c8d466e9d45e6645e2a2869 P 3c1aba6ee1d244fd9c0daba722aa0b3b: stopping tablet replica
I20260709 12:27:56.788463  9681 raft_consensus.cc:2243] T e477f70d4c8d466e9d45e6645e2a2869 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:56.789762  9681 raft_consensus.cc:2272] T e477f70d4c8d466e9d45e6645e2a2869 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.793318  9681 tablet_replica.cc:333] T 442e0dfc272840f7a14c2232ed65425c P 3c1aba6ee1d244fd9c0daba722aa0b3b: stopping tablet replica
I20260709 12:27:56.794221  9681 raft_consensus.cc:2243] T 442e0dfc272840f7a14c2232ed65425c P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:56.795704  9681 raft_consensus.cc:2272] T 442e0dfc272840f7a14c2232ed65425c P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:56.798887 16834 consensus_peers.cc:597] T fe16827e0b4a45baa99739174f92a0f7 P 17294485b7f24e2b9fae71dd3169a336 -> Peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Couldn't send request to peer 3c1aba6ee1d244fd9c0daba722aa0b3b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:56.801957  9681 tablet_replica.cc:333] T cfc80a8e57c24a768ebc48dd544a6c80 P 3c1aba6ee1d244fd9c0daba722aa0b3b: stopping tablet replica
I20260709 12:27:56.803215  9681 raft_consensus.cc:2243] T cfc80a8e57c24a768ebc48dd544a6c80 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.803915  9681 raft_consensus.cc:2272] T cfc80a8e57c24a768ebc48dd544a6c80 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.807243  9681 tablet_replica.cc:333] T c220555f395e46d4be83f2b16f9691ef P 3c1aba6ee1d244fd9c0daba722aa0b3b: stopping tablet replica
I20260709 12:27:56.808472  9681 raft_consensus.cc:2243] T c220555f395e46d4be83f2b16f9691ef P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.809095  9681 raft_consensus.cc:2272] T c220555f395e46d4be83f2b16f9691ef P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.812287  9681 tablet_replica.cc:333] T 5025c37302bd4a2aa076878e1af90366 P 3c1aba6ee1d244fd9c0daba722aa0b3b: stopping tablet replica
I20260709 12:27:56.813512  9681 raft_consensus.cc:2243] T 5025c37302bd4a2aa076878e1af90366 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.815649  9681 raft_consensus.cc:2272] T 5025c37302bd4a2aa076878e1af90366 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.819343  9681 tablet_replica.cc:333] T de72d440fa1641a39aee027ffc0588a3 P 3c1aba6ee1d244fd9c0daba722aa0b3b: stopping tablet replica
I20260709 12:27:56.820976  9681 raft_consensus.cc:2243] T de72d440fa1641a39aee027ffc0588a3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.821748  9681 raft_consensus.cc:2272] T de72d440fa1641a39aee027ffc0588a3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.825093  9681 tablet_replica.cc:333] T ce37f3e8575c4b8e88935db231644a27 P 3c1aba6ee1d244fd9c0daba722aa0b3b: stopping tablet replica
I20260709 12:27:56.825949  9681 raft_consensus.cc:2243] T ce37f3e8575c4b8e88935db231644a27 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:56.827190  9681 raft_consensus.cc:2272] T ce37f3e8575c4b8e88935db231644a27 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.831229  9681 tablet_replica.cc:333] T 223b3745452c412581caf058f6b81fe2 P 3c1aba6ee1d244fd9c0daba722aa0b3b: stopping tablet replica
W20260709 12:27:56.831940 16908 consensus_peers.cc:597] T de72d440fa1641a39aee027ffc0588a3 P 82f27bcdf252425aad4c4a37d064f68d -> Peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Couldn't send request to peer 3c1aba6ee1d244fd9c0daba722aa0b3b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:56.832480  9681 raft_consensus.cc:2243] T 223b3745452c412581caf058f6b81fe2 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.833146  9681 raft_consensus.cc:2272] T 223b3745452c412581caf058f6b81fe2 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.837226  9681 tablet_replica.cc:333] T e628dacc30694988a7c795441df15600 P 3c1aba6ee1d244fd9c0daba722aa0b3b: stopping tablet replica
I20260709 12:27:56.838294  9681 raft_consensus.cc:2243] T e628dacc30694988a7c795441df15600 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.839186  9681 raft_consensus.cc:2272] T e628dacc30694988a7c795441df15600 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:56.840135 16908 consensus_peers.cc:597] T 51d96c645e894c8597652daf12a21cf3 P 82f27bcdf252425aad4c4a37d064f68d -> Peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Couldn't send request to peer 3c1aba6ee1d244fd9c0daba722aa0b3b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:56.842986  9681 tablet_replica.cc:333] T fe16827e0b4a45baa99739174f92a0f7 P 3c1aba6ee1d244fd9c0daba722aa0b3b: stopping tablet replica
I20260709 12:27:56.844187  9681 raft_consensus.cc:2243] T fe16827e0b4a45baa99739174f92a0f7 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.844868  9681 raft_consensus.cc:2272] T fe16827e0b4a45baa99739174f92a0f7 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.847543  9681 tablet_replica.cc:333] T 60a8110f7e424463ae56af0646bf4434 P 3c1aba6ee1d244fd9c0daba722aa0b3b: stopping tablet replica
I20260709 12:27:56.848253  9681 raft_consensus.cc:2243] T 60a8110f7e424463ae56af0646bf4434 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.848788  9681 raft_consensus.cc:2272] T 60a8110f7e424463ae56af0646bf4434 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.852285  9681 tablet_replica.cc:333] T c5baa0b4140847958c6528b3dbda7617 P 3c1aba6ee1d244fd9c0daba722aa0b3b: stopping tablet replica
I20260709 12:27:56.853654  9681 raft_consensus.cc:2243] T c5baa0b4140847958c6528b3dbda7617 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.854300  9681 raft_consensus.cc:2272] T c5baa0b4140847958c6528b3dbda7617 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.858816  9681 tablet_replica.cc:333] T 00e5268529b241f184c460704ab9ed3c P 3c1aba6ee1d244fd9c0daba722aa0b3b: stopping tablet replica
I20260709 12:27:56.860134  9681 raft_consensus.cc:2243] T 00e5268529b241f184c460704ab9ed3c P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.860908  9681 raft_consensus.cc:2272] T 00e5268529b241f184c460704ab9ed3c P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.865685  9681 tablet_replica.cc:333] T 6e43addba09b4930a12c94e691b2c76f P 3c1aba6ee1d244fd9c0daba722aa0b3b: stopping tablet replica
I20260709 12:27:56.866699  9681 raft_consensus.cc:2243] T 6e43addba09b4930a12c94e691b2c76f P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:56.867913  9681 raft_consensus.cc:2272] T 6e43addba09b4930a12c94e691b2c76f P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.870993  9681 tablet_replica.cc:333] T fbafe39b79894737b395f95013bc6c86 P 3c1aba6ee1d244fd9c0daba722aa0b3b: stopping tablet replica
I20260709 12:27:56.871840  9681 raft_consensus.cc:2243] T fbafe39b79894737b395f95013bc6c86 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.872469  9681 raft_consensus.cc:2272] T fbafe39b79894737b395f95013bc6c86 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.875403  9681 tablet_replica.cc:333] T aee6b58df96f401f88392d39eba8ffbf P 3c1aba6ee1d244fd9c0daba722aa0b3b: stopping tablet replica
I20260709 12:27:56.876256  9681 raft_consensus.cc:2243] T aee6b58df96f401f88392d39eba8ffbf P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.876909  9681 raft_consensus.cc:2272] T aee6b58df96f401f88392d39eba8ffbf P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.879866  9681 tablet_replica.cc:333] T 5868b3bc1ee44923a18d74874a8f3b30 P 3c1aba6ee1d244fd9c0daba722aa0b3b: stopping tablet replica
I20260709 12:27:56.880615  9681 raft_consensus.cc:2243] T 5868b3bc1ee44923a18d74874a8f3b30 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:56.881626  9681 raft_consensus.cc:2272] T 5868b3bc1ee44923a18d74874a8f3b30 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:56.882287 16834 consensus_peers.cc:597] T 840a644e56054e13bfd7585fa064120c P 17294485b7f24e2b9fae71dd3169a336 -> Peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Couldn't send request to peer 3c1aba6ee1d244fd9c0daba722aa0b3b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:56.886296 16834 consensus_peers.cc:597] T cd637126e0044d7996f18e258282a145 P 17294485b7f24e2b9fae71dd3169a336 -> Peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Couldn't send request to peer 3c1aba6ee1d244fd9c0daba722aa0b3b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:56.886551  9681 tablet_replica.cc:333] T ea5085716661498e9f3bfdfa2fc5737a P 3c1aba6ee1d244fd9c0daba722aa0b3b: stopping tablet replica
W20260709 12:27:56.886438 16908 consensus_peers.cc:597] T ea5085716661498e9f3bfdfa2fc5737a P 82f27bcdf252425aad4c4a37d064f68d -> Peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Couldn't send request to peer 3c1aba6ee1d244fd9c0daba722aa0b3b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:56.887440  9681 raft_consensus.cc:2243] T ea5085716661498e9f3bfdfa2fc5737a P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.888257  9681 raft_consensus.cc:2272] T ea5085716661498e9f3bfdfa2fc5737a P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.891899  9681 tablet_replica.cc:333] T cd637126e0044d7996f18e258282a145 P 3c1aba6ee1d244fd9c0daba722aa0b3b: stopping tablet replica
I20260709 12:27:56.893033  9681 raft_consensus.cc:2243] T cd637126e0044d7996f18e258282a145 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.893657  9681 raft_consensus.cc:2272] T cd637126e0044d7996f18e258282a145 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.896646  9681 tablet_replica.cc:333] T d6811cd94dfd44149e1329e919d82f0f P 3c1aba6ee1d244fd9c0daba722aa0b3b: stopping tablet replica
I20260709 12:27:56.897871  9681 raft_consensus.cc:2243] T d6811cd94dfd44149e1329e919d82f0f P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:56.899511  9681 raft_consensus.cc:2272] T d6811cd94dfd44149e1329e919d82f0f P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.904394  9681 tablet_replica.cc:333] T 6916ee6a900c46508c98006aa85fe2d9 P 3c1aba6ee1d244fd9c0daba722aa0b3b: stopping tablet replica
I20260709 12:27:56.905483  9681 raft_consensus.cc:2243] T 6916ee6a900c46508c98006aa85fe2d9 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:56.906713  9681 raft_consensus.cc:2272] T 6916ee6a900c46508c98006aa85fe2d9 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.909464  9681 tablet_replica.cc:333] T 7b90200ef21f42f1929fbf0051ef5b3e P 3c1aba6ee1d244fd9c0daba722aa0b3b: stopping tablet replica
I20260709 12:27:56.910063  9681 raft_consensus.cc:2243] T 7b90200ef21f42f1929fbf0051ef5b3e P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:56.911135  9681 raft_consensus.cc:2272] T 7b90200ef21f42f1929fbf0051ef5b3e P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.914800  9681 tablet_replica.cc:333] T 29fcc4f156a54ca4b54a4a11e2cee973 P 3c1aba6ee1d244fd9c0daba722aa0b3b: stopping tablet replica
I20260709 12:27:56.915521  9681 raft_consensus.cc:2243] T 29fcc4f156a54ca4b54a4a11e2cee973 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.916236  9681 raft_consensus.cc:2272] T 29fcc4f156a54ca4b54a4a11e2cee973 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:56.920503 16908 consensus_peers.cc:597] T cfc80a8e57c24a768ebc48dd544a6c80 P 82f27bcdf252425aad4c4a37d064f68d -> Peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Couldn't send request to peer 3c1aba6ee1d244fd9c0daba722aa0b3b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:56.921984  9681 tablet_replica.cc:333] T 51d96c645e894c8597652daf12a21cf3 P 3c1aba6ee1d244fd9c0daba722aa0b3b: stopping tablet replica
I20260709 12:27:56.923118  9681 raft_consensus.cc:2243] T 51d96c645e894c8597652daf12a21cf3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.923877  9681 raft_consensus.cc:2272] T 51d96c645e894c8597652daf12a21cf3 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.927299  9681 tablet_replica.cc:333] T 9067b67140fa48e883d2d240a6046d63 P 3c1aba6ee1d244fd9c0daba722aa0b3b: stopping tablet replica
I20260709 12:27:56.928146  9681 raft_consensus.cc:2243] T 9067b67140fa48e883d2d240a6046d63 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.928730  9681 raft_consensus.cc:2272] T 9067b67140fa48e883d2d240a6046d63 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.931258  9681 tablet_replica.cc:333] T 28bdf20fc71548da87c4558dacc503db P 3c1aba6ee1d244fd9c0daba722aa0b3b: stopping tablet replica
I20260709 12:27:56.932044  9681 raft_consensus.cc:2243] T 28bdf20fc71548da87c4558dacc503db P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.932662  9681 raft_consensus.cc:2272] T 28bdf20fc71548da87c4558dacc503db P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.935412  9681 tablet_replica.cc:333] T fd1494eb0dd14dab9a2e4c07812117c2 P 3c1aba6ee1d244fd9c0daba722aa0b3b: stopping tablet replica
I20260709 12:27:56.936179  9681 raft_consensus.cc:2243] T fd1494eb0dd14dab9a2e4c07812117c2 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.936764  9681 raft_consensus.cc:2272] T fd1494eb0dd14dab9a2e4c07812117c2 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.939842  9681 tablet_replica.cc:333] T a0409dc146674a39a9ceeeeebc081453 P 3c1aba6ee1d244fd9c0daba722aa0b3b: stopping tablet replica
I20260709 12:27:56.940438  9681 raft_consensus.cc:2243] T a0409dc146674a39a9ceeeeebc081453 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:56.941591  9681 raft_consensus.cc:2272] T a0409dc146674a39a9ceeeeebc081453 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.945179  9681 tablet_replica.cc:333] T b6f178076e7f4c7bb41b4853bacbfc4e P 3c1aba6ee1d244fd9c0daba722aa0b3b: stopping tablet replica
I20260709 12:27:56.946116  9681 raft_consensus.cc:2243] T b6f178076e7f4c7bb41b4853bacbfc4e P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.946836  9681 raft_consensus.cc:2272] T b6f178076e7f4c7bb41b4853bacbfc4e P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.950105  9681 tablet_replica.cc:333] T 840a644e56054e13bfd7585fa064120c P 3c1aba6ee1d244fd9c0daba722aa0b3b: stopping tablet replica
I20260709 12:27:56.950875  9681 raft_consensus.cc:2243] T 840a644e56054e13bfd7585fa064120c P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.951388  9681 raft_consensus.cc:2272] T 840a644e56054e13bfd7585fa064120c P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.954916  9681 tablet_replica.cc:333] T 30a37807dd6548adb6e16f8a4d2e5774 P 3c1aba6ee1d244fd9c0daba722aa0b3b: stopping tablet replica
I20260709 12:27:56.955528  9681 raft_consensus.cc:2243] T 30a37807dd6548adb6e16f8a4d2e5774 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:56.956607  9681 raft_consensus.cc:2272] T 30a37807dd6548adb6e16f8a4d2e5774 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.959206  9681 tablet_replica.cc:333] T 52538067157143b2abd4656a4bbb9442 P 3c1aba6ee1d244fd9c0daba722aa0b3b: stopping tablet replica
I20260709 12:27:56.959877  9681 raft_consensus.cc:2243] T 52538067157143b2abd4656a4bbb9442 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.960422  9681 raft_consensus.cc:2272] T 52538067157143b2abd4656a4bbb9442 P 3c1aba6ee1d244fd9c0daba722aa0b3b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:56.967468 16834 consensus_peers.cc:597] T 9067b67140fa48e883d2d240a6046d63 P 17294485b7f24e2b9fae71dd3169a336 -> Peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Couldn't send request to peer 3c1aba6ee1d244fd9c0daba722aa0b3b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:56.994958 16908 consensus_peers.cc:597] T f29cf6eb18e842c3a5aa62d8fae53279 P 82f27bcdf252425aad4c4a37d064f68d -> Peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Couldn't send request to peer 3c1aba6ee1d244fd9c0daba722aa0b3b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:57.041262 16834 consensus_peers.cc:597] T f5345dc6d3b946e0bb9220acf126cf59 P 17294485b7f24e2b9fae71dd3169a336 -> Peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Couldn't send request to peer 3c1aba6ee1d244fd9c0daba722aa0b3b. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:57.047776 16908 consensus_peers.cc:597] T aee6b58df96f401f88392d39eba8ffbf P 82f27bcdf252425aad4c4a37d064f68d -> Peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Couldn't send request to peer 3c1aba6ee1d244fd9c0daba722aa0b3b. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:57.050798 16834 consensus_peers.cc:597] T 60a8110f7e424463ae56af0646bf4434 P 17294485b7f24e2b9fae71dd3169a336 -> Peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Couldn't send request to peer 3c1aba6ee1d244fd9c0daba722aa0b3b. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:57.058966  9681 tablet_server.cc:196] TabletServer@127.9.116.66:0 shutdown complete.
W20260709 12:27:57.090173 16908 consensus_peers.cc:597] T c220555f395e46d4be83f2b16f9691ef P 82f27bcdf252425aad4c4a37d064f68d -> Peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Couldn't send request to peer 3c1aba6ee1d244fd9c0daba722aa0b3b. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:57.114498 16834 consensus_peers.cc:597] T c5baa0b4140847958c6528b3dbda7617 P 17294485b7f24e2b9fae71dd3169a336 -> Peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Couldn't send request to peer 3c1aba6ee1d244fd9c0daba722aa0b3b. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:57.158116  9681 tablet_server.cc:179] TabletServer@127.9.116.67:0 shutting down...
I20260709 12:27:57.297292 18003 raft_consensus.cc:493] T b10d5b4017584d0fb22f9e542d95fcb1 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:57.298105 18003 raft_consensus.cc:515] T b10d5b4017584d0fb22f9e542d95fcb1 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
W20260709 12:27:57.307318 16907 consensus_peers.cc:597] T aee6b58df96f401f88392d39eba8ffbf P 82f27bcdf252425aad4c4a37d064f68d -> Peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Couldn't send request to peer 17294485b7f24e2b9fae71dd3169a336. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:57.313853 16907 consensus_peers.cc:597] T fd1494eb0dd14dab9a2e4c07812117c2 P 82f27bcdf252425aad4c4a37d064f68d -> Peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Couldn't send request to peer 17294485b7f24e2b9fae71dd3169a336. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:57.373468 18015 raft_consensus.cc:493] T 3d614e06fd2c40189161e22ad9217e5d P 17294485b7f24e2b9fae71dd3169a336 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:57.374212 18015 raft_consensus.cc:515] T 3d614e06fd2c40189161e22ad9217e5d P 17294485b7f24e2b9fae71dd3169a336 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:57.375794 18012 raft_consensus.cc:493] T 5025c37302bd4a2aa076878e1af90366 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:57.376304 18012 raft_consensus.cc:515] T 5025c37302bd4a2aa076878e1af90366 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:57.377068 18015 leader_election.cc:290] T 3d614e06fd2c40189161e22ad9217e5d P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:57.377110 18003 leader_election.cc:290] T b10d5b4017584d0fb22f9e542d95fcb1 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:57.378341 18012 leader_election.cc:290] T 5025c37302bd4a2aa076878e1af90366 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
W20260709 12:27:57.383407 16907 leader_election.cc:336] T b10d5b4017584d0fb22f9e542d95fcb1 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:57.391548 16834 leader_election.cc:336] T 5025c37302bd4a2aa076878e1af90366 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111)
W20260709 12:27:57.393254 16907 leader_election.cc:336] T b10d5b4017584d0fb22f9e542d95fcb1 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:57.394731 16907 leader_election.cc:304] T b10d5b4017584d0fb22f9e542d95fcb1 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8
I20260709 12:27:57.400480 18003 raft_consensus.cc:2749] T b10d5b4017584d0fb22f9e542d95fcb1 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:27:57.402235 16833 leader_election.cc:336] T 3d614e06fd2c40189161e22ad9217e5d P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
W20260709 12:27:57.402945 16833 leader_election.cc:336] T 5025c37302bd4a2aa076878e1af90366 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:57.403254 16833 leader_election.cc:304] T 5025c37302bd4a2aa076878e1af90366 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8
I20260709 12:27:57.404039 18012 raft_consensus.cc:2749] T 5025c37302bd4a2aa076878e1af90366 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:57.418318 18002 raft_consensus.cc:493] T 3e78004b8cc14ac6b93c857cbdd63329 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:57.419062 18002 raft_consensus.cc:515] T 3e78004b8cc14ac6b93c857cbdd63329 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:57.422654 16938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d614e06fd2c40189161e22ad9217e5d" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:57.427564 18002 leader_election.cc:290] T 3e78004b8cc14ac6b93c857cbdd63329 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
W20260709 12:27:57.431260 16907 leader_election.cc:336] T 3e78004b8cc14ac6b93c857cbdd63329 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:57.438704 18012 raft_consensus.cc:493] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 17294485b7f24e2b9fae71dd3169a336 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:57.439361 18012 raft_consensus.cc:515] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 17294485b7f24e2b9fae71dd3169a336 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:57.441767 18012 leader_election.cc:290] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:57.418081 18017 raft_consensus.cc:493] T 223b3745452c412581caf058f6b81fe2 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:57.442914 18012 raft_consensus.cc:493] T 28bdf20fc71548da87c4558dacc503db P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:57.443601 18012 raft_consensus.cc:515] T 28bdf20fc71548da87c4558dacc503db P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } }
I20260709 12:27:57.446446 18012 leader_election.cc:290] T 28bdf20fc71548da87c4558dacc503db P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
W20260709 12:27:57.447242 16907 leader_election.cc:336] T 3e78004b8cc14ac6b93c857cbdd63329 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:57.447763 16907 leader_election.cc:304] T 3e78004b8cc14ac6b93c857cbdd63329 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8
I20260709 12:27:57.450121 18002 raft_consensus.cc:2749] T 3e78004b8cc14ac6b93c857cbdd63329 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:57.449878 18017 raft_consensus.cc:515] T 223b3745452c412581caf058f6b81fe2 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:57.453773 16935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f2b93e5d2045a5a0cd1f9b5806a133" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:57.454735 16833 leader_election.cc:304] T 3d614e06fd2c40189161e22ad9217e5d P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336; no voters: 82f27bcdf252425aad4c4a37d064f68d, 879366e90f5c420588945e0d545017c8
I20260709 12:27:57.457607 18017 leader_election.cc:290] T 223b3745452c412581caf058f6b81fe2 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
W20260709 12:27:57.461268 16834 leader_election.cc:336] T 28bdf20fc71548da87c4558dacc503db P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111)
I20260709 12:27:57.461957 18015 raft_consensus.cc:2749] T 3d614e06fd2c40189161e22ad9217e5d P 17294485b7f24e2b9fae71dd3169a336 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:27:57.462841 16833 leader_election.cc:336] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:57.468894 16833 leader_election.cc:304] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336; no voters: 82f27bcdf252425aad4c4a37d064f68d, 879366e90f5c420588945e0d545017c8
I20260709 12:27:57.470256 18012 raft_consensus.cc:2749] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 17294485b7f24e2b9fae71dd3169a336 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:27:57.476362 16908 leader_election.cc:336] T 223b3745452c412581caf058f6b81fe2 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111)
W20260709 12:27:57.483314 16833 leader_election.cc:336] T 28bdf20fc71548da87c4558dacc503db P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:57.483994 16833 leader_election.cc:304] T 28bdf20fc71548da87c4558dacc503db P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8
W20260709 12:27:57.484448 16907 consensus_peers.cc:597] T c220555f395e46d4be83f2b16f9691ef P 82f27bcdf252425aad4c4a37d064f68d -> Peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Couldn't send request to peer 17294485b7f24e2b9fae71dd3169a336. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:57.484882 18012 raft_consensus.cc:2749] T 28bdf20fc71548da87c4558dacc503db P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:27:57.491729 16907 leader_election.cc:336] T 223b3745452c412581caf058f6b81fe2 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:57.492251 16907 leader_election.cc:304] T 223b3745452c412581caf058f6b81fe2 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8
I20260709 12:27:57.493108 18017 raft_consensus.cc:2749] T 223b3745452c412581caf058f6b81fe2 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:27:57.493868 16907 consensus_peers.cc:597] T 51ebab30b5104589803b75a1b48c5aa2 P 82f27bcdf252425aad4c4a37d064f68d -> Peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Couldn't send request to peer 17294485b7f24e2b9fae71dd3169a336. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:57.494477 16907 consensus_peers.cc:597] T de72d440fa1641a39aee027ffc0588a3 P 82f27bcdf252425aad4c4a37d064f68d -> Peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Couldn't send request to peer 17294485b7f24e2b9fae71dd3169a336. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:57.501564  9681 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:57.502758  9681 tablet_replica.cc:333] T 7562feb416f84f0b948343356153d8d2 P 17294485b7f24e2b9fae71dd3169a336: stopping tablet replica
I20260709 12:27:57.503880  9681 raft_consensus.cc:2243] T 7562feb416f84f0b948343356153d8d2 P 17294485b7f24e2b9fae71dd3169a336 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:57.505131  9681 raft_consensus.cc:2272] T 7562feb416f84f0b948343356153d8d2 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:57.508388  9681 tablet_replica.cc:333] T a4252af16e15424399c32c789c8e6c23 P 17294485b7f24e2b9fae71dd3169a336: stopping tablet replica
I20260709 12:27:57.510720  9681 raft_consensus.cc:2243] T a4252af16e15424399c32c789c8e6c23 P 17294485b7f24e2b9fae71dd3169a336 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:57.513101  9681 raft_consensus.cc:2272] T a4252af16e15424399c32c789c8e6c23 P 17294485b7f24e2b9fae71dd3169a336 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:57.516289  9681 tablet_replica.cc:333] T ce37f3e8575c4b8e88935db231644a27 P 17294485b7f24e2b9fae71dd3169a336: stopping tablet replica
I20260709 12:27:57.516253 18012 raft_consensus.cc:493] T b10d5b4017584d0fb22f9e542d95fcb1 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 879366e90f5c420588945e0d545017c8)
W20260709 12:27:57.517112 16907 consensus_peers.cc:597] T f29cf6eb18e842c3a5aa62d8fae53279 P 82f27bcdf252425aad4c4a37d064f68d -> Peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Couldn't send request to peer 17294485b7f24e2b9fae71dd3169a336. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:57.516963 18012 raft_consensus.cc:515] T b10d5b4017584d0fb22f9e542d95fcb1 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:57.517534  9681 raft_consensus.cc:2243] T ce37f3e8575c4b8e88935db231644a27 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:57.518191  9681 raft_consensus.cc:2272] T ce37f3e8575c4b8e88935db231644a27 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:57.519017 18012 leader_election.cc:290] T b10d5b4017584d0fb22f9e542d95fcb1 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:57.520080 16935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b10d5b4017584d0fb22f9e542d95fcb1" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d" is_pre_election: true
I20260709 12:27:57.520795 16935 raft_consensus.cc:2468] T b10d5b4017584d0fb22f9e542d95fcb1 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 2.
I20260709 12:27:57.520924  9681 tablet_replica.cc:333] T f29cf6eb18e842c3a5aa62d8fae53279 P 17294485b7f24e2b9fae71dd3169a336: stopping tablet replica
I20260709 12:27:57.521854  9681 raft_consensus.cc:2243] T f29cf6eb18e842c3a5aa62d8fae53279 P 17294485b7f24e2b9fae71dd3169a336 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:57.522445  9681 raft_consensus.cc:2272] T f29cf6eb18e842c3a5aa62d8fae53279 P 17294485b7f24e2b9fae71dd3169a336 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:57.523169 18018 raft_consensus.cc:493] T 3d614e06fd2c40189161e22ad9217e5d P 82f27bcdf252425aad4c4a37d064f68d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:57.523718 18018 raft_consensus.cc:515] T 3d614e06fd2c40189161e22ad9217e5d P 82f27bcdf252425aad4c4a37d064f68d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:57.525341 18018 leader_election.cc:290] T 3d614e06fd2c40189161e22ad9217e5d P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:57.527796  9681 tablet_replica.cc:333] T 3e78004b8cc14ac6b93c857cbdd63329 P 17294485b7f24e2b9fae71dd3169a336: stopping tablet replica
I20260709 12:27:57.528826  9681 raft_consensus.cc:2243] T 3e78004b8cc14ac6b93c857cbdd63329 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:57.529371  9681 raft_consensus.cc:2272] T 3e78004b8cc14ac6b93c857cbdd63329 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:57.530697 16907 consensus_peers.cc:597] T 51d96c645e894c8597652daf12a21cf3 P 82f27bcdf252425aad4c4a37d064f68d -> Peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Couldn't send request to peer 17294485b7f24e2b9fae71dd3169a336. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:57.525281 16833 leader_election.cc:304] T b10d5b4017584d0fb22f9e542d95fcb1 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 82f27bcdf252425aad4c4a37d064f68d; no voters: 
W20260709 12:27:57.531335 16907 leader_election.cc:336] T 3d614e06fd2c40189161e22ad9217e5d P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:57.532012  9681 tablet_replica.cc:333] T f5345dc6d3b946e0bb9220acf126cf59 P 17294485b7f24e2b9fae71dd3169a336: stopping tablet replica
I20260709 12:27:57.532100 18012 raft_consensus.cc:2804] T b10d5b4017584d0fb22f9e542d95fcb1 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:57.532910 18012 raft_consensus.cc:493] T b10d5b4017584d0fb22f9e542d95fcb1 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:57.533018  9681 raft_consensus.cc:2243] T f5345dc6d3b946e0bb9220acf126cf59 P 17294485b7f24e2b9fae71dd3169a336 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:57.533342 18012 raft_consensus.cc:3060] T b10d5b4017584d0fb22f9e542d95fcb1 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:27:57.534122 16833 leader_election.cc:336] T b10d5b4017584d0fb22f9e542d95fcb1 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:57.534230  9681 raft_consensus.cc:2272] T f5345dc6d3b946e0bb9220acf126cf59 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:57.532099 16907 leader_election.cc:336] T 3d614e06fd2c40189161e22ad9217e5d P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:57.535737 16907 leader_election.cc:304] T 3d614e06fd2c40189161e22ad9217e5d P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8
I20260709 12:27:57.536522 18018 raft_consensus.cc:2749] T 3d614e06fd2c40189161e22ad9217e5d P 82f27bcdf252425aad4c4a37d064f68d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:57.537349  9681 tablet_replica.cc:333] T 5f88e29c7ffd4b3b856561ee240cdd43 P 17294485b7f24e2b9fae71dd3169a336: stopping tablet replica
I20260709 12:27:57.538303  9681 raft_consensus.cc:2243] T 5f88e29c7ffd4b3b856561ee240cdd43 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:57.538874  9681 raft_consensus.cc:2272] T 5f88e29c7ffd4b3b856561ee240cdd43 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:57.540933 18012 raft_consensus.cc:515] T b10d5b4017584d0fb22f9e542d95fcb1 P 17294485b7f24e2b9fae71dd3169a336 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:57.541289  9681 tablet_replica.cc:333] T 51ebab30b5104589803b75a1b48c5aa2 P 17294485b7f24e2b9fae71dd3169a336: stopping tablet replica
I20260709 12:27:57.541245 18018 raft_consensus.cc:493] T 3649e7bb023a4958a01ad5ecbe446f0f P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:57.542128 18018 raft_consensus.cc:515] T 3649e7bb023a4958a01ad5ecbe446f0f P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:57.542481  9681 raft_consensus.cc:2243] T 51ebab30b5104589803b75a1b48c5aa2 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:57.543272  9681 raft_consensus.cc:2272] T 51ebab30b5104589803b75a1b48c5aa2 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:57.544790 18018 leader_election.cc:290] T 3649e7bb023a4958a01ad5ecbe446f0f P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:57.546077 18012 leader_election.cc:290] T b10d5b4017584d0fb22f9e542d95fcb1 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 3 election: Requested vote from peers 82f27bcdf252425aad4c4a37d064f68d (127.9.116.68:37919), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:57.546360 16935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b10d5b4017584d0fb22f9e542d95fcb1" candidate_uuid: "17294485b7f24e2b9fae71dd3169a336" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "82f27bcdf252425aad4c4a37d064f68d"
I20260709 12:27:57.546674  9681 tablet_replica.cc:333] T f39dd87ef56a40e2bf56704b2815a619 P 17294485b7f24e2b9fae71dd3169a336: stopping tablet replica
I20260709 12:27:57.547014 16935 raft_consensus.cc:3060] T b10d5b4017584d0fb22f9e542d95fcb1 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:57.547863  9681 raft_consensus.cc:2243] T f39dd87ef56a40e2bf56704b2815a619 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:57.548785  9681 raft_consensus.cc:2272] T f39dd87ef56a40e2bf56704b2815a619 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:57.552654 16833 leader_election.cc:336] T b10d5b4017584d0fb22f9e542d95fcb1 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:57.553380  9681 tablet_replica.cc:333] T 3d614e06fd2c40189161e22ad9217e5d P 17294485b7f24e2b9fae71dd3169a336: stopping tablet replica
I20260709 12:27:57.554112  9681 raft_consensus.cc:2243] T 3d614e06fd2c40189161e22ad9217e5d P 17294485b7f24e2b9fae71dd3169a336 [term 4 FOLLOWER]: Raft consensus shutting down.
W20260709 12:27:57.554467 16907 leader_election.cc:336] T 3649e7bb023a4958a01ad5ecbe446f0f P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:57.554687  9681 raft_consensus.cc:2272] T 3d614e06fd2c40189161e22ad9217e5d P 17294485b7f24e2b9fae71dd3169a336 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:57.555114 16935 raft_consensus.cc:2468] T b10d5b4017584d0fb22f9e542d95fcb1 P 82f27bcdf252425aad4c4a37d064f68d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17294485b7f24e2b9fae71dd3169a336 in term 3.
W20260709 12:27:57.555372 16907 leader_election.cc:336] T 3649e7bb023a4958a01ad5ecbe446f0f P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:57.555850 16907 leader_election.cc:304] T 3649e7bb023a4958a01ad5ecbe446f0f P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8
I20260709 12:27:57.556571 18017 raft_consensus.cc:2749] T 3649e7bb023a4958a01ad5ecbe446f0f P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:57.557279 16833 leader_election.cc:304] T b10d5b4017584d0fb22f9e542d95fcb1 P 17294485b7f24e2b9fae71dd3169a336 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17294485b7f24e2b9fae71dd3169a336, 82f27bcdf252425aad4c4a37d064f68d; no voters: 879366e90f5c420588945e0d545017c8
I20260709 12:27:57.557659  9681 tablet_replica.cc:333] T e477f70d4c8d466e9d45e6645e2a2869 P 17294485b7f24e2b9fae71dd3169a336: stopping tablet replica
I20260709 12:27:57.558007 18012 raft_consensus.cc:2804] T b10d5b4017584d0fb22f9e542d95fcb1 P 17294485b7f24e2b9fae71dd3169a336 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:57.558523 18012 raft_consensus.cc:697] T b10d5b4017584d0fb22f9e542d95fcb1 P 17294485b7f24e2b9fae71dd3169a336 [term 3 LEADER]: Becoming Leader. State: Replica: 17294485b7f24e2b9fae71dd3169a336, State: Running, Role: LEADER
I20260709 12:27:57.558647  9681 raft_consensus.cc:2243] T e477f70d4c8d466e9d45e6645e2a2869 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:57.559278  9681 raft_consensus.cc:2272] T e477f70d4c8d466e9d45e6645e2a2869 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:57.559916 16907 consensus_peers.cc:597] T f39dd87ef56a40e2bf56704b2815a619 P 82f27bcdf252425aad4c4a37d064f68d -> Peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Couldn't send request to peer 17294485b7f24e2b9fae71dd3169a336. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:57.559425 18012 consensus_queue.cc:237] T b10d5b4017584d0fb22f9e542d95fcb1 P 17294485b7f24e2b9fae71dd3169a336 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:57.562397  9681 tablet_replica.cc:333] T 514ee26ff21e4c08976b6a0397b730fe P 17294485b7f24e2b9fae71dd3169a336: stopping tablet replica
I20260709 12:27:57.563453  9681 raft_consensus.cc:2243] T 514ee26ff21e4c08976b6a0397b730fe P 17294485b7f24e2b9fae71dd3169a336 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:57.564513  9681 raft_consensus.cc:2272] T 514ee26ff21e4c08976b6a0397b730fe P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:57.567047  9681 tablet_replica.cc:333] T 3649e7bb023a4958a01ad5ecbe446f0f P 17294485b7f24e2b9fae71dd3169a336: stopping tablet replica
I20260709 12:27:57.567760  9681 raft_consensus.cc:2243] T 3649e7bb023a4958a01ad5ecbe446f0f P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:57.568202  9681 raft_consensus.cc:2272] T 3649e7bb023a4958a01ad5ecbe446f0f P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:57.570086  9681 tablet_replica.cc:333] T cfc80a8e57c24a768ebc48dd544a6c80 P 17294485b7f24e2b9fae71dd3169a336: stopping tablet replica
I20260709 12:27:57.570655  9681 raft_consensus.cc:2243] T cfc80a8e57c24a768ebc48dd544a6c80 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:57.571152  9681 raft_consensus.cc:2272] T cfc80a8e57c24a768ebc48dd544a6c80 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:57.573354  9681 tablet_replica.cc:333] T c220555f395e46d4be83f2b16f9691ef P 17294485b7f24e2b9fae71dd3169a336: stopping tablet replica
I20260709 12:27:57.573937  9681 raft_consensus.cc:2243] T c220555f395e46d4be83f2b16f9691ef P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:57.574379  9681 raft_consensus.cc:2272] T c220555f395e46d4be83f2b16f9691ef P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:57.577019  9681 tablet_replica.cc:333] T 28c655b68dc545948c67e0977b49e770 P 17294485b7f24e2b9fae71dd3169a336: stopping tablet replica
I20260709 12:27:57.577764  9681 raft_consensus.cc:2243] T 28c655b68dc545948c67e0977b49e770 P 17294485b7f24e2b9fae71dd3169a336 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:57.578564  9681 raft_consensus.cc:2272] T 28c655b68dc545948c67e0977b49e770 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:57.580725  9681 tablet_replica.cc:333] T 5025c37302bd4a2aa076878e1af90366 P 17294485b7f24e2b9fae71dd3169a336: stopping tablet replica
I20260709 12:27:57.581293  9681 raft_consensus.cc:2243] T 5025c37302bd4a2aa076878e1af90366 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:57.582140  9681 raft_consensus.cc:2272] T 5025c37302bd4a2aa076878e1af90366 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:57.584921  9681 tablet_replica.cc:333] T 5868b3bc1ee44923a18d74874a8f3b30 P 17294485b7f24e2b9fae71dd3169a336: stopping tablet replica
I20260709 12:27:57.585798  9681 raft_consensus.cc:2243] T 5868b3bc1ee44923a18d74874a8f3b30 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:57.586504  9681 raft_consensus.cc:2272] T 5868b3bc1ee44923a18d74874a8f3b30 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:57.589203  9681 tablet_replica.cc:333] T 6e89df746e0c49d184637314ce87045a P 17294485b7f24e2b9fae71dd3169a336: stopping tablet replica
I20260709 12:27:57.590139  9681 raft_consensus.cc:2243] T 6e89df746e0c49d184637314ce87045a P 17294485b7f24e2b9fae71dd3169a336 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:57.590758  9681 raft_consensus.cc:2272] T 6e89df746e0c49d184637314ce87045a P 17294485b7f24e2b9fae71dd3169a336 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:57.593793  9681 tablet_replica.cc:333] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 17294485b7f24e2b9fae71dd3169a336: stopping tablet replica
I20260709 12:27:57.594558  9681 raft_consensus.cc:2243] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 17294485b7f24e2b9fae71dd3169a336 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:57.595024  9681 raft_consensus.cc:2272] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 17294485b7f24e2b9fae71dd3169a336 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:57.597112  9681 tablet_replica.cc:333] T 27dda31a8cd1468eb3a824ae026485a3 P 17294485b7f24e2b9fae71dd3169a336: stopping tablet replica
I20260709 12:27:57.597878  9681 raft_consensus.cc:2243] T 27dda31a8cd1468eb3a824ae026485a3 P 17294485b7f24e2b9fae71dd3169a336 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:27:57.598783  9681 raft_consensus.cc:2272] T 27dda31a8cd1468eb3a824ae026485a3 P 17294485b7f24e2b9fae71dd3169a336 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:57.601634  9681 tablet_replica.cc:333] T b777ccb9937a476590a534fea0428c5c P 17294485b7f24e2b9fae71dd3169a336: stopping tablet replica
I20260709 12:27:57.602258  9681 raft_consensus.cc:2243] T b777ccb9937a476590a534fea0428c5c P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:57.602777  9681 raft_consensus.cc:2272] T b777ccb9937a476590a534fea0428c5c P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:57.605257  9681 tablet_replica.cc:333] T c5baa0b4140847958c6528b3dbda7617 P 17294485b7f24e2b9fae71dd3169a336: stopping tablet replica
I20260709 12:27:57.605882  9681 raft_consensus.cc:2243] T c5baa0b4140847958c6528b3dbda7617 P 17294485b7f24e2b9fae71dd3169a336 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:57.606949  9681 raft_consensus.cc:2272] T c5baa0b4140847958c6528b3dbda7617 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:57.610021  9681 tablet_replica.cc:333] T 60a8110f7e424463ae56af0646bf4434 P 17294485b7f24e2b9fae71dd3169a336: stopping tablet replica
I20260709 12:27:57.610802  9681 raft_consensus.cc:2243] T 60a8110f7e424463ae56af0646bf4434 P 17294485b7f24e2b9fae71dd3169a336 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:57.611850  9681 raft_consensus.cc:2272] T 60a8110f7e424463ae56af0646bf4434 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:57.613927  9681 tablet_replica.cc:333] T fe16827e0b4a45baa99739174f92a0f7 P 17294485b7f24e2b9fae71dd3169a336: stopping tablet replica
I20260709 12:27:57.614606  9681 raft_consensus.cc:2243] T fe16827e0b4a45baa99739174f92a0f7 P 17294485b7f24e2b9fae71dd3169a336 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:57.615365  9681 raft_consensus.cc:2272] T fe16827e0b4a45baa99739174f92a0f7 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:57.618268  9681 tablet_replica.cc:333] T b10d5b4017584d0fb22f9e542d95fcb1 P 17294485b7f24e2b9fae71dd3169a336: stopping tablet replica
I20260709 12:27:57.618940  9681 raft_consensus.cc:2243] T b10d5b4017584d0fb22f9e542d95fcb1 P 17294485b7f24e2b9fae71dd3169a336 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:27:57.619839  9681 pending_rounds.cc:70] T b10d5b4017584d0fb22f9e542d95fcb1 P 17294485b7f24e2b9fae71dd3169a336: Trying to abort 1 pending ops.
I20260709 12:27:57.620055  9681 pending_rounds.cc:77] T b10d5b4017584d0fb22f9e542d95fcb1 P 17294485b7f24e2b9fae71dd3169a336: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305625917693947904 op_type: NO_OP noop_request { }
I20260709 12:27:57.620466  9681 raft_consensus.cc:2889] T b10d5b4017584d0fb22f9e542d95fcb1 P 17294485b7f24e2b9fae71dd3169a336 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:27:57.620759  9681 raft_consensus.cc:2272] T b10d5b4017584d0fb22f9e542d95fcb1 P 17294485b7f24e2b9fae71dd3169a336 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:57.623837  9681 tablet_replica.cc:333] T 27f104a1ba60493ab47f6b876da48d67 P 17294485b7f24e2b9fae71dd3169a336: stopping tablet replica
I20260709 12:27:57.624511  9681 raft_consensus.cc:2243] T 27f104a1ba60493ab47f6b876da48d67 P 17294485b7f24e2b9fae71dd3169a336 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:57.625352  9681 raft_consensus.cc:2272] T 27f104a1ba60493ab47f6b876da48d67 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:57.627943  9681 tablet_replica.cc:333] T e628dacc30694988a7c795441df15600 P 17294485b7f24e2b9fae71dd3169a336: stopping tablet replica
I20260709 12:27:57.628583  9681 raft_consensus.cc:2243] T e628dacc30694988a7c795441df15600 P 17294485b7f24e2b9fae71dd3169a336 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:57.629519  9681 raft_consensus.cc:2272] T e628dacc30694988a7c795441df15600 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:57.629560 18018 raft_consensus.cc:493] T a8a632c738e94b26a8352a68a42a0670 P 82f27bcdf252425aad4c4a37d064f68d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:57.630191 18018 raft_consensus.cc:515] T a8a632c738e94b26a8352a68a42a0670 P 82f27bcdf252425aad4c4a37d064f68d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:57.632745 18018 leader_election.cc:290] T a8a632c738e94b26a8352a68a42a0670 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:57.633025  9681 tablet_replica.cc:333] T cd637126e0044d7996f18e258282a145 P 17294485b7f24e2b9fae71dd3169a336: stopping tablet replica
I20260709 12:27:57.634246  9681 raft_consensus.cc:2243] T cd637126e0044d7996f18e258282a145 P 17294485b7f24e2b9fae71dd3169a336 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:57.635380  9681 raft_consensus.cc:2272] T cd637126e0044d7996f18e258282a145 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:57.637789 16907 leader_election.cc:336] T a8a632c738e94b26a8352a68a42a0670 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:57.638500  9681 tablet_replica.cc:333] T fd1494eb0dd14dab9a2e4c07812117c2 P 17294485b7f24e2b9fae71dd3169a336: stopping tablet replica
W20260709 12:27:57.638522 16908 leader_election.cc:336] T a8a632c738e94b26a8352a68a42a0670 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111)
I20260709 12:27:57.639160 16908 leader_election.cc:304] T a8a632c738e94b26a8352a68a42a0670 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8
I20260709 12:27:57.639232  9681 raft_consensus.cc:2243] T fd1494eb0dd14dab9a2e4c07812117c2 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:57.639822 18018 raft_consensus.cc:2749] T a8a632c738e94b26a8352a68a42a0670 P 82f27bcdf252425aad4c4a37d064f68d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:57.639906  9681 raft_consensus.cc:2272] T fd1494eb0dd14dab9a2e4c07812117c2 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:57.642581  9681 tablet_replica.cc:333] T 29fcc4f156a54ca4b54a4a11e2cee973 P 17294485b7f24e2b9fae71dd3169a336: stopping tablet replica
I20260709 12:27:57.643258  9681 raft_consensus.cc:2243] T 29fcc4f156a54ca4b54a4a11e2cee973 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:57.643847  9681 raft_consensus.cc:2272] T 29fcc4f156a54ca4b54a4a11e2cee973 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:57.645978  9681 tablet_replica.cc:333] T 51d96c645e894c8597652daf12a21cf3 P 17294485b7f24e2b9fae71dd3169a336: stopping tablet replica
I20260709 12:27:57.646531  9681 raft_consensus.cc:2243] T 51d96c645e894c8597652daf12a21cf3 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:57.646932  9681 raft_consensus.cc:2272] T 51d96c645e894c8597652daf12a21cf3 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:57.649075  9681 tablet_replica.cc:333] T 9067b67140fa48e883d2d240a6046d63 P 17294485b7f24e2b9fae71dd3169a336: stopping tablet replica
I20260709 12:27:57.649636  9681 raft_consensus.cc:2243] T 9067b67140fa48e883d2d240a6046d63 P 17294485b7f24e2b9fae71dd3169a336 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:57.650400  9681 raft_consensus.cc:2272] T 9067b67140fa48e883d2d240a6046d63 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:57.652449  9681 tablet_replica.cc:333] T 28bdf20fc71548da87c4558dacc503db P 17294485b7f24e2b9fae71dd3169a336: stopping tablet replica
I20260709 12:27:57.652980  9681 raft_consensus.cc:2243] T 28bdf20fc71548da87c4558dacc503db P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:57.653409  9681 raft_consensus.cc:2272] T 28bdf20fc71548da87c4558dacc503db P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:57.655405  9681 tablet_replica.cc:333] T b86527b8a77848629c50a32e2534f7ba P 17294485b7f24e2b9fae71dd3169a336: stopping tablet replica
I20260709 12:27:57.656025  9681 raft_consensus.cc:2243] T b86527b8a77848629c50a32e2534f7ba P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:57.656490  9681 raft_consensus.cc:2272] T b86527b8a77848629c50a32e2534f7ba P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:57.658736  9681 tablet_replica.cc:333] T 30a37807dd6548adb6e16f8a4d2e5774 P 17294485b7f24e2b9fae71dd3169a336: stopping tablet replica
I20260709 12:27:57.659315  9681 raft_consensus.cc:2243] T 30a37807dd6548adb6e16f8a4d2e5774 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:57.659829  9681 raft_consensus.cc:2272] T 30a37807dd6548adb6e16f8a4d2e5774 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:57.662014  9681 tablet_replica.cc:333] T 98a96f910b4449f7ba9c875e45090080 P 17294485b7f24e2b9fae71dd3169a336: stopping tablet replica
I20260709 12:27:57.662647  9681 raft_consensus.cc:2243] T 98a96f910b4449f7ba9c875e45090080 P 17294485b7f24e2b9fae71dd3169a336 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:57.663548  9681 raft_consensus.cc:2272] T 98a96f910b4449f7ba9c875e45090080 P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:57.666859  9681 tablet_replica.cc:333] T 52538067157143b2abd4656a4bbb9442 P 17294485b7f24e2b9fae71dd3169a336: stopping tablet replica
I20260709 12:27:57.667881  9681 raft_consensus.cc:2243] T 52538067157143b2abd4656a4bbb9442 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:57.668810  9681 raft_consensus.cc:2272] T 52538067157143b2abd4656a4bbb9442 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:57.671511  9681 tablet_replica.cc:333] T b6f178076e7f4c7bb41b4853bacbfc4e P 17294485b7f24e2b9fae71dd3169a336: stopping tablet replica
I20260709 12:27:57.672240  9681 raft_consensus.cc:2243] T b6f178076e7f4c7bb41b4853bacbfc4e P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:57.672749  9681 raft_consensus.cc:2272] T b6f178076e7f4c7bb41b4853bacbfc4e P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:57.675290  9681 tablet_replica.cc:333] T 840a644e56054e13bfd7585fa064120c P 17294485b7f24e2b9fae71dd3169a336: stopping tablet replica
I20260709 12:27:57.676069  9681 raft_consensus.cc:2243] T 840a644e56054e13bfd7585fa064120c P 17294485b7f24e2b9fae71dd3169a336 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:57.677052  9681 raft_consensus.cc:2272] T 840a644e56054e13bfd7585fa064120c P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:57.679334  9681 tablet_replica.cc:333] T aee6b58df96f401f88392d39eba8ffbf P 17294485b7f24e2b9fae71dd3169a336: stopping tablet replica
I20260709 12:27:57.679934  9681 raft_consensus.cc:2243] T aee6b58df96f401f88392d39eba8ffbf P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:57.680413  9681 raft_consensus.cc:2272] T aee6b58df96f401f88392d39eba8ffbf P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:57.682621  9681 tablet_replica.cc:333] T 6e43addba09b4930a12c94e691b2c76f P 17294485b7f24e2b9fae71dd3169a336: stopping tablet replica
I20260709 12:27:57.683223  9681 raft_consensus.cc:2243] T 6e43addba09b4930a12c94e691b2c76f P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:57.683759  9681 raft_consensus.cc:2272] T 6e43addba09b4930a12c94e691b2c76f P 17294485b7f24e2b9fae71dd3169a336 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:57.686230  9681 tablet_replica.cc:333] T de72d440fa1641a39aee027ffc0588a3 P 17294485b7f24e2b9fae71dd3169a336: stopping tablet replica
I20260709 12:27:57.686972  9681 raft_consensus.cc:2243] T de72d440fa1641a39aee027ffc0588a3 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:57.687891  9681 raft_consensus.cc:2272] T de72d440fa1641a39aee027ffc0588a3 P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:57.691562  9681 tablet_replica.cc:333] T 288d05b8017c4e0f8cd40048647aecae P 17294485b7f24e2b9fae71dd3169a336: stopping tablet replica
I20260709 12:27:57.692408  9681 raft_consensus.cc:2243] T 288d05b8017c4e0f8cd40048647aecae P 17294485b7f24e2b9fae71dd3169a336 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:57.693687  9681 raft_consensus.cc:2272] T 288d05b8017c4e0f8cd40048647aecae P 17294485b7f24e2b9fae71dd3169a336 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:57.713227 16907 consensus_peers.cc:597] T b777ccb9937a476590a534fea0428c5c P 82f27bcdf252425aad4c4a37d064f68d -> Peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Couldn't send request to peer 17294485b7f24e2b9fae71dd3169a336. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:57.720932 16907 consensus_peers.cc:597] T cfc80a8e57c24a768ebc48dd544a6c80 P 82f27bcdf252425aad4c4a37d064f68d -> Peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Couldn't send request to peer 17294485b7f24e2b9fae71dd3169a336. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:57.736325 16907 consensus_peers.cc:597] T 29fcc4f156a54ca4b54a4a11e2cee973 P 82f27bcdf252425aad4c4a37d064f68d -> Peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Couldn't send request to peer 17294485b7f24e2b9fae71dd3169a336. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:57.742877 18018 raft_consensus.cc:493] T 6a86fc21ef0044bb91dd271c9a019336 P 82f27bcdf252425aad4c4a37d064f68d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:57.743608 18018 raft_consensus.cc:515] T 6a86fc21ef0044bb91dd271c9a019336 P 82f27bcdf252425aad4c4a37d064f68d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:57.745995 18018 leader_election.cc:290] T 6a86fc21ef0044bb91dd271c9a019336 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
W20260709 12:27:57.747802 16907 consensus_peers.cc:597] T b86527b8a77848629c50a32e2534f7ba P 82f27bcdf252425aad4c4a37d064f68d -> Peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Couldn't send request to peer 17294485b7f24e2b9fae71dd3169a336. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:57.751255 16907 leader_election.cc:336] T 6a86fc21ef0044bb91dd271c9a019336 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
W20260709 12:27:57.752374 16908 leader_election.cc:336] T 6a86fc21ef0044bb91dd271c9a019336 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111)
I20260709 12:27:57.752732 16908 leader_election.cc:304] T 6a86fc21ef0044bb91dd271c9a019336 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8
I20260709 12:27:57.753333 18018 raft_consensus.cc:2749] T 6a86fc21ef0044bb91dd271c9a019336 P 82f27bcdf252425aad4c4a37d064f68d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:57.851084 18018 raft_consensus.cc:493] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:57.851763 18018 raft_consensus.cc:515] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:57.854039 18018 leader_election.cc:290] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
W20260709 12:27:57.858927 16907 leader_election.cc:336] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Network error: Client connection negotiation failed: client connection to 127.9.116.67:38103: connect: Connection refused (error 111)
W20260709 12:27:57.859923 16907 leader_election.cc:336] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:57.860342 16907 leader_election.cc:304] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8
I20260709 12:27:57.861778 18018 raft_consensus.cc:2749] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:57.891359 18018 raft_consensus.cc:493] T 62e4e875fd4e4604952120df324e99cb P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3c1aba6ee1d244fd9c0daba722aa0b3b)
I20260709 12:27:57.891896 18018 raft_consensus.cc:515] T 62e4e875fd4e4604952120df324e99cb P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:57.893846 18018 leader_election.cc:290] T 62e4e875fd4e4604952120df324e99cb P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
W20260709 12:27:57.898329 16908 leader_election.cc:336] T 62e4e875fd4e4604952120df324e99cb P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111)
W20260709 12:27:57.898757 16907 leader_election.cc:336] T 62e4e875fd4e4604952120df324e99cb P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:57.899148 16907 leader_election.cc:304] T 62e4e875fd4e4604952120df324e99cb P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8
I20260709 12:27:57.899766 18018 raft_consensus.cc:2749] T 62e4e875fd4e4604952120df324e99cb P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:57.936781 18017 raft_consensus.cc:493] T 5868b3bc1ee44923a18d74874a8f3b30 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3c1aba6ee1d244fd9c0daba722aa0b3b)
I20260709 12:27:57.937598 18017 raft_consensus.cc:515] T 5868b3bc1ee44923a18d74874a8f3b30 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:57.940436 18017 leader_election.cc:290] T 5868b3bc1ee44923a18d74874a8f3b30 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
I20260709 12:27:57.946810 18017 raft_consensus.cc:493] T 8eaf179090b14105b52c4701d5599216 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3c1aba6ee1d244fd9c0daba722aa0b3b)
I20260709 12:27:57.947492 18017 raft_consensus.cc:515] T 8eaf179090b14105b52c4701d5599216 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
W20260709 12:27:57.948208 16908 leader_election.cc:336] T 5868b3bc1ee44923a18d74874a8f3b30 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111)
W20260709 12:27:57.949595 16907 leader_election.cc:336] T 5868b3bc1ee44923a18d74874a8f3b30 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Network error: Client connection negotiation failed: client connection to 127.9.116.67:38103: connect: Connection refused (error 111)
I20260709 12:27:57.950095 16907 leader_election.cc:304] T 5868b3bc1ee44923a18d74874a8f3b30 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 17294485b7f24e2b9fae71dd3169a336, 3c1aba6ee1d244fd9c0daba722aa0b3b
I20260709 12:27:57.950163 18017 leader_election.cc:290] T 8eaf179090b14105b52c4701d5599216 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:57.950968 18017 raft_consensus.cc:2749] T 5868b3bc1ee44923a18d74874a8f3b30 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:27:57.955869 16908 leader_election.cc:336] T 8eaf179090b14105b52c4701d5599216 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111)
W20260709 12:27:57.956611 16907 leader_election.cc:336] T 8eaf179090b14105b52c4701d5599216 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:57.956981 16907 leader_election.cc:304] T 8eaf179090b14105b52c4701d5599216 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8
I20260709 12:27:57.957595 18017 raft_consensus.cc:2749] T 8eaf179090b14105b52c4701d5599216 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:57.997622 18018 raft_consensus.cc:493] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3c1aba6ee1d244fd9c0daba722aa0b3b)
I20260709 12:27:57.998404 18002 raft_consensus.cc:493] T 442e0dfc272840f7a14c2232ed65425c P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3c1aba6ee1d244fd9c0daba722aa0b3b)
I20260709 12:27:57.998281 18018 raft_consensus.cc:515] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:57.999086 18002 raft_consensus.cc:515] T 442e0dfc272840f7a14c2232ed65425c P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:58.001667 18018 leader_election.cc:290] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:58.001842 18002 leader_election.cc:290] T 442e0dfc272840f7a14c2232ed65425c P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:58.010178 18002 raft_consensus.cc:493] T d6811cd94dfd44149e1329e919d82f0f P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3c1aba6ee1d244fd9c0daba722aa0b3b)
I20260709 12:27:58.010727 18002 raft_consensus.cc:515] T d6811cd94dfd44149e1329e919d82f0f P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
W20260709 12:27:58.011402 16908 leader_election.cc:336] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111)
W20260709 12:27:58.012176 16908 leader_election.cc:336] T 442e0dfc272840f7a14c2232ed65425c P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111)
W20260709 12:27:58.012961 16907 leader_election.cc:336] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:58.013607 16907 leader_election.cc:304] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8
I20260709 12:27:58.014487 18018 raft_consensus.cc:2749] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:58.014184 18002 leader_election.cc:290] T d6811cd94dfd44149e1329e919d82f0f P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
W20260709 12:27:58.015506 16907 leader_election.cc:336] T 442e0dfc272840f7a14c2232ed65425c P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:58.016008 16907 leader_election.cc:304] T 442e0dfc272840f7a14c2232ed65425c P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8
I20260709 12:27:58.016747 18002 raft_consensus.cc:2749] T 442e0dfc272840f7a14c2232ed65425c P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:27:58.019037 16908 leader_election.cc:336] T d6811cd94dfd44149e1329e919d82f0f P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111)
W20260709 12:27:58.022405 16907 leader_election.cc:336] T d6811cd94dfd44149e1329e919d82f0f P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:58.022845 16907 leader_election.cc:304] T d6811cd94dfd44149e1329e919d82f0f P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8
I20260709 12:27:58.023851 18002 raft_consensus.cc:2749] T d6811cd94dfd44149e1329e919d82f0f P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:58.127384 18002 raft_consensus.cc:493] T 2f737ece325c44c58194725a82923014 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3c1aba6ee1d244fd9c0daba722aa0b3b)
I20260709 12:27:58.128202 18002 raft_consensus.cc:515] T 2f737ece325c44c58194725a82923014 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:58.131003 18002 leader_election.cc:290] T 2f737ece325c44c58194725a82923014 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
W20260709 12:27:58.135525 16908 leader_election.cc:336] T 2f737ece325c44c58194725a82923014 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111)
W20260709 12:27:58.138685 16907 leader_election.cc:336] T 2f737ece325c44c58194725a82923014 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:58.139305 16907 leader_election.cc:304] T 2f737ece325c44c58194725a82923014 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8
I20260709 12:27:58.140383 18002 raft_consensus.cc:2749] T 2f737ece325c44c58194725a82923014 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:58.146888 18002 raft_consensus.cc:493] T 7b90200ef21f42f1929fbf0051ef5b3e P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3c1aba6ee1d244fd9c0daba722aa0b3b)
I20260709 12:27:58.147567 18002 raft_consensus.cc:515] T 7b90200ef21f42f1929fbf0051ef5b3e P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:58.150049 18002 leader_election.cc:290] T 7b90200ef21f42f1929fbf0051ef5b3e P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
W20260709 12:27:58.153930 16908 leader_election.cc:336] T 7b90200ef21f42f1929fbf0051ef5b3e P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111)
W20260709 12:27:58.154606 16907 leader_election.cc:336] T 7b90200ef21f42f1929fbf0051ef5b3e P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:58.155145 16907 leader_election.cc:304] T 7b90200ef21f42f1929fbf0051ef5b3e P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8
I20260709 12:27:58.156011 18002 raft_consensus.cc:2749] T 7b90200ef21f42f1929fbf0051ef5b3e P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:58.219288 18002 raft_consensus.cc:493] T a0409dc146674a39a9ceeeeebc081453 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3c1aba6ee1d244fd9c0daba722aa0b3b)
I20260709 12:27:58.220188 18002 raft_consensus.cc:515] T a0409dc146674a39a9ceeeeebc081453 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:58.222587 18002 leader_election.cc:290] T a0409dc146674a39a9ceeeeebc081453 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
W20260709 12:27:58.226823 16907 leader_election.cc:336] T a0409dc146674a39a9ceeeeebc081453 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
W20260709 12:27:58.227517 16908 leader_election.cc:336] T a0409dc146674a39a9ceeeeebc081453 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111)
I20260709 12:27:58.228025 16908 leader_election.cc:304] T a0409dc146674a39a9ceeeeebc081453 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8
I20260709 12:27:58.228698 18002 raft_consensus.cc:2749] T a0409dc146674a39a9ceeeeebc081453 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:58.302354 18017 raft_consensus.cc:493] T 6916ee6a900c46508c98006aa85fe2d9 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3c1aba6ee1d244fd9c0daba722aa0b3b)
I20260709 12:27:58.302886 18017 raft_consensus.cc:515] T 6916ee6a900c46508c98006aa85fe2d9 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:58.304936 18017 leader_election.cc:290] T 6916ee6a900c46508c98006aa85fe2d9 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:27:58.309087 18017 raft_consensus.cc:493] T 6e43addba09b4930a12c94e691b2c76f P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3c1aba6ee1d244fd9c0daba722aa0b3b)
W20260709 12:27:58.309648 16908 leader_election.cc:336] T 6916ee6a900c46508c98006aa85fe2d9 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111)
I20260709 12:27:58.309603 18017 raft_consensus.cc:515] T 6e43addba09b4930a12c94e691b2c76f P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
W20260709 12:27:58.311865 16907 leader_election.cc:336] T 6916ee6a900c46508c98006aa85fe2d9 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:58.312119 18017 leader_election.cc:290] T 6e43addba09b4930a12c94e691b2c76f P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
I20260709 12:27:58.312345 16907 leader_election.cc:304] T 6916ee6a900c46508c98006aa85fe2d9 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8
I20260709 12:27:58.313163 18017 raft_consensus.cc:2749] T 6916ee6a900c46508c98006aa85fe2d9 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:27:58.317368 16908 leader_election.cc:336] T 6e43addba09b4930a12c94e691b2c76f P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111)
W20260709 12:27:58.318426 16907 leader_election.cc:336] T 6e43addba09b4930a12c94e691b2c76f P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Network error: Client connection negotiation failed: client connection to 127.9.116.67:38103: connect: Connection refused (error 111)
I20260709 12:27:58.318773 16907 leader_election.cc:304] T 6e43addba09b4930a12c94e691b2c76f P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 17294485b7f24e2b9fae71dd3169a336, 3c1aba6ee1d244fd9c0daba722aa0b3b
I20260709 12:27:58.319396 18017 raft_consensus.cc:2749] T 6e43addba09b4930a12c94e691b2c76f P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:27:58.328198 16889 debug-util.cc:398] Leaking SignalData structure 0x7b0800027780 after lost signal to thread 9684
W20260709 12:27:58.329192 16889 debug-util.cc:398] Leaking SignalData structure 0x7b0800135a20 after lost signal to thread 16651
W20260709 12:27:58.330715 16889 debug-util.cc:398] Leaking SignalData structure 0x7b0800141aa0 after lost signal to thread 16966
I20260709 12:27:58.364725 18017 raft_consensus.cc:493] T 30a37807dd6548adb6e16f8a4d2e5774 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3c1aba6ee1d244fd9c0daba722aa0b3b)
I20260709 12:27:58.365384 18017 raft_consensus.cc:515] T 30a37807dd6548adb6e16f8a4d2e5774 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:58.367151 18017 leader_election.cc:290] T 30a37807dd6548adb6e16f8a4d2e5774 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
W20260709 12:27:58.371552 16908 leader_election.cc:336] T 30a37807dd6548adb6e16f8a4d2e5774 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111)
W20260709 12:27:58.372403 16907 leader_election.cc:336] T 30a37807dd6548adb6e16f8a4d2e5774 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Network error: Client connection negotiation failed: client connection to 127.9.116.67:38103: connect: Connection refused (error 111)
I20260709 12:27:58.373014 16907 leader_election.cc:304] T 30a37807dd6548adb6e16f8a4d2e5774 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 17294485b7f24e2b9fae71dd3169a336, 3c1aba6ee1d244fd9c0daba722aa0b3b
I20260709 12:27:58.373805 18017 raft_consensus.cc:2749] T 30a37807dd6548adb6e16f8a4d2e5774 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:58.559275 18017 raft_consensus.cc:493] T f5345dc6d3b946e0bb9220acf126cf59 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17294485b7f24e2b9fae71dd3169a336)
I20260709 12:27:58.560007 18017 raft_consensus.cc:515] T f5345dc6d3b946e0bb9220acf126cf59 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:58.562613 18017 leader_election.cc:290] T f5345dc6d3b946e0bb9220acf126cf59 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
W20260709 12:27:58.566814 16908 leader_election.cc:336] T f5345dc6d3b946e0bb9220acf126cf59 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111)
W20260709 12:27:58.567371 16907 leader_election.cc:336] T f5345dc6d3b946e0bb9220acf126cf59 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Network error: Client connection negotiation failed: client connection to 127.9.116.67:38103: connect: Connection refused (error 111)
I20260709 12:27:58.567807 16907 leader_election.cc:304] T f5345dc6d3b946e0bb9220acf126cf59 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 17294485b7f24e2b9fae71dd3169a336, 3c1aba6ee1d244fd9c0daba722aa0b3b
I20260709 12:27:58.568434 18017 raft_consensus.cc:2749] T f5345dc6d3b946e0bb9220acf126cf59 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:27:58.688987 16907 consensus_peers.cc:597] T 51ebab30b5104589803b75a1b48c5aa2 P 82f27bcdf252425aad4c4a37d064f68d -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:58.783154  9681 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 16889)
W20260709 12:27:58.796403 16907 consensus_peers.cc:597] T b777ccb9937a476590a534fea0428c5c P 82f27bcdf252425aad4c4a37d064f68d -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:58.809443 18017 raft_consensus.cc:493] T 60a8110f7e424463ae56af0646bf4434 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17294485b7f24e2b9fae71dd3169a336)
I20260709 12:27:58.810055 18017 raft_consensus.cc:515] T 60a8110f7e424463ae56af0646bf4434 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:58.813537 18017 leader_election.cc:290] T 60a8110f7e424463ae56af0646bf4434 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
W20260709 12:27:58.819769 16908 leader_election.cc:336] T 60a8110f7e424463ae56af0646bf4434 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111)
W20260709 12:27:58.820564 16907 leader_election.cc:336] T 60a8110f7e424463ae56af0646bf4434 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Network error: Client connection negotiation failed: client connection to 127.9.116.67:38103: connect: Connection refused (error 111)
I20260709 12:27:58.821074 16907 leader_election.cc:304] T 60a8110f7e424463ae56af0646bf4434 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 17294485b7f24e2b9fae71dd3169a336, 3c1aba6ee1d244fd9c0daba722aa0b3b
I20260709 12:27:58.822499 18017 raft_consensus.cc:2749] T 60a8110f7e424463ae56af0646bf4434 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:58.922148 18017 raft_consensus.cc:493] T 27f104a1ba60493ab47f6b876da48d67 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17294485b7f24e2b9fae71dd3169a336)
I20260709 12:27:58.922999 18017 raft_consensus.cc:515] T 27f104a1ba60493ab47f6b876da48d67 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:58.923200 18002 raft_consensus.cc:493] T 7562feb416f84f0b948343356153d8d2 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17294485b7f24e2b9fae71dd3169a336)
I20260709 12:27:58.924301 18002 raft_consensus.cc:515] T 7562feb416f84f0b948343356153d8d2 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:58.925382 18017 leader_election.cc:290] T 27f104a1ba60493ab47f6b876da48d67 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:58.926935 18002 leader_election.cc:290] T 7562feb416f84f0b948343356153d8d2 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
W20260709 12:27:58.931015 16907 leader_election.cc:336] T 27f104a1ba60493ab47f6b876da48d67 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Network error: Client connection negotiation failed: client connection to 127.9.116.67:38103: connect: Connection refused (error 111)
W20260709 12:27:58.931514 16907 leader_election.cc:336] T 7562feb416f84f0b948343356153d8d2 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Network error: Client connection negotiation failed: client connection to 127.9.116.67:38103: connect: Connection refused (error 111)
W20260709 12:27:58.932128 16907 leader_election.cc:336] T 27f104a1ba60493ab47f6b876da48d67 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:58.932436 16907 leader_election.cc:304] T 27f104a1ba60493ab47f6b876da48d67 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8
I20260709 12:27:58.933101 18002 raft_consensus.cc:2749] T 27f104a1ba60493ab47f6b876da48d67 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:27:58.933156 16907 leader_election.cc:336] T 7562feb416f84f0b948343356153d8d2 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:58.935233 16907 leader_election.cc:304] T 7562feb416f84f0b948343356153d8d2 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8
I20260709 12:27:58.936553 18017 raft_consensus.cc:2749] T 7562feb416f84f0b948343356153d8d2 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:58.951452 18002 raft_consensus.cc:493] T 27dda31a8cd1468eb3a824ae026485a3 P 82f27bcdf252425aad4c4a37d064f68d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 17294485b7f24e2b9fae71dd3169a336)
I20260709 12:27:58.952045 18002 raft_consensus.cc:515] T 27dda31a8cd1468eb3a824ae026485a3 P 82f27bcdf252425aad4c4a37d064f68d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:58.953426 18017 raft_consensus.cc:493] T 28c655b68dc545948c67e0977b49e770 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17294485b7f24e2b9fae71dd3169a336)
I20260709 12:27:58.954298 18017 raft_consensus.cc:515] T 28c655b68dc545948c67e0977b49e770 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:58.954746 18002 leader_election.cc:290] T 27dda31a8cd1468eb3a824ae026485a3 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
I20260709 12:27:58.956715 18017 leader_election.cc:290] T 28c655b68dc545948c67e0977b49e770 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
W20260709 12:27:58.961210 16907 leader_election.cc:336] T 27dda31a8cd1468eb3a824ae026485a3 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Network error: Client connection negotiation failed: client connection to 127.9.116.67:38103: connect: Connection refused (error 111)
W20260709 12:27:58.961756 16907 leader_election.cc:336] T 28c655b68dc545948c67e0977b49e770 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Network error: Client connection negotiation failed: client connection to 127.9.116.67:38103: connect: Connection refused (error 111)
W20260709 12:27:58.962306 16907 leader_election.cc:336] T 27dda31a8cd1468eb3a824ae026485a3 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:58.962626 16907 leader_election.cc:304] T 27dda31a8cd1468eb3a824ae026485a3 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8
I20260709 12:27:58.963398 18017 raft_consensus.cc:2749] T 27dda31a8cd1468eb3a824ae026485a3 P 82f27bcdf252425aad4c4a37d064f68d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:27:58.963457 16907 leader_election.cc:336] T 28c655b68dc545948c67e0977b49e770 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:58.964450 16907 leader_election.cc:304] T 28c655b68dc545948c67e0977b49e770 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8
I20260709 12:27:58.965255 18017 raft_consensus.cc:2749] T 28c655b68dc545948c67e0977b49e770 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:58.990288 18002 raft_consensus.cc:493] T 288d05b8017c4e0f8cd40048647aecae P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17294485b7f24e2b9fae71dd3169a336)
I20260709 12:27:58.991058 18002 raft_consensus.cc:515] T 288d05b8017c4e0f8cd40048647aecae P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:58.994040 18002 leader_election.cc:290] T 288d05b8017c4e0f8cd40048647aecae P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
W20260709 12:27:59.002272 16907 leader_election.cc:336] T 288d05b8017c4e0f8cd40048647aecae P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Network error: Client connection negotiation failed: client connection to 127.9.116.67:38103: connect: Connection refused (error 111)
W20260709 12:27:59.002962 16907 leader_election.cc:336] T 288d05b8017c4e0f8cd40048647aecae P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:59.003317 16907 leader_election.cc:304] T 288d05b8017c4e0f8cd40048647aecae P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8
I20260709 12:27:59.004241 18002 raft_consensus.cc:2749] T 288d05b8017c4e0f8cd40048647aecae P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:27:59.020066 16907 consensus_peers.cc:597] T 00e5268529b241f184c460704ab9ed3c P 82f27bcdf252425aad4c4a37d064f68d -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:59.036952 16908 consensus_peers.cc:597] T 29fcc4f156a54ca4b54a4a11e2cee973 P 82f27bcdf252425aad4c4a37d064f68d -> Peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Couldn't send request to peer 3c1aba6ee1d244fd9c0daba722aa0b3b. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:59.037730 18002 raft_consensus.cc:493] T 514ee26ff21e4c08976b6a0397b730fe P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17294485b7f24e2b9fae71dd3169a336)
I20260709 12:27:59.038203 18002 raft_consensus.cc:515] T 514ee26ff21e4c08976b6a0397b730fe P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:59.040231 18002 leader_election.cc:290] T 514ee26ff21e4c08976b6a0397b730fe P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
W20260709 12:27:59.047646 16907 leader_election.cc:336] T 514ee26ff21e4c08976b6a0397b730fe P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Network error: Client connection negotiation failed: client connection to 127.9.116.67:38103: connect: Connection refused (error 111)
W20260709 12:27:59.048589 16907 leader_election.cc:336] T 514ee26ff21e4c08976b6a0397b730fe P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:59.050086 16907 leader_election.cc:304] T 514ee26ff21e4c08976b6a0397b730fe P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8
I20260709 12:27:59.051083 18017 raft_consensus.cc:2749] T 514ee26ff21e4c08976b6a0397b730fe P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:27:59.061728 16907 consensus_peers.cc:597] T ea5085716661498e9f3bfdfa2fc5737a P 82f27bcdf252425aad4c4a37d064f68d -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:59.111248 18017 raft_consensus.cc:493] T 98a96f910b4449f7ba9c875e45090080 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17294485b7f24e2b9fae71dd3169a336)
I20260709 12:27:59.111889 18017 raft_consensus.cc:515] T 98a96f910b4449f7ba9c875e45090080 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:59.113839 18017 leader_election.cc:290] T 98a96f910b4449f7ba9c875e45090080 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
W20260709 12:27:59.119812 16907 leader_election.cc:336] T 98a96f910b4449f7ba9c875e45090080 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Network error: Client connection negotiation failed: client connection to 127.9.116.67:38103: connect: Connection refused (error 111)
W20260709 12:27:59.120743 16907 leader_election.cc:336] T 98a96f910b4449f7ba9c875e45090080 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:59.121208 16907 leader_election.cc:304] T 98a96f910b4449f7ba9c875e45090080 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8
I20260709 12:27:59.122396 18017 raft_consensus.cc:2749] T 98a96f910b4449f7ba9c875e45090080 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:27:59.123504 16908 consensus_peers.cc:597] T fd1494eb0dd14dab9a2e4c07812117c2 P 82f27bcdf252425aad4c4a37d064f68d -> Peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Couldn't send request to peer 3c1aba6ee1d244fd9c0daba722aa0b3b. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:59.126689 16908 consensus_peers.cc:597] T f39dd87ef56a40e2bf56704b2815a619 P 82f27bcdf252425aad4c4a37d064f68d -> Peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Couldn't send request to peer 3c1aba6ee1d244fd9c0daba722aa0b3b. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:59.166853 16907 consensus_peers.cc:597] T fbafe39b79894737b395f95013bc6c86 P 82f27bcdf252425aad4c4a37d064f68d -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:59.266494 16907 consensus_peers.cc:597] T b86527b8a77848629c50a32e2534f7ba P 82f27bcdf252425aad4c4a37d064f68d -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:59.269778 16908 consensus_peers.cc:597] T fbafe39b79894737b395f95013bc6c86 P 82f27bcdf252425aad4c4a37d064f68d -> Peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Couldn't send request to peer 3c1aba6ee1d244fd9c0daba722aa0b3b. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:59.306501 18024 raft_consensus.cc:493] T 3649e7bb023a4958a01ad5ecbe446f0f P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:59.307250 18024 raft_consensus.cc:515] T 3649e7bb023a4958a01ad5ecbe446f0f P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:59.309808 18024 leader_election.cc:290] T 3649e7bb023a4958a01ad5ecbe446f0f P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
W20260709 12:27:59.317364 16907 leader_election.cc:336] T 3649e7bb023a4958a01ad5ecbe446f0f P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
W20260709 12:27:59.318547 16907 leader_election.cc:336] T 3649e7bb023a4958a01ad5ecbe446f0f P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Network error: Client connection negotiation failed: client connection to 127.9.116.67:38103: connect: Connection refused (error 111)
I20260709 12:27:59.319195 16907 leader_election.cc:304] T 3649e7bb023a4958a01ad5ecbe446f0f P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8
I20260709 12:27:59.320313 18024 raft_consensus.cc:2749] T 3649e7bb023a4958a01ad5ecbe446f0f P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:27:59.323493 16908 consensus_peers.cc:597] T c220555f395e46d4be83f2b16f9691ef P 82f27bcdf252425aad4c4a37d064f68d -> Peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Couldn't send request to peer 3c1aba6ee1d244fd9c0daba722aa0b3b. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:59.333468 18024 raft_consensus.cc:493] T 223b3745452c412581caf058f6b81fe2 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:59.334246 18024 raft_consensus.cc:515] T 223b3745452c412581caf058f6b81fe2 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:59.337831 18024 leader_election.cc:290] T 223b3745452c412581caf058f6b81fe2 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
W20260709 12:27:59.345353 16908 leader_election.cc:336] T 223b3745452c412581caf058f6b81fe2 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111)
W20260709 12:27:59.349220 16907 leader_election.cc:336] T 223b3745452c412581caf058f6b81fe2 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:59.350003 16907 leader_election.cc:304] T 223b3745452c412581caf058f6b81fe2 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8
I20260709 12:27:59.350864 18024 raft_consensus.cc:2749] T 223b3745452c412581caf058f6b81fe2 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:27:59.379504 16908 consensus_peers.cc:597] T de72d440fa1641a39aee027ffc0588a3 P 82f27bcdf252425aad4c4a37d064f68d -> Peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Couldn't send request to peer 3c1aba6ee1d244fd9c0daba722aa0b3b. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:59.487419 16908 consensus_peers.cc:597] T 51d96c645e894c8597652daf12a21cf3 P 82f27bcdf252425aad4c4a37d064f68d -> Peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Couldn't send request to peer 3c1aba6ee1d244fd9c0daba722aa0b3b. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:59.489724 16908 consensus_peers.cc:597] T ea5085716661498e9f3bfdfa2fc5737a P 82f27bcdf252425aad4c4a37d064f68d -> Peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Couldn't send request to peer 3c1aba6ee1d244fd9c0daba722aa0b3b. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:59.542086 16908 consensus_peers.cc:597] T aee6b58df96f401f88392d39eba8ffbf P 82f27bcdf252425aad4c4a37d064f68d -> Peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Couldn't send request to peer 3c1aba6ee1d244fd9c0daba722aa0b3b. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:59.544864 16908 consensus_peers.cc:597] T 00e5268529b241f184c460704ab9ed3c P 82f27bcdf252425aad4c4a37d064f68d -> Peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Couldn't send request to peer 3c1aba6ee1d244fd9c0daba722aa0b3b. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:59.555189 18024 raft_consensus.cc:493] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:59.555814 18024 raft_consensus.cc:515] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:59.557729 18024 leader_election.cc:290] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
W20260709 12:27:59.562620 16907 leader_election.cc:336] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Network error: Client connection negotiation failed: client connection to 127.9.116.67:38103: connect: Connection refused (error 111)
W20260709 12:27:59.563465 16907 leader_election.cc:336] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:59.563864 16907 leader_election.cc:304] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8
I20260709 12:27:59.564481 18024 raft_consensus.cc:2749] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:27:59.614167 16908 consensus_peers.cc:597] T cfc80a8e57c24a768ebc48dd544a6c80 P 82f27bcdf252425aad4c4a37d064f68d -> Peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Couldn't send request to peer 3c1aba6ee1d244fd9c0daba722aa0b3b. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:59.664844 16908 consensus_peers.cc:597] T f29cf6eb18e842c3a5aa62d8fae53279 P 82f27bcdf252425aad4c4a37d064f68d -> Peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Couldn't send request to peer 3c1aba6ee1d244fd9c0daba722aa0b3b. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:59.671939 18017 raft_consensus.cc:493] T 3e78004b8cc14ac6b93c857cbdd63329 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:59.672629 18017 raft_consensus.cc:515] T 3e78004b8cc14ac6b93c857cbdd63329 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:59.674723 18017 leader_election.cc:290] T 3e78004b8cc14ac6b93c857cbdd63329 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:59.675755 18017 raft_consensus.cc:493] T 3d614e06fd2c40189161e22ad9217e5d P 82f27bcdf252425aad4c4a37d064f68d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:59.676476 18017 raft_consensus.cc:515] T 3d614e06fd2c40189161e22ad9217e5d P 82f27bcdf252425aad4c4a37d064f68d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:27:59.680190 18024 raft_consensus.cc:493] T 6a86fc21ef0044bb91dd271c9a019336 P 82f27bcdf252425aad4c4a37d064f68d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:59.680470 18017 leader_election.cc:290] T 3d614e06fd2c40189161e22ad9217e5d P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:27:59.680783 18024 raft_consensus.cc:515] T 6a86fc21ef0044bb91dd271c9a019336 P 82f27bcdf252425aad4c4a37d064f68d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:59.683138 18024 leader_election.cc:290] T 6a86fc21ef0044bb91dd271c9a019336 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
W20260709 12:27:59.684371 16907 leader_election.cc:336] T 3e78004b8cc14ac6b93c857cbdd63329 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Network error: Client connection negotiation failed: client connection to 127.9.116.67:38103: connect: Connection refused (error 111)
W20260709 12:27:59.686250 16907 leader_election.cc:336] T 3e78004b8cc14ac6b93c857cbdd63329 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:59.686728 16907 leader_election.cc:304] T 3e78004b8cc14ac6b93c857cbdd63329 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8
W20260709 12:27:59.686937 16908 leader_election.cc:336] T 6a86fc21ef0044bb91dd271c9a019336 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111)
I20260709 12:27:59.687693 18024 raft_consensus.cc:2749] T 3e78004b8cc14ac6b93c857cbdd63329 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:27:59.689724 16907 leader_election.cc:336] T 3d614e06fd2c40189161e22ad9217e5d P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Network error: Client connection negotiation failed: client connection to 127.9.116.67:38103: connect: Connection refused (error 111)
W20260709 12:27:59.690644 16907 leader_election.cc:336] T 3d614e06fd2c40189161e22ad9217e5d P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:59.691028 16907 leader_election.cc:304] T 3d614e06fd2c40189161e22ad9217e5d P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8
I20260709 12:27:59.691732 18017 raft_consensus.cc:2749] T 3d614e06fd2c40189161e22ad9217e5d P 82f27bcdf252425aad4c4a37d064f68d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:27:59.691947 16907 leader_election.cc:336] T 6a86fc21ef0044bb91dd271c9a019336 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:59.692561 16907 leader_election.cc:304] T 6a86fc21ef0044bb91dd271c9a019336 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8
I20260709 12:27:59.693182 18017 raft_consensus.cc:2749] T 6a86fc21ef0044bb91dd271c9a019336 P 82f27bcdf252425aad4c4a37d064f68d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:59.702309 18017 raft_consensus.cc:493] T 8eaf179090b14105b52c4701d5599216 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3c1aba6ee1d244fd9c0daba722aa0b3b)
I20260709 12:27:59.703195 18017 raft_consensus.cc:515] T 8eaf179090b14105b52c4701d5599216 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:59.705571 18017 leader_election.cc:290] T 8eaf179090b14105b52c4701d5599216 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
W20260709 12:27:59.709874 16907 leader_election.cc:336] T 8eaf179090b14105b52c4701d5599216 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
W20260709 12:27:59.710633 16908 leader_election.cc:336] T 8eaf179090b14105b52c4701d5599216 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111)
I20260709 12:27:59.711081 16908 leader_election.cc:304] T 8eaf179090b14105b52c4701d5599216 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8
I20260709 12:27:59.712039 18017 raft_consensus.cc:2749] T 8eaf179090b14105b52c4701d5599216 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:59.722065 18017 raft_consensus.cc:493] T 5868b3bc1ee44923a18d74874a8f3b30 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3c1aba6ee1d244fd9c0daba722aa0b3b)
I20260709 12:27:59.722815 18017 raft_consensus.cc:515] T 5868b3bc1ee44923a18d74874a8f3b30 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:27:59.725869 18017 leader_election.cc:290] T 5868b3bc1ee44923a18d74874a8f3b30 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
W20260709 12:27:59.731304 16908 leader_election.cc:336] T 5868b3bc1ee44923a18d74874a8f3b30 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111)
W20260709 12:27:59.731910 16907 leader_election.cc:336] T 5868b3bc1ee44923a18d74874a8f3b30 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Network error: Client connection negotiation failed: client connection to 127.9.116.67:38103: connect: Connection refused (error 111)
I20260709 12:27:59.732342 16907 leader_election.cc:304] T 5868b3bc1ee44923a18d74874a8f3b30 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 17294485b7f24e2b9fae71dd3169a336, 3c1aba6ee1d244fd9c0daba722aa0b3b
I20260709 12:27:59.733034 18024 raft_consensus.cc:2749] T 5868b3bc1ee44923a18d74874a8f3b30 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:59.738525 18024 raft_consensus.cc:493] T 7b90200ef21f42f1929fbf0051ef5b3e P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3c1aba6ee1d244fd9c0daba722aa0b3b)
I20260709 12:27:59.739355 18024 raft_consensus.cc:515] T 7b90200ef21f42f1929fbf0051ef5b3e P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:59.742293 18024 leader_election.cc:290] T 7b90200ef21f42f1929fbf0051ef5b3e P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
W20260709 12:27:59.744797 16907 consensus_peers.cc:597] T b777ccb9937a476590a534fea0428c5c P 82f27bcdf252425aad4c4a37d064f68d -> Peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Couldn't send request to peer 17294485b7f24e2b9fae71dd3169a336. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.67:38103: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:59.748646 16908 leader_election.cc:336] T 7b90200ef21f42f1929fbf0051ef5b3e P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111)
W20260709 12:27:59.750059 16907 leader_election.cc:336] T 7b90200ef21f42f1929fbf0051ef5b3e P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:27:59.750634 16907 leader_election.cc:304] T 7b90200ef21f42f1929fbf0051ef5b3e P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8
I20260709 12:27:59.751546 18024 raft_consensus.cc:2749] T 7b90200ef21f42f1929fbf0051ef5b3e P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:27:59.783807  9681 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 16889)
I20260709 12:27:59.809741 18017 raft_consensus.cc:493] T a8a632c738e94b26a8352a68a42a0670 P 82f27bcdf252425aad4c4a37d064f68d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:27:59.810446 18017 raft_consensus.cc:515] T a8a632c738e94b26a8352a68a42a0670 P 82f27bcdf252425aad4c4a37d064f68d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:59.812856 18017 leader_election.cc:290] T a8a632c738e94b26a8352a68a42a0670 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
W20260709 12:27:59.818495 16907 consensus_peers.cc:597] T 51ebab30b5104589803b75a1b48c5aa2 P 82f27bcdf252425aad4c4a37d064f68d -> Peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Couldn't send request to peer 17294485b7f24e2b9fae71dd3169a336. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.67:38103: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:59.819067 16907 consensus_peers.cc:597] T fd1494eb0dd14dab9a2e4c07812117c2 P 82f27bcdf252425aad4c4a37d064f68d -> Peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Couldn't send request to peer 17294485b7f24e2b9fae71dd3169a336. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.67:38103: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:59.819712 16907 leader_election.cc:336] T a8a632c738e94b26a8352a68a42a0670 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
W20260709 12:27:59.820693 16908 leader_election.cc:336] T a8a632c738e94b26a8352a68a42a0670 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111)
I20260709 12:27:59.821244 16908 leader_election.cc:304] T a8a632c738e94b26a8352a68a42a0670 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8
I20260709 12:27:59.822829 18017 raft_consensus.cc:2749] T a8a632c738e94b26a8352a68a42a0670 P 82f27bcdf252425aad4c4a37d064f68d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:27:59.861395 16907 consensus_peers.cc:597] T de72d440fa1641a39aee027ffc0588a3 P 82f27bcdf252425aad4c4a37d064f68d -> Peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Couldn't send request to peer 17294485b7f24e2b9fae71dd3169a336. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.67:38103: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:59.886868 16907 consensus_peers.cc:597] T aee6b58df96f401f88392d39eba8ffbf P 82f27bcdf252425aad4c4a37d064f68d -> Peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Couldn't send request to peer 17294485b7f24e2b9fae71dd3169a336. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.67:38103: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:59.952759 18017 raft_consensus.cc:493] T d6811cd94dfd44149e1329e919d82f0f P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3c1aba6ee1d244fd9c0daba722aa0b3b)
I20260709 12:27:59.953536 18017 raft_consensus.cc:515] T d6811cd94dfd44149e1329e919d82f0f P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:27:59.956746 18017 leader_election.cc:290] T d6811cd94dfd44149e1329e919d82f0f P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
W20260709 12:27:59.957617 16907 consensus_peers.cc:597] T c220555f395e46d4be83f2b16f9691ef P 82f27bcdf252425aad4c4a37d064f68d -> Peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Couldn't send request to peer 17294485b7f24e2b9fae71dd3169a336. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.67:38103: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:59.960703 16907 leader_election.cc:336] T d6811cd94dfd44149e1329e919d82f0f P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
W20260709 12:27:59.961159 16908 leader_election.cc:336] T d6811cd94dfd44149e1329e919d82f0f P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111)
I20260709 12:27:59.961587 16908 leader_election.cc:304] T d6811cd94dfd44149e1329e919d82f0f P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8
I20260709 12:27:59.962353 18017 raft_consensus.cc:2749] T d6811cd94dfd44149e1329e919d82f0f P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:00.042696 18017 raft_consensus.cc:493] T 62e4e875fd4e4604952120df324e99cb P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3c1aba6ee1d244fd9c0daba722aa0b3b)
I20260709 12:28:00.043318 18017 raft_consensus.cc:515] T 62e4e875fd4e4604952120df324e99cb P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:28:00.045558 18017 leader_election.cc:290] T 62e4e875fd4e4604952120df324e99cb P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
W20260709 12:28:00.048727 16908 leader_election.cc:336] T 62e4e875fd4e4604952120df324e99cb P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111)
W20260709 12:28:00.049708 16907 leader_election.cc:336] T 62e4e875fd4e4604952120df324e99cb P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:28:00.050186 16907 leader_election.cc:304] T 62e4e875fd4e4604952120df324e99cb P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8
I20260709 12:28:00.051033 18017 raft_consensus.cc:2749] T 62e4e875fd4e4604952120df324e99cb P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:00.072839 18017 raft_consensus.cc:493] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3c1aba6ee1d244fd9c0daba722aa0b3b)
I20260709 12:28:00.073380 18017 raft_consensus.cc:515] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:28:00.075407 18017 leader_election.cc:290] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
W20260709 12:28:00.080605 16907 leader_election.cc:336] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
W20260709 12:28:00.081452 16908 leader_election.cc:336] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111)
I20260709 12:28:00.081904 16908 leader_election.cc:304] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8
I20260709 12:28:00.082521 18017 raft_consensus.cc:2749] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:28:00.116984 16907 consensus_peers.cc:597] T 51d96c645e894c8597652daf12a21cf3 P 82f27bcdf252425aad4c4a37d064f68d -> Peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Couldn't send request to peer 17294485b7f24e2b9fae71dd3169a336. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.67:38103: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:00.139228 18017 raft_consensus.cc:493] T 2f737ece325c44c58194725a82923014 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3c1aba6ee1d244fd9c0daba722aa0b3b)
I20260709 12:28:00.139842 18017 raft_consensus.cc:515] T 2f737ece325c44c58194725a82923014 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:28:00.142143 18017 leader_election.cc:290] T 2f737ece325c44c58194725a82923014 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
W20260709 12:28:00.146569 16907 consensus_peers.cc:597] T f39dd87ef56a40e2bf56704b2815a619 P 82f27bcdf252425aad4c4a37d064f68d -> Peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Couldn't send request to peer 17294485b7f24e2b9fae71dd3169a336. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.67:38103: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:00.148885 16908 leader_election.cc:336] T 2f737ece325c44c58194725a82923014 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111)
W20260709 12:28:00.155736 16907 leader_election.cc:336] T 2f737ece325c44c58194725a82923014 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:28:00.156363 16907 leader_election.cc:304] T 2f737ece325c44c58194725a82923014 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8
I20260709 12:28:00.157276 18017 raft_consensus.cc:2749] T 2f737ece325c44c58194725a82923014 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:00.227800 18017 raft_consensus.cc:493] T 442e0dfc272840f7a14c2232ed65425c P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3c1aba6ee1d244fd9c0daba722aa0b3b)
I20260709 12:28:00.228487 18017 raft_consensus.cc:515] T 442e0dfc272840f7a14c2232ed65425c P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:28:00.230599 18017 leader_election.cc:290] T 442e0dfc272840f7a14c2232ed65425c P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
W20260709 12:28:00.234759 16908 leader_election.cc:336] T 442e0dfc272840f7a14c2232ed65425c P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111)
W20260709 12:28:00.237154 16907 leader_election.cc:336] T 442e0dfc272840f7a14c2232ed65425c P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:28:00.237569 16907 leader_election.cc:304] T 442e0dfc272840f7a14c2232ed65425c P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8
I20260709 12:28:00.238411 18017 raft_consensus.cc:2749] T 442e0dfc272840f7a14c2232ed65425c P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:00.239281 18024 raft_consensus.cc:493] T 6e43addba09b4930a12c94e691b2c76f P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3c1aba6ee1d244fd9c0daba722aa0b3b)
I20260709 12:28:00.240037 18024 raft_consensus.cc:515] T 6e43addba09b4930a12c94e691b2c76f P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:28:00.242976 18024 leader_election.cc:290] T 6e43addba09b4930a12c94e691b2c76f P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
W20260709 12:28:00.246479 16908 leader_election.cc:336] T 6e43addba09b4930a12c94e691b2c76f P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111)
W20260709 12:28:00.250080 16907 leader_election.cc:336] T 6e43addba09b4930a12c94e691b2c76f P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Network error: Client connection negotiation failed: client connection to 127.9.116.67:38103: connect: Connection refused (error 111)
I20260709 12:28:00.250514 16907 leader_election.cc:304] T 6e43addba09b4930a12c94e691b2c76f P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 17294485b7f24e2b9fae71dd3169a336, 3c1aba6ee1d244fd9c0daba722aa0b3b
I20260709 12:28:00.251117 18024 raft_consensus.cc:2749] T 6e43addba09b4930a12c94e691b2c76f P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:28:00.251375 16907 consensus_peers.cc:597] T b86527b8a77848629c50a32e2534f7ba P 82f27bcdf252425aad4c4a37d064f68d -> Peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Couldn't send request to peer 17294485b7f24e2b9fae71dd3169a336. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.67:38103: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:00.272434 16907 consensus_peers.cc:597] T cfc80a8e57c24a768ebc48dd544a6c80 P 82f27bcdf252425aad4c4a37d064f68d -> Peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Couldn't send request to peer 17294485b7f24e2b9fae71dd3169a336. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.67:38103: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:00.274963 16907 consensus_peers.cc:597] T f29cf6eb18e842c3a5aa62d8fae53279 P 82f27bcdf252425aad4c4a37d064f68d -> Peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Couldn't send request to peer 17294485b7f24e2b9fae71dd3169a336. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.67:38103: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:00.309176 18024 raft_consensus.cc:493] T a0409dc146674a39a9ceeeeebc081453 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3c1aba6ee1d244fd9c0daba722aa0b3b)
W20260709 12:28:00.310084 16907 consensus_peers.cc:597] T 29fcc4f156a54ca4b54a4a11e2cee973 P 82f27bcdf252425aad4c4a37d064f68d -> Peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Couldn't send request to peer 17294485b7f24e2b9fae71dd3169a336. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.67:38103: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:00.310073 18024 raft_consensus.cc:515] T a0409dc146674a39a9ceeeeebc081453 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:28:00.313021 18024 leader_election.cc:290] T a0409dc146674a39a9ceeeeebc081453 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
W20260709 12:28:00.317646 16908 leader_election.cc:336] T a0409dc146674a39a9ceeeeebc081453 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111)
W20260709 12:28:00.319150 16907 leader_election.cc:336] T a0409dc146674a39a9ceeeeebc081453 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:28:00.319792 16907 leader_election.cc:304] T a0409dc146674a39a9ceeeeebc081453 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8
I20260709 12:28:00.321082 18024 raft_consensus.cc:2749] T a0409dc146674a39a9ceeeeebc081453 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:00.383453 18024 raft_consensus.cc:493] T 30a37807dd6548adb6e16f8a4d2e5774 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3c1aba6ee1d244fd9c0daba722aa0b3b)
I20260709 12:28:00.384111 18024 raft_consensus.cc:515] T 30a37807dd6548adb6e16f8a4d2e5774 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:28:00.386579 18024 leader_election.cc:290] T 30a37807dd6548adb6e16f8a4d2e5774 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
W20260709 12:28:00.390538 16907 leader_election.cc:336] T 30a37807dd6548adb6e16f8a4d2e5774 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Network error: Client connection negotiation failed: client connection to 127.9.116.67:38103: connect: Connection refused (error 111)
W20260709 12:28:00.391654 16908 leader_election.cc:336] T 30a37807dd6548adb6e16f8a4d2e5774 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111)
I20260709 12:28:00.392030 16908 leader_election.cc:304] T 30a37807dd6548adb6e16f8a4d2e5774 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 17294485b7f24e2b9fae71dd3169a336, 3c1aba6ee1d244fd9c0daba722aa0b3b
I20260709 12:28:00.392653 18024 raft_consensus.cc:2749] T 30a37807dd6548adb6e16f8a4d2e5774 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:00.438773 18024 raft_consensus.cc:493] T 6916ee6a900c46508c98006aa85fe2d9 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3c1aba6ee1d244fd9c0daba722aa0b3b)
I20260709 12:28:00.439285 18024 raft_consensus.cc:515] T 6916ee6a900c46508c98006aa85fe2d9 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:28:00.441001 18024 leader_election.cc:290] T 6916ee6a900c46508c98006aa85fe2d9 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
W20260709 12:28:00.445703 16907 leader_election.cc:336] T 6916ee6a900c46508c98006aa85fe2d9 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
W20260709 12:28:00.446244 16908 leader_election.cc:336] T 6916ee6a900c46508c98006aa85fe2d9 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111)
I20260709 12:28:00.446650 16908 leader_election.cc:304] T 6916ee6a900c46508c98006aa85fe2d9 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8
I20260709 12:28:00.447454 18024 raft_consensus.cc:2749] T 6916ee6a900c46508c98006aa85fe2d9 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:00.552795 18024 raft_consensus.cc:493] T f5345dc6d3b946e0bb9220acf126cf59 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17294485b7f24e2b9fae71dd3169a336)
I20260709 12:28:00.553763 18024 raft_consensus.cc:515] T f5345dc6d3b946e0bb9220acf126cf59 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:28:00.557641 18024 leader_election.cc:290] T f5345dc6d3b946e0bb9220acf126cf59 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
W20260709 12:28:00.565606 16908 leader_election.cc:336] T f5345dc6d3b946e0bb9220acf126cf59 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111)
W20260709 12:28:00.566381 16907 leader_election.cc:336] T f5345dc6d3b946e0bb9220acf126cf59 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Network error: Client connection negotiation failed: client connection to 127.9.116.67:38103: connect: Connection refused (error 111)
I20260709 12:28:00.566746 16907 leader_election.cc:304] T f5345dc6d3b946e0bb9220acf126cf59 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 17294485b7f24e2b9fae71dd3169a336, 3c1aba6ee1d244fd9c0daba722aa0b3b
I20260709 12:28:00.567601 18025 raft_consensus.cc:2749] T f5345dc6d3b946e0bb9220acf126cf59 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:00.580240 18025 raft_consensus.cc:493] T b10d5b4017584d0fb22f9e542d95fcb1 P 82f27bcdf252425aad4c4a37d064f68d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:00.580884 18025 raft_consensus.cc:515] T b10d5b4017584d0fb22f9e542d95fcb1 P 82f27bcdf252425aad4c4a37d064f68d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:28:00.583227 18025 leader_election.cc:290] T b10d5b4017584d0fb22f9e542d95fcb1 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:28:00.586258 18025 raft_consensus.cc:493] T 27dda31a8cd1468eb3a824ae026485a3 P 82f27bcdf252425aad4c4a37d064f68d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 17294485b7f24e2b9fae71dd3169a336)
I20260709 12:28:00.586874 18025 raft_consensus.cc:515] T 27dda31a8cd1468eb3a824ae026485a3 P 82f27bcdf252425aad4c4a37d064f68d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
W20260709 12:28:00.589166 16907 leader_election.cc:336] T b10d5b4017584d0fb22f9e542d95fcb1 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Network error: Client connection negotiation failed: client connection to 127.9.116.67:38103: connect: Connection refused (error 111)
I20260709 12:28:00.589207 18025 leader_election.cc:290] T 27dda31a8cd1468eb3a824ae026485a3 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
W20260709 12:28:00.590185 16907 leader_election.cc:336] T b10d5b4017584d0fb22f9e542d95fcb1 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:28:00.590538 16907 leader_election.cc:304] T b10d5b4017584d0fb22f9e542d95fcb1 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8
I20260709 12:28:00.591307 18025 raft_consensus.cc:2749] T b10d5b4017584d0fb22f9e542d95fcb1 P 82f27bcdf252425aad4c4a37d064f68d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:28:00.594280 16907 leader_election.cc:336] T 27dda31a8cd1468eb3a824ae026485a3 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
W20260709 12:28:00.596796 16907 leader_election.cc:336] T 27dda31a8cd1468eb3a824ae026485a3 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Network error: Client connection negotiation failed: client connection to 127.9.116.67:38103: connect: Connection refused (error 111)
I20260709 12:28:00.597239 16907 leader_election.cc:304] T 27dda31a8cd1468eb3a824ae026485a3 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8
I20260709 12:28:00.598125 18025 raft_consensus.cc:2749] T 27dda31a8cd1468eb3a824ae026485a3 P 82f27bcdf252425aad4c4a37d064f68d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:00.612444 18025 raft_consensus.cc:493] T 514ee26ff21e4c08976b6a0397b730fe P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17294485b7f24e2b9fae71dd3169a336)
I20260709 12:28:00.613169 18025 raft_consensus.cc:515] T 514ee26ff21e4c08976b6a0397b730fe P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:28:00.616329 18025 leader_election.cc:290] T 514ee26ff21e4c08976b6a0397b730fe P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
W20260709 12:28:00.622517 16907 leader_election.cc:336] T 514ee26ff21e4c08976b6a0397b730fe P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
W20260709 12:28:00.623342 16907 leader_election.cc:336] T 514ee26ff21e4c08976b6a0397b730fe P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Network error: Client connection negotiation failed: client connection to 127.9.116.67:38103: connect: Connection refused (error 111)
I20260709 12:28:00.624068 16907 leader_election.cc:304] T 514ee26ff21e4c08976b6a0397b730fe P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8
I20260709 12:28:00.624763 18024 raft_consensus.cc:2749] T 514ee26ff21e4c08976b6a0397b730fe P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:00.660053 18025 raft_consensus.cc:493] T 28c655b68dc545948c67e0977b49e770 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17294485b7f24e2b9fae71dd3169a336)
I20260709 12:28:00.660663 18025 raft_consensus.cc:515] T 28c655b68dc545948c67e0977b49e770 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:28:00.662999 18025 leader_election.cc:290] T 28c655b68dc545948c67e0977b49e770 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
W20260709 12:28:00.668877 16907 leader_election.cc:336] T 28c655b68dc545948c67e0977b49e770 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Network error: Client connection negotiation failed: client connection to 127.9.116.67:38103: connect: Connection refused (error 111)
W20260709 12:28:00.669657 16907 leader_election.cc:336] T 28c655b68dc545948c67e0977b49e770 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:28:00.670042 16907 leader_election.cc:304] T 28c655b68dc545948c67e0977b49e770 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8
I20260709 12:28:00.670814 18025 raft_consensus.cc:2749] T 28c655b68dc545948c67e0977b49e770 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:28:00.784461  9681 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 16889)
I20260709 12:28:00.835323 18024 raft_consensus.cc:493] T 60a8110f7e424463ae56af0646bf4434 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17294485b7f24e2b9fae71dd3169a336)
I20260709 12:28:00.836362 18024 raft_consensus.cc:515] T 60a8110f7e424463ae56af0646bf4434 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:28:00.839087 18024 leader_election.cc:290] T 60a8110f7e424463ae56af0646bf4434 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
W20260709 12:28:00.845285 16907 leader_election.cc:336] T 60a8110f7e424463ae56af0646bf4434 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Network error: Client connection negotiation failed: client connection to 127.9.116.67:38103: connect: Connection refused (error 111)
W20260709 12:28:00.845818 16908 leader_election.cc:336] T 60a8110f7e424463ae56af0646bf4434 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111)
I20260709 12:28:00.846310 16908 leader_election.cc:304] T 60a8110f7e424463ae56af0646bf4434 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 17294485b7f24e2b9fae71dd3169a336, 3c1aba6ee1d244fd9c0daba722aa0b3b
I20260709 12:28:00.847261 18024 raft_consensus.cc:2749] T 60a8110f7e424463ae56af0646bf4434 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:00.884929 18024 raft_consensus.cc:493] T 288d05b8017c4e0f8cd40048647aecae P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17294485b7f24e2b9fae71dd3169a336)
I20260709 12:28:00.885421 18024 raft_consensus.cc:515] T 288d05b8017c4e0f8cd40048647aecae P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:28:00.887176 18024 leader_election.cc:290] T 288d05b8017c4e0f8cd40048647aecae P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
W20260709 12:28:00.892643 16907 leader_election.cc:336] T 288d05b8017c4e0f8cd40048647aecae P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Network error: Client connection negotiation failed: client connection to 127.9.116.67:38103: connect: Connection refused (error 111)
W20260709 12:28:00.893428 16907 leader_election.cc:336] T 288d05b8017c4e0f8cd40048647aecae P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:28:00.893821 16907 leader_election.cc:304] T 288d05b8017c4e0f8cd40048647aecae P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8
I20260709 12:28:00.894593 18024 raft_consensus.cc:2749] T 288d05b8017c4e0f8cd40048647aecae P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:28:00.985494 16907 consensus_peers.cc:597] T b777ccb9937a476590a534fea0428c5c P 82f27bcdf252425aad4c4a37d064f68d -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:28:01.090649 18024 raft_consensus.cc:493] T 7562feb416f84f0b948343356153d8d2 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17294485b7f24e2b9fae71dd3169a336)
I20260709 12:28:01.091377 18024 raft_consensus.cc:515] T 7562feb416f84f0b948343356153d8d2 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:28:01.094089 18024 leader_election.cc:290] T 7562feb416f84f0b948343356153d8d2 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
W20260709 12:28:01.102144 16907 leader_election.cc:336] T 7562feb416f84f0b948343356153d8d2 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Network error: Client connection negotiation failed: client connection to 127.9.116.67:38103: connect: Connection refused (error 111)
W20260709 12:28:01.102996 16907 leader_election.cc:336] T 7562feb416f84f0b948343356153d8d2 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:28:01.103354 16907 leader_election.cc:304] T 7562feb416f84f0b948343356153d8d2 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8
I20260709 12:28:01.104183 18024 raft_consensus.cc:2749] T 7562feb416f84f0b948343356153d8d2 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:01.113493 18024 raft_consensus.cc:493] T 27f104a1ba60493ab47f6b876da48d67 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17294485b7f24e2b9fae71dd3169a336)
I20260709 12:28:01.114261 18024 raft_consensus.cc:515] T 27f104a1ba60493ab47f6b876da48d67 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:28:01.117112 18024 leader_election.cc:290] T 27f104a1ba60493ab47f6b876da48d67 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
W20260709 12:28:01.121944 16907 leader_election.cc:336] T 27f104a1ba60493ab47f6b876da48d67 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Network error: Client connection negotiation failed: client connection to 127.9.116.67:38103: connect: Connection refused (error 111)
W20260709 12:28:01.122779 16907 leader_election.cc:336] T 27f104a1ba60493ab47f6b876da48d67 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:28:01.123317 16907 leader_election.cc:304] T 27f104a1ba60493ab47f6b876da48d67 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8
I20260709 12:28:01.124431 18025 raft_consensus.cc:2749] T 27f104a1ba60493ab47f6b876da48d67 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:01.125835 18025 raft_consensus.cc:493] T 98a96f910b4449f7ba9c875e45090080 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17294485b7f24e2b9fae71dd3169a336)
I20260709 12:28:01.126335 18025 raft_consensus.cc:515] T 98a96f910b4449f7ba9c875e45090080 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:28:01.128360 18025 leader_election.cc:290] T 98a96f910b4449f7ba9c875e45090080 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
W20260709 12:28:01.132220 16907 leader_election.cc:336] T 98a96f910b4449f7ba9c875e45090080 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Network error: Client connection negotiation failed: client connection to 127.9.116.67:38103: connect: Connection refused (error 111)
W20260709 12:28:01.133441 16907 leader_election.cc:336] T 98a96f910b4449f7ba9c875e45090080 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:28:01.133910 16907 leader_election.cc:304] T 98a96f910b4449f7ba9c875e45090080 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8
I20260709 12:28:01.135332 18024 raft_consensus.cc:2749] T 98a96f910b4449f7ba9c875e45090080 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:28:01.211225 16907 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.116.67:38103: connect: Connection refused (error 111) [suppressed 455 similar messages]
W20260709 12:28:01.218624 16907 consensus_peers.cc:597] T 51ebab30b5104589803b75a1b48c5aa2 P 82f27bcdf252425aad4c4a37d064f68d -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:01.427929 16907 consensus_peers.cc:597] T fbafe39b79894737b395f95013bc6c86 P 82f27bcdf252425aad4c4a37d064f68d -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:01.507258 16907 consensus_peers.cc:597] T b86527b8a77848629c50a32e2534f7ba P 82f27bcdf252425aad4c4a37d064f68d -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:28:01.536075 18025 raft_consensus.cc:493] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:28:01.536873 18025 raft_consensus.cc:515] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:28:01.539768 18025 leader_election.cc:290] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
W20260709 12:28:01.547035 16907 leader_election.cc:336] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Network error: Client connection negotiation failed: client connection to 127.9.116.67:38103: connect: Connection refused (error 111)
W20260709 12:28:01.547847 16907 leader_election.cc:336] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:28:01.548202 16907 leader_election.cc:304] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8
I20260709 12:28:01.548902 18027 raft_consensus.cc:2749] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:28:01.587369 16908 consensus_peers.cc:597] T f39dd87ef56a40e2bf56704b2815a619 P 82f27bcdf252425aad4c4a37d064f68d -> Peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Couldn't send request to peer 3c1aba6ee1d244fd9c0daba722aa0b3b. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:01.627851 16907 consensus_peers.cc:597] T ea5085716661498e9f3bfdfa2fc5737a P 82f27bcdf252425aad4c4a37d064f68d -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:01.638449 16908 consensus_peers.cc:597] T fd1494eb0dd14dab9a2e4c07812117c2 P 82f27bcdf252425aad4c4a37d064f68d -> Peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Couldn't send request to peer 3c1aba6ee1d244fd9c0daba722aa0b3b. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:28:01.678867 18025 raft_consensus.cc:493] T 5868b3bc1ee44923a18d74874a8f3b30 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3c1aba6ee1d244fd9c0daba722aa0b3b)
I20260709 12:28:01.679538 18025 raft_consensus.cc:515] T 5868b3bc1ee44923a18d74874a8f3b30 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:28:01.681706 18025 leader_election.cc:290] T 5868b3bc1ee44923a18d74874a8f3b30 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
W20260709 12:28:01.685552 16908 leader_election.cc:336] T 5868b3bc1ee44923a18d74874a8f3b30 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111)
W20260709 12:28:01.686599 16907 leader_election.cc:336] T 5868b3bc1ee44923a18d74874a8f3b30 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Network error: Client connection negotiation failed: client connection to 127.9.116.67:38103: connect: Connection refused (error 111)
I20260709 12:28:01.686975 16907 leader_election.cc:304] T 5868b3bc1ee44923a18d74874a8f3b30 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 17294485b7f24e2b9fae71dd3169a336, 3c1aba6ee1d244fd9c0daba722aa0b3b
I20260709 12:28:01.687614 18025 raft_consensus.cc:2749] T 5868b3bc1ee44923a18d74874a8f3b30 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:28:01.702337 16908 consensus_peers.cc:597] T fbafe39b79894737b395f95013bc6c86 P 82f27bcdf252425aad4c4a37d064f68d -> Peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Couldn't send request to peer 3c1aba6ee1d244fd9c0daba722aa0b3b. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:01.725297 16907 consensus_peers.cc:597] T 00e5268529b241f184c460704ab9ed3c P 82f27bcdf252425aad4c4a37d064f68d -> Peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Couldn't send request to peer 879366e90f5c420588945e0d545017c8. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:01.785008  9681 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 16889)
I20260709 12:28:01.799469 18025 raft_consensus.cc:493] T 6a86fc21ef0044bb91dd271c9a019336 P 82f27bcdf252425aad4c4a37d064f68d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:28:01.800547 18025 raft_consensus.cc:515] T 6a86fc21ef0044bb91dd271c9a019336 P 82f27bcdf252425aad4c4a37d064f68d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:28:01.802619 18025 leader_election.cc:290] T 6a86fc21ef0044bb91dd271c9a019336 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
W20260709 12:28:01.807725 16907 leader_election.cc:336] T 6a86fc21ef0044bb91dd271c9a019336 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
W20260709 12:28:01.808413 16908 leader_election.cc:336] T 6a86fc21ef0044bb91dd271c9a019336 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111)
I20260709 12:28:01.808902 16908 leader_election.cc:304] T 6a86fc21ef0044bb91dd271c9a019336 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8
I20260709 12:28:01.809609 18025 raft_consensus.cc:2749] T 6a86fc21ef0044bb91dd271c9a019336 P 82f27bcdf252425aad4c4a37d064f68d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:28:01.857781 16908 consensus_peers.cc:597] T 29fcc4f156a54ca4b54a4a11e2cee973 P 82f27bcdf252425aad4c4a37d064f68d -> Peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Couldn't send request to peer 3c1aba6ee1d244fd9c0daba722aa0b3b. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:28:01.885126 18025 raft_consensus.cc:493] T 223b3745452c412581caf058f6b81fe2 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:28:01.885849 18025 raft_consensus.cc:515] T 223b3745452c412581caf058f6b81fe2 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:28:01.888429 18025 leader_election.cc:290] T 223b3745452c412581caf058f6b81fe2 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
W20260709 12:28:01.892730 16908 leader_election.cc:336] T 223b3745452c412581caf058f6b81fe2 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111)
W20260709 12:28:01.893458 16907 leader_election.cc:336] T 223b3745452c412581caf058f6b81fe2 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:28:01.893960 18025 raft_consensus.cc:493] T 3e78004b8cc14ac6b93c857cbdd63329 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:28:01.894071 16907 leader_election.cc:304] T 223b3745452c412581caf058f6b81fe2 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8
I20260709 12:28:01.894511 18025 raft_consensus.cc:515] T 3e78004b8cc14ac6b93c857cbdd63329 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:28:01.895442 18027 raft_consensus.cc:2749] T 223b3745452c412581caf058f6b81fe2 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:01.897110 18025 leader_election.cc:290] T 3e78004b8cc14ac6b93c857cbdd63329 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
W20260709 12:28:01.905927 16907 leader_election.cc:336] T 3e78004b8cc14ac6b93c857cbdd63329 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Network error: Client connection negotiation failed: client connection to 127.9.116.67:38103: connect: Connection refused (error 111)
W20260709 12:28:01.907110 16907 leader_election.cc:336] T 3e78004b8cc14ac6b93c857cbdd63329 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:28:01.907691 16907 leader_election.cc:304] T 3e78004b8cc14ac6b93c857cbdd63329 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8
I20260709 12:28:01.908674 18025 raft_consensus.cc:2749] T 3e78004b8cc14ac6b93c857cbdd63329 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:28:01.918011 16908 consensus_peers.cc:597] T 51d96c645e894c8597652daf12a21cf3 P 82f27bcdf252425aad4c4a37d064f68d -> Peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Couldn't send request to peer 3c1aba6ee1d244fd9c0daba722aa0b3b. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:28:01.927763 18025 raft_consensus.cc:493] T 3649e7bb023a4958a01ad5ecbe446f0f P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:28:01.928422 18025 raft_consensus.cc:515] T 3649e7bb023a4958a01ad5ecbe446f0f P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:28:01.930531 18025 leader_election.cc:290] T 3649e7bb023a4958a01ad5ecbe446f0f P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
W20260709 12:28:01.935335 16907 leader_election.cc:336] T 3649e7bb023a4958a01ad5ecbe446f0f P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Network error: Client connection negotiation failed: client connection to 127.9.116.67:38103: connect: Connection refused (error 111)
W20260709 12:28:01.936506 16907 leader_election.cc:336] T 3649e7bb023a4958a01ad5ecbe446f0f P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:28:01.937170 16907 leader_election.cc:304] T 3649e7bb023a4958a01ad5ecbe446f0f P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8
I20260709 12:28:01.938344 18025 raft_consensus.cc:2749] T 3649e7bb023a4958a01ad5ecbe446f0f P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:28:01.984329 16908 consensus_peers.cc:597] T de72d440fa1641a39aee027ffc0588a3 P 82f27bcdf252425aad4c4a37d064f68d -> Peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Couldn't send request to peer 3c1aba6ee1d244fd9c0daba722aa0b3b. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:28:01.991375 18025 raft_consensus.cc:493] T 3d614e06fd2c40189161e22ad9217e5d P 82f27bcdf252425aad4c4a37d064f68d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 879366e90f5c420588945e0d545017c8)
I20260709 12:28:01.992074 18025 raft_consensus.cc:515] T 3d614e06fd2c40189161e22ad9217e5d P 82f27bcdf252425aad4c4a37d064f68d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:28:01.995110 18025 leader_election.cc:290] T 3d614e06fd2c40189161e22ad9217e5d P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
W20260709 12:28:02.004351 16907 leader_election.cc:336] T 3d614e06fd2c40189161e22ad9217e5d P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
W20260709 12:28:02.005482 16907 leader_election.cc:336] T 3d614e06fd2c40189161e22ad9217e5d P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Network error: Client connection negotiation failed: client connection to 127.9.116.67:38103: connect: Connection refused (error 111)
I20260709 12:28:02.005966 16907 leader_election.cc:304] T 3d614e06fd2c40189161e22ad9217e5d P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8
I20260709 12:28:02.006846 18025 raft_consensus.cc:2749] T 3d614e06fd2c40189161e22ad9217e5d P 82f27bcdf252425aad4c4a37d064f68d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:02.038494 18025 raft_consensus.cc:493] T 62e4e875fd4e4604952120df324e99cb P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3c1aba6ee1d244fd9c0daba722aa0b3b)
I20260709 12:28:02.040042 18025 raft_consensus.cc:515] T 62e4e875fd4e4604952120df324e99cb P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:28:02.047115 18025 leader_election.cc:290] T 62e4e875fd4e4604952120df324e99cb P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
W20260709 12:28:02.053194 16908 leader_election.cc:336] T 62e4e875fd4e4604952120df324e99cb P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111)
W20260709 12:28:02.054291 16907 leader_election.cc:336] T 62e4e875fd4e4604952120df324e99cb P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:28:02.055263 16907 leader_election.cc:304] T 62e4e875fd4e4604952120df324e99cb P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8
I20260709 12:28:02.057303 18025 raft_consensus.cc:2749] T 62e4e875fd4e4604952120df324e99cb P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:28:02.136142 16908 consensus_peers.cc:597] T c220555f395e46d4be83f2b16f9691ef P 82f27bcdf252425aad4c4a37d064f68d -> Peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Couldn't send request to peer 3c1aba6ee1d244fd9c0daba722aa0b3b. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:02.190114 16907 consensus_peers.cc:597] T de72d440fa1641a39aee027ffc0588a3 P 82f27bcdf252425aad4c4a37d064f68d -> Peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Couldn't send request to peer 17294485b7f24e2b9fae71dd3169a336. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.67:38103: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:02.210031 16908 consensus_peers.cc:597] T cfc80a8e57c24a768ebc48dd544a6c80 P 82f27bcdf252425aad4c4a37d064f68d -> Peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Couldn't send request to peer 3c1aba6ee1d244fd9c0daba722aa0b3b. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:02.210945 16908 consensus_peers.cc:597] T f29cf6eb18e842c3a5aa62d8fae53279 P 82f27bcdf252425aad4c4a37d064f68d -> Peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Couldn't send request to peer 3c1aba6ee1d244fd9c0daba722aa0b3b. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:02.214524 16908 consensus_peers.cc:597] T ea5085716661498e9f3bfdfa2fc5737a P 82f27bcdf252425aad4c4a37d064f68d -> Peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Couldn't send request to peer 3c1aba6ee1d244fd9c0daba722aa0b3b. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:28:02.230206 18027 raft_consensus.cc:493] T 2f737ece325c44c58194725a82923014 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3c1aba6ee1d244fd9c0daba722aa0b3b)
W20260709 12:28:02.231608 16908 consensus_peers.cc:597] T 00e5268529b241f184c460704ab9ed3c P 82f27bcdf252425aad4c4a37d064f68d -> Peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Couldn't send request to peer 3c1aba6ee1d244fd9c0daba722aa0b3b. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:28:02.231348 18027 raft_consensus.cc:515] T 2f737ece325c44c58194725a82923014 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:28:02.235077 18027 leader_election.cc:290] T 2f737ece325c44c58194725a82923014 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
W20260709 12:28:02.239526 16908 leader_election.cc:336] T 2f737ece325c44c58194725a82923014 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111)
W20260709 12:28:02.240293 16907 leader_election.cc:336] T 2f737ece325c44c58194725a82923014 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:28:02.240756 16907 leader_election.cc:304] T 2f737ece325c44c58194725a82923014 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8
I20260709 12:28:02.241490 18027 raft_consensus.cc:2749] T 2f737ece325c44c58194725a82923014 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:28:02.276226 16908 consensus_peers.cc:597] T aee6b58df96f401f88392d39eba8ffbf P 82f27bcdf252425aad4c4a37d064f68d -> Peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Couldn't send request to peer 3c1aba6ee1d244fd9c0daba722aa0b3b. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:02.311069 16907 consensus_peers.cc:597] T aee6b58df96f401f88392d39eba8ffbf P 82f27bcdf252425aad4c4a37d064f68d -> Peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Couldn't send request to peer 17294485b7f24e2b9fae71dd3169a336. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.67:38103: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:02.318485 16907 consensus_peers.cc:597] T fd1494eb0dd14dab9a2e4c07812117c2 P 82f27bcdf252425aad4c4a37d064f68d -> Peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Couldn't send request to peer 17294485b7f24e2b9fae71dd3169a336. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.67:38103: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:28:02.338876 18027 raft_consensus.cc:493] T 6916ee6a900c46508c98006aa85fe2d9 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3c1aba6ee1d244fd9c0daba722aa0b3b)
I20260709 12:28:02.339964 18027 raft_consensus.cc:515] T 6916ee6a900c46508c98006aa85fe2d9 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
W20260709 12:28:02.344448 16907 consensus_peers.cc:597] T b777ccb9937a476590a534fea0428c5c P 82f27bcdf252425aad4c4a37d064f68d -> Peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Couldn't send request to peer 17294485b7f24e2b9fae71dd3169a336. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.67:38103: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:28:02.345643 18027 leader_election.cc:290] T 6916ee6a900c46508c98006aa85fe2d9 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
W20260709 12:28:02.349116 16908 leader_election.cc:336] T 6916ee6a900c46508c98006aa85fe2d9 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111)
W20260709 12:28:02.349786 16907 leader_election.cc:336] T 6916ee6a900c46508c98006aa85fe2d9 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:28:02.350243 16907 leader_election.cc:304] T 6916ee6a900c46508c98006aa85fe2d9 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8
I20260709 12:28:02.351095 18027 raft_consensus.cc:2749] T 6916ee6a900c46508c98006aa85fe2d9 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:28:02.370272 16907 consensus_peers.cc:597] T 51ebab30b5104589803b75a1b48c5aa2 P 82f27bcdf252425aad4c4a37d064f68d -> Peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Couldn't send request to peer 17294485b7f24e2b9fae71dd3169a336. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.67:38103: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:28:02.467900  9681 tablet_server.cc:196] TabletServer@127.9.116.67:0 shutdown complete.
I20260709 12:28:02.520015 18027 raft_consensus.cc:493] T f5345dc6d3b946e0bb9220acf126cf59 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17294485b7f24e2b9fae71dd3169a336)
I20260709 12:28:02.520906 18027 raft_consensus.cc:515] T f5345dc6d3b946e0bb9220acf126cf59 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
W20260709 12:28:02.522332 16907 consensus_peers.cc:597] T c220555f395e46d4be83f2b16f9691ef P 82f27bcdf252425aad4c4a37d064f68d -> Peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Couldn't send request to peer 17294485b7f24e2b9fae71dd3169a336. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.67:38103: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:28:02.523852 18027 leader_election.cc:290] T f5345dc6d3b946e0bb9220acf126cf59 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
W20260709 12:28:02.529621 16907 leader_election.cc:336] T f5345dc6d3b946e0bb9220acf126cf59 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Network error: Client connection negotiation failed: client connection to 127.9.116.67:38103: connect: Connection refused (error 111)
W20260709 12:28:02.530225 16908 leader_election.cc:336] T f5345dc6d3b946e0bb9220acf126cf59 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111)
I20260709 12:28:02.530675 16908 leader_election.cc:304] T f5345dc6d3b946e0bb9220acf126cf59 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 17294485b7f24e2b9fae71dd3169a336, 3c1aba6ee1d244fd9c0daba722aa0b3b
I20260709 12:28:02.531409 18027 raft_consensus.cc:2749] T f5345dc6d3b946e0bb9220acf126cf59 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:28:02.543421 16907 consensus_peers.cc:597] T f39dd87ef56a40e2bf56704b2815a619 P 82f27bcdf252425aad4c4a37d064f68d -> Peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Couldn't send request to peer 17294485b7f24e2b9fae71dd3169a336. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.67:38103: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:28:02.629793  9681 tablet_server.cc:179] TabletServer@127.9.116.68:0 shutting down...
W20260709 12:28:02.672678 16907 consensus_peers.cc:597] T b86527b8a77848629c50a32e2534f7ba P 82f27bcdf252425aad4c4a37d064f68d -> Peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Couldn't send request to peer 17294485b7f24e2b9fae71dd3169a336. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.67:38103: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:02.677206 16907 consensus_peers.cc:597] T 51d96c645e894c8597652daf12a21cf3 P 82f27bcdf252425aad4c4a37d064f68d -> Peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Couldn't send request to peer 17294485b7f24e2b9fae71dd3169a336. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.67:38103: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:28:02.681820 18029 raft_consensus.cc:493] T 7b90200ef21f42f1929fbf0051ef5b3e P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3c1aba6ee1d244fd9c0daba722aa0b3b)
I20260709 12:28:02.682655 18029 raft_consensus.cc:515] T 7b90200ef21f42f1929fbf0051ef5b3e P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:28:02.686450 18029 leader_election.cc:290] T 7b90200ef21f42f1929fbf0051ef5b3e P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
W20260709 12:28:02.690649 16907 leader_election.cc:336] T 7b90200ef21f42f1929fbf0051ef5b3e P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
W20260709 12:28:02.691972 16908 leader_election.cc:336] T 7b90200ef21f42f1929fbf0051ef5b3e P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111)
I20260709 12:28:02.692585 16908 leader_election.cc:304] T 7b90200ef21f42f1929fbf0051ef5b3e P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8
I20260709 12:28:02.693544 18029 raft_consensus.cc:2749] T 7b90200ef21f42f1929fbf0051ef5b3e P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:02.703779  9681 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:28:02.705037  9681 tablet_replica.cc:333] T a8a632c738e94b26a8352a68a42a0670 P 82f27bcdf252425aad4c4a37d064f68d: stopping tablet replica
I20260709 12:28:02.704190 18029 raft_consensus.cc:493] T 8eaf179090b14105b52c4701d5599216 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3c1aba6ee1d244fd9c0daba722aa0b3b)
I20260709 12:28:02.705932 18029 raft_consensus.cc:515] T 8eaf179090b14105b52c4701d5599216 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } } peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } }
I20260709 12:28:02.707028  9681 raft_consensus.cc:2243] T a8a632c738e94b26a8352a68a42a0670 P 82f27bcdf252425aad4c4a37d064f68d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:02.708083  9681 raft_consensus.cc:2272] T a8a632c738e94b26a8352a68a42a0670 P 82f27bcdf252425aad4c4a37d064f68d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.709151 18029 leader_election.cc:290] T 8eaf179090b14105b52c4701d5599216 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833), 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629)
I20260709 12:28:02.712574  9681 tablet_replica.cc:333] T 8eaf179090b14105b52c4701d5599216 P 82f27bcdf252425aad4c4a37d064f68d: stopping tablet replica
W20260709 12:28:02.713414 16907 leader_election.cc:336] T 8eaf179090b14105b52c4701d5599216 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:28:02.713989  9681 raft_consensus.cc:2243] T 8eaf179090b14105b52c4701d5599216 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:28:02.713992 16908 leader_election.cc:336] T 8eaf179090b14105b52c4701d5599216 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111)
I20260709 12:28:02.714573 16908 leader_election.cc:304] T 8eaf179090b14105b52c4701d5599216 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 3c1aba6ee1d244fd9c0daba722aa0b3b, 879366e90f5c420588945e0d545017c8
I20260709 12:28:02.714860  9681 raft_consensus.cc:2272] T 8eaf179090b14105b52c4701d5599216 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.718099  9681 tablet_replica.cc:333] T 3d614e06fd2c40189161e22ad9217e5d P 82f27bcdf252425aad4c4a37d064f68d: stopping tablet replica
I20260709 12:28:02.718999  9681 raft_consensus.cc:2243] T 3d614e06fd2c40189161e22ad9217e5d P 82f27bcdf252425aad4c4a37d064f68d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:02.719784  9681 raft_consensus.cc:2272] T 3d614e06fd2c40189161e22ad9217e5d P 82f27bcdf252425aad4c4a37d064f68d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.722780  9681 tablet_replica.cc:333] T f39dd87ef56a40e2bf56704b2815a619 P 82f27bcdf252425aad4c4a37d064f68d: stopping tablet replica
I20260709 12:28:02.723968  9681 raft_consensus.cc:2243] T f39dd87ef56a40e2bf56704b2815a619 P 82f27bcdf252425aad4c4a37d064f68d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:02.725421  9681 raft_consensus.cc:2272] T f39dd87ef56a40e2bf56704b2815a619 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.728786 18027 raft_consensus.cc:493] T b10d5b4017584d0fb22f9e542d95fcb1 P 82f27bcdf252425aad4c4a37d064f68d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:02.729105  9681 tablet_replica.cc:333] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 82f27bcdf252425aad4c4a37d064f68d: stopping tablet replica
I20260709 12:28:02.729444 18027 raft_consensus.cc:515] T b10d5b4017584d0fb22f9e542d95fcb1 P 82f27bcdf252425aad4c4a37d064f68d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:28:02.730136  9681 raft_consensus.cc:2243] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:02.731045  9681 raft_consensus.cc:2272] T 6a1e8d1852ae457db7e3be5b6957f1b3 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.732285 18027 leader_election.cc:290] T b10d5b4017584d0fb22f9e542d95fcb1 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:28:02.734951  9681 tablet_replica.cc:333] T f29cf6eb18e842c3a5aa62d8fae53279 P 82f27bcdf252425aad4c4a37d064f68d: stopping tablet replica
I20260709 12:28:02.736207  9681 raft_consensus.cc:2243] T f29cf6eb18e842c3a5aa62d8fae53279 P 82f27bcdf252425aad4c4a37d064f68d [term 3 LEADER]: Raft consensus shutting down.
W20260709 12:28:02.738778 16907 leader_election.cc:336] T b10d5b4017584d0fb22f9e542d95fcb1 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Network error: Client connection negotiation failed: client connection to 127.9.116.67:38103: connect: Connection refused (error 111)
I20260709 12:28:02.739336  9681 raft_consensus.cc:2272] T f29cf6eb18e842c3a5aa62d8fae53279 P 82f27bcdf252425aad4c4a37d064f68d [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:02.742043 16907 leader_election.cc:336] T b10d5b4017584d0fb22f9e542d95fcb1 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:28:02.742621 16907 leader_election.cc:304] T b10d5b4017584d0fb22f9e542d95fcb1 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8
I20260709 12:28:02.743852 18031 raft_consensus.cc:2749] T b10d5b4017584d0fb22f9e542d95fcb1 P 82f27bcdf252425aad4c4a37d064f68d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:02.744136  9681 tablet_replica.cc:333] T 3e78004b8cc14ac6b93c857cbdd63329 P 82f27bcdf252425aad4c4a37d064f68d: stopping tablet replica
I20260709 12:28:02.745268  9681 raft_consensus.cc:2243] T 3e78004b8cc14ac6b93c857cbdd63329 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:02.746019  9681 raft_consensus.cc:2272] T 3e78004b8cc14ac6b93c857cbdd63329 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.748588  9681 tablet_replica.cc:333] T f5345dc6d3b946e0bb9220acf126cf59 P 82f27bcdf252425aad4c4a37d064f68d: stopping tablet replica
I20260709 12:28:02.749209  9681 raft_consensus.cc:2243] T f5345dc6d3b946e0bb9220acf126cf59 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:02.749706  9681 raft_consensus.cc:2272] T f5345dc6d3b946e0bb9220acf126cf59 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.752076  9681 tablet_replica.cc:333] T 6a86fc21ef0044bb91dd271c9a019336 P 82f27bcdf252425aad4c4a37d064f68d: stopping tablet replica
I20260709 12:28:02.752715  9681 raft_consensus.cc:2243] T 6a86fc21ef0044bb91dd271c9a019336 P 82f27bcdf252425aad4c4a37d064f68d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:02.753206  9681 raft_consensus.cc:2272] T 6a86fc21ef0044bb91dd271c9a019336 P 82f27bcdf252425aad4c4a37d064f68d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.755806  9681 tablet_replica.cc:333] T 51ebab30b5104589803b75a1b48c5aa2 P 82f27bcdf252425aad4c4a37d064f68d: stopping tablet replica
I20260709 12:28:02.756611  9681 raft_consensus.cc:2243] T 51ebab30b5104589803b75a1b48c5aa2 P 82f27bcdf252425aad4c4a37d064f68d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:02.757829  9681 raft_consensus.cc:2272] T 51ebab30b5104589803b75a1b48c5aa2 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.761358  9681 tablet_replica.cc:333] T 7562feb416f84f0b948343356153d8d2 P 82f27bcdf252425aad4c4a37d064f68d: stopping tablet replica
I20260709 12:28:02.762056  9681 raft_consensus.cc:2243] T 7562feb416f84f0b948343356153d8d2 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:02.762641  9681 raft_consensus.cc:2272] T 7562feb416f84f0b948343356153d8d2 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.764509 18031 raft_consensus.cc:493] T 27f104a1ba60493ab47f6b876da48d67 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17294485b7f24e2b9fae71dd3169a336)
I20260709 12:28:02.765168 18031 raft_consensus.cc:515] T 27f104a1ba60493ab47f6b876da48d67 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } } peers { permanent_uuid: "879366e90f5c420588945e0d545017c8" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 39833 } }
I20260709 12:28:02.766192  9681 tablet_replica.cc:333] T 442e0dfc272840f7a14c2232ed65425c P 82f27bcdf252425aad4c4a37d064f68d: stopping tablet replica
I20260709 12:28:02.767148  9681 raft_consensus.cc:2243] T 442e0dfc272840f7a14c2232ed65425c P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:02.767267 18031 leader_election.cc:290] T 27f104a1ba60493ab47f6b876da48d67 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103), 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833)
I20260709 12:28:02.768085  9681 raft_consensus.cc:2272] T 442e0dfc272840f7a14c2232ed65425c P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:02.771456 16907 leader_election.cc:336] T 27f104a1ba60493ab47f6b876da48d67 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Network error: Client connection negotiation failed: client connection to 127.9.116.67:38103: connect: Connection refused (error 111)
I20260709 12:28:02.771948  9681 tablet_replica.cc:333] T 62e4e875fd4e4604952120df324e99cb P 82f27bcdf252425aad4c4a37d064f68d: stopping tablet replica
W20260709 12:28:02.772393 16907 leader_election.cc:336] T 27f104a1ba60493ab47f6b876da48d67 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 879366e90f5c420588945e0d545017c8 (127.9.116.65:39833): Network error: Client connection negotiation failed: client connection to 127.9.116.65:39833: connect: Connection refused (error 111)
I20260709 12:28:02.772758 16907 leader_election.cc:304] T 27f104a1ba60493ab47f6b876da48d67 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 17294485b7f24e2b9fae71dd3169a336, 879366e90f5c420588945e0d545017c8
I20260709 12:28:02.772872  9681 raft_consensus.cc:2243] T 62e4e875fd4e4604952120df324e99cb P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:02.773563 18031 raft_consensus.cc:2749] T 27f104a1ba60493ab47f6b876da48d67 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:02.773694  9681 raft_consensus.cc:2272] T 62e4e875fd4e4604952120df324e99cb P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.776750  9681 tablet_replica.cc:333] T 3649e7bb023a4958a01ad5ecbe446f0f P 82f27bcdf252425aad4c4a37d064f68d: stopping tablet replica
I20260709 12:28:02.777542  9681 raft_consensus.cc:2243] T 3649e7bb023a4958a01ad5ecbe446f0f P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:02.778220  9681 raft_consensus.cc:2272] T 3649e7bb023a4958a01ad5ecbe446f0f P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.781418  9681 tablet_replica.cc:333] T 29fcc4f156a54ca4b54a4a11e2cee973 P 82f27bcdf252425aad4c4a37d064f68d: stopping tablet replica
I20260709 12:28:02.782419  9681 raft_consensus.cc:2243] T 29fcc4f156a54ca4b54a4a11e2cee973 P 82f27bcdf252425aad4c4a37d064f68d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:02.784158  9681 raft_consensus.cc:2272] T 29fcc4f156a54ca4b54a4a11e2cee973 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.786782  9681 tablet_replica.cc:333] T 51d96c645e894c8597652daf12a21cf3 P 82f27bcdf252425aad4c4a37d064f68d: stopping tablet replica
I20260709 12:28:02.787400  9681 raft_consensus.cc:2243] T 51d96c645e894c8597652daf12a21cf3 P 82f27bcdf252425aad4c4a37d064f68d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:02.788514  9681 raft_consensus.cc:2272] T 51d96c645e894c8597652daf12a21cf3 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.790793  9681 tablet_replica.cc:333] T cfc80a8e57c24a768ebc48dd544a6c80 P 82f27bcdf252425aad4c4a37d064f68d: stopping tablet replica
I20260709 12:28:02.791640  9681 raft_consensus.cc:2243] T cfc80a8e57c24a768ebc48dd544a6c80 P 82f27bcdf252425aad4c4a37d064f68d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:02.792654  9681 raft_consensus.cc:2272] T cfc80a8e57c24a768ebc48dd544a6c80 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.794790  9681 tablet_replica.cc:333] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d: stopping tablet replica
I20260709 12:28:02.795389  9681 raft_consensus.cc:2243] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:02.796005  9681 raft_consensus.cc:2272] T a4f2b93e5d2045a5a0cd1f9b5806a133 P 82f27bcdf252425aad4c4a37d064f68d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.798683  9681 tablet_replica.cc:333] T 27dda31a8cd1468eb3a824ae026485a3 P 82f27bcdf252425aad4c4a37d064f68d: stopping tablet replica
I20260709 12:28:02.799329  9681 raft_consensus.cc:2243] T 27dda31a8cd1468eb3a824ae026485a3 P 82f27bcdf252425aad4c4a37d064f68d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:02.799927  9681 raft_consensus.cc:2272] T 27dda31a8cd1468eb3a824ae026485a3 P 82f27bcdf252425aad4c4a37d064f68d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.801776 18031 raft_consensus.cc:493] T 60a8110f7e424463ae56af0646bf4434 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17294485b7f24e2b9fae71dd3169a336)
I20260709 12:28:02.802750 18031 raft_consensus.cc:515] T 60a8110f7e424463ae56af0646bf4434 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c1aba6ee1d244fd9c0daba722aa0b3b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43629 } } peers { permanent_uuid: "17294485b7f24e2b9fae71dd3169a336" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 38103 } } peers { permanent_uuid: "82f27bcdf252425aad4c4a37d064f68d" member_type: VOTER last_known_addr { host: "127.9.116.68" port: 37919 } }
I20260709 12:28:02.803256  9681 tablet_replica.cc:333] T b777ccb9937a476590a534fea0428c5c P 82f27bcdf252425aad4c4a37d064f68d: stopping tablet replica
I20260709 12:28:02.804214  9681 raft_consensus.cc:2243] T b777ccb9937a476590a534fea0428c5c P 82f27bcdf252425aad4c4a37d064f68d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:02.805351  9681 raft_consensus.cc:2272] T b777ccb9937a476590a534fea0428c5c P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.805606 18031 leader_election.cc:290] T 60a8110f7e424463ae56af0646bf4434 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629), 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103)
W20260709 12:28:02.809653 16908 leader_election.cc:336] T 60a8110f7e424463ae56af0646bf4434 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3c1aba6ee1d244fd9c0daba722aa0b3b (127.9.116.66:43629): Network error: Client connection negotiation failed: client connection to 127.9.116.66:43629: connect: Connection refused (error 111)
I20260709 12:28:02.810765  9681 tablet_replica.cc:333] T 223b3745452c412581caf058f6b81fe2 P 82f27bcdf252425aad4c4a37d064f68d: stopping tablet replica
W20260709 12:28:02.810871 16907 leader_election.cc:336] T 60a8110f7e424463ae56af0646bf4434 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 17294485b7f24e2b9fae71dd3169a336 (127.9.116.67:38103): Network error: Client connection negotiation failed: client connection to 127.9.116.67:38103: connect: Connection refused (error 111)
I20260709 12:28:02.811510 16907 leader_election.cc:304] T 60a8110f7e424463ae56af0646bf4434 P 82f27bcdf252425aad4c4a37d064f68d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82f27bcdf252425aad4c4a37d064f68d; no voters: 17294485b7f24e2b9fae71dd3169a336, 3c1aba6ee1d244fd9c0daba722aa0b3b
I20260709 12:28:02.811870  9681 raft_consensus.cc:2243] T 223b3745452c412581caf058f6b81fe2 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:02.812234 18031 raft_consensus.cc:2749] T 60a8110f7e424463ae56af0646bf4434 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:02.812662  9681 raft_consensus.cc:2272] T 223b3745452c412581caf058f6b81fe2 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.816506  9681 tablet_replica.cc:333] T 2f737ece325c44c58194725a82923014 P 82f27bcdf252425aad4c4a37d064f68d: stopping tablet replica
I20260709 12:28:02.817549  9681 raft_consensus.cc:2243] T 2f737ece325c44c58194725a82923014 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:02.818132  9681 raft_consensus.cc:2272] T 2f737ece325c44c58194725a82923014 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.821166  9681 tablet_replica.cc:333] T b10d5b4017584d0fb22f9e542d95fcb1 P 82f27bcdf252425aad4c4a37d064f68d: stopping tablet replica
I20260709 12:28:02.822027  9681 raft_consensus.cc:2243] T b10d5b4017584d0fb22f9e542d95fcb1 P 82f27bcdf252425aad4c4a37d064f68d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:02.822880  9681 raft_consensus.cc:2272] T b10d5b4017584d0fb22f9e542d95fcb1 P 82f27bcdf252425aad4c4a37d064f68d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.826908  9681 tablet_replica.cc:333] T a0409dc146674a39a9ceeeeebc081453 P 82f27bcdf252425aad4c4a37d064f68d: stopping tablet replica
I20260709 12:28:02.827943  9681 raft_consensus.cc:2243] T a0409dc146674a39a9ceeeeebc081453 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:02.828714  9681 raft_consensus.cc:2272] T a0409dc146674a39a9ceeeeebc081453 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.832235  9681 tablet_replica.cc:333] T c220555f395e46d4be83f2b16f9691ef P 82f27bcdf252425aad4c4a37d064f68d: stopping tablet replica
I20260709 12:28:02.833160  9681 raft_consensus.cc:2243] T c220555f395e46d4be83f2b16f9691ef P 82f27bcdf252425aad4c4a37d064f68d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:02.834367  9681 raft_consensus.cc:2272] T c220555f395e46d4be83f2b16f9691ef P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.836849  9681 tablet_replica.cc:333] T 28c655b68dc545948c67e0977b49e770 P 82f27bcdf252425aad4c4a37d064f68d: stopping tablet replica
I20260709 12:28:02.837514  9681 raft_consensus.cc:2243] T 28c655b68dc545948c67e0977b49e770 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:02.838102  9681 raft_consensus.cc:2272] T 28c655b68dc545948c67e0977b49e770 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.840829  9681 tablet_replica.cc:333] T 00e5268529b241f184c460704ab9ed3c P 82f27bcdf252425aad4c4a37d064f68d: stopping tablet replica
I20260709 12:28:02.841501  9681 raft_consensus.cc:2243] T 00e5268529b241f184c460704ab9ed3c P 82f27bcdf252425aad4c4a37d064f68d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:02.842773  9681 raft_consensus.cc:2272] T 00e5268529b241f184c460704ab9ed3c P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.845414  9681 tablet_replica.cc:333] T fbafe39b79894737b395f95013bc6c86 P 82f27bcdf252425aad4c4a37d064f68d: stopping tablet replica
I20260709 12:28:02.846130  9681 raft_consensus.cc:2243] T fbafe39b79894737b395f95013bc6c86 P 82f27bcdf252425aad4c4a37d064f68d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:02.847195  9681 raft_consensus.cc:2272] T fbafe39b79894737b395f95013bc6c86 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.849705  9681 tablet_replica.cc:333] T aee6b58df96f401f88392d39eba8ffbf P 82f27bcdf252425aad4c4a37d064f68d: stopping tablet replica
I20260709 12:28:02.850317  9681 raft_consensus.cc:2243] T aee6b58df96f401f88392d39eba8ffbf P 82f27bcdf252425aad4c4a37d064f68d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:02.851342  9681 raft_consensus.cc:2272] T aee6b58df96f401f88392d39eba8ffbf P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.853937  9681 tablet_replica.cc:333] T 5868b3bc1ee44923a18d74874a8f3b30 P 82f27bcdf252425aad4c4a37d064f68d: stopping tablet replica
I20260709 12:28:02.854848  9681 raft_consensus.cc:2243] T 5868b3bc1ee44923a18d74874a8f3b30 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:02.855559  9681 raft_consensus.cc:2272] T 5868b3bc1ee44923a18d74874a8f3b30 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.858948  9681 tablet_replica.cc:333] T ea5085716661498e9f3bfdfa2fc5737a P 82f27bcdf252425aad4c4a37d064f68d: stopping tablet replica
I20260709 12:28:02.859947  9681 raft_consensus.cc:2243] T ea5085716661498e9f3bfdfa2fc5737a P 82f27bcdf252425aad4c4a37d064f68d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:02.861781  9681 raft_consensus.cc:2272] T ea5085716661498e9f3bfdfa2fc5737a P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.866082  9681 tablet_replica.cc:333] T b86527b8a77848629c50a32e2534f7ba P 82f27bcdf252425aad4c4a37d064f68d: stopping tablet replica
I20260709 12:28:02.866824  9681 raft_consensus.cc:2243] T b86527b8a77848629c50a32e2534f7ba P 82f27bcdf252425aad4c4a37d064f68d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:02.868094  9681 raft_consensus.cc:2272] T b86527b8a77848629c50a32e2534f7ba P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.870596  9681 tablet_replica.cc:333] T 98a96f910b4449f7ba9c875e45090080 P 82f27bcdf252425aad4c4a37d064f68d: stopping tablet replica
I20260709 12:28:02.871330  9681 raft_consensus.cc:2243] T 98a96f910b4449f7ba9c875e45090080 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:02.871973  9681 raft_consensus.cc:2272] T 98a96f910b4449f7ba9c875e45090080 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.876037  9681 tablet_replica.cc:333] T 30a37807dd6548adb6e16f8a4d2e5774 P 82f27bcdf252425aad4c4a37d064f68d: stopping tablet replica
I20260709 12:28:02.877070  9681 raft_consensus.cc:2243] T 30a37807dd6548adb6e16f8a4d2e5774 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:02.877796  9681 raft_consensus.cc:2272] T 30a37807dd6548adb6e16f8a4d2e5774 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.880509  9681 tablet_replica.cc:333] T 27f104a1ba60493ab47f6b876da48d67 P 82f27bcdf252425aad4c4a37d064f68d: stopping tablet replica
I20260709 12:28:02.881139  9681 raft_consensus.cc:2243] T 27f104a1ba60493ab47f6b876da48d67 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:02.881651  9681 raft_consensus.cc:2272] T 27f104a1ba60493ab47f6b876da48d67 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.884130  9681 tablet_replica.cc:333] T 6e43addba09b4930a12c94e691b2c76f P 82f27bcdf252425aad4c4a37d064f68d: stopping tablet replica
I20260709 12:28:02.884703  9681 raft_consensus.cc:2243] T 6e43addba09b4930a12c94e691b2c76f P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:02.885496  9681 raft_consensus.cc:2272] T 6e43addba09b4930a12c94e691b2c76f P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.889344  9681 tablet_replica.cc:333] T 514ee26ff21e4c08976b6a0397b730fe P 82f27bcdf252425aad4c4a37d064f68d: stopping tablet replica
I20260709 12:28:02.890075  9681 raft_consensus.cc:2243] T 514ee26ff21e4c08976b6a0397b730fe P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:02.890789  9681 raft_consensus.cc:2272] T 514ee26ff21e4c08976b6a0397b730fe P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.893163  9681 tablet_replica.cc:333] T 7b90200ef21f42f1929fbf0051ef5b3e P 82f27bcdf252425aad4c4a37d064f68d: stopping tablet replica
I20260709 12:28:02.894110  9681 raft_consensus.cc:2243] T 7b90200ef21f42f1929fbf0051ef5b3e P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:02.894815  9681 raft_consensus.cc:2272] T 7b90200ef21f42f1929fbf0051ef5b3e P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.897838  9681 tablet_replica.cc:333] T fd1494eb0dd14dab9a2e4c07812117c2 P 82f27bcdf252425aad4c4a37d064f68d: stopping tablet replica
I20260709 12:28:02.898733  9681 raft_consensus.cc:2243] T fd1494eb0dd14dab9a2e4c07812117c2 P 82f27bcdf252425aad4c4a37d064f68d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:02.900025  9681 raft_consensus.cc:2272] T fd1494eb0dd14dab9a2e4c07812117c2 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.903040  9681 tablet_replica.cc:333] T de72d440fa1641a39aee027ffc0588a3 P 82f27bcdf252425aad4c4a37d064f68d: stopping tablet replica
I20260709 12:28:02.903891  9681 raft_consensus.cc:2243] T de72d440fa1641a39aee027ffc0588a3 P 82f27bcdf252425aad4c4a37d064f68d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:02.905076  9681 raft_consensus.cc:2272] T de72d440fa1641a39aee027ffc0588a3 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.907455  9681 tablet_replica.cc:333] T d6811cd94dfd44149e1329e919d82f0f P 82f27bcdf252425aad4c4a37d064f68d: stopping tablet replica
I20260709 12:28:02.908146  9681 raft_consensus.cc:2243] T d6811cd94dfd44149e1329e919d82f0f P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:02.908661  9681 raft_consensus.cc:2272] T d6811cd94dfd44149e1329e919d82f0f P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.911095  9681 tablet_replica.cc:333] T 288d05b8017c4e0f8cd40048647aecae P 82f27bcdf252425aad4c4a37d064f68d: stopping tablet replica
I20260709 12:28:02.911763  9681 raft_consensus.cc:2243] T 288d05b8017c4e0f8cd40048647aecae P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:02.912313  9681 raft_consensus.cc:2272] T 288d05b8017c4e0f8cd40048647aecae P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.915904  9681 tablet_replica.cc:333] T 6916ee6a900c46508c98006aa85fe2d9 P 82f27bcdf252425aad4c4a37d064f68d: stopping tablet replica
I20260709 12:28:02.916600  9681 raft_consensus.cc:2243] T 6916ee6a900c46508c98006aa85fe2d9 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:02.917171  9681 raft_consensus.cc:2272] T 6916ee6a900c46508c98006aa85fe2d9 P 82f27bcdf252425aad4c4a37d064f68d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:02.919775  9681 tablet_replica.cc:333] T 60a8110f7e424463ae56af0646bf4434 P 82f27bcdf252425aad4c4a37d064f68d: stopping tablet replica
I20260709 12:28:02.920380  9681 raft_consensus.cc:2243] T 60a8110f7e424463ae56af0646bf4434 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:02.920933  9681 raft_consensus.cc:2272] T 60a8110f7e424463ae56af0646bf4434 P 82f27bcdf252425aad4c4a37d064f68d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:03.012398  9681 tablet_server.cc:196] TabletServer@127.9.116.68:0 shutdown complete.
I20260709 12:28:03.096580  9681 master.cc:562] Master@127.9.116.126:46577 shutting down...
I20260709 12:28:03.140631  9681 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 6ab0b5a8a05748e0b6c4b2e058a40dc4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:03.141497  9681 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 6ab0b5a8a05748e0b6c4b2e058a40dc4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:03.141886  9681 tablet_replica.cc:333] T 00000000000000000000000000000000 P 6ab0b5a8a05748e0b6c4b2e058a40dc4: stopping tablet replica
I20260709 12:28:03.168128  9681 master.cc:584] Master@127.9.116.126:46577 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (43245 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 12:28:03.289602  9681 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.9.116.126:42259
I20260709 12:28:03.290854  9681 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:28:03.298712 18033 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:03.298854 18032 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:03.300776 18035 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:03.302142  9681 server_base.cc:1061] running on GCE node
I20260709 12:28:03.304095  9681 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:28:03.304350  9681 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:28:03.304540  9681 hybrid_clock.cc:648] HybridClock initialized: now 1783600083304514 us; error 0 us; skew 500 ppm
I20260709 12:28:03.305415  9681 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:28:03.309386  9681 webserver.cc:533] Webserver started at http://127.9.116.126:38539/ using document root <none> and password file <none>
I20260709 12:28:03.309978  9681 fs_manager.cc:362] Metadata directory not provided
I20260709 12:28:03.310189  9681 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:28:03.310515  9681 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:28:03.312062  9681 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599781984018-9681-0/minicluster-data/master-0-root/instance:
uuid: "7744ed65fa3148d9a6b386a5d76657a0"
format_stamp: "Formatted at 2026-07-09 12:28:03 on dist-test-slave-zk51"
I20260709 12:28:03.317639  9681 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:28:03.322412 18040 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:03.323529  9681 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.001s
I20260709 12:28:03.323881  9681 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599781984018-9681-0/minicluster-data/master-0-root
uuid: "7744ed65fa3148d9a6b386a5d76657a0"
format_stamp: "Formatted at 2026-07-09 12:28:03 on dist-test-slave-zk51"
I20260709 12:28:03.324201  9681 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599781984018-9681-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599781984018-9681-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599781984018-9681-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:28:03.359391  9681 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:28:03.361368  9681 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:28:03.412782  9681 rpc_server.cc:307] RPC server started. Bound to: 127.9.116.126:42259
I20260709 12:28:03.413026 18091 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.116.126:42259 every 8 connection(s)
I20260709 12:28:03.417569 18092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:03.434213 18092 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7744ed65fa3148d9a6b386a5d76657a0: Bootstrap starting.
I20260709 12:28:03.439764 18092 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7744ed65fa3148d9a6b386a5d76657a0: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:03.444653 18092 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7744ed65fa3148d9a6b386a5d76657a0: No bootstrap required, opened a new log
I20260709 12:28:03.447207 18092 raft_consensus.cc:359] T 00000000000000000000000000000000 P 7744ed65fa3148d9a6b386a5d76657a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7744ed65fa3148d9a6b386a5d76657a0" member_type: VOTER }
I20260709 12:28:03.447774 18092 raft_consensus.cc:385] T 00000000000000000000000000000000 P 7744ed65fa3148d9a6b386a5d76657a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:03.448045 18092 raft_consensus.cc:740] T 00000000000000000000000000000000 P 7744ed65fa3148d9a6b386a5d76657a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7744ed65fa3148d9a6b386a5d76657a0, State: Initialized, Role: FOLLOWER
I20260709 12:28:03.448755 18092 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7744ed65fa3148d9a6b386a5d76657a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7744ed65fa3148d9a6b386a5d76657a0" member_type: VOTER }
I20260709 12:28:03.449254 18092 raft_consensus.cc:399] T 00000000000000000000000000000000 P 7744ed65fa3148d9a6b386a5d76657a0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:28:03.449471 18092 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7744ed65fa3148d9a6b386a5d76657a0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:28:03.449806 18092 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 7744ed65fa3148d9a6b386a5d76657a0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:03.454936 18092 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7744ed65fa3148d9a6b386a5d76657a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7744ed65fa3148d9a6b386a5d76657a0" member_type: VOTER }
I20260709 12:28:03.455559 18092 leader_election.cc:304] T 00000000000000000000000000000000 P 7744ed65fa3148d9a6b386a5d76657a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7744ed65fa3148d9a6b386a5d76657a0; no voters: 
I20260709 12:28:03.456871 18092 leader_election.cc:290] T 00000000000000000000000000000000 P 7744ed65fa3148d9a6b386a5d76657a0 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:28:03.457530 18095 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 7744ed65fa3148d9a6b386a5d76657a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:03.459378 18095 raft_consensus.cc:697] T 00000000000000000000000000000000 P 7744ed65fa3148d9a6b386a5d76657a0 [term 1 LEADER]: Becoming Leader. State: Replica: 7744ed65fa3148d9a6b386a5d76657a0, State: Running, Role: LEADER
I20260709 12:28:03.460005 18092 sys_catalog.cc:565] T 00000000000000000000000000000000 P 7744ed65fa3148d9a6b386a5d76657a0 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:28:03.460182 18095 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7744ed65fa3148d9a6b386a5d76657a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7744ed65fa3148d9a6b386a5d76657a0" member_type: VOTER }
I20260709 12:28:03.469082 18097 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7744ed65fa3148d9a6b386a5d76657a0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7744ed65fa3148d9a6b386a5d76657a0. Latest consensus state: current_term: 1 leader_uuid: "7744ed65fa3148d9a6b386a5d76657a0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7744ed65fa3148d9a6b386a5d76657a0" member_type: VOTER } }
I20260709 12:28:03.469627 18097 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7744ed65fa3148d9a6b386a5d76657a0 [sys.catalog]: This master's current role is: LEADER
I20260709 12:28:03.469250 18096 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7744ed65fa3148d9a6b386a5d76657a0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7744ed65fa3148d9a6b386a5d76657a0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7744ed65fa3148d9a6b386a5d76657a0" member_type: VOTER } }
I20260709 12:28:03.470482 18096 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7744ed65fa3148d9a6b386a5d76657a0 [sys.catalog]: This master's current role is: LEADER
I20260709 12:28:03.471809 18103 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:28:03.477485 18103 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:28:03.481895  9681 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:28:03.489683 18103 catalog_manager.cc:1383] Generated new cluster ID: eb406859cc5c436a8ccd7a357c6b76e5
I20260709 12:28:03.490031 18103 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:28:03.505353 18103 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:28:03.507022 18103 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:28:03.531499 18103 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 7744ed65fa3148d9a6b386a5d76657a0: Generated new TSK 0
I20260709 12:28:03.532229 18103 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:28:03.554561  9681 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:28:03.562772 18113 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:03.563468 18114 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:03.567088  9681 server_base.cc:1061] running on GCE node
W20260709 12:28:03.567314 18116 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:03.568601  9681 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:28:03.568809  9681 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:28:03.568930  9681 hybrid_clock.cc:648] HybridClock initialized: now 1783600083568919 us; error 0 us; skew 500 ppm
I20260709 12:28:03.569427  9681 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:28:03.572047  9681 webserver.cc:533] Webserver started at http://127.9.116.65:46415/ using document root <none> and password file <none>
I20260709 12:28:03.572623  9681 fs_manager.cc:362] Metadata directory not provided
I20260709 12:28:03.572839  9681 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:28:03.573086  9681 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:28:03.574281  9681 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599781984018-9681-0/minicluster-data/ts-0-root/instance:
uuid: "5ac1c3901f284979a114ebe1dc69831b"
format_stamp: "Formatted at 2026-07-09 12:28:03 on dist-test-slave-zk51"
I20260709 12:28:03.579912  9681 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.000s	sys 0.004s
I20260709 12:28:03.584731 18121 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:03.585695  9681 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.005s	sys 0.000s
I20260709 12:28:03.586159  9681 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599781984018-9681-0/minicluster-data/ts-0-root
uuid: "5ac1c3901f284979a114ebe1dc69831b"
format_stamp: "Formatted at 2026-07-09 12:28:03 on dist-test-slave-zk51"
I20260709 12:28:03.586526  9681 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599781984018-9681-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599781984018-9681-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599781984018-9681-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:28:03.611788  9681 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:28:03.613227  9681 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:28:03.615845  9681 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:28:03.619648  9681 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:28:03.619915  9681 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:28:03.620141  9681 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:28:03.620293  9681 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:03.678066  9681 rpc_server.cc:307] RPC server started. Bound to: 127.9.116.65:43785
I20260709 12:28:03.678372 18183 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.116.65:43785 every 8 connection(s)
I20260709 12:28:03.683521  9681 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:28:03.693552 18189 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:03.695650 18191 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:03.697088 18188 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:03.697467  9681 server_base.cc:1061] running on GCE node
I20260709 12:28:03.699549  9681 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:28:03.699911  9681 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:28:03.700115  9681 hybrid_clock.cc:648] HybridClock initialized: now 1783600083700091 us; error 0 us; skew 500 ppm
I20260709 12:28:03.700795  9681 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:28:03.704210 18184 heartbeater.cc:344] Connected to a master server at 127.9.116.126:42259
I20260709 12:28:03.704836 18184 heartbeater.cc:461] Registering TS with master...
I20260709 12:28:03.705017  9681 webserver.cc:533] Webserver started at http://127.9.116.66:38225/ using document root <none> and password file <none>
I20260709 12:28:03.705744  9681 fs_manager.cc:362] Metadata directory not provided
I20260709 12:28:03.705868 18184 heartbeater.cc:507] Master 127.9.116.126:42259 requested a full tablet report, sending...
I20260709 12:28:03.706039  9681 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:28:03.706457  9681 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:28:03.708190  9681 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599781984018-9681-0/minicluster-data/ts-1-root/instance:
uuid: "1ec72e086a2e41498a8e344cfae3b8f5"
format_stamp: "Formatted at 2026-07-09 12:28:03 on dist-test-slave-zk51"
I20260709 12:28:03.708796 18057 ts_manager.cc:194] Registered new tserver with Master: 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785)
I20260709 12:28:03.710726 18057 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56970
I20260709 12:28:03.714032  9681 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:28:03.720037 18196 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:03.721832  9681 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.002s
I20260709 12:28:03.722554  9681 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599781984018-9681-0/minicluster-data/ts-1-root
uuid: "1ec72e086a2e41498a8e344cfae3b8f5"
format_stamp: "Formatted at 2026-07-09 12:28:03 on dist-test-slave-zk51"
I20260709 12:28:03.723158  9681 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599781984018-9681-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599781984018-9681-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599781984018-9681-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:28:03.763641  9681 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:28:03.765075  9681 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:28:03.766762  9681 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:28:03.769220  9681 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:28:03.769472  9681 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:03.769742  9681 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:28:03.769925  9681 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:03.840588  9681 rpc_server.cc:307] RPC server started. Bound to: 127.9.116.66:41289
I20260709 12:28:03.840776 18258 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.116.66:41289 every 8 connection(s)
I20260709 12:28:03.847666  9681 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:28:03.856527 18262 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:03.859884 18263 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:03.861276  9681 server_base.cc:1061] running on GCE node
W20260709 12:28:03.862238 18265 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:03.863488  9681 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:28:03.864079 18259 heartbeater.cc:344] Connected to a master server at 127.9.116.126:42259
W20260709 12:28:03.864140  9681 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:28:03.864634  9681 hybrid_clock.cc:648] HybridClock initialized: now 1783600083864607 us; error 0 us; skew 500 ppm
I20260709 12:28:03.864666 18259 heartbeater.cc:461] Registering TS with master...
I20260709 12:28:03.865351  9681 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:28:03.865760 18259 heartbeater.cc:507] Master 127.9.116.126:42259 requested a full tablet report, sending...
I20260709 12:28:03.868822  9681 webserver.cc:533] Webserver started at http://127.9.116.67:41601/ using document root <none> and password file <none>
I20260709 12:28:03.869328 18057 ts_manager.cc:194] Registered new tserver with Master: 1ec72e086a2e41498a8e344cfae3b8f5 (127.9.116.66:41289)
I20260709 12:28:03.869580  9681 fs_manager.cc:362] Metadata directory not provided
I20260709 12:28:03.869885  9681 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:28:03.870229  9681 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:28:03.871271 18057 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56974
I20260709 12:28:03.871812  9681 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599781984018-9681-0/minicluster-data/ts-2-root/instance:
uuid: "8b070276227b44858767bb33e02cc11b"
format_stamp: "Formatted at 2026-07-09 12:28:03 on dist-test-slave-zk51"
I20260709 12:28:03.878675  9681 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:28:03.883347 18270 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:03.884423  9681 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:28:03.884723  9681 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599781984018-9681-0/minicluster-data/ts-2-root
uuid: "8b070276227b44858767bb33e02cc11b"
format_stamp: "Formatted at 2026-07-09 12:28:03 on dist-test-slave-zk51"
I20260709 12:28:03.885021  9681 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599781984018-9681-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599781984018-9681-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599781984018-9681-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:28:03.901895  9681 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:28:03.903710  9681 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:28:03.906038  9681 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:28:03.908769  9681 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:28:03.908990  9681 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:03.909189  9681 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:28:03.909323  9681 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:03.965178  9681 rpc_server.cc:307] RPC server started. Bound to: 127.9.116.67:41781
I20260709 12:28:03.965304 18332 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.116.67:41781 every 8 connection(s)
I20260709 12:28:03.982967 18333 heartbeater.cc:344] Connected to a master server at 127.9.116.126:42259
I20260709 12:28:03.983433 18333 heartbeater.cc:461] Registering TS with master...
I20260709 12:28:03.984233 18333 heartbeater.cc:507] Master 127.9.116.126:42259 requested a full tablet report, sending...
I20260709 12:28:03.986914 18057 ts_manager.cc:194] Registered new tserver with Master: 8b070276227b44858767bb33e02cc11b (127.9.116.67:41781)
I20260709 12:28:03.987838  9681 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.019142964s
I20260709 12:28:03.988713 18057 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56978
I20260709 12:28:04.024899 18057 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56990:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:28:04.028915 18057 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:28:04.121250 18223 tablet_service.cc:1511] Processing CreateTablet for tablet f7836af3dd864d4cbc3a4f9ee717a6ee (DEFAULT_TABLE table=test-workload [id=456f7235c6124a25951ee6f40765b35d]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:28:04.123481 18223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7836af3dd864d4cbc3a4f9ee717a6ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:04.125254 18222 tablet_service.cc:1511] Processing CreateTablet for tablet e545023b44d846bbb719556f2d284a1e (DEFAULT_TABLE table=test-workload [id=456f7235c6124a25951ee6f40765b35d]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:28:04.126763 18221 tablet_service.cc:1511] Processing CreateTablet for tablet 5c0b48a3f0574c0ead9ce938d7ce0fa6 (DEFAULT_TABLE table=test-workload [id=456f7235c6124a25951ee6f40765b35d]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:28:04.139519 18220 tablet_service.cc:1511] Processing CreateTablet for tablet a901c0ae9d9f4e82939a611b87bc6014 (DEFAULT_TABLE table=test-workload [id=456f7235c6124a25951ee6f40765b35d]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:28:04.126992 18224 tablet_service.cc:1511] Processing CreateTablet for tablet c9cdcf5095a14f4db2efdef9465c5719 (DEFAULT_TABLE table=test-workload [id=456f7235c6124a25951ee6f40765b35d]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:28:04.141528 18222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e545023b44d846bbb719556f2d284a1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:04.148010 18220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a901c0ae9d9f4e82939a611b87bc6014. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:04.149407 18224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9cdcf5095a14f4db2efdef9465c5719. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:04.152012 18221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c0b48a3f0574c0ead9ce938d7ce0fa6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:04.160133 18297 tablet_service.cc:1511] Processing CreateTablet for tablet f7836af3dd864d4cbc3a4f9ee717a6ee (DEFAULT_TABLE table=test-workload [id=456f7235c6124a25951ee6f40765b35d]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:28:04.160481 18219 tablet_service.cc:1511] Processing CreateTablet for tablet 3fa608df520c42249d93ddb828490f2d (DEFAULT_TABLE table=test-workload [id=456f7235c6124a25951ee6f40765b35d]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:28:04.161934 18219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fa608df520c42249d93ddb828490f2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:04.162772 18296 tablet_service.cc:1511] Processing CreateTablet for tablet e545023b44d846bbb719556f2d284a1e (DEFAULT_TABLE table=test-workload [id=456f7235c6124a25951ee6f40765b35d]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:28:04.161937 18297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7836af3dd864d4cbc3a4f9ee717a6ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:04.164633 18296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e545023b44d846bbb719556f2d284a1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:04.160882 18298 tablet_service.cc:1511] Processing CreateTablet for tablet c9cdcf5095a14f4db2efdef9465c5719 (DEFAULT_TABLE table=test-workload [id=456f7235c6124a25951ee6f40765b35d]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:28:04.170051 18218 tablet_service.cc:1511] Processing CreateTablet for tablet d88e2a949fe645c8a5bd2a10fcd84b0d (DEFAULT_TABLE table=test-workload [id=456f7235c6124a25951ee6f40765b35d]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:28:04.170261 18295 tablet_service.cc:1511] Processing CreateTablet for tablet 5c0b48a3f0574c0ead9ce938d7ce0fa6 (DEFAULT_TABLE table=test-workload [id=456f7235c6124a25951ee6f40765b35d]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:28:04.172289 18295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c0b48a3f0574c0ead9ce938d7ce0fa6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:04.173506 18217 tablet_service.cc:1511] Processing CreateTablet for tablet 2452f65bb1e24de4b47df9d6efcb5443 (DEFAULT_TABLE table=test-workload [id=456f7235c6124a25951ee6f40765b35d]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:28:04.173883 18216 tablet_service.cc:1511] Processing CreateTablet for tablet 019a279ca008410abf88a5dc9f30974a (DEFAULT_TABLE table=test-workload [id=456f7235c6124a25951ee6f40765b35d]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:28:04.175513 18218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d88e2a949fe645c8a5bd2a10fcd84b0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:04.170261 18294 tablet_service.cc:1511] Processing CreateTablet for tablet a901c0ae9d9f4e82939a611b87bc6014 (DEFAULT_TABLE table=test-workload [id=456f7235c6124a25951ee6f40765b35d]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:28:04.176188 18216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 019a279ca008410abf88a5dc9f30974a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:04.177160 18294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a901c0ae9d9f4e82939a611b87bc6014. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:04.177783 18217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2452f65bb1e24de4b47df9d6efcb5443. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:04.182113 18293 tablet_service.cc:1511] Processing CreateTablet for tablet 3fa608df520c42249d93ddb828490f2d (DEFAULT_TABLE table=test-workload [id=456f7235c6124a25951ee6f40765b35d]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:28:04.179256 18298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9cdcf5095a14f4db2efdef9465c5719. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:04.186056 18293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fa608df520c42249d93ddb828490f2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:04.198251 18149 tablet_service.cc:1511] Processing CreateTablet for tablet c9cdcf5095a14f4db2efdef9465c5719 (DEFAULT_TABLE table=test-workload [id=456f7235c6124a25951ee6f40765b35d]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:28:04.200374 18149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9cdcf5095a14f4db2efdef9465c5719. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:04.201603 18148 tablet_service.cc:1511] Processing CreateTablet for tablet f7836af3dd864d4cbc3a4f9ee717a6ee (DEFAULT_TABLE table=test-workload [id=456f7235c6124a25951ee6f40765b35d]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:28:04.208371 18147 tablet_service.cc:1511] Processing CreateTablet for tablet e545023b44d846bbb719556f2d284a1e (DEFAULT_TABLE table=test-workload [id=456f7235c6124a25951ee6f40765b35d]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:28:04.211122 18146 tablet_service.cc:1511] Processing CreateTablet for tablet 5c0b48a3f0574c0ead9ce938d7ce0fa6 (DEFAULT_TABLE table=test-workload [id=456f7235c6124a25951ee6f40765b35d]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:28:04.213622 18145 tablet_service.cc:1511] Processing CreateTablet for tablet a901c0ae9d9f4e82939a611b87bc6014 (DEFAULT_TABLE table=test-workload [id=456f7235c6124a25951ee6f40765b35d]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:28:04.206328 18144 tablet_service.cc:1511] Processing CreateTablet for tablet 3fa608df520c42249d93ddb828490f2d (DEFAULT_TABLE table=test-workload [id=456f7235c6124a25951ee6f40765b35d]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:28:04.222996 18215 tablet_service.cc:1511] Processing CreateTablet for tablet ec13962b83ce4b6ebe53124d2fdddcd5 (DEFAULT_TABLE table=test-workload [id=456f7235c6124a25951ee6f40765b35d]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:28:04.226737 18143 tablet_service.cc:1511] Processing CreateTablet for tablet d88e2a949fe645c8a5bd2a10fcd84b0d (DEFAULT_TABLE table=test-workload [id=456f7235c6124a25951ee6f40765b35d]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:28:04.231909 18148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7836af3dd864d4cbc3a4f9ee717a6ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:04.239184 18350 tablet_bootstrap.cc:492] T e545023b44d846bbb719556f2d284a1e P 1ec72e086a2e41498a8e344cfae3b8f5: Bootstrap starting.
I20260709 12:28:04.241822 18215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec13962b83ce4b6ebe53124d2fdddcd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:04.257688 18291 tablet_service.cc:1511] Processing CreateTablet for tablet 2452f65bb1e24de4b47df9d6efcb5443 (DEFAULT_TABLE table=test-workload [id=456f7235c6124a25951ee6f40765b35d]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:28:04.257417 18292 tablet_service.cc:1511] Processing CreateTablet for tablet d88e2a949fe645c8a5bd2a10fcd84b0d (DEFAULT_TABLE table=test-workload [id=456f7235c6124a25951ee6f40765b35d]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:28:04.262310 18290 tablet_service.cc:1511] Processing CreateTablet for tablet 019a279ca008410abf88a5dc9f30974a (DEFAULT_TABLE table=test-workload [id=456f7235c6124a25951ee6f40765b35d]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:28:04.264030 18145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a901c0ae9d9f4e82939a611b87bc6014. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:04.265609 18289 tablet_service.cc:1511] Processing CreateTablet for tablet ec13962b83ce4b6ebe53124d2fdddcd5 (DEFAULT_TABLE table=test-workload [id=456f7235c6124a25951ee6f40765b35d]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:28:04.259305 18291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2452f65bb1e24de4b47df9d6efcb5443. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:04.273633 18142 tablet_service.cc:1511] Processing CreateTablet for tablet 2452f65bb1e24de4b47df9d6efcb5443 (DEFAULT_TABLE table=test-workload [id=456f7235c6124a25951ee6f40765b35d]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:28:04.275022 18289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec13962b83ce4b6ebe53124d2fdddcd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:04.277304 18140 tablet_service.cc:1511] Processing CreateTablet for tablet ec13962b83ce4b6ebe53124d2fdddcd5 (DEFAULT_TABLE table=test-workload [id=456f7235c6124a25951ee6f40765b35d]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:28:04.279121 18290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 019a279ca008410abf88a5dc9f30974a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:04.280951 18292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d88e2a949fe645c8a5bd2a10fcd84b0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:04.283713 18141 tablet_service.cc:1511] Processing CreateTablet for tablet 019a279ca008410abf88a5dc9f30974a (DEFAULT_TABLE table=test-workload [id=456f7235c6124a25951ee6f40765b35d]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:28:04.285068 18146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c0b48a3f0574c0ead9ce938d7ce0fa6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:04.287710 18142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2452f65bb1e24de4b47df9d6efcb5443. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:04.288863 18147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e545023b44d846bbb719556f2d284a1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:04.289881 18140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec13962b83ce4b6ebe53124d2fdddcd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:04.291966 18144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fa608df520c42249d93ddb828490f2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:04.300081 18143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d88e2a949fe645c8a5bd2a10fcd84b0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:04.310626 18350 tablet_bootstrap.cc:654] T e545023b44d846bbb719556f2d284a1e P 1ec72e086a2e41498a8e344cfae3b8f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:04.326694 18141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 019a279ca008410abf88a5dc9f30974a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:04.394064 18350 tablet_bootstrap.cc:492] T e545023b44d846bbb719556f2d284a1e P 1ec72e086a2e41498a8e344cfae3b8f5: No bootstrap required, opened a new log
I20260709 12:28:04.394935 18350 ts_tablet_manager.cc:1403] T e545023b44d846bbb719556f2d284a1e P 1ec72e086a2e41498a8e344cfae3b8f5: Time spent bootstrapping tablet: real 0.156s	user 0.008s	sys 0.010s
I20260709 12:28:04.401065 18351 tablet_bootstrap.cc:492] T a901c0ae9d9f4e82939a611b87bc6014 P 8b070276227b44858767bb33e02cc11b: Bootstrap starting.
I20260709 12:28:04.446520 18353 tablet_bootstrap.cc:492] T c9cdcf5095a14f4db2efdef9465c5719 P 5ac1c3901f284979a114ebe1dc69831b: Bootstrap starting.
I20260709 12:28:04.439291 18350 raft_consensus.cc:359] T e545023b44d846bbb719556f2d284a1e P 1ec72e086a2e41498a8e344cfae3b8f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:04.456862 18350 raft_consensus.cc:385] T e545023b44d846bbb719556f2d284a1e P 1ec72e086a2e41498a8e344cfae3b8f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:04.457211 18350 raft_consensus.cc:740] T e545023b44d846bbb719556f2d284a1e P 1ec72e086a2e41498a8e344cfae3b8f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ec72e086a2e41498a8e344cfae3b8f5, State: Initialized, Role: FOLLOWER
I20260709 12:28:04.458242 18350 consensus_queue.cc:260] T e545023b44d846bbb719556f2d284a1e P 1ec72e086a2e41498a8e344cfae3b8f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:04.461432 18351 tablet_bootstrap.cc:654] T a901c0ae9d9f4e82939a611b87bc6014 P 8b070276227b44858767bb33e02cc11b: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:04.461952 18353 tablet_bootstrap.cc:654] T c9cdcf5095a14f4db2efdef9465c5719 P 5ac1c3901f284979a114ebe1dc69831b: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:04.467052 18259 heartbeater.cc:499] Master 127.9.116.126:42259 was elected leader, sending a full tablet report...
I20260709 12:28:04.468809 18350 ts_tablet_manager.cc:1434] T e545023b44d846bbb719556f2d284a1e P 1ec72e086a2e41498a8e344cfae3b8f5: Time spent starting tablet: real 0.074s	user 0.016s	sys 0.003s
I20260709 12:28:04.470305 18350 tablet_bootstrap.cc:492] T 3fa608df520c42249d93ddb828490f2d P 1ec72e086a2e41498a8e344cfae3b8f5: Bootstrap starting.
W20260709 12:28:04.476598 18105 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:28:04.479920 18350 tablet_bootstrap.cc:654] T 3fa608df520c42249d93ddb828490f2d P 1ec72e086a2e41498a8e344cfae3b8f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:04.483790 18351 tablet_bootstrap.cc:492] T a901c0ae9d9f4e82939a611b87bc6014 P 8b070276227b44858767bb33e02cc11b: No bootstrap required, opened a new log
I20260709 12:28:04.484508 18351 ts_tablet_manager.cc:1403] T a901c0ae9d9f4e82939a611b87bc6014 P 8b070276227b44858767bb33e02cc11b: Time spent bootstrapping tablet: real 0.084s	user 0.012s	sys 0.003s
I20260709 12:28:04.486567 18353 tablet_bootstrap.cc:492] T c9cdcf5095a14f4db2efdef9465c5719 P 5ac1c3901f284979a114ebe1dc69831b: No bootstrap required, opened a new log
I20260709 12:28:04.487851 18353 ts_tablet_manager.cc:1403] T c9cdcf5095a14f4db2efdef9465c5719 P 5ac1c3901f284979a114ebe1dc69831b: Time spent bootstrapping tablet: real 0.042s	user 0.019s	sys 0.009s
I20260709 12:28:04.488651 18351 raft_consensus.cc:359] T a901c0ae9d9f4e82939a611b87bc6014 P 8b070276227b44858767bb33e02cc11b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:04.489688 18351 raft_consensus.cc:385] T a901c0ae9d9f4e82939a611b87bc6014 P 8b070276227b44858767bb33e02cc11b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:04.490031 18351 raft_consensus.cc:740] T a901c0ae9d9f4e82939a611b87bc6014 P 8b070276227b44858767bb33e02cc11b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b070276227b44858767bb33e02cc11b, State: Initialized, Role: FOLLOWER
I20260709 12:28:04.491065 18351 consensus_queue.cc:260] T a901c0ae9d9f4e82939a611b87bc6014 P 8b070276227b44858767bb33e02cc11b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:04.491932 18353 raft_consensus.cc:359] T c9cdcf5095a14f4db2efdef9465c5719 P 5ac1c3901f284979a114ebe1dc69831b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } } peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } }
I20260709 12:28:04.492887 18350 tablet_bootstrap.cc:492] T 3fa608df520c42249d93ddb828490f2d P 1ec72e086a2e41498a8e344cfae3b8f5: No bootstrap required, opened a new log
I20260709 12:28:04.492822 18353 raft_consensus.cc:385] T c9cdcf5095a14f4db2efdef9465c5719 P 5ac1c3901f284979a114ebe1dc69831b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:04.493626 18353 raft_consensus.cc:740] T c9cdcf5095a14f4db2efdef9465c5719 P 5ac1c3901f284979a114ebe1dc69831b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ac1c3901f284979a114ebe1dc69831b, State: Initialized, Role: FOLLOWER
I20260709 12:28:04.493762 18350 ts_tablet_manager.cc:1403] T 3fa608df520c42249d93ddb828490f2d P 1ec72e086a2e41498a8e344cfae3b8f5: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.007s
I20260709 12:28:04.494632 18353 consensus_queue.cc:260] T c9cdcf5095a14f4db2efdef9465c5719 P 5ac1c3901f284979a114ebe1dc69831b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } } peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } }
I20260709 12:28:04.499081 18350 raft_consensus.cc:359] T 3fa608df520c42249d93ddb828490f2d P 1ec72e086a2e41498a8e344cfae3b8f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:04.500694 18350 raft_consensus.cc:385] T 3fa608df520c42249d93ddb828490f2d P 1ec72e086a2e41498a8e344cfae3b8f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:04.501771 18350 raft_consensus.cc:740] T 3fa608df520c42249d93ddb828490f2d P 1ec72e086a2e41498a8e344cfae3b8f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ec72e086a2e41498a8e344cfae3b8f5, State: Initialized, Role: FOLLOWER
I20260709 12:28:04.503288 18350 consensus_queue.cc:260] T 3fa608df520c42249d93ddb828490f2d P 1ec72e086a2e41498a8e344cfae3b8f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:04.507258 18350 ts_tablet_manager.cc:1434] T 3fa608df520c42249d93ddb828490f2d P 1ec72e086a2e41498a8e344cfae3b8f5: Time spent starting tablet: real 0.013s	user 0.012s	sys 0.000s
I20260709 12:28:04.508862 18350 tablet_bootstrap.cc:492] T 019a279ca008410abf88a5dc9f30974a P 1ec72e086a2e41498a8e344cfae3b8f5: Bootstrap starting.
I20260709 12:28:04.519853 18350 tablet_bootstrap.cc:654] T 019a279ca008410abf88a5dc9f30974a P 1ec72e086a2e41498a8e344cfae3b8f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:04.534894 18333 heartbeater.cc:499] Master 127.9.116.126:42259 was elected leader, sending a full tablet report...
I20260709 12:28:04.534935 18351 ts_tablet_manager.cc:1434] T a901c0ae9d9f4e82939a611b87bc6014 P 8b070276227b44858767bb33e02cc11b: Time spent starting tablet: real 0.050s	user 0.017s	sys 0.033s
I20260709 12:28:04.536959 18184 heartbeater.cc:499] Master 127.9.116.126:42259 was elected leader, sending a full tablet report...
I20260709 12:28:04.539899 18350 tablet_bootstrap.cc:492] T 019a279ca008410abf88a5dc9f30974a P 1ec72e086a2e41498a8e344cfae3b8f5: No bootstrap required, opened a new log
I20260709 12:28:04.544371 18350 ts_tablet_manager.cc:1403] T 019a279ca008410abf88a5dc9f30974a P 1ec72e086a2e41498a8e344cfae3b8f5: Time spent bootstrapping tablet: real 0.036s	user 0.026s	sys 0.007s
I20260709 12:28:04.545070 18351 tablet_bootstrap.cc:492] T f7836af3dd864d4cbc3a4f9ee717a6ee P 8b070276227b44858767bb33e02cc11b: Bootstrap starting.
I20260709 12:28:04.536940 18353 ts_tablet_manager.cc:1434] T c9cdcf5095a14f4db2efdef9465c5719 P 5ac1c3901f284979a114ebe1dc69831b: Time spent starting tablet: real 0.049s	user 0.022s	sys 0.025s
I20260709 12:28:04.548496 18350 raft_consensus.cc:359] T 019a279ca008410abf88a5dc9f30974a P 1ec72e086a2e41498a8e344cfae3b8f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:04.549731 18350 raft_consensus.cc:385] T 019a279ca008410abf88a5dc9f30974a P 1ec72e086a2e41498a8e344cfae3b8f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:04.550132 18350 raft_consensus.cc:740] T 019a279ca008410abf88a5dc9f30974a P 1ec72e086a2e41498a8e344cfae3b8f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ec72e086a2e41498a8e344cfae3b8f5, State: Initialized, Role: FOLLOWER
I20260709 12:28:04.549232 18353 tablet_bootstrap.cc:492] T ec13962b83ce4b6ebe53124d2fdddcd5 P 5ac1c3901f284979a114ebe1dc69831b: Bootstrap starting.
I20260709 12:28:04.551193 18350 consensus_queue.cc:260] T 019a279ca008410abf88a5dc9f30974a P 1ec72e086a2e41498a8e344cfae3b8f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:04.554651 18351 tablet_bootstrap.cc:654] T f7836af3dd864d4cbc3a4f9ee717a6ee P 8b070276227b44858767bb33e02cc11b: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:04.560120 18353 tablet_bootstrap.cc:654] T ec13962b83ce4b6ebe53124d2fdddcd5 P 5ac1c3901f284979a114ebe1dc69831b: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:04.560426 18350 ts_tablet_manager.cc:1434] T 019a279ca008410abf88a5dc9f30974a P 1ec72e086a2e41498a8e344cfae3b8f5: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.005s
I20260709 12:28:04.562234 18350 tablet_bootstrap.cc:492] T f7836af3dd864d4cbc3a4f9ee717a6ee P 1ec72e086a2e41498a8e344cfae3b8f5: Bootstrap starting.
I20260709 12:28:04.568078 18351 tablet_bootstrap.cc:492] T f7836af3dd864d4cbc3a4f9ee717a6ee P 8b070276227b44858767bb33e02cc11b: No bootstrap required, opened a new log
I20260709 12:28:04.568991 18351 ts_tablet_manager.cc:1403] T f7836af3dd864d4cbc3a4f9ee717a6ee P 8b070276227b44858767bb33e02cc11b: Time spent bootstrapping tablet: real 0.024s	user 0.022s	sys 0.000s
I20260709 12:28:04.570796 18353 tablet_bootstrap.cc:492] T ec13962b83ce4b6ebe53124d2fdddcd5 P 5ac1c3901f284979a114ebe1dc69831b: No bootstrap required, opened a new log
I20260709 12:28:04.571025 18350 tablet_bootstrap.cc:654] T f7836af3dd864d4cbc3a4f9ee717a6ee P 1ec72e086a2e41498a8e344cfae3b8f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:04.571487 18353 ts_tablet_manager.cc:1403] T ec13962b83ce4b6ebe53124d2fdddcd5 P 5ac1c3901f284979a114ebe1dc69831b: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.000s
I20260709 12:28:04.573323 18354 raft_consensus.cc:493] T e545023b44d846bbb719556f2d284a1e P 1ec72e086a2e41498a8e344cfae3b8f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:04.573153 18351 raft_consensus.cc:359] T f7836af3dd864d4cbc3a4f9ee717a6ee P 8b070276227b44858767bb33e02cc11b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:04.573967 18354 raft_consensus.cc:515] T e545023b44d846bbb719556f2d284a1e P 1ec72e086a2e41498a8e344cfae3b8f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:04.574185 18351 raft_consensus.cc:385] T f7836af3dd864d4cbc3a4f9ee717a6ee P 8b070276227b44858767bb33e02cc11b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:04.574980 18351 raft_consensus.cc:740] T f7836af3dd864d4cbc3a4f9ee717a6ee P 8b070276227b44858767bb33e02cc11b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b070276227b44858767bb33e02cc11b, State: Initialized, Role: FOLLOWER
I20260709 12:28:04.575628 18353 raft_consensus.cc:359] T ec13962b83ce4b6ebe53124d2fdddcd5 P 5ac1c3901f284979a114ebe1dc69831b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:04.576632 18353 raft_consensus.cc:385] T ec13962b83ce4b6ebe53124d2fdddcd5 P 5ac1c3901f284979a114ebe1dc69831b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:04.577025 18353 raft_consensus.cc:740] T ec13962b83ce4b6ebe53124d2fdddcd5 P 5ac1c3901f284979a114ebe1dc69831b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ac1c3901f284979a114ebe1dc69831b, State: Initialized, Role: FOLLOWER
I20260709 12:28:04.576231 18351 consensus_queue.cc:260] T f7836af3dd864d4cbc3a4f9ee717a6ee P 8b070276227b44858767bb33e02cc11b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:04.577476 18354 leader_election.cc:290] T e545023b44d846bbb719556f2d284a1e P 1ec72e086a2e41498a8e344cfae3b8f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785), 8b070276227b44858767bb33e02cc11b (127.9.116.67:41781)
I20260709 12:28:04.578094 18353 consensus_queue.cc:260] T ec13962b83ce4b6ebe53124d2fdddcd5 P 5ac1c3901f284979a114ebe1dc69831b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:04.580088 18351 ts_tablet_manager.cc:1434] T f7836af3dd864d4cbc3a4f9ee717a6ee P 8b070276227b44858767bb33e02cc11b: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 12:28:04.581276 18353 ts_tablet_manager.cc:1434] T ec13962b83ce4b6ebe53124d2fdddcd5 P 5ac1c3901f284979a114ebe1dc69831b: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 12:28:04.582267 18351 tablet_bootstrap.cc:492] T ec13962b83ce4b6ebe53124d2fdddcd5 P 8b070276227b44858767bb33e02cc11b: Bootstrap starting.
I20260709 12:28:04.582716 18353 tablet_bootstrap.cc:492] T f7836af3dd864d4cbc3a4f9ee717a6ee P 5ac1c3901f284979a114ebe1dc69831b: Bootstrap starting.
I20260709 12:28:04.592384 18353 tablet_bootstrap.cc:654] T f7836af3dd864d4cbc3a4f9ee717a6ee P 5ac1c3901f284979a114ebe1dc69831b: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:04.593230 18351 tablet_bootstrap.cc:654] T ec13962b83ce4b6ebe53124d2fdddcd5 P 8b070276227b44858767bb33e02cc11b: Neither blocks nor log segments found. Creating new log.
W20260709 12:28:04.596922 18260 tablet.cc:2406] T 019a279ca008410abf88a5dc9f30974a P 1ec72e086a2e41498a8e344cfae3b8f5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:28:04.607373 18353 tablet_bootstrap.cc:492] T f7836af3dd864d4cbc3a4f9ee717a6ee P 5ac1c3901f284979a114ebe1dc69831b: No bootstrap required, opened a new log
I20260709 12:28:04.608287 18353 ts_tablet_manager.cc:1403] T f7836af3dd864d4cbc3a4f9ee717a6ee P 5ac1c3901f284979a114ebe1dc69831b: Time spent bootstrapping tablet: real 0.026s	user 0.018s	sys 0.004s
I20260709 12:28:04.614464 18353 raft_consensus.cc:359] T f7836af3dd864d4cbc3a4f9ee717a6ee P 5ac1c3901f284979a114ebe1dc69831b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:04.616012 18353 raft_consensus.cc:385] T f7836af3dd864d4cbc3a4f9ee717a6ee P 5ac1c3901f284979a114ebe1dc69831b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:04.616457 18353 raft_consensus.cc:740] T f7836af3dd864d4cbc3a4f9ee717a6ee P 5ac1c3901f284979a114ebe1dc69831b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ac1c3901f284979a114ebe1dc69831b, State: Initialized, Role: FOLLOWER
I20260709 12:28:04.618112 18353 consensus_queue.cc:260] T f7836af3dd864d4cbc3a4f9ee717a6ee P 5ac1c3901f284979a114ebe1dc69831b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:04.623113 18353 ts_tablet_manager.cc:1434] T f7836af3dd864d4cbc3a4f9ee717a6ee P 5ac1c3901f284979a114ebe1dc69831b: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.004s
I20260709 12:28:04.625504 18353 tablet_bootstrap.cc:492] T 019a279ca008410abf88a5dc9f30974a P 5ac1c3901f284979a114ebe1dc69831b: Bootstrap starting.
I20260709 12:28:04.640727 18353 tablet_bootstrap.cc:654] T 019a279ca008410abf88a5dc9f30974a P 5ac1c3901f284979a114ebe1dc69831b: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:04.658242 18353 tablet_bootstrap.cc:492] T 019a279ca008410abf88a5dc9f30974a P 5ac1c3901f284979a114ebe1dc69831b: No bootstrap required, opened a new log
I20260709 12:28:04.659063 18353 ts_tablet_manager.cc:1403] T 019a279ca008410abf88a5dc9f30974a P 5ac1c3901f284979a114ebe1dc69831b: Time spent bootstrapping tablet: real 0.034s	user 0.020s	sys 0.005s
I20260709 12:28:04.665517 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e545023b44d846bbb719556f2d284a1e" candidate_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b070276227b44858767bb33e02cc11b" is_pre_election: true
W20260709 12:28:04.668368 18200 leader_election.cc:343] T e545023b44d846bbb719556f2d284a1e P 1ec72e086a2e41498a8e344cfae3b8f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b070276227b44858767bb33e02cc11b (127.9.116.67:41781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:04.668918 18353 raft_consensus.cc:359] T 019a279ca008410abf88a5dc9f30974a P 5ac1c3901f284979a114ebe1dc69831b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:04.669617 18353 raft_consensus.cc:385] T 019a279ca008410abf88a5dc9f30974a P 5ac1c3901f284979a114ebe1dc69831b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:04.669931 18353 raft_consensus.cc:740] T 019a279ca008410abf88a5dc9f30974a P 5ac1c3901f284979a114ebe1dc69831b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ac1c3901f284979a114ebe1dc69831b, State: Initialized, Role: FOLLOWER
I20260709 12:28:04.670671 18353 consensus_queue.cc:260] T 019a279ca008410abf88a5dc9f30974a P 5ac1c3901f284979a114ebe1dc69831b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:04.672550 18351 tablet_bootstrap.cc:492] T ec13962b83ce4b6ebe53124d2fdddcd5 P 8b070276227b44858767bb33e02cc11b: No bootstrap required, opened a new log
I20260709 12:28:04.673316 18351 ts_tablet_manager.cc:1403] T ec13962b83ce4b6ebe53124d2fdddcd5 P 8b070276227b44858767bb33e02cc11b: Time spent bootstrapping tablet: real 0.092s	user 0.022s	sys 0.049s
I20260709 12:28:04.672494 18350 tablet_bootstrap.cc:492] T f7836af3dd864d4cbc3a4f9ee717a6ee P 1ec72e086a2e41498a8e344cfae3b8f5: No bootstrap required, opened a new log
I20260709 12:28:04.674908 18350 ts_tablet_manager.cc:1403] T f7836af3dd864d4cbc3a4f9ee717a6ee P 1ec72e086a2e41498a8e344cfae3b8f5: Time spent bootstrapping tablet: real 0.113s	user 0.037s	sys 0.057s
I20260709 12:28:04.677105 18351 raft_consensus.cc:359] T ec13962b83ce4b6ebe53124d2fdddcd5 P 8b070276227b44858767bb33e02cc11b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:04.672501 18353 ts_tablet_manager.cc:1434] T 019a279ca008410abf88a5dc9f30974a P 5ac1c3901f284979a114ebe1dc69831b: Time spent starting tablet: real 0.013s	user 0.012s	sys 0.000s
I20260709 12:28:04.678118 18351 raft_consensus.cc:385] T ec13962b83ce4b6ebe53124d2fdddcd5 P 8b070276227b44858767bb33e02cc11b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:04.678697 18351 raft_consensus.cc:740] T ec13962b83ce4b6ebe53124d2fdddcd5 P 8b070276227b44858767bb33e02cc11b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b070276227b44858767bb33e02cc11b, State: Initialized, Role: FOLLOWER
I20260709 12:28:04.678372 18350 raft_consensus.cc:359] T f7836af3dd864d4cbc3a4f9ee717a6ee P 1ec72e086a2e41498a8e344cfae3b8f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:04.679185 18353 tablet_bootstrap.cc:492] T a901c0ae9d9f4e82939a611b87bc6014 P 5ac1c3901f284979a114ebe1dc69831b: Bootstrap starting.
I20260709 12:28:04.679608 18351 consensus_queue.cc:260] T ec13962b83ce4b6ebe53124d2fdddcd5 P 8b070276227b44858767bb33e02cc11b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:04.682554 18351 ts_tablet_manager.cc:1434] T ec13962b83ce4b6ebe53124d2fdddcd5 P 8b070276227b44858767bb33e02cc11b: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 12:28:04.678191 18159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e545023b44d846bbb719556f2d284a1e" candidate_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ac1c3901f284979a114ebe1dc69831b" is_pre_election: true
I20260709 12:28:04.684204 18351 tablet_bootstrap.cc:492] T e545023b44d846bbb719556f2d284a1e P 8b070276227b44858767bb33e02cc11b: Bootstrap starting.
I20260709 12:28:04.679178 18350 raft_consensus.cc:385] T f7836af3dd864d4cbc3a4f9ee717a6ee P 1ec72e086a2e41498a8e344cfae3b8f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:04.686211 18350 raft_consensus.cc:740] T f7836af3dd864d4cbc3a4f9ee717a6ee P 1ec72e086a2e41498a8e344cfae3b8f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ec72e086a2e41498a8e344cfae3b8f5, State: Initialized, Role: FOLLOWER
I20260709 12:28:04.687121 18350 consensus_queue.cc:260] T f7836af3dd864d4cbc3a4f9ee717a6ee P 1ec72e086a2e41498a8e344cfae3b8f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
W20260709 12:28:04.688199 18200 leader_election.cc:343] T e545023b44d846bbb719556f2d284a1e P 1ec72e086a2e41498a8e344cfae3b8f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:04.689632 18200 leader_election.cc:304] T e545023b44d846bbb719556f2d284a1e P 1ec72e086a2e41498a8e344cfae3b8f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ec72e086a2e41498a8e344cfae3b8f5; no voters: 5ac1c3901f284979a114ebe1dc69831b, 8b070276227b44858767bb33e02cc11b
I20260709 12:28:04.690553 18354 raft_consensus.cc:2749] T e545023b44d846bbb719556f2d284a1e P 1ec72e086a2e41498a8e344cfae3b8f5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:04.691680 18351 tablet_bootstrap.cc:654] T e545023b44d846bbb719556f2d284a1e P 8b070276227b44858767bb33e02cc11b: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:04.692696 18350 ts_tablet_manager.cc:1434] T f7836af3dd864d4cbc3a4f9ee717a6ee P 1ec72e086a2e41498a8e344cfae3b8f5: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.001s
I20260709 12:28:04.694253 18350 tablet_bootstrap.cc:492] T 5c0b48a3f0574c0ead9ce938d7ce0fa6 P 1ec72e086a2e41498a8e344cfae3b8f5: Bootstrap starting.
I20260709 12:28:04.695685 18353 tablet_bootstrap.cc:654] T a901c0ae9d9f4e82939a611b87bc6014 P 5ac1c3901f284979a114ebe1dc69831b: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:04.703047 18350 tablet_bootstrap.cc:654] T 5c0b48a3f0574c0ead9ce938d7ce0fa6 P 1ec72e086a2e41498a8e344cfae3b8f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:04.707455 18354 raft_consensus.cc:493] T 3fa608df520c42249d93ddb828490f2d P 1ec72e086a2e41498a8e344cfae3b8f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:04.708292 18354 raft_consensus.cc:515] T 3fa608df520c42249d93ddb828490f2d P 1ec72e086a2e41498a8e344cfae3b8f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:04.712714 18159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa608df520c42249d93ddb828490f2d" candidate_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ac1c3901f284979a114ebe1dc69831b" is_pre_election: true
W20260709 12:28:04.714999 18200 leader_election.cc:343] T 3fa608df520c42249d93ddb828490f2d P 1ec72e086a2e41498a8e344cfae3b8f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:04.716668 18354 leader_election.cc:290] T 3fa608df520c42249d93ddb828490f2d P 1ec72e086a2e41498a8e344cfae3b8f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785), 8b070276227b44858767bb33e02cc11b (127.9.116.67:41781)
I20260709 12:28:04.718735 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa608df520c42249d93ddb828490f2d" candidate_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b070276227b44858767bb33e02cc11b" is_pre_election: true
W20260709 12:28:04.720619 18200 leader_election.cc:343] T 3fa608df520c42249d93ddb828490f2d P 1ec72e086a2e41498a8e344cfae3b8f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b070276227b44858767bb33e02cc11b (127.9.116.67:41781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:04.721006 18351 tablet_bootstrap.cc:492] T e545023b44d846bbb719556f2d284a1e P 8b070276227b44858767bb33e02cc11b: No bootstrap required, opened a new log
I20260709 12:28:04.721674 18351 ts_tablet_manager.cc:1403] T e545023b44d846bbb719556f2d284a1e P 8b070276227b44858767bb33e02cc11b: Time spent bootstrapping tablet: real 0.038s	user 0.016s	sys 0.021s
I20260709 12:28:04.721310 18200 leader_election.cc:304] T 3fa608df520c42249d93ddb828490f2d P 1ec72e086a2e41498a8e344cfae3b8f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ec72e086a2e41498a8e344cfae3b8f5; no voters: 5ac1c3901f284979a114ebe1dc69831b, 8b070276227b44858767bb33e02cc11b
I20260709 12:28:04.724143 18354 raft_consensus.cc:2749] T 3fa608df520c42249d93ddb828490f2d P 1ec72e086a2e41498a8e344cfae3b8f5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:04.724567 18353 tablet_bootstrap.cc:492] T a901c0ae9d9f4e82939a611b87bc6014 P 5ac1c3901f284979a114ebe1dc69831b: No bootstrap required, opened a new log
I20260709 12:28:04.725225 18353 ts_tablet_manager.cc:1403] T a901c0ae9d9f4e82939a611b87bc6014 P 5ac1c3901f284979a114ebe1dc69831b: Time spent bootstrapping tablet: real 0.046s	user 0.014s	sys 0.018s
I20260709 12:28:04.726307 18351 raft_consensus.cc:359] T e545023b44d846bbb719556f2d284a1e P 8b070276227b44858767bb33e02cc11b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:04.727047 18350 tablet_bootstrap.cc:492] T 5c0b48a3f0574c0ead9ce938d7ce0fa6 P 1ec72e086a2e41498a8e344cfae3b8f5: No bootstrap required, opened a new log
I20260709 12:28:04.727166 18351 raft_consensus.cc:385] T e545023b44d846bbb719556f2d284a1e P 8b070276227b44858767bb33e02cc11b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:04.727777 18350 ts_tablet_manager.cc:1403] T 5c0b48a3f0574c0ead9ce938d7ce0fa6 P 1ec72e086a2e41498a8e344cfae3b8f5: Time spent bootstrapping tablet: real 0.034s	user 0.017s	sys 0.000s
I20260709 12:28:04.727705 18351 raft_consensus.cc:740] T e545023b44d846bbb719556f2d284a1e P 8b070276227b44858767bb33e02cc11b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b070276227b44858767bb33e02cc11b, State: Initialized, Role: FOLLOWER
I20260709 12:28:04.728705 18353 raft_consensus.cc:359] T a901c0ae9d9f4e82939a611b87bc6014 P 5ac1c3901f284979a114ebe1dc69831b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:04.728786 18351 consensus_queue.cc:260] T e545023b44d846bbb719556f2d284a1e P 8b070276227b44858767bb33e02cc11b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:04.729593 18353 raft_consensus.cc:385] T a901c0ae9d9f4e82939a611b87bc6014 P 5ac1c3901f284979a114ebe1dc69831b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:04.729949 18353 raft_consensus.cc:740] T a901c0ae9d9f4e82939a611b87bc6014 P 5ac1c3901f284979a114ebe1dc69831b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ac1c3901f284979a114ebe1dc69831b, State: Initialized, Role: FOLLOWER
I20260709 12:28:04.730790 18350 raft_consensus.cc:359] T 5c0b48a3f0574c0ead9ce938d7ce0fa6 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:04.731424 18351 ts_tablet_manager.cc:1434] T e545023b44d846bbb719556f2d284a1e P 8b070276227b44858767bb33e02cc11b: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.002s
I20260709 12:28:04.730929 18353 consensus_queue.cc:260] T a901c0ae9d9f4e82939a611b87bc6014 P 5ac1c3901f284979a114ebe1dc69831b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:04.731695 18350 raft_consensus.cc:385] T 5c0b48a3f0574c0ead9ce938d7ce0fa6 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:04.732086 18350 raft_consensus.cc:740] T 5c0b48a3f0574c0ead9ce938d7ce0fa6 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ec72e086a2e41498a8e344cfae3b8f5, State: Initialized, Role: FOLLOWER
I20260709 12:28:04.732690 18351 tablet_bootstrap.cc:492] T 5c0b48a3f0574c0ead9ce938d7ce0fa6 P 8b070276227b44858767bb33e02cc11b: Bootstrap starting.
I20260709 12:28:04.733049 18350 consensus_queue.cc:260] T 5c0b48a3f0574c0ead9ce938d7ce0fa6 P 1ec72e086a2e41498a8e344cfae3b8f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:04.738322 18353 ts_tablet_manager.cc:1434] T a901c0ae9d9f4e82939a611b87bc6014 P 5ac1c3901f284979a114ebe1dc69831b: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.002s
I20260709 12:28:04.739264 18350 ts_tablet_manager.cc:1434] T 5c0b48a3f0574c0ead9ce938d7ce0fa6 P 1ec72e086a2e41498a8e344cfae3b8f5: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:28:04.739674 18353 tablet_bootstrap.cc:492] T d88e2a949fe645c8a5bd2a10fcd84b0d P 5ac1c3901f284979a114ebe1dc69831b: Bootstrap starting.
I20260709 12:28:04.740621 18351 tablet_bootstrap.cc:654] T 5c0b48a3f0574c0ead9ce938d7ce0fa6 P 8b070276227b44858767bb33e02cc11b: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:04.740717 18350 tablet_bootstrap.cc:492] T d88e2a949fe645c8a5bd2a10fcd84b0d P 1ec72e086a2e41498a8e344cfae3b8f5: Bootstrap starting.
I20260709 12:28:04.748804 18353 tablet_bootstrap.cc:654] T d88e2a949fe645c8a5bd2a10fcd84b0d P 5ac1c3901f284979a114ebe1dc69831b: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:04.757082 18350 tablet_bootstrap.cc:654] T d88e2a949fe645c8a5bd2a10fcd84b0d P 1ec72e086a2e41498a8e344cfae3b8f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:04.763345 18353 tablet_bootstrap.cc:492] T d88e2a949fe645c8a5bd2a10fcd84b0d P 5ac1c3901f284979a114ebe1dc69831b: No bootstrap required, opened a new log
I20260709 12:28:04.764276 18353 ts_tablet_manager.cc:1403] T d88e2a949fe645c8a5bd2a10fcd84b0d P 5ac1c3901f284979a114ebe1dc69831b: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.008s
I20260709 12:28:04.766762 18351 tablet_bootstrap.cc:492] T 5c0b48a3f0574c0ead9ce938d7ce0fa6 P 8b070276227b44858767bb33e02cc11b: No bootstrap required, opened a new log
I20260709 12:28:04.767369 18351 ts_tablet_manager.cc:1403] T 5c0b48a3f0574c0ead9ce938d7ce0fa6 P 8b070276227b44858767bb33e02cc11b: Time spent bootstrapping tablet: real 0.035s	user 0.017s	sys 0.017s
I20260709 12:28:04.767422 18353 raft_consensus.cc:359] T d88e2a949fe645c8a5bd2a10fcd84b0d P 5ac1c3901f284979a114ebe1dc69831b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:04.768407 18353 raft_consensus.cc:385] T d88e2a949fe645c8a5bd2a10fcd84b0d P 5ac1c3901f284979a114ebe1dc69831b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:04.768713 18353 raft_consensus.cc:740] T d88e2a949fe645c8a5bd2a10fcd84b0d P 5ac1c3901f284979a114ebe1dc69831b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ac1c3901f284979a114ebe1dc69831b, State: Initialized, Role: FOLLOWER
I20260709 12:28:04.769562 18350 tablet_bootstrap.cc:492] T d88e2a949fe645c8a5bd2a10fcd84b0d P 1ec72e086a2e41498a8e344cfae3b8f5: No bootstrap required, opened a new log
I20260709 12:28:04.770079 18350 ts_tablet_manager.cc:1403] T d88e2a949fe645c8a5bd2a10fcd84b0d P 1ec72e086a2e41498a8e344cfae3b8f5: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.004s
I20260709 12:28:04.769646 18353 consensus_queue.cc:260] T d88e2a949fe645c8a5bd2a10fcd84b0d P 5ac1c3901f284979a114ebe1dc69831b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:04.770665 18351 raft_consensus.cc:359] T 5c0b48a3f0574c0ead9ce938d7ce0fa6 P 8b070276227b44858767bb33e02cc11b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:04.771399 18351 raft_consensus.cc:385] T 5c0b48a3f0574c0ead9ce938d7ce0fa6 P 8b070276227b44858767bb33e02cc11b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:04.771730 18351 raft_consensus.cc:740] T 5c0b48a3f0574c0ead9ce938d7ce0fa6 P 8b070276227b44858767bb33e02cc11b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b070276227b44858767bb33e02cc11b, State: Initialized, Role: FOLLOWER
I20260709 12:28:04.772838 18353 ts_tablet_manager.cc:1434] T d88e2a949fe645c8a5bd2a10fcd84b0d P 5ac1c3901f284979a114ebe1dc69831b: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:28:04.773089 18351 consensus_queue.cc:260] T 5c0b48a3f0574c0ead9ce938d7ce0fa6 P 8b070276227b44858767bb33e02cc11b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:04.773216 18350 raft_consensus.cc:359] T d88e2a949fe645c8a5bd2a10fcd84b0d P 1ec72e086a2e41498a8e344cfae3b8f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:04.774130 18353 tablet_bootstrap.cc:492] T e545023b44d846bbb719556f2d284a1e P 5ac1c3901f284979a114ebe1dc69831b: Bootstrap starting.
I20260709 12:28:04.774286 18350 raft_consensus.cc:385] T d88e2a949fe645c8a5bd2a10fcd84b0d P 1ec72e086a2e41498a8e344cfae3b8f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:04.774642 18350 raft_consensus.cc:740] T d88e2a949fe645c8a5bd2a10fcd84b0d P 1ec72e086a2e41498a8e344cfae3b8f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ec72e086a2e41498a8e344cfae3b8f5, State: Initialized, Role: FOLLOWER
I20260709 12:28:04.775731 18351 ts_tablet_manager.cc:1434] T 5c0b48a3f0574c0ead9ce938d7ce0fa6 P 8b070276227b44858767bb33e02cc11b: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:28:04.775501 18350 consensus_queue.cc:260] T d88e2a949fe645c8a5bd2a10fcd84b0d P 1ec72e086a2e41498a8e344cfae3b8f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:04.776794 18351 tablet_bootstrap.cc:492] T c9cdcf5095a14f4db2efdef9465c5719 P 8b070276227b44858767bb33e02cc11b: Bootstrap starting.
I20260709 12:28:04.781510 18353 tablet_bootstrap.cc:654] T e545023b44d846bbb719556f2d284a1e P 5ac1c3901f284979a114ebe1dc69831b: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:04.784672 18351 tablet_bootstrap.cc:654] T c9cdcf5095a14f4db2efdef9465c5719 P 8b070276227b44858767bb33e02cc11b: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:04.785476 18350 ts_tablet_manager.cc:1434] T d88e2a949fe645c8a5bd2a10fcd84b0d P 1ec72e086a2e41498a8e344cfae3b8f5: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:28:04.789682 18350 tablet_bootstrap.cc:492] T 2452f65bb1e24de4b47df9d6efcb5443 P 1ec72e086a2e41498a8e344cfae3b8f5: Bootstrap starting.
I20260709 12:28:04.800998 18350 tablet_bootstrap.cc:654] T 2452f65bb1e24de4b47df9d6efcb5443 P 1ec72e086a2e41498a8e344cfae3b8f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:04.802829 18353 tablet_bootstrap.cc:492] T e545023b44d846bbb719556f2d284a1e P 5ac1c3901f284979a114ebe1dc69831b: No bootstrap required, opened a new log
I20260709 12:28:04.803516 18353 ts_tablet_manager.cc:1403] T e545023b44d846bbb719556f2d284a1e P 5ac1c3901f284979a114ebe1dc69831b: Time spent bootstrapping tablet: real 0.030s	user 0.016s	sys 0.003s
I20260709 12:28:04.805635 18351 tablet_bootstrap.cc:492] T c9cdcf5095a14f4db2efdef9465c5719 P 8b070276227b44858767bb33e02cc11b: No bootstrap required, opened a new log
I20260709 12:28:04.806381 18358 raft_consensus.cc:493] T f7836af3dd864d4cbc3a4f9ee717a6ee P 8b070276227b44858767bb33e02cc11b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:04.806552 18351 ts_tablet_manager.cc:1403] T c9cdcf5095a14f4db2efdef9465c5719 P 8b070276227b44858767bb33e02cc11b: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.008s
I20260709 12:28:04.806783 18353 raft_consensus.cc:359] T e545023b44d846bbb719556f2d284a1e P 5ac1c3901f284979a114ebe1dc69831b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:04.806979 18358 raft_consensus.cc:515] T f7836af3dd864d4cbc3a4f9ee717a6ee P 8b070276227b44858767bb33e02cc11b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:04.807864 18353 raft_consensus.cc:385] T e545023b44d846bbb719556f2d284a1e P 5ac1c3901f284979a114ebe1dc69831b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:04.808182 18353 raft_consensus.cc:740] T e545023b44d846bbb719556f2d284a1e P 5ac1c3901f284979a114ebe1dc69831b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ac1c3901f284979a114ebe1dc69831b, State: Initialized, Role: FOLLOWER
I20260709 12:28:04.809126 18353 consensus_queue.cc:260] T e545023b44d846bbb719556f2d284a1e P 5ac1c3901f284979a114ebe1dc69831b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:04.811928 18353 ts_tablet_manager.cc:1434] T e545023b44d846bbb719556f2d284a1e P 5ac1c3901f284979a114ebe1dc69831b: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:28:04.813654 18353 tablet_bootstrap.cc:492] T 3fa608df520c42249d93ddb828490f2d P 5ac1c3901f284979a114ebe1dc69831b: Bootstrap starting.
I20260709 12:28:04.813392 18359 raft_consensus.cc:493] T c9cdcf5095a14f4db2efdef9465c5719 P 5ac1c3901f284979a114ebe1dc69831b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:04.814556 18359 raft_consensus.cc:515] T c9cdcf5095a14f4db2efdef9465c5719 P 5ac1c3901f284979a114ebe1dc69831b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } } peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } }
I20260709 12:28:04.811350 18351 raft_consensus.cc:359] T c9cdcf5095a14f4db2efdef9465c5719 P 8b070276227b44858767bb33e02cc11b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } } peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } }
I20260709 12:28:04.824105 18351 raft_consensus.cc:385] T c9cdcf5095a14f4db2efdef9465c5719 P 8b070276227b44858767bb33e02cc11b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:04.824597 18351 raft_consensus.cc:740] T c9cdcf5095a14f4db2efdef9465c5719 P 8b070276227b44858767bb33e02cc11b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b070276227b44858767bb33e02cc11b, State: Initialized, Role: FOLLOWER
I20260709 12:28:04.825675 18351 consensus_queue.cc:260] T c9cdcf5095a14f4db2efdef9465c5719 P 8b070276227b44858767bb33e02cc11b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } } peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } }
I20260709 12:28:04.820035 18358 leader_election.cc:290] T f7836af3dd864d4cbc3a4f9ee717a6ee P 8b070276227b44858767bb33e02cc11b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785), 1ec72e086a2e41498a8e344cfae3b8f5 (127.9.116.66:41289)
I20260709 12:28:04.837361 18350 tablet_bootstrap.cc:492] T 2452f65bb1e24de4b47df9d6efcb5443 P 1ec72e086a2e41498a8e344cfae3b8f5: No bootstrap required, opened a new log
I20260709 12:28:04.843470 18354 raft_consensus.cc:493] T 019a279ca008410abf88a5dc9f30974a P 1ec72e086a2e41498a8e344cfae3b8f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:04.845041 18354 raft_consensus.cc:515] T 019a279ca008410abf88a5dc9f30974a P 1ec72e086a2e41498a8e344cfae3b8f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:04.843757 18350 ts_tablet_manager.cc:1403] T 2452f65bb1e24de4b47df9d6efcb5443 P 1ec72e086a2e41498a8e344cfae3b8f5: Time spent bootstrapping tablet: real 0.054s	user 0.020s	sys 0.012s
I20260709 12:28:04.850586 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a279ca008410abf88a5dc9f30974a" candidate_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b070276227b44858767bb33e02cc11b" is_pre_election: true
I20260709 12:28:04.853068 18350 raft_consensus.cc:359] T 2452f65bb1e24de4b47df9d6efcb5443 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:04.854856 18350 raft_consensus.cc:385] T 2452f65bb1e24de4b47df9d6efcb5443 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:04.855247 18350 raft_consensus.cc:740] T 2452f65bb1e24de4b47df9d6efcb5443 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ec72e086a2e41498a8e344cfae3b8f5, State: Initialized, Role: FOLLOWER
W20260709 12:28:04.856981 18200 leader_election.cc:343] T 019a279ca008410abf88a5dc9f30974a P 1ec72e086a2e41498a8e344cfae3b8f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b070276227b44858767bb33e02cc11b (127.9.116.67:41781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:04.858173 18354 leader_election.cc:290] T 019a279ca008410abf88a5dc9f30974a P 1ec72e086a2e41498a8e344cfae3b8f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785), 8b070276227b44858767bb33e02cc11b (127.9.116.67:41781)
I20260709 12:28:04.861379 18159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a279ca008410abf88a5dc9f30974a" candidate_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ac1c3901f284979a114ebe1dc69831b" is_pre_election: true
I20260709 12:28:04.862684 18159 raft_consensus.cc:2468] T 019a279ca008410abf88a5dc9f30974a P 5ac1c3901f284979a114ebe1dc69831b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ec72e086a2e41498a8e344cfae3b8f5 in term 0.
I20260709 12:28:04.863646 18353 tablet_bootstrap.cc:654] T 3fa608df520c42249d93ddb828490f2d P 5ac1c3901f284979a114ebe1dc69831b: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:04.833418 18359 leader_election.cc:290] T c9cdcf5095a14f4db2efdef9465c5719 P 5ac1c3901f284979a114ebe1dc69831b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ec72e086a2e41498a8e344cfae3b8f5 (127.9.116.66:41289), 8b070276227b44858767bb33e02cc11b (127.9.116.67:41781)
I20260709 12:28:04.869237 18350 consensus_queue.cc:260] T 2452f65bb1e24de4b47df9d6efcb5443 P 1ec72e086a2e41498a8e344cfae3b8f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:04.870999 18200 leader_election.cc:304] T 019a279ca008410abf88a5dc9f30974a P 1ec72e086a2e41498a8e344cfae3b8f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ec72e086a2e41498a8e344cfae3b8f5, 5ac1c3901f284979a114ebe1dc69831b; no voters: 8b070276227b44858767bb33e02cc11b
I20260709 12:28:04.874697 18350 ts_tablet_manager.cc:1434] T 2452f65bb1e24de4b47df9d6efcb5443 P 1ec72e086a2e41498a8e344cfae3b8f5: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.003s
I20260709 12:28:04.880595 18354 raft_consensus.cc:2804] T 019a279ca008410abf88a5dc9f30974a P 1ec72e086a2e41498a8e344cfae3b8f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:04.888377 18354 raft_consensus.cc:493] T 019a279ca008410abf88a5dc9f30974a P 1ec72e086a2e41498a8e344cfae3b8f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:04.889011 18354 raft_consensus.cc:3060] T 019a279ca008410abf88a5dc9f30974a P 1ec72e086a2e41498a8e344cfae3b8f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:04.897591 18351 ts_tablet_manager.cc:1434] T c9cdcf5095a14f4db2efdef9465c5719 P 8b070276227b44858767bb33e02cc11b: Time spent starting tablet: real 0.090s	user 0.015s	sys 0.031s
I20260709 12:28:04.903370 18358 raft_consensus.cc:493] T a901c0ae9d9f4e82939a611b87bc6014 P 8b070276227b44858767bb33e02cc11b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:04.904098 18358 raft_consensus.cc:515] T a901c0ae9d9f4e82939a611b87bc6014 P 8b070276227b44858767bb33e02cc11b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:04.906420 18358 leader_election.cc:290] T a901c0ae9d9f4e82939a611b87bc6014 P 8b070276227b44858767bb33e02cc11b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785), 1ec72e086a2e41498a8e344cfae3b8f5 (127.9.116.66:41289)
I20260709 12:28:04.906657 18350 tablet_bootstrap.cc:492] T c9cdcf5095a14f4db2efdef9465c5719 P 1ec72e086a2e41498a8e344cfae3b8f5: Bootstrap starting.
I20260709 12:28:04.907814 18351 tablet_bootstrap.cc:492] T 2452f65bb1e24de4b47df9d6efcb5443 P 8b070276227b44858767bb33e02cc11b: Bootstrap starting.
W20260709 12:28:04.916908 18200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:43785, user_credentials={real_user=slave}} blocked reactor thread for 45069.7us
I20260709 12:28:04.920665 18359 raft_consensus.cc:493] T ec13962b83ce4b6ebe53124d2fdddcd5 P 5ac1c3901f284979a114ebe1dc69831b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:04.923026 18359 raft_consensus.cc:515] T ec13962b83ce4b6ebe53124d2fdddcd5 P 5ac1c3901f284979a114ebe1dc69831b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:04.924117 18385 raft_consensus.cc:493] T d88e2a949fe645c8a5bd2a10fcd84b0d P 1ec72e086a2e41498a8e344cfae3b8f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:04.925087 18385 raft_consensus.cc:515] T d88e2a949fe645c8a5bd2a10fcd84b0d P 1ec72e086a2e41498a8e344cfae3b8f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:04.927544 18350 tablet_bootstrap.cc:654] T c9cdcf5095a14f4db2efdef9465c5719 P 1ec72e086a2e41498a8e344cfae3b8f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:04.929549 18159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7836af3dd864d4cbc3a4f9ee717a6ee" candidate_uuid: "8b070276227b44858767bb33e02cc11b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ac1c3901f284979a114ebe1dc69831b" is_pre_election: true
I20260709 12:28:04.930675 18159 raft_consensus.cc:2468] T f7836af3dd864d4cbc3a4f9ee717a6ee P 5ac1c3901f284979a114ebe1dc69831b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b070276227b44858767bb33e02cc11b in term 0.
I20260709 12:28:04.929894 18385 leader_election.cc:290] T d88e2a949fe645c8a5bd2a10fcd84b0d P 1ec72e086a2e41498a8e344cfae3b8f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785), 8b070276227b44858767bb33e02cc11b (127.9.116.67:41781)
I20260709 12:28:04.931087 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7836af3dd864d4cbc3a4f9ee717a6ee" candidate_uuid: "8b070276227b44858767bb33e02cc11b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" is_pre_election: true
I20260709 12:28:04.931915 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88e2a949fe645c8a5bd2a10fcd84b0d" candidate_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b070276227b44858767bb33e02cc11b" is_pre_election: true
I20260709 12:28:04.932907 18234 raft_consensus.cc:2468] T f7836af3dd864d4cbc3a4f9ee717a6ee P 1ec72e086a2e41498a8e344cfae3b8f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b070276227b44858767bb33e02cc11b in term 0.
I20260709 12:28:04.936002 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a901c0ae9d9f4e82939a611b87bc6014" candidate_uuid: "8b070276227b44858767bb33e02cc11b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" is_pre_election: true
I20260709 12:28:04.936153 18274 leader_election.cc:304] T f7836af3dd864d4cbc3a4f9ee717a6ee P 8b070276227b44858767bb33e02cc11b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ac1c3901f284979a114ebe1dc69831b, 8b070276227b44858767bb33e02cc11b; no voters: 
I20260709 12:28:04.938496 18381 raft_consensus.cc:2804] T f7836af3dd864d4cbc3a4f9ee717a6ee P 8b070276227b44858767bb33e02cc11b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:04.939216 18381 raft_consensus.cc:493] T f7836af3dd864d4cbc3a4f9ee717a6ee P 8b070276227b44858767bb33e02cc11b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:04.939747 18381 raft_consensus.cc:3060] T f7836af3dd864d4cbc3a4f9ee717a6ee P 8b070276227b44858767bb33e02cc11b [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:28:04.942016 18200 leader_election.cc:343] T d88e2a949fe645c8a5bd2a10fcd84b0d P 1ec72e086a2e41498a8e344cfae3b8f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b070276227b44858767bb33e02cc11b (127.9.116.67:41781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:04.932313 18158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a901c0ae9d9f4e82939a611b87bc6014" candidate_uuid: "8b070276227b44858767bb33e02cc11b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ac1c3901f284979a114ebe1dc69831b" is_pre_election: true
I20260709 12:28:04.944269 18158 raft_consensus.cc:2468] T a901c0ae9d9f4e82939a611b87bc6014 P 5ac1c3901f284979a114ebe1dc69831b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b070276227b44858767bb33e02cc11b in term 0.
W20260709 12:28:04.945430 18271 leader_election.cc:343] T a901c0ae9d9f4e82939a611b87bc6014 P 8b070276227b44858767bb33e02cc11b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1ec72e086a2e41498a8e344cfae3b8f5 (127.9.116.66:41289): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:04.946734 18274 leader_election.cc:304] T a901c0ae9d9f4e82939a611b87bc6014 P 8b070276227b44858767bb33e02cc11b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ac1c3901f284979a114ebe1dc69831b, 8b070276227b44858767bb33e02cc11b; no voters: 1ec72e086a2e41498a8e344cfae3b8f5
I20260709 12:28:04.947146 18359 leader_election.cc:290] T ec13962b83ce4b6ebe53124d2fdddcd5 P 5ac1c3901f284979a114ebe1dc69831b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ec72e086a2e41498a8e344cfae3b8f5 (127.9.116.66:41289), 8b070276227b44858767bb33e02cc11b (127.9.116.67:41781)
I20260709 12:28:04.947783 18359 raft_consensus.cc:493] T f7836af3dd864d4cbc3a4f9ee717a6ee P 5ac1c3901f284979a114ebe1dc69831b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:04.947916 18358 raft_consensus.cc:2804] T a901c0ae9d9f4e82939a611b87bc6014 P 8b070276227b44858767bb33e02cc11b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:04.948304 18359 raft_consensus.cc:515] T f7836af3dd864d4cbc3a4f9ee717a6ee P 5ac1c3901f284979a114ebe1dc69831b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:04.948619 18358 raft_consensus.cc:493] T a901c0ae9d9f4e82939a611b87bc6014 P 8b070276227b44858767bb33e02cc11b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:04.949196 18358 raft_consensus.cc:3060] T a901c0ae9d9f4e82939a611b87bc6014 P 8b070276227b44858767bb33e02cc11b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:04.950390 18359 leader_election.cc:290] T f7836af3dd864d4cbc3a4f9ee717a6ee P 5ac1c3901f284979a114ebe1dc69831b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ec72e086a2e41498a8e344cfae3b8f5 (127.9.116.66:41289), 8b070276227b44858767bb33e02cc11b (127.9.116.67:41781)
I20260709 12:28:04.928843 18354 raft_consensus.cc:515] T 019a279ca008410abf88a5dc9f30974a P 1ec72e086a2e41498a8e344cfae3b8f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:04.959477 18353 tablet_bootstrap.cc:492] T 3fa608df520c42249d93ddb828490f2d P 5ac1c3901f284979a114ebe1dc69831b: No bootstrap required, opened a new log
I20260709 12:28:04.960212 18353 ts_tablet_manager.cc:1403] T 3fa608df520c42249d93ddb828490f2d P 5ac1c3901f284979a114ebe1dc69831b: Time spent bootstrapping tablet: real 0.147s	user 0.016s	sys 0.006s
I20260709 12:28:04.963521 18353 raft_consensus.cc:359] T 3fa608df520c42249d93ddb828490f2d P 5ac1c3901f284979a114ebe1dc69831b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:04.964277 18353 raft_consensus.cc:385] T 3fa608df520c42249d93ddb828490f2d P 5ac1c3901f284979a114ebe1dc69831b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:04.964576 18353 raft_consensus.cc:740] T 3fa608df520c42249d93ddb828490f2d P 5ac1c3901f284979a114ebe1dc69831b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ac1c3901f284979a114ebe1dc69831b, State: Initialized, Role: FOLLOWER
I20260709 12:28:04.968446 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a279ca008410abf88a5dc9f30974a" candidate_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b070276227b44858767bb33e02cc11b"
W20260709 12:28:04.970606 18200 leader_election.cc:343] T 019a279ca008410abf88a5dc9f30974a P 1ec72e086a2e41498a8e344cfae3b8f5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8b070276227b44858767bb33e02cc11b (127.9.116.67:41781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:04.971268 18353 consensus_queue.cc:260] T 3fa608df520c42249d93ddb828490f2d P 5ac1c3901f284979a114ebe1dc69831b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:04.975670 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13962b83ce4b6ebe53124d2fdddcd5" candidate_uuid: "5ac1c3901f284979a114ebe1dc69831b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b070276227b44858767bb33e02cc11b" is_pre_election: true
I20260709 12:28:04.976696 18351 tablet_bootstrap.cc:654] T 2452f65bb1e24de4b47df9d6efcb5443 P 8b070276227b44858767bb33e02cc11b: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:04.976857 18307 raft_consensus.cc:2468] T ec13962b83ce4b6ebe53124d2fdddcd5 P 8b070276227b44858767bb33e02cc11b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ac1c3901f284979a114ebe1dc69831b in term 0.
I20260709 12:28:04.979152 18158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88e2a949fe645c8a5bd2a10fcd84b0d" candidate_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ac1c3901f284979a114ebe1dc69831b" is_pre_election: true
I20260709 12:28:04.980319 18158 raft_consensus.cc:2468] T d88e2a949fe645c8a5bd2a10fcd84b0d P 5ac1c3901f284979a114ebe1dc69831b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ec72e086a2e41498a8e344cfae3b8f5 in term 0.
I20260709 12:28:04.978984 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7836af3dd864d4cbc3a4f9ee717a6ee" candidate_uuid: "5ac1c3901f284979a114ebe1dc69831b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b070276227b44858767bb33e02cc11b" is_pre_election: true
I20260709 12:28:04.980954 18125 leader_election.cc:304] T ec13962b83ce4b6ebe53124d2fdddcd5 P 5ac1c3901f284979a114ebe1dc69831b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ac1c3901f284979a114ebe1dc69831b, 8b070276227b44858767bb33e02cc11b; no voters: 
I20260709 12:28:04.982578 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cdcf5095a14f4db2efdef9465c5719" candidate_uuid: "5ac1c3901f284979a114ebe1dc69831b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b070276227b44858767bb33e02cc11b" is_pre_election: true
I20260709 12:28:04.982734 18158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a279ca008410abf88a5dc9f30974a" candidate_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ac1c3901f284979a114ebe1dc69831b"
I20260709 12:28:04.983629 18308 raft_consensus.cc:2468] T c9cdcf5095a14f4db2efdef9465c5719 P 8b070276227b44858767bb33e02cc11b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ac1c3901f284979a114ebe1dc69831b in term 0.
I20260709 12:28:04.983718 18158 raft_consensus.cc:3060] T 019a279ca008410abf88a5dc9f30974a P 5ac1c3901f284979a114ebe1dc69831b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:04.983938 18387 raft_consensus.cc:2804] T ec13962b83ce4b6ebe53124d2fdddcd5 P 5ac1c3901f284979a114ebe1dc69831b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:04.984498 18387 raft_consensus.cc:493] T ec13962b83ce4b6ebe53124d2fdddcd5 P 5ac1c3901f284979a114ebe1dc69831b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:04.984858 18387 raft_consensus.cc:3060] T ec13962b83ce4b6ebe53124d2fdddcd5 P 5ac1c3901f284979a114ebe1dc69831b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:04.985170 18125 leader_election.cc:304] T c9cdcf5095a14f4db2efdef9465c5719 P 5ac1c3901f284979a114ebe1dc69831b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ac1c3901f284979a114ebe1dc69831b, 8b070276227b44858767bb33e02cc11b; no voters: 
I20260709 12:28:04.985297 18385 raft_consensus.cc:493] T 5c0b48a3f0574c0ead9ce938d7ce0fa6 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:04.985872 18353 ts_tablet_manager.cc:1434] T 3fa608df520c42249d93ddb828490f2d P 5ac1c3901f284979a114ebe1dc69831b: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 12:28:04.985965 18385 raft_consensus.cc:515] T 5c0b48a3f0574c0ead9ce938d7ce0fa6 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:04.986420 18354 leader_election.cc:290] T 019a279ca008410abf88a5dc9f30974a P 1ec72e086a2e41498a8e344cfae3b8f5 [CANDIDATE]: Term 1 election: Requested vote from peers 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785), 8b070276227b44858767bb33e02cc11b (127.9.116.67:41781)
I20260709 12:28:04.988992 18385 leader_election.cc:290] T 5c0b48a3f0574c0ead9ce938d7ce0fa6 P 1ec72e086a2e41498a8e344cfae3b8f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785), 8b070276227b44858767bb33e02cc11b (127.9.116.67:41781)
I20260709 12:28:04.986050 18359 raft_consensus.cc:2804] T c9cdcf5095a14f4db2efdef9465c5719 P 5ac1c3901f284979a114ebe1dc69831b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:04.989957 18359 raft_consensus.cc:493] T c9cdcf5095a14f4db2efdef9465c5719 P 5ac1c3901f284979a114ebe1dc69831b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:04.990223 18350 tablet_bootstrap.cc:492] T c9cdcf5095a14f4db2efdef9465c5719 P 1ec72e086a2e41498a8e344cfae3b8f5: No bootstrap required, opened a new log
I20260709 12:28:04.990398 18359 raft_consensus.cc:3060] T c9cdcf5095a14f4db2efdef9465c5719 P 5ac1c3901f284979a114ebe1dc69831b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:04.992838 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c0b48a3f0574c0ead9ce938d7ce0fa6" candidate_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b070276227b44858767bb33e02cc11b" is_pre_election: true
I20260709 12:28:04.993551 18308 raft_consensus.cc:2468] T 5c0b48a3f0574c0ead9ce938d7ce0fa6 P 8b070276227b44858767bb33e02cc11b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ec72e086a2e41498a8e344cfae3b8f5 in term 0.
I20260709 12:28:04.995103 18200 leader_election.cc:304] T 5c0b48a3f0574c0ead9ce938d7ce0fa6 P 1ec72e086a2e41498a8e344cfae3b8f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ec72e086a2e41498a8e344cfae3b8f5, 8b070276227b44858767bb33e02cc11b; no voters: 
I20260709 12:28:04.990815 18350 ts_tablet_manager.cc:1403] T c9cdcf5095a14f4db2efdef9465c5719 P 1ec72e086a2e41498a8e344cfae3b8f5: Time spent bootstrapping tablet: real 0.084s	user 0.014s	sys 0.001s
I20260709 12:28:04.995869 18353 tablet_bootstrap.cc:492] T 5c0b48a3f0574c0ead9ce938d7ce0fa6 P 5ac1c3901f284979a114ebe1dc69831b: Bootstrap starting.
I20260709 12:28:04.996192 18385 raft_consensus.cc:2804] T 5c0b48a3f0574c0ead9ce938d7ce0fa6 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:04.996925 18385 raft_consensus.cc:493] T 5c0b48a3f0574c0ead9ce938d7ce0fa6 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:04.997478 18385 raft_consensus.cc:3060] T 5c0b48a3f0574c0ead9ce938d7ce0fa6 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:04.997973 18381 raft_consensus.cc:515] T f7836af3dd864d4cbc3a4f9ee717a6ee P 8b070276227b44858767bb33e02cc11b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:04.999007 18350 raft_consensus.cc:359] T c9cdcf5095a14f4db2efdef9465c5719 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } } peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } }
I20260709 12:28:04.999540 18306 raft_consensus.cc:2393] T f7836af3dd864d4cbc3a4f9ee717a6ee P 8b070276227b44858767bb33e02cc11b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ac1c3901f284979a114ebe1dc69831b in current term 1: Already voted for candidate 8b070276227b44858767bb33e02cc11b in this term.
I20260709 12:28:05.003073 18353 tablet_bootstrap.cc:654] T 5c0b48a3f0574c0ead9ce938d7ce0fa6 P 5ac1c3901f284979a114ebe1dc69831b: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:05.003532 18351 tablet_bootstrap.cc:492] T 2452f65bb1e24de4b47df9d6efcb5443 P 8b070276227b44858767bb33e02cc11b: No bootstrap required, opened a new log
I20260709 12:28:05.003986 18350 raft_consensus.cc:385] T c9cdcf5095a14f4db2efdef9465c5719 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:05.004199 18351 ts_tablet_manager.cc:1403] T 2452f65bb1e24de4b47df9d6efcb5443 P 8b070276227b44858767bb33e02cc11b: Time spent bootstrapping tablet: real 0.097s	user 0.014s	sys 0.004s
I20260709 12:28:05.004391 18350 raft_consensus.cc:740] T c9cdcf5095a14f4db2efdef9465c5719 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ec72e086a2e41498a8e344cfae3b8f5, State: Initialized, Role: FOLLOWER
I20260709 12:28:05.004760 18200 leader_election.cc:304] T d88e2a949fe645c8a5bd2a10fcd84b0d P 1ec72e086a2e41498a8e344cfae3b8f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ec72e086a2e41498a8e344cfae3b8f5, 5ac1c3901f284979a114ebe1dc69831b; no voters: 8b070276227b44858767bb33e02cc11b
I20260709 12:28:05.005811 18354 raft_consensus.cc:2804] T d88e2a949fe645c8a5bd2a10fcd84b0d P 1ec72e086a2e41498a8e344cfae3b8f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:04.990330 18358 raft_consensus.cc:515] T a901c0ae9d9f4e82939a611b87bc6014 P 8b070276227b44858767bb33e02cc11b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:05.006469 18354 raft_consensus.cc:493] T d88e2a949fe645c8a5bd2a10fcd84b0d P 1ec72e086a2e41498a8e344cfae3b8f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:05.007048 18354 raft_consensus.cc:3060] T d88e2a949fe645c8a5bd2a10fcd84b0d P 1ec72e086a2e41498a8e344cfae3b8f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:05.007761 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cdcf5095a14f4db2efdef9465c5719" candidate_uuid: "5ac1c3901f284979a114ebe1dc69831b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" is_pre_election: true
I20260709 12:28:05.010406 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13962b83ce4b6ebe53124d2fdddcd5" candidate_uuid: "5ac1c3901f284979a114ebe1dc69831b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" is_pre_election: true
I20260709 12:28:05.005558 18350 consensus_queue.cc:260] T c9cdcf5095a14f4db2efdef9465c5719 P 1ec72e086a2e41498a8e344cfae3b8f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } } peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } }
I20260709 12:28:05.011802 18233 raft_consensus.cc:2468] T c9cdcf5095a14f4db2efdef9465c5719 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ac1c3901f284979a114ebe1dc69831b in term 0.
I20260709 12:28:05.013311 18157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7836af3dd864d4cbc3a4f9ee717a6ee" candidate_uuid: "8b070276227b44858767bb33e02cc11b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ac1c3901f284979a114ebe1dc69831b"
I20260709 12:28:05.010483 18159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a901c0ae9d9f4e82939a611b87bc6014" candidate_uuid: "8b070276227b44858767bb33e02cc11b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ac1c3901f284979a114ebe1dc69831b"
I20260709 12:28:05.014847 18157 raft_consensus.cc:3060] T f7836af3dd864d4cbc3a4f9ee717a6ee P 5ac1c3901f284979a114ebe1dc69831b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:05.014914 18159 raft_consensus.cc:3060] T a901c0ae9d9f4e82939a611b87bc6014 P 5ac1c3901f284979a114ebe1dc69831b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:05.018700 18358 leader_election.cc:290] T a901c0ae9d9f4e82939a611b87bc6014 P 8b070276227b44858767bb33e02cc11b [CANDIDATE]: Term 1 election: Requested vote from peers 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785), 1ec72e086a2e41498a8e344cfae3b8f5 (127.9.116.66:41289)
I20260709 12:28:05.020174 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a901c0ae9d9f4e82939a611b87bc6014" candidate_uuid: "8b070276227b44858767bb33e02cc11b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ec72e086a2e41498a8e344cfae3b8f5"
I20260709 12:28:05.022795 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7836af3dd864d4cbc3a4f9ee717a6ee" candidate_uuid: "5ac1c3901f284979a114ebe1dc69831b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" is_pre_election: true
I20260709 12:28:05.023799 18234 raft_consensus.cc:2468] T f7836af3dd864d4cbc3a4f9ee717a6ee P 1ec72e086a2e41498a8e344cfae3b8f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ac1c3901f284979a114ebe1dc69831b in term 0.
I20260709 12:28:05.024449 18156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c0b48a3f0574c0ead9ce938d7ce0fa6" candidate_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ac1c3901f284979a114ebe1dc69831b" is_pre_election: true
W20260709 12:28:05.027066 18200 leader_election.cc:343] T 5c0b48a3f0574c0ead9ce938d7ce0fa6 P 1ec72e086a2e41498a8e344cfae3b8f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:28:05.028293 18271 leader_election.cc:343] T a901c0ae9d9f4e82939a611b87bc6014 P 8b070276227b44858767bb33e02cc11b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1ec72e086a2e41498a8e344cfae3b8f5 (127.9.116.66:41289): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:28:05.029157 18122 leader_election.cc:343] T ec13962b83ce4b6ebe53124d2fdddcd5 P 5ac1c3901f284979a114ebe1dc69831b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1ec72e086a2e41498a8e344cfae3b8f5 (127.9.116.66:41289): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:05.030480 18354 raft_consensus.cc:515] T d88e2a949fe645c8a5bd2a10fcd84b0d P 1ec72e086a2e41498a8e344cfae3b8f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:05.031315 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7836af3dd864d4cbc3a4f9ee717a6ee" candidate_uuid: "8b070276227b44858767bb33e02cc11b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ec72e086a2e41498a8e344cfae3b8f5"
I20260709 12:28:05.051183 18350 ts_tablet_manager.cc:1434] T c9cdcf5095a14f4db2efdef9465c5719 P 1ec72e086a2e41498a8e344cfae3b8f5: Time spent starting tablet: real 0.055s	user 0.006s	sys 0.017s
I20260709 12:28:05.028177 18387 raft_consensus.cc:515] T ec13962b83ce4b6ebe53124d2fdddcd5 P 5ac1c3901f284979a114ebe1dc69831b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:05.062085 18350 tablet_bootstrap.cc:492] T ec13962b83ce4b6ebe53124d2fdddcd5 P 1ec72e086a2e41498a8e344cfae3b8f5: Bootstrap starting.
I20260709 12:28:05.062556 18122 leader_election.cc:304] T f7836af3dd864d4cbc3a4f9ee717a6ee P 5ac1c3901f284979a114ebe1dc69831b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ec72e086a2e41498a8e344cfae3b8f5, 5ac1c3901f284979a114ebe1dc69831b; no voters: 8b070276227b44858767bb33e02cc11b
I20260709 12:28:05.063714 18387 leader_election.cc:290] T ec13962b83ce4b6ebe53124d2fdddcd5 P 5ac1c3901f284979a114ebe1dc69831b [CANDIDATE]: Term 1 election: Requested vote from peers 1ec72e086a2e41498a8e344cfae3b8f5 (127.9.116.66:41289), 8b070276227b44858767bb33e02cc11b (127.9.116.67:41781)
I20260709 12:28:05.034520 18158 raft_consensus.cc:2468] T 019a279ca008410abf88a5dc9f30974a P 5ac1c3901f284979a114ebe1dc69831b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ec72e086a2e41498a8e344cfae3b8f5 in term 1.
I20260709 12:28:05.035784 18381 leader_election.cc:290] T f7836af3dd864d4cbc3a4f9ee717a6ee P 8b070276227b44858767bb33e02cc11b [CANDIDATE]: Term 1 election: Requested vote from peers 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785), 1ec72e086a2e41498a8e344cfae3b8f5 (127.9.116.66:41289)
I20260709 12:28:05.051163 18157 raft_consensus.cc:2468] T f7836af3dd864d4cbc3a4f9ee717a6ee P 5ac1c3901f284979a114ebe1dc69831b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b070276227b44858767bb33e02cc11b in term 1.
I20260709 12:28:05.065171 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13962b83ce4b6ebe53124d2fdddcd5" candidate_uuid: "5ac1c3901f284979a114ebe1dc69831b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b070276227b44858767bb33e02cc11b"
I20260709 12:28:05.065847 18306 raft_consensus.cc:3060] T ec13962b83ce4b6ebe53124d2fdddcd5 P 8b070276227b44858767bb33e02cc11b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:05.054104 18385 raft_consensus.cc:515] T 5c0b48a3f0574c0ead9ce938d7ce0fa6 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:05.066191 18274 leader_election.cc:304] T f7836af3dd864d4cbc3a4f9ee717a6ee P 8b070276227b44858767bb33e02cc11b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ac1c3901f284979a114ebe1dc69831b, 8b070276227b44858767bb33e02cc11b; no voters: 
I20260709 12:28:05.067221 18381 raft_consensus.cc:2804] T f7836af3dd864d4cbc3a4f9ee717a6ee P 8b070276227b44858767bb33e02cc11b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:05.068694 18381 raft_consensus.cc:697] T f7836af3dd864d4cbc3a4f9ee717a6ee P 8b070276227b44858767bb33e02cc11b [term 1 LEADER]: Becoming Leader. State: Replica: 8b070276227b44858767bb33e02cc11b, State: Running, Role: LEADER
I20260709 12:28:05.069893 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c0b48a3f0574c0ead9ce938d7ce0fa6" candidate_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b070276227b44858767bb33e02cc11b"
I20260709 12:28:05.065337 18387 raft_consensus.cc:2764] T f7836af3dd864d4cbc3a4f9ee717a6ee P 5ac1c3901f284979a114ebe1dc69831b [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:28:05.070597 18308 raft_consensus.cc:3060] T 5c0b48a3f0574c0ead9ce938d7ce0fa6 P 8b070276227b44858767bb33e02cc11b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:05.069666 18381 consensus_queue.cc:237] T f7836af3dd864d4cbc3a4f9ee717a6ee P 8b070276227b44858767bb33e02cc11b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:05.077617 18354 leader_election.cc:290] T d88e2a949fe645c8a5bd2a10fcd84b0d P 1ec72e086a2e41498a8e344cfae3b8f5 [CANDIDATE]: Term 1 election: Requested vote from peers 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785), 8b070276227b44858767bb33e02cc11b (127.9.116.67:41781)
I20260709 12:28:05.035069 18351 raft_consensus.cc:359] T 2452f65bb1e24de4b47df9d6efcb5443 P 8b070276227b44858767bb33e02cc11b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:05.079732 18351 raft_consensus.cc:385] T 2452f65bb1e24de4b47df9d6efcb5443 P 8b070276227b44858767bb33e02cc11b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:05.080302 18351 raft_consensus.cc:740] T 2452f65bb1e24de4b47df9d6efcb5443 P 8b070276227b44858767bb33e02cc11b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b070276227b44858767bb33e02cc11b, State: Initialized, Role: FOLLOWER
I20260709 12:28:05.080607 18358 raft_consensus.cc:493] T e545023b44d846bbb719556f2d284a1e P 8b070276227b44858767bb33e02cc11b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:05.081089 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88e2a949fe645c8a5bd2a10fcd84b0d" candidate_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b070276227b44858767bb33e02cc11b"
I20260709 12:28:05.081439 18358 raft_consensus.cc:515] T e545023b44d846bbb719556f2d284a1e P 8b070276227b44858767bb33e02cc11b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:05.081826 18351 consensus_queue.cc:260] T 2452f65bb1e24de4b47df9d6efcb5443 P 8b070276227b44858767bb33e02cc11b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:05.074692 18234 raft_consensus.cc:3060] T f7836af3dd864d4cbc3a4f9ee717a6ee P 1ec72e086a2e41498a8e344cfae3b8f5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:28:05.084076 18200 leader_election.cc:343] T d88e2a949fe645c8a5bd2a10fcd84b0d P 1ec72e086a2e41498a8e344cfae3b8f5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8b070276227b44858767bb33e02cc11b (127.9.116.67:41781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:05.086045 18358 leader_election.cc:290] T e545023b44d846bbb719556f2d284a1e P 8b070276227b44858767bb33e02cc11b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785), 1ec72e086a2e41498a8e344cfae3b8f5 (127.9.116.66:41289)
I20260709 12:28:05.086726 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e545023b44d846bbb719556f2d284a1e" candidate_uuid: "8b070276227b44858767bb33e02cc11b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" is_pre_election: true
I20260709 12:28:05.086983 18306 raft_consensus.cc:2468] T ec13962b83ce4b6ebe53124d2fdddcd5 P 8b070276227b44858767bb33e02cc11b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ac1c3901f284979a114ebe1dc69831b in term 1.
I20260709 12:28:05.087563 18233 raft_consensus.cc:2468] T e545023b44d846bbb719556f2d284a1e P 1ec72e086a2e41498a8e344cfae3b8f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b070276227b44858767bb33e02cc11b in term 0.
I20260709 12:28:05.051865 18159 raft_consensus.cc:2468] T a901c0ae9d9f4e82939a611b87bc6014 P 5ac1c3901f284979a114ebe1dc69831b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b070276227b44858767bb33e02cc11b in term 1.
I20260709 12:28:05.088140 18308 raft_consensus.cc:2468] T 5c0b48a3f0574c0ead9ce938d7ce0fa6 P 8b070276227b44858767bb33e02cc11b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ec72e086a2e41498a8e344cfae3b8f5 in term 1.
I20260709 12:28:05.089301 18125 leader_election.cc:304] T ec13962b83ce4b6ebe53124d2fdddcd5 P 5ac1c3901f284979a114ebe1dc69831b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ac1c3901f284979a114ebe1dc69831b, 8b070276227b44858767bb33e02cc11b; no voters: 
I20260709 12:28:05.089709 18385 leader_election.cc:290] T 5c0b48a3f0574c0ead9ce938d7ce0fa6 P 1ec72e086a2e41498a8e344cfae3b8f5 [CANDIDATE]: Term 1 election: Requested vote from peers 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785), 8b070276227b44858767bb33e02cc11b (127.9.116.67:41781)
I20260709 12:28:05.090436 18387 raft_consensus.cc:2804] T ec13962b83ce4b6ebe53124d2fdddcd5 P 5ac1c3901f284979a114ebe1dc69831b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:05.090957 18387 raft_consensus.cc:697] T ec13962b83ce4b6ebe53124d2fdddcd5 P 5ac1c3901f284979a114ebe1dc69831b [term 1 LEADER]: Becoming Leader. State: Replica: 5ac1c3901f284979a114ebe1dc69831b, State: Running, Role: LEADER
I20260709 12:28:05.091111 18353 tablet_bootstrap.cc:492] T 5c0b48a3f0574c0ead9ce938d7ce0fa6 P 5ac1c3901f284979a114ebe1dc69831b: No bootstrap required, opened a new log
I20260709 12:28:05.089419 18271 leader_election.cc:304] T e545023b44d846bbb719556f2d284a1e P 8b070276227b44858767bb33e02cc11b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ec72e086a2e41498a8e344cfae3b8f5, 8b070276227b44858767bb33e02cc11b; no voters: 
I20260709 12:28:05.092022 18387 consensus_queue.cc:237] T ec13962b83ce4b6ebe53124d2fdddcd5 P 5ac1c3901f284979a114ebe1dc69831b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:05.092757 18358 raft_consensus.cc:2804] T e545023b44d846bbb719556f2d284a1e P 8b070276227b44858767bb33e02cc11b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:05.093425 18358 raft_consensus.cc:493] T e545023b44d846bbb719556f2d284a1e P 8b070276227b44858767bb33e02cc11b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:05.093586 18350 tablet_bootstrap.cc:654] T ec13962b83ce4b6ebe53124d2fdddcd5 P 1ec72e086a2e41498a8e344cfae3b8f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:05.089412 18200 leader_election.cc:304] T 5c0b48a3f0574c0ead9ce938d7ce0fa6 P 1ec72e086a2e41498a8e344cfae3b8f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ec72e086a2e41498a8e344cfae3b8f5, 8b070276227b44858767bb33e02cc11b; no voters: 
I20260709 12:28:05.094971 18351 ts_tablet_manager.cc:1434] T 2452f65bb1e24de4b47df9d6efcb5443 P 8b070276227b44858767bb33e02cc11b: Time spent starting tablet: real 0.090s	user 0.011s	sys 0.001s
I20260709 12:28:05.093888 18358 raft_consensus.cc:3060] T e545023b44d846bbb719556f2d284a1e P 8b070276227b44858767bb33e02cc11b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:05.099139 18351 tablet_bootstrap.cc:492] T d88e2a949fe645c8a5bd2a10fcd84b0d P 8b070276227b44858767bb33e02cc11b: Bootstrap starting.
I20260709 12:28:05.102622 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13962b83ce4b6ebe53124d2fdddcd5" candidate_uuid: "5ac1c3901f284979a114ebe1dc69831b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ec72e086a2e41498a8e344cfae3b8f5"
I20260709 12:28:05.088308 18158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e545023b44d846bbb719556f2d284a1e" candidate_uuid: "8b070276227b44858767bb33e02cc11b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ac1c3901f284979a114ebe1dc69831b" is_pre_election: true
I20260709 12:28:05.103848 18158 raft_consensus.cc:2468] T e545023b44d846bbb719556f2d284a1e P 5ac1c3901f284979a114ebe1dc69831b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b070276227b44858767bb33e02cc11b in term 0.
I20260709 12:28:05.091647 18353 ts_tablet_manager.cc:1403] T 5c0b48a3f0574c0ead9ce938d7ce0fa6 P 5ac1c3901f284979a114ebe1dc69831b: Time spent bootstrapping tablet: real 0.096s	user 0.013s	sys 0.008s
I20260709 12:28:05.119947 18392 raft_consensus.cc:493] T e545023b44d846bbb719556f2d284a1e P 5ac1c3901f284979a114ebe1dc69831b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:05.121582 18392 raft_consensus.cc:515] T e545023b44d846bbb719556f2d284a1e P 5ac1c3901f284979a114ebe1dc69831b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:05.130493 18353 raft_consensus.cc:359] T 5c0b48a3f0574c0ead9ce938d7ce0fa6 P 5ac1c3901f284979a114ebe1dc69831b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:05.104842 18200 leader_election.cc:304] T 019a279ca008410abf88a5dc9f30974a P 1ec72e086a2e41498a8e344cfae3b8f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ec72e086a2e41498a8e344cfae3b8f5, 5ac1c3901f284979a114ebe1dc69831b; no voters: 8b070276227b44858767bb33e02cc11b
I20260709 12:28:05.133235 18158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c0b48a3f0574c0ead9ce938d7ce0fa6" candidate_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ac1c3901f284979a114ebe1dc69831b"
I20260709 12:28:05.133685 18391 raft_consensus.cc:2804] T 019a279ca008410abf88a5dc9f30974a P 1ec72e086a2e41498a8e344cfae3b8f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:05.134814 18391 raft_consensus.cc:697] T 019a279ca008410abf88a5dc9f30974a P 1ec72e086a2e41498a8e344cfae3b8f5 [term 1 LEADER]: Becoming Leader. State: Replica: 1ec72e086a2e41498a8e344cfae3b8f5, State: Running, Role: LEADER
I20260709 12:28:05.135109 18359 raft_consensus.cc:515] T c9cdcf5095a14f4db2efdef9465c5719 P 5ac1c3901f284979a114ebe1dc69831b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } } peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } }
I20260709 12:28:05.136087 18234 raft_consensus.cc:2468] T f7836af3dd864d4cbc3a4f9ee717a6ee P 1ec72e086a2e41498a8e344cfae3b8f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b070276227b44858767bb33e02cc11b in term 1.
I20260709 12:28:05.131122 18353 raft_consensus.cc:385] T 5c0b48a3f0574c0ead9ce938d7ce0fa6 P 5ac1c3901f284979a114ebe1dc69831b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:05.110853 18385 raft_consensus.cc:2804] T 5c0b48a3f0574c0ead9ce938d7ce0fa6 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:05.138576 18353 raft_consensus.cc:740] T 5c0b48a3f0574c0ead9ce938d7ce0fa6 P 5ac1c3901f284979a114ebe1dc69831b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ac1c3901f284979a114ebe1dc69831b, State: Initialized, Role: FOLLOWER
I20260709 12:28:05.140050 18353 consensus_queue.cc:260] T 5c0b48a3f0574c0ead9ce938d7ce0fa6 P 5ac1c3901f284979a114ebe1dc69831b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:05.143874 18159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88e2a949fe645c8a5bd2a10fcd84b0d" candidate_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ac1c3901f284979a114ebe1dc69831b"
I20260709 12:28:05.144737 18353 ts_tablet_manager.cc:1434] T 5c0b48a3f0574c0ead9ce938d7ce0fa6 P 5ac1c3901f284979a114ebe1dc69831b: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.001s
I20260709 12:28:05.144829 18159 raft_consensus.cc:3060] T d88e2a949fe645c8a5bd2a10fcd84b0d P 5ac1c3901f284979a114ebe1dc69831b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:05.145855 18353 tablet_bootstrap.cc:492] T 2452f65bb1e24de4b47df9d6efcb5443 P 5ac1c3901f284979a114ebe1dc69831b: Bootstrap starting.
I20260709 12:28:05.146441 18158 raft_consensus.cc:3060] T 5c0b48a3f0574c0ead9ce938d7ce0fa6 P 5ac1c3901f284979a114ebe1dc69831b [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:28:05.148176 18122 leader_election.cc:343] T ec13962b83ce4b6ebe53124d2fdddcd5 P 5ac1c3901f284979a114ebe1dc69831b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1ec72e086a2e41498a8e344cfae3b8f5 (127.9.116.66:41289): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:05.151671 18385 raft_consensus.cc:697] T 5c0b48a3f0574c0ead9ce938d7ce0fa6 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 1 LEADER]: Becoming Leader. State: Replica: 1ec72e086a2e41498a8e344cfae3b8f5, State: Running, Role: LEADER
I20260709 12:28:05.152294 18353 tablet_bootstrap.cc:654] T 2452f65bb1e24de4b47df9d6efcb5443 P 5ac1c3901f284979a114ebe1dc69831b: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:05.152743 18385 consensus_queue.cc:237] T 5c0b48a3f0574c0ead9ce938d7ce0fa6 P 1ec72e086a2e41498a8e344cfae3b8f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:05.153872 18159 raft_consensus.cc:2468] T d88e2a949fe645c8a5bd2a10fcd84b0d P 5ac1c3901f284979a114ebe1dc69831b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ec72e086a2e41498a8e344cfae3b8f5 in term 1.
I20260709 12:28:05.156315 18200 leader_election.cc:304] T d88e2a949fe645c8a5bd2a10fcd84b0d P 1ec72e086a2e41498a8e344cfae3b8f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ec72e086a2e41498a8e344cfae3b8f5, 5ac1c3901f284979a114ebe1dc69831b; no voters: 8b070276227b44858767bb33e02cc11b
I20260709 12:28:05.157276 18354 raft_consensus.cc:2804] T d88e2a949fe645c8a5bd2a10fcd84b0d P 1ec72e086a2e41498a8e344cfae3b8f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:05.158560 18351 tablet_bootstrap.cc:654] T d88e2a949fe645c8a5bd2a10fcd84b0d P 8b070276227b44858767bb33e02cc11b: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:05.129603 18274 leader_election.cc:304] T a901c0ae9d9f4e82939a611b87bc6014 P 8b070276227b44858767bb33e02cc11b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ac1c3901f284979a114ebe1dc69831b, 8b070276227b44858767bb33e02cc11b; no voters: 1ec72e086a2e41498a8e344cfae3b8f5
I20260709 12:28:05.160493 18391 consensus_queue.cc:237] T 019a279ca008410abf88a5dc9f30974a P 1ec72e086a2e41498a8e344cfae3b8f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
W20260709 12:28:05.168404 18274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.65:43785, user_credentials={real_user=slave}} blocked reactor thread for 54596.3us
I20260709 12:28:05.169742 18381 raft_consensus.cc:2804] T a901c0ae9d9f4e82939a611b87bc6014 P 8b070276227b44858767bb33e02cc11b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:05.171777 18381 raft_consensus.cc:697] T a901c0ae9d9f4e82939a611b87bc6014 P 8b070276227b44858767bb33e02cc11b [term 1 LEADER]: Becoming Leader. State: Replica: 8b070276227b44858767bb33e02cc11b, State: Running, Role: LEADER
I20260709 12:28:05.173333 18381 consensus_queue.cc:237] T a901c0ae9d9f4e82939a611b87bc6014 P 8b070276227b44858767bb33e02cc11b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:05.177739 18396 raft_consensus.cc:493] T 3fa608df520c42249d93ddb828490f2d P 5ac1c3901f284979a114ebe1dc69831b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:05.178620 18396 raft_consensus.cc:515] T 3fa608df520c42249d93ddb828490f2d P 5ac1c3901f284979a114ebe1dc69831b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:05.181622 18396 leader_election.cc:290] T 3fa608df520c42249d93ddb828490f2d P 5ac1c3901f284979a114ebe1dc69831b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ec72e086a2e41498a8e344cfae3b8f5 (127.9.116.66:41289), 8b070276227b44858767bb33e02cc11b (127.9.116.67:41781)
I20260709 12:28:05.182860 18359 leader_election.cc:290] T c9cdcf5095a14f4db2efdef9465c5719 P 5ac1c3901f284979a114ebe1dc69831b [CANDIDATE]: Term 1 election: Requested vote from peers 1ec72e086a2e41498a8e344cfae3b8f5 (127.9.116.66:41289), 8b070276227b44858767bb33e02cc11b (127.9.116.67:41781)
I20260709 12:28:05.183672 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa608df520c42249d93ddb828490f2d" candidate_uuid: "5ac1c3901f284979a114ebe1dc69831b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b070276227b44858767bb33e02cc11b" is_pre_election: true
W20260709 12:28:05.187673 18125 leader_election.cc:343] T 3fa608df520c42249d93ddb828490f2d P 5ac1c3901f284979a114ebe1dc69831b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b070276227b44858767bb33e02cc11b (127.9.116.67:41781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:05.189587 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cdcf5095a14f4db2efdef9465c5719" candidate_uuid: "5ac1c3901f284979a114ebe1dc69831b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b070276227b44858767bb33e02cc11b"
I20260709 12:28:05.190557 18308 raft_consensus.cc:3060] T c9cdcf5095a14f4db2efdef9465c5719 P 8b070276227b44858767bb33e02cc11b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:05.194963 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e545023b44d846bbb719556f2d284a1e" candidate_uuid: "5ac1c3901f284979a114ebe1dc69831b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b070276227b44858767bb33e02cc11b" is_pre_election: true
I20260709 12:28:05.193410 18392 leader_election.cc:290] T e545023b44d846bbb719556f2d284a1e P 5ac1c3901f284979a114ebe1dc69831b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ec72e086a2e41498a8e344cfae3b8f5 (127.9.116.66:41289), 8b070276227b44858767bb33e02cc11b (127.9.116.67:41781)
I20260709 12:28:05.213528 18358 raft_consensus.cc:515] T e545023b44d846bbb719556f2d284a1e P 8b070276227b44858767bb33e02cc11b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:05.215536 18306 raft_consensus.cc:2393] T e545023b44d846bbb719556f2d284a1e P 8b070276227b44858767bb33e02cc11b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ac1c3901f284979a114ebe1dc69831b in current term 1: Already voted for candidate 8b070276227b44858767bb33e02cc11b in this term.
I20260709 12:28:05.220862 18308 raft_consensus.cc:2468] T c9cdcf5095a14f4db2efdef9465c5719 P 8b070276227b44858767bb33e02cc11b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ac1c3901f284979a114ebe1dc69831b in term 1.
I20260709 12:28:05.224324 18125 leader_election.cc:304] T c9cdcf5095a14f4db2efdef9465c5719 P 5ac1c3901f284979a114ebe1dc69831b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ac1c3901f284979a114ebe1dc69831b, 8b070276227b44858767bb33e02cc11b; no voters: 
I20260709 12:28:05.226665 18392 raft_consensus.cc:2804] T c9cdcf5095a14f4db2efdef9465c5719 P 5ac1c3901f284979a114ebe1dc69831b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:05.226655 18350 tablet_bootstrap.cc:492] T ec13962b83ce4b6ebe53124d2fdddcd5 P 1ec72e086a2e41498a8e344cfae3b8f5: No bootstrap required, opened a new log
I20260709 12:28:05.227807 18350 ts_tablet_manager.cc:1403] T ec13962b83ce4b6ebe53124d2fdddcd5 P 1ec72e086a2e41498a8e344cfae3b8f5: Time spent bootstrapping tablet: real 0.166s	user 0.034s	sys 0.023s
I20260709 12:28:05.229277 18056 catalog_manager.cc:5697] T f7836af3dd864d4cbc3a4f9ee717a6ee P 8b070276227b44858767bb33e02cc11b reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b070276227b44858767bb33e02cc11b (127.9.116.67). New cstate: current_term: 1 leader_uuid: "8b070276227b44858767bb33e02cc11b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:05.231763 18350 raft_consensus.cc:359] T ec13962b83ce4b6ebe53124d2fdddcd5 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:05.233165 18350 raft_consensus.cc:385] T ec13962b83ce4b6ebe53124d2fdddcd5 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:05.233548 18350 raft_consensus.cc:740] T ec13962b83ce4b6ebe53124d2fdddcd5 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ec72e086a2e41498a8e344cfae3b8f5, State: Initialized, Role: FOLLOWER
I20260709 12:28:05.234573 18350 consensus_queue.cc:260] T ec13962b83ce4b6ebe53124d2fdddcd5 P 1ec72e086a2e41498a8e344cfae3b8f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:05.234405 18054 catalog_manager.cc:5697] T ec13962b83ce4b6ebe53124d2fdddcd5 P 5ac1c3901f284979a114ebe1dc69831b reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65). New cstate: current_term: 1 leader_uuid: "5ac1c3901f284979a114ebe1dc69831b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:05.227793 18392 raft_consensus.cc:697] T c9cdcf5095a14f4db2efdef9465c5719 P 5ac1c3901f284979a114ebe1dc69831b [term 1 LEADER]: Becoming Leader. State: Replica: 5ac1c3901f284979a114ebe1dc69831b, State: Running, Role: LEADER
I20260709 12:28:05.238436 18158 raft_consensus.cc:2468] T 5c0b48a3f0574c0ead9ce938d7ce0fa6 P 5ac1c3901f284979a114ebe1dc69831b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ec72e086a2e41498a8e344cfae3b8f5 in term 1.
I20260709 12:28:05.238587 18354 raft_consensus.cc:697] T d88e2a949fe645c8a5bd2a10fcd84b0d P 1ec72e086a2e41498a8e344cfae3b8f5 [term 1 LEADER]: Becoming Leader. State: Replica: 1ec72e086a2e41498a8e344cfae3b8f5, State: Running, Role: LEADER
I20260709 12:28:05.256541 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cdcf5095a14f4db2efdef9465c5719" candidate_uuid: "5ac1c3901f284979a114ebe1dc69831b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ec72e086a2e41498a8e344cfae3b8f5"
I20260709 12:28:05.256443 18392 consensus_queue.cc:237] T c9cdcf5095a14f4db2efdef9465c5719 P 5ac1c3901f284979a114ebe1dc69831b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } } peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } }
I20260709 12:28:05.257606 18234 raft_consensus.cc:3060] T c9cdcf5095a14f4db2efdef9465c5719 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:05.260339 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa608df520c42249d93ddb828490f2d" candidate_uuid: "5ac1c3901f284979a114ebe1dc69831b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" is_pre_election: true
I20260709 12:28:05.261097 18233 raft_consensus.cc:2468] T 3fa608df520c42249d93ddb828490f2d P 1ec72e086a2e41498a8e344cfae3b8f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ac1c3901f284979a114ebe1dc69831b in term 0.
I20260709 12:28:05.267318 18398 raft_consensus.cc:493] T 2452f65bb1e24de4b47df9d6efcb5443 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:05.268795 18122 leader_election.cc:304] T 3fa608df520c42249d93ddb828490f2d P 5ac1c3901f284979a114ebe1dc69831b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ec72e086a2e41498a8e344cfae3b8f5, 5ac1c3901f284979a114ebe1dc69831b; no voters: 8b070276227b44858767bb33e02cc11b
I20260709 12:28:05.268471 18354 consensus_queue.cc:237] T d88e2a949fe645c8a5bd2a10fcd84b0d P 1ec72e086a2e41498a8e344cfae3b8f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:05.269361 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e545023b44d846bbb719556f2d284a1e" candidate_uuid: "5ac1c3901f284979a114ebe1dc69831b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" is_pre_election: true
I20260709 12:28:05.283756 18359 raft_consensus.cc:2804] T 3fa608df520c42249d93ddb828490f2d P 5ac1c3901f284979a114ebe1dc69831b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:05.274227 18398 raft_consensus.cc:515] T 2452f65bb1e24de4b47df9d6efcb5443 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:05.285728 18233 raft_consensus.cc:2468] T e545023b44d846bbb719556f2d284a1e P 1ec72e086a2e41498a8e344cfae3b8f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ac1c3901f284979a114ebe1dc69831b in term 0.
I20260709 12:28:05.292022 18159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e545023b44d846bbb719556f2d284a1e" candidate_uuid: "8b070276227b44858767bb33e02cc11b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ac1c3901f284979a114ebe1dc69831b"
I20260709 12:28:05.290674 18359 raft_consensus.cc:493] T 3fa608df520c42249d93ddb828490f2d P 5ac1c3901f284979a114ebe1dc69831b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:05.295840 18359 raft_consensus.cc:3060] T 3fa608df520c42249d93ddb828490f2d P 5ac1c3901f284979a114ebe1dc69831b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:05.295908 18159 raft_consensus.cc:3060] T e545023b44d846bbb719556f2d284a1e P 5ac1c3901f284979a114ebe1dc69831b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:05.296455 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e545023b44d846bbb719556f2d284a1e" candidate_uuid: "8b070276227b44858767bb33e02cc11b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ec72e086a2e41498a8e344cfae3b8f5"
I20260709 12:28:05.297148 18232 raft_consensus.cc:3060] T e545023b44d846bbb719556f2d284a1e P 1ec72e086a2e41498a8e344cfae3b8f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:05.300457 18351 tablet_bootstrap.cc:492] T d88e2a949fe645c8a5bd2a10fcd84b0d P 8b070276227b44858767bb33e02cc11b: No bootstrap required, opened a new log
I20260709 12:28:05.292789 18358 leader_election.cc:290] T e545023b44d846bbb719556f2d284a1e P 8b070276227b44858767bb33e02cc11b [CANDIDATE]: Term 1 election: Requested vote from peers 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785), 1ec72e086a2e41498a8e344cfae3b8f5 (127.9.116.66:41289)
I20260709 12:28:05.301632 18351 ts_tablet_manager.cc:1403] T d88e2a949fe645c8a5bd2a10fcd84b0d P 8b070276227b44858767bb33e02cc11b: Time spent bootstrapping tablet: real 0.203s	user 0.032s	sys 0.010s
I20260709 12:28:05.305630 18234 raft_consensus.cc:2468] T c9cdcf5095a14f4db2efdef9465c5719 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ac1c3901f284979a114ebe1dc69831b in term 1.
I20260709 12:28:05.306770 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2452f65bb1e24de4b47df9d6efcb5443" candidate_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b070276227b44858767bb33e02cc11b" is_pre_election: true
I20260709 12:28:05.307847 18308 raft_consensus.cc:2468] T 2452f65bb1e24de4b47df9d6efcb5443 P 8b070276227b44858767bb33e02cc11b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ec72e086a2e41498a8e344cfae3b8f5 in term 0.
I20260709 12:28:05.308935 18351 raft_consensus.cc:359] T d88e2a949fe645c8a5bd2a10fcd84b0d P 8b070276227b44858767bb33e02cc11b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:05.309867 18351 raft_consensus.cc:385] T d88e2a949fe645c8a5bd2a10fcd84b0d P 8b070276227b44858767bb33e02cc11b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:05.309607 18200 leader_election.cc:304] T 2452f65bb1e24de4b47df9d6efcb5443 P 1ec72e086a2e41498a8e344cfae3b8f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ec72e086a2e41498a8e344cfae3b8f5, 8b070276227b44858767bb33e02cc11b; no voters: 
I20260709 12:28:05.310945 18402 raft_consensus.cc:2804] T 2452f65bb1e24de4b47df9d6efcb5443 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:05.311368 18122 leader_election.cc:304] T e545023b44d846bbb719556f2d284a1e P 5ac1c3901f284979a114ebe1dc69831b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ec72e086a2e41498a8e344cfae3b8f5, 5ac1c3901f284979a114ebe1dc69831b; no voters: 8b070276227b44858767bb33e02cc11b
I20260709 12:28:05.314289 18402 raft_consensus.cc:493] T 2452f65bb1e24de4b47df9d6efcb5443 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:05.314913 18402 raft_consensus.cc:3060] T 2452f65bb1e24de4b47df9d6efcb5443 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:05.317040 18158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2452f65bb1e24de4b47df9d6efcb5443" candidate_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ac1c3901f284979a114ebe1dc69831b" is_pre_election: true
I20260709 12:28:05.303362 18398 leader_election.cc:290] T 2452f65bb1e24de4b47df9d6efcb5443 P 1ec72e086a2e41498a8e344cfae3b8f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785), 8b070276227b44858767bb33e02cc11b (127.9.116.67:41781)
I20260709 12:28:05.311343 18351 raft_consensus.cc:740] T d88e2a949fe645c8a5bd2a10fcd84b0d P 8b070276227b44858767bb33e02cc11b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b070276227b44858767bb33e02cc11b, State: Initialized, Role: FOLLOWER
W20260709 12:28:05.321585 18200 leader_election.cc:343] T 2452f65bb1e24de4b47df9d6efcb5443 P 1ec72e086a2e41498a8e344cfae3b8f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:05.321806 18350 ts_tablet_manager.cc:1434] T ec13962b83ce4b6ebe53124d2fdddcd5 P 1ec72e086a2e41498a8e344cfae3b8f5: Time spent starting tablet: real 0.093s	user 0.012s	sys 0.004s
I20260709 12:28:05.326624 18350 tablet_bootstrap.cc:492] T a901c0ae9d9f4e82939a611b87bc6014 P 1ec72e086a2e41498a8e344cfae3b8f5: Bootstrap starting.
I20260709 12:28:05.327157 18353 tablet_bootstrap.cc:492] T 2452f65bb1e24de4b47df9d6efcb5443 P 5ac1c3901f284979a114ebe1dc69831b: No bootstrap required, opened a new log
I20260709 12:28:05.328075 18353 ts_tablet_manager.cc:1403] T 2452f65bb1e24de4b47df9d6efcb5443 P 5ac1c3901f284979a114ebe1dc69831b: Time spent bootstrapping tablet: real 0.182s	user 0.015s	sys 0.009s
I20260709 12:28:05.330296 18159 raft_consensus.cc:2468] T e545023b44d846bbb719556f2d284a1e P 5ac1c3901f284979a114ebe1dc69831b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b070276227b44858767bb33e02cc11b in term 1.
I20260709 12:28:05.331219 18392 raft_consensus.cc:2764] T e545023b44d846bbb719556f2d284a1e P 5ac1c3901f284979a114ebe1dc69831b [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:28:05.332487 18274 leader_election.cc:304] T e545023b44d846bbb719556f2d284a1e P 8b070276227b44858767bb33e02cc11b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ac1c3901f284979a114ebe1dc69831b, 8b070276227b44858767bb33e02cc11b; no voters: 
I20260709 12:28:05.334429 18358 raft_consensus.cc:2804] T e545023b44d846bbb719556f2d284a1e P 8b070276227b44858767bb33e02cc11b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:05.334513 18232 raft_consensus.cc:2468] T e545023b44d846bbb719556f2d284a1e P 1ec72e086a2e41498a8e344cfae3b8f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b070276227b44858767bb33e02cc11b in term 1.
I20260709 12:28:05.335024 18358 raft_consensus.cc:697] T e545023b44d846bbb719556f2d284a1e P 8b070276227b44858767bb33e02cc11b [term 1 LEADER]: Becoming Leader. State: Replica: 8b070276227b44858767bb33e02cc11b, State: Running, Role: LEADER
I20260709 12:28:05.334712 18353 raft_consensus.cc:359] T 2452f65bb1e24de4b47df9d6efcb5443 P 5ac1c3901f284979a114ebe1dc69831b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:05.335892 18353 raft_consensus.cc:385] T 2452f65bb1e24de4b47df9d6efcb5443 P 5ac1c3901f284979a114ebe1dc69831b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:05.336292 18353 raft_consensus.cc:740] T 2452f65bb1e24de4b47df9d6efcb5443 P 5ac1c3901f284979a114ebe1dc69831b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ac1c3901f284979a114ebe1dc69831b, State: Initialized, Role: FOLLOWER
I20260709 12:28:05.336047 18358 consensus_queue.cc:237] T e545023b44d846bbb719556f2d284a1e P 8b070276227b44858767bb33e02cc11b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:05.336354 18359 raft_consensus.cc:515] T 3fa608df520c42249d93ddb828490f2d P 5ac1c3901f284979a114ebe1dc69831b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:05.342623 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa608df520c42249d93ddb828490f2d" candidate_uuid: "5ac1c3901f284979a114ebe1dc69831b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ec72e086a2e41498a8e344cfae3b8f5"
I20260709 12:28:05.342842 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa608df520c42249d93ddb828490f2d" candidate_uuid: "5ac1c3901f284979a114ebe1dc69831b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b070276227b44858767bb33e02cc11b"
I20260709 12:28:05.343719 18234 raft_consensus.cc:3060] T 3fa608df520c42249d93ddb828490f2d P 1ec72e086a2e41498a8e344cfae3b8f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:05.344050 18353 consensus_queue.cc:260] T 2452f65bb1e24de4b47df9d6efcb5443 P 5ac1c3901f284979a114ebe1dc69831b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
W20260709 12:28:05.345091 18125 leader_election.cc:343] T 3fa608df520c42249d93ddb828490f2d P 5ac1c3901f284979a114ebe1dc69831b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8b070276227b44858767bb33e02cc11b (127.9.116.67:41781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:05.346575 18353 ts_tablet_manager.cc:1434] T 2452f65bb1e24de4b47df9d6efcb5443 P 5ac1c3901f284979a114ebe1dc69831b: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:28:05.326422 18351 consensus_queue.cc:260] T d88e2a949fe645c8a5bd2a10fcd84b0d P 8b070276227b44858767bb33e02cc11b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:05.349038 18351 ts_tablet_manager.cc:1434] T d88e2a949fe645c8a5bd2a10fcd84b0d P 8b070276227b44858767bb33e02cc11b: Time spent starting tablet: real 0.045s	user 0.008s	sys 0.000s
I20260709 12:28:05.349406 18350 tablet_bootstrap.cc:654] T a901c0ae9d9f4e82939a611b87bc6014 P 1ec72e086a2e41498a8e344cfae3b8f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:05.350257 18351 tablet_bootstrap.cc:492] T 3fa608df520c42249d93ddb828490f2d P 8b070276227b44858767bb33e02cc11b: Bootstrap starting.
I20260709 12:28:05.350298 18359 leader_election.cc:290] T 3fa608df520c42249d93ddb828490f2d P 5ac1c3901f284979a114ebe1dc69831b [CANDIDATE]: Term 1 election: Requested vote from peers 1ec72e086a2e41498a8e344cfae3b8f5 (127.9.116.66:41289), 8b070276227b44858767bb33e02cc11b (127.9.116.67:41781)
I20260709 12:28:05.358361 18351 tablet_bootstrap.cc:654] T 3fa608df520c42249d93ddb828490f2d P 8b070276227b44858767bb33e02cc11b: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:05.359277 18350 tablet_bootstrap.cc:492] T a901c0ae9d9f4e82939a611b87bc6014 P 1ec72e086a2e41498a8e344cfae3b8f5: No bootstrap required, opened a new log
I20260709 12:28:05.359833 18350 ts_tablet_manager.cc:1403] T a901c0ae9d9f4e82939a611b87bc6014 P 1ec72e086a2e41498a8e344cfae3b8f5: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.005s
I20260709 12:28:05.366358 18350 raft_consensus.cc:359] T a901c0ae9d9f4e82939a611b87bc6014 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:05.367100 18350 raft_consensus.cc:385] T a901c0ae9d9f4e82939a611b87bc6014 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:05.367389 18350 raft_consensus.cc:740] T a901c0ae9d9f4e82939a611b87bc6014 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ec72e086a2e41498a8e344cfae3b8f5, State: Initialized, Role: FOLLOWER
I20260709 12:28:05.367952 18053 catalog_manager.cc:5697] T 019a279ca008410abf88a5dc9f30974a P 1ec72e086a2e41498a8e344cfae3b8f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1ec72e086a2e41498a8e344cfae3b8f5 (127.9.116.66). New cstate: current_term: 1 leader_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:05.368829 18350 consensus_queue.cc:260] T a901c0ae9d9f4e82939a611b87bc6014 P 1ec72e086a2e41498a8e344cfae3b8f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:05.371028 18350 ts_tablet_manager.cc:1434] T a901c0ae9d9f4e82939a611b87bc6014 P 1ec72e086a2e41498a8e344cfae3b8f5: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.001s
I20260709 12:28:05.372370 18054 catalog_manager.cc:5697] T a901c0ae9d9f4e82939a611b87bc6014 P 8b070276227b44858767bb33e02cc11b reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b070276227b44858767bb33e02cc11b (127.9.116.67). New cstate: current_term: 1 leader_uuid: "8b070276227b44858767bb33e02cc11b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:05.373766 18234 raft_consensus.cc:2468] T 3fa608df520c42249d93ddb828490f2d P 1ec72e086a2e41498a8e344cfae3b8f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ac1c3901f284979a114ebe1dc69831b in term 1.
I20260709 12:28:05.375023 18122 leader_election.cc:304] T 3fa608df520c42249d93ddb828490f2d P 5ac1c3901f284979a114ebe1dc69831b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ec72e086a2e41498a8e344cfae3b8f5, 5ac1c3901f284979a114ebe1dc69831b; no voters: 8b070276227b44858767bb33e02cc11b
I20260709 12:28:05.375319 18402 raft_consensus.cc:515] T 2452f65bb1e24de4b47df9d6efcb5443 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:05.374918 18054 catalog_manager.cc:5697] T e545023b44d846bbb719556f2d284a1e P 8b070276227b44858767bb33e02cc11b reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b070276227b44858767bb33e02cc11b (127.9.116.67). New cstate: current_term: 1 leader_uuid: "8b070276227b44858767bb33e02cc11b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:05.376287 18359 raft_consensus.cc:2804] T 3fa608df520c42249d93ddb828490f2d P 5ac1c3901f284979a114ebe1dc69831b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:05.376852 18359 raft_consensus.cc:697] T 3fa608df520c42249d93ddb828490f2d P 5ac1c3901f284979a114ebe1dc69831b [term 1 LEADER]: Becoming Leader. State: Replica: 5ac1c3901f284979a114ebe1dc69831b, State: Running, Role: LEADER
I20260709 12:28:05.377563 18402 leader_election.cc:290] T 2452f65bb1e24de4b47df9d6efcb5443 P 1ec72e086a2e41498a8e344cfae3b8f5 [CANDIDATE]: Term 1 election: Requested vote from peers 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785), 8b070276227b44858767bb33e02cc11b (127.9.116.67:41781)
I20260709 12:28:05.377720 18359 consensus_queue.cc:237] T 3fa608df520c42249d93ddb828490f2d P 5ac1c3901f284979a114ebe1dc69831b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:05.380468 18159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2452f65bb1e24de4b47df9d6efcb5443" candidate_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ac1c3901f284979a114ebe1dc69831b"
I20260709 12:28:05.381145 18159 raft_consensus.cc:3060] T 2452f65bb1e24de4b47df9d6efcb5443 P 5ac1c3901f284979a114ebe1dc69831b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:05.381788 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2452f65bb1e24de4b47df9d6efcb5443" candidate_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b070276227b44858767bb33e02cc11b"
I20260709 12:28:05.382481 18351 tablet_bootstrap.cc:492] T 3fa608df520c42249d93ddb828490f2d P 8b070276227b44858767bb33e02cc11b: No bootstrap required, opened a new log
I20260709 12:28:05.382512 18308 raft_consensus.cc:3060] T 2452f65bb1e24de4b47df9d6efcb5443 P 8b070276227b44858767bb33e02cc11b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:05.383376 18351 ts_tablet_manager.cc:1403] T 3fa608df520c42249d93ddb828490f2d P 8b070276227b44858767bb33e02cc11b: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.002s
I20260709 12:28:05.387040 18351 raft_consensus.cc:359] T 3fa608df520c42249d93ddb828490f2d P 8b070276227b44858767bb33e02cc11b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:05.387770 18351 raft_consensus.cc:385] T 3fa608df520c42249d93ddb828490f2d P 8b070276227b44858767bb33e02cc11b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:05.388042 18351 raft_consensus.cc:740] T 3fa608df520c42249d93ddb828490f2d P 8b070276227b44858767bb33e02cc11b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b070276227b44858767bb33e02cc11b, State: Initialized, Role: FOLLOWER
I20260709 12:28:05.388948 18351 consensus_queue.cc:260] T 3fa608df520c42249d93ddb828490f2d P 8b070276227b44858767bb33e02cc11b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:05.390300 18402 raft_consensus.cc:493] T ec13962b83ce4b6ebe53124d2fdddcd5 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:05.390841 18402 raft_consensus.cc:515] T ec13962b83ce4b6ebe53124d2fdddcd5 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:05.391635 18351 ts_tablet_manager.cc:1434] T 3fa608df520c42249d93ddb828490f2d P 8b070276227b44858767bb33e02cc11b: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 12:28:05.393115 18351 tablet_bootstrap.cc:492] T 019a279ca008410abf88a5dc9f30974a P 8b070276227b44858767bb33e02cc11b: Bootstrap starting.
I20260709 12:28:05.394753 18159 raft_consensus.cc:2468] T 2452f65bb1e24de4b47df9d6efcb5443 P 5ac1c3901f284979a114ebe1dc69831b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ec72e086a2e41498a8e344cfae3b8f5 in term 1.
I20260709 12:28:05.395800 18158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13962b83ce4b6ebe53124d2fdddcd5" candidate_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ac1c3901f284979a114ebe1dc69831b" is_pre_election: true
I20260709 12:28:05.397163 18200 leader_election.cc:304] T 2452f65bb1e24de4b47df9d6efcb5443 P 1ec72e086a2e41498a8e344cfae3b8f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ec72e086a2e41498a8e344cfae3b8f5, 5ac1c3901f284979a114ebe1dc69831b; no voters: 
I20260709 12:28:05.397852 18402 leader_election.cc:290] T ec13962b83ce4b6ebe53124d2fdddcd5 P 1ec72e086a2e41498a8e344cfae3b8f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785), 8b070276227b44858767bb33e02cc11b (127.9.116.67:41781)
I20260709 12:28:05.398442 18402 raft_consensus.cc:2804] T 2452f65bb1e24de4b47df9d6efcb5443 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:05.399127 18402 raft_consensus.cc:697] T 2452f65bb1e24de4b47df9d6efcb5443 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 1 LEADER]: Becoming Leader. State: Replica: 1ec72e086a2e41498a8e344cfae3b8f5, State: Running, Role: LEADER
I20260709 12:28:05.399327 18351 tablet_bootstrap.cc:654] T 019a279ca008410abf88a5dc9f30974a P 8b070276227b44858767bb33e02cc11b: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:05.399518 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13962b83ce4b6ebe53124d2fdddcd5" candidate_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b070276227b44858767bb33e02cc11b" is_pre_election: true
I20260709 12:28:05.399987 18402 consensus_queue.cc:237] T 2452f65bb1e24de4b47df9d6efcb5443 P 1ec72e086a2e41498a8e344cfae3b8f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:05.400381 18306 raft_consensus.cc:2393] T ec13962b83ce4b6ebe53124d2fdddcd5 P 8b070276227b44858767bb33e02cc11b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ec72e086a2e41498a8e344cfae3b8f5 in current term 1: Already voted for candidate 5ac1c3901f284979a114ebe1dc69831b in this term.
I20260709 12:28:05.401773 18200 leader_election.cc:304] T ec13962b83ce4b6ebe53124d2fdddcd5 P 1ec72e086a2e41498a8e344cfae3b8f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ec72e086a2e41498a8e344cfae3b8f5; no voters: 5ac1c3901f284979a114ebe1dc69831b, 8b070276227b44858767bb33e02cc11b
I20260709 12:28:05.403003 18354 raft_consensus.cc:3060] T ec13962b83ce4b6ebe53124d2fdddcd5 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:05.403862 18358 raft_consensus.cc:493] T d88e2a949fe645c8a5bd2a10fcd84b0d P 8b070276227b44858767bb33e02cc11b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:05.404691 18358 raft_consensus.cc:515] T d88e2a949fe645c8a5bd2a10fcd84b0d P 8b070276227b44858767bb33e02cc11b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:05.409951 18158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88e2a949fe645c8a5bd2a10fcd84b0d" candidate_uuid: "8b070276227b44858767bb33e02cc11b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ac1c3901f284979a114ebe1dc69831b" is_pre_election: true
I20260709 12:28:05.411155 18158 raft_consensus.cc:2393] T d88e2a949fe645c8a5bd2a10fcd84b0d P 5ac1c3901f284979a114ebe1dc69831b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b070276227b44858767bb33e02cc11b in current term 1: Already voted for candidate 1ec72e086a2e41498a8e344cfae3b8f5 in this term.
I20260709 12:28:05.415220 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88e2a949fe645c8a5bd2a10fcd84b0d" candidate_uuid: "8b070276227b44858767bb33e02cc11b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" is_pre_election: true
I20260709 12:28:05.418115 18271 leader_election.cc:304] T d88e2a949fe645c8a5bd2a10fcd84b0d P 8b070276227b44858767bb33e02cc11b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b070276227b44858767bb33e02cc11b; no voters: 1ec72e086a2e41498a8e344cfae3b8f5, 5ac1c3901f284979a114ebe1dc69831b
I20260709 12:28:05.419328 18381 raft_consensus.cc:3060] T d88e2a949fe645c8a5bd2a10fcd84b0d P 8b070276227b44858767bb33e02cc11b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:05.422185 18308 raft_consensus.cc:2468] T 2452f65bb1e24de4b47df9d6efcb5443 P 8b070276227b44858767bb33e02cc11b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ec72e086a2e41498a8e344cfae3b8f5 in term 1.
I20260709 12:28:05.428207 18358 leader_election.cc:290] T d88e2a949fe645c8a5bd2a10fcd84b0d P 8b070276227b44858767bb33e02cc11b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785), 1ec72e086a2e41498a8e344cfae3b8f5 (127.9.116.66:41289)
I20260709 12:28:05.429692 18056 catalog_manager.cc:5697] T c9cdcf5095a14f4db2efdef9465c5719 P 5ac1c3901f284979a114ebe1dc69831b reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65). New cstate: current_term: 1 leader_uuid: "5ac1c3901f284979a114ebe1dc69831b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:05.437036 18354 raft_consensus.cc:2749] T ec13962b83ce4b6ebe53124d2fdddcd5 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:05.450081 18381 raft_consensus.cc:2749] T d88e2a949fe645c8a5bd2a10fcd84b0d P 8b070276227b44858767bb33e02cc11b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:05.457911 18053 catalog_manager.cc:5697] T d88e2a949fe645c8a5bd2a10fcd84b0d P 1ec72e086a2e41498a8e344cfae3b8f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1ec72e086a2e41498a8e344cfae3b8f5 (127.9.116.66). New cstate: current_term: 1 leader_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:05.460327 18053 catalog_manager.cc:5697] T 5c0b48a3f0574c0ead9ce938d7ce0fa6 P 1ec72e086a2e41498a8e344cfae3b8f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1ec72e086a2e41498a8e344cfae3b8f5 (127.9.116.66). New cstate: current_term: 1 leader_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:05.462055 18351 tablet_bootstrap.cc:492] T 019a279ca008410abf88a5dc9f30974a P 8b070276227b44858767bb33e02cc11b: No bootstrap required, opened a new log
I20260709 12:28:05.462626 18351 ts_tablet_manager.cc:1403] T 019a279ca008410abf88a5dc9f30974a P 8b070276227b44858767bb33e02cc11b: Time spent bootstrapping tablet: real 0.070s	user 0.025s	sys 0.043s
I20260709 12:28:05.462627 18056 catalog_manager.cc:5697] T 3fa608df520c42249d93ddb828490f2d P 5ac1c3901f284979a114ebe1dc69831b reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65). New cstate: current_term: 1 leader_uuid: "5ac1c3901f284979a114ebe1dc69831b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:05.465783 18351 raft_consensus.cc:359] T 019a279ca008410abf88a5dc9f30974a P 8b070276227b44858767bb33e02cc11b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:05.466542 18351 raft_consensus.cc:385] T 019a279ca008410abf88a5dc9f30974a P 8b070276227b44858767bb33e02cc11b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:05.466843 18351 raft_consensus.cc:740] T 019a279ca008410abf88a5dc9f30974a P 8b070276227b44858767bb33e02cc11b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b070276227b44858767bb33e02cc11b, State: Initialized, Role: FOLLOWER
I20260709 12:28:05.467732 18351 consensus_queue.cc:260] T 019a279ca008410abf88a5dc9f30974a P 8b070276227b44858767bb33e02cc11b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:05.469813 18351 ts_tablet_manager.cc:1434] T 019a279ca008410abf88a5dc9f30974a P 8b070276227b44858767bb33e02cc11b: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:28:05.481120 18054 catalog_manager.cc:5697] T 2452f65bb1e24de4b47df9d6efcb5443 P 1ec72e086a2e41498a8e344cfae3b8f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1ec72e086a2e41498a8e344cfae3b8f5 (127.9.116.66). New cstate: current_term: 1 leader_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } health_report { overall_health: UNKNOWN } } }
W20260709 12:28:05.487155 18105 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:28:05.508997 18381 consensus_queue.cc:1048] T f7836af3dd864d4cbc3a4f9ee717a6ee P 8b070276227b44858767bb33e02cc11b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:05.525483 18381 consensus_queue.cc:1048] T f7836af3dd864d4cbc3a4f9ee717a6ee P 8b070276227b44858767bb33e02cc11b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:05.532637 18359 consensus_queue.cc:1048] T ec13962b83ce4b6ebe53124d2fdddcd5 P 5ac1c3901f284979a114ebe1dc69831b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:05.536161 18402 consensus_queue.cc:1048] T 5c0b48a3f0574c0ead9ce938d7ce0fa6 P 1ec72e086a2e41498a8e344cfae3b8f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:05.556442 18392 consensus_queue.cc:1048] T ec13962b83ce4b6ebe53124d2fdddcd5 P 5ac1c3901f284979a114ebe1dc69831b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:05.557595 18354 consensus_queue.cc:1048] T 5c0b48a3f0574c0ead9ce938d7ce0fa6 P 1ec72e086a2e41498a8e344cfae3b8f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:05.569507 18354 raft_consensus.cc:493] T a901c0ae9d9f4e82939a611b87bc6014 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:05.570258 18354 raft_consensus.cc:515] T a901c0ae9d9f4e82939a611b87bc6014 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:05.573982 18354 leader_election.cc:290] T a901c0ae9d9f4e82939a611b87bc6014 P 1ec72e086a2e41498a8e344cfae3b8f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785), 8b070276227b44858767bb33e02cc11b (127.9.116.67:41781)
I20260709 12:28:05.574306 18159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a901c0ae9d9f4e82939a611b87bc6014" candidate_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ac1c3901f284979a114ebe1dc69831b" is_pre_election: true
I20260709 12:28:05.575223 18159 raft_consensus.cc:2393] T a901c0ae9d9f4e82939a611b87bc6014 P 5ac1c3901f284979a114ebe1dc69831b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ec72e086a2e41498a8e344cfae3b8f5 in current term 1: Already voted for candidate 8b070276227b44858767bb33e02cc11b in this term.
I20260709 12:28:05.577426 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a901c0ae9d9f4e82939a611b87bc6014" candidate_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b070276227b44858767bb33e02cc11b" is_pre_election: true
I20260709 12:28:05.578908 18200 leader_election.cc:304] T a901c0ae9d9f4e82939a611b87bc6014 P 1ec72e086a2e41498a8e344cfae3b8f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ec72e086a2e41498a8e344cfae3b8f5; no voters: 5ac1c3901f284979a114ebe1dc69831b, 8b070276227b44858767bb33e02cc11b
I20260709 12:28:05.579834 18354 raft_consensus.cc:3060] T a901c0ae9d9f4e82939a611b87bc6014 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:05.589735 18354 raft_consensus.cc:2749] T a901c0ae9d9f4e82939a611b87bc6014 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:05.614109 18381 consensus_queue.cc:1048] T a901c0ae9d9f4e82939a611b87bc6014 P 8b070276227b44858767bb33e02cc11b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:05.624258 18354 consensus_queue.cc:1048] T 019a279ca008410abf88a5dc9f30974a P 1ec72e086a2e41498a8e344cfae3b8f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:05.628847 18381 consensus_queue.cc:1048] T a901c0ae9d9f4e82939a611b87bc6014 P 8b070276227b44858767bb33e02cc11b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:05.643267 18306 raft_consensus.cc:3060] T 019a279ca008410abf88a5dc9f30974a P 8b070276227b44858767bb33e02cc11b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:05.653967  9681 ts_manager.cc:295] Set tserver state for 5ac1c3901f284979a114ebe1dc69831b to MAINTENANCE_MODE
I20260709 12:28:05.655325  9681 tablet_server.cc:179] TabletServer@127.9.116.65:0 shutting down...
I20260709 12:28:05.668596 18398 consensus_queue.cc:1048] T 019a279ca008410abf88a5dc9f30974a P 1ec72e086a2e41498a8e344cfae3b8f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:05.670694 18359 consensus_queue.cc:1048] T c9cdcf5095a14f4db2efdef9465c5719 P 5ac1c3901f284979a114ebe1dc69831b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:05.721280 18392 consensus_queue.cc:1048] T c9cdcf5095a14f4db2efdef9465c5719 P 5ac1c3901f284979a114ebe1dc69831b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:05.732487  9681 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:28:05.736402  9681 tablet_replica.cc:333] T 2452f65bb1e24de4b47df9d6efcb5443 P 5ac1c3901f284979a114ebe1dc69831b: stopping tablet replica
I20260709 12:28:05.737324  9681 raft_consensus.cc:2243] T 2452f65bb1e24de4b47df9d6efcb5443 P 5ac1c3901f284979a114ebe1dc69831b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:05.737700  9681 raft_consensus.cc:2272] T 2452f65bb1e24de4b47df9d6efcb5443 P 5ac1c3901f284979a114ebe1dc69831b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:05.739950  9681 tablet_replica.cc:333] T 3fa608df520c42249d93ddb828490f2d P 5ac1c3901f284979a114ebe1dc69831b: stopping tablet replica
I20260709 12:28:05.740476  9681 raft_consensus.cc:2243] T 3fa608df520c42249d93ddb828490f2d P 5ac1c3901f284979a114ebe1dc69831b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:05.741039  9681 pending_rounds.cc:70] T 3fa608df520c42249d93ddb828490f2d P 5ac1c3901f284979a114ebe1dc69831b: Trying to abort 1 pending ops.
I20260709 12:28:05.741212  9681 pending_rounds.cc:77] T 3fa608df520c42249d93ddb828490f2d P 5ac1c3901f284979a114ebe1dc69831b: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305625949717790720 op_type: NO_OP noop_request { }
I20260709 12:28:05.741488  9681 raft_consensus.cc:2889] T 3fa608df520c42249d93ddb828490f2d P 5ac1c3901f284979a114ebe1dc69831b [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:28:05.741719  9681 raft_consensus.cc:2272] T 3fa608df520c42249d93ddb828490f2d P 5ac1c3901f284979a114ebe1dc69831b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:05.736430 18398 consensus_queue.cc:1048] T d88e2a949fe645c8a5bd2a10fcd84b0d P 1ec72e086a2e41498a8e344cfae3b8f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:28:05.744875  9681 tablet_replica.cc:333] T e545023b44d846bbb719556f2d284a1e P 5ac1c3901f284979a114ebe1dc69831b: stopping tablet replica
I20260709 12:28:05.745880  9681 raft_consensus.cc:2243] T e545023b44d846bbb719556f2d284a1e P 5ac1c3901f284979a114ebe1dc69831b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:05.746528  9681 raft_consensus.cc:2272] T e545023b44d846bbb719556f2d284a1e P 5ac1c3901f284979a114ebe1dc69831b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:05.749035  9681 tablet_replica.cc:333] T a901c0ae9d9f4e82939a611b87bc6014 P 5ac1c3901f284979a114ebe1dc69831b: stopping tablet replica
I20260709 12:28:05.749626  9681 raft_consensus.cc:2243] T a901c0ae9d9f4e82939a611b87bc6014 P 5ac1c3901f284979a114ebe1dc69831b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:05.750247  9681 raft_consensus.cc:2272] T a901c0ae9d9f4e82939a611b87bc6014 P 5ac1c3901f284979a114ebe1dc69831b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:05.753539  9681 tablet_replica.cc:333] T 5c0b48a3f0574c0ead9ce938d7ce0fa6 P 5ac1c3901f284979a114ebe1dc69831b: stopping tablet replica
I20260709 12:28:05.754535  9681 raft_consensus.cc:2243] T 5c0b48a3f0574c0ead9ce938d7ce0fa6 P 5ac1c3901f284979a114ebe1dc69831b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:05.755046  9681 raft_consensus.cc:2272] T 5c0b48a3f0574c0ead9ce938d7ce0fa6 P 5ac1c3901f284979a114ebe1dc69831b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:05.760186  9681 tablet_replica.cc:333] T 019a279ca008410abf88a5dc9f30974a P 5ac1c3901f284979a114ebe1dc69831b: stopping tablet replica
W20260709 12:28:05.760177 18200 consensus_peers.cc:597] T d88e2a949fe645c8a5bd2a10fcd84b0d P 1ec72e086a2e41498a8e344cfae3b8f5 -> Peer 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785): Couldn't send request to peer 5ac1c3901f284979a114ebe1dc69831b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:05.761158  9681 raft_consensus.cc:2243] T 019a279ca008410abf88a5dc9f30974a P 5ac1c3901f284979a114ebe1dc69831b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:05.761788  9681 raft_consensus.cc:2272] T 019a279ca008410abf88a5dc9f30974a P 5ac1c3901f284979a114ebe1dc69831b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:05.765187  9681 tablet_replica.cc:333] T d88e2a949fe645c8a5bd2a10fcd84b0d P 5ac1c3901f284979a114ebe1dc69831b: stopping tablet replica
I20260709 12:28:05.766075  9681 raft_consensus.cc:2243] T d88e2a949fe645c8a5bd2a10fcd84b0d P 5ac1c3901f284979a114ebe1dc69831b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:05.766474  9681 raft_consensus.cc:2272] T d88e2a949fe645c8a5bd2a10fcd84b0d P 5ac1c3901f284979a114ebe1dc69831b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:05.768374  9681 tablet_replica.cc:333] T f7836af3dd864d4cbc3a4f9ee717a6ee P 5ac1c3901f284979a114ebe1dc69831b: stopping tablet replica
I20260709 12:28:05.768893  9681 raft_consensus.cc:2243] T f7836af3dd864d4cbc3a4f9ee717a6ee P 5ac1c3901f284979a114ebe1dc69831b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:05.769270  9681 raft_consensus.cc:2272] T f7836af3dd864d4cbc3a4f9ee717a6ee P 5ac1c3901f284979a114ebe1dc69831b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:05.772719  9681 tablet_replica.cc:333] T ec13962b83ce4b6ebe53124d2fdddcd5 P 5ac1c3901f284979a114ebe1dc69831b: stopping tablet replica
I20260709 12:28:05.773777  9681 raft_consensus.cc:2243] T ec13962b83ce4b6ebe53124d2fdddcd5 P 5ac1c3901f284979a114ebe1dc69831b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:05.773476 18381 raft_consensus.cc:493] T 3fa608df520c42249d93ddb828490f2d P 8b070276227b44858767bb33e02cc11b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:05.774537 18381 raft_consensus.cc:515] T 3fa608df520c42249d93ddb828490f2d P 8b070276227b44858767bb33e02cc11b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:05.775277  9681 raft_consensus.cc:2272] T ec13962b83ce4b6ebe53124d2fdddcd5 P 5ac1c3901f284979a114ebe1dc69831b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:05.776952 18381 leader_election.cc:290] T 3fa608df520c42249d93ddb828490f2d P 8b070276227b44858767bb33e02cc11b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785), 1ec72e086a2e41498a8e344cfae3b8f5 (127.9.116.66:41289)
I20260709 12:28:05.778136 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa608df520c42249d93ddb828490f2d" candidate_uuid: "8b070276227b44858767bb33e02cc11b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" is_pre_election: true
I20260709 12:28:05.778441  9681 tablet_replica.cc:333] T c9cdcf5095a14f4db2efdef9465c5719 P 5ac1c3901f284979a114ebe1dc69831b: stopping tablet replica
I20260709 12:28:05.779053 18234 raft_consensus.cc:2393] T 3fa608df520c42249d93ddb828490f2d P 1ec72e086a2e41498a8e344cfae3b8f5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b070276227b44858767bb33e02cc11b in current term 1: Already voted for candidate 5ac1c3901f284979a114ebe1dc69831b in this term.
I20260709 12:28:05.779206  9681 raft_consensus.cc:2243] T c9cdcf5095a14f4db2efdef9465c5719 P 5ac1c3901f284979a114ebe1dc69831b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:05.780474  9681 raft_consensus.cc:2272] T c9cdcf5095a14f4db2efdef9465c5719 P 5ac1c3901f284979a114ebe1dc69831b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:05.781212 18274 leader_election.cc:336] T 3fa608df520c42249d93ddb828490f2d P 8b070276227b44858767bb33e02cc11b [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:28:05.781884 18274 leader_election.cc:304] T 3fa608df520c42249d93ddb828490f2d P 8b070276227b44858767bb33e02cc11b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b070276227b44858767bb33e02cc11b; no voters: 1ec72e086a2e41498a8e344cfae3b8f5, 5ac1c3901f284979a114ebe1dc69831b
I20260709 12:28:05.782866 18381 raft_consensus.cc:3060] T 3fa608df520c42249d93ddb828490f2d P 8b070276227b44858767bb33e02cc11b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:05.792713 18381 raft_consensus.cc:2749] T 3fa608df520c42249d93ddb828490f2d P 8b070276227b44858767bb33e02cc11b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:05.808475  9681 tablet_server.cc:196] TabletServer@127.9.116.65:0 shutdown complete.
W20260709 12:28:05.820412 18200 consensus_peers.cc:597] T 2452f65bb1e24de4b47df9d6efcb5443 P 1ec72e086a2e41498a8e344cfae3b8f5 -> Peer 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785): Couldn't send request to peer 5ac1c3901f284979a114ebe1dc69831b. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:43785: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:05.825709 18407 consensus_queue.cc:1048] T 2452f65bb1e24de4b47df9d6efcb5443 P 1ec72e086a2e41498a8e344cfae3b8f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:28:05.912724 18274 consensus_peers.cc:597] T e545023b44d846bbb719556f2d284a1e P 8b070276227b44858767bb33e02cc11b -> Peer 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785): Couldn't send request to peer 5ac1c3901f284979a114ebe1dc69831b. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:43785: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:05.940991 18358 consensus_queue.cc:1048] T e545023b44d846bbb719556f2d284a1e P 8b070276227b44858767bb33e02cc11b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:28:06.058826 18274 consensus_peers.cc:597] T f7836af3dd864d4cbc3a4f9ee717a6ee P 8b070276227b44858767bb33e02cc11b -> Peer 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785): Couldn't send request to peer 5ac1c3901f284979a114ebe1dc69831b. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:43785: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:06.102633 18274 consensus_peers.cc:597] T a901c0ae9d9f4e82939a611b87bc6014 P 8b070276227b44858767bb33e02cc11b -> Peer 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785): Couldn't send request to peer 5ac1c3901f284979a114ebe1dc69831b. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:43785: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:06.114849 18200 consensus_peers.cc:597] T 5c0b48a3f0574c0ead9ce938d7ce0fa6 P 1ec72e086a2e41498a8e344cfae3b8f5 -> Peer 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785): Couldn't send request to peer 5ac1c3901f284979a114ebe1dc69831b. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:43785: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:06.166085 18200 consensus_peers.cc:597] T 019a279ca008410abf88a5dc9f30974a P 1ec72e086a2e41498a8e344cfae3b8f5 -> Peer 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785): Couldn't send request to peer 5ac1c3901f284979a114ebe1dc69831b. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:43785: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:06.242543 18200 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.116.65:43785: connect: Connection refused (error 111) [suppressed 136 similar messages]
W20260709 12:28:06.488317 18105 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:28:07.054813 18381 raft_consensus.cc:493] T ec13962b83ce4b6ebe53124d2fdddcd5 P 8b070276227b44858767bb33e02cc11b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ac1c3901f284979a114ebe1dc69831b)
I20260709 12:28:07.055437 18381 raft_consensus.cc:515] T ec13962b83ce4b6ebe53124d2fdddcd5 P 8b070276227b44858767bb33e02cc11b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:07.057796 18381 leader_election.cc:290] T ec13962b83ce4b6ebe53124d2fdddcd5 P 8b070276227b44858767bb33e02cc11b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785), 1ec72e086a2e41498a8e344cfae3b8f5 (127.9.116.66:41289)
I20260709 12:28:07.059681 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13962b83ce4b6ebe53124d2fdddcd5" candidate_uuid: "8b070276227b44858767bb33e02cc11b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" is_pre_election: true
W20260709 12:28:07.063948 18274 leader_election.cc:336] T ec13962b83ce4b6ebe53124d2fdddcd5 P 8b070276227b44858767bb33e02cc11b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785): Network error: Client connection negotiation failed: client connection to 127.9.116.65:43785: connect: Connection refused (error 111)
I20260709 12:28:07.064338 18385 raft_consensus.cc:493] T ec13962b83ce4b6ebe53124d2fdddcd5 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ac1c3901f284979a114ebe1dc69831b)
I20260709 12:28:07.064438 18274 leader_election.cc:304] T ec13962b83ce4b6ebe53124d2fdddcd5 P 8b070276227b44858767bb33e02cc11b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b070276227b44858767bb33e02cc11b; no voters: 1ec72e086a2e41498a8e344cfae3b8f5, 5ac1c3901f284979a114ebe1dc69831b
I20260709 12:28:07.064940 18385 raft_consensus.cc:515] T ec13962b83ce4b6ebe53124d2fdddcd5 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:07.065367 18381 raft_consensus.cc:2749] T ec13962b83ce4b6ebe53124d2fdddcd5 P 8b070276227b44858767bb33e02cc11b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:07.066771 18385 leader_election.cc:290] T ec13962b83ce4b6ebe53124d2fdddcd5 P 1ec72e086a2e41498a8e344cfae3b8f5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785), 8b070276227b44858767bb33e02cc11b (127.9.116.67:41781)
I20260709 12:28:07.068643 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13962b83ce4b6ebe53124d2fdddcd5" candidate_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b070276227b44858767bb33e02cc11b" is_pre_election: true
I20260709 12:28:07.069427 18306 raft_consensus.cc:2468] T ec13962b83ce4b6ebe53124d2fdddcd5 P 8b070276227b44858767bb33e02cc11b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ec72e086a2e41498a8e344cfae3b8f5 in term 1.
I20260709 12:28:07.070559 18200 leader_election.cc:304] T ec13962b83ce4b6ebe53124d2fdddcd5 P 1ec72e086a2e41498a8e344cfae3b8f5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ec72e086a2e41498a8e344cfae3b8f5, 8b070276227b44858767bb33e02cc11b; no voters: 
I20260709 12:28:07.071455 18385 raft_consensus.cc:2804] T ec13962b83ce4b6ebe53124d2fdddcd5 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:28:07.071524 18200 leader_election.cc:336] T ec13962b83ce4b6ebe53124d2fdddcd5 P 1ec72e086a2e41498a8e344cfae3b8f5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785): Network error: Client connection negotiation failed: client connection to 127.9.116.65:43785: connect: Connection refused (error 111)
I20260709 12:28:07.071975 18385 raft_consensus.cc:493] T ec13962b83ce4b6ebe53124d2fdddcd5 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5ac1c3901f284979a114ebe1dc69831b)
I20260709 12:28:07.072386 18385 raft_consensus.cc:3060] T ec13962b83ce4b6ebe53124d2fdddcd5 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:07.081419 18385 raft_consensus.cc:515] T ec13962b83ce4b6ebe53124d2fdddcd5 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:07.084604 18385 leader_election.cc:290] T ec13962b83ce4b6ebe53124d2fdddcd5 P 1ec72e086a2e41498a8e344cfae3b8f5 [CANDIDATE]: Term 2 election: Requested vote from peers 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785), 8b070276227b44858767bb33e02cc11b (127.9.116.67:41781)
I20260709 12:28:07.086412 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13962b83ce4b6ebe53124d2fdddcd5" candidate_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b070276227b44858767bb33e02cc11b"
I20260709 12:28:07.087148 18306 raft_consensus.cc:3060] T ec13962b83ce4b6ebe53124d2fdddcd5 P 8b070276227b44858767bb33e02cc11b [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:28:07.089303 18200 leader_election.cc:336] T ec13962b83ce4b6ebe53124d2fdddcd5 P 1ec72e086a2e41498a8e344cfae3b8f5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785): Network error: Client connection negotiation failed: client connection to 127.9.116.65:43785: connect: Connection refused (error 111)
I20260709 12:28:07.093526 18306 raft_consensus.cc:2468] T ec13962b83ce4b6ebe53124d2fdddcd5 P 8b070276227b44858767bb33e02cc11b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ec72e086a2e41498a8e344cfae3b8f5 in term 2.
I20260709 12:28:07.095068 18200 leader_election.cc:304] T ec13962b83ce4b6ebe53124d2fdddcd5 P 1ec72e086a2e41498a8e344cfae3b8f5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ec72e086a2e41498a8e344cfae3b8f5, 8b070276227b44858767bb33e02cc11b; no voters: 5ac1c3901f284979a114ebe1dc69831b
I20260709 12:28:07.096127 18385 raft_consensus.cc:2804] T ec13962b83ce4b6ebe53124d2fdddcd5 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:07.096709 18385 raft_consensus.cc:697] T ec13962b83ce4b6ebe53124d2fdddcd5 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 2 LEADER]: Becoming Leader. State: Replica: 1ec72e086a2e41498a8e344cfae3b8f5, State: Running, Role: LEADER
I20260709 12:28:07.097496 18385 consensus_queue.cc:237] T ec13962b83ce4b6ebe53124d2fdddcd5 P 1ec72e086a2e41498a8e344cfae3b8f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:07.106741 18056 catalog_manager.cc:5697] T ec13962b83ce4b6ebe53124d2fdddcd5 P 1ec72e086a2e41498a8e344cfae3b8f5 reported cstate change: term changed from 1 to 2, leader changed from 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65) to 1ec72e086a2e41498a8e344cfae3b8f5 (127.9.116.66). New cstate: current_term: 2 leader_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:07.206990 18385 raft_consensus.cc:493] T c9cdcf5095a14f4db2efdef9465c5719 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ac1c3901f284979a114ebe1dc69831b)
I20260709 12:28:07.207612 18385 raft_consensus.cc:515] T c9cdcf5095a14f4db2efdef9465c5719 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } } peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } }
I20260709 12:28:07.209501 18385 leader_election.cc:290] T c9cdcf5095a14f4db2efdef9465c5719 P 1ec72e086a2e41498a8e344cfae3b8f5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8b070276227b44858767bb33e02cc11b (127.9.116.67:41781), 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785)
I20260709 12:28:07.210592 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cdcf5095a14f4db2efdef9465c5719" candidate_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b070276227b44858767bb33e02cc11b" is_pre_election: true
W20260709 12:28:07.213507 18200 leader_election.cc:336] T c9cdcf5095a14f4db2efdef9465c5719 P 1ec72e086a2e41498a8e344cfae3b8f5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785): Network error: Client connection negotiation failed: client connection to 127.9.116.65:43785: connect: Connection refused (error 111)
I20260709 12:28:07.213876 18200 leader_election.cc:304] T c9cdcf5095a14f4db2efdef9465c5719 P 1ec72e086a2e41498a8e344cfae3b8f5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ec72e086a2e41498a8e344cfae3b8f5; no voters: 5ac1c3901f284979a114ebe1dc69831b, 8b070276227b44858767bb33e02cc11b
I20260709 12:28:07.214632 18385 raft_consensus.cc:2749] T c9cdcf5095a14f4db2efdef9465c5719 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:07.225797 18381 raft_consensus.cc:493] T c9cdcf5095a14f4db2efdef9465c5719 P 8b070276227b44858767bb33e02cc11b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ac1c3901f284979a114ebe1dc69831b)
I20260709 12:28:07.226423 18381 raft_consensus.cc:515] T c9cdcf5095a14f4db2efdef9465c5719 P 8b070276227b44858767bb33e02cc11b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } } peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } }
I20260709 12:28:07.228930 18381 leader_election.cc:290] T c9cdcf5095a14f4db2efdef9465c5719 P 8b070276227b44858767bb33e02cc11b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1ec72e086a2e41498a8e344cfae3b8f5 (127.9.116.66:41289), 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785)
I20260709 12:28:07.229961 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cdcf5095a14f4db2efdef9465c5719" candidate_uuid: "8b070276227b44858767bb33e02cc11b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" is_pre_election: true
I20260709 12:28:07.230875 18234 raft_consensus.cc:2468] T c9cdcf5095a14f4db2efdef9465c5719 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b070276227b44858767bb33e02cc11b in term 1.
I20260709 12:28:07.232229 18271 leader_election.cc:304] T c9cdcf5095a14f4db2efdef9465c5719 P 8b070276227b44858767bb33e02cc11b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ec72e086a2e41498a8e344cfae3b8f5, 8b070276227b44858767bb33e02cc11b; no voters: 
I20260709 12:28:07.232967 18381 raft_consensus.cc:2804] T c9cdcf5095a14f4db2efdef9465c5719 P 8b070276227b44858767bb33e02cc11b [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:28:07.233254 18274 leader_election.cc:336] T c9cdcf5095a14f4db2efdef9465c5719 P 8b070276227b44858767bb33e02cc11b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785): Network error: Client connection negotiation failed: client connection to 127.9.116.65:43785: connect: Connection refused (error 111)
I20260709 12:28:07.233305 18381 raft_consensus.cc:493] T c9cdcf5095a14f4db2efdef9465c5719 P 8b070276227b44858767bb33e02cc11b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5ac1c3901f284979a114ebe1dc69831b)
I20260709 12:28:07.233892 18381 raft_consensus.cc:3060] T c9cdcf5095a14f4db2efdef9465c5719 P 8b070276227b44858767bb33e02cc11b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:07.240533 18381 raft_consensus.cc:515] T c9cdcf5095a14f4db2efdef9465c5719 P 8b070276227b44858767bb33e02cc11b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } } peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } }
I20260709 12:28:07.242817 18381 leader_election.cc:290] T c9cdcf5095a14f4db2efdef9465c5719 P 8b070276227b44858767bb33e02cc11b [CANDIDATE]: Term 2 election: Requested vote from peers 1ec72e086a2e41498a8e344cfae3b8f5 (127.9.116.66:41289), 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785)
I20260709 12:28:07.243928 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cdcf5095a14f4db2efdef9465c5719" candidate_uuid: "8b070276227b44858767bb33e02cc11b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ec72e086a2e41498a8e344cfae3b8f5"
I20260709 12:28:07.244611 18234 raft_consensus.cc:3060] T c9cdcf5095a14f4db2efdef9465c5719 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:28:07.247051 18274 leader_election.cc:336] T c9cdcf5095a14f4db2efdef9465c5719 P 8b070276227b44858767bb33e02cc11b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785): Network error: Client connection negotiation failed: client connection to 127.9.116.65:43785: connect: Connection refused (error 111)
I20260709 12:28:07.250021 18234 raft_consensus.cc:2468] T c9cdcf5095a14f4db2efdef9465c5719 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b070276227b44858767bb33e02cc11b in term 2.
I20260709 12:28:07.251381 18271 leader_election.cc:304] T c9cdcf5095a14f4db2efdef9465c5719 P 8b070276227b44858767bb33e02cc11b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ec72e086a2e41498a8e344cfae3b8f5, 8b070276227b44858767bb33e02cc11b; no voters: 5ac1c3901f284979a114ebe1dc69831b
I20260709 12:28:07.252244 18381 raft_consensus.cc:2804] T c9cdcf5095a14f4db2efdef9465c5719 P 8b070276227b44858767bb33e02cc11b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:07.252842 18381 raft_consensus.cc:697] T c9cdcf5095a14f4db2efdef9465c5719 P 8b070276227b44858767bb33e02cc11b [term 2 LEADER]: Becoming Leader. State: Replica: 8b070276227b44858767bb33e02cc11b, State: Running, Role: LEADER
I20260709 12:28:07.253587 18381 consensus_queue.cc:237] T c9cdcf5095a14f4db2efdef9465c5719 P 8b070276227b44858767bb33e02cc11b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } } peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } }
I20260709 12:28:07.262631 18056 catalog_manager.cc:5697] T c9cdcf5095a14f4db2efdef9465c5719 P 8b070276227b44858767bb33e02cc11b reported cstate change: term changed from 1 to 2, leader changed from 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65) to 8b070276227b44858767bb33e02cc11b (127.9.116.67). New cstate: current_term: 2 leader_uuid: "8b070276227b44858767bb33e02cc11b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } health_report { overall_health: UNKNOWN } } }
W20260709 12:28:07.489418 18105 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:28:07.507400 18381 raft_consensus.cc:493] T 3fa608df520c42249d93ddb828490f2d P 8b070276227b44858767bb33e02cc11b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:07.508423 18381 raft_consensus.cc:515] T 3fa608df520c42249d93ddb828490f2d P 8b070276227b44858767bb33e02cc11b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:07.510388 18381 leader_election.cc:290] T 3fa608df520c42249d93ddb828490f2d P 8b070276227b44858767bb33e02cc11b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785), 1ec72e086a2e41498a8e344cfae3b8f5 (127.9.116.66:41289)
I20260709 12:28:07.511737 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa608df520c42249d93ddb828490f2d" candidate_uuid: "8b070276227b44858767bb33e02cc11b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" is_pre_election: true
I20260709 12:28:07.512410 18234 raft_consensus.cc:2468] T 3fa608df520c42249d93ddb828490f2d P 1ec72e086a2e41498a8e344cfae3b8f5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b070276227b44858767bb33e02cc11b in term 1.
W20260709 12:28:07.512773 18274 leader_election.cc:336] T 3fa608df520c42249d93ddb828490f2d P 8b070276227b44858767bb33e02cc11b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785): Network error: Client connection negotiation failed: client connection to 127.9.116.65:43785: connect: Connection refused (error 111)
I20260709 12:28:07.513458 18271 leader_election.cc:304] T 3fa608df520c42249d93ddb828490f2d P 8b070276227b44858767bb33e02cc11b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ec72e086a2e41498a8e344cfae3b8f5, 8b070276227b44858767bb33e02cc11b; no voters: 5ac1c3901f284979a114ebe1dc69831b
I20260709 12:28:07.514196 18381 raft_consensus.cc:2804] T 3fa608df520c42249d93ddb828490f2d P 8b070276227b44858767bb33e02cc11b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:07.514586 18381 raft_consensus.cc:493] T 3fa608df520c42249d93ddb828490f2d P 8b070276227b44858767bb33e02cc11b [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:07.514901 18381 raft_consensus.cc:3060] T 3fa608df520c42249d93ddb828490f2d P 8b070276227b44858767bb33e02cc11b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:07.520776 18381 raft_consensus.cc:515] T 3fa608df520c42249d93ddb828490f2d P 8b070276227b44858767bb33e02cc11b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:07.523151 18381 leader_election.cc:290] T 3fa608df520c42249d93ddb828490f2d P 8b070276227b44858767bb33e02cc11b [CANDIDATE]: Term 2 election: Requested vote from peers 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785), 1ec72e086a2e41498a8e344cfae3b8f5 (127.9.116.66:41289)
I20260709 12:28:07.525015 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa608df520c42249d93ddb828490f2d" candidate_uuid: "8b070276227b44858767bb33e02cc11b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ec72e086a2e41498a8e344cfae3b8f5"
I20260709 12:28:07.525803 18234 raft_consensus.cc:3060] T 3fa608df520c42249d93ddb828490f2d P 1ec72e086a2e41498a8e344cfae3b8f5 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:28:07.527280 18274 leader_election.cc:336] T 3fa608df520c42249d93ddb828490f2d P 8b070276227b44858767bb33e02cc11b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785): Network error: Client connection negotiation failed: client connection to 127.9.116.65:43785: connect: Connection refused (error 111)
I20260709 12:28:07.534428 18234 raft_consensus.cc:2468] T 3fa608df520c42249d93ddb828490f2d P 1ec72e086a2e41498a8e344cfae3b8f5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b070276227b44858767bb33e02cc11b in term 2.
W20260709 12:28:07.536311 18200 consensus_peers.cc:597] T ec13962b83ce4b6ebe53124d2fdddcd5 P 1ec72e086a2e41498a8e344cfae3b8f5 -> Peer 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785): Couldn't send request to peer 5ac1c3901f284979a114ebe1dc69831b. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:43785: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:07.536269 18271 leader_election.cc:304] T 3fa608df520c42249d93ddb828490f2d P 8b070276227b44858767bb33e02cc11b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ec72e086a2e41498a8e344cfae3b8f5, 8b070276227b44858767bb33e02cc11b; no voters: 5ac1c3901f284979a114ebe1dc69831b
I20260709 12:28:07.537746 18381 raft_consensus.cc:2804] T 3fa608df520c42249d93ddb828490f2d P 8b070276227b44858767bb33e02cc11b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:07.538378 18381 raft_consensus.cc:697] T 3fa608df520c42249d93ddb828490f2d P 8b070276227b44858767bb33e02cc11b [term 2 LEADER]: Becoming Leader. State: Replica: 8b070276227b44858767bb33e02cc11b, State: Running, Role: LEADER
I20260709 12:28:07.539230 18381 consensus_queue.cc:237] T 3fa608df520c42249d93ddb828490f2d P 8b070276227b44858767bb33e02cc11b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:07.549242 18056 catalog_manager.cc:5697] T 3fa608df520c42249d93ddb828490f2d P 8b070276227b44858767bb33e02cc11b reported cstate change: term changed from 1 to 2, leader changed from 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65) to 8b070276227b44858767bb33e02cc11b (127.9.116.67). New cstate: current_term: 2 leader_uuid: "8b070276227b44858767bb33e02cc11b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:07.649914 18306 raft_consensus.cc:1275] T ec13962b83ce4b6ebe53124d2fdddcd5 P 8b070276227b44858767bb33e02cc11b [term 2 FOLLOWER]: Refusing update from remote peer 1ec72e086a2e41498a8e344cfae3b8f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:07.651544 18385 consensus_queue.cc:1048] T ec13962b83ce4b6ebe53124d2fdddcd5 P 1ec72e086a2e41498a8e344cfae3b8f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:07.698454 18234 raft_consensus.cc:1275] T c9cdcf5095a14f4db2efdef9465c5719 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 2 FOLLOWER]: Refusing update from remote peer 8b070276227b44858767bb33e02cc11b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:07.700662 18381 consensus_queue.cc:1048] T c9cdcf5095a14f4db2efdef9465c5719 P 8b070276227b44858767bb33e02cc11b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:28:07.717895 18274 consensus_peers.cc:597] T c9cdcf5095a14f4db2efdef9465c5719 P 8b070276227b44858767bb33e02cc11b -> Peer 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785): Couldn't send request to peer 5ac1c3901f284979a114ebe1dc69831b. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:43785: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:08.090865 18232 raft_consensus.cc:1275] T 3fa608df520c42249d93ddb828490f2d P 1ec72e086a2e41498a8e344cfae3b8f5 [term 2 FOLLOWER]: Refusing update from remote peer 8b070276227b44858767bb33e02cc11b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:28:08.092257 18381 consensus_queue.cc:1048] T 3fa608df520c42249d93ddb828490f2d P 8b070276227b44858767bb33e02cc11b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:28:08.110042 18274 consensus_peers.cc:597] T 3fa608df520c42249d93ddb828490f2d P 8b070276227b44858767bb33e02cc11b -> Peer 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785): Couldn't send request to peer 5ac1c3901f284979a114ebe1dc69831b. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:43785: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:08.186224 18200 consensus_peers.cc:597] T 2452f65bb1e24de4b47df9d6efcb5443 P 1ec72e086a2e41498a8e344cfae3b8f5 -> Peer 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785): Couldn't send request to peer 5ac1c3901f284979a114ebe1dc69831b. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:43785: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:08.253279 18200 consensus_peers.cc:597] T d88e2a949fe645c8a5bd2a10fcd84b0d P 1ec72e086a2e41498a8e344cfae3b8f5 -> Peer 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785): Couldn't send request to peer 5ac1c3901f284979a114ebe1dc69831b. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:43785: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:08.490444 18105 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:28:08.491828 18274 consensus_peers.cc:597] T f7836af3dd864d4cbc3a4f9ee717a6ee P 8b070276227b44858767bb33e02cc11b -> Peer 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785): Couldn't send request to peer 5ac1c3901f284979a114ebe1dc69831b. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:43785: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:08.494748 18274 consensus_peers.cc:597] T a901c0ae9d9f4e82939a611b87bc6014 P 8b070276227b44858767bb33e02cc11b -> Peer 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785): Couldn't send request to peer 5ac1c3901f284979a114ebe1dc69831b. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:43785: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:08.527251 18200 consensus_peers.cc:597] T 019a279ca008410abf88a5dc9f30974a P 1ec72e086a2e41498a8e344cfae3b8f5 -> Peer 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785): Couldn't send request to peer 5ac1c3901f284979a114ebe1dc69831b. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:43785: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:08.557140 18274 consensus_peers.cc:597] T e545023b44d846bbb719556f2d284a1e P 8b070276227b44858767bb33e02cc11b -> Peer 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785): Couldn't send request to peer 5ac1c3901f284979a114ebe1dc69831b. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:43785: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:08.844262 18200 consensus_peers.cc:597] T 5c0b48a3f0574c0ead9ce938d7ce0fa6 P 1ec72e086a2e41498a8e344cfae3b8f5 -> Peer 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785): Couldn't send request to peer 5ac1c3901f284979a114ebe1dc69831b. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:43785: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:09.491761 18105 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:28:10.020247 18200 consensus_peers.cc:597] T ec13962b83ce4b6ebe53124d2fdddcd5 P 1ec72e086a2e41498a8e344cfae3b8f5 -> Peer 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785): Couldn't send request to peer 5ac1c3901f284979a114ebe1dc69831b. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:43785: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:10.047257 18274 consensus_peers.cc:597] T c9cdcf5095a14f4db2efdef9465c5719 P 8b070276227b44858767bb33e02cc11b -> Peer 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785): Couldn't send request to peer 5ac1c3901f284979a114ebe1dc69831b. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:43785: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:10.488575 18200 consensus_peers.cc:597] T 2452f65bb1e24de4b47df9d6efcb5443 P 1ec72e086a2e41498a8e344cfae3b8f5 -> Peer 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785): Couldn't send request to peer 5ac1c3901f284979a114ebe1dc69831b. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:43785: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:10.492883 18105 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:28:10.534755 18200 consensus_peers.cc:597] T d88e2a949fe645c8a5bd2a10fcd84b0d P 1ec72e086a2e41498a8e344cfae3b8f5 -> Peer 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785): Couldn't send request to peer 5ac1c3901f284979a114ebe1dc69831b. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:43785: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:10.745132 18274 consensus_peers.cc:597] T 3fa608df520c42249d93ddb828490f2d P 8b070276227b44858767bb33e02cc11b -> Peer 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785): Couldn't send request to peer 5ac1c3901f284979a114ebe1dc69831b. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:43785: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:10.782369 18274 consensus_peers.cc:597] T f7836af3dd864d4cbc3a4f9ee717a6ee P 8b070276227b44858767bb33e02cc11b -> Peer 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785): Couldn't send request to peer 5ac1c3901f284979a114ebe1dc69831b. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:43785: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:10.833521 18274 consensus_peers.cc:597] T e545023b44d846bbb719556f2d284a1e P 8b070276227b44858767bb33e02cc11b -> Peer 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785): Couldn't send request to peer 5ac1c3901f284979a114ebe1dc69831b. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:43785: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:28:10.840502  9681 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:28:10.849086 18460 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:10.849722 18461 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:10.851820 18463 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:10.853173  9681 server_base.cc:1061] running on GCE node
I20260709 12:28:10.854739  9681 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:28:10.854952  9681 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:28:10.855089  9681 hybrid_clock.cc:648] HybridClock initialized: now 1783600090855078 us; error 0 us; skew 500 ppm
I20260709 12:28:10.855741  9681 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:28:10.859977  9681 webserver.cc:533] Webserver started at http://127.9.116.65:46415/ using document root <none> and password file <none>
I20260709 12:28:10.860747  9681 fs_manager.cc:362] Metadata directory not provided
I20260709 12:28:10.861002  9681 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:28:10.866165  9681 fs_manager.cc:714] Time spent opening directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 12:28:10.871289 18468 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:10.872522  9681 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:28:10.873170  9681 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599781984018-9681-0/minicluster-data/ts-0-root
uuid: "5ac1c3901f284979a114ebe1dc69831b"
format_stamp: "Formatted at 2026-07-09 12:28:03 on dist-test-slave-zk51"
I20260709 12:28:10.873592  9681 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599781984018-9681-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599781984018-9681-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599781984018-9681-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:28:10.910288  9681 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:28:10.911702  9681 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:28:10.913378  9681 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:28:10.918197 18475 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
I20260709 12:28:11.000545  9681 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 12:28:11.001070  9681 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.085s	user 0.002s	sys 0.002s
I20260709 12:28:11.001470  9681 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 12:28:11.007853 18475 tablet_bootstrap.cc:492] T f7836af3dd864d4cbc3a4f9ee717a6ee P 5ac1c3901f284979a114ebe1dc69831b: Bootstrap starting.
I20260709 12:28:11.024544 18475 tablet_bootstrap.cc:492] T f7836af3dd864d4cbc3a4f9ee717a6ee P 5ac1c3901f284979a114ebe1dc69831b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:11.025677 18475 tablet_bootstrap.cc:492] T f7836af3dd864d4cbc3a4f9ee717a6ee P 5ac1c3901f284979a114ebe1dc69831b: Bootstrap complete.
I20260709 12:28:11.026321 18475 ts_tablet_manager.cc:1403] T f7836af3dd864d4cbc3a4f9ee717a6ee P 5ac1c3901f284979a114ebe1dc69831b: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
I20260709 12:28:11.028687 18475 raft_consensus.cc:359] T f7836af3dd864d4cbc3a4f9ee717a6ee P 5ac1c3901f284979a114ebe1dc69831b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:11.029310 18475 raft_consensus.cc:740] T f7836af3dd864d4cbc3a4f9ee717a6ee P 5ac1c3901f284979a114ebe1dc69831b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ac1c3901f284979a114ebe1dc69831b, State: Initialized, Role: FOLLOWER
I20260709 12:28:11.030107 18475 consensus_queue.cc:260] T f7836af3dd864d4cbc3a4f9ee717a6ee P 5ac1c3901f284979a114ebe1dc69831b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:11.032588 18475 ts_tablet_manager.cc:1434] T f7836af3dd864d4cbc3a4f9ee717a6ee P 5ac1c3901f284979a114ebe1dc69831b: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:28:11.033387 18475 tablet_bootstrap.cc:492] T a901c0ae9d9f4e82939a611b87bc6014 P 5ac1c3901f284979a114ebe1dc69831b: Bootstrap starting.
I20260709 12:28:11.051647 18475 tablet_bootstrap.cc:492] T a901c0ae9d9f4e82939a611b87bc6014 P 5ac1c3901f284979a114ebe1dc69831b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:11.052558 18475 tablet_bootstrap.cc:492] T a901c0ae9d9f4e82939a611b87bc6014 P 5ac1c3901f284979a114ebe1dc69831b: Bootstrap complete.
I20260709 12:28:11.053169 18475 ts_tablet_manager.cc:1403] T a901c0ae9d9f4e82939a611b87bc6014 P 5ac1c3901f284979a114ebe1dc69831b: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.000s
I20260709 12:28:11.055691 18475 raft_consensus.cc:359] T a901c0ae9d9f4e82939a611b87bc6014 P 5ac1c3901f284979a114ebe1dc69831b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:11.056273 18475 raft_consensus.cc:740] T a901c0ae9d9f4e82939a611b87bc6014 P 5ac1c3901f284979a114ebe1dc69831b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ac1c3901f284979a114ebe1dc69831b, State: Initialized, Role: FOLLOWER
I20260709 12:28:11.056991 18475 consensus_queue.cc:260] T a901c0ae9d9f4e82939a611b87bc6014 P 5ac1c3901f284979a114ebe1dc69831b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:11.057771  9681 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 12:28:11.058175  9681 ts_tablet_manager.cc:595] Time spent register tablets: real 0.057s	user 0.051s	sys 0.004s
I20260709 12:28:11.059149 18475 ts_tablet_manager.cc:1434] T a901c0ae9d9f4e82939a611b87bc6014 P 5ac1c3901f284979a114ebe1dc69831b: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:28:11.060287 18475 tablet_bootstrap.cc:492] T c9cdcf5095a14f4db2efdef9465c5719 P 5ac1c3901f284979a114ebe1dc69831b: Bootstrap starting.
I20260709 12:28:11.081804 18475 tablet_bootstrap.cc:492] T c9cdcf5095a14f4db2efdef9465c5719 P 5ac1c3901f284979a114ebe1dc69831b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:11.083137 18475 tablet_bootstrap.cc:492] T c9cdcf5095a14f4db2efdef9465c5719 P 5ac1c3901f284979a114ebe1dc69831b: Bootstrap complete.
I20260709 12:28:11.084054 18475 ts_tablet_manager.cc:1403] T c9cdcf5095a14f4db2efdef9465c5719 P 5ac1c3901f284979a114ebe1dc69831b: Time spent bootstrapping tablet: real 0.024s	user 0.019s	sys 0.003s
I20260709 12:28:11.086691 18475 raft_consensus.cc:359] T c9cdcf5095a14f4db2efdef9465c5719 P 5ac1c3901f284979a114ebe1dc69831b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } } peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } }
I20260709 12:28:11.087335 18475 raft_consensus.cc:740] T c9cdcf5095a14f4db2efdef9465c5719 P 5ac1c3901f284979a114ebe1dc69831b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ac1c3901f284979a114ebe1dc69831b, State: Initialized, Role: FOLLOWER
I20260709 12:28:11.088138 18475 consensus_queue.cc:260] T c9cdcf5095a14f4db2efdef9465c5719 P 5ac1c3901f284979a114ebe1dc69831b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } } peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } }
I20260709 12:28:11.090190 18475 ts_tablet_manager.cc:1434] T c9cdcf5095a14f4db2efdef9465c5719 P 5ac1c3901f284979a114ebe1dc69831b: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.004s
I20260709 12:28:11.091039 18475 tablet_bootstrap.cc:492] T 5c0b48a3f0574c0ead9ce938d7ce0fa6 P 5ac1c3901f284979a114ebe1dc69831b: Bootstrap starting.
I20260709 12:28:11.115124 18475 tablet_bootstrap.cc:492] T 5c0b48a3f0574c0ead9ce938d7ce0fa6 P 5ac1c3901f284979a114ebe1dc69831b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:11.117277 18475 tablet_bootstrap.cc:492] T 5c0b48a3f0574c0ead9ce938d7ce0fa6 P 5ac1c3901f284979a114ebe1dc69831b: Bootstrap complete.
I20260709 12:28:11.118520 18475 ts_tablet_manager.cc:1403] T 5c0b48a3f0574c0ead9ce938d7ce0fa6 P 5ac1c3901f284979a114ebe1dc69831b: Time spent bootstrapping tablet: real 0.028s	user 0.017s	sys 0.004s
I20260709 12:28:11.122339 18475 raft_consensus.cc:359] T 5c0b48a3f0574c0ead9ce938d7ce0fa6 P 5ac1c3901f284979a114ebe1dc69831b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:11.123445 18475 raft_consensus.cc:740] T 5c0b48a3f0574c0ead9ce938d7ce0fa6 P 5ac1c3901f284979a114ebe1dc69831b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ac1c3901f284979a114ebe1dc69831b, State: Initialized, Role: FOLLOWER
I20260709 12:28:11.124822 18475 consensus_queue.cc:260] T 5c0b48a3f0574c0ead9ce938d7ce0fa6 P 5ac1c3901f284979a114ebe1dc69831b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:11.128412 18475 ts_tablet_manager.cc:1434] T 5c0b48a3f0574c0ead9ce938d7ce0fa6 P 5ac1c3901f284979a114ebe1dc69831b: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 12:28:11.129550 18475 tablet_bootstrap.cc:492] T d88e2a949fe645c8a5bd2a10fcd84b0d P 5ac1c3901f284979a114ebe1dc69831b: Bootstrap starting.
I20260709 12:28:11.139343  9681 rpc_server.cc:307] RPC server started. Bound to: 127.9.116.65:43785
I20260709 12:28:11.139696 18536 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.116.65:43785 every 8 connection(s)
I20260709 12:28:11.152207  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:11.256352 18511 raft_consensus.cc:3060] T c9cdcf5095a14f4db2efdef9465c5719 P 5ac1c3901f284979a114ebe1dc69831b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:11.256446 18475 tablet_bootstrap.cc:492] T d88e2a949fe645c8a5bd2a10fcd84b0d P 5ac1c3901f284979a114ebe1dc69831b: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:11.257689 18475 tablet_bootstrap.cc:492] T d88e2a949fe645c8a5bd2a10fcd84b0d P 5ac1c3901f284979a114ebe1dc69831b: Bootstrap complete.
I20260709 12:28:11.258749 18475 ts_tablet_manager.cc:1403] T d88e2a949fe645c8a5bd2a10fcd84b0d P 5ac1c3901f284979a114ebe1dc69831b: Time spent bootstrapping tablet: real 0.129s	user 0.035s	sys 0.055s
I20260709 12:28:11.262110 18475 raft_consensus.cc:359] T d88e2a949fe645c8a5bd2a10fcd84b0d P 5ac1c3901f284979a114ebe1dc69831b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:11.262903 18475 raft_consensus.cc:740] T d88e2a949fe645c8a5bd2a10fcd84b0d P 5ac1c3901f284979a114ebe1dc69831b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ac1c3901f284979a114ebe1dc69831b, State: Initialized, Role: FOLLOWER
I20260709 12:28:11.280025 18475 consensus_queue.cc:260] T d88e2a949fe645c8a5bd2a10fcd84b0d P 5ac1c3901f284979a114ebe1dc69831b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:11.282498 18537 heartbeater.cc:344] Connected to a master server at 127.9.116.126:42259
I20260709 12:28:11.286384 18537 heartbeater.cc:461] Registering TS with master...
I20260709 12:28:11.286792 18475 ts_tablet_manager.cc:1434] T d88e2a949fe645c8a5bd2a10fcd84b0d P 5ac1c3901f284979a114ebe1dc69831b: Time spent starting tablet: real 0.028s	user 0.011s	sys 0.000s
I20260709 12:28:11.287735 18475 tablet_bootstrap.cc:492] T 3fa608df520c42249d93ddb828490f2d P 5ac1c3901f284979a114ebe1dc69831b: Bootstrap starting.
I20260709 12:28:11.287611 18537 heartbeater.cc:507] Master 127.9.116.126:42259 requested a full tablet report, sending...
I20260709 12:28:11.304150 18054 ts_manager.cc:194] Re-registered known tserver with Master: 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785)
I20260709 12:28:11.314895 18475 tablet_bootstrap.cc:492] T 3fa608df520c42249d93ddb828490f2d P 5ac1c3901f284979a114ebe1dc69831b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:28:11.316498 18475 tablet_bootstrap.cc:492] T 3fa608df520c42249d93ddb828490f2d P 5ac1c3901f284979a114ebe1dc69831b: Bootstrap complete.
I20260709 12:28:11.317288 18475 ts_tablet_manager.cc:1403] T 3fa608df520c42249d93ddb828490f2d P 5ac1c3901f284979a114ebe1dc69831b: Time spent bootstrapping tablet: real 0.030s	user 0.019s	sys 0.000s
I20260709 12:28:11.320019 18475 raft_consensus.cc:359] T 3fa608df520c42249d93ddb828490f2d P 5ac1c3901f284979a114ebe1dc69831b [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:11.321000 18475 raft_consensus.cc:740] T 3fa608df520c42249d93ddb828490f2d P 5ac1c3901f284979a114ebe1dc69831b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ac1c3901f284979a114ebe1dc69831b, State: Initialized, Role: FOLLOWER
I20260709 12:28:11.321830 18475 consensus_queue.cc:260] T 3fa608df520c42249d93ddb828490f2d P 5ac1c3901f284979a114ebe1dc69831b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:11.324438 18475 ts_tablet_manager.cc:1434] T 3fa608df520c42249d93ddb828490f2d P 5ac1c3901f284979a114ebe1dc69831b: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:28:11.325416 18475 tablet_bootstrap.cc:492] T e545023b44d846bbb719556f2d284a1e P 5ac1c3901f284979a114ebe1dc69831b: Bootstrap starting.
I20260709 12:28:11.341982 18475 tablet_bootstrap.cc:492] T e545023b44d846bbb719556f2d284a1e P 5ac1c3901f284979a114ebe1dc69831b: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:11.343104 18475 tablet_bootstrap.cc:492] T e545023b44d846bbb719556f2d284a1e P 5ac1c3901f284979a114ebe1dc69831b: Bootstrap complete.
I20260709 12:28:11.343873 18475 ts_tablet_manager.cc:1403] T e545023b44d846bbb719556f2d284a1e P 5ac1c3901f284979a114ebe1dc69831b: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 12:28:11.346807 18475 raft_consensus.cc:359] T e545023b44d846bbb719556f2d284a1e P 5ac1c3901f284979a114ebe1dc69831b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:11.347816 18475 raft_consensus.cc:740] T e545023b44d846bbb719556f2d284a1e P 5ac1c3901f284979a114ebe1dc69831b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ac1c3901f284979a114ebe1dc69831b, State: Initialized, Role: FOLLOWER
I20260709 12:28:11.349262 18475 consensus_queue.cc:260] T e545023b44d846bbb719556f2d284a1e P 5ac1c3901f284979a114ebe1dc69831b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:11.351544 18475 ts_tablet_manager.cc:1434] T e545023b44d846bbb719556f2d284a1e P 5ac1c3901f284979a114ebe1dc69831b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:28:11.352746 18475 tablet_bootstrap.cc:492] T 019a279ca008410abf88a5dc9f30974a P 5ac1c3901f284979a114ebe1dc69831b: Bootstrap starting.
W20260709 12:28:11.359369 18200 consensus_peers.cc:597] T 019a279ca008410abf88a5dc9f30974a P 1ec72e086a2e41498a8e344cfae3b8f5 -> Peer 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785): Couldn't send request to peer 5ac1c3901f284979a114ebe1dc69831b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:28:11.372439 18475 tablet_bootstrap.cc:492] T 019a279ca008410abf88a5dc9f30974a P 5ac1c3901f284979a114ebe1dc69831b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:11.373997 18475 tablet_bootstrap.cc:492] T 019a279ca008410abf88a5dc9f30974a P 5ac1c3901f284979a114ebe1dc69831b: Bootstrap complete.
I20260709 12:28:11.374907 18475 ts_tablet_manager.cc:1403] T 019a279ca008410abf88a5dc9f30974a P 5ac1c3901f284979a114ebe1dc69831b: Time spent bootstrapping tablet: real 0.022s	user 0.008s	sys 0.010s
I20260709 12:28:11.378149 18475 raft_consensus.cc:359] T 019a279ca008410abf88a5dc9f30974a P 5ac1c3901f284979a114ebe1dc69831b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:11.378965 18475 raft_consensus.cc:740] T 019a279ca008410abf88a5dc9f30974a P 5ac1c3901f284979a114ebe1dc69831b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ac1c3901f284979a114ebe1dc69831b, State: Initialized, Role: FOLLOWER
I20260709 12:28:11.379926 18475 consensus_queue.cc:260] T 019a279ca008410abf88a5dc9f30974a P 5ac1c3901f284979a114ebe1dc69831b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:11.467418 18306 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e545023b44d846bbb719556f2d284a1e"
dest_uuid: "8b070276227b44858767bb33e02cc11b"
mode: GRACEFUL
new_leader_uuid: "1ec72e086a2e41498a8e344cfae3b8f5"
 from {username='slave'} at 127.0.0.1:57496
I20260709 12:28:11.468550 18306 raft_consensus.cc:606] T e545023b44d846bbb719556f2d284a1e P 8b070276227b44858767bb33e02cc11b [term 1 LEADER]: Received request to transfer leadership to TS 1ec72e086a2e41498a8e344cfae3b8f5
W20260709 12:28:11.493904 18105 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:28:11.496717 18475 ts_tablet_manager.cc:1434] T 019a279ca008410abf88a5dc9f30974a P 5ac1c3901f284979a114ebe1dc69831b: Time spent starting tablet: real 0.121s	user 0.007s	sys 0.004s
I20260709 12:28:11.497617 18475 tablet_bootstrap.cc:492] T ec13962b83ce4b6ebe53124d2fdddcd5 P 5ac1c3901f284979a114ebe1dc69831b: Bootstrap starting.
I20260709 12:28:11.498116 18234 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec13962b83ce4b6ebe53124d2fdddcd5"
dest_uuid: "1ec72e086a2e41498a8e344cfae3b8f5"
mode: GRACEFUL
new_leader_uuid: "8b070276227b44858767bb33e02cc11b"
 from {username='slave'} at 127.0.0.1:51982
I20260709 12:28:11.498804 18234 raft_consensus.cc:606] T ec13962b83ce4b6ebe53124d2fdddcd5 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 2 LEADER]: Received request to transfer leadership to TS 8b070276227b44858767bb33e02cc11b
I20260709 12:28:11.500284  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:28:11.501310  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:11.502231  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:11.504904 18054 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34724
I20260709 12:28:11.510962 18475 tablet_bootstrap.cc:492] T ec13962b83ce4b6ebe53124d2fdddcd5 P 5ac1c3901f284979a114ebe1dc69831b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:11.512152 18475 tablet_bootstrap.cc:492] T ec13962b83ce4b6ebe53124d2fdddcd5 P 5ac1c3901f284979a114ebe1dc69831b: Bootstrap complete.
I20260709 12:28:11.512805 18475 ts_tablet_manager.cc:1403] T ec13962b83ce4b6ebe53124d2fdddcd5 P 5ac1c3901f284979a114ebe1dc69831b: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.003s
I20260709 12:28:11.512944 18537 heartbeater.cc:499] Master 127.9.116.126:42259 was elected leader, sending a full tablet report...
I20260709 12:28:11.515547 18475 raft_consensus.cc:359] T ec13962b83ce4b6ebe53124d2fdddcd5 P 5ac1c3901f284979a114ebe1dc69831b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:11.516289 18475 raft_consensus.cc:740] T ec13962b83ce4b6ebe53124d2fdddcd5 P 5ac1c3901f284979a114ebe1dc69831b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ac1c3901f284979a114ebe1dc69831b, State: Initialized, Role: FOLLOWER
I20260709 12:28:11.517006 18475 consensus_queue.cc:260] T ec13962b83ce4b6ebe53124d2fdddcd5 P 5ac1c3901f284979a114ebe1dc69831b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:11.519114 18552 raft_consensus.cc:993] T ec13962b83ce4b6ebe53124d2fdddcd5 P 1ec72e086a2e41498a8e344cfae3b8f5: : Instructing follower 8b070276227b44858767bb33e02cc11b to start an election
I20260709 12:28:11.519305 18475 ts_tablet_manager.cc:1434] T ec13962b83ce4b6ebe53124d2fdddcd5 P 5ac1c3901f284979a114ebe1dc69831b: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:28:11.519937 18552 raft_consensus.cc:1081] T ec13962b83ce4b6ebe53124d2fdddcd5 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 2 LEADER]: Signalling peer 8b070276227b44858767bb33e02cc11b to start an election
I20260709 12:28:11.520493 18475 tablet_bootstrap.cc:492] T 2452f65bb1e24de4b47df9d6efcb5443 P 5ac1c3901f284979a114ebe1dc69831b: Bootstrap starting.
I20260709 12:28:11.522799 18306 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ec13962b83ce4b6ebe53124d2fdddcd5"
dest_uuid: "8b070276227b44858767bb33e02cc11b"
 from {username='slave'} at 127.0.0.1:39144
I20260709 12:28:11.523838 18306 raft_consensus.cc:493] T ec13962b83ce4b6ebe53124d2fdddcd5 P 8b070276227b44858767bb33e02cc11b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:11.524290 18306 raft_consensus.cc:3060] T ec13962b83ce4b6ebe53124d2fdddcd5 P 8b070276227b44858767bb33e02cc11b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:11.527135 18511 raft_consensus.cc:3060] T ec13962b83ce4b6ebe53124d2fdddcd5 P 5ac1c3901f284979a114ebe1dc69831b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:11.539558 18306 raft_consensus.cc:515] T ec13962b83ce4b6ebe53124d2fdddcd5 P 8b070276227b44858767bb33e02cc11b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:11.540374 18475 tablet_bootstrap.cc:492] T 2452f65bb1e24de4b47df9d6efcb5443 P 5ac1c3901f284979a114ebe1dc69831b: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:11.542866 18306 leader_election.cc:290] T ec13962b83ce4b6ebe53124d2fdddcd5 P 8b070276227b44858767bb33e02cc11b [CANDIDATE]: Term 3 election: Requested vote from peers 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785), 1ec72e086a2e41498a8e344cfae3b8f5 (127.9.116.66:41289)
I20260709 12:28:11.542807 18475 tablet_bootstrap.cc:492] T 2452f65bb1e24de4b47df9d6efcb5443 P 5ac1c3901f284979a114ebe1dc69831b: Bootstrap complete.
I20260709 12:28:11.543280 18512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13962b83ce4b6ebe53124d2fdddcd5" candidate_uuid: "8b070276227b44858767bb33e02cc11b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5ac1c3901f284979a114ebe1dc69831b"
I20260709 12:28:11.543371 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec13962b83ce4b6ebe53124d2fdddcd5" candidate_uuid: "8b070276227b44858767bb33e02cc11b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1ec72e086a2e41498a8e344cfae3b8f5"
I20260709 12:28:11.544282 18475 ts_tablet_manager.cc:1403] T 2452f65bb1e24de4b47df9d6efcb5443 P 5ac1c3901f284979a114ebe1dc69831b: Time spent bootstrapping tablet: real 0.024s	user 0.021s	sys 0.000s
I20260709 12:28:11.544240 18234 raft_consensus.cc:3055] T ec13962b83ce4b6ebe53124d2fdddcd5 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:11.544793 18234 raft_consensus.cc:740] T ec13962b83ce4b6ebe53124d2fdddcd5 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1ec72e086a2e41498a8e344cfae3b8f5, State: Running, Role: LEADER
I20260709 12:28:11.546099 18234 consensus_queue.cc:260] T ec13962b83ce4b6ebe53124d2fdddcd5 P 1ec72e086a2e41498a8e344cfae3b8f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:11.548012 18475 raft_consensus.cc:359] T 2452f65bb1e24de4b47df9d6efcb5443 P 5ac1c3901f284979a114ebe1dc69831b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:11.548805 18475 raft_consensus.cc:740] T 2452f65bb1e24de4b47df9d6efcb5443 P 5ac1c3901f284979a114ebe1dc69831b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ac1c3901f284979a114ebe1dc69831b, State: Initialized, Role: FOLLOWER
I20260709 12:28:11.548982 18234 raft_consensus.cc:3060] T ec13962b83ce4b6ebe53124d2fdddcd5 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:11.549921 18475 consensus_queue.cc:260] T 2452f65bb1e24de4b47df9d6efcb5443 P 5ac1c3901f284979a114ebe1dc69831b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:11.552474 18475 ts_tablet_manager.cc:1434] T 2452f65bb1e24de4b47df9d6efcb5443 P 5ac1c3901f284979a114ebe1dc69831b: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:28:11.552626 18550 raft_consensus.cc:993] T e545023b44d846bbb719556f2d284a1e P 8b070276227b44858767bb33e02cc11b: : Instructing follower 1ec72e086a2e41498a8e344cfae3b8f5 to start an election
I20260709 12:28:11.553419 18553 raft_consensus.cc:1081] T e545023b44d846bbb719556f2d284a1e P 8b070276227b44858767bb33e02cc11b [term 1 LEADER]: Signalling peer 1ec72e086a2e41498a8e344cfae3b8f5 to start an election
I20260709 12:28:11.555114 18232 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e545023b44d846bbb719556f2d284a1e"
dest_uuid: "1ec72e086a2e41498a8e344cfae3b8f5"
 from {username='slave'} at 127.0.0.1:51584
I20260709 12:28:11.555727 18232 raft_consensus.cc:493] T e545023b44d846bbb719556f2d284a1e P 1ec72e086a2e41498a8e344cfae3b8f5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:11.556034 18232 raft_consensus.cc:3060] T e545023b44d846bbb719556f2d284a1e P 1ec72e086a2e41498a8e344cfae3b8f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:11.556984 18234 raft_consensus.cc:2468] T ec13962b83ce4b6ebe53124d2fdddcd5 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b070276227b44858767bb33e02cc11b in term 3.
I20260709 12:28:11.558300 18271 leader_election.cc:304] T ec13962b83ce4b6ebe53124d2fdddcd5 P 8b070276227b44858767bb33e02cc11b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ec72e086a2e41498a8e344cfae3b8f5, 8b070276227b44858767bb33e02cc11b; no voters: 5ac1c3901f284979a114ebe1dc69831b
I20260709 12:28:11.559615 18553 raft_consensus.cc:2804] T ec13962b83ce4b6ebe53124d2fdddcd5 P 8b070276227b44858767bb33e02cc11b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:11.560129 18553 raft_consensus.cc:697] T ec13962b83ce4b6ebe53124d2fdddcd5 P 8b070276227b44858767bb33e02cc11b [term 3 LEADER]: Becoming Leader. State: Replica: 8b070276227b44858767bb33e02cc11b, State: Running, Role: LEADER
I20260709 12:28:11.561003 18553 consensus_queue.cc:237] T ec13962b83ce4b6ebe53124d2fdddcd5 P 8b070276227b44858767bb33e02cc11b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:11.562623 18232 raft_consensus.cc:515] T e545023b44d846bbb719556f2d284a1e P 1ec72e086a2e41498a8e344cfae3b8f5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:11.566306 18512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e545023b44d846bbb719556f2d284a1e" candidate_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ac1c3901f284979a114ebe1dc69831b"
I20260709 12:28:11.566838 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e545023b44d846bbb719556f2d284a1e" candidate_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8b070276227b44858767bb33e02cc11b"
I20260709 12:28:11.567497 18512 raft_consensus.cc:3060] T e545023b44d846bbb719556f2d284a1e P 5ac1c3901f284979a114ebe1dc69831b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:11.567795 18306 raft_consensus.cc:3055] T e545023b44d846bbb719556f2d284a1e P 8b070276227b44858767bb33e02cc11b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:11.568125 18306 raft_consensus.cc:740] T e545023b44d846bbb719556f2d284a1e P 8b070276227b44858767bb33e02cc11b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8b070276227b44858767bb33e02cc11b, State: Running, Role: LEADER
I20260709 12:28:11.569260 18306 consensus_queue.cc:260] T e545023b44d846bbb719556f2d284a1e P 8b070276227b44858767bb33e02cc11b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:11.570776 18306 raft_consensus.cc:3060] T e545023b44d846bbb719556f2d284a1e P 8b070276227b44858767bb33e02cc11b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:11.574467 18232 leader_election.cc:290] T e545023b44d846bbb719556f2d284a1e P 1ec72e086a2e41498a8e344cfae3b8f5 [CANDIDATE]: Term 2 election: Requested vote from peers 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785), 8b070276227b44858767bb33e02cc11b (127.9.116.67:41781)
I20260709 12:28:11.579725 18306 raft_consensus.cc:2468] T e545023b44d846bbb719556f2d284a1e P 8b070276227b44858767bb33e02cc11b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ec72e086a2e41498a8e344cfae3b8f5 in term 2.
I20260709 12:28:11.581714 18200 leader_election.cc:304] T e545023b44d846bbb719556f2d284a1e P 1ec72e086a2e41498a8e344cfae3b8f5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ec72e086a2e41498a8e344cfae3b8f5, 8b070276227b44858767bb33e02cc11b; no voters: 
I20260709 12:28:11.582629 18556 raft_consensus.cc:2804] T e545023b44d846bbb719556f2d284a1e P 1ec72e086a2e41498a8e344cfae3b8f5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:11.583519 18556 raft_consensus.cc:697] T e545023b44d846bbb719556f2d284a1e P 1ec72e086a2e41498a8e344cfae3b8f5 [term 2 LEADER]: Becoming Leader. State: Replica: 1ec72e086a2e41498a8e344cfae3b8f5, State: Running, Role: LEADER
I20260709 12:28:11.584503 18556 consensus_queue.cc:237] T e545023b44d846bbb719556f2d284a1e P 1ec72e086a2e41498a8e344cfae3b8f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:11.590667 18512 raft_consensus.cc:2468] T e545023b44d846bbb719556f2d284a1e P 5ac1c3901f284979a114ebe1dc69831b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ec72e086a2e41498a8e344cfae3b8f5 in term 2.
I20260709 12:28:11.590569 18056 catalog_manager.cc:5697] T ec13962b83ce4b6ebe53124d2fdddcd5 P 8b070276227b44858767bb33e02cc11b reported cstate change: term changed from 2 to 3, leader changed from 1ec72e086a2e41498a8e344cfae3b8f5 (127.9.116.66) to 8b070276227b44858767bb33e02cc11b (127.9.116.67). New cstate: current_term: 3 leader_uuid: "8b070276227b44858767bb33e02cc11b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:11.600966 18054 catalog_manager.cc:5697] T e545023b44d846bbb719556f2d284a1e P 1ec72e086a2e41498a8e344cfae3b8f5 reported cstate change: term changed from 1 to 2, leader changed from 8b070276227b44858767bb33e02cc11b (127.9.116.67) to 1ec72e086a2e41498a8e344cfae3b8f5 (127.9.116.66). New cstate: current_term: 2 leader_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:11.647426 18511 raft_consensus.cc:3060] T 3fa608df520c42249d93ddb828490f2d P 5ac1c3901f284979a114ebe1dc69831b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:11.653651 18511 pending_rounds.cc:85] T 3fa608df520c42249d93ddb828490f2d P 5ac1c3901f284979a114ebe1dc69831b: Aborting all ops after (but not including) 0
I20260709 12:28:11.653885 18511 pending_rounds.cc:107] T 3fa608df520c42249d93ddb828490f2d P 5ac1c3901f284979a114ebe1dc69831b: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:28:11.654165 18511 raft_consensus.cc:2889] T 3fa608df520c42249d93ddb828490f2d P 5ac1c3901f284979a114ebe1dc69831b [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:11.991137 18306 raft_consensus.cc:1275] T e545023b44d846bbb719556f2d284a1e P 8b070276227b44858767bb33e02cc11b [term 2 FOLLOWER]: Refusing update from remote peer 1ec72e086a2e41498a8e344cfae3b8f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:11.993366 18556 consensus_queue.cc:1048] T e545023b44d846bbb719556f2d284a1e P 1ec72e086a2e41498a8e344cfae3b8f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:12.007761 18511 raft_consensus.cc:1275] T e545023b44d846bbb719556f2d284a1e P 5ac1c3901f284979a114ebe1dc69831b [term 2 FOLLOWER]: Refusing update from remote peer 1ec72e086a2e41498a8e344cfae3b8f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:12.009702 18556 consensus_queue.cc:1048] T e545023b44d846bbb719556f2d284a1e P 1ec72e086a2e41498a8e344cfae3b8f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:12.023754 18232 raft_consensus.cc:1275] T ec13962b83ce4b6ebe53124d2fdddcd5 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 3 FOLLOWER]: Refusing update from remote peer 8b070276227b44858767bb33e02cc11b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:12.025894 18550 consensus_queue.cc:1048] T ec13962b83ce4b6ebe53124d2fdddcd5 P 8b070276227b44858767bb33e02cc11b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:28:12.043017 18511 raft_consensus.cc:3060] T ec13962b83ce4b6ebe53124d2fdddcd5 P 5ac1c3901f284979a114ebe1dc69831b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:12.052453 18511 raft_consensus.cc:1275] T ec13962b83ce4b6ebe53124d2fdddcd5 P 5ac1c3901f284979a114ebe1dc69831b [term 3 FOLLOWER]: Refusing update from remote peer 8b070276227b44858767bb33e02cc11b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:12.054338 18553 consensus_queue.cc:1048] T ec13962b83ce4b6ebe53124d2fdddcd5 P 8b070276227b44858767bb33e02cc11b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:28:12.406400 18329 debug-util.cc:398] Leaking SignalData structure 0x7b080035dae0 after lost signal to thread 9684
W20260709 12:28:12.407969 18329 debug-util.cc:398] Leaking SignalData structure 0x7b08002fb6c0 after lost signal to thread 18091
W20260709 12:28:12.410765 18329 debug-util.cc:398] Leaking SignalData structure 0x7b080033f720 after lost signal to thread 18332
W20260709 12:28:12.412703 18329 debug-util.cc:398] Leaking SignalData structure 0x7b0800269400 after lost signal to thread 18536
W20260709 12:28:12.496084 18105 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:28:12.517473  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:12.531858 18306 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c9cdcf5095a14f4db2efdef9465c5719"
dest_uuid: "8b070276227b44858767bb33e02cc11b"
mode: GRACEFUL
new_leader_uuid: "1ec72e086a2e41498a8e344cfae3b8f5"
 from {username='slave'} at 127.0.0.1:57496
I20260709 12:28:12.533069 18306 raft_consensus.cc:606] T c9cdcf5095a14f4db2efdef9465c5719 P 8b070276227b44858767bb33e02cc11b [term 2 LEADER]: Received request to transfer leadership to TS 1ec72e086a2e41498a8e344cfae3b8f5
I20260709 12:28:12.538740 18232 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d88e2a949fe645c8a5bd2a10fcd84b0d"
dest_uuid: "1ec72e086a2e41498a8e344cfae3b8f5"
mode: GRACEFUL
new_leader_uuid: "8b070276227b44858767bb33e02cc11b"
 from {username='slave'} at 127.0.0.1:51982
I20260709 12:28:12.539497 18232 raft_consensus.cc:606] T d88e2a949fe645c8a5bd2a10fcd84b0d P 1ec72e086a2e41498a8e344cfae3b8f5 [term 1 LEADER]: Received request to transfer leadership to TS 8b070276227b44858767bb33e02cc11b
I20260709 12:28:12.542553  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:28:12.543725  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:12.545149  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:12.822539 18453 raft_consensus.cc:993] T d88e2a949fe645c8a5bd2a10fcd84b0d P 1ec72e086a2e41498a8e344cfae3b8f5: : Instructing follower 8b070276227b44858767bb33e02cc11b to start an election
I20260709 12:28:12.823335 18556 raft_consensus.cc:1081] T d88e2a949fe645c8a5bd2a10fcd84b0d P 1ec72e086a2e41498a8e344cfae3b8f5 [term 1 LEADER]: Signalling peer 8b070276227b44858767bb33e02cc11b to start an election
I20260709 12:28:12.825709 18306 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d88e2a949fe645c8a5bd2a10fcd84b0d"
dest_uuid: "8b070276227b44858767bb33e02cc11b"
 from {username='slave'} at 127.0.0.1:39144
I20260709 12:28:12.826602 18306 raft_consensus.cc:493] T d88e2a949fe645c8a5bd2a10fcd84b0d P 8b070276227b44858767bb33e02cc11b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:12.827157 18306 raft_consensus.cc:3060] T d88e2a949fe645c8a5bd2a10fcd84b0d P 8b070276227b44858767bb33e02cc11b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:12.833554 18575 raft_consensus.cc:993] T c9cdcf5095a14f4db2efdef9465c5719 P 8b070276227b44858767bb33e02cc11b: : Instructing follower 1ec72e086a2e41498a8e344cfae3b8f5 to start an election
I20260709 12:28:12.834334 18574 raft_consensus.cc:1081] T c9cdcf5095a14f4db2efdef9465c5719 P 8b070276227b44858767bb33e02cc11b [term 2 LEADER]: Signalling peer 1ec72e086a2e41498a8e344cfae3b8f5 to start an election
I20260709 12:28:12.836705 18232 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c9cdcf5095a14f4db2efdef9465c5719"
dest_uuid: "1ec72e086a2e41498a8e344cfae3b8f5"
 from {username='slave'} at 127.0.0.1:51584
I20260709 12:28:12.837623 18232 raft_consensus.cc:493] T c9cdcf5095a14f4db2efdef9465c5719 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:12.838042 18232 raft_consensus.cc:3060] T c9cdcf5095a14f4db2efdef9465c5719 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:12.841308 18306 raft_consensus.cc:515] T d88e2a949fe645c8a5bd2a10fcd84b0d P 8b070276227b44858767bb33e02cc11b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:12.845070 18306 leader_election.cc:290] T d88e2a949fe645c8a5bd2a10fcd84b0d P 8b070276227b44858767bb33e02cc11b [CANDIDATE]: Term 2 election: Requested vote from peers 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785), 1ec72e086a2e41498a8e344cfae3b8f5 (127.9.116.66:41289)
I20260709 12:28:12.845947 18512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88e2a949fe645c8a5bd2a10fcd84b0d" candidate_uuid: "8b070276227b44858767bb33e02cc11b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ac1c3901f284979a114ebe1dc69831b"
I20260709 12:28:12.847303 18512 raft_consensus.cc:3060] T d88e2a949fe645c8a5bd2a10fcd84b0d P 5ac1c3901f284979a114ebe1dc69831b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:12.848413 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88e2a949fe645c8a5bd2a10fcd84b0d" candidate_uuid: "8b070276227b44858767bb33e02cc11b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1ec72e086a2e41498a8e344cfae3b8f5"
I20260709 12:28:12.849436 18234 raft_consensus.cc:3055] T d88e2a949fe645c8a5bd2a10fcd84b0d P 1ec72e086a2e41498a8e344cfae3b8f5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:12.849952 18234 raft_consensus.cc:740] T d88e2a949fe645c8a5bd2a10fcd84b0d P 1ec72e086a2e41498a8e344cfae3b8f5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1ec72e086a2e41498a8e344cfae3b8f5, State: Running, Role: LEADER
I20260709 12:28:12.851053 18232 raft_consensus.cc:515] T c9cdcf5095a14f4db2efdef9465c5719 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } } peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } }
I20260709 12:28:12.851689 18234 consensus_queue.cc:260] T d88e2a949fe645c8a5bd2a10fcd84b0d P 1ec72e086a2e41498a8e344cfae3b8f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:12.854228 18232 leader_election.cc:290] T c9cdcf5095a14f4db2efdef9465c5719 P 1ec72e086a2e41498a8e344cfae3b8f5 [CANDIDATE]: Term 3 election: Requested vote from peers 8b070276227b44858767bb33e02cc11b (127.9.116.67:41781), 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785)
I20260709 12:28:12.856148 18511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cdcf5095a14f4db2efdef9465c5719" candidate_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5ac1c3901f284979a114ebe1dc69831b"
I20260709 12:28:12.856884 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cdcf5095a14f4db2efdef9465c5719" candidate_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8b070276227b44858767bb33e02cc11b"
I20260709 12:28:12.857535 18306 raft_consensus.cc:3055] T c9cdcf5095a14f4db2efdef9465c5719 P 8b070276227b44858767bb33e02cc11b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:12.857859 18306 raft_consensus.cc:740] T c9cdcf5095a14f4db2efdef9465c5719 P 8b070276227b44858767bb33e02cc11b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8b070276227b44858767bb33e02cc11b, State: Running, Role: LEADER
I20260709 12:28:12.858351 18511 raft_consensus.cc:3060] T c9cdcf5095a14f4db2efdef9465c5719 P 5ac1c3901f284979a114ebe1dc69831b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:12.859231 18306 consensus_queue.cc:260] T c9cdcf5095a14f4db2efdef9465c5719 P 8b070276227b44858767bb33e02cc11b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } } peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } }
I20260709 12:28:12.860015 18234 raft_consensus.cc:3060] T d88e2a949fe645c8a5bd2a10fcd84b0d P 1ec72e086a2e41498a8e344cfae3b8f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:12.860643 18512 raft_consensus.cc:2468] T d88e2a949fe645c8a5bd2a10fcd84b0d P 5ac1c3901f284979a114ebe1dc69831b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b070276227b44858767bb33e02cc11b in term 2.
I20260709 12:28:12.863095 18274 leader_election.cc:304] T d88e2a949fe645c8a5bd2a10fcd84b0d P 8b070276227b44858767bb33e02cc11b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ac1c3901f284979a114ebe1dc69831b, 8b070276227b44858767bb33e02cc11b; no voters: 
I20260709 12:28:12.864534 18574 raft_consensus.cc:2804] T d88e2a949fe645c8a5bd2a10fcd84b0d P 8b070276227b44858767bb33e02cc11b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:12.865127 18574 raft_consensus.cc:697] T d88e2a949fe645c8a5bd2a10fcd84b0d P 8b070276227b44858767bb33e02cc11b [term 2 LEADER]: Becoming Leader. State: Replica: 8b070276227b44858767bb33e02cc11b, State: Running, Role: LEADER
I20260709 12:28:12.867080 18574 consensus_queue.cc:237] T d88e2a949fe645c8a5bd2a10fcd84b0d P 8b070276227b44858767bb33e02cc11b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:12.860924 18306 raft_consensus.cc:3060] T c9cdcf5095a14f4db2efdef9465c5719 P 8b070276227b44858767bb33e02cc11b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:12.870434 18234 raft_consensus.cc:2468] T d88e2a949fe645c8a5bd2a10fcd84b0d P 1ec72e086a2e41498a8e344cfae3b8f5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b070276227b44858767bb33e02cc11b in term 2.
I20260709 12:28:12.878631 18511 raft_consensus.cc:2468] T c9cdcf5095a14f4db2efdef9465c5719 P 5ac1c3901f284979a114ebe1dc69831b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ec72e086a2e41498a8e344cfae3b8f5 in term 3.
I20260709 12:28:12.880319 18200 leader_election.cc:304] T c9cdcf5095a14f4db2efdef9465c5719 P 1ec72e086a2e41498a8e344cfae3b8f5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ec72e086a2e41498a8e344cfae3b8f5, 5ac1c3901f284979a114ebe1dc69831b; no voters: 
I20260709 12:28:12.880888 18306 raft_consensus.cc:2468] T c9cdcf5095a14f4db2efdef9465c5719 P 8b070276227b44858767bb33e02cc11b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ec72e086a2e41498a8e344cfae3b8f5 in term 3.
I20260709 12:28:12.881413 18556 raft_consensus.cc:2804] T c9cdcf5095a14f4db2efdef9465c5719 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:12.881982 18556 raft_consensus.cc:697] T c9cdcf5095a14f4db2efdef9465c5719 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 3 LEADER]: Becoming Leader. State: Replica: 1ec72e086a2e41498a8e344cfae3b8f5, State: Running, Role: LEADER
I20260709 12:28:12.883124 18556 consensus_queue.cc:237] T c9cdcf5095a14f4db2efdef9465c5719 P 1ec72e086a2e41498a8e344cfae3b8f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } } peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } }
I20260709 12:28:12.891134 18053 catalog_manager.cc:5697] T d88e2a949fe645c8a5bd2a10fcd84b0d P 8b070276227b44858767bb33e02cc11b reported cstate change: term changed from 1 to 2, leader changed from 1ec72e086a2e41498a8e344cfae3b8f5 (127.9.116.66) to 8b070276227b44858767bb33e02cc11b (127.9.116.67). New cstate: current_term: 2 leader_uuid: "8b070276227b44858767bb33e02cc11b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:12.895318 18054 catalog_manager.cc:5697] T c9cdcf5095a14f4db2efdef9465c5719 P 1ec72e086a2e41498a8e344cfae3b8f5 reported cstate change: term changed from 2 to 3, leader changed from 8b070276227b44858767bb33e02cc11b (127.9.116.67) to 1ec72e086a2e41498a8e344cfae3b8f5 (127.9.116.66). New cstate: current_term: 3 leader_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:13.269785 18512 raft_consensus.cc:1275] T d88e2a949fe645c8a5bd2a10fcd84b0d P 5ac1c3901f284979a114ebe1dc69831b [term 2 FOLLOWER]: Refusing update from remote peer 8b070276227b44858767bb33e02cc11b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:13.271425 18574 consensus_queue.cc:1048] T d88e2a949fe645c8a5bd2a10fcd84b0d P 8b070276227b44858767bb33e02cc11b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:13.288319 18234 raft_consensus.cc:1275] T d88e2a949fe645c8a5bd2a10fcd84b0d P 1ec72e086a2e41498a8e344cfae3b8f5 [term 2 FOLLOWER]: Refusing update from remote peer 8b070276227b44858767bb33e02cc11b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:13.290512 18575 consensus_queue.cc:1048] T d88e2a949fe645c8a5bd2a10fcd84b0d P 8b070276227b44858767bb33e02cc11b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:13.427155 18512 raft_consensus.cc:1275] T c9cdcf5095a14f4db2efdef9465c5719 P 5ac1c3901f284979a114ebe1dc69831b [term 3 FOLLOWER]: Refusing update from remote peer 1ec72e086a2e41498a8e344cfae3b8f5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:13.428753 18556 consensus_queue.cc:1048] T c9cdcf5095a14f4db2efdef9465c5719 P 1ec72e086a2e41498a8e344cfae3b8f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:13.441805 18306 raft_consensus.cc:1275] T c9cdcf5095a14f4db2efdef9465c5719 P 8b070276227b44858767bb33e02cc11b [term 3 FOLLOWER]: Refusing update from remote peer 1ec72e086a2e41498a8e344cfae3b8f5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:13.443722 18556 consensus_queue.cc:1048] T c9cdcf5095a14f4db2efdef9465c5719 P 1ec72e086a2e41498a8e344cfae3b8f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:28:13.497918 18105 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:28:13.562026  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:13.573172 18234 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e545023b44d846bbb719556f2d284a1e"
dest_uuid: "1ec72e086a2e41498a8e344cfae3b8f5"
mode: GRACEFUL
new_leader_uuid: "8b070276227b44858767bb33e02cc11b"
 from {username='slave'} at 127.0.0.1:51982
I20260709 12:28:13.573992 18234 raft_consensus.cc:606] T e545023b44d846bbb719556f2d284a1e P 1ec72e086a2e41498a8e344cfae3b8f5 [term 2 LEADER]: Received request to transfer leadership to TS 8b070276227b44858767bb33e02cc11b
I20260709 12:28:13.577982 18306 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f7836af3dd864d4cbc3a4f9ee717a6ee"
dest_uuid: "8b070276227b44858767bb33e02cc11b"
mode: GRACEFUL
new_leader_uuid: "1ec72e086a2e41498a8e344cfae3b8f5"
 from {username='slave'} at 127.0.0.1:57496
I20260709 12:28:13.578883 18306 raft_consensus.cc:606] T f7836af3dd864d4cbc3a4f9ee717a6ee P 8b070276227b44858767bb33e02cc11b [term 1 LEADER]: Received request to transfer leadership to TS 1ec72e086a2e41498a8e344cfae3b8f5
I20260709 12:28:13.580807  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:28:13.581444  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:13.582391  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:13.849648 18575 raft_consensus.cc:993] T f7836af3dd864d4cbc3a4f9ee717a6ee P 8b070276227b44858767bb33e02cc11b: : Instructing follower 1ec72e086a2e41498a8e344cfae3b8f5 to start an election
I20260709 12:28:13.850394 18574 raft_consensus.cc:1081] T f7836af3dd864d4cbc3a4f9ee717a6ee P 8b070276227b44858767bb33e02cc11b [term 1 LEADER]: Signalling peer 1ec72e086a2e41498a8e344cfae3b8f5 to start an election
I20260709 12:28:13.852504 18234 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f7836af3dd864d4cbc3a4f9ee717a6ee"
dest_uuid: "1ec72e086a2e41498a8e344cfae3b8f5"
 from {username='slave'} at 127.0.0.1:51584
I20260709 12:28:13.853045 18234 raft_consensus.cc:493] T f7836af3dd864d4cbc3a4f9ee717a6ee P 1ec72e086a2e41498a8e344cfae3b8f5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:13.853343 18234 raft_consensus.cc:3060] T f7836af3dd864d4cbc3a4f9ee717a6ee P 1ec72e086a2e41498a8e344cfae3b8f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:13.859155 18234 raft_consensus.cc:515] T f7836af3dd864d4cbc3a4f9ee717a6ee P 1ec72e086a2e41498a8e344cfae3b8f5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:13.860706 18234 leader_election.cc:290] T f7836af3dd864d4cbc3a4f9ee717a6ee P 1ec72e086a2e41498a8e344cfae3b8f5 [CANDIDATE]: Term 2 election: Requested vote from peers 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785), 8b070276227b44858767bb33e02cc11b (127.9.116.67:41781)
I20260709 12:28:13.862280 18512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7836af3dd864d4cbc3a4f9ee717a6ee" candidate_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ac1c3901f284979a114ebe1dc69831b"
I20260709 12:28:13.862777 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7836af3dd864d4cbc3a4f9ee717a6ee" candidate_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8b070276227b44858767bb33e02cc11b"
I20260709 12:28:13.863369 18512 raft_consensus.cc:3060] T f7836af3dd864d4cbc3a4f9ee717a6ee P 5ac1c3901f284979a114ebe1dc69831b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:13.863528 18306 raft_consensus.cc:3055] T f7836af3dd864d4cbc3a4f9ee717a6ee P 8b070276227b44858767bb33e02cc11b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:13.864099 18306 raft_consensus.cc:740] T f7836af3dd864d4cbc3a4f9ee717a6ee P 8b070276227b44858767bb33e02cc11b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8b070276227b44858767bb33e02cc11b, State: Running, Role: LEADER
I20260709 12:28:13.864918 18306 consensus_queue.cc:260] T f7836af3dd864d4cbc3a4f9ee717a6ee P 8b070276227b44858767bb33e02cc11b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:13.865974 18306 raft_consensus.cc:3060] T f7836af3dd864d4cbc3a4f9ee717a6ee P 8b070276227b44858767bb33e02cc11b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:13.873250 18306 raft_consensus.cc:2468] T f7836af3dd864d4cbc3a4f9ee717a6ee P 8b070276227b44858767bb33e02cc11b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ec72e086a2e41498a8e344cfae3b8f5 in term 2.
I20260709 12:28:13.874476 18200 leader_election.cc:304] T f7836af3dd864d4cbc3a4f9ee717a6ee P 1ec72e086a2e41498a8e344cfae3b8f5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ec72e086a2e41498a8e344cfae3b8f5, 8b070276227b44858767bb33e02cc11b; no voters: 
I20260709 12:28:13.875180 18512 raft_consensus.cc:2468] T f7836af3dd864d4cbc3a4f9ee717a6ee P 5ac1c3901f284979a114ebe1dc69831b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ec72e086a2e41498a8e344cfae3b8f5 in term 2.
I20260709 12:28:13.875438 18590 raft_consensus.cc:2804] T f7836af3dd864d4cbc3a4f9ee717a6ee P 1ec72e086a2e41498a8e344cfae3b8f5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:13.876345 18590 raft_consensus.cc:697] T f7836af3dd864d4cbc3a4f9ee717a6ee P 1ec72e086a2e41498a8e344cfae3b8f5 [term 2 LEADER]: Becoming Leader. State: Replica: 1ec72e086a2e41498a8e344cfae3b8f5, State: Running, Role: LEADER
I20260709 12:28:13.877840 18590 consensus_queue.cc:237] T f7836af3dd864d4cbc3a4f9ee717a6ee P 1ec72e086a2e41498a8e344cfae3b8f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:13.888834 18054 catalog_manager.cc:5697] T f7836af3dd864d4cbc3a4f9ee717a6ee P 1ec72e086a2e41498a8e344cfae3b8f5 reported cstate change: term changed from 1 to 2, leader changed from 8b070276227b44858767bb33e02cc11b (127.9.116.67) to 1ec72e086a2e41498a8e344cfae3b8f5 (127.9.116.66). New cstate: current_term: 2 leader_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:13.905942 18453 raft_consensus.cc:993] T e545023b44d846bbb719556f2d284a1e P 1ec72e086a2e41498a8e344cfae3b8f5: : Instructing follower 8b070276227b44858767bb33e02cc11b to start an election
I20260709 12:28:13.906560 18590 raft_consensus.cc:1081] T e545023b44d846bbb719556f2d284a1e P 1ec72e086a2e41498a8e344cfae3b8f5 [term 2 LEADER]: Signalling peer 8b070276227b44858767bb33e02cc11b to start an election
I20260709 12:28:13.909296 18306 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e545023b44d846bbb719556f2d284a1e"
dest_uuid: "8b070276227b44858767bb33e02cc11b"
 from {username='slave'} at 127.0.0.1:39144
I20260709 12:28:13.909817 18306 raft_consensus.cc:493] T e545023b44d846bbb719556f2d284a1e P 8b070276227b44858767bb33e02cc11b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:13.910146 18306 raft_consensus.cc:3060] T e545023b44d846bbb719556f2d284a1e P 8b070276227b44858767bb33e02cc11b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:13.917157 18306 raft_consensus.cc:515] T e545023b44d846bbb719556f2d284a1e P 8b070276227b44858767bb33e02cc11b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:13.919440 18306 leader_election.cc:290] T e545023b44d846bbb719556f2d284a1e P 8b070276227b44858767bb33e02cc11b [CANDIDATE]: Term 3 election: Requested vote from peers 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785), 1ec72e086a2e41498a8e344cfae3b8f5 (127.9.116.66:41289)
I20260709 12:28:13.921010 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e545023b44d846bbb719556f2d284a1e" candidate_uuid: "8b070276227b44858767bb33e02cc11b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1ec72e086a2e41498a8e344cfae3b8f5"
I20260709 12:28:13.921015 18512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e545023b44d846bbb719556f2d284a1e" candidate_uuid: "8b070276227b44858767bb33e02cc11b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5ac1c3901f284979a114ebe1dc69831b"
I20260709 12:28:13.921970 18234 raft_consensus.cc:3055] T e545023b44d846bbb719556f2d284a1e P 1ec72e086a2e41498a8e344cfae3b8f5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:13.922187 18512 raft_consensus.cc:3060] T e545023b44d846bbb719556f2d284a1e P 5ac1c3901f284979a114ebe1dc69831b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:13.922396 18234 raft_consensus.cc:740] T e545023b44d846bbb719556f2d284a1e P 1ec72e086a2e41498a8e344cfae3b8f5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1ec72e086a2e41498a8e344cfae3b8f5, State: Running, Role: LEADER
I20260709 12:28:13.923632 18234 consensus_queue.cc:260] T e545023b44d846bbb719556f2d284a1e P 1ec72e086a2e41498a8e344cfae3b8f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:13.925084 18234 raft_consensus.cc:3060] T e545023b44d846bbb719556f2d284a1e P 1ec72e086a2e41498a8e344cfae3b8f5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:13.931725 18234 raft_consensus.cc:2468] T e545023b44d846bbb719556f2d284a1e P 1ec72e086a2e41498a8e344cfae3b8f5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b070276227b44858767bb33e02cc11b in term 3.
I20260709 12:28:13.933068 18271 leader_election.cc:304] T e545023b44d846bbb719556f2d284a1e P 8b070276227b44858767bb33e02cc11b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ec72e086a2e41498a8e344cfae3b8f5, 8b070276227b44858767bb33e02cc11b; no voters: 
I20260709 12:28:13.933914 18574 raft_consensus.cc:2804] T e545023b44d846bbb719556f2d284a1e P 8b070276227b44858767bb33e02cc11b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:13.934403 18574 raft_consensus.cc:697] T e545023b44d846bbb719556f2d284a1e P 8b070276227b44858767bb33e02cc11b [term 3 LEADER]: Becoming Leader. State: Replica: 8b070276227b44858767bb33e02cc11b, State: Running, Role: LEADER
I20260709 12:28:13.935905 18512 raft_consensus.cc:2468] T e545023b44d846bbb719556f2d284a1e P 5ac1c3901f284979a114ebe1dc69831b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b070276227b44858767bb33e02cc11b in term 3.
I20260709 12:28:13.935550 18574 consensus_queue.cc:237] T e545023b44d846bbb719556f2d284a1e P 8b070276227b44858767bb33e02cc11b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:13.948655 18054 catalog_manager.cc:5697] T e545023b44d846bbb719556f2d284a1e P 8b070276227b44858767bb33e02cc11b reported cstate change: term changed from 2 to 3, leader changed from 1ec72e086a2e41498a8e344cfae3b8f5 (127.9.116.66) to 8b070276227b44858767bb33e02cc11b (127.9.116.67). New cstate: current_term: 3 leader_uuid: "8b070276227b44858767bb33e02cc11b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:14.394147 18512 raft_consensus.cc:1275] T e545023b44d846bbb719556f2d284a1e P 5ac1c3901f284979a114ebe1dc69831b [term 3 FOLLOWER]: Refusing update from remote peer 8b070276227b44858767bb33e02cc11b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:14.396266 18575 consensus_queue.cc:1048] T e545023b44d846bbb719556f2d284a1e P 8b070276227b44858767bb33e02cc11b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:28:14.420675 18234 raft_consensus.cc:1275] T e545023b44d846bbb719556f2d284a1e P 1ec72e086a2e41498a8e344cfae3b8f5 [term 3 FOLLOWER]: Refusing update from remote peer 8b070276227b44858767bb33e02cc11b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:14.425482 18574 consensus_queue.cc:1048] T e545023b44d846bbb719556f2d284a1e P 8b070276227b44858767bb33e02cc11b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:28:14.463624 18306 raft_consensus.cc:1275] T f7836af3dd864d4cbc3a4f9ee717a6ee P 8b070276227b44858767bb33e02cc11b [term 2 FOLLOWER]: Refusing update from remote peer 1ec72e086a2e41498a8e344cfae3b8f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:14.465752 18590 consensus_queue.cc:1048] T f7836af3dd864d4cbc3a4f9ee717a6ee P 1ec72e086a2e41498a8e344cfae3b8f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:14.481230 18512 raft_consensus.cc:1275] T f7836af3dd864d4cbc3a4f9ee717a6ee P 5ac1c3901f284979a114ebe1dc69831b [term 2 FOLLOWER]: Refusing update from remote peer 1ec72e086a2e41498a8e344cfae3b8f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:14.483409 18453 consensus_queue.cc:1048] T f7836af3dd864d4cbc3a4f9ee717a6ee P 1ec72e086a2e41498a8e344cfae3b8f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:28:14.499163 18105 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:28:14.590452  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:14.599862 18306 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e545023b44d846bbb719556f2d284a1e"
dest_uuid: "8b070276227b44858767bb33e02cc11b"
mode: GRACEFUL
new_leader_uuid: "1ec72e086a2e41498a8e344cfae3b8f5"
 from {username='slave'} at 127.0.0.1:57496
I20260709 12:28:14.600970 18306 raft_consensus.cc:606] T e545023b44d846bbb719556f2d284a1e P 8b070276227b44858767bb33e02cc11b [term 3 LEADER]: Received request to transfer leadership to TS 1ec72e086a2e41498a8e344cfae3b8f5
I20260709 12:28:14.604672 18234 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f7836af3dd864d4cbc3a4f9ee717a6ee"
dest_uuid: "1ec72e086a2e41498a8e344cfae3b8f5"
mode: GRACEFUL
new_leader_uuid: "8b070276227b44858767bb33e02cc11b"
 from {username='slave'} at 127.0.0.1:51982
I20260709 12:28:14.605239 18234 raft_consensus.cc:606] T f7836af3dd864d4cbc3a4f9ee717a6ee P 1ec72e086a2e41498a8e344cfae3b8f5 [term 2 LEADER]: Received request to transfer leadership to TS 8b070276227b44858767bb33e02cc11b
I20260709 12:28:14.606674  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:28:14.607309  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:14.608024  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:14.978471 18609 raft_consensus.cc:993] T e545023b44d846bbb719556f2d284a1e P 8b070276227b44858767bb33e02cc11b: : Instructing follower 1ec72e086a2e41498a8e344cfae3b8f5 to start an election
I20260709 12:28:14.979156 18603 raft_consensus.cc:1081] T e545023b44d846bbb719556f2d284a1e P 8b070276227b44858767bb33e02cc11b [term 3 LEADER]: Signalling peer 1ec72e086a2e41498a8e344cfae3b8f5 to start an election
I20260709 12:28:14.981511 18234 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e545023b44d846bbb719556f2d284a1e"
dest_uuid: "1ec72e086a2e41498a8e344cfae3b8f5"
 from {username='slave'} at 127.0.0.1:51584
I20260709 12:28:14.982383 18234 raft_consensus.cc:493] T e545023b44d846bbb719556f2d284a1e P 1ec72e086a2e41498a8e344cfae3b8f5 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:14.982774 18234 raft_consensus.cc:3060] T e545023b44d846bbb719556f2d284a1e P 1ec72e086a2e41498a8e344cfae3b8f5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:14.990813 18234 raft_consensus.cc:515] T e545023b44d846bbb719556f2d284a1e P 1ec72e086a2e41498a8e344cfae3b8f5 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:14.993870 18234 leader_election.cc:290] T e545023b44d846bbb719556f2d284a1e P 1ec72e086a2e41498a8e344cfae3b8f5 [CANDIDATE]: Term 4 election: Requested vote from peers 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785), 8b070276227b44858767bb33e02cc11b (127.9.116.67:41781)
I20260709 12:28:14.995178 18512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e545023b44d846bbb719556f2d284a1e" candidate_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5ac1c3901f284979a114ebe1dc69831b"
I20260709 12:28:14.995973 18512 raft_consensus.cc:3060] T e545023b44d846bbb719556f2d284a1e P 5ac1c3901f284979a114ebe1dc69831b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:14.996193 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e545023b44d846bbb719556f2d284a1e" candidate_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "8b070276227b44858767bb33e02cc11b"
I20260709 12:28:14.996780 18306 raft_consensus.cc:3055] T e545023b44d846bbb719556f2d284a1e P 8b070276227b44858767bb33e02cc11b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:28:14.997110 18306 raft_consensus.cc:740] T e545023b44d846bbb719556f2d284a1e P 8b070276227b44858767bb33e02cc11b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8b070276227b44858767bb33e02cc11b, State: Running, Role: LEADER
I20260709 12:28:14.997929 18306 consensus_queue.cc:260] T e545023b44d846bbb719556f2d284a1e P 8b070276227b44858767bb33e02cc11b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:14.999330 18306 raft_consensus.cc:3060] T e545023b44d846bbb719556f2d284a1e P 8b070276227b44858767bb33e02cc11b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:15.005579 18512 raft_consensus.cc:2468] T e545023b44d846bbb719556f2d284a1e P 5ac1c3901f284979a114ebe1dc69831b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ec72e086a2e41498a8e344cfae3b8f5 in term 4.
I20260709 12:28:15.007654 18200 leader_election.cc:304] T e545023b44d846bbb719556f2d284a1e P 1ec72e086a2e41498a8e344cfae3b8f5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ec72e086a2e41498a8e344cfae3b8f5, 5ac1c3901f284979a114ebe1dc69831b; no voters: 
I20260709 12:28:15.010812 18306 raft_consensus.cc:2468] T e545023b44d846bbb719556f2d284a1e P 8b070276227b44858767bb33e02cc11b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ec72e086a2e41498a8e344cfae3b8f5 in term 4.
I20260709 12:28:15.013340 18453 raft_consensus.cc:2804] T e545023b44d846bbb719556f2d284a1e P 1ec72e086a2e41498a8e344cfae3b8f5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:28:15.014297 18453 raft_consensus.cc:697] T e545023b44d846bbb719556f2d284a1e P 1ec72e086a2e41498a8e344cfae3b8f5 [term 4 LEADER]: Becoming Leader. State: Replica: 1ec72e086a2e41498a8e344cfae3b8f5, State: Running, Role: LEADER
I20260709 12:28:15.016582 18453 consensus_queue.cc:237] T e545023b44d846bbb719556f2d284a1e P 1ec72e086a2e41498a8e344cfae3b8f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:15.035900 18054 catalog_manager.cc:5697] T e545023b44d846bbb719556f2d284a1e P 1ec72e086a2e41498a8e344cfae3b8f5 reported cstate change: term changed from 3 to 4, leader changed from 8b070276227b44858767bb33e02cc11b (127.9.116.67) to 1ec72e086a2e41498a8e344cfae3b8f5 (127.9.116.66). New cstate: current_term: 4 leader_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:15.037680 18610 raft_consensus.cc:993] T f7836af3dd864d4cbc3a4f9ee717a6ee P 1ec72e086a2e41498a8e344cfae3b8f5: : Instructing follower 8b070276227b44858767bb33e02cc11b to start an election
I20260709 12:28:15.038583 18612 raft_consensus.cc:1081] T f7836af3dd864d4cbc3a4f9ee717a6ee P 1ec72e086a2e41498a8e344cfae3b8f5 [term 2 LEADER]: Signalling peer 8b070276227b44858767bb33e02cc11b to start an election
I20260709 12:28:15.041438 18306 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f7836af3dd864d4cbc3a4f9ee717a6ee"
dest_uuid: "8b070276227b44858767bb33e02cc11b"
 from {username='slave'} at 127.0.0.1:39144
I20260709 12:28:15.042143 18306 raft_consensus.cc:493] T f7836af3dd864d4cbc3a4f9ee717a6ee P 8b070276227b44858767bb33e02cc11b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:15.042564 18306 raft_consensus.cc:3060] T f7836af3dd864d4cbc3a4f9ee717a6ee P 8b070276227b44858767bb33e02cc11b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:15.053069 18306 raft_consensus.cc:515] T f7836af3dd864d4cbc3a4f9ee717a6ee P 8b070276227b44858767bb33e02cc11b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:15.056278 18512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7836af3dd864d4cbc3a4f9ee717a6ee" candidate_uuid: "8b070276227b44858767bb33e02cc11b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5ac1c3901f284979a114ebe1dc69831b"
I20260709 12:28:15.056484 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7836af3dd864d4cbc3a4f9ee717a6ee" candidate_uuid: "8b070276227b44858767bb33e02cc11b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1ec72e086a2e41498a8e344cfae3b8f5"
I20260709 12:28:15.057046 18234 raft_consensus.cc:3055] T f7836af3dd864d4cbc3a4f9ee717a6ee P 1ec72e086a2e41498a8e344cfae3b8f5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:15.057046 18512 raft_consensus.cc:3060] T f7836af3dd864d4cbc3a4f9ee717a6ee P 5ac1c3901f284979a114ebe1dc69831b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:15.057461 18234 raft_consensus.cc:740] T f7836af3dd864d4cbc3a4f9ee717a6ee P 1ec72e086a2e41498a8e344cfae3b8f5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1ec72e086a2e41498a8e344cfae3b8f5, State: Running, Role: LEADER
I20260709 12:28:15.058270 18234 consensus_queue.cc:260] T f7836af3dd864d4cbc3a4f9ee717a6ee P 1ec72e086a2e41498a8e344cfae3b8f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:15.059355 18234 raft_consensus.cc:3060] T f7836af3dd864d4cbc3a4f9ee717a6ee P 1ec72e086a2e41498a8e344cfae3b8f5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:15.066092 18512 raft_consensus.cc:2468] T f7836af3dd864d4cbc3a4f9ee717a6ee P 5ac1c3901f284979a114ebe1dc69831b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b070276227b44858767bb33e02cc11b in term 3.
I20260709 12:28:15.067986 18306 leader_election.cc:290] T f7836af3dd864d4cbc3a4f9ee717a6ee P 8b070276227b44858767bb33e02cc11b [CANDIDATE]: Term 3 election: Requested vote from peers 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785), 1ec72e086a2e41498a8e344cfae3b8f5 (127.9.116.66:41289)
I20260709 12:28:15.067871 18274 leader_election.cc:304] T f7836af3dd864d4cbc3a4f9ee717a6ee P 8b070276227b44858767bb33e02cc11b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ac1c3901f284979a114ebe1dc69831b, 8b070276227b44858767bb33e02cc11b; no voters: 
I20260709 12:28:15.067871 18234 raft_consensus.cc:2468] T f7836af3dd864d4cbc3a4f9ee717a6ee P 1ec72e086a2e41498a8e344cfae3b8f5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b070276227b44858767bb33e02cc11b in term 3.
I20260709 12:28:15.069099 18603 raft_consensus.cc:2804] T f7836af3dd864d4cbc3a4f9ee717a6ee P 8b070276227b44858767bb33e02cc11b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:15.069670 18603 raft_consensus.cc:697] T f7836af3dd864d4cbc3a4f9ee717a6ee P 8b070276227b44858767bb33e02cc11b [term 3 LEADER]: Becoming Leader. State: Replica: 8b070276227b44858767bb33e02cc11b, State: Running, Role: LEADER
I20260709 12:28:15.070653 18603 consensus_queue.cc:237] T f7836af3dd864d4cbc3a4f9ee717a6ee P 8b070276227b44858767bb33e02cc11b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:15.080627 18053 catalog_manager.cc:5697] T f7836af3dd864d4cbc3a4f9ee717a6ee P 8b070276227b44858767bb33e02cc11b reported cstate change: term changed from 2 to 3, leader changed from 1ec72e086a2e41498a8e344cfae3b8f5 (127.9.116.66) to 8b070276227b44858767bb33e02cc11b (127.9.116.67). New cstate: current_term: 3 leader_uuid: "8b070276227b44858767bb33e02cc11b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:15.426435 18306 raft_consensus.cc:1275] T e545023b44d846bbb719556f2d284a1e P 8b070276227b44858767bb33e02cc11b [term 4 FOLLOWER]: Refusing update from remote peer 1ec72e086a2e41498a8e344cfae3b8f5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:28:15.428215 18612 consensus_queue.cc:1048] T e545023b44d846bbb719556f2d284a1e P 1ec72e086a2e41498a8e344cfae3b8f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:28:15.440682 18512 raft_consensus.cc:1275] T e545023b44d846bbb719556f2d284a1e P 5ac1c3901f284979a114ebe1dc69831b [term 4 FOLLOWER]: Refusing update from remote peer 1ec72e086a2e41498a8e344cfae3b8f5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:28:15.446538 18612 consensus_queue.cc:1048] T e545023b44d846bbb719556f2d284a1e P 1ec72e086a2e41498a8e344cfae3b8f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:28:15.500484 18105 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:28:15.588785 18512 raft_consensus.cc:1275] T f7836af3dd864d4cbc3a4f9ee717a6ee P 5ac1c3901f284979a114ebe1dc69831b [term 3 FOLLOWER]: Refusing update from remote peer 8b070276227b44858767bb33e02cc11b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:15.592025 18624 consensus_queue.cc:1048] T f7836af3dd864d4cbc3a4f9ee717a6ee P 8b070276227b44858767bb33e02cc11b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:15.607633 18234 raft_consensus.cc:1275] T f7836af3dd864d4cbc3a4f9ee717a6ee P 1ec72e086a2e41498a8e344cfae3b8f5 [term 3 FOLLOWER]: Refusing update from remote peer 8b070276227b44858767bb33e02cc11b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:15.611797 18624 consensus_queue.cc:1048] T f7836af3dd864d4cbc3a4f9ee717a6ee P 8b070276227b44858767bb33e02cc11b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:15.616741  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:15.634449 18234 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "019a279ca008410abf88a5dc9f30974a"
dest_uuid: "1ec72e086a2e41498a8e344cfae3b8f5"
mode: GRACEFUL
new_leader_uuid: "8b070276227b44858767bb33e02cc11b"
 from {username='slave'} at 127.0.0.1:51982
I20260709 12:28:15.635269 18234 raft_consensus.cc:606] T 019a279ca008410abf88a5dc9f30974a P 1ec72e086a2e41498a8e344cfae3b8f5 [term 1 LEADER]: Received request to transfer leadership to TS 8b070276227b44858767bb33e02cc11b
I20260709 12:28:15.638744 18306 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d88e2a949fe645c8a5bd2a10fcd84b0d"
dest_uuid: "8b070276227b44858767bb33e02cc11b"
mode: GRACEFUL
new_leader_uuid: "1ec72e086a2e41498a8e344cfae3b8f5"
 from {username='slave'} at 127.0.0.1:57496
I20260709 12:28:15.639449 18306 raft_consensus.cc:606] T d88e2a949fe645c8a5bd2a10fcd84b0d P 8b070276227b44858767bb33e02cc11b [term 2 LEADER]: Received request to transfer leadership to TS 1ec72e086a2e41498a8e344cfae3b8f5
I20260709 12:28:15.641098  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:28:15.641963  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:15.642831  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:15.921866 18610 raft_consensus.cc:993] T 019a279ca008410abf88a5dc9f30974a P 1ec72e086a2e41498a8e344cfae3b8f5: : Instructing follower 8b070276227b44858767bb33e02cc11b to start an election
I20260709 12:28:15.922691 18453 raft_consensus.cc:1081] T 019a279ca008410abf88a5dc9f30974a P 1ec72e086a2e41498a8e344cfae3b8f5 [term 1 LEADER]: Signalling peer 8b070276227b44858767bb33e02cc11b to start an election
I20260709 12:28:15.926208 18306 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "019a279ca008410abf88a5dc9f30974a"
dest_uuid: "8b070276227b44858767bb33e02cc11b"
 from {username='slave'} at 127.0.0.1:39144
I20260709 12:28:15.927235 18306 raft_consensus.cc:493] T 019a279ca008410abf88a5dc9f30974a P 8b070276227b44858767bb33e02cc11b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:15.927889 18306 raft_consensus.cc:3060] T 019a279ca008410abf88a5dc9f30974a P 8b070276227b44858767bb33e02cc11b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:15.939646 18306 raft_consensus.cc:515] T 019a279ca008410abf88a5dc9f30974a P 8b070276227b44858767bb33e02cc11b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:15.942543 18306 leader_election.cc:290] T 019a279ca008410abf88a5dc9f30974a P 8b070276227b44858767bb33e02cc11b [CANDIDATE]: Term 2 election: Requested vote from peers 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785), 1ec72e086a2e41498a8e344cfae3b8f5 (127.9.116.66:41289)
I20260709 12:28:15.944171 18512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a279ca008410abf88a5dc9f30974a" candidate_uuid: "8b070276227b44858767bb33e02cc11b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ac1c3901f284979a114ebe1dc69831b"
I20260709 12:28:15.944171 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a279ca008410abf88a5dc9f30974a" candidate_uuid: "8b070276227b44858767bb33e02cc11b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1ec72e086a2e41498a8e344cfae3b8f5"
I20260709 12:28:15.945312 18512 raft_consensus.cc:3060] T 019a279ca008410abf88a5dc9f30974a P 5ac1c3901f284979a114ebe1dc69831b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:15.945474 18234 raft_consensus.cc:3055] T 019a279ca008410abf88a5dc9f30974a P 1ec72e086a2e41498a8e344cfae3b8f5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:15.945921 18234 raft_consensus.cc:740] T 019a279ca008410abf88a5dc9f30974a P 1ec72e086a2e41498a8e344cfae3b8f5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1ec72e086a2e41498a8e344cfae3b8f5, State: Running, Role: LEADER
I20260709 12:28:15.947028 18234 consensus_queue.cc:260] T 019a279ca008410abf88a5dc9f30974a P 1ec72e086a2e41498a8e344cfae3b8f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:15.950733 18234 raft_consensus.cc:3060] T 019a279ca008410abf88a5dc9f30974a P 1ec72e086a2e41498a8e344cfae3b8f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:15.958374 18512 raft_consensus.cc:2468] T 019a279ca008410abf88a5dc9f30974a P 5ac1c3901f284979a114ebe1dc69831b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b070276227b44858767bb33e02cc11b in term 2.
I20260709 12:28:15.960669 18274 leader_election.cc:304] T 019a279ca008410abf88a5dc9f30974a P 8b070276227b44858767bb33e02cc11b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ac1c3901f284979a114ebe1dc69831b, 8b070276227b44858767bb33e02cc11b; no voters: 
I20260709 12:28:15.961862 18624 raft_consensus.cc:2804] T 019a279ca008410abf88a5dc9f30974a P 8b070276227b44858767bb33e02cc11b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:15.962203 18234 raft_consensus.cc:2468] T 019a279ca008410abf88a5dc9f30974a P 1ec72e086a2e41498a8e344cfae3b8f5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b070276227b44858767bb33e02cc11b in term 2.
I20260709 12:28:15.962556 18624 raft_consensus.cc:697] T 019a279ca008410abf88a5dc9f30974a P 8b070276227b44858767bb33e02cc11b [term 2 LEADER]: Becoming Leader. State: Replica: 8b070276227b44858767bb33e02cc11b, State: Running, Role: LEADER
I20260709 12:28:15.965082 18624 consensus_queue.cc:237] T 019a279ca008410abf88a5dc9f30974a P 8b070276227b44858767bb33e02cc11b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:15.974545 18053 catalog_manager.cc:5697] T 019a279ca008410abf88a5dc9f30974a P 8b070276227b44858767bb33e02cc11b reported cstate change: term changed from 1 to 2, leader changed from 1ec72e086a2e41498a8e344cfae3b8f5 (127.9.116.66) to 8b070276227b44858767bb33e02cc11b (127.9.116.67). New cstate: current_term: 2 leader_uuid: "8b070276227b44858767bb33e02cc11b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:16.020519 18626 raft_consensus.cc:993] T d88e2a949fe645c8a5bd2a10fcd84b0d P 8b070276227b44858767bb33e02cc11b: : Instructing follower 1ec72e086a2e41498a8e344cfae3b8f5 to start an election
I20260709 12:28:16.021286 18624 raft_consensus.cc:1081] T d88e2a949fe645c8a5bd2a10fcd84b0d P 8b070276227b44858767bb33e02cc11b [term 2 LEADER]: Signalling peer 1ec72e086a2e41498a8e344cfae3b8f5 to start an election
I20260709 12:28:16.023684 18234 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d88e2a949fe645c8a5bd2a10fcd84b0d"
dest_uuid: "1ec72e086a2e41498a8e344cfae3b8f5"
 from {username='slave'} at 127.0.0.1:51584
I20260709 12:28:16.024358 18234 raft_consensus.cc:493] T d88e2a949fe645c8a5bd2a10fcd84b0d P 1ec72e086a2e41498a8e344cfae3b8f5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:16.024744 18234 raft_consensus.cc:3060] T d88e2a949fe645c8a5bd2a10fcd84b0d P 1ec72e086a2e41498a8e344cfae3b8f5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:16.030711 18234 raft_consensus.cc:515] T d88e2a949fe645c8a5bd2a10fcd84b0d P 1ec72e086a2e41498a8e344cfae3b8f5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:16.032303 18234 leader_election.cc:290] T d88e2a949fe645c8a5bd2a10fcd84b0d P 1ec72e086a2e41498a8e344cfae3b8f5 [CANDIDATE]: Term 3 election: Requested vote from peers 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785), 8b070276227b44858767bb33e02cc11b (127.9.116.67:41781)
I20260709 12:28:16.033490 18512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88e2a949fe645c8a5bd2a10fcd84b0d" candidate_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5ac1c3901f284979a114ebe1dc69831b"
I20260709 12:28:16.033890 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88e2a949fe645c8a5bd2a10fcd84b0d" candidate_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8b070276227b44858767bb33e02cc11b"
I20260709 12:28:16.034231 18512 raft_consensus.cc:3060] T d88e2a949fe645c8a5bd2a10fcd84b0d P 5ac1c3901f284979a114ebe1dc69831b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:16.034621 18306 raft_consensus.cc:3055] T d88e2a949fe645c8a5bd2a10fcd84b0d P 8b070276227b44858767bb33e02cc11b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:16.035228 18306 raft_consensus.cc:740] T d88e2a949fe645c8a5bd2a10fcd84b0d P 8b070276227b44858767bb33e02cc11b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8b070276227b44858767bb33e02cc11b, State: Running, Role: LEADER
I20260709 12:28:16.036819 18306 consensus_queue.cc:260] T d88e2a949fe645c8a5bd2a10fcd84b0d P 8b070276227b44858767bb33e02cc11b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:16.038620 18306 raft_consensus.cc:3060] T d88e2a949fe645c8a5bd2a10fcd84b0d P 8b070276227b44858767bb33e02cc11b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:16.045004 18512 raft_consensus.cc:2468] T d88e2a949fe645c8a5bd2a10fcd84b0d P 5ac1c3901f284979a114ebe1dc69831b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ec72e086a2e41498a8e344cfae3b8f5 in term 3.
I20260709 12:28:16.046440 18200 leader_election.cc:304] T d88e2a949fe645c8a5bd2a10fcd84b0d P 1ec72e086a2e41498a8e344cfae3b8f5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ec72e086a2e41498a8e344cfae3b8f5, 5ac1c3901f284979a114ebe1dc69831b; no voters: 
I20260709 12:28:16.047816 18453 raft_consensus.cc:2804] T d88e2a949fe645c8a5bd2a10fcd84b0d P 1ec72e086a2e41498a8e344cfae3b8f5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:16.048323 18453 raft_consensus.cc:697] T d88e2a949fe645c8a5bd2a10fcd84b0d P 1ec72e086a2e41498a8e344cfae3b8f5 [term 3 LEADER]: Becoming Leader. State: Replica: 1ec72e086a2e41498a8e344cfae3b8f5, State: Running, Role: LEADER
I20260709 12:28:16.048699 18306 raft_consensus.cc:2468] T d88e2a949fe645c8a5bd2a10fcd84b0d P 8b070276227b44858767bb33e02cc11b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ec72e086a2e41498a8e344cfae3b8f5 in term 3.
I20260709 12:28:16.049199 18453 consensus_queue.cc:237] T d88e2a949fe645c8a5bd2a10fcd84b0d P 1ec72e086a2e41498a8e344cfae3b8f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } }
I20260709 12:28:16.063880 18053 catalog_manager.cc:5697] T d88e2a949fe645c8a5bd2a10fcd84b0d P 1ec72e086a2e41498a8e344cfae3b8f5 reported cstate change: term changed from 2 to 3, leader changed from 8b070276227b44858767bb33e02cc11b (127.9.116.67) to 1ec72e086a2e41498a8e344cfae3b8f5 (127.9.116.66). New cstate: current_term: 3 leader_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:16.461076 18234 raft_consensus.cc:1275] T 019a279ca008410abf88a5dc9f30974a P 1ec72e086a2e41498a8e344cfae3b8f5 [term 2 FOLLOWER]: Refusing update from remote peer 8b070276227b44858767bb33e02cc11b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:16.462740 18633 consensus_queue.cc:1048] T 019a279ca008410abf88a5dc9f30974a P 8b070276227b44858767bb33e02cc11b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ec72e086a2e41498a8e344cfae3b8f5" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:16.481884 18512 raft_consensus.cc:1275] T 019a279ca008410abf88a5dc9f30974a P 5ac1c3901f284979a114ebe1dc69831b [term 2 FOLLOWER]: Refusing update from remote peer 8b070276227b44858767bb33e02cc11b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:16.487494 18624 consensus_queue.cc:1048] T 019a279ca008410abf88a5dc9f30974a P 8b070276227b44858767bb33e02cc11b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:28:16.501917 18105 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:28:16.545737 18306 raft_consensus.cc:1275] T d88e2a949fe645c8a5bd2a10fcd84b0d P 8b070276227b44858767bb33e02cc11b [term 3 FOLLOWER]: Refusing update from remote peer 1ec72e086a2e41498a8e344cfae3b8f5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:16.547700 18453 consensus_queue.cc:1048] T d88e2a949fe645c8a5bd2a10fcd84b0d P 1ec72e086a2e41498a8e344cfae3b8f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b070276227b44858767bb33e02cc11b" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 41781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:16.562100 18512 raft_consensus.cc:1275] T d88e2a949fe645c8a5bd2a10fcd84b0d P 5ac1c3901f284979a114ebe1dc69831b [term 3 FOLLOWER]: Refusing update from remote peer 1ec72e086a2e41498a8e344cfae3b8f5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:16.566470 18642 consensus_queue.cc:1048] T d88e2a949fe645c8a5bd2a10fcd84b0d P 1ec72e086a2e41498a8e344cfae3b8f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ac1c3901f284979a114ebe1dc69831b" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 43785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:28:16.655758  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:16.702371  9681 tablet_server.cc:179] TabletServer@127.9.116.65:43785 shutting down...
I20260709 12:28:16.748430  9681 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:28:16.749394  9681 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:16.750308  9681 raft_consensus.cc:2243] T 2452f65bb1e24de4b47df9d6efcb5443 P 5ac1c3901f284979a114ebe1dc69831b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:16.750927  9681 raft_consensus.cc:2272] T 2452f65bb1e24de4b47df9d6efcb5443 P 5ac1c3901f284979a114ebe1dc69831b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:16.754294  9681 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:16.755434  9681 raft_consensus.cc:2243] T ec13962b83ce4b6ebe53124d2fdddcd5 P 5ac1c3901f284979a114ebe1dc69831b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:16.756176  9681 raft_consensus.cc:2272] T ec13962b83ce4b6ebe53124d2fdddcd5 P 5ac1c3901f284979a114ebe1dc69831b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:16.759490  9681 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:16.760497  9681 raft_consensus.cc:2243] T 019a279ca008410abf88a5dc9f30974a P 5ac1c3901f284979a114ebe1dc69831b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:16.761099  9681 raft_consensus.cc:2272] T 019a279ca008410abf88a5dc9f30974a P 5ac1c3901f284979a114ebe1dc69831b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:16.763164 18274 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 97 similar messages]
I20260709 12:28:16.766669  9681 tablet_replica.cc:333] stopping tablet replica
W20260709 12:28:16.766710 18274 consensus_peers.cc:597] T 3fa608df520c42249d93ddb828490f2d P 8b070276227b44858767bb33e02cc11b -> Peer 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785): Couldn't send request to peer 5ac1c3901f284979a114ebe1dc69831b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:16.767963  9681 raft_consensus.cc:2243] T 5c0b48a3f0574c0ead9ce938d7ce0fa6 P 5ac1c3901f284979a114ebe1dc69831b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:16.768698  9681 raft_consensus.cc:2272] T 5c0b48a3f0574c0ead9ce938d7ce0fa6 P 5ac1c3901f284979a114ebe1dc69831b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:16.773025  9681 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:16.773978  9681 raft_consensus.cc:2243] T c9cdcf5095a14f4db2efdef9465c5719 P 5ac1c3901f284979a114ebe1dc69831b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:16.774637  9681 raft_consensus.cc:2272] T c9cdcf5095a14f4db2efdef9465c5719 P 5ac1c3901f284979a114ebe1dc69831b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:16.778692  9681 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:16.779968  9681 raft_consensus.cc:2243] T f7836af3dd864d4cbc3a4f9ee717a6ee P 5ac1c3901f284979a114ebe1dc69831b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:16.780742  9681 raft_consensus.cc:2272] T f7836af3dd864d4cbc3a4f9ee717a6ee P 5ac1c3901f284979a114ebe1dc69831b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:16.785156  9681 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:16.786044  9681 raft_consensus.cc:2243] T d88e2a949fe645c8a5bd2a10fcd84b0d P 5ac1c3901f284979a114ebe1dc69831b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:16.786707  9681 raft_consensus.cc:2272] T d88e2a949fe645c8a5bd2a10fcd84b0d P 5ac1c3901f284979a114ebe1dc69831b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:16.790714  9681 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:16.791607  9681 raft_consensus.cc:2243] T e545023b44d846bbb719556f2d284a1e P 5ac1c3901f284979a114ebe1dc69831b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:16.792200  9681 raft_consensus.cc:2272] T e545023b44d846bbb719556f2d284a1e P 5ac1c3901f284979a114ebe1dc69831b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:16.796579  9681 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:16.797514  9681 raft_consensus.cc:2243] T 3fa608df520c42249d93ddb828490f2d P 5ac1c3901f284979a114ebe1dc69831b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:16.798382  9681 raft_consensus.cc:2272] T 3fa608df520c42249d93ddb828490f2d P 5ac1c3901f284979a114ebe1dc69831b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:16.800698 18274 consensus_peers.cc:597] T f7836af3dd864d4cbc3a4f9ee717a6ee P 8b070276227b44858767bb33e02cc11b -> Peer 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785): Couldn't send request to peer 5ac1c3901f284979a114ebe1dc69831b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:16.803049  9681 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:16.804284  9681 raft_consensus.cc:2243] T a901c0ae9d9f4e82939a611b87bc6014 P 5ac1c3901f284979a114ebe1dc69831b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:16.804963  9681 raft_consensus.cc:2272] T a901c0ae9d9f4e82939a611b87bc6014 P 5ac1c3901f284979a114ebe1dc69831b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:16.820354 18200 consensus_peers.cc:597] T c9cdcf5095a14f4db2efdef9465c5719 P 1ec72e086a2e41498a8e344cfae3b8f5 -> Peer 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785): Couldn't send request to peer 5ac1c3901f284979a114ebe1dc69831b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:16.859988  9681 tablet_server.cc:196] TabletServer@127.9.116.65:43785 shutdown complete.
I20260709 12:28:16.906463  9681 tablet_server.cc:179] TabletServer@127.9.116.66:0 shutting down...
W20260709 12:28:16.935776 18274 consensus_peers.cc:597] T ec13962b83ce4b6ebe53124d2fdddcd5 P 8b070276227b44858767bb33e02cc11b -> Peer 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785): Couldn't send request to peer 5ac1c3901f284979a114ebe1dc69831b. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:43785: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:16.935847 18271 consensus_peers.cc:597] T 019a279ca008410abf88a5dc9f30974a P 8b070276227b44858767bb33e02cc11b -> Peer 1ec72e086a2e41498a8e344cfae3b8f5 (127.9.116.66:41289): Couldn't send request to peer 1ec72e086a2e41498a8e344cfae3b8f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:16.962908  9681 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:28:16.964130  9681 tablet_replica.cc:333] T ec13962b83ce4b6ebe53124d2fdddcd5 P 1ec72e086a2e41498a8e344cfae3b8f5: stopping tablet replica
I20260709 12:28:16.965444  9681 raft_consensus.cc:2243] T ec13962b83ce4b6ebe53124d2fdddcd5 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:16.966276  9681 raft_consensus.cc:2272] T ec13962b83ce4b6ebe53124d2fdddcd5 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:16.969732  9681 tablet_replica.cc:333] T c9cdcf5095a14f4db2efdef9465c5719 P 1ec72e086a2e41498a8e344cfae3b8f5: stopping tablet replica
I20260709 12:28:16.970733  9681 raft_consensus.cc:2243] T c9cdcf5095a14f4db2efdef9465c5719 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:28:16.971805  9681 raft_consensus.cc:2272] T c9cdcf5095a14f4db2efdef9465c5719 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:16.971869 18274 consensus_peers.cc:597] T 019a279ca008410abf88a5dc9f30974a P 8b070276227b44858767bb33e02cc11b -> Peer 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785): Couldn't send request to peer 5ac1c3901f284979a114ebe1dc69831b. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:43785: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:16.972604 18200 consensus_peers.cc:597] T e545023b44d846bbb719556f2d284a1e P 1ec72e086a2e41498a8e344cfae3b8f5 -> Peer 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785): Couldn't send request to peer 5ac1c3901f284979a114ebe1dc69831b. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:43785: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:16.974679  9681 tablet_replica.cc:333] T 2452f65bb1e24de4b47df9d6efcb5443 P 1ec72e086a2e41498a8e344cfae3b8f5: stopping tablet replica
I20260709 12:28:16.975414  9681 raft_consensus.cc:2243] T 2452f65bb1e24de4b47df9d6efcb5443 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:16.976388  9681 raft_consensus.cc:2272] T 2452f65bb1e24de4b47df9d6efcb5443 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:16.979524  9681 tablet_replica.cc:333] T 019a279ca008410abf88a5dc9f30974a P 1ec72e086a2e41498a8e344cfae3b8f5: stopping tablet replica
I20260709 12:28:16.980273  9681 raft_consensus.cc:2243] T 019a279ca008410abf88a5dc9f30974a P 1ec72e086a2e41498a8e344cfae3b8f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:16.980806  9681 raft_consensus.cc:2272] T 019a279ca008410abf88a5dc9f30974a P 1ec72e086a2e41498a8e344cfae3b8f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:16.984197  9681 tablet_replica.cc:333] T 5c0b48a3f0574c0ead9ce938d7ce0fa6 P 1ec72e086a2e41498a8e344cfae3b8f5: stopping tablet replica
I20260709 12:28:16.985335  9681 raft_consensus.cc:2243] T 5c0b48a3f0574c0ead9ce938d7ce0fa6 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:16.986594  9681 raft_consensus.cc:2272] T 5c0b48a3f0574c0ead9ce938d7ce0fa6 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:16.989146 18200 consensus_peers.cc:597] T d88e2a949fe645c8a5bd2a10fcd84b0d P 1ec72e086a2e41498a8e344cfae3b8f5 -> Peer 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785): Couldn't send request to peer 5ac1c3901f284979a114ebe1dc69831b. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:43785: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:16.989672  9681 tablet_replica.cc:333] T d88e2a949fe645c8a5bd2a10fcd84b0d P 1ec72e086a2e41498a8e344cfae3b8f5: stopping tablet replica
I20260709 12:28:16.990321  9681 raft_consensus.cc:2243] T d88e2a949fe645c8a5bd2a10fcd84b0d P 1ec72e086a2e41498a8e344cfae3b8f5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:28:16.991148  9681 raft_consensus.cc:2272] T d88e2a949fe645c8a5bd2a10fcd84b0d P 1ec72e086a2e41498a8e344cfae3b8f5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:16.994506  9681 tablet_replica.cc:333] T f7836af3dd864d4cbc3a4f9ee717a6ee P 1ec72e086a2e41498a8e344cfae3b8f5: stopping tablet replica
I20260709 12:28:16.995091  9681 raft_consensus.cc:2243] T f7836af3dd864d4cbc3a4f9ee717a6ee P 1ec72e086a2e41498a8e344cfae3b8f5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:16.995636  9681 raft_consensus.cc:2272] T f7836af3dd864d4cbc3a4f9ee717a6ee P 1ec72e086a2e41498a8e344cfae3b8f5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:16.997908  9681 tablet_replica.cc:333] T a901c0ae9d9f4e82939a611b87bc6014 P 1ec72e086a2e41498a8e344cfae3b8f5: stopping tablet replica
I20260709 12:28:16.998484  9681 raft_consensus.cc:2243] T a901c0ae9d9f4e82939a611b87bc6014 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:16.998961  9681 raft_consensus.cc:2272] T a901c0ae9d9f4e82939a611b87bc6014 P 1ec72e086a2e41498a8e344cfae3b8f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:17.002039  9681 tablet_replica.cc:333] T 3fa608df520c42249d93ddb828490f2d P 1ec72e086a2e41498a8e344cfae3b8f5: stopping tablet replica
I20260709 12:28:17.002617  9681 raft_consensus.cc:2243] T 3fa608df520c42249d93ddb828490f2d P 1ec72e086a2e41498a8e344cfae3b8f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:17.003084  9681 raft_consensus.cc:2272] T 3fa608df520c42249d93ddb828490f2d P 1ec72e086a2e41498a8e344cfae3b8f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:17.005578  9681 tablet_replica.cc:333] T e545023b44d846bbb719556f2d284a1e P 1ec72e086a2e41498a8e344cfae3b8f5: stopping tablet replica
I20260709 12:28:17.006112  9681 raft_consensus.cc:2243] T e545023b44d846bbb719556f2d284a1e P 1ec72e086a2e41498a8e344cfae3b8f5 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:28:17.006928  9681 raft_consensus.cc:2272] T e545023b44d846bbb719556f2d284a1e P 1ec72e086a2e41498a8e344cfae3b8f5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:17.044026  9681 tablet_server.cc:196] TabletServer@127.9.116.66:0 shutdown complete.
I20260709 12:28:17.077373  9681 tablet_server.cc:179] TabletServer@127.9.116.67:0 shutting down...
I20260709 12:28:17.112074  9681 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:28:17.112995  9681 tablet_replica.cc:333] T 2452f65bb1e24de4b47df9d6efcb5443 P 8b070276227b44858767bb33e02cc11b: stopping tablet replica
I20260709 12:28:17.114166  9681 raft_consensus.cc:2243] T 2452f65bb1e24de4b47df9d6efcb5443 P 8b070276227b44858767bb33e02cc11b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:17.114946  9681 raft_consensus.cc:2272] T 2452f65bb1e24de4b47df9d6efcb5443 P 8b070276227b44858767bb33e02cc11b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:17.117501  9681 tablet_replica.cc:333] T c9cdcf5095a14f4db2efdef9465c5719 P 8b070276227b44858767bb33e02cc11b: stopping tablet replica
I20260709 12:28:17.118057  9681 raft_consensus.cc:2243] T c9cdcf5095a14f4db2efdef9465c5719 P 8b070276227b44858767bb33e02cc11b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:17.118453  9681 raft_consensus.cc:2272] T c9cdcf5095a14f4db2efdef9465c5719 P 8b070276227b44858767bb33e02cc11b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:17.120653  9681 tablet_replica.cc:333] T 019a279ca008410abf88a5dc9f30974a P 8b070276227b44858767bb33e02cc11b: stopping tablet replica
I20260709 12:28:17.121199  9681 raft_consensus.cc:2243] T 019a279ca008410abf88a5dc9f30974a P 8b070276227b44858767bb33e02cc11b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:17.122042  9681 raft_consensus.cc:2272] T 019a279ca008410abf88a5dc9f30974a P 8b070276227b44858767bb33e02cc11b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:17.124857  9681 tablet_replica.cc:333] T 5c0b48a3f0574c0ead9ce938d7ce0fa6 P 8b070276227b44858767bb33e02cc11b: stopping tablet replica
I20260709 12:28:17.125412  9681 raft_consensus.cc:2243] T 5c0b48a3f0574c0ead9ce938d7ce0fa6 P 8b070276227b44858767bb33e02cc11b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:17.125823  9681 raft_consensus.cc:2272] T 5c0b48a3f0574c0ead9ce938d7ce0fa6 P 8b070276227b44858767bb33e02cc11b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:17.128363  9681 tablet_replica.cc:333] T 3fa608df520c42249d93ddb828490f2d P 8b070276227b44858767bb33e02cc11b: stopping tablet replica
I20260709 12:28:17.129040  9681 raft_consensus.cc:2243] T 3fa608df520c42249d93ddb828490f2d P 8b070276227b44858767bb33e02cc11b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:17.130198  9681 raft_consensus.cc:2272] T 3fa608df520c42249d93ddb828490f2d P 8b070276227b44858767bb33e02cc11b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:17.133286  9681 tablet_replica.cc:333] T a901c0ae9d9f4e82939a611b87bc6014 P 8b070276227b44858767bb33e02cc11b: stopping tablet replica
W20260709 12:28:17.133277 18274 consensus_peers.cc:597] T a901c0ae9d9f4e82939a611b87bc6014 P 8b070276227b44858767bb33e02cc11b -> Peer 5ac1c3901f284979a114ebe1dc69831b (127.9.116.65:43785): Couldn't send request to peer 5ac1c3901f284979a114ebe1dc69831b. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:43785: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:17.134191  9681 raft_consensus.cc:2243] T a901c0ae9d9f4e82939a611b87bc6014 P 8b070276227b44858767bb33e02cc11b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:17.135115  9681 raft_consensus.cc:2272] T a901c0ae9d9f4e82939a611b87bc6014 P 8b070276227b44858767bb33e02cc11b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:17.137565  9681 tablet_replica.cc:333] T e545023b44d846bbb719556f2d284a1e P 8b070276227b44858767bb33e02cc11b: stopping tablet replica
I20260709 12:28:17.138566  9681 raft_consensus.cc:2243] T e545023b44d846bbb719556f2d284a1e P 8b070276227b44858767bb33e02cc11b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:17.139298  9681 raft_consensus.cc:2272] T e545023b44d846bbb719556f2d284a1e P 8b070276227b44858767bb33e02cc11b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:17.141718  9681 tablet_replica.cc:333] T ec13962b83ce4b6ebe53124d2fdddcd5 P 8b070276227b44858767bb33e02cc11b: stopping tablet replica
I20260709 12:28:17.142308  9681 raft_consensus.cc:2243] T ec13962b83ce4b6ebe53124d2fdddcd5 P 8b070276227b44858767bb33e02cc11b [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:28:17.143280  9681 raft_consensus.cc:2272] T ec13962b83ce4b6ebe53124d2fdddcd5 P 8b070276227b44858767bb33e02cc11b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:17.145751  9681 tablet_replica.cc:333] T d88e2a949fe645c8a5bd2a10fcd84b0d P 8b070276227b44858767bb33e02cc11b: stopping tablet replica
I20260709 12:28:17.146440  9681 raft_consensus.cc:2243] T d88e2a949fe645c8a5bd2a10fcd84b0d P 8b070276227b44858767bb33e02cc11b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:17.146914  9681 raft_consensus.cc:2272] T d88e2a949fe645c8a5bd2a10fcd84b0d P 8b070276227b44858767bb33e02cc11b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:17.150169  9681 tablet_replica.cc:333] T f7836af3dd864d4cbc3a4f9ee717a6ee P 8b070276227b44858767bb33e02cc11b: stopping tablet replica
I20260709 12:28:17.150735  9681 raft_consensus.cc:2243] T f7836af3dd864d4cbc3a4f9ee717a6ee P 8b070276227b44858767bb33e02cc11b [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:28:17.151652  9681 raft_consensus.cc:2272] T f7836af3dd864d4cbc3a4f9ee717a6ee P 8b070276227b44858767bb33e02cc11b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:17.214424  9681 tablet_server.cc:196] TabletServer@127.9.116.67:0 shutdown complete.
I20260709 12:28:17.244207  9681 master.cc:562] Master@127.9.116.126:42259 shutting down...
I20260709 12:28:17.275817  9681 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 7744ed65fa3148d9a6b386a5d76657a0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:17.276602  9681 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 7744ed65fa3148d9a6b386a5d76657a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:17.276997  9681 tablet_replica.cc:333] T 00000000000000000000000000000000 P 7744ed65fa3148d9a6b386a5d76657a0: stopping tablet replica
I20260709 12:28:17.301698  9681 master.cc:584] Master@127.9.116.126:42259 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (14072 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 12:28:17.362252  9681 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.9.116.126:40631
I20260709 12:28:17.364524  9681 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:28:17.370857 18650 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:17.372269 18651 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:17.373067 18653 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:17.373111  9681 server_base.cc:1061] running on GCE node
I20260709 12:28:17.374331  9681 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:28:17.374567  9681 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:28:17.374742  9681 hybrid_clock.cc:648] HybridClock initialized: now 1783600097374722 us; error 0 us; skew 500 ppm
I20260709 12:28:17.375319  9681 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:28:17.378589  9681 webserver.cc:533] Webserver started at http://127.9.116.126:45151/ using document root <none> and password file <none>
I20260709 12:28:17.379279  9681 fs_manager.cc:362] Metadata directory not provided
I20260709 12:28:17.379539  9681 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:28:17.380005  9681 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:28:17.381605  9681 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599781984018-9681-0/minicluster-data/master-0-root/instance:
uuid: "a3a5ea333f924b9b9b7445c65eec6e9f"
format_stamp: "Formatted at 2026-07-09 12:28:17 on dist-test-slave-zk51"
I20260709 12:28:17.387306  9681 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 12:28:17.391772 18658 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:17.392755  9681 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:28:17.393038  9681 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599781984018-9681-0/minicluster-data/master-0-root
uuid: "a3a5ea333f924b9b9b7445c65eec6e9f"
format_stamp: "Formatted at 2026-07-09 12:28:17 on dist-test-slave-zk51"
I20260709 12:28:17.393329  9681 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599781984018-9681-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599781984018-9681-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599781984018-9681-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:28:17.420994  9681 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:28:17.422556  9681 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:28:17.474551  9681 rpc_server.cc:307] RPC server started. Bound to: 127.9.116.126:40631
I20260709 12:28:17.474828 18709 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.116.126:40631 every 8 connection(s)
I20260709 12:28:17.479240 18710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:17.495232 18710 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3a5ea333f924b9b9b7445c65eec6e9f: Bootstrap starting.
I20260709 12:28:17.502142 18710 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a3a5ea333f924b9b9b7445c65eec6e9f: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:17.507814 18710 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3a5ea333f924b9b9b7445c65eec6e9f: No bootstrap required, opened a new log
I20260709 12:28:17.510169 18710 raft_consensus.cc:359] T 00000000000000000000000000000000 P a3a5ea333f924b9b9b7445c65eec6e9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3a5ea333f924b9b9b7445c65eec6e9f" member_type: VOTER }
I20260709 12:28:17.510572 18710 raft_consensus.cc:385] T 00000000000000000000000000000000 P a3a5ea333f924b9b9b7445c65eec6e9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:17.510871 18710 raft_consensus.cc:740] T 00000000000000000000000000000000 P a3a5ea333f924b9b9b7445c65eec6e9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3a5ea333f924b9b9b7445c65eec6e9f, State: Initialized, Role: FOLLOWER
I20260709 12:28:17.511538 18710 consensus_queue.cc:260] T 00000000000000000000000000000000 P a3a5ea333f924b9b9b7445c65eec6e9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3a5ea333f924b9b9b7445c65eec6e9f" member_type: VOTER }
I20260709 12:28:17.512032 18710 raft_consensus.cc:399] T 00000000000000000000000000000000 P a3a5ea333f924b9b9b7445c65eec6e9f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:28:17.512254 18710 raft_consensus.cc:493] T 00000000000000000000000000000000 P a3a5ea333f924b9b9b7445c65eec6e9f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:28:17.512538 18710 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a3a5ea333f924b9b9b7445c65eec6e9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:17.517894 18710 raft_consensus.cc:515] T 00000000000000000000000000000000 P a3a5ea333f924b9b9b7445c65eec6e9f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3a5ea333f924b9b9b7445c65eec6e9f" member_type: VOTER }
I20260709 12:28:17.518503 18710 leader_election.cc:304] T 00000000000000000000000000000000 P a3a5ea333f924b9b9b7445c65eec6e9f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a3a5ea333f924b9b9b7445c65eec6e9f; no voters: 
I20260709 12:28:17.519833 18710 leader_election.cc:290] T 00000000000000000000000000000000 P a3a5ea333f924b9b9b7445c65eec6e9f [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:28:17.520291 18713 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a3a5ea333f924b9b9b7445c65eec6e9f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:17.521765 18713 raft_consensus.cc:697] T 00000000000000000000000000000000 P a3a5ea333f924b9b9b7445c65eec6e9f [term 1 LEADER]: Becoming Leader. State: Replica: a3a5ea333f924b9b9b7445c65eec6e9f, State: Running, Role: LEADER
I20260709 12:28:17.522531 18713 consensus_queue.cc:237] T 00000000000000000000000000000000 P a3a5ea333f924b9b9b7445c65eec6e9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3a5ea333f924b9b9b7445c65eec6e9f" member_type: VOTER }
I20260709 12:28:17.523346 18710 sys_catalog.cc:565] T 00000000000000000000000000000000 P a3a5ea333f924b9b9b7445c65eec6e9f [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:28:17.527676 18714 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3a5ea333f924b9b9b7445c65eec6e9f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a3a5ea333f924b9b9b7445c65eec6e9f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3a5ea333f924b9b9b7445c65eec6e9f" member_type: VOTER } }
I20260709 12:28:17.527732 18715 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3a5ea333f924b9b9b7445c65eec6e9f [sys.catalog]: SysCatalogTable state changed. Reason: New leader a3a5ea333f924b9b9b7445c65eec6e9f. Latest consensus state: current_term: 1 leader_uuid: "a3a5ea333f924b9b9b7445c65eec6e9f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3a5ea333f924b9b9b7445c65eec6e9f" member_type: VOTER } }
I20260709 12:28:17.528913 18714 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3a5ea333f924b9b9b7445c65eec6e9f [sys.catalog]: This master's current role is: LEADER
I20260709 12:28:17.529001 18715 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3a5ea333f924b9b9b7445c65eec6e9f [sys.catalog]: This master's current role is: LEADER
I20260709 12:28:17.534245 18719 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:28:17.540199 18719 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:28:17.544612  9681 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:28:17.550016 18719 catalog_manager.cc:1383] Generated new cluster ID: d4b2eaffb2984648b3a58fb015a5f002
I20260709 12:28:17.550356 18719 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:28:17.583261 18719 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:28:17.585042 18719 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:28:17.604205 18719 catalog_manager.cc:6070] T 00000000000000000000000000000000 P a3a5ea333f924b9b9b7445c65eec6e9f: Generated new TSK 0
I20260709 12:28:17.604856 18719 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:28:17.611763  9681 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:28:17.619639 18731 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:17.622149 18732 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:17.625727  9681 server_base.cc:1061] running on GCE node
W20260709 12:28:17.625650 18734 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:17.627182  9681 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:28:17.627408  9681 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:28:17.627537  9681 hybrid_clock.cc:648] HybridClock initialized: now 1783600097627525 us; error 0 us; skew 500 ppm
I20260709 12:28:17.628152  9681 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:28:17.630811  9681 webserver.cc:533] Webserver started at http://127.9.116.65:40243/ using document root <none> and password file <none>
I20260709 12:28:17.631297  9681 fs_manager.cc:362] Metadata directory not provided
I20260709 12:28:17.631469  9681 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:28:17.631774  9681 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:28:17.633014  9681 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599781984018-9681-0/minicluster-data/ts-0-root/instance:
uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf"
format_stamp: "Formatted at 2026-07-09 12:28:17 on dist-test-slave-zk51"
I20260709 12:28:17.638538  9681 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:28:17.643121 18739 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:17.644304  9681 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:28:17.644713  9681 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599781984018-9681-0/minicluster-data/ts-0-root
uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf"
format_stamp: "Formatted at 2026-07-09 12:28:17 on dist-test-slave-zk51"
I20260709 12:28:17.645026  9681 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599781984018-9681-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599781984018-9681-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599781984018-9681-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:28:17.662367  9681 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:28:17.664498  9681 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:28:17.666513  9681 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:28:17.669534  9681 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:28:17.669770  9681 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:17.670150  9681 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:28:17.670334  9681 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:17.726814  9681 rpc_server.cc:307] RPC server started. Bound to: 127.9.116.65:38671
I20260709 12:28:17.726939 18801 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.116.65:38671 every 8 connection(s)
I20260709 12:28:17.733078  9681 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:28:17.745251 18807 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:17.745524 18806 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:17.750663 18802 heartbeater.cc:344] Connected to a master server at 127.9.116.126:40631
I20260709 12:28:17.750710  9681 server_base.cc:1061] running on GCE node
I20260709 12:28:17.751391 18802 heartbeater.cc:461] Registering TS with master...
W20260709 12:28:17.752166 18809 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:17.752517 18802 heartbeater.cc:507] Master 127.9.116.126:40631 requested a full tablet report, sending...
I20260709 12:28:17.753683  9681 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:28:17.754005  9681 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:28:17.754230  9681 hybrid_clock.cc:648] HybridClock initialized: now 1783600097754212 us; error 0 us; skew 500 ppm
I20260709 12:28:17.755074  9681 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:28:17.755978 18675 ts_manager.cc:194] Registered new tserver with Master: 25b288d1edc745c38bc5c8b6f6e9c0cf (127.9.116.65:38671)
I20260709 12:28:17.758399  9681 webserver.cc:533] Webserver started at http://127.9.116.66:43991/ using document root <none> and password file <none>
I20260709 12:28:17.759068  9681 fs_manager.cc:362] Metadata directory not provided
I20260709 12:28:17.759076 18675 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50362
I20260709 12:28:17.759363  9681 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:28:17.760200  9681 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:28:17.762050  9681 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599781984018-9681-0/minicluster-data/ts-1-root/instance:
uuid: "67d909eeb6c54a85818d44641cc8424b"
format_stamp: "Formatted at 2026-07-09 12:28:17 on dist-test-slave-zk51"
I20260709 12:28:17.768932  9681 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.004s	sys 0.004s
I20260709 12:28:17.773351 18814 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:17.774462  9681 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:28:17.774813  9681 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599781984018-9681-0/minicluster-data/ts-1-root
uuid: "67d909eeb6c54a85818d44641cc8424b"
format_stamp: "Formatted at 2026-07-09 12:28:17 on dist-test-slave-zk51"
I20260709 12:28:17.775138  9681 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599781984018-9681-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599781984018-9681-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599781984018-9681-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:28:17.792672  9681 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:28:17.793962  9681 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:28:17.795786  9681 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:28:17.799142  9681 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:28:17.800215  9681 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s	user 0.001s	sys 0.000s
I20260709 12:28:17.800590  9681 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:28:17.800779  9681 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:17.857833  9681 rpc_server.cc:307] RPC server started. Bound to: 127.9.116.66:43739
I20260709 12:28:17.858243 18876 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.116.66:43739 every 8 connection(s)
I20260709 12:28:17.863775  9681 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:28:17.873396 18880 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:17.875523 18881 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:17.877306  9681 server_base.cc:1061] running on GCE node
W20260709 12:28:17.878780 18883 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:17.880245  9681 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:28:17.880508  9681 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:28:17.880705  9681 hybrid_clock.cc:648] HybridClock initialized: now 1783600097880692 us; error 0 us; skew 500 ppm
I20260709 12:28:17.881261 18877 heartbeater.cc:344] Connected to a master server at 127.9.116.126:40631
I20260709 12:28:17.881506  9681 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:28:17.881997 18877 heartbeater.cc:461] Registering TS with master...
I20260709 12:28:17.883232 18877 heartbeater.cc:507] Master 127.9.116.126:40631 requested a full tablet report, sending...
I20260709 12:28:17.885092  9681 webserver.cc:533] Webserver started at http://127.9.116.67:39679/ using document root <none> and password file <none>
I20260709 12:28:17.885910  9681 fs_manager.cc:362] Metadata directory not provided
I20260709 12:28:17.886016 18675 ts_manager.cc:194] Registered new tserver with Master: 67d909eeb6c54a85818d44641cc8424b (127.9.116.66:43739)
I20260709 12:28:17.886183  9681 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:28:17.886660  9681 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:28:17.888136 18675 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50376
I20260709 12:28:17.888391  9681 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599781984018-9681-0/minicluster-data/ts-2-root/instance:
uuid: "42cc16ce1da94811a17ab22a6424b516"
format_stamp: "Formatted at 2026-07-09 12:28:17 on dist-test-slave-zk51"
I20260709 12:28:17.894762  9681 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:28:17.900243 18888 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:17.901348  9681 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:28:17.902005  9681 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599781984018-9681-0/minicluster-data/ts-2-root
uuid: "42cc16ce1da94811a17ab22a6424b516"
format_stamp: "Formatted at 2026-07-09 12:28:17 on dist-test-slave-zk51"
I20260709 12:28:17.902407  9681 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599781984018-9681-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599781984018-9681-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599781984018-9681-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:28:17.917508  9681 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:28:17.918913  9681 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:28:17.921414  9681 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:28:17.925736  9681 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:28:17.926054  9681 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:17.926342  9681 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:28:17.926548  9681 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:17.985592  9681 rpc_server.cc:307] RPC server started. Bound to: 127.9.116.67:44151
I20260709 12:28:17.985744 18950 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.116.67:44151 every 8 connection(s)
I20260709 12:28:18.003182 18951 heartbeater.cc:344] Connected to a master server at 127.9.116.126:40631
I20260709 12:28:18.003819 18951 heartbeater.cc:461] Registering TS with master...
I20260709 12:28:18.005064 18951 heartbeater.cc:507] Master 127.9.116.126:40631 requested a full tablet report, sending...
I20260709 12:28:18.007759 18675 ts_manager.cc:194] Registered new tserver with Master: 42cc16ce1da94811a17ab22a6424b516 (127.9.116.67:44151)
I20260709 12:28:18.007877  9681 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.018371339s
I20260709 12:28:18.009305 18675 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50378
I20260709 12:28:18.043076 18675 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50390:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:28:18.046432 18675 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:28:18.105077 18842 tablet_service.cc:1511] Processing CreateTablet for tablet 7b9bc09ccef44cedad0fa90946690174 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=0d6854fcabb34cc6b78d8524356834e7]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:28:18.106985 18842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b9bc09ccef44cedad0fa90946690174. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:18.106422 18841 tablet_service.cc:1511] Processing CreateTablet for tablet 85ea50703c9b483e8e574cd021139872 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=0d6854fcabb34cc6b78d8524356834e7]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:28:18.111826 18841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85ea50703c9b483e8e574cd021139872. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:18.124472 18916 tablet_service.cc:1511] Processing CreateTablet for tablet 7b9bc09ccef44cedad0fa90946690174 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=0d6854fcabb34cc6b78d8524356834e7]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:28:18.124830 18915 tablet_service.cc:1511] Processing CreateTablet for tablet 85ea50703c9b483e8e574cd021139872 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=0d6854fcabb34cc6b78d8524356834e7]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:28:18.126556 18916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b9bc09ccef44cedad0fa90946690174. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:18.139410 18767 tablet_service.cc:1511] Processing CreateTablet for tablet 7b9bc09ccef44cedad0fa90946690174 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=0d6854fcabb34cc6b78d8524356834e7]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:28:18.141830 18767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b9bc09ccef44cedad0fa90946690174. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:18.142769 18915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85ea50703c9b483e8e574cd021139872. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:18.145780 18766 tablet_service.cc:1511] Processing CreateTablet for tablet 85ea50703c9b483e8e574cd021139872 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=0d6854fcabb34cc6b78d8524356834e7]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:28:18.148667 18766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85ea50703c9b483e8e574cd021139872. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:18.173627 18967 tablet_bootstrap.cc:492] T 85ea50703c9b483e8e574cd021139872 P 42cc16ce1da94811a17ab22a6424b516: Bootstrap starting.
I20260709 12:28:18.176928 18966 tablet_bootstrap.cc:492] T 7b9bc09ccef44cedad0fa90946690174 P 67d909eeb6c54a85818d44641cc8424b: Bootstrap starting.
I20260709 12:28:18.185504 18966 tablet_bootstrap.cc:654] T 7b9bc09ccef44cedad0fa90946690174 P 67d909eeb6c54a85818d44641cc8424b: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:18.188472 18967 tablet_bootstrap.cc:654] T 85ea50703c9b483e8e574cd021139872 P 42cc16ce1da94811a17ab22a6424b516: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:18.194185 18968 tablet_bootstrap.cc:492] T 85ea50703c9b483e8e574cd021139872 P 25b288d1edc745c38bc5c8b6f6e9c0cf: Bootstrap starting.
I20260709 12:28:18.197602 18966 tablet_bootstrap.cc:492] T 7b9bc09ccef44cedad0fa90946690174 P 67d909eeb6c54a85818d44641cc8424b: No bootstrap required, opened a new log
I20260709 12:28:18.198289 18966 ts_tablet_manager.cc:1403] T 7b9bc09ccef44cedad0fa90946690174 P 67d909eeb6c54a85818d44641cc8424b: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.000s
I20260709 12:28:18.198657 18967 tablet_bootstrap.cc:492] T 85ea50703c9b483e8e574cd021139872 P 42cc16ce1da94811a17ab22a6424b516: No bootstrap required, opened a new log
I20260709 12:28:18.199302 18967 ts_tablet_manager.cc:1403] T 85ea50703c9b483e8e574cd021139872 P 42cc16ce1da94811a17ab22a6424b516: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.005s
I20260709 12:28:18.201232 18966 raft_consensus.cc:359] T 7b9bc09ccef44cedad0fa90946690174 P 67d909eeb6c54a85818d44641cc8424b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d909eeb6c54a85818d44641cc8424b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43739 } } peers { permanent_uuid: "42cc16ce1da94811a17ab22a6424b516" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 44151 } } peers { permanent_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38671 } }
I20260709 12:28:18.202024 18966 raft_consensus.cc:385] T 7b9bc09ccef44cedad0fa90946690174 P 67d909eeb6c54a85818d44641cc8424b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:18.202298 18966 raft_consensus.cc:740] T 7b9bc09ccef44cedad0fa90946690174 P 67d909eeb6c54a85818d44641cc8424b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67d909eeb6c54a85818d44641cc8424b, State: Initialized, Role: FOLLOWER
I20260709 12:28:18.203125 18966 consensus_queue.cc:260] T 7b9bc09ccef44cedad0fa90946690174 P 67d909eeb6c54a85818d44641cc8424b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d909eeb6c54a85818d44641cc8424b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43739 } } peers { permanent_uuid: "42cc16ce1da94811a17ab22a6424b516" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 44151 } } peers { permanent_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38671 } }
I20260709 12:28:18.202983 18967 raft_consensus.cc:359] T 85ea50703c9b483e8e574cd021139872 P 42cc16ce1da94811a17ab22a6424b516 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38671 } } peers { permanent_uuid: "67d909eeb6c54a85818d44641cc8424b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43739 } } peers { permanent_uuid: "42cc16ce1da94811a17ab22a6424b516" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 44151 } }
I20260709 12:28:18.204169 18967 raft_consensus.cc:385] T 85ea50703c9b483e8e574cd021139872 P 42cc16ce1da94811a17ab22a6424b516 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:18.204448 18968 tablet_bootstrap.cc:654] T 85ea50703c9b483e8e574cd021139872 P 25b288d1edc745c38bc5c8b6f6e9c0cf: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:18.204510 18967 raft_consensus.cc:740] T 85ea50703c9b483e8e574cd021139872 P 42cc16ce1da94811a17ab22a6424b516 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42cc16ce1da94811a17ab22a6424b516, State: Initialized, Role: FOLLOWER
I20260709 12:28:18.206053 18967 consensus_queue.cc:260] T 85ea50703c9b483e8e574cd021139872 P 42cc16ce1da94811a17ab22a6424b516 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38671 } } peers { permanent_uuid: "67d909eeb6c54a85818d44641cc8424b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43739 } } peers { permanent_uuid: "42cc16ce1da94811a17ab22a6424b516" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 44151 } }
I20260709 12:28:18.207032 18966 ts_tablet_manager.cc:1434] T 7b9bc09ccef44cedad0fa90946690174 P 67d909eeb6c54a85818d44641cc8424b: Time spent starting tablet: real 0.008s	user 0.010s	sys 0.000s
I20260709 12:28:18.206668 18877 heartbeater.cc:499] Master 127.9.116.126:40631 was elected leader, sending a full tablet report...
I20260709 12:28:18.209712 18966 tablet_bootstrap.cc:492] T 85ea50703c9b483e8e574cd021139872 P 67d909eeb6c54a85818d44641cc8424b: Bootstrap starting.
I20260709 12:28:18.216467 18968 tablet_bootstrap.cc:492] T 85ea50703c9b483e8e574cd021139872 P 25b288d1edc745c38bc5c8b6f6e9c0cf: No bootstrap required, opened a new log
I20260709 12:28:18.217283 18968 ts_tablet_manager.cc:1403] T 85ea50703c9b483e8e574cd021139872 P 25b288d1edc745c38bc5c8b6f6e9c0cf: Time spent bootstrapping tablet: real 0.023s	user 0.018s	sys 0.001s
I20260709 12:28:18.223534 18968 raft_consensus.cc:359] T 85ea50703c9b483e8e574cd021139872 P 25b288d1edc745c38bc5c8b6f6e9c0cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38671 } } peers { permanent_uuid: "67d909eeb6c54a85818d44641cc8424b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43739 } } peers { permanent_uuid: "42cc16ce1da94811a17ab22a6424b516" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 44151 } }
I20260709 12:28:18.224658 18968 raft_consensus.cc:385] T 85ea50703c9b483e8e574cd021139872 P 25b288d1edc745c38bc5c8b6f6e9c0cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:18.225137 18966 tablet_bootstrap.cc:654] T 85ea50703c9b483e8e574cd021139872 P 67d909eeb6c54a85818d44641cc8424b: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:18.225262 18951 heartbeater.cc:499] Master 127.9.116.126:40631 was elected leader, sending a full tablet report...
I20260709 12:28:18.226505 18967 ts_tablet_manager.cc:1434] T 85ea50703c9b483e8e574cd021139872 P 42cc16ce1da94811a17ab22a6424b516: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.017s
I20260709 12:28:18.228053 18967 tablet_bootstrap.cc:492] T 7b9bc09ccef44cedad0fa90946690174 P 42cc16ce1da94811a17ab22a6424b516: Bootstrap starting.
I20260709 12:28:18.225221 18968 raft_consensus.cc:740] T 85ea50703c9b483e8e574cd021139872 P 25b288d1edc745c38bc5c8b6f6e9c0cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b288d1edc745c38bc5c8b6f6e9c0cf, State: Initialized, Role: FOLLOWER
I20260709 12:28:18.233605 18968 consensus_queue.cc:260] T 85ea50703c9b483e8e574cd021139872 P 25b288d1edc745c38bc5c8b6f6e9c0cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38671 } } peers { permanent_uuid: "67d909eeb6c54a85818d44641cc8424b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43739 } } peers { permanent_uuid: "42cc16ce1da94811a17ab22a6424b516" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 44151 } }
I20260709 12:28:18.238382 18967 tablet_bootstrap.cc:654] T 7b9bc09ccef44cedad0fa90946690174 P 42cc16ce1da94811a17ab22a6424b516: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:18.262683 18968 ts_tablet_manager.cc:1434] T 85ea50703c9b483e8e574cd021139872 P 25b288d1edc745c38bc5c8b6f6e9c0cf: Time spent starting tablet: real 0.045s	user 0.022s	sys 0.010s
I20260709 12:28:18.262918 18967 tablet_bootstrap.cc:492] T 7b9bc09ccef44cedad0fa90946690174 P 42cc16ce1da94811a17ab22a6424b516: No bootstrap required, opened a new log
I20260709 12:28:18.264200 18967 ts_tablet_manager.cc:1403] T 7b9bc09ccef44cedad0fa90946690174 P 42cc16ce1da94811a17ab22a6424b516: Time spent bootstrapping tablet: real 0.036s	user 0.011s	sys 0.017s
I20260709 12:28:18.264165 18802 heartbeater.cc:499] Master 127.9.116.126:40631 was elected leader, sending a full tablet report...
I20260709 12:28:18.265388 18968 tablet_bootstrap.cc:492] T 7b9bc09ccef44cedad0fa90946690174 P 25b288d1edc745c38bc5c8b6f6e9c0cf: Bootstrap starting.
I20260709 12:28:18.266805 18966 tablet_bootstrap.cc:492] T 85ea50703c9b483e8e574cd021139872 P 67d909eeb6c54a85818d44641cc8424b: No bootstrap required, opened a new log
I20260709 12:28:18.267416 18966 ts_tablet_manager.cc:1403] T 85ea50703c9b483e8e574cd021139872 P 67d909eeb6c54a85818d44641cc8424b: Time spent bootstrapping tablet: real 0.058s	user 0.035s	sys 0.016s
I20260709 12:28:18.268013 18967 raft_consensus.cc:359] T 7b9bc09ccef44cedad0fa90946690174 P 42cc16ce1da94811a17ab22a6424b516 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d909eeb6c54a85818d44641cc8424b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43739 } } peers { permanent_uuid: "42cc16ce1da94811a17ab22a6424b516" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 44151 } } peers { permanent_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38671 } }
I20260709 12:28:18.268965 18967 raft_consensus.cc:385] T 7b9bc09ccef44cedad0fa90946690174 P 42cc16ce1da94811a17ab22a6424b516 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:18.269259 18967 raft_consensus.cc:740] T 7b9bc09ccef44cedad0fa90946690174 P 42cc16ce1da94811a17ab22a6424b516 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42cc16ce1da94811a17ab22a6424b516, State: Initialized, Role: FOLLOWER
I20260709 12:28:18.270107 18967 consensus_queue.cc:260] T 7b9bc09ccef44cedad0fa90946690174 P 42cc16ce1da94811a17ab22a6424b516 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d909eeb6c54a85818d44641cc8424b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43739 } } peers { permanent_uuid: "42cc16ce1da94811a17ab22a6424b516" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 44151 } } peers { permanent_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38671 } }
I20260709 12:28:18.270753 18966 raft_consensus.cc:359] T 85ea50703c9b483e8e574cd021139872 P 67d909eeb6c54a85818d44641cc8424b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38671 } } peers { permanent_uuid: "67d909eeb6c54a85818d44641cc8424b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43739 } } peers { permanent_uuid: "42cc16ce1da94811a17ab22a6424b516" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 44151 } }
I20260709 12:28:18.271606 18966 raft_consensus.cc:385] T 85ea50703c9b483e8e574cd021139872 P 67d909eeb6c54a85818d44641cc8424b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:18.271919 18966 raft_consensus.cc:740] T 85ea50703c9b483e8e574cd021139872 P 67d909eeb6c54a85818d44641cc8424b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67d909eeb6c54a85818d44641cc8424b, State: Initialized, Role: FOLLOWER
I20260709 12:28:18.272696 18968 tablet_bootstrap.cc:654] T 7b9bc09ccef44cedad0fa90946690174 P 25b288d1edc745c38bc5c8b6f6e9c0cf: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:18.273361 18966 consensus_queue.cc:260] T 85ea50703c9b483e8e574cd021139872 P 67d909eeb6c54a85818d44641cc8424b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38671 } } peers { permanent_uuid: "67d909eeb6c54a85818d44641cc8424b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43739 } } peers { permanent_uuid: "42cc16ce1da94811a17ab22a6424b516" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 44151 } }
I20260709 12:28:18.276183 18966 ts_tablet_manager.cc:1434] T 85ea50703c9b483e8e574cd021139872 P 67d909eeb6c54a85818d44641cc8424b: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:28:18.281214 18967 ts_tablet_manager.cc:1434] T 7b9bc09ccef44cedad0fa90946690174 P 42cc16ce1da94811a17ab22a6424b516: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 12:28:18.286675 18968 tablet_bootstrap.cc:492] T 7b9bc09ccef44cedad0fa90946690174 P 25b288d1edc745c38bc5c8b6f6e9c0cf: No bootstrap required, opened a new log
I20260709 12:28:18.287469 18968 ts_tablet_manager.cc:1403] T 7b9bc09ccef44cedad0fa90946690174 P 25b288d1edc745c38bc5c8b6f6e9c0cf: Time spent bootstrapping tablet: real 0.022s	user 0.006s	sys 0.011s
I20260709 12:28:18.291302 18968 raft_consensus.cc:359] T 7b9bc09ccef44cedad0fa90946690174 P 25b288d1edc745c38bc5c8b6f6e9c0cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d909eeb6c54a85818d44641cc8424b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43739 } } peers { permanent_uuid: "42cc16ce1da94811a17ab22a6424b516" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 44151 } } peers { permanent_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38671 } }
I20260709 12:28:18.292214 18968 raft_consensus.cc:385] T 7b9bc09ccef44cedad0fa90946690174 P 25b288d1edc745c38bc5c8b6f6e9c0cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:18.292502 18968 raft_consensus.cc:740] T 7b9bc09ccef44cedad0fa90946690174 P 25b288d1edc745c38bc5c8b6f6e9c0cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b288d1edc745c38bc5c8b6f6e9c0cf, State: Initialized, Role: FOLLOWER
I20260709 12:28:18.293375 18968 consensus_queue.cc:260] T 7b9bc09ccef44cedad0fa90946690174 P 25b288d1edc745c38bc5c8b6f6e9c0cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d909eeb6c54a85818d44641cc8424b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43739 } } peers { permanent_uuid: "42cc16ce1da94811a17ab22a6424b516" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 44151 } } peers { permanent_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38671 } }
I20260709 12:28:18.295869 18968 ts_tablet_manager.cc:1434] T 7b9bc09ccef44cedad0fa90946690174 P 25b288d1edc745c38bc5c8b6f6e9c0cf: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.008s
I20260709 12:28:18.408897 18972 raft_consensus.cc:493] T 85ea50703c9b483e8e574cd021139872 P 42cc16ce1da94811a17ab22a6424b516 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:18.409528 18972 raft_consensus.cc:515] T 85ea50703c9b483e8e574cd021139872 P 42cc16ce1da94811a17ab22a6424b516 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38671 } } peers { permanent_uuid: "67d909eeb6c54a85818d44641cc8424b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43739 } } peers { permanent_uuid: "42cc16ce1da94811a17ab22a6424b516" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 44151 } }
I20260709 12:28:18.411756 18972 leader_election.cc:290] T 85ea50703c9b483e8e574cd021139872 P 42cc16ce1da94811a17ab22a6424b516 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25b288d1edc745c38bc5c8b6f6e9c0cf (127.9.116.65:38671), 67d909eeb6c54a85818d44641cc8424b (127.9.116.66:43739)
I20260709 12:28:18.423799 18777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85ea50703c9b483e8e574cd021139872" candidate_uuid: "42cc16ce1da94811a17ab22a6424b516" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf" is_pre_election: true
I20260709 12:28:18.424595 18852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85ea50703c9b483e8e574cd021139872" candidate_uuid: "42cc16ce1da94811a17ab22a6424b516" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67d909eeb6c54a85818d44641cc8424b" is_pre_election: true
I20260709 12:28:18.424768 18777 raft_consensus.cc:2468] T 85ea50703c9b483e8e574cd021139872 P 25b288d1edc745c38bc5c8b6f6e9c0cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42cc16ce1da94811a17ab22a6424b516 in term 0.
I20260709 12:28:18.425324 18852 raft_consensus.cc:2468] T 85ea50703c9b483e8e574cd021139872 P 67d909eeb6c54a85818d44641cc8424b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42cc16ce1da94811a17ab22a6424b516 in term 0.
I20260709 12:28:18.426646 18891 leader_election.cc:304] T 85ea50703c9b483e8e574cd021139872 P 42cc16ce1da94811a17ab22a6424b516 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b288d1edc745c38bc5c8b6f6e9c0cf, 42cc16ce1da94811a17ab22a6424b516; no voters: 
I20260709 12:28:18.427798 18972 raft_consensus.cc:2804] T 85ea50703c9b483e8e574cd021139872 P 42cc16ce1da94811a17ab22a6424b516 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:18.428188 18972 raft_consensus.cc:493] T 85ea50703c9b483e8e574cd021139872 P 42cc16ce1da94811a17ab22a6424b516 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:18.428428 18972 raft_consensus.cc:3060] T 85ea50703c9b483e8e574cd021139872 P 42cc16ce1da94811a17ab22a6424b516 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:18.438071 18972 raft_consensus.cc:515] T 85ea50703c9b483e8e574cd021139872 P 42cc16ce1da94811a17ab22a6424b516 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38671 } } peers { permanent_uuid: "67d909eeb6c54a85818d44641cc8424b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43739 } } peers { permanent_uuid: "42cc16ce1da94811a17ab22a6424b516" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 44151 } }
I20260709 12:28:18.440963 18972 leader_election.cc:290] T 85ea50703c9b483e8e574cd021139872 P 42cc16ce1da94811a17ab22a6424b516 [CANDIDATE]: Term 1 election: Requested vote from peers 25b288d1edc745c38bc5c8b6f6e9c0cf (127.9.116.65:38671), 67d909eeb6c54a85818d44641cc8424b (127.9.116.66:43739)
I20260709 12:28:18.442137 18777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85ea50703c9b483e8e574cd021139872" candidate_uuid: "42cc16ce1da94811a17ab22a6424b516" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf"
I20260709 12:28:18.442354 18852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85ea50703c9b483e8e574cd021139872" candidate_uuid: "42cc16ce1da94811a17ab22a6424b516" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67d909eeb6c54a85818d44641cc8424b"
I20260709 12:28:18.443032 18852 raft_consensus.cc:3060] T 85ea50703c9b483e8e574cd021139872 P 67d909eeb6c54a85818d44641cc8424b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:18.442894 18777 raft_consensus.cc:3060] T 85ea50703c9b483e8e574cd021139872 P 25b288d1edc745c38bc5c8b6f6e9c0cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:18.450106 18975 raft_consensus.cc:493] T 7b9bc09ccef44cedad0fa90946690174 P 25b288d1edc745c38bc5c8b6f6e9c0cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:18.450047 18852 raft_consensus.cc:2468] T 85ea50703c9b483e8e574cd021139872 P 67d909eeb6c54a85818d44641cc8424b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42cc16ce1da94811a17ab22a6424b516 in term 1.
I20260709 12:28:18.450075 18777 raft_consensus.cc:2468] T 85ea50703c9b483e8e574cd021139872 P 25b288d1edc745c38bc5c8b6f6e9c0cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42cc16ce1da94811a17ab22a6424b516 in term 1.
I20260709 12:28:18.451259 18975 raft_consensus.cc:515] T 7b9bc09ccef44cedad0fa90946690174 P 25b288d1edc745c38bc5c8b6f6e9c0cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d909eeb6c54a85818d44641cc8424b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43739 } } peers { permanent_uuid: "42cc16ce1da94811a17ab22a6424b516" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 44151 } } peers { permanent_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38671 } }
I20260709 12:28:18.452170 18891 leader_election.cc:304] T 85ea50703c9b483e8e574cd021139872 P 42cc16ce1da94811a17ab22a6424b516 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b288d1edc745c38bc5c8b6f6e9c0cf, 42cc16ce1da94811a17ab22a6424b516; no voters: 
I20260709 12:28:18.453011 18972 raft_consensus.cc:2804] T 85ea50703c9b483e8e574cd021139872 P 42cc16ce1da94811a17ab22a6424b516 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:18.454155 18972 raft_consensus.cc:697] T 85ea50703c9b483e8e574cd021139872 P 42cc16ce1da94811a17ab22a6424b516 [term 1 LEADER]: Becoming Leader. State: Replica: 42cc16ce1da94811a17ab22a6424b516, State: Running, Role: LEADER
I20260709 12:28:18.454387 18975 leader_election.cc:290] T 7b9bc09ccef44cedad0fa90946690174 P 25b288d1edc745c38bc5c8b6f6e9c0cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67d909eeb6c54a85818d44641cc8424b (127.9.116.66:43739), 42cc16ce1da94811a17ab22a6424b516 (127.9.116.67:44151)
I20260709 12:28:18.455983 18972 consensus_queue.cc:237] T 85ea50703c9b483e8e574cd021139872 P 42cc16ce1da94811a17ab22a6424b516 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38671 } } peers { permanent_uuid: "67d909eeb6c54a85818d44641cc8424b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43739 } } peers { permanent_uuid: "42cc16ce1da94811a17ab22a6424b516" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 44151 } }
I20260709 12:28:18.471395 18852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b9bc09ccef44cedad0fa90946690174" candidate_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67d909eeb6c54a85818d44641cc8424b" is_pre_election: true
I20260709 12:28:18.472245 18852 raft_consensus.cc:2468] T 7b9bc09ccef44cedad0fa90946690174 P 67d909eeb6c54a85818d44641cc8424b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b288d1edc745c38bc5c8b6f6e9c0cf in term 0.
I20260709 12:28:18.468676 18673 catalog_manager.cc:5697] T 85ea50703c9b483e8e574cd021139872 P 42cc16ce1da94811a17ab22a6424b516 reported cstate change: term changed from 0 to 1, leader changed from <none> to 42cc16ce1da94811a17ab22a6424b516 (127.9.116.67). New cstate: current_term: 1 leader_uuid: "42cc16ce1da94811a17ab22a6424b516" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67d909eeb6c54a85818d44641cc8424b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43739 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42cc16ce1da94811a17ab22a6424b516" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 44151 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:18.474107 18743 leader_election.cc:304] T 7b9bc09ccef44cedad0fa90946690174 P 25b288d1edc745c38bc5c8b6f6e9c0cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b288d1edc745c38bc5c8b6f6e9c0cf, 67d909eeb6c54a85818d44641cc8424b; no voters: 
I20260709 12:28:18.475121 18926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b9bc09ccef44cedad0fa90946690174" candidate_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42cc16ce1da94811a17ab22a6424b516" is_pre_election: true
I20260709 12:28:18.476222 18975 raft_consensus.cc:2804] T 7b9bc09ccef44cedad0fa90946690174 P 25b288d1edc745c38bc5c8b6f6e9c0cf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:18.476683 18926 raft_consensus.cc:2468] T 7b9bc09ccef44cedad0fa90946690174 P 42cc16ce1da94811a17ab22a6424b516 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b288d1edc745c38bc5c8b6f6e9c0cf in term 0.
I20260709 12:28:18.477365 18975 raft_consensus.cc:493] T 7b9bc09ccef44cedad0fa90946690174 P 25b288d1edc745c38bc5c8b6f6e9c0cf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:18.477870 18975 raft_consensus.cc:3060] T 7b9bc09ccef44cedad0fa90946690174 P 25b288d1edc745c38bc5c8b6f6e9c0cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:18.486816 18975 raft_consensus.cc:515] T 7b9bc09ccef44cedad0fa90946690174 P 25b288d1edc745c38bc5c8b6f6e9c0cf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d909eeb6c54a85818d44641cc8424b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43739 } } peers { permanent_uuid: "42cc16ce1da94811a17ab22a6424b516" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 44151 } } peers { permanent_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38671 } }
I20260709 12:28:18.488876 18975 leader_election.cc:290] T 7b9bc09ccef44cedad0fa90946690174 P 25b288d1edc745c38bc5c8b6f6e9c0cf [CANDIDATE]: Term 1 election: Requested vote from peers 67d909eeb6c54a85818d44641cc8424b (127.9.116.66:43739), 42cc16ce1da94811a17ab22a6424b516 (127.9.116.67:44151)
I20260709 12:28:18.490170 18852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b9bc09ccef44cedad0fa90946690174" candidate_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67d909eeb6c54a85818d44641cc8424b"
I20260709 12:28:18.490351 18926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b9bc09ccef44cedad0fa90946690174" candidate_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42cc16ce1da94811a17ab22a6424b516"
I20260709 12:28:18.490869 18852 raft_consensus.cc:3060] T 7b9bc09ccef44cedad0fa90946690174 P 67d909eeb6c54a85818d44641cc8424b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:18.491068 18926 raft_consensus.cc:3060] T 7b9bc09ccef44cedad0fa90946690174 P 42cc16ce1da94811a17ab22a6424b516 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:18.497473 18926 raft_consensus.cc:2468] T 7b9bc09ccef44cedad0fa90946690174 P 42cc16ce1da94811a17ab22a6424b516 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b288d1edc745c38bc5c8b6f6e9c0cf in term 1.
I20260709 12:28:18.497474 18852 raft_consensus.cc:2468] T 7b9bc09ccef44cedad0fa90946690174 P 67d909eeb6c54a85818d44641cc8424b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b288d1edc745c38bc5c8b6f6e9c0cf in term 1.
I20260709 12:28:18.499012 18743 leader_election.cc:304] T 7b9bc09ccef44cedad0fa90946690174 P 25b288d1edc745c38bc5c8b6f6e9c0cf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b288d1edc745c38bc5c8b6f6e9c0cf, 42cc16ce1da94811a17ab22a6424b516; no voters: 
I20260709 12:28:18.500324 18975 raft_consensus.cc:2804] T 7b9bc09ccef44cedad0fa90946690174 P 25b288d1edc745c38bc5c8b6f6e9c0cf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:18.502251 18975 raft_consensus.cc:697] T 7b9bc09ccef44cedad0fa90946690174 P 25b288d1edc745c38bc5c8b6f6e9c0cf [term 1 LEADER]: Becoming Leader. State: Replica: 25b288d1edc745c38bc5c8b6f6e9c0cf, State: Running, Role: LEADER
I20260709 12:28:18.503176 18975 consensus_queue.cc:237] T 7b9bc09ccef44cedad0fa90946690174 P 25b288d1edc745c38bc5c8b6f6e9c0cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d909eeb6c54a85818d44641cc8424b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43739 } } peers { permanent_uuid: "42cc16ce1da94811a17ab22a6424b516" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 44151 } } peers { permanent_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38671 } }
I20260709 12:28:18.511951 18673 catalog_manager.cc:5697] T 7b9bc09ccef44cedad0fa90946690174 P 25b288d1edc745c38bc5c8b6f6e9c0cf reported cstate change: term changed from 0 to 1, leader changed from <none> to 25b288d1edc745c38bc5c8b6f6e9c0cf (127.9.116.65). New cstate: current_term: 1 leader_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d909eeb6c54a85818d44641cc8424b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43739 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42cc16ce1da94811a17ab22a6424b516" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 44151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38671 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:18.629917 18673 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50392:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:28:18.632239 18673 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:28:18.662011 18766 tablet_service.cc:1511] Processing CreateTablet for tablet 01d9d0d451da41b3a10ff9c6258c464a (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=55b2572247af4a7b91fed607e26c2de7]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:28:18.663633 18766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01d9d0d451da41b3a10ff9c6258c464a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:18.663201 18842 tablet_service.cc:1511] Processing CreateTablet for tablet 01d9d0d451da41b3a10ff9c6258c464a (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=55b2572247af4a7b91fed607e26c2de7]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:28:18.665071 18842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01d9d0d451da41b3a10ff9c6258c464a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:18.666841 18916 tablet_service.cc:1511] Processing CreateTablet for tablet 01d9d0d451da41b3a10ff9c6258c464a (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=55b2572247af4a7b91fed607e26c2de7]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:28:18.667840 18767 tablet_service.cc:1511] Processing CreateTablet for tablet 99d2103987f449d88ad24772538c8277 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=55b2572247af4a7b91fed607e26c2de7]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:28:18.668783 18916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01d9d0d451da41b3a10ff9c6258c464a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:18.669214 18767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99d2103987f449d88ad24772538c8277. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:18.670953 18915 tablet_service.cc:1511] Processing CreateTablet for tablet 99d2103987f449d88ad24772538c8277 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=55b2572247af4a7b91fed607e26c2de7]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:28:18.671706 18841 tablet_service.cc:1511] Processing CreateTablet for tablet 99d2103987f449d88ad24772538c8277 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=55b2572247af4a7b91fed607e26c2de7]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:28:18.672314 18915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99d2103987f449d88ad24772538c8277. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:18.672998 18841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99d2103987f449d88ad24772538c8277. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:18.693665 18968 tablet_bootstrap.cc:492] T 99d2103987f449d88ad24772538c8277 P 25b288d1edc745c38bc5c8b6f6e9c0cf: Bootstrap starting.
I20260709 12:28:18.702646 18968 tablet_bootstrap.cc:654] T 99d2103987f449d88ad24772538c8277 P 25b288d1edc745c38bc5c8b6f6e9c0cf: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:18.714166 18967 tablet_bootstrap.cc:492] T 99d2103987f449d88ad24772538c8277 P 42cc16ce1da94811a17ab22a6424b516: Bootstrap starting.
I20260709 12:28:18.716019 18966 tablet_bootstrap.cc:492] T 01d9d0d451da41b3a10ff9c6258c464a P 67d909eeb6c54a85818d44641cc8424b: Bootstrap starting.
I20260709 12:28:18.722807 18968 tablet_bootstrap.cc:492] T 99d2103987f449d88ad24772538c8277 P 25b288d1edc745c38bc5c8b6f6e9c0cf: No bootstrap required, opened a new log
I20260709 12:28:18.723862 18968 ts_tablet_manager.cc:1403] T 99d2103987f449d88ad24772538c8277 P 25b288d1edc745c38bc5c8b6f6e9c0cf: Time spent bootstrapping tablet: real 0.030s	user 0.015s	sys 0.008s
I20260709 12:28:18.726475 18966 tablet_bootstrap.cc:654] T 01d9d0d451da41b3a10ff9c6258c464a P 67d909eeb6c54a85818d44641cc8424b: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:18.727486 18967 tablet_bootstrap.cc:654] T 99d2103987f449d88ad24772538c8277 P 42cc16ce1da94811a17ab22a6424b516: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:18.727402 18968 raft_consensus.cc:359] T 99d2103987f449d88ad24772538c8277 P 25b288d1edc745c38bc5c8b6f6e9c0cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38671 } } peers { permanent_uuid: "67d909eeb6c54a85818d44641cc8424b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43739 } } peers { permanent_uuid: "42cc16ce1da94811a17ab22a6424b516" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 44151 } }
I20260709 12:28:18.728375 18968 raft_consensus.cc:385] T 99d2103987f449d88ad24772538c8277 P 25b288d1edc745c38bc5c8b6f6e9c0cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:18.728704 18968 raft_consensus.cc:740] T 99d2103987f449d88ad24772538c8277 P 25b288d1edc745c38bc5c8b6f6e9c0cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b288d1edc745c38bc5c8b6f6e9c0cf, State: Initialized, Role: FOLLOWER
I20260709 12:28:18.729539 18968 consensus_queue.cc:260] T 99d2103987f449d88ad24772538c8277 P 25b288d1edc745c38bc5c8b6f6e9c0cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38671 } } peers { permanent_uuid: "67d909eeb6c54a85818d44641cc8424b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43739 } } peers { permanent_uuid: "42cc16ce1da94811a17ab22a6424b516" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 44151 } }
I20260709 12:28:18.732203 18968 ts_tablet_manager.cc:1434] T 99d2103987f449d88ad24772538c8277 P 25b288d1edc745c38bc5c8b6f6e9c0cf: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:28:18.733536 18968 tablet_bootstrap.cc:492] T 01d9d0d451da41b3a10ff9c6258c464a P 25b288d1edc745c38bc5c8b6f6e9c0cf: Bootstrap starting.
I20260709 12:28:18.735011 18967 tablet_bootstrap.cc:492] T 99d2103987f449d88ad24772538c8277 P 42cc16ce1da94811a17ab22a6424b516: No bootstrap required, opened a new log
I20260709 12:28:18.735811 18967 ts_tablet_manager.cc:1403] T 99d2103987f449d88ad24772538c8277 P 42cc16ce1da94811a17ab22a6424b516: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.001s
I20260709 12:28:18.736804 18966 tablet_bootstrap.cc:492] T 01d9d0d451da41b3a10ff9c6258c464a P 67d909eeb6c54a85818d44641cc8424b: No bootstrap required, opened a new log
I20260709 12:28:18.737690 18966 ts_tablet_manager.cc:1403] T 01d9d0d451da41b3a10ff9c6258c464a P 67d909eeb6c54a85818d44641cc8424b: Time spent bootstrapping tablet: real 0.022s	user 0.006s	sys 0.010s
I20260709 12:28:18.739692 18967 raft_consensus.cc:359] T 99d2103987f449d88ad24772538c8277 P 42cc16ce1da94811a17ab22a6424b516 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38671 } } peers { permanent_uuid: "67d909eeb6c54a85818d44641cc8424b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43739 } } peers { permanent_uuid: "42cc16ce1da94811a17ab22a6424b516" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 44151 } }
I20260709 12:28:18.740788 18967 raft_consensus.cc:385] T 99d2103987f449d88ad24772538c8277 P 42cc16ce1da94811a17ab22a6424b516 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:18.741397 18967 raft_consensus.cc:740] T 99d2103987f449d88ad24772538c8277 P 42cc16ce1da94811a17ab22a6424b516 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42cc16ce1da94811a17ab22a6424b516, State: Initialized, Role: FOLLOWER
I20260709 12:28:18.741489 18966 raft_consensus.cc:359] T 01d9d0d451da41b3a10ff9c6258c464a P 67d909eeb6c54a85818d44641cc8424b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38671 } } peers { permanent_uuid: "67d909eeb6c54a85818d44641cc8424b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43739 } } peers { permanent_uuid: "42cc16ce1da94811a17ab22a6424b516" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 44151 } }
I20260709 12:28:18.742113 18968 tablet_bootstrap.cc:654] T 01d9d0d451da41b3a10ff9c6258c464a P 25b288d1edc745c38bc5c8b6f6e9c0cf: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:18.742602 18967 consensus_queue.cc:260] T 99d2103987f449d88ad24772538c8277 P 42cc16ce1da94811a17ab22a6424b516 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38671 } } peers { permanent_uuid: "67d909eeb6c54a85818d44641cc8424b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43739 } } peers { permanent_uuid: "42cc16ce1da94811a17ab22a6424b516" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 44151 } }
I20260709 12:28:18.742421 18966 raft_consensus.cc:385] T 01d9d0d451da41b3a10ff9c6258c464a P 67d909eeb6c54a85818d44641cc8424b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:18.743780 18966 raft_consensus.cc:740] T 01d9d0d451da41b3a10ff9c6258c464a P 67d909eeb6c54a85818d44641cc8424b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67d909eeb6c54a85818d44641cc8424b, State: Initialized, Role: FOLLOWER
I20260709 12:28:18.746111 18966 consensus_queue.cc:260] T 01d9d0d451da41b3a10ff9c6258c464a P 67d909eeb6c54a85818d44641cc8424b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38671 } } peers { permanent_uuid: "67d909eeb6c54a85818d44641cc8424b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43739 } } peers { permanent_uuid: "42cc16ce1da94811a17ab22a6424b516" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 44151 } }
I20260709 12:28:18.750586 18967 ts_tablet_manager.cc:1434] T 99d2103987f449d88ad24772538c8277 P 42cc16ce1da94811a17ab22a6424b516: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.002s
I20260709 12:28:18.751885 18967 tablet_bootstrap.cc:492] T 01d9d0d451da41b3a10ff9c6258c464a P 42cc16ce1da94811a17ab22a6424b516: Bootstrap starting.
I20260709 12:28:18.753489 18966 ts_tablet_manager.cc:1434] T 01d9d0d451da41b3a10ff9c6258c464a P 67d909eeb6c54a85818d44641cc8424b: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.005s
I20260709 12:28:18.756870 18966 tablet_bootstrap.cc:492] T 99d2103987f449d88ad24772538c8277 P 67d909eeb6c54a85818d44641cc8424b: Bootstrap starting.
I20260709 12:28:18.757301 18968 tablet_bootstrap.cc:492] T 01d9d0d451da41b3a10ff9c6258c464a P 25b288d1edc745c38bc5c8b6f6e9c0cf: No bootstrap required, opened a new log
I20260709 12:28:18.758316 18968 ts_tablet_manager.cc:1403] T 01d9d0d451da41b3a10ff9c6258c464a P 25b288d1edc745c38bc5c8b6f6e9c0cf: Time spent bootstrapping tablet: real 0.025s	user 0.018s	sys 0.000s
I20260709 12:28:18.759291 18967 tablet_bootstrap.cc:654] T 01d9d0d451da41b3a10ff9c6258c464a P 42cc16ce1da94811a17ab22a6424b516: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:18.762707 18968 raft_consensus.cc:359] T 01d9d0d451da41b3a10ff9c6258c464a P 25b288d1edc745c38bc5c8b6f6e9c0cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38671 } } peers { permanent_uuid: "67d909eeb6c54a85818d44641cc8424b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43739 } } peers { permanent_uuid: "42cc16ce1da94811a17ab22a6424b516" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 44151 } }
I20260709 12:28:18.763849 18968 raft_consensus.cc:385] T 01d9d0d451da41b3a10ff9c6258c464a P 25b288d1edc745c38bc5c8b6f6e9c0cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:18.764258 18968 raft_consensus.cc:740] T 01d9d0d451da41b3a10ff9c6258c464a P 25b288d1edc745c38bc5c8b6f6e9c0cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b288d1edc745c38bc5c8b6f6e9c0cf, State: Initialized, Role: FOLLOWER
I20260709 12:28:18.765424 18966 tablet_bootstrap.cc:654] T 99d2103987f449d88ad24772538c8277 P 67d909eeb6c54a85818d44641cc8424b: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:18.771520 18968 consensus_queue.cc:260] T 01d9d0d451da41b3a10ff9c6258c464a P 25b288d1edc745c38bc5c8b6f6e9c0cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38671 } } peers { permanent_uuid: "67d909eeb6c54a85818d44641cc8424b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43739 } } peers { permanent_uuid: "42cc16ce1da94811a17ab22a6424b516" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 44151 } }
I20260709 12:28:18.774852 18968 ts_tablet_manager.cc:1434] T 01d9d0d451da41b3a10ff9c6258c464a P 25b288d1edc745c38bc5c8b6f6e9c0cf: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:28:18.784579 18967 tablet_bootstrap.cc:492] T 01d9d0d451da41b3a10ff9c6258c464a P 42cc16ce1da94811a17ab22a6424b516: No bootstrap required, opened a new log
I20260709 12:28:18.784632 18966 tablet_bootstrap.cc:492] T 99d2103987f449d88ad24772538c8277 P 67d909eeb6c54a85818d44641cc8424b: No bootstrap required, opened a new log
I20260709 12:28:18.785715 18967 ts_tablet_manager.cc:1403] T 01d9d0d451da41b3a10ff9c6258c464a P 42cc16ce1da94811a17ab22a6424b516: Time spent bootstrapping tablet: real 0.034s	user 0.023s	sys 0.008s
I20260709 12:28:18.785823 18966 ts_tablet_manager.cc:1403] T 99d2103987f449d88ad24772538c8277 P 67d909eeb6c54a85818d44641cc8424b: Time spent bootstrapping tablet: real 0.029s	user 0.016s	sys 0.010s
I20260709 12:28:18.789563 18967 raft_consensus.cc:359] T 01d9d0d451da41b3a10ff9c6258c464a P 42cc16ce1da94811a17ab22a6424b516 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38671 } } peers { permanent_uuid: "67d909eeb6c54a85818d44641cc8424b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43739 } } peers { permanent_uuid: "42cc16ce1da94811a17ab22a6424b516" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 44151 } }
I20260709 12:28:18.790505 18967 raft_consensus.cc:385] T 01d9d0d451da41b3a10ff9c6258c464a P 42cc16ce1da94811a17ab22a6424b516 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:18.790004 18966 raft_consensus.cc:359] T 99d2103987f449d88ad24772538c8277 P 67d909eeb6c54a85818d44641cc8424b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38671 } } peers { permanent_uuid: "67d909eeb6c54a85818d44641cc8424b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43739 } } peers { permanent_uuid: "42cc16ce1da94811a17ab22a6424b516" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 44151 } }
I20260709 12:28:18.790998 18967 raft_consensus.cc:740] T 01d9d0d451da41b3a10ff9c6258c464a P 42cc16ce1da94811a17ab22a6424b516 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42cc16ce1da94811a17ab22a6424b516, State: Initialized, Role: FOLLOWER
I20260709 12:28:18.791321 18966 raft_consensus.cc:385] T 99d2103987f449d88ad24772538c8277 P 67d909eeb6c54a85818d44641cc8424b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:18.791838 18966 raft_consensus.cc:740] T 99d2103987f449d88ad24772538c8277 P 67d909eeb6c54a85818d44641cc8424b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67d909eeb6c54a85818d44641cc8424b, State: Initialized, Role: FOLLOWER
I20260709 12:28:18.792644 18966 consensus_queue.cc:260] T 99d2103987f449d88ad24772538c8277 P 67d909eeb6c54a85818d44641cc8424b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38671 } } peers { permanent_uuid: "67d909eeb6c54a85818d44641cc8424b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43739 } } peers { permanent_uuid: "42cc16ce1da94811a17ab22a6424b516" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 44151 } }
I20260709 12:28:18.792430 18967 consensus_queue.cc:260] T 01d9d0d451da41b3a10ff9c6258c464a P 42cc16ce1da94811a17ab22a6424b516 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38671 } } peers { permanent_uuid: "67d909eeb6c54a85818d44641cc8424b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43739 } } peers { permanent_uuid: "42cc16ce1da94811a17ab22a6424b516" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 44151 } }
I20260709 12:28:18.795990 18967 ts_tablet_manager.cc:1434] T 01d9d0d451da41b3a10ff9c6258c464a P 42cc16ce1da94811a17ab22a6424b516: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.002s
I20260709 12:28:18.796360 18971 raft_consensus.cc:493] T 01d9d0d451da41b3a10ff9c6258c464a P 67d909eeb6c54a85818d44641cc8424b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:18.797014 18971 raft_consensus.cc:515] T 01d9d0d451da41b3a10ff9c6258c464a P 67d909eeb6c54a85818d44641cc8424b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38671 } } peers { permanent_uuid: "67d909eeb6c54a85818d44641cc8424b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43739 } } peers { permanent_uuid: "42cc16ce1da94811a17ab22a6424b516" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 44151 } }
I20260709 12:28:18.795990 18966 ts_tablet_manager.cc:1434] T 99d2103987f449d88ad24772538c8277 P 67d909eeb6c54a85818d44641cc8424b: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.004s
I20260709 12:28:18.803138 18971 leader_election.cc:290] T 01d9d0d451da41b3a10ff9c6258c464a P 67d909eeb6c54a85818d44641cc8424b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25b288d1edc745c38bc5c8b6f6e9c0cf (127.9.116.65:38671), 42cc16ce1da94811a17ab22a6424b516 (127.9.116.67:44151)
I20260709 12:28:18.817912 18972 raft_consensus.cc:493] T 99d2103987f449d88ad24772538c8277 P 42cc16ce1da94811a17ab22a6424b516 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:18.818773 18972 raft_consensus.cc:515] T 99d2103987f449d88ad24772538c8277 P 42cc16ce1da94811a17ab22a6424b516 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38671 } } peers { permanent_uuid: "67d909eeb6c54a85818d44641cc8424b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43739 } } peers { permanent_uuid: "42cc16ce1da94811a17ab22a6424b516" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 44151 } }
I20260709 12:28:18.819247 18777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d9d0d451da41b3a10ff9c6258c464a" candidate_uuid: "67d909eeb6c54a85818d44641cc8424b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf" is_pre_election: true
I20260709 12:28:18.820169 18777 raft_consensus.cc:2468] T 01d9d0d451da41b3a10ff9c6258c464a P 25b288d1edc745c38bc5c8b6f6e9c0cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67d909eeb6c54a85818d44641cc8424b in term 0.
I20260709 12:28:18.821878 18817 leader_election.cc:304] T 01d9d0d451da41b3a10ff9c6258c464a P 67d909eeb6c54a85818d44641cc8424b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b288d1edc745c38bc5c8b6f6e9c0cf, 67d909eeb6c54a85818d44641cc8424b; no voters: 
I20260709 12:28:18.822743 18777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d2103987f449d88ad24772538c8277" candidate_uuid: "42cc16ce1da94811a17ab22a6424b516" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf" is_pre_election: true
I20260709 12:28:18.823223 18972 leader_election.cc:290] T 99d2103987f449d88ad24772538c8277 P 42cc16ce1da94811a17ab22a6424b516 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25b288d1edc745c38bc5c8b6f6e9c0cf (127.9.116.65:38671), 67d909eeb6c54a85818d44641cc8424b (127.9.116.66:43739)
I20260709 12:28:18.823063 18852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d2103987f449d88ad24772538c8277" candidate_uuid: "42cc16ce1da94811a17ab22a6424b516" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67d909eeb6c54a85818d44641cc8424b" is_pre_election: true
I20260709 12:28:18.823102 18971 raft_consensus.cc:2804] T 01d9d0d451da41b3a10ff9c6258c464a P 67d909eeb6c54a85818d44641cc8424b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:18.823786 18777 raft_consensus.cc:2468] T 99d2103987f449d88ad24772538c8277 P 25b288d1edc745c38bc5c8b6f6e9c0cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42cc16ce1da94811a17ab22a6424b516 in term 0.
I20260709 12:28:18.824168 18852 raft_consensus.cc:2468] T 99d2103987f449d88ad24772538c8277 P 67d909eeb6c54a85818d44641cc8424b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42cc16ce1da94811a17ab22a6424b516 in term 0.
I20260709 12:28:18.824366 18971 raft_consensus.cc:493] T 01d9d0d451da41b3a10ff9c6258c464a P 67d909eeb6c54a85818d44641cc8424b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:18.824819 18971 raft_consensus.cc:3060] T 01d9d0d451da41b3a10ff9c6258c464a P 67d909eeb6c54a85818d44641cc8424b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:18.825493 18892 leader_election.cc:304] T 99d2103987f449d88ad24772538c8277 P 42cc16ce1da94811a17ab22a6424b516 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42cc16ce1da94811a17ab22a6424b516, 67d909eeb6c54a85818d44641cc8424b; no voters: 
I20260709 12:28:18.826787 18972 raft_consensus.cc:2804] T 99d2103987f449d88ad24772538c8277 P 42cc16ce1da94811a17ab22a6424b516 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:18.827167 18972 raft_consensus.cc:493] T 99d2103987f449d88ad24772538c8277 P 42cc16ce1da94811a17ab22a6424b516 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:18.827527 18972 raft_consensus.cc:3060] T 99d2103987f449d88ad24772538c8277 P 42cc16ce1da94811a17ab22a6424b516 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:18.829960 18926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d9d0d451da41b3a10ff9c6258c464a" candidate_uuid: "67d909eeb6c54a85818d44641cc8424b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42cc16ce1da94811a17ab22a6424b516" is_pre_election: true
I20260709 12:28:18.830590 18926 raft_consensus.cc:2468] T 01d9d0d451da41b3a10ff9c6258c464a P 42cc16ce1da94811a17ab22a6424b516 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67d909eeb6c54a85818d44641cc8424b in term 0.
I20260709 12:28:18.834808 18971 raft_consensus.cc:515] T 01d9d0d451da41b3a10ff9c6258c464a P 67d909eeb6c54a85818d44641cc8424b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38671 } } peers { permanent_uuid: "67d909eeb6c54a85818d44641cc8424b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43739 } } peers { permanent_uuid: "42cc16ce1da94811a17ab22a6424b516" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 44151 } }
I20260709 12:28:18.835904 18972 raft_consensus.cc:515] T 99d2103987f449d88ad24772538c8277 P 42cc16ce1da94811a17ab22a6424b516 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38671 } } peers { permanent_uuid: "67d909eeb6c54a85818d44641cc8424b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43739 } } peers { permanent_uuid: "42cc16ce1da94811a17ab22a6424b516" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 44151 } }
I20260709 12:28:18.837512 18971 leader_election.cc:290] T 01d9d0d451da41b3a10ff9c6258c464a P 67d909eeb6c54a85818d44641cc8424b [CANDIDATE]: Term 1 election: Requested vote from peers 25b288d1edc745c38bc5c8b6f6e9c0cf (127.9.116.65:38671), 42cc16ce1da94811a17ab22a6424b516 (127.9.116.67:44151)
I20260709 12:28:18.838479 18926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d9d0d451da41b3a10ff9c6258c464a" candidate_uuid: "67d909eeb6c54a85818d44641cc8424b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42cc16ce1da94811a17ab22a6424b516"
I20260709 12:28:18.838888 18776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d2103987f449d88ad24772538c8277" candidate_uuid: "42cc16ce1da94811a17ab22a6424b516" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf"
I20260709 12:28:18.839728 18776 raft_consensus.cc:3060] T 99d2103987f449d88ad24772538c8277 P 25b288d1edc745c38bc5c8b6f6e9c0cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:18.839812 18926 raft_consensus.cc:3060] T 01d9d0d451da41b3a10ff9c6258c464a P 42cc16ce1da94811a17ab22a6424b516 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:18.840137 18972 leader_election.cc:290] T 99d2103987f449d88ad24772538c8277 P 42cc16ce1da94811a17ab22a6424b516 [CANDIDATE]: Term 1 election: Requested vote from peers 25b288d1edc745c38bc5c8b6f6e9c0cf (127.9.116.65:38671), 67d909eeb6c54a85818d44641cc8424b (127.9.116.66:43739)
I20260709 12:28:18.838568 18777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d9d0d451da41b3a10ff9c6258c464a" candidate_uuid: "67d909eeb6c54a85818d44641cc8424b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf"
I20260709 12:28:18.841187 18777 raft_consensus.cc:3060] T 01d9d0d451da41b3a10ff9c6258c464a P 25b288d1edc745c38bc5c8b6f6e9c0cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:18.842468 18852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d2103987f449d88ad24772538c8277" candidate_uuid: "42cc16ce1da94811a17ab22a6424b516" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67d909eeb6c54a85818d44641cc8424b"
I20260709 12:28:18.843288 18852 raft_consensus.cc:3060] T 99d2103987f449d88ad24772538c8277 P 67d909eeb6c54a85818d44641cc8424b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:18.850256 18777 raft_consensus.cc:2468] T 01d9d0d451da41b3a10ff9c6258c464a P 25b288d1edc745c38bc5c8b6f6e9c0cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67d909eeb6c54a85818d44641cc8424b in term 1.
I20260709 12:28:18.851620 18926 raft_consensus.cc:2468] T 01d9d0d451da41b3a10ff9c6258c464a P 42cc16ce1da94811a17ab22a6424b516 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67d909eeb6c54a85818d44641cc8424b in term 1.
I20260709 12:28:18.852039 18817 leader_election.cc:304] T 01d9d0d451da41b3a10ff9c6258c464a P 67d909eeb6c54a85818d44641cc8424b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b288d1edc745c38bc5c8b6f6e9c0cf, 67d909eeb6c54a85818d44641cc8424b; no voters: 
I20260709 12:28:18.850255 18776 raft_consensus.cc:2468] T 99d2103987f449d88ad24772538c8277 P 25b288d1edc745c38bc5c8b6f6e9c0cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42cc16ce1da94811a17ab22a6424b516 in term 1.
I20260709 12:28:18.853083 18971 raft_consensus.cc:2804] T 01d9d0d451da41b3a10ff9c6258c464a P 67d909eeb6c54a85818d44641cc8424b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:18.853745 18852 raft_consensus.cc:2468] T 99d2103987f449d88ad24772538c8277 P 67d909eeb6c54a85818d44641cc8424b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42cc16ce1da94811a17ab22a6424b516 in term 1.
I20260709 12:28:18.854285 18891 leader_election.cc:304] T 99d2103987f449d88ad24772538c8277 P 42cc16ce1da94811a17ab22a6424b516 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b288d1edc745c38bc5c8b6f6e9c0cf, 42cc16ce1da94811a17ab22a6424b516; no voters: 
I20260709 12:28:18.855268 18971 raft_consensus.cc:697] T 01d9d0d451da41b3a10ff9c6258c464a P 67d909eeb6c54a85818d44641cc8424b [term 1 LEADER]: Becoming Leader. State: Replica: 67d909eeb6c54a85818d44641cc8424b, State: Running, Role: LEADER
I20260709 12:28:18.856715 18971 consensus_queue.cc:237] T 01d9d0d451da41b3a10ff9c6258c464a P 67d909eeb6c54a85818d44641cc8424b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38671 } } peers { permanent_uuid: "67d909eeb6c54a85818d44641cc8424b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43739 } } peers { permanent_uuid: "42cc16ce1da94811a17ab22a6424b516" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 44151 } }
I20260709 12:28:18.856900 18972 raft_consensus.cc:2804] T 99d2103987f449d88ad24772538c8277 P 42cc16ce1da94811a17ab22a6424b516 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:18.858413 18979 consensus_queue.cc:1048] T 85ea50703c9b483e8e574cd021139872 P 42cc16ce1da94811a17ab22a6424b516 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:18.859287 18972 raft_consensus.cc:697] T 99d2103987f449d88ad24772538c8277 P 42cc16ce1da94811a17ab22a6424b516 [term 1 LEADER]: Becoming Leader. State: Replica: 42cc16ce1da94811a17ab22a6424b516, State: Running, Role: LEADER
I20260709 12:28:18.860366 18972 consensus_queue.cc:237] T 99d2103987f449d88ad24772538c8277 P 42cc16ce1da94811a17ab22a6424b516 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38671 } } peers { permanent_uuid: "67d909eeb6c54a85818d44641cc8424b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43739 } } peers { permanent_uuid: "42cc16ce1da94811a17ab22a6424b516" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 44151 } }
I20260709 12:28:18.868544 18672 catalog_manager.cc:5697] T 01d9d0d451da41b3a10ff9c6258c464a P 67d909eeb6c54a85818d44641cc8424b reported cstate change: term changed from 0 to 1, leader changed from <none> to 67d909eeb6c54a85818d44641cc8424b (127.9.116.66). New cstate: current_term: 1 leader_uuid: "67d909eeb6c54a85818d44641cc8424b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67d909eeb6c54a85818d44641cc8424b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43739 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42cc16ce1da94811a17ab22a6424b516" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 44151 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:18.876446 18673 catalog_manager.cc:5697] T 99d2103987f449d88ad24772538c8277 P 42cc16ce1da94811a17ab22a6424b516 reported cstate change: term changed from 0 to 1, leader changed from <none> to 42cc16ce1da94811a17ab22a6424b516 (127.9.116.67). New cstate: current_term: 1 leader_uuid: "42cc16ce1da94811a17ab22a6424b516" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67d909eeb6c54a85818d44641cc8424b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43739 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42cc16ce1da94811a17ab22a6424b516" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 44151 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:18.886216 18979 consensus_queue.cc:1048] T 85ea50703c9b483e8e574cd021139872 P 42cc16ce1da94811a17ab22a6424b516 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67d909eeb6c54a85818d44641cc8424b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:18.941293 18852 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01d9d0d451da41b3a10ff9c6258c464a"
dest_uuid: "67d909eeb6c54a85818d44641cc8424b"
mode: GRACEFUL
new_leader_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf"
 from {username='slave'} at 127.0.0.1:52420
I20260709 12:28:18.941941 18852 raft_consensus.cc:606] T 01d9d0d451da41b3a10ff9c6258c464a P 67d909eeb6c54a85818d44641cc8424b [term 1 LEADER]: Received request to transfer leadership to TS 25b288d1edc745c38bc5c8b6f6e9c0cf
I20260709 12:28:18.958016 18926 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "99d2103987f449d88ad24772538c8277"
dest_uuid: "42cc16ce1da94811a17ab22a6424b516"
mode: GRACEFUL
new_leader_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf"
 from {username='slave'} at 127.0.0.1:54636
I20260709 12:28:18.958832 18926 raft_consensus.cc:606] T 99d2103987f449d88ad24772538c8277 P 42cc16ce1da94811a17ab22a6424b516 [term 1 LEADER]: Received request to transfer leadership to TS 25b288d1edc745c38bc5c8b6f6e9c0cf
I20260709 12:28:19.040342 18975 consensus_queue.cc:1048] T 7b9bc09ccef44cedad0fa90946690174 P 25b288d1edc745c38bc5c8b6f6e9c0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "67d909eeb6c54a85818d44641cc8424b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:19.056898 19011 consensus_queue.cc:1048] T 7b9bc09ccef44cedad0fa90946690174 P 25b288d1edc745c38bc5c8b6f6e9c0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "42cc16ce1da94811a17ab22a6424b516" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:19.254926 18971 consensus_queue.cc:1048] T 01d9d0d451da41b3a10ff9c6258c464a P 67d909eeb6c54a85818d44641cc8424b [LEADER]: Connected to new peer: Peer: permanent_uuid: "42cc16ce1da94811a17ab22a6424b516" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:19.267200 19014 consensus_queue.cc:1048] T 01d9d0d451da41b3a10ff9c6258c464a P 67d909eeb6c54a85818d44641cc8424b [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:19.277665 18999 raft_consensus.cc:993] T 01d9d0d451da41b3a10ff9c6258c464a P 67d909eeb6c54a85818d44641cc8424b: : Instructing follower 25b288d1edc745c38bc5c8b6f6e9c0cf to start an election
I20260709 12:28:19.278196 18999 raft_consensus.cc:1081] T 01d9d0d451da41b3a10ff9c6258c464a P 67d909eeb6c54a85818d44641cc8424b [term 1 LEADER]: Signalling peer 25b288d1edc745c38bc5c8b6f6e9c0cf to start an election
I20260709 12:28:19.280193 18776 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "01d9d0d451da41b3a10ff9c6258c464a"
dest_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf"
 from {username='slave'} at 127.0.0.1:35516
I20260709 12:28:19.281164 18776 raft_consensus.cc:493] T 01d9d0d451da41b3a10ff9c6258c464a P 25b288d1edc745c38bc5c8b6f6e9c0cf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:19.281741 18776 raft_consensus.cc:3060] T 01d9d0d451da41b3a10ff9c6258c464a P 25b288d1edc745c38bc5c8b6f6e9c0cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:19.289556 18776 raft_consensus.cc:515] T 01d9d0d451da41b3a10ff9c6258c464a P 25b288d1edc745c38bc5c8b6f6e9c0cf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38671 } } peers { permanent_uuid: "67d909eeb6c54a85818d44641cc8424b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43739 } } peers { permanent_uuid: "42cc16ce1da94811a17ab22a6424b516" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 44151 } }
I20260709 12:28:19.291903 18776 leader_election.cc:290] T 01d9d0d451da41b3a10ff9c6258c464a P 25b288d1edc745c38bc5c8b6f6e9c0cf [CANDIDATE]: Term 2 election: Requested vote from peers 67d909eeb6c54a85818d44641cc8424b (127.9.116.66:43739), 42cc16ce1da94811a17ab22a6424b516 (127.9.116.67:44151)
I20260709 12:28:19.293018 18852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d9d0d451da41b3a10ff9c6258c464a" candidate_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "67d909eeb6c54a85818d44641cc8424b"
I20260709 12:28:19.293252 18926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d9d0d451da41b3a10ff9c6258c464a" candidate_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "42cc16ce1da94811a17ab22a6424b516"
I20260709 12:28:19.293727 18852 raft_consensus.cc:3055] T 01d9d0d451da41b3a10ff9c6258c464a P 67d909eeb6c54a85818d44641cc8424b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:19.293771 18926 raft_consensus.cc:3060] T 01d9d0d451da41b3a10ff9c6258c464a P 42cc16ce1da94811a17ab22a6424b516 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:19.294271 18852 raft_consensus.cc:740] T 01d9d0d451da41b3a10ff9c6258c464a P 67d909eeb6c54a85818d44641cc8424b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 67d909eeb6c54a85818d44641cc8424b, State: Running, Role: LEADER
I20260709 12:28:19.295562 18852 consensus_queue.cc:260] T 01d9d0d451da41b3a10ff9c6258c464a P 67d909eeb6c54a85818d44641cc8424b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38671 } } peers { permanent_uuid: "67d909eeb6c54a85818d44641cc8424b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43739 } } peers { permanent_uuid: "42cc16ce1da94811a17ab22a6424b516" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 44151 } }
I20260709 12:28:19.297363 18852 raft_consensus.cc:3060] T 01d9d0d451da41b3a10ff9c6258c464a P 67d909eeb6c54a85818d44641cc8424b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:19.306556 18926 raft_consensus.cc:2468] T 01d9d0d451da41b3a10ff9c6258c464a P 42cc16ce1da94811a17ab22a6424b516 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b288d1edc745c38bc5c8b6f6e9c0cf in term 2.
I20260709 12:28:19.307420 18852 raft_consensus.cc:2468] T 01d9d0d451da41b3a10ff9c6258c464a P 67d909eeb6c54a85818d44641cc8424b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b288d1edc745c38bc5c8b6f6e9c0cf in term 2.
I20260709 12:28:19.308138 18743 leader_election.cc:304] T 01d9d0d451da41b3a10ff9c6258c464a P 25b288d1edc745c38bc5c8b6f6e9c0cf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b288d1edc745c38bc5c8b6f6e9c0cf, 42cc16ce1da94811a17ab22a6424b516; no voters: 
I20260709 12:28:19.309264 19011 raft_consensus.cc:2804] T 01d9d0d451da41b3a10ff9c6258c464a P 25b288d1edc745c38bc5c8b6f6e9c0cf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:19.309821 19011 raft_consensus.cc:697] T 01d9d0d451da41b3a10ff9c6258c464a P 25b288d1edc745c38bc5c8b6f6e9c0cf [term 2 LEADER]: Becoming Leader. State: Replica: 25b288d1edc745c38bc5c8b6f6e9c0cf, State: Running, Role: LEADER
I20260709 12:28:19.310622 19011 consensus_queue.cc:237] T 01d9d0d451da41b3a10ff9c6258c464a P 25b288d1edc745c38bc5c8b6f6e9c0cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38671 } } peers { permanent_uuid: "67d909eeb6c54a85818d44641cc8424b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43739 } } peers { permanent_uuid: "42cc16ce1da94811a17ab22a6424b516" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 44151 } }
I20260709 12:28:19.317998 18673 catalog_manager.cc:5697] T 01d9d0d451da41b3a10ff9c6258c464a P 25b288d1edc745c38bc5c8b6f6e9c0cf reported cstate change: term changed from 1 to 2, leader changed from 67d909eeb6c54a85818d44641cc8424b (127.9.116.66) to 25b288d1edc745c38bc5c8b6f6e9c0cf (127.9.116.65). New cstate: current_term: 2 leader_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67d909eeb6c54a85818d44641cc8424b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43739 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42cc16ce1da94811a17ab22a6424b516" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 44151 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:19.382870 18979 consensus_queue.cc:1048] T 99d2103987f449d88ad24772538c8277 P 42cc16ce1da94811a17ab22a6424b516 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:19.391621 19000 raft_consensus.cc:993] T 99d2103987f449d88ad24772538c8277 P 42cc16ce1da94811a17ab22a6424b516: : Instructing follower 25b288d1edc745c38bc5c8b6f6e9c0cf to start an election
I20260709 12:28:19.392220 18972 raft_consensus.cc:1081] T 99d2103987f449d88ad24772538c8277 P 42cc16ce1da94811a17ab22a6424b516 [term 1 LEADER]: Signalling peer 25b288d1edc745c38bc5c8b6f6e9c0cf to start an election
I20260709 12:28:19.394327 18777 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "99d2103987f449d88ad24772538c8277"
dest_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf"
 from {username='slave'} at 127.0.0.1:35502
I20260709 12:28:19.397033 18777 raft_consensus.cc:493] T 99d2103987f449d88ad24772538c8277 P 25b288d1edc745c38bc5c8b6f6e9c0cf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:19.397496 18777 raft_consensus.cc:3060] T 99d2103987f449d88ad24772538c8277 P 25b288d1edc745c38bc5c8b6f6e9c0cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:19.398010 18979 consensus_queue.cc:1048] T 99d2103987f449d88ad24772538c8277 P 42cc16ce1da94811a17ab22a6424b516 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67d909eeb6c54a85818d44641cc8424b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:19.409277 18777 raft_consensus.cc:515] T 99d2103987f449d88ad24772538c8277 P 25b288d1edc745c38bc5c8b6f6e9c0cf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38671 } } peers { permanent_uuid: "67d909eeb6c54a85818d44641cc8424b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43739 } } peers { permanent_uuid: "42cc16ce1da94811a17ab22a6424b516" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 44151 } }
I20260709 12:28:19.415416 18777 leader_election.cc:290] T 99d2103987f449d88ad24772538c8277 P 25b288d1edc745c38bc5c8b6f6e9c0cf [CANDIDATE]: Term 2 election: Requested vote from peers 67d909eeb6c54a85818d44641cc8424b (127.9.116.66:43739), 42cc16ce1da94811a17ab22a6424b516 (127.9.116.67:44151)
I20260709 12:28:19.417204 18926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d2103987f449d88ad24772538c8277" candidate_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "42cc16ce1da94811a17ab22a6424b516"
I20260709 12:28:19.418118 18926 raft_consensus.cc:3055] T 99d2103987f449d88ad24772538c8277 P 42cc16ce1da94811a17ab22a6424b516 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:19.418537 18926 raft_consensus.cc:740] T 99d2103987f449d88ad24772538c8277 P 42cc16ce1da94811a17ab22a6424b516 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 42cc16ce1da94811a17ab22a6424b516, State: Running, Role: LEADER
I20260709 12:28:19.418274 18852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d2103987f449d88ad24772538c8277" candidate_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "67d909eeb6c54a85818d44641cc8424b"
I20260709 12:28:19.420212 18852 raft_consensus.cc:3060] T 99d2103987f449d88ad24772538c8277 P 67d909eeb6c54a85818d44641cc8424b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:19.419862 18926 consensus_queue.cc:260] T 99d2103987f449d88ad24772538c8277 P 42cc16ce1da94811a17ab22a6424b516 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38671 } } peers { permanent_uuid: "67d909eeb6c54a85818d44641cc8424b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43739 } } peers { permanent_uuid: "42cc16ce1da94811a17ab22a6424b516" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 44151 } }
I20260709 12:28:19.421515 18926 raft_consensus.cc:3060] T 99d2103987f449d88ad24772538c8277 P 42cc16ce1da94811a17ab22a6424b516 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:19.430073 18852 raft_consensus.cc:2468] T 99d2103987f449d88ad24772538c8277 P 67d909eeb6c54a85818d44641cc8424b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b288d1edc745c38bc5c8b6f6e9c0cf in term 2.
I20260709 12:28:19.431733 18743 leader_election.cc:304] T 99d2103987f449d88ad24772538c8277 P 25b288d1edc745c38bc5c8b6f6e9c0cf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b288d1edc745c38bc5c8b6f6e9c0cf, 67d909eeb6c54a85818d44641cc8424b; no voters: 
I20260709 12:28:19.432312 18926 raft_consensus.cc:2468] T 99d2103987f449d88ad24772538c8277 P 42cc16ce1da94811a17ab22a6424b516 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b288d1edc745c38bc5c8b6f6e9c0cf in term 2.
I20260709 12:28:19.432695 19011 raft_consensus.cc:2804] T 99d2103987f449d88ad24772538c8277 P 25b288d1edc745c38bc5c8b6f6e9c0cf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:19.433252 19011 raft_consensus.cc:697] T 99d2103987f449d88ad24772538c8277 P 25b288d1edc745c38bc5c8b6f6e9c0cf [term 2 LEADER]: Becoming Leader. State: Replica: 25b288d1edc745c38bc5c8b6f6e9c0cf, State: Running, Role: LEADER
I20260709 12:28:19.434012 19011 consensus_queue.cc:237] T 99d2103987f449d88ad24772538c8277 P 25b288d1edc745c38bc5c8b6f6e9c0cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38671 } } peers { permanent_uuid: "67d909eeb6c54a85818d44641cc8424b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43739 } } peers { permanent_uuid: "42cc16ce1da94811a17ab22a6424b516" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 44151 } }
I20260709 12:28:19.442065 18675 catalog_manager.cc:5697] T 99d2103987f449d88ad24772538c8277 P 25b288d1edc745c38bc5c8b6f6e9c0cf reported cstate change: term changed from 1 to 2, leader changed from 42cc16ce1da94811a17ab22a6424b516 (127.9.116.67) to 25b288d1edc745c38bc5c8b6f6e9c0cf (127.9.116.65). New cstate: current_term: 2 leader_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67d909eeb6c54a85818d44641cc8424b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43739 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42cc16ce1da94811a17ab22a6424b516" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 44151 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:19.468650  9681 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 12:28:19.471439  9681 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 12:28:19.472056  9681 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 12:28:19.488973 18777 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "99d2103987f449d88ad24772538c8277"
dest_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf"
mode: GRACEFUL
new_leader_uuid: "67d909eeb6c54a85818d44641cc8424b"
 from {username='slave'} at 127.0.0.1:35518
I20260709 12:28:19.489573 18777 raft_consensus.cc:606] T 99d2103987f449d88ad24772538c8277 P 25b288d1edc745c38bc5c8b6f6e9c0cf [term 2 LEADER]: Received request to transfer leadership to TS 67d909eeb6c54a85818d44641cc8424b
I20260709 12:28:19.490938  9681 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 12:28:19.729777 18852 raft_consensus.cc:1275] T 01d9d0d451da41b3a10ff9c6258c464a P 67d909eeb6c54a85818d44641cc8424b [term 2 FOLLOWER]: Refusing update from remote peer 25b288d1edc745c38bc5c8b6f6e9c0cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:19.731518 19011 consensus_queue.cc:1048] T 01d9d0d451da41b3a10ff9c6258c464a P 25b288d1edc745c38bc5c8b6f6e9c0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "67d909eeb6c54a85818d44641cc8424b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:19.742590 18926 raft_consensus.cc:1275] T 01d9d0d451da41b3a10ff9c6258c464a P 42cc16ce1da94811a17ab22a6424b516 [term 2 FOLLOWER]: Refusing update from remote peer 25b288d1edc745c38bc5c8b6f6e9c0cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:19.744303 19011 consensus_queue.cc:1048] T 01d9d0d451da41b3a10ff9c6258c464a P 25b288d1edc745c38bc5c8b6f6e9c0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "42cc16ce1da94811a17ab22a6424b516" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:19.985488 18926 raft_consensus.cc:1275] T 99d2103987f449d88ad24772538c8277 P 42cc16ce1da94811a17ab22a6424b516 [term 2 FOLLOWER]: Refusing update from remote peer 25b288d1edc745c38bc5c8b6f6e9c0cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:19.987108 19011 consensus_queue.cc:1048] T 99d2103987f449d88ad24772538c8277 P 25b288d1edc745c38bc5c8b6f6e9c0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "42cc16ce1da94811a17ab22a6424b516" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:19.997668 18852 raft_consensus.cc:1275] T 99d2103987f449d88ad24772538c8277 P 67d909eeb6c54a85818d44641cc8424b [term 2 FOLLOWER]: Refusing update from remote peer 25b288d1edc745c38bc5c8b6f6e9c0cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:20.000196 18975 consensus_queue.cc:1048] T 99d2103987f449d88ad24772538c8277 P 25b288d1edc745c38bc5c8b6f6e9c0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "67d909eeb6c54a85818d44641cc8424b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:20.007540 19011 raft_consensus.cc:993] T 99d2103987f449d88ad24772538c8277 P 25b288d1edc745c38bc5c8b6f6e9c0cf: : Instructing follower 67d909eeb6c54a85818d44641cc8424b to start an election
I20260709 12:28:20.008167 18975 raft_consensus.cc:1081] T 99d2103987f449d88ad24772538c8277 P 25b288d1edc745c38bc5c8b6f6e9c0cf [term 2 LEADER]: Signalling peer 67d909eeb6c54a85818d44641cc8424b to start an election
I20260709 12:28:20.010070 18852 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "99d2103987f449d88ad24772538c8277"
dest_uuid: "67d909eeb6c54a85818d44641cc8424b"
 from {username='slave'} at 127.0.0.1:52408
I20260709 12:28:20.010794 18852 raft_consensus.cc:493] T 99d2103987f449d88ad24772538c8277 P 67d909eeb6c54a85818d44641cc8424b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:20.011180 18852 raft_consensus.cc:3060] T 99d2103987f449d88ad24772538c8277 P 67d909eeb6c54a85818d44641cc8424b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:20.017658 18852 raft_consensus.cc:515] T 99d2103987f449d88ad24772538c8277 P 67d909eeb6c54a85818d44641cc8424b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38671 } } peers { permanent_uuid: "67d909eeb6c54a85818d44641cc8424b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43739 } } peers { permanent_uuid: "42cc16ce1da94811a17ab22a6424b516" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 44151 } }
I20260709 12:28:20.019673 18852 leader_election.cc:290] T 99d2103987f449d88ad24772538c8277 P 67d909eeb6c54a85818d44641cc8424b [CANDIDATE]: Term 3 election: Requested vote from peers 25b288d1edc745c38bc5c8b6f6e9c0cf (127.9.116.65:38671), 42cc16ce1da94811a17ab22a6424b516 (127.9.116.67:44151)
I20260709 12:28:20.020606 18777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d2103987f449d88ad24772538c8277" candidate_uuid: "67d909eeb6c54a85818d44641cc8424b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf"
I20260709 12:28:20.020965 18926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d2103987f449d88ad24772538c8277" candidate_uuid: "67d909eeb6c54a85818d44641cc8424b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "42cc16ce1da94811a17ab22a6424b516"
I20260709 12:28:20.021359 18777 raft_consensus.cc:3055] T 99d2103987f449d88ad24772538c8277 P 25b288d1edc745c38bc5c8b6f6e9c0cf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:20.021575 18926 raft_consensus.cc:3060] T 99d2103987f449d88ad24772538c8277 P 42cc16ce1da94811a17ab22a6424b516 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:20.021754 18777 raft_consensus.cc:740] T 99d2103987f449d88ad24772538c8277 P 25b288d1edc745c38bc5c8b6f6e9c0cf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 25b288d1edc745c38bc5c8b6f6e9c0cf, State: Running, Role: LEADER
I20260709 12:28:20.022717 18777 consensus_queue.cc:260] T 99d2103987f449d88ad24772538c8277 P 25b288d1edc745c38bc5c8b6f6e9c0cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38671 } } peers { permanent_uuid: "67d909eeb6c54a85818d44641cc8424b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43739 } } peers { permanent_uuid: "42cc16ce1da94811a17ab22a6424b516" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 44151 } }
I20260709 12:28:20.024641 18777 raft_consensus.cc:3060] T 99d2103987f449d88ad24772538c8277 P 25b288d1edc745c38bc5c8b6f6e9c0cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:20.028201 18926 raft_consensus.cc:2468] T 99d2103987f449d88ad24772538c8277 P 42cc16ce1da94811a17ab22a6424b516 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67d909eeb6c54a85818d44641cc8424b in term 3.
I20260709 12:28:20.029521 18818 leader_election.cc:304] T 99d2103987f449d88ad24772538c8277 P 67d909eeb6c54a85818d44641cc8424b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42cc16ce1da94811a17ab22a6424b516, 67d909eeb6c54a85818d44641cc8424b; no voters: 
I20260709 12:28:20.030290 18999 raft_consensus.cc:2804] T 99d2103987f449d88ad24772538c8277 P 67d909eeb6c54a85818d44641cc8424b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:20.030762 18777 raft_consensus.cc:2468] T 99d2103987f449d88ad24772538c8277 P 25b288d1edc745c38bc5c8b6f6e9c0cf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67d909eeb6c54a85818d44641cc8424b in term 3.
I20260709 12:28:20.031293 18999 raft_consensus.cc:697] T 99d2103987f449d88ad24772538c8277 P 67d909eeb6c54a85818d44641cc8424b [term 3 LEADER]: Becoming Leader. State: Replica: 67d909eeb6c54a85818d44641cc8424b, State: Running, Role: LEADER
I20260709 12:28:20.032239 18999 consensus_queue.cc:237] T 99d2103987f449d88ad24772538c8277 P 67d909eeb6c54a85818d44641cc8424b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38671 } } peers { permanent_uuid: "67d909eeb6c54a85818d44641cc8424b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43739 } } peers { permanent_uuid: "42cc16ce1da94811a17ab22a6424b516" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 44151 } }
I20260709 12:28:20.038785 18673 catalog_manager.cc:5697] T 99d2103987f449d88ad24772538c8277 P 67d909eeb6c54a85818d44641cc8424b reported cstate change: term changed from 2 to 3, leader changed from 25b288d1edc745c38bc5c8b6f6e9c0cf (127.9.116.65) to 67d909eeb6c54a85818d44641cc8424b (127.9.116.66). New cstate: current_term: 3 leader_uuid: "67d909eeb6c54a85818d44641cc8424b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25b288d1edc745c38bc5c8b6f6e9c0cf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67d909eeb6c54a85818d44641cc8424b" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 43739 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42cc16ce1da94811a17ab22a6424b516" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 44151 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:20.145082  9681 tablet_server.cc:179] TabletServer@127.9.116.65:0 shutting down...
I20260709 12:28:20.170176  9681 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:28:20.171187  9681 tablet_replica.cc:333] T 01d9d0d451da41b3a10ff9c6258c464a P 25b288d1edc745c38bc5c8b6f6e9c0cf: stopping tablet replica
I20260709 12:28:20.172204  9681 raft_consensus.cc:2243] T 01d9d0d451da41b3a10ff9c6258c464a P 25b288d1edc745c38bc5c8b6f6e9c0cf [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:20.173308  9681 raft_consensus.cc:2272] T 01d9d0d451da41b3a10ff9c6258c464a P 25b288d1edc745c38bc5c8b6f6e9c0cf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.175817  9681 tablet_replica.cc:333] T 99d2103987f449d88ad24772538c8277 P 25b288d1edc745c38bc5c8b6f6e9c0cf: stopping tablet replica
I20260709 12:28:20.176391  9681 raft_consensus.cc:2243] T 99d2103987f449d88ad24772538c8277 P 25b288d1edc745c38bc5c8b6f6e9c0cf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:20.177212  9681 raft_consensus.cc:2272] T 99d2103987f449d88ad24772538c8277 P 25b288d1edc745c38bc5c8b6f6e9c0cf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.179996  9681 tablet_replica.cc:333] T 7b9bc09ccef44cedad0fa90946690174 P 25b288d1edc745c38bc5c8b6f6e9c0cf: stopping tablet replica
I20260709 12:28:20.180557  9681 raft_consensus.cc:2243] T 7b9bc09ccef44cedad0fa90946690174 P 25b288d1edc745c38bc5c8b6f6e9c0cf [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:20.181382  9681 raft_consensus.cc:2272] T 7b9bc09ccef44cedad0fa90946690174 P 25b288d1edc745c38bc5c8b6f6e9c0cf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.183331  9681 tablet_replica.cc:333] T 85ea50703c9b483e8e574cd021139872 P 25b288d1edc745c38bc5c8b6f6e9c0cf: stopping tablet replica
I20260709 12:28:20.184247  9681 raft_consensus.cc:2243] T 85ea50703c9b483e8e574cd021139872 P 25b288d1edc745c38bc5c8b6f6e9c0cf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:20.184966  9681 raft_consensus.cc:2272] T 85ea50703c9b483e8e574cd021139872 P 25b288d1edc745c38bc5c8b6f6e9c0cf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.209728  9681 tablet_server.cc:196] TabletServer@127.9.116.65:0 shutdown complete.
I20260709 12:28:20.226344  9681 tablet_server.cc:179] TabletServer@127.9.116.66:0 shutting down...
I20260709 12:28:20.250186  9681 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:28:20.250852  9681 tablet_replica.cc:333] T 01d9d0d451da41b3a10ff9c6258c464a P 67d909eeb6c54a85818d44641cc8424b: stopping tablet replica
I20260709 12:28:20.251396  9681 raft_consensus.cc:2243] T 01d9d0d451da41b3a10ff9c6258c464a P 67d909eeb6c54a85818d44641cc8424b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:20.251968  9681 raft_consensus.cc:2272] T 01d9d0d451da41b3a10ff9c6258c464a P 67d909eeb6c54a85818d44641cc8424b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.254544  9681 tablet_replica.cc:333] T 85ea50703c9b483e8e574cd021139872 P 67d909eeb6c54a85818d44641cc8424b: stopping tablet replica
I20260709 12:28:20.255056  9681 raft_consensus.cc:2243] T 85ea50703c9b483e8e574cd021139872 P 67d909eeb6c54a85818d44641cc8424b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:20.255448  9681 raft_consensus.cc:2272] T 85ea50703c9b483e8e574cd021139872 P 67d909eeb6c54a85818d44641cc8424b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.258054  9681 tablet_replica.cc:333] T 99d2103987f449d88ad24772538c8277 P 67d909eeb6c54a85818d44641cc8424b: stopping tablet replica
I20260709 12:28:20.258735  9681 raft_consensus.cc:2243] T 99d2103987f449d88ad24772538c8277 P 67d909eeb6c54a85818d44641cc8424b [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:28:20.259531  9681 pending_rounds.cc:70] T 99d2103987f449d88ad24772538c8277 P 67d909eeb6c54a85818d44641cc8424b: Trying to abort 1 pending ops.
I20260709 12:28:20.259817  9681 pending_rounds.cc:77] T 99d2103987f449d88ad24772538c8277 P 67d909eeb6c54a85818d44641cc8424b: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305626009740140544 op_type: NO_OP noop_request { }
I20260709 12:28:20.260171  9681 raft_consensus.cc:2889] T 99d2103987f449d88ad24772538c8277 P 67d909eeb6c54a85818d44641cc8424b [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:28:20.260428  9681 raft_consensus.cc:2272] T 99d2103987f449d88ad24772538c8277 P 67d909eeb6c54a85818d44641cc8424b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.263329  9681 tablet_replica.cc:333] T 7b9bc09ccef44cedad0fa90946690174 P 67d909eeb6c54a85818d44641cc8424b: stopping tablet replica
I20260709 12:28:20.263957  9681 raft_consensus.cc:2243] T 7b9bc09ccef44cedad0fa90946690174 P 67d909eeb6c54a85818d44641cc8424b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:20.264446  9681 raft_consensus.cc:2272] T 7b9bc09ccef44cedad0fa90946690174 P 67d909eeb6c54a85818d44641cc8424b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.278800  9681 tablet_server.cc:196] TabletServer@127.9.116.66:0 shutdown complete.
I20260709 12:28:20.296568  9681 tablet_server.cc:179] TabletServer@127.9.116.67:0 shutting down...
I20260709 12:28:20.318423  9681 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:28:20.319242  9681 tablet_replica.cc:333] T 01d9d0d451da41b3a10ff9c6258c464a P 42cc16ce1da94811a17ab22a6424b516: stopping tablet replica
I20260709 12:28:20.319924  9681 raft_consensus.cc:2243] T 01d9d0d451da41b3a10ff9c6258c464a P 42cc16ce1da94811a17ab22a6424b516 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:20.320456  9681 raft_consensus.cc:2272] T 01d9d0d451da41b3a10ff9c6258c464a P 42cc16ce1da94811a17ab22a6424b516 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.323010  9681 tablet_replica.cc:333] T 99d2103987f449d88ad24772538c8277 P 42cc16ce1da94811a17ab22a6424b516: stopping tablet replica
I20260709 12:28:20.323714  9681 raft_consensus.cc:2243] T 99d2103987f449d88ad24772538c8277 P 42cc16ce1da94811a17ab22a6424b516 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:20.324223  9681 raft_consensus.cc:2272] T 99d2103987f449d88ad24772538c8277 P 42cc16ce1da94811a17ab22a6424b516 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.326754  9681 tablet_replica.cc:333] T 7b9bc09ccef44cedad0fa90946690174 P 42cc16ce1da94811a17ab22a6424b516: stopping tablet replica
I20260709 12:28:20.327348  9681 raft_consensus.cc:2243] T 7b9bc09ccef44cedad0fa90946690174 P 42cc16ce1da94811a17ab22a6424b516 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:20.327911  9681 raft_consensus.cc:2272] T 7b9bc09ccef44cedad0fa90946690174 P 42cc16ce1da94811a17ab22a6424b516 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.330054  9681 tablet_replica.cc:333] T 85ea50703c9b483e8e574cd021139872 P 42cc16ce1da94811a17ab22a6424b516: stopping tablet replica
I20260709 12:28:20.330571  9681 raft_consensus.cc:2243] T 85ea50703c9b483e8e574cd021139872 P 42cc16ce1da94811a17ab22a6424b516 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:20.331413  9681 raft_consensus.cc:2272] T 85ea50703c9b483e8e574cd021139872 P 42cc16ce1da94811a17ab22a6424b516 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.357455  9681 tablet_server.cc:196] TabletServer@127.9.116.67:0 shutdown complete.
I20260709 12:28:20.374711  9681 master.cc:562] Master@127.9.116.126:40631 shutting down...
I20260709 12:28:20.397192  9681 raft_consensus.cc:2243] T 00000000000000000000000000000000 P a3a5ea333f924b9b9b7445c65eec6e9f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:20.397766  9681 raft_consensus.cc:2272] T 00000000000000000000000000000000 P a3a5ea333f924b9b9b7445c65eec6e9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.398051  9681 tablet_replica.cc:333] T 00000000000000000000000000000000 P a3a5ea333f924b9b9b7445c65eec6e9f: stopping tablet replica
I20260709 12:28:20.419229  9681 master.cc:584] Master@127.9.116.126:40631 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (3091 ms)
[----------] 6 tests from LeaderRebalancerTest (318275 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 12:28:20.452000  9681 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.9.116.126:42093
I20260709 12:28:20.453127  9681 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:28:20.459702 19025 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:20.460366 19026 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:20.461692 19028 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:20.463097  9681 server_base.cc:1061] running on GCE node
I20260709 12:28:20.464268  9681 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:28:20.464484  9681 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:28:20.464970  9681 hybrid_clock.cc:648] HybridClock initialized: now 1783600100464915 us; error 0 us; skew 500 ppm
I20260709 12:28:20.465782  9681 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:28:20.468616  9681 webserver.cc:533] Webserver started at http://127.9.116.126:38461/ using document root <none> and password file <none>
I20260709 12:28:20.469129  9681 fs_manager.cc:362] Metadata directory not provided
I20260709 12:28:20.469313  9681 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:28:20.469667  9681 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:28:20.470813  9681 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599781984018-9681-0/minicluster-data/master-0-root/instance:
uuid: "9370f92c47a14d899d2bfc637e9440dc"
format_stamp: "Formatted at 2026-07-09 12:28:20 on dist-test-slave-zk51"
I20260709 12:28:20.476217  9681 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 12:28:20.480569 19033 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:20.481603  9681 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.001s
I20260709 12:28:20.481914  9681 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599781984018-9681-0/minicluster-data/master-0-root
uuid: "9370f92c47a14d899d2bfc637e9440dc"
format_stamp: "Formatted at 2026-07-09 12:28:20 on dist-test-slave-zk51"
I20260709 12:28:20.482213  9681 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599781984018-9681-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599781984018-9681-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599781984018-9681-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:28:20.522588  9681 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:28:20.523707  9681 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:28:20.568980  9681 rpc_server.cc:307] RPC server started. Bound to: 127.9.116.126:42093
I20260709 12:28:20.569082 19084 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.116.126:42093 every 8 connection(s)
I20260709 12:28:20.573165 19085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:20.588579 19085 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9370f92c47a14d899d2bfc637e9440dc: Bootstrap starting.
I20260709 12:28:20.593209 19085 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9370f92c47a14d899d2bfc637e9440dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:20.598218 19085 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9370f92c47a14d899d2bfc637e9440dc: No bootstrap required, opened a new log
I20260709 12:28:20.601029 19085 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9370f92c47a14d899d2bfc637e9440dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9370f92c47a14d899d2bfc637e9440dc" member_type: VOTER }
I20260709 12:28:20.601517 19085 raft_consensus.cc:385] T 00000000000000000000000000000000 P 9370f92c47a14d899d2bfc637e9440dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:20.601809 19085 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9370f92c47a14d899d2bfc637e9440dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9370f92c47a14d899d2bfc637e9440dc, State: Initialized, Role: FOLLOWER
I20260709 12:28:20.602522 19085 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9370f92c47a14d899d2bfc637e9440dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9370f92c47a14d899d2bfc637e9440dc" member_type: VOTER }
I20260709 12:28:20.603044 19085 raft_consensus.cc:399] T 00000000000000000000000000000000 P 9370f92c47a14d899d2bfc637e9440dc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:28:20.603296 19085 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9370f92c47a14d899d2bfc637e9440dc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:28:20.603684 19085 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9370f92c47a14d899d2bfc637e9440dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:20.611673 19085 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9370f92c47a14d899d2bfc637e9440dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9370f92c47a14d899d2bfc637e9440dc" member_type: VOTER }
I20260709 12:28:20.612506 19085 leader_election.cc:304] T 00000000000000000000000000000000 P 9370f92c47a14d899d2bfc637e9440dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9370f92c47a14d899d2bfc637e9440dc; no voters: 
I20260709 12:28:20.614192 19085 leader_election.cc:290] T 00000000000000000000000000000000 P 9370f92c47a14d899d2bfc637e9440dc [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:28:20.614655 19088 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9370f92c47a14d899d2bfc637e9440dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:20.616372 19088 raft_consensus.cc:697] T 00000000000000000000000000000000 P 9370f92c47a14d899d2bfc637e9440dc [term 1 LEADER]: Becoming Leader. State: Replica: 9370f92c47a14d899d2bfc637e9440dc, State: Running, Role: LEADER
I20260709 12:28:20.617215 19088 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9370f92c47a14d899d2bfc637e9440dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9370f92c47a14d899d2bfc637e9440dc" member_type: VOTER }
I20260709 12:28:20.617950 19085 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9370f92c47a14d899d2bfc637e9440dc [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:28:20.620824 19089 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9370f92c47a14d899d2bfc637e9440dc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9370f92c47a14d899d2bfc637e9440dc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9370f92c47a14d899d2bfc637e9440dc" member_type: VOTER } }
I20260709 12:28:20.620934 19090 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9370f92c47a14d899d2bfc637e9440dc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9370f92c47a14d899d2bfc637e9440dc. Latest consensus state: current_term: 1 leader_uuid: "9370f92c47a14d899d2bfc637e9440dc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9370f92c47a14d899d2bfc637e9440dc" member_type: VOTER } }
I20260709 12:28:20.621845 19089 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9370f92c47a14d899d2bfc637e9440dc [sys.catalog]: This master's current role is: LEADER
I20260709 12:28:20.621914 19090 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9370f92c47a14d899d2bfc637e9440dc [sys.catalog]: This master's current role is: LEADER
I20260709 12:28:20.629563 19093 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:28:20.638795 19093 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:28:20.640055  9681 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:28:20.649279 19093 catalog_manager.cc:1383] Generated new cluster ID: 378051fb4a97441f92fc8572a6a6b174
I20260709 12:28:20.649598 19093 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:28:20.668974 19093 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:28:20.670311 19093 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:28:20.693933 19093 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 9370f92c47a14d899d2bfc637e9440dc: Generated new TSK 0
I20260709 12:28:20.694568 19093 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:28:20.707357  9681 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:28:20.713882 19106 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:20.714519 19107 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:20.716709 19109 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:20.717664  9681 server_base.cc:1061] running on GCE node
I20260709 12:28:20.718616  9681 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:28:20.718809  9681 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:28:20.718927  9681 hybrid_clock.cc:648] HybridClock initialized: now 1783600100718917 us; error 0 us; skew 500 ppm
I20260709 12:28:20.719461  9681 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:28:20.722654  9681 webserver.cc:533] Webserver started at http://127.9.116.65:39167/ using document root <none> and password file <none>
I20260709 12:28:20.723277  9681 fs_manager.cc:362] Metadata directory not provided
I20260709 12:28:20.723470  9681 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:28:20.723971  9681 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:28:20.725356  9681 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599781984018-9681-0/minicluster-data/ts-0-root/instance:
uuid: "a5cd38daa04940ac97f9037e3241cdaf"
format_stamp: "Formatted at 2026-07-09 12:28:20 on dist-test-slave-zk51"
I20260709 12:28:20.731356  9681 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:28:20.736197 19114 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:20.737282  9681 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:28:20.737983  9681 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599781984018-9681-0/minicluster-data/ts-0-root
uuid: "a5cd38daa04940ac97f9037e3241cdaf"
format_stamp: "Formatted at 2026-07-09 12:28:20 on dist-test-slave-zk51"
I20260709 12:28:20.738461  9681 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599781984018-9681-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599781984018-9681-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599781984018-9681-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:28:20.770301  9681 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:28:20.771517  9681 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:28:20.773283  9681 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:28:20.776262  9681 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:28:20.776484  9681 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:20.776985  9681 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:28:20.777310  9681 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:20.832556  9681 rpc_server.cc:307] RPC server started. Bound to: 127.9.116.65:42503
I20260709 12:28:20.832664 19176 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.116.65:42503 every 8 connection(s)
I20260709 12:28:20.838738  9681 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:28:20.848423 19181 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:20.849601 19182 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:20.853296  9681 server_base.cc:1061] running on GCE node
W20260709 12:28:20.854557 19184 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:20.856146  9681 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:28:20.856163 19177 heartbeater.cc:344] Connected to a master server at 127.9.116.126:42093
W20260709 12:28:20.856545  9681 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:28:20.857052  9681 hybrid_clock.cc:648] HybridClock initialized: now 1783600100856977 us; error 0 us; skew 500 ppm
I20260709 12:28:20.857157 19177 heartbeater.cc:461] Registering TS with master...
I20260709 12:28:20.857923  9681 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:28:20.858214 19177 heartbeater.cc:507] Master 127.9.116.126:42093 requested a full tablet report, sending...
I20260709 12:28:20.861101 19050 ts_manager.cc:194] Registered new tserver with Master: a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65:42503)
I20260709 12:28:20.861784  9681 webserver.cc:533] Webserver started at http://127.9.116.66:42285/ using document root <none> and password file <none>
I20260709 12:28:20.862576  9681 fs_manager.cc:362] Metadata directory not provided
I20260709 12:28:20.862944  9681 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:28:20.863278 19050 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37304
I20260709 12:28:20.863284  9681 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:28:20.865268  9681 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599781984018-9681-0/minicluster-data/ts-1-root/instance:
uuid: "595ece3316774e33930c4ef7923b8dc1"
format_stamp: "Formatted at 2026-07-09 12:28:20 on dist-test-slave-zk51"
I20260709 12:28:20.870261  9681 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.003s
I20260709 12:28:20.874492 19189 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:20.875715  9681 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.002s
I20260709 12:28:20.876176  9681 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599781984018-9681-0/minicluster-data/ts-1-root
uuid: "595ece3316774e33930c4ef7923b8dc1"
format_stamp: "Formatted at 2026-07-09 12:28:20 on dist-test-slave-zk51"
I20260709 12:28:20.876550  9681 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599781984018-9681-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599781984018-9681-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599781984018-9681-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:28:20.893425  9681 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:28:20.894613  9681 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:28:20.896166  9681 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:28:20.898670  9681 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:28:20.898911  9681 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:20.899171  9681 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:28:20.899358  9681 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:20.954205  9681 rpc_server.cc:307] RPC server started. Bound to: 127.9.116.66:37433
I20260709 12:28:20.954528 19251 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.116.66:37433 every 8 connection(s)
I20260709 12:28:20.959523  9681 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:28:20.968242 19255 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:20.971519 19256 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:20.972442  9681 server_base.cc:1061] running on GCE node
W20260709 12:28:20.972165 19258 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:20.974484  9681 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:28:20.974798  9681 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:28:20.975019  9681 hybrid_clock.cc:648] HybridClock initialized: now 1783600100975001 us; error 0 us; skew 500 ppm
I20260709 12:28:20.975853  9681 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:28:20.977674 19252 heartbeater.cc:344] Connected to a master server at 127.9.116.126:42093
I20260709 12:28:20.978418 19252 heartbeater.cc:461] Registering TS with master...
I20260709 12:28:20.979627  9681 webserver.cc:533] Webserver started at http://127.9.116.67:38339/ using document root <none> and password file <none>
I20260709 12:28:20.980129 19252 heartbeater.cc:507] Master 127.9.116.126:42093 requested a full tablet report, sending...
I20260709 12:28:20.980547  9681 fs_manager.cc:362] Metadata directory not provided
I20260709 12:28:20.980883  9681 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:28:20.981237  9681 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:28:20.982774 19050 ts_manager.cc:194] Registered new tserver with Master: 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66:37433)
I20260709 12:28:20.982822  9681 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599781984018-9681-0/minicluster-data/ts-2-root/instance:
uuid: "ecd798a306df4905858bf774b6cd98f3"
format_stamp: "Formatted at 2026-07-09 12:28:20 on dist-test-slave-zk51"
I20260709 12:28:20.985034 19050 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37310
I20260709 12:28:20.989001  9681 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:28:20.992465 19263 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:20.993789  9681 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:28:20.994205  9681 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599781984018-9681-0/minicluster-data/ts-2-root
uuid: "ecd798a306df4905858bf774b6cd98f3"
format_stamp: "Formatted at 2026-07-09 12:28:20 on dist-test-slave-zk51"
I20260709 12:28:20.994529  9681 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599781984018-9681-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599781984018-9681-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599781984018-9681-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:28:21.015972  9681 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:28:21.017155  9681 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:28:21.018704  9681 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:28:21.021209  9681 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:28:21.021476  9681 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:21.021739  9681 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:28:21.021937  9681 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:21.069272  9681 rpc_server.cc:307] RPC server started. Bound to: 127.9.116.67:37403
I20260709 12:28:21.069478 19325 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.116.67:37403 every 8 connection(s)
I20260709 12:28:21.085266 19326 heartbeater.cc:344] Connected to a master server at 127.9.116.126:42093
I20260709 12:28:21.086066 19326 heartbeater.cc:461] Registering TS with master...
I20260709 12:28:21.086927 19326 heartbeater.cc:507] Master 127.9.116.126:42093 requested a full tablet report, sending...
I20260709 12:28:21.089120 19050 ts_manager.cc:194] Registered new tserver with Master: ecd798a306df4905858bf774b6cd98f3 (127.9.116.67:37403)
I20260709 12:28:21.089602  9681 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016583188s
I20260709 12:28:21.090600 19050 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37322
I20260709 12:28:21.120014 19050 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37326:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:28:21.123366 19050 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:28:21.200287 19141 tablet_service.cc:1511] Processing CreateTablet for tablet 9150dab4dcbc4945994ab3f7090326b5 (DEFAULT_TABLE table=test-workload [id=c22d6b435617437eb895b82d045aef29]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:28:21.202349 19141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9150dab4dcbc4945994ab3f7090326b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:21.204541 19142 tablet_service.cc:1511] Processing CreateTablet for tablet d9d28b53dbf34d0b94a1b47ab3ed7c3e (DEFAULT_TABLE table=test-workload [id=c22d6b435617437eb895b82d045aef29]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:28:21.206759 19142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9d28b53dbf34d0b94a1b47ab3ed7c3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:21.207864 19139 tablet_service.cc:1511] Processing CreateTablet for tablet 584e9788383444ce82092f41f1749c44 (DEFAULT_TABLE table=test-workload [id=c22d6b435617437eb895b82d045aef29]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:28:21.209614 19139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 584e9788383444ce82092f41f1749c44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:21.204587 19140 tablet_service.cc:1511] Processing CreateTablet for tablet 489fca1a81224008bc8b8e01b86bab9a (DEFAULT_TABLE table=test-workload [id=c22d6b435617437eb895b82d045aef29]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:28:21.212484 19140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 489fca1a81224008bc8b8e01b86bab9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:21.218626 19138 tablet_service.cc:1511] Processing CreateTablet for tablet f4a87e357d584a3b925af9c5d05e2ab6 (DEFAULT_TABLE table=test-workload [id=c22d6b435617437eb895b82d045aef29]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:28:21.220443 19138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4a87e357d584a3b925af9c5d05e2ab6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:21.226408 19137 tablet_service.cc:1511] Processing CreateTablet for tablet c511fe69a84144d2ad2e090cc6766ffc (DEFAULT_TABLE table=test-workload [id=c22d6b435617437eb895b82d045aef29]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:28:21.228123 19137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c511fe69a84144d2ad2e090cc6766ffc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:21.245165 19291 tablet_service.cc:1511] Processing CreateTablet for tablet d9d28b53dbf34d0b94a1b47ab3ed7c3e (DEFAULT_TABLE table=test-workload [id=c22d6b435617437eb895b82d045aef29]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:28:21.249446 19290 tablet_service.cc:1511] Processing CreateTablet for tablet 9150dab4dcbc4945994ab3f7090326b5 (DEFAULT_TABLE table=test-workload [id=c22d6b435617437eb895b82d045aef29]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:28:21.247334 19291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9d28b53dbf34d0b94a1b47ab3ed7c3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:21.250387 19288 tablet_service.cc:1511] Processing CreateTablet for tablet 584e9788383444ce82092f41f1749c44 (DEFAULT_TABLE table=test-workload [id=c22d6b435617437eb895b82d045aef29]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:28:21.251078 19290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9150dab4dcbc4945994ab3f7090326b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:21.251946 19288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 584e9788383444ce82092f41f1749c44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:21.253365 19289 tablet_service.cc:1511] Processing CreateTablet for tablet 489fca1a81224008bc8b8e01b86bab9a (DEFAULT_TABLE table=test-workload [id=c22d6b435617437eb895b82d045aef29]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:28:21.254976 19289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 489fca1a81224008bc8b8e01b86bab9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:21.256793 19287 tablet_service.cc:1511] Processing CreateTablet for tablet f4a87e357d584a3b925af9c5d05e2ab6 (DEFAULT_TABLE table=test-workload [id=c22d6b435617437eb895b82d045aef29]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:28:21.258373 19287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4a87e357d584a3b925af9c5d05e2ab6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:21.261338 19286 tablet_service.cc:1511] Processing CreateTablet for tablet c511fe69a84144d2ad2e090cc6766ffc (DEFAULT_TABLE table=test-workload [id=c22d6b435617437eb895b82d045aef29]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:28:21.263849 19286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c511fe69a84144d2ad2e090cc6766ffc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:21.272291 19136 tablet_service.cc:1511] Processing CreateTablet for tablet c542a19e01724e1982bf9694078796f3 (DEFAULT_TABLE table=test-workload [id=c22d6b435617437eb895b82d045aef29]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:28:21.273854 19136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c542a19e01724e1982bf9694078796f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:21.289559 19217 tablet_service.cc:1511] Processing CreateTablet for tablet d9d28b53dbf34d0b94a1b47ab3ed7c3e (DEFAULT_TABLE table=test-workload [id=c22d6b435617437eb895b82d045aef29]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:28:21.291184 19217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9d28b53dbf34d0b94a1b47ab3ed7c3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:21.290884 19214 tablet_service.cc:1511] Processing CreateTablet for tablet 584e9788383444ce82092f41f1749c44 (DEFAULT_TABLE table=test-workload [id=c22d6b435617437eb895b82d045aef29]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:28:21.291893 19340 tablet_bootstrap.cc:492] T 9150dab4dcbc4945994ab3f7090326b5 P a5cd38daa04940ac97f9037e3241cdaf: Bootstrap starting.
I20260709 12:28:21.293208 19213 tablet_service.cc:1511] Processing CreateTablet for tablet f4a87e357d584a3b925af9c5d05e2ab6 (DEFAULT_TABLE table=test-workload [id=c22d6b435617437eb895b82d045aef29]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:28:21.295831 19216 tablet_service.cc:1511] Processing CreateTablet for tablet 9150dab4dcbc4945994ab3f7090326b5 (DEFAULT_TABLE table=test-workload [id=c22d6b435617437eb895b82d045aef29]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:28:21.296761 19215 tablet_service.cc:1511] Processing CreateTablet for tablet 489fca1a81224008bc8b8e01b86bab9a (DEFAULT_TABLE table=test-workload [id=c22d6b435617437eb895b82d045aef29]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:28:21.298533 19212 tablet_service.cc:1511] Processing CreateTablet for tablet c511fe69a84144d2ad2e090cc6766ffc (DEFAULT_TABLE table=test-workload [id=c22d6b435617437eb895b82d045aef29]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:28:21.302171 19285 tablet_service.cc:1511] Processing CreateTablet for tablet c542a19e01724e1982bf9694078796f3 (DEFAULT_TABLE table=test-workload [id=c22d6b435617437eb895b82d045aef29]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:28:21.304207 19285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c542a19e01724e1982bf9694078796f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:21.306201 19210 tablet_service.cc:1511] Processing CreateTablet for tablet 22e532f746f14300aac7e6240a0e18bd (DEFAULT_TABLE table=test-workload [id=c22d6b435617437eb895b82d045aef29]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:28:21.307806 19210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22e532f746f14300aac7e6240a0e18bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:21.308468 19216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9150dab4dcbc4945994ab3f7090326b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:21.308768 19211 tablet_service.cc:1511] Processing CreateTablet for tablet c542a19e01724e1982bf9694078796f3 (DEFAULT_TABLE table=test-workload [id=c22d6b435617437eb895b82d045aef29]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:28:21.310281 19211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c542a19e01724e1982bf9694078796f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:21.312644 19284 tablet_service.cc:1511] Processing CreateTablet for tablet 22e532f746f14300aac7e6240a0e18bd (DEFAULT_TABLE table=test-workload [id=c22d6b435617437eb895b82d045aef29]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:28:21.314532 19284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22e532f746f14300aac7e6240a0e18bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:21.317039 19283 tablet_service.cc:1511] Processing CreateTablet for tablet c783b6e59edb46c4976d6b2117292201 (DEFAULT_TABLE table=test-workload [id=c22d6b435617437eb895b82d045aef29]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:28:21.318794 19283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c783b6e59edb46c4976d6b2117292201. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:21.319881 19209 tablet_service.cc:1511] Processing CreateTablet for tablet c783b6e59edb46c4976d6b2117292201 (DEFAULT_TABLE table=test-workload [id=c22d6b435617437eb895b82d045aef29]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:28:21.326452 19136 tablet_service.cc:1511] Processing CreateTablet for tablet c783b6e59edb46c4976d6b2117292201 (DEFAULT_TABLE table=test-workload [id=c22d6b435617437eb895b82d045aef29]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:28:21.328354 19136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c783b6e59edb46c4976d6b2117292201. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:21.330595 19215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 489fca1a81224008bc8b8e01b86bab9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:21.331475 19209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c783b6e59edb46c4976d6b2117292201. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:21.332520 19212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c511fe69a84144d2ad2e090cc6766ffc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:21.335964 19214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 584e9788383444ce82092f41f1749c44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:21.340085 19213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4a87e357d584a3b925af9c5d05e2ab6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:21.352149 19340 tablet_bootstrap.cc:654] T 9150dab4dcbc4945994ab3f7090326b5 P a5cd38daa04940ac97f9037e3241cdaf: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:21.363879 19142 tablet_service.cc:1511] Processing CreateTablet for tablet 22e532f746f14300aac7e6240a0e18bd (DEFAULT_TABLE table=test-workload [id=c22d6b435617437eb895b82d045aef29]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:28:21.386292 19340 tablet_bootstrap.cc:492] T 9150dab4dcbc4945994ab3f7090326b5 P a5cd38daa04940ac97f9037e3241cdaf: No bootstrap required, opened a new log
I20260709 12:28:21.388540 19142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22e532f746f14300aac7e6240a0e18bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:21.387351 19340 ts_tablet_manager.cc:1403] T 9150dab4dcbc4945994ab3f7090326b5 P a5cd38daa04940ac97f9037e3241cdaf: Time spent bootstrapping tablet: real 0.096s	user 0.010s	sys 0.000s
I20260709 12:28:21.440961 19340 raft_consensus.cc:359] T 9150dab4dcbc4945994ab3f7090326b5 P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:21.442127 19340 raft_consensus.cc:385] T 9150dab4dcbc4945994ab3f7090326b5 P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:21.442587 19340 raft_consensus.cc:740] T 9150dab4dcbc4945994ab3f7090326b5 P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5cd38daa04940ac97f9037e3241cdaf, State: Initialized, Role: FOLLOWER
I20260709 12:28:21.449615 19342 tablet_bootstrap.cc:492] T c542a19e01724e1982bf9694078796f3 P 595ece3316774e33930c4ef7923b8dc1: Bootstrap starting.
I20260709 12:28:21.454386 19342 tablet_bootstrap.cc:654] T c542a19e01724e1982bf9694078796f3 P 595ece3316774e33930c4ef7923b8dc1: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:21.456338 19340 consensus_queue.cc:260] T 9150dab4dcbc4945994ab3f7090326b5 P a5cd38daa04940ac97f9037e3241cdaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:21.463697 19343 tablet_bootstrap.cc:492] T 9150dab4dcbc4945994ab3f7090326b5 P ecd798a306df4905858bf774b6cd98f3: Bootstrap starting.
W20260709 12:28:21.483834 19035 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.9.116.65:42503, user_credentials={real_user=slave}} blocked reactor thread for 56573.1us
I20260709 12:28:21.496636 19343 tablet_bootstrap.cc:654] T 9150dab4dcbc4945994ab3f7090326b5 P ecd798a306df4905858bf774b6cd98f3: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:21.506515 19340 ts_tablet_manager.cc:1434] T 9150dab4dcbc4945994ab3f7090326b5 P a5cd38daa04940ac97f9037e3241cdaf: Time spent starting tablet: real 0.107s	user 0.025s	sys 0.014s
I20260709 12:28:21.507871 19342 tablet_bootstrap.cc:492] T c542a19e01724e1982bf9694078796f3 P 595ece3316774e33930c4ef7923b8dc1: No bootstrap required, opened a new log
I20260709 12:28:21.508872 19342 ts_tablet_manager.cc:1403] T c542a19e01724e1982bf9694078796f3 P 595ece3316774e33930c4ef7923b8dc1: Time spent bootstrapping tablet: real 0.060s	user 0.025s	sys 0.011s
I20260709 12:28:21.509004 19177 heartbeater.cc:499] Master 127.9.116.126:42093 was elected leader, sending a full tablet report...
I20260709 12:28:21.512323 19340 tablet_bootstrap.cc:492] T 489fca1a81224008bc8b8e01b86bab9a P a5cd38daa04940ac97f9037e3241cdaf: Bootstrap starting.
I20260709 12:28:21.512984 19347 raft_consensus.cc:493] T 9150dab4dcbc4945994ab3f7090326b5 P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:21.513612 19347 raft_consensus.cc:515] T 9150dab4dcbc4945994ab3f7090326b5 P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:21.520627 19340 tablet_bootstrap.cc:654] T 489fca1a81224008bc8b8e01b86bab9a P a5cd38daa04940ac97f9037e3241cdaf: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:21.522315 19342 raft_consensus.cc:359] T c542a19e01724e1982bf9694078796f3 P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:21.523524 19342 raft_consensus.cc:385] T c542a19e01724e1982bf9694078796f3 P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:21.524070 19342 raft_consensus.cc:740] T c542a19e01724e1982bf9694078796f3 P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 595ece3316774e33930c4ef7923b8dc1, State: Initialized, Role: FOLLOWER
I20260709 12:28:21.525190 19342 consensus_queue.cc:260] T c542a19e01724e1982bf9694078796f3 P 595ece3316774e33930c4ef7923b8dc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:21.525873 19347 leader_election.cc:290] T 9150dab4dcbc4945994ab3f7090326b5 P a5cd38daa04940ac97f9037e3241cdaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66:37433), ecd798a306df4905858bf774b6cd98f3 (127.9.116.67:37403)
I20260709 12:28:21.526991 19343 tablet_bootstrap.cc:492] T 9150dab4dcbc4945994ab3f7090326b5 P ecd798a306df4905858bf774b6cd98f3: No bootstrap required, opened a new log
I20260709 12:28:21.528247 19343 ts_tablet_manager.cc:1403] T 9150dab4dcbc4945994ab3f7090326b5 P ecd798a306df4905858bf774b6cd98f3: Time spent bootstrapping tablet: real 0.065s	user 0.015s	sys 0.002s
I20260709 12:28:21.532505 19343 raft_consensus.cc:359] T 9150dab4dcbc4945994ab3f7090326b5 P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:21.533742 19343 raft_consensus.cc:385] T 9150dab4dcbc4945994ab3f7090326b5 P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:21.534215 19343 raft_consensus.cc:740] T 9150dab4dcbc4945994ab3f7090326b5 P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd798a306df4905858bf774b6cd98f3, State: Initialized, Role: FOLLOWER
I20260709 12:28:21.535653 19343 consensus_queue.cc:260] T 9150dab4dcbc4945994ab3f7090326b5 P ecd798a306df4905858bf774b6cd98f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:21.544312 19326 heartbeater.cc:499] Master 127.9.116.126:42093 was elected leader, sending a full tablet report...
I20260709 12:28:21.545840 19340 tablet_bootstrap.cc:492] T 489fca1a81224008bc8b8e01b86bab9a P a5cd38daa04940ac97f9037e3241cdaf: No bootstrap required, opened a new log
I20260709 12:28:21.546433 19340 ts_tablet_manager.cc:1403] T 489fca1a81224008bc8b8e01b86bab9a P a5cd38daa04940ac97f9037e3241cdaf: Time spent bootstrapping tablet: real 0.034s	user 0.017s	sys 0.012s
I20260709 12:28:21.549306 19340 raft_consensus.cc:359] T 489fca1a81224008bc8b8e01b86bab9a P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:21.544390 19343 ts_tablet_manager.cc:1434] T 9150dab4dcbc4945994ab3f7090326b5 P ecd798a306df4905858bf774b6cd98f3: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.004s
I20260709 12:28:21.550125 19340 raft_consensus.cc:385] T 489fca1a81224008bc8b8e01b86bab9a P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:21.550463 19340 raft_consensus.cc:740] T 489fca1a81224008bc8b8e01b86bab9a P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5cd38daa04940ac97f9037e3241cdaf, State: Initialized, Role: FOLLOWER
I20260709 12:28:21.551296 19340 consensus_queue.cc:260] T 489fca1a81224008bc8b8e01b86bab9a P a5cd38daa04940ac97f9037e3241cdaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:21.553630 19340 ts_tablet_manager.cc:1434] T 489fca1a81224008bc8b8e01b86bab9a P a5cd38daa04940ac97f9037e3241cdaf: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:28:21.554708 19340 tablet_bootstrap.cc:492] T c511fe69a84144d2ad2e090cc6766ffc P a5cd38daa04940ac97f9037e3241cdaf: Bootstrap starting.
I20260709 12:28:21.551885 19343 tablet_bootstrap.cc:492] T 584e9788383444ce82092f41f1749c44 P ecd798a306df4905858bf774b6cd98f3: Bootstrap starting.
I20260709 12:28:21.562083 19340 tablet_bootstrap.cc:654] T c511fe69a84144d2ad2e090cc6766ffc P a5cd38daa04940ac97f9037e3241cdaf: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:21.566546 19342 ts_tablet_manager.cc:1434] T c542a19e01724e1982bf9694078796f3 P 595ece3316774e33930c4ef7923b8dc1: Time spent starting tablet: real 0.057s	user 0.001s	sys 0.017s
I20260709 12:28:21.567876 19252 heartbeater.cc:499] Master 127.9.116.126:42093 was elected leader, sending a full tablet report...
I20260709 12:28:21.579107 19342 tablet_bootstrap.cc:492] T c511fe69a84144d2ad2e090cc6766ffc P 595ece3316774e33930c4ef7923b8dc1: Bootstrap starting.
I20260709 12:28:21.596571 19351 raft_consensus.cc:493] T 9150dab4dcbc4945994ab3f7090326b5 P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:21.597450 19351 raft_consensus.cc:515] T 9150dab4dcbc4945994ab3f7090326b5 P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:21.602434 19343 tablet_bootstrap.cc:654] T 584e9788383444ce82092f41f1749c44 P ecd798a306df4905858bf774b6cd98f3: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:21.613969 19227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9150dab4dcbc4945994ab3f7090326b5" candidate_uuid: "a5cd38daa04940ac97f9037e3241cdaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "595ece3316774e33930c4ef7923b8dc1" is_pre_election: true
W20260709 12:28:21.622442 19117 leader_election.cc:343] T 9150dab4dcbc4945994ab3f7090326b5 P a5cd38daa04940ac97f9037e3241cdaf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66:37433): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:21.622804 19342 tablet_bootstrap.cc:654] T c511fe69a84144d2ad2e090cc6766ffc P 595ece3316774e33930c4ef7923b8dc1: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:21.620121 19340 tablet_bootstrap.cc:492] T c511fe69a84144d2ad2e090cc6766ffc P a5cd38daa04940ac97f9037e3241cdaf: No bootstrap required, opened a new log
I20260709 12:28:21.624810 19340 ts_tablet_manager.cc:1403] T c511fe69a84144d2ad2e090cc6766ffc P a5cd38daa04940ac97f9037e3241cdaf: Time spent bootstrapping tablet: real 0.070s	user 0.025s	sys 0.032s
I20260709 12:28:21.626434 19301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9150dab4dcbc4945994ab3f7090326b5" candidate_uuid: "a5cd38daa04940ac97f9037e3241cdaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd798a306df4905858bf774b6cd98f3" is_pre_election: true
I20260709 12:28:21.627218 19301 raft_consensus.cc:2468] T 9150dab4dcbc4945994ab3f7090326b5 P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a5cd38daa04940ac97f9037e3241cdaf in term 0.
I20260709 12:28:21.628537 19117 leader_election.cc:304] T 9150dab4dcbc4945994ab3f7090326b5 P a5cd38daa04940ac97f9037e3241cdaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a5cd38daa04940ac97f9037e3241cdaf, ecd798a306df4905858bf774b6cd98f3; no voters: 595ece3316774e33930c4ef7923b8dc1
I20260709 12:28:21.629851 19347 raft_consensus.cc:2804] T 9150dab4dcbc4945994ab3f7090326b5 P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:21.630264 19347 raft_consensus.cc:493] T 9150dab4dcbc4945994ab3f7090326b5 P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:21.630611 19347 raft_consensus.cc:3060] T 9150dab4dcbc4945994ab3f7090326b5 P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:21.629201 19340 raft_consensus.cc:359] T c511fe69a84144d2ad2e090cc6766ffc P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:21.633255 19152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9150dab4dcbc4945994ab3f7090326b5" candidate_uuid: "ecd798a306df4905858bf774b6cd98f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5cd38daa04940ac97f9037e3241cdaf" is_pre_election: true
I20260709 12:28:21.633724 19340 raft_consensus.cc:385] T c511fe69a84144d2ad2e090cc6766ffc P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:28:21.633515 19098 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:28:21.634231 19340 raft_consensus.cc:740] T c511fe69a84144d2ad2e090cc6766ffc P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5cd38daa04940ac97f9037e3241cdaf, State: Initialized, Role: FOLLOWER
I20260709 12:28:21.610719 19351 leader_election.cc:290] T 9150dab4dcbc4945994ab3f7090326b5 P ecd798a306df4905858bf774b6cd98f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65:42503), 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66:37433)
I20260709 12:28:21.635452 19340 consensus_queue.cc:260] T c511fe69a84144d2ad2e090cc6766ffc P a5cd38daa04940ac97f9037e3241cdaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:21.639462 19340 ts_tablet_manager.cc:1434] T c511fe69a84144d2ad2e090cc6766ffc P a5cd38daa04940ac97f9037e3241cdaf: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 12:28:21.642987 19343 tablet_bootstrap.cc:492] T 584e9788383444ce82092f41f1749c44 P ecd798a306df4905858bf774b6cd98f3: No bootstrap required, opened a new log
I20260709 12:28:21.643693 19343 ts_tablet_manager.cc:1403] T 584e9788383444ce82092f41f1749c44 P ecd798a306df4905858bf774b6cd98f3: Time spent bootstrapping tablet: real 0.092s	user 0.014s	sys 0.002s
I20260709 12:28:21.643939 19347 raft_consensus.cc:515] T 9150dab4dcbc4945994ab3f7090326b5 P a5cd38daa04940ac97f9037e3241cdaf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:21.645256 19152 raft_consensus.cc:2393] T 9150dab4dcbc4945994ab3f7090326b5 P a5cd38daa04940ac97f9037e3241cdaf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd798a306df4905858bf774b6cd98f3 in current term 1: Already voted for candidate a5cd38daa04940ac97f9037e3241cdaf in this term.
I20260709 12:28:21.646999 19340 tablet_bootstrap.cc:492] T f4a87e357d584a3b925af9c5d05e2ab6 P a5cd38daa04940ac97f9037e3241cdaf: Bootstrap starting.
I20260709 12:28:21.647192 19227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9150dab4dcbc4945994ab3f7090326b5" candidate_uuid: "a5cd38daa04940ac97f9037e3241cdaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "595ece3316774e33930c4ef7923b8dc1"
I20260709 12:28:21.647444 19343 raft_consensus.cc:359] T 584e9788383444ce82092f41f1749c44 P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:21.648358 19343 raft_consensus.cc:385] T 584e9788383444ce82092f41f1749c44 P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:28:21.648829 19117 leader_election.cc:343] T 9150dab4dcbc4945994ab3f7090326b5 P a5cd38daa04940ac97f9037e3241cdaf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66:37433): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:21.648870 19343 raft_consensus.cc:740] T 584e9788383444ce82092f41f1749c44 P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd798a306df4905858bf774b6cd98f3, State: Initialized, Role: FOLLOWER
I20260709 12:28:21.650492 19343 consensus_queue.cc:260] T 584e9788383444ce82092f41f1749c44 P ecd798a306df4905858bf774b6cd98f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:21.651665 19301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9150dab4dcbc4945994ab3f7090326b5" candidate_uuid: "a5cd38daa04940ac97f9037e3241cdaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd798a306df4905858bf774b6cd98f3"
I20260709 12:28:21.652385 19301 raft_consensus.cc:3060] T 9150dab4dcbc4945994ab3f7090326b5 P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:21.655237 19340 tablet_bootstrap.cc:654] T f4a87e357d584a3b925af9c5d05e2ab6 P a5cd38daa04940ac97f9037e3241cdaf: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:21.656996 19343 ts_tablet_manager.cc:1434] T 584e9788383444ce82092f41f1749c44 P ecd798a306df4905858bf774b6cd98f3: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 12:28:21.658705 19343 tablet_bootstrap.cc:492] T 489fca1a81224008bc8b8e01b86bab9a P ecd798a306df4905858bf774b6cd98f3: Bootstrap starting.
I20260709 12:28:21.661587 19301 raft_consensus.cc:2468] T 9150dab4dcbc4945994ab3f7090326b5 P ecd798a306df4905858bf774b6cd98f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5cd38daa04940ac97f9037e3241cdaf in term 1.
I20260709 12:28:21.662997 19117 leader_election.cc:304] T 9150dab4dcbc4945994ab3f7090326b5 P a5cd38daa04940ac97f9037e3241cdaf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a5cd38daa04940ac97f9037e3241cdaf, ecd798a306df4905858bf774b6cd98f3; no voters: 595ece3316774e33930c4ef7923b8dc1
I20260709 12:28:21.664173 19344 raft_consensus.cc:2804] T 9150dab4dcbc4945994ab3f7090326b5 P a5cd38daa04940ac97f9037e3241cdaf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:21.658190 19347 leader_election.cc:290] T 9150dab4dcbc4945994ab3f7090326b5 P a5cd38daa04940ac97f9037e3241cdaf [CANDIDATE]: Term 1 election: Requested vote from peers 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66:37433), ecd798a306df4905858bf774b6cd98f3 (127.9.116.67:37403)
I20260709 12:28:21.669164 19351 raft_consensus.cc:493] T 584e9788383444ce82092f41f1749c44 P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:21.684053 19342 tablet_bootstrap.cc:492] T c511fe69a84144d2ad2e090cc6766ffc P 595ece3316774e33930c4ef7923b8dc1: No bootstrap required, opened a new log
I20260709 12:28:21.685410 19342 ts_tablet_manager.cc:1403] T c511fe69a84144d2ad2e090cc6766ffc P 595ece3316774e33930c4ef7923b8dc1: Time spent bootstrapping tablet: real 0.107s	user 0.010s	sys 0.029s
I20260709 12:28:21.690367 19351 raft_consensus.cc:515] T 584e9788383444ce82092f41f1749c44 P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:21.692050 19350 raft_consensus.cc:493] T c542a19e01724e1982bf9694078796f3 P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:21.693065 19350 raft_consensus.cc:515] T c542a19e01724e1982bf9694078796f3 P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:21.697780 19152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584e9788383444ce82092f41f1749c44" candidate_uuid: "ecd798a306df4905858bf774b6cd98f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5cd38daa04940ac97f9037e3241cdaf" is_pre_election: true
I20260709 12:28:21.690721 19342 raft_consensus.cc:359] T c511fe69a84144d2ad2e090cc6766ffc P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:21.701117 19342 raft_consensus.cc:385] T c511fe69a84144d2ad2e090cc6766ffc P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:21.701205 19227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9150dab4dcbc4945994ab3f7090326b5" candidate_uuid: "ecd798a306df4905858bf774b6cd98f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "595ece3316774e33930c4ef7923b8dc1" is_pre_election: true
I20260709 12:28:21.701529 19342 raft_consensus.cc:740] T c511fe69a84144d2ad2e090cc6766ffc P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 595ece3316774e33930c4ef7923b8dc1, State: Initialized, Role: FOLLOWER
W20260709 12:28:21.702613 19265 leader_election.cc:343] T 584e9788383444ce82092f41f1749c44 P ecd798a306df4905858bf774b6cd98f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65:42503): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:28:21.703009 19266 leader_election.cc:343] T 9150dab4dcbc4945994ab3f7090326b5 P ecd798a306df4905858bf774b6cd98f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66:37433): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:21.702468 19342 consensus_queue.cc:260] T c511fe69a84144d2ad2e090cc6766ffc P 595ece3316774e33930c4ef7923b8dc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:21.703421 19350 leader_election.cc:290] T c542a19e01724e1982bf9694078796f3 P 595ece3316774e33930c4ef7923b8dc1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65:42503), ecd798a306df4905858bf774b6cd98f3 (127.9.116.67:37403)
I20260709 12:28:21.703493 19266 leader_election.cc:304] T 9150dab4dcbc4945994ab3f7090326b5 P ecd798a306df4905858bf774b6cd98f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd798a306df4905858bf774b6cd98f3; no voters: 595ece3316774e33930c4ef7923b8dc1, a5cd38daa04940ac97f9037e3241cdaf
I20260709 12:28:21.711081 19343 tablet_bootstrap.cc:654] T 489fca1a81224008bc8b8e01b86bab9a P ecd798a306df4905858bf774b6cd98f3: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:21.712304 19340 tablet_bootstrap.cc:492] T f4a87e357d584a3b925af9c5d05e2ab6 P a5cd38daa04940ac97f9037e3241cdaf: No bootstrap required, opened a new log
I20260709 12:28:21.712980 19340 ts_tablet_manager.cc:1403] T f4a87e357d584a3b925af9c5d05e2ab6 P a5cd38daa04940ac97f9037e3241cdaf: Time spent bootstrapping tablet: real 0.066s	user 0.032s	sys 0.018s
I20260709 12:28:21.712823 19350 raft_consensus.cc:493] T c511fe69a84144d2ad2e090cc6766ffc P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:21.713734 19350 raft_consensus.cc:515] T c511fe69a84144d2ad2e090cc6766ffc P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:21.714814 19351 leader_election.cc:290] T 584e9788383444ce82092f41f1749c44 P ecd798a306df4905858bf774b6cd98f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65:42503), 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66:37433)
I20260709 12:28:21.715540 19351 raft_consensus.cc:2749] T 9150dab4dcbc4945994ab3f7090326b5 P ecd798a306df4905858bf774b6cd98f3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:21.700300 19344 raft_consensus.cc:697] T 9150dab4dcbc4945994ab3f7090326b5 P a5cd38daa04940ac97f9037e3241cdaf [term 1 LEADER]: Becoming Leader. State: Replica: a5cd38daa04940ac97f9037e3241cdaf, State: Running, Role: LEADER
I20260709 12:28:21.719156 19344 consensus_queue.cc:237] T 9150dab4dcbc4945994ab3f7090326b5 P a5cd38daa04940ac97f9037e3241cdaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:21.719213 19340 raft_consensus.cc:359] T f4a87e357d584a3b925af9c5d05e2ab6 P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:21.720429 19340 raft_consensus.cc:385] T f4a87e357d584a3b925af9c5d05e2ab6 P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:21.720852 19340 raft_consensus.cc:740] T f4a87e357d584a3b925af9c5d05e2ab6 P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5cd38daa04940ac97f9037e3241cdaf, State: Initialized, Role: FOLLOWER
I20260709 12:28:21.721915 19340 consensus_queue.cc:260] T f4a87e357d584a3b925af9c5d05e2ab6 P a5cd38daa04940ac97f9037e3241cdaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:21.726018 19340 ts_tablet_manager.cc:1434] T f4a87e357d584a3b925af9c5d05e2ab6 P a5cd38daa04940ac97f9037e3241cdaf: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.004s
I20260709 12:28:21.727635 19340 tablet_bootstrap.cc:492] T c542a19e01724e1982bf9694078796f3 P a5cd38daa04940ac97f9037e3241cdaf: Bootstrap starting.
I20260709 12:28:21.734720 19342 ts_tablet_manager.cc:1434] T c511fe69a84144d2ad2e090cc6766ffc P 595ece3316774e33930c4ef7923b8dc1: Time spent starting tablet: real 0.049s	user 0.016s	sys 0.020s
I20260709 12:28:21.735737 19152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c542a19e01724e1982bf9694078796f3" candidate_uuid: "595ece3316774e33930c4ef7923b8dc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5cd38daa04940ac97f9037e3241cdaf" is_pre_election: true
I20260709 12:28:21.736986 19227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584e9788383444ce82092f41f1749c44" candidate_uuid: "ecd798a306df4905858bf774b6cd98f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "595ece3316774e33930c4ef7923b8dc1" is_pre_election: true
I20260709 12:28:21.737285 19151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c511fe69a84144d2ad2e090cc6766ffc" candidate_uuid: "595ece3316774e33930c4ef7923b8dc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5cd38daa04940ac97f9037e3241cdaf" is_pre_election: true
I20260709 12:28:21.737694 19340 tablet_bootstrap.cc:654] T c542a19e01724e1982bf9694078796f3 P a5cd38daa04940ac97f9037e3241cdaf: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:21.738180 19342 tablet_bootstrap.cc:492] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P 595ece3316774e33930c4ef7923b8dc1: Bootstrap starting.
I20260709 12:28:21.738147 19151 raft_consensus.cc:2468] T c511fe69a84144d2ad2e090cc6766ffc P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 595ece3316774e33930c4ef7923b8dc1 in term 0.
W20260709 12:28:21.739055 19266 leader_election.cc:343] T 584e9788383444ce82092f41f1749c44 P ecd798a306df4905858bf774b6cd98f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66:37433): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:21.741300 19350 leader_election.cc:290] T c511fe69a84144d2ad2e090cc6766ffc P 595ece3316774e33930c4ef7923b8dc1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65:42503), ecd798a306df4905858bf774b6cd98f3 (127.9.116.67:37403)
W20260709 12:28:21.740902 19191 leader_election.cc:343] T c542a19e01724e1982bf9694078796f3 P 595ece3316774e33930c4ef7923b8dc1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65:42503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:21.742494 19266 leader_election.cc:304] T 584e9788383444ce82092f41f1749c44 P ecd798a306df4905858bf774b6cd98f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd798a306df4905858bf774b6cd98f3; no voters: 595ece3316774e33930c4ef7923b8dc1, a5cd38daa04940ac97f9037e3241cdaf
I20260709 12:28:21.743112 19191 leader_election.cc:304] T c511fe69a84144d2ad2e090cc6766ffc P 595ece3316774e33930c4ef7923b8dc1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 595ece3316774e33930c4ef7923b8dc1, a5cd38daa04940ac97f9037e3241cdaf; no voters: 
I20260709 12:28:21.743562 19351 raft_consensus.cc:2749] T 584e9788383444ce82092f41f1749c44 P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:21.748176 19350 raft_consensus.cc:2804] T c511fe69a84144d2ad2e090cc6766ffc P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:21.757124 19350 raft_consensus.cc:493] T c511fe69a84144d2ad2e090cc6766ffc P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:21.757659 19350 raft_consensus.cc:3060] T c511fe69a84144d2ad2e090cc6766ffc P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:21.763845 19301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c542a19e01724e1982bf9694078796f3" candidate_uuid: "595ece3316774e33930c4ef7923b8dc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd798a306df4905858bf774b6cd98f3" is_pre_election: true
I20260709 12:28:21.764300 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c511fe69a84144d2ad2e090cc6766ffc" candidate_uuid: "595ece3316774e33930c4ef7923b8dc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd798a306df4905858bf774b6cd98f3" is_pre_election: true
I20260709 12:28:21.765725 19342 tablet_bootstrap.cc:654] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P 595ece3316774e33930c4ef7923b8dc1: Neither blocks nor log segments found. Creating new log.
W20260709 12:28:21.769745 19192 leader_election.cc:343] T c542a19e01724e1982bf9694078796f3 P 595ece3316774e33930c4ef7923b8dc1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecd798a306df4905858bf774b6cd98f3 (127.9.116.67:37403): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:21.770520 19192 leader_election.cc:304] T c542a19e01724e1982bf9694078796f3 P 595ece3316774e33930c4ef7923b8dc1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 595ece3316774e33930c4ef7923b8dc1; no voters: a5cd38daa04940ac97f9037e3241cdaf, ecd798a306df4905858bf774b6cd98f3
I20260709 12:28:21.771530 19362 raft_consensus.cc:2749] T c542a19e01724e1982bf9694078796f3 P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:21.771780 19340 tablet_bootstrap.cc:492] T c542a19e01724e1982bf9694078796f3 P a5cd38daa04940ac97f9037e3241cdaf: No bootstrap required, opened a new log
W20260709 12:28:21.772051 19192 leader_election.cc:343] T c511fe69a84144d2ad2e090cc6766ffc P 595ece3316774e33930c4ef7923b8dc1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecd798a306df4905858bf774b6cd98f3 (127.9.116.67:37403): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:21.772644 19340 ts_tablet_manager.cc:1403] T c542a19e01724e1982bf9694078796f3 P a5cd38daa04940ac97f9037e3241cdaf: Time spent bootstrapping tablet: real 0.045s	user 0.023s	sys 0.006s
I20260709 12:28:21.776814 19340 raft_consensus.cc:359] T c542a19e01724e1982bf9694078796f3 P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:21.777726 19340 raft_consensus.cc:385] T c542a19e01724e1982bf9694078796f3 P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:21.778928 19340 raft_consensus.cc:740] T c542a19e01724e1982bf9694078796f3 P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5cd38daa04940ac97f9037e3241cdaf, State: Initialized, Role: FOLLOWER
I20260709 12:28:21.777424 19049 catalog_manager.cc:5697] T 9150dab4dcbc4945994ab3f7090326b5 P a5cd38daa04940ac97f9037e3241cdaf reported cstate change: term changed from 0 to 1, leader changed from <none> to a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65). New cstate: current_term: 1 leader_uuid: "a5cd38daa04940ac97f9037e3241cdaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:21.780082 19340 consensus_queue.cc:260] T c542a19e01724e1982bf9694078796f3 P a5cd38daa04940ac97f9037e3241cdaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:21.777587 19350 raft_consensus.cc:515] T c511fe69a84144d2ad2e090cc6766ffc P 595ece3316774e33930c4ef7923b8dc1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:21.782636 19340 ts_tablet_manager.cc:1434] T c542a19e01724e1982bf9694078796f3 P a5cd38daa04940ac97f9037e3241cdaf: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:28:21.784318 19340 tablet_bootstrap.cc:492] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P a5cd38daa04940ac97f9037e3241cdaf: Bootstrap starting.
I20260709 12:28:21.784514 19343 tablet_bootstrap.cc:492] T 489fca1a81224008bc8b8e01b86bab9a P ecd798a306df4905858bf774b6cd98f3: No bootstrap required, opened a new log
I20260709 12:28:21.785226 19343 ts_tablet_manager.cc:1403] T 489fca1a81224008bc8b8e01b86bab9a P ecd798a306df4905858bf774b6cd98f3: Time spent bootstrapping tablet: real 0.127s	user 0.028s	sys 0.006s
I20260709 12:28:21.785854 19151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c511fe69a84144d2ad2e090cc6766ffc" candidate_uuid: "595ece3316774e33930c4ef7923b8dc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5cd38daa04940ac97f9037e3241cdaf"
I20260709 12:28:21.786520 19151 raft_consensus.cc:3060] T c511fe69a84144d2ad2e090cc6766ffc P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:21.788554 19343 raft_consensus.cc:359] T 489fca1a81224008bc8b8e01b86bab9a P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:21.790110 19343 raft_consensus.cc:385] T 489fca1a81224008bc8b8e01b86bab9a P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:21.790859 19343 raft_consensus.cc:740] T 489fca1a81224008bc8b8e01b86bab9a P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd798a306df4905858bf774b6cd98f3, State: Initialized, Role: FOLLOWER
I20260709 12:28:21.792639 19343 consensus_queue.cc:260] T 489fca1a81224008bc8b8e01b86bab9a P ecd798a306df4905858bf774b6cd98f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:21.797642 19340 tablet_bootstrap.cc:654] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P a5cd38daa04940ac97f9037e3241cdaf: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:21.798096 19350 leader_election.cc:290] T c511fe69a84144d2ad2e090cc6766ffc P 595ece3316774e33930c4ef7923b8dc1 [CANDIDATE]: Term 1 election: Requested vote from peers a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65:42503), ecd798a306df4905858bf774b6cd98f3 (127.9.116.67:37403)
I20260709 12:28:21.796813 19151 raft_consensus.cc:2468] T c511fe69a84144d2ad2e090cc6766ffc P a5cd38daa04940ac97f9037e3241cdaf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 595ece3316774e33930c4ef7923b8dc1 in term 1.
I20260709 12:28:21.799216 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c511fe69a84144d2ad2e090cc6766ffc" candidate_uuid: "595ece3316774e33930c4ef7923b8dc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd798a306df4905858bf774b6cd98f3"
I20260709 12:28:21.799902 19191 leader_election.cc:304] T c511fe69a84144d2ad2e090cc6766ffc P 595ece3316774e33930c4ef7923b8dc1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 595ece3316774e33930c4ef7923b8dc1, a5cd38daa04940ac97f9037e3241cdaf; no voters: 
I20260709 12:28:21.800879 19350 raft_consensus.cc:2804] T c511fe69a84144d2ad2e090cc6766ffc P 595ece3316774e33930c4ef7923b8dc1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:21.802204 19350 raft_consensus.cc:697] T c511fe69a84144d2ad2e090cc6766ffc P 595ece3316774e33930c4ef7923b8dc1 [term 1 LEADER]: Becoming Leader. State: Replica: 595ece3316774e33930c4ef7923b8dc1, State: Running, Role: LEADER
I20260709 12:28:21.803131 19350 consensus_queue.cc:237] T c511fe69a84144d2ad2e090cc6766ffc P 595ece3316774e33930c4ef7923b8dc1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
W20260709 12:28:21.804898 19192 leader_election.cc:343] T c511fe69a84144d2ad2e090cc6766ffc P 595ece3316774e33930c4ef7923b8dc1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ecd798a306df4905858bf774b6cd98f3 (127.9.116.67:37403): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:21.808522 19343 ts_tablet_manager.cc:1434] T 489fca1a81224008bc8b8e01b86bab9a P ecd798a306df4905858bf774b6cd98f3: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 12:28:21.812393 19340 tablet_bootstrap.cc:492] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P a5cd38daa04940ac97f9037e3241cdaf: No bootstrap required, opened a new log
I20260709 12:28:21.814086 19340 ts_tablet_manager.cc:1403] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P a5cd38daa04940ac97f9037e3241cdaf: Time spent bootstrapping tablet: real 0.030s	user 0.018s	sys 0.011s
I20260709 12:28:21.815997 19343 tablet_bootstrap.cc:492] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P ecd798a306df4905858bf774b6cd98f3: Bootstrap starting.
I20260709 12:28:21.817366 19342 tablet_bootstrap.cc:492] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P 595ece3316774e33930c4ef7923b8dc1: No bootstrap required, opened a new log
I20260709 12:28:21.818728 19342 ts_tablet_manager.cc:1403] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P 595ece3316774e33930c4ef7923b8dc1: Time spent bootstrapping tablet: real 0.081s	user 0.022s	sys 0.000s
I20260709 12:28:21.820346 19344 raft_consensus.cc:493] T c542a19e01724e1982bf9694078796f3 P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:21.821115 19344 raft_consensus.cc:515] T c542a19e01724e1982bf9694078796f3 P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:21.822424 19342 raft_consensus.cc:359] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } }
I20260709 12:28:21.823807 19344 leader_election.cc:290] T c542a19e01724e1982bf9694078796f3 P a5cd38daa04940ac97f9037e3241cdaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66:37433), ecd798a306df4905858bf774b6cd98f3 (127.9.116.67:37403)
I20260709 12:28:21.824821 19340 raft_consensus.cc:359] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } }
I20260709 12:28:21.828377 19340 raft_consensus.cc:385] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:21.828776 19340 raft_consensus.cc:740] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5cd38daa04940ac97f9037e3241cdaf, State: Initialized, Role: FOLLOWER
I20260709 12:28:21.829710 19340 consensus_queue.cc:260] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P a5cd38daa04940ac97f9037e3241cdaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } }
I20260709 12:28:21.825454 19343 tablet_bootstrap.cc:654] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P ecd798a306df4905858bf774b6cd98f3: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:21.826241 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c542a19e01724e1982bf9694078796f3" candidate_uuid: "a5cd38daa04940ac97f9037e3241cdaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd798a306df4905858bf774b6cd98f3" is_pre_election: true
I20260709 12:28:21.825476 19227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c542a19e01724e1982bf9694078796f3" candidate_uuid: "a5cd38daa04940ac97f9037e3241cdaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "595ece3316774e33930c4ef7923b8dc1" is_pre_election: true
I20260709 12:28:21.831481 19227 raft_consensus.cc:2468] T c542a19e01724e1982bf9694078796f3 P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a5cd38daa04940ac97f9037e3241cdaf in term 0.
W20260709 12:28:21.832492 19117 leader_election.cc:343] T c542a19e01724e1982bf9694078796f3 P a5cd38daa04940ac97f9037e3241cdaf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecd798a306df4905858bf774b6cd98f3 (127.9.116.67:37403): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:21.833432 19117 leader_election.cc:304] T c542a19e01724e1982bf9694078796f3 P a5cd38daa04940ac97f9037e3241cdaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 595ece3316774e33930c4ef7923b8dc1, a5cd38daa04940ac97f9037e3241cdaf; no voters: ecd798a306df4905858bf774b6cd98f3
I20260709 12:28:21.834273 19050 catalog_manager.cc:5697] T c511fe69a84144d2ad2e090cc6766ffc P 595ece3316774e33930c4ef7923b8dc1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66). New cstate: current_term: 1 leader_uuid: "595ece3316774e33930c4ef7923b8dc1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:21.835850 19342 raft_consensus.cc:385] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:21.836326 19342 raft_consensus.cc:740] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 595ece3316774e33930c4ef7923b8dc1, State: Initialized, Role: FOLLOWER
I20260709 12:28:21.837477 19342 consensus_queue.cc:260] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P 595ece3316774e33930c4ef7923b8dc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } }
I20260709 12:28:21.838316 19343 tablet_bootstrap.cc:492] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P ecd798a306df4905858bf774b6cd98f3: No bootstrap required, opened a new log
I20260709 12:28:21.839143 19343 ts_tablet_manager.cc:1403] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P ecd798a306df4905858bf774b6cd98f3: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.002s
I20260709 12:28:21.840046 19342 ts_tablet_manager.cc:1434] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P 595ece3316774e33930c4ef7923b8dc1: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.003s
I20260709 12:28:21.841552 19342 tablet_bootstrap.cc:492] T 9150dab4dcbc4945994ab3f7090326b5 P 595ece3316774e33930c4ef7923b8dc1: Bootstrap starting.
I20260709 12:28:21.843355 19343 raft_consensus.cc:359] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } }
I20260709 12:28:21.845671 19343 raft_consensus.cc:385] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:21.846045 19343 raft_consensus.cc:740] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd798a306df4905858bf774b6cd98f3, State: Initialized, Role: FOLLOWER
I20260709 12:28:21.846871 19340 ts_tablet_manager.cc:1434] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P a5cd38daa04940ac97f9037e3241cdaf: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.001s
I20260709 12:28:21.847015 19359 raft_consensus.cc:2804] T c542a19e01724e1982bf9694078796f3 P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:21.847663 19359 raft_consensus.cc:493] T c542a19e01724e1982bf9694078796f3 P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:21.848080 19359 raft_consensus.cc:3060] T c542a19e01724e1982bf9694078796f3 P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:21.848245 19340 tablet_bootstrap.cc:492] T 584e9788383444ce82092f41f1749c44 P a5cd38daa04940ac97f9037e3241cdaf: Bootstrap starting.
I20260709 12:28:21.847752 19343 consensus_queue.cc:260] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P ecd798a306df4905858bf774b6cd98f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } }
I20260709 12:28:21.856297 19340 tablet_bootstrap.cc:654] T 584e9788383444ce82092f41f1749c44 P a5cd38daa04940ac97f9037e3241cdaf: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:21.858278 19343 ts_tablet_manager.cc:1434] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P ecd798a306df4905858bf774b6cd98f3: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 12:28:21.859805 19343 tablet_bootstrap.cc:492] T c511fe69a84144d2ad2e090cc6766ffc P ecd798a306df4905858bf774b6cd98f3: Bootstrap starting.
I20260709 12:28:21.864125 19342 tablet_bootstrap.cc:654] T 9150dab4dcbc4945994ab3f7090326b5 P 595ece3316774e33930c4ef7923b8dc1: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:21.867556 19343 tablet_bootstrap.cc:654] T c511fe69a84144d2ad2e090cc6766ffc P ecd798a306df4905858bf774b6cd98f3: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:21.864089 19359 raft_consensus.cc:515] T c542a19e01724e1982bf9694078796f3 P a5cd38daa04940ac97f9037e3241cdaf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:21.870684 19359 leader_election.cc:290] T c542a19e01724e1982bf9694078796f3 P a5cd38daa04940ac97f9037e3241cdaf [CANDIDATE]: Term 1 election: Requested vote from peers 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66:37433), ecd798a306df4905858bf774b6cd98f3 (127.9.116.67:37403)
I20260709 12:28:21.871809 19227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c542a19e01724e1982bf9694078796f3" candidate_uuid: "a5cd38daa04940ac97f9037e3241cdaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "595ece3316774e33930c4ef7923b8dc1"
I20260709 12:28:21.872800 19227 raft_consensus.cc:3060] T c542a19e01724e1982bf9694078796f3 P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:21.878108 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c542a19e01724e1982bf9694078796f3" candidate_uuid: "a5cd38daa04940ac97f9037e3241cdaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd798a306df4905858bf774b6cd98f3"
I20260709 12:28:21.882463 19340 tablet_bootstrap.cc:492] T 584e9788383444ce82092f41f1749c44 P a5cd38daa04940ac97f9037e3241cdaf: No bootstrap required, opened a new log
I20260709 12:28:21.883062 19340 ts_tablet_manager.cc:1403] T 584e9788383444ce82092f41f1749c44 P a5cd38daa04940ac97f9037e3241cdaf: Time spent bootstrapping tablet: real 0.035s	user 0.014s	sys 0.002s
W20260709 12:28:21.884927 19117 leader_election.cc:343] T c542a19e01724e1982bf9694078796f3 P a5cd38daa04940ac97f9037e3241cdaf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ecd798a306df4905858bf774b6cd98f3 (127.9.116.67:37403): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:21.888742 19340 raft_consensus.cc:359] T 584e9788383444ce82092f41f1749c44 P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:21.891094 19350 raft_consensus.cc:493] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:21.892155 19350 raft_consensus.cc:515] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } }
I20260709 12:28:21.899857 19351 raft_consensus.cc:493] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:21.900527 19351 raft_consensus.cc:515] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } }
I20260709 12:28:21.901331 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d28b53dbf34d0b94a1b47ab3ed7c3e" candidate_uuid: "595ece3316774e33930c4ef7923b8dc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd798a306df4905858bf774b6cd98f3" is_pre_election: true
I20260709 12:28:21.901539 19151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d28b53dbf34d0b94a1b47ab3ed7c3e" candidate_uuid: "595ece3316774e33930c4ef7923b8dc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5cd38daa04940ac97f9037e3241cdaf" is_pre_election: true
I20260709 12:28:21.902431 19151 raft_consensus.cc:2468] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 595ece3316774e33930c4ef7923b8dc1 in term 0.
I20260709 12:28:21.903187 19350 leader_election.cc:290] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P 595ece3316774e33930c4ef7923b8dc1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65:42503), ecd798a306df4905858bf774b6cd98f3 (127.9.116.67:37403)
I20260709 12:28:21.889994 19340 raft_consensus.cc:385] T 584e9788383444ce82092f41f1749c44 P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:21.904196 19191 leader_election.cc:304] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P 595ece3316774e33930c4ef7923b8dc1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 595ece3316774e33930c4ef7923b8dc1, a5cd38daa04940ac97f9037e3241cdaf; no voters: 
I20260709 12:28:21.904425 19340 raft_consensus.cc:740] T 584e9788383444ce82092f41f1749c44 P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5cd38daa04940ac97f9037e3241cdaf, State: Initialized, Role: FOLLOWER
I20260709 12:28:21.902419 19300 raft_consensus.cc:2468] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 595ece3316774e33930c4ef7923b8dc1 in term 0.
I20260709 12:28:21.905366 19226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d28b53dbf34d0b94a1b47ab3ed7c3e" candidate_uuid: "ecd798a306df4905858bf774b6cd98f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "595ece3316774e33930c4ef7923b8dc1" is_pre_election: true
I20260709 12:28:21.902825 19351 leader_election.cc:290] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P ecd798a306df4905858bf774b6cd98f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65:42503), 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66:37433)
I20260709 12:28:21.905848 19350 raft_consensus.cc:2804] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:21.912853 19226 raft_consensus.cc:2468] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd798a306df4905858bf774b6cd98f3 in term 0.
I20260709 12:28:21.916393 19266 leader_election.cc:304] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P ecd798a306df4905858bf774b6cd98f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 595ece3316774e33930c4ef7923b8dc1, ecd798a306df4905858bf774b6cd98f3; no voters: 
I20260709 12:28:21.906952 19151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d28b53dbf34d0b94a1b47ab3ed7c3e" candidate_uuid: "ecd798a306df4905858bf774b6cd98f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5cd38daa04940ac97f9037e3241cdaf" is_pre_election: true
I20260709 12:28:21.918041 19227 raft_consensus.cc:2468] T c542a19e01724e1982bf9694078796f3 P 595ece3316774e33930c4ef7923b8dc1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5cd38daa04940ac97f9037e3241cdaf in term 1.
I20260709 12:28:21.918254 19151 raft_consensus.cc:2468] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd798a306df4905858bf774b6cd98f3 in term 0.
I20260709 12:28:21.919248 19351 raft_consensus.cc:2804] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:21.919720 19351 raft_consensus.cc:493] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:21.919636 19117 leader_election.cc:304] T c542a19e01724e1982bf9694078796f3 P a5cd38daa04940ac97f9037e3241cdaf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 595ece3316774e33930c4ef7923b8dc1, a5cd38daa04940ac97f9037e3241cdaf; no voters: ecd798a306df4905858bf774b6cd98f3
I20260709 12:28:21.920281 19351 raft_consensus.cc:3060] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:21.920801 19359 raft_consensus.cc:2804] T c542a19e01724e1982bf9694078796f3 P a5cd38daa04940ac97f9037e3241cdaf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:21.921661 19359 raft_consensus.cc:697] T c542a19e01724e1982bf9694078796f3 P a5cd38daa04940ac97f9037e3241cdaf [term 1 LEADER]: Becoming Leader. State: Replica: a5cd38daa04940ac97f9037e3241cdaf, State: Running, Role: LEADER
I20260709 12:28:21.923156 19359 consensus_queue.cc:237] T c542a19e01724e1982bf9694078796f3 P a5cd38daa04940ac97f9037e3241cdaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:21.916371 19350 raft_consensus.cc:493] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:21.924834 19350 raft_consensus.cc:3060] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:21.905930 19340 consensus_queue.cc:260] T 584e9788383444ce82092f41f1749c44 P a5cd38daa04940ac97f9037e3241cdaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:21.929960 19351 raft_consensus.cc:515] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P ecd798a306df4905858bf774b6cd98f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } }
I20260709 12:28:21.933565 19151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d28b53dbf34d0b94a1b47ab3ed7c3e" candidate_uuid: "ecd798a306df4905858bf774b6cd98f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5cd38daa04940ac97f9037e3241cdaf"
I20260709 12:28:21.933621 19340 ts_tablet_manager.cc:1434] T 584e9788383444ce82092f41f1749c44 P a5cd38daa04940ac97f9037e3241cdaf: Time spent starting tablet: real 0.050s	user 0.008s	sys 0.006s
I20260709 12:28:21.934283 19151 raft_consensus.cc:3060] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:21.934283 19350 raft_consensus.cc:515] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P 595ece3316774e33930c4ef7923b8dc1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } }
I20260709 12:28:21.937269 19350 leader_election.cc:290] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P 595ece3316774e33930c4ef7923b8dc1 [CANDIDATE]: Term 1 election: Requested vote from peers a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65:42503), ecd798a306df4905858bf774b6cd98f3 (127.9.116.67:37403)
I20260709 12:28:21.938598 19152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d28b53dbf34d0b94a1b47ab3ed7c3e" candidate_uuid: "595ece3316774e33930c4ef7923b8dc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5cd38daa04940ac97f9037e3241cdaf"
I20260709 12:28:21.939664 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d28b53dbf34d0b94a1b47ab3ed7c3e" candidate_uuid: "595ece3316774e33930c4ef7923b8dc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd798a306df4905858bf774b6cd98f3"
I20260709 12:28:21.941080 19300 raft_consensus.cc:2393] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P ecd798a306df4905858bf774b6cd98f3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 595ece3316774e33930c4ef7923b8dc1 in current term 1: Already voted for candidate ecd798a306df4905858bf774b6cd98f3 in this term.
I20260709 12:28:21.941980 19340 tablet_bootstrap.cc:492] T c783b6e59edb46c4976d6b2117292201 P a5cd38daa04940ac97f9037e3241cdaf: Bootstrap starting.
I20260709 12:28:21.942071 19342 tablet_bootstrap.cc:492] T 9150dab4dcbc4945994ab3f7090326b5 P 595ece3316774e33930c4ef7923b8dc1: No bootstrap required, opened a new log
I20260709 12:28:21.942677 19342 ts_tablet_manager.cc:1403] T 9150dab4dcbc4945994ab3f7090326b5 P 595ece3316774e33930c4ef7923b8dc1: Time spent bootstrapping tablet: real 0.102s	user 0.030s	sys 0.043s
I20260709 12:28:21.944207 19191 leader_election.cc:304] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P 595ece3316774e33930c4ef7923b8dc1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 595ece3316774e33930c4ef7923b8dc1; no voters: a5cd38daa04940ac97f9037e3241cdaf, ecd798a306df4905858bf774b6cd98f3
I20260709 12:28:21.946007 19342 raft_consensus.cc:359] T 9150dab4dcbc4945994ab3f7090326b5 P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:21.946941 19342 raft_consensus.cc:385] T 9150dab4dcbc4945994ab3f7090326b5 P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:21.947278 19342 raft_consensus.cc:740] T 9150dab4dcbc4945994ab3f7090326b5 P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 595ece3316774e33930c4ef7923b8dc1, State: Initialized, Role: FOLLOWER
I20260709 12:28:21.949144 19340 tablet_bootstrap.cc:654] T c783b6e59edb46c4976d6b2117292201 P a5cd38daa04940ac97f9037e3241cdaf: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:21.948899 19342 consensus_queue.cc:260] T 9150dab4dcbc4945994ab3f7090326b5 P 595ece3316774e33930c4ef7923b8dc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:21.949914 19351 leader_election.cc:290] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P ecd798a306df4905858bf774b6cd98f3 [CANDIDATE]: Term 1 election: Requested vote from peers a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65:42503), 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66:37433)
I20260709 12:28:21.950129 19227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d28b53dbf34d0b94a1b47ab3ed7c3e" candidate_uuid: "ecd798a306df4905858bf774b6cd98f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "595ece3316774e33930c4ef7923b8dc1"
I20260709 12:28:21.950985 19227 raft_consensus.cc:2393] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P 595ece3316774e33930c4ef7923b8dc1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ecd798a306df4905858bf774b6cd98f3 in current term 1: Already voted for candidate 595ece3316774e33930c4ef7923b8dc1 in this term.
I20260709 12:28:21.951769 19362 raft_consensus.cc:2749] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P 595ece3316774e33930c4ef7923b8dc1 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:28:21.951969 19342 ts_tablet_manager.cc:1434] T 9150dab4dcbc4945994ab3f7090326b5 P 595ece3316774e33930c4ef7923b8dc1: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:28:21.952730 19343 tablet_bootstrap.cc:492] T c511fe69a84144d2ad2e090cc6766ffc P ecd798a306df4905858bf774b6cd98f3: No bootstrap required, opened a new log
I20260709 12:28:21.953291 19343 ts_tablet_manager.cc:1403] T c511fe69a84144d2ad2e090cc6766ffc P ecd798a306df4905858bf774b6cd98f3: Time spent bootstrapping tablet: real 0.094s	user 0.027s	sys 0.023s
I20260709 12:28:21.953837 19342 tablet_bootstrap.cc:492] T 22e532f746f14300aac7e6240a0e18bd P 595ece3316774e33930c4ef7923b8dc1: Bootstrap starting.
I20260709 12:28:21.956589 19343 raft_consensus.cc:359] T c511fe69a84144d2ad2e090cc6766ffc P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:21.957420 19343 raft_consensus.cc:385] T c511fe69a84144d2ad2e090cc6766ffc P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:21.957716 19343 raft_consensus.cc:740] T c511fe69a84144d2ad2e090cc6766ffc P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd798a306df4905858bf774b6cd98f3, State: Initialized, Role: FOLLOWER
I20260709 12:28:21.947743 19151 raft_consensus.cc:2468] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P a5cd38daa04940ac97f9037e3241cdaf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd798a306df4905858bf774b6cd98f3 in term 1.
I20260709 12:28:21.959336 19265 leader_election.cc:304] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P ecd798a306df4905858bf774b6cd98f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a5cd38daa04940ac97f9037e3241cdaf, ecd798a306df4905858bf774b6cd98f3; no voters: 595ece3316774e33930c4ef7923b8dc1
I20260709 12:28:21.960490 19363 raft_consensus.cc:2804] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P ecd798a306df4905858bf774b6cd98f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:21.961133 19363 raft_consensus.cc:697] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P ecd798a306df4905858bf774b6cd98f3 [term 1 LEADER]: Becoming Leader. State: Replica: ecd798a306df4905858bf774b6cd98f3, State: Running, Role: LEADER
I20260709 12:28:21.948578 19046 catalog_manager.cc:5697] T c542a19e01724e1982bf9694078796f3 P a5cd38daa04940ac97f9037e3241cdaf reported cstate change: term changed from 0 to 1, leader changed from <none> to a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65). New cstate: current_term: 1 leader_uuid: "a5cd38daa04940ac97f9037e3241cdaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:21.961964 19343 consensus_queue.cc:260] T c511fe69a84144d2ad2e090cc6766ffc P ecd798a306df4905858bf774b6cd98f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:21.962073 19363 consensus_queue.cc:237] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P ecd798a306df4905858bf774b6cd98f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } }
I20260709 12:28:21.963105 19342 tablet_bootstrap.cc:654] T 22e532f746f14300aac7e6240a0e18bd P 595ece3316774e33930c4ef7923b8dc1: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:21.965281 19343 ts_tablet_manager.cc:1434] T c511fe69a84144d2ad2e090cc6766ffc P ecd798a306df4905858bf774b6cd98f3: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:28:21.966535 19343 tablet_bootstrap.cc:492] T f4a87e357d584a3b925af9c5d05e2ab6 P ecd798a306df4905858bf774b6cd98f3: Bootstrap starting.
I20260709 12:28:21.975019 19343 tablet_bootstrap.cc:654] T f4a87e357d584a3b925af9c5d05e2ab6 P ecd798a306df4905858bf774b6cd98f3: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:21.983628 19050 catalog_manager.cc:5697] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P ecd798a306df4905858bf774b6cd98f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to ecd798a306df4905858bf774b6cd98f3 (127.9.116.67). New cstate: current_term: 1 leader_uuid: "ecd798a306df4905858bf774b6cd98f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:21.991699 19342 tablet_bootstrap.cc:492] T 22e532f746f14300aac7e6240a0e18bd P 595ece3316774e33930c4ef7923b8dc1: No bootstrap required, opened a new log
I20260709 12:28:21.992357 19342 ts_tablet_manager.cc:1403] T 22e532f746f14300aac7e6240a0e18bd P 595ece3316774e33930c4ef7923b8dc1: Time spent bootstrapping tablet: real 0.039s	user 0.015s	sys 0.023s
I20260709 12:28:21.996308 19342 raft_consensus.cc:359] T 22e532f746f14300aac7e6240a0e18bd P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:21.997287 19342 raft_consensus.cc:385] T 22e532f746f14300aac7e6240a0e18bd P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:21.997594 19342 raft_consensus.cc:740] T 22e532f746f14300aac7e6240a0e18bd P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 595ece3316774e33930c4ef7923b8dc1, State: Initialized, Role: FOLLOWER
I20260709 12:28:21.998425 19359 raft_consensus.cc:493] T f4a87e357d584a3b925af9c5d05e2ab6 P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:21.998560 19342 consensus_queue.cc:260] T 22e532f746f14300aac7e6240a0e18bd P 595ece3316774e33930c4ef7923b8dc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:21.999310 19359 raft_consensus.cc:515] T f4a87e357d584a3b925af9c5d05e2ab6 P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:22.001219 19342 ts_tablet_manager.cc:1434] T 22e532f746f14300aac7e6240a0e18bd P 595ece3316774e33930c4ef7923b8dc1: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:28:22.002275 19342 tablet_bootstrap.cc:492] T f4a87e357d584a3b925af9c5d05e2ab6 P 595ece3316774e33930c4ef7923b8dc1: Bootstrap starting.
I20260709 12:28:22.002652 19344 raft_consensus.cc:493] T 489fca1a81224008bc8b8e01b86bab9a P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:22.002764 19227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a87e357d584a3b925af9c5d05e2ab6" candidate_uuid: "a5cd38daa04940ac97f9037e3241cdaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "595ece3316774e33930c4ef7923b8dc1" is_pre_election: true
I20260709 12:28:22.003526 19344 raft_consensus.cc:515] T 489fca1a81224008bc8b8e01b86bab9a P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
W20260709 12:28:22.007634 19117 leader_election.cc:343] T f4a87e357d584a3b925af9c5d05e2ab6 P a5cd38daa04940ac97f9037e3241cdaf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66:37433): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:22.008837 19359 leader_election.cc:290] T f4a87e357d584a3b925af9c5d05e2ab6 P a5cd38daa04940ac97f9037e3241cdaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66:37433), ecd798a306df4905858bf774b6cd98f3 (127.9.116.67:37403)
I20260709 12:28:22.010515 19342 tablet_bootstrap.cc:654] T f4a87e357d584a3b925af9c5d05e2ab6 P 595ece3316774e33930c4ef7923b8dc1: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:22.011474 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a87e357d584a3b925af9c5d05e2ab6" candidate_uuid: "a5cd38daa04940ac97f9037e3241cdaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd798a306df4905858bf774b6cd98f3" is_pre_election: true
I20260709 12:28:22.012220 19227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489fca1a81224008bc8b8e01b86bab9a" candidate_uuid: "a5cd38daa04940ac97f9037e3241cdaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "595ece3316774e33930c4ef7923b8dc1" is_pre_election: true
W20260709 12:28:22.013756 19117 leader_election.cc:343] T f4a87e357d584a3b925af9c5d05e2ab6 P a5cd38daa04940ac97f9037e3241cdaf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecd798a306df4905858bf774b6cd98f3 (127.9.116.67:37403): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:22.014304 19117 leader_election.cc:304] T f4a87e357d584a3b925af9c5d05e2ab6 P a5cd38daa04940ac97f9037e3241cdaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a5cd38daa04940ac97f9037e3241cdaf; no voters: 595ece3316774e33930c4ef7923b8dc1, ecd798a306df4905858bf774b6cd98f3
I20260709 12:28:22.014938 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489fca1a81224008bc8b8e01b86bab9a" candidate_uuid: "a5cd38daa04940ac97f9037e3241cdaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd798a306df4905858bf774b6cd98f3" is_pre_election: true
I20260709 12:28:22.015782 19300 raft_consensus.cc:2468] T 489fca1a81224008bc8b8e01b86bab9a P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a5cd38daa04940ac97f9037e3241cdaf in term 0.
W20260709 12:28:22.016050 19117 leader_election.cc:343] T 489fca1a81224008bc8b8e01b86bab9a P a5cd38daa04940ac97f9037e3241cdaf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66:37433): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:22.012629 19344 leader_election.cc:290] T 489fca1a81224008bc8b8e01b86bab9a P a5cd38daa04940ac97f9037e3241cdaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66:37433), ecd798a306df4905858bf774b6cd98f3 (127.9.116.67:37403)
I20260709 12:28:22.016986 19344 raft_consensus.cc:2749] T f4a87e357d584a3b925af9c5d05e2ab6 P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:22.018076 19117 leader_election.cc:304] T 489fca1a81224008bc8b8e01b86bab9a P a5cd38daa04940ac97f9037e3241cdaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a5cd38daa04940ac97f9037e3241cdaf, ecd798a306df4905858bf774b6cd98f3; no voters: 595ece3316774e33930c4ef7923b8dc1
I20260709 12:28:22.019042 19343 tablet_bootstrap.cc:492] T f4a87e357d584a3b925af9c5d05e2ab6 P ecd798a306df4905858bf774b6cd98f3: No bootstrap required, opened a new log
I20260709 12:28:22.019459 19344 raft_consensus.cc:2804] T 489fca1a81224008bc8b8e01b86bab9a P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:22.019683 19343 ts_tablet_manager.cc:1403] T f4a87e357d584a3b925af9c5d05e2ab6 P ecd798a306df4905858bf774b6cd98f3: Time spent bootstrapping tablet: real 0.053s	user 0.008s	sys 0.012s
I20260709 12:28:22.019966 19344 raft_consensus.cc:493] T 489fca1a81224008bc8b8e01b86bab9a P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:22.020380 19344 raft_consensus.cc:3060] T 489fca1a81224008bc8b8e01b86bab9a P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:22.023339 19343 raft_consensus.cc:359] T f4a87e357d584a3b925af9c5d05e2ab6 P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:22.024551 19343 raft_consensus.cc:385] T f4a87e357d584a3b925af9c5d05e2ab6 P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:22.024891 19343 raft_consensus.cc:740] T f4a87e357d584a3b925af9c5d05e2ab6 P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd798a306df4905858bf774b6cd98f3, State: Initialized, Role: FOLLOWER
I20260709 12:28:22.026095 19343 consensus_queue.cc:260] T f4a87e357d584a3b925af9c5d05e2ab6 P ecd798a306df4905858bf774b6cd98f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:22.034266 19343 ts_tablet_manager.cc:1434] T f4a87e357d584a3b925af9c5d05e2ab6 P ecd798a306df4905858bf774b6cd98f3: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.001s
I20260709 12:28:22.039691 19344 raft_consensus.cc:515] T 489fca1a81224008bc8b8e01b86bab9a P a5cd38daa04940ac97f9037e3241cdaf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:22.041500 19342 tablet_bootstrap.cc:492] T f4a87e357d584a3b925af9c5d05e2ab6 P 595ece3316774e33930c4ef7923b8dc1: No bootstrap required, opened a new log
I20260709 12:28:22.042160 19342 ts_tablet_manager.cc:1403] T f4a87e357d584a3b925af9c5d05e2ab6 P 595ece3316774e33930c4ef7923b8dc1: Time spent bootstrapping tablet: real 0.040s	user 0.016s	sys 0.011s
I20260709 12:28:22.042479 19344 leader_election.cc:290] T 489fca1a81224008bc8b8e01b86bab9a P a5cd38daa04940ac97f9037e3241cdaf [CANDIDATE]: Term 1 election: Requested vote from peers 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66:37433), ecd798a306df4905858bf774b6cd98f3 (127.9.116.67:37403)
I20260709 12:28:22.045250 19343 tablet_bootstrap.cc:492] T c783b6e59edb46c4976d6b2117292201 P ecd798a306df4905858bf774b6cd98f3: Bootstrap starting.
I20260709 12:28:22.046041 19342 raft_consensus.cc:359] T f4a87e357d584a3b925af9c5d05e2ab6 P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:22.047220 19342 raft_consensus.cc:385] T f4a87e357d584a3b925af9c5d05e2ab6 P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:22.046377 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489fca1a81224008bc8b8e01b86bab9a" candidate_uuid: "a5cd38daa04940ac97f9037e3241cdaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd798a306df4905858bf774b6cd98f3"
I20260709 12:28:22.047693 19342 raft_consensus.cc:740] T f4a87e357d584a3b925af9c5d05e2ab6 P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 595ece3316774e33930c4ef7923b8dc1, State: Initialized, Role: FOLLOWER
I20260709 12:28:22.048058 19300 raft_consensus.cc:3060] T 489fca1a81224008bc8b8e01b86bab9a P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:22.048630 19342 consensus_queue.cc:260] T f4a87e357d584a3b925af9c5d05e2ab6 P 595ece3316774e33930c4ef7923b8dc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:22.045495 19227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489fca1a81224008bc8b8e01b86bab9a" candidate_uuid: "a5cd38daa04940ac97f9037e3241cdaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "595ece3316774e33930c4ef7923b8dc1"
I20260709 12:28:22.052181 19342 ts_tablet_manager.cc:1434] T f4a87e357d584a3b925af9c5d05e2ab6 P 595ece3316774e33930c4ef7923b8dc1: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.002s
I20260709 12:28:22.053709 19342 tablet_bootstrap.cc:492] T 584e9788383444ce82092f41f1749c44 P 595ece3316774e33930c4ef7923b8dc1: Bootstrap starting.
I20260709 12:28:22.056007 19343 tablet_bootstrap.cc:654] T c783b6e59edb46c4976d6b2117292201 P ecd798a306df4905858bf774b6cd98f3: Neither blocks nor log segments found. Creating new log.
W20260709 12:28:22.057698 19117 leader_election.cc:343] T 489fca1a81224008bc8b8e01b86bab9a P a5cd38daa04940ac97f9037e3241cdaf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66:37433): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:22.059744 19300 raft_consensus.cc:2468] T 489fca1a81224008bc8b8e01b86bab9a P ecd798a306df4905858bf774b6cd98f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5cd38daa04940ac97f9037e3241cdaf in term 1.
I20260709 12:28:22.061127 19117 leader_election.cc:304] T 489fca1a81224008bc8b8e01b86bab9a P a5cd38daa04940ac97f9037e3241cdaf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a5cd38daa04940ac97f9037e3241cdaf, ecd798a306df4905858bf774b6cd98f3; no voters: 595ece3316774e33930c4ef7923b8dc1
I20260709 12:28:22.061767 19342 tablet_bootstrap.cc:654] T 584e9788383444ce82092f41f1749c44 P 595ece3316774e33930c4ef7923b8dc1: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:22.062381 19344 raft_consensus.cc:2804] T 489fca1a81224008bc8b8e01b86bab9a P a5cd38daa04940ac97f9037e3241cdaf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:22.062956 19344 raft_consensus.cc:697] T 489fca1a81224008bc8b8e01b86bab9a P a5cd38daa04940ac97f9037e3241cdaf [term 1 LEADER]: Becoming Leader. State: Replica: a5cd38daa04940ac97f9037e3241cdaf, State: Running, Role: LEADER
I20260709 12:28:22.064025 19344 consensus_queue.cc:237] T 489fca1a81224008bc8b8e01b86bab9a P a5cd38daa04940ac97f9037e3241cdaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:22.070962 19340 tablet_bootstrap.cc:492] T c783b6e59edb46c4976d6b2117292201 P a5cd38daa04940ac97f9037e3241cdaf: No bootstrap required, opened a new log
I20260709 12:28:22.072484 19340 ts_tablet_manager.cc:1403] T c783b6e59edb46c4976d6b2117292201 P a5cd38daa04940ac97f9037e3241cdaf: Time spent bootstrapping tablet: real 0.131s	user 0.038s	sys 0.031s
I20260709 12:28:22.075686 19340 raft_consensus.cc:359] T c783b6e59edb46c4976d6b2117292201 P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:22.076923 19342 tablet_bootstrap.cc:492] T 584e9788383444ce82092f41f1749c44 P 595ece3316774e33930c4ef7923b8dc1: No bootstrap required, opened a new log
I20260709 12:28:22.072516 19343 tablet_bootstrap.cc:492] T c783b6e59edb46c4976d6b2117292201 P ecd798a306df4905858bf774b6cd98f3: No bootstrap required, opened a new log
I20260709 12:28:22.077894 19342 ts_tablet_manager.cc:1403] T 584e9788383444ce82092f41f1749c44 P 595ece3316774e33930c4ef7923b8dc1: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.012s
I20260709 12:28:22.078197 19343 ts_tablet_manager.cc:1403] T c783b6e59edb46c4976d6b2117292201 P ecd798a306df4905858bf774b6cd98f3: Time spent bootstrapping tablet: real 0.033s	user 0.011s	sys 0.013s
I20260709 12:28:22.076920 19340 raft_consensus.cc:385] T c783b6e59edb46c4976d6b2117292201 P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:22.079900 19340 raft_consensus.cc:740] T c783b6e59edb46c4976d6b2117292201 P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5cd38daa04940ac97f9037e3241cdaf, State: Initialized, Role: FOLLOWER
I20260709 12:28:22.080765 19340 consensus_queue.cc:260] T c783b6e59edb46c4976d6b2117292201 P a5cd38daa04940ac97f9037e3241cdaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:22.081756 19342 raft_consensus.cc:359] T 584e9788383444ce82092f41f1749c44 P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:22.082088 19343 raft_consensus.cc:359] T c783b6e59edb46c4976d6b2117292201 P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:22.082574 19342 raft_consensus.cc:385] T 584e9788383444ce82092f41f1749c44 P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:22.082886 19340 ts_tablet_manager.cc:1434] T c783b6e59edb46c4976d6b2117292201 P a5cd38daa04940ac97f9037e3241cdaf: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 12:28:22.083034 19342 raft_consensus.cc:740] T 584e9788383444ce82092f41f1749c44 P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 595ece3316774e33930c4ef7923b8dc1, State: Initialized, Role: FOLLOWER
I20260709 12:28:22.082909 19343 raft_consensus.cc:385] T c783b6e59edb46c4976d6b2117292201 P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:22.082494 19048 catalog_manager.cc:5697] T 489fca1a81224008bc8b8e01b86bab9a P a5cd38daa04940ac97f9037e3241cdaf reported cstate change: term changed from 0 to 1, leader changed from <none> to a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65). New cstate: current_term: 1 leader_uuid: "a5cd38daa04940ac97f9037e3241cdaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:22.083990 19343 raft_consensus.cc:740] T c783b6e59edb46c4976d6b2117292201 P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd798a306df4905858bf774b6cd98f3, State: Initialized, Role: FOLLOWER
I20260709 12:28:22.084194 19340 tablet_bootstrap.cc:492] T 22e532f746f14300aac7e6240a0e18bd P a5cd38daa04940ac97f9037e3241cdaf: Bootstrap starting.
I20260709 12:28:22.084113 19342 consensus_queue.cc:260] T 584e9788383444ce82092f41f1749c44 P 595ece3316774e33930c4ef7923b8dc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:22.085520 19343 consensus_queue.cc:260] T c783b6e59edb46c4976d6b2117292201 P ecd798a306df4905858bf774b6cd98f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:22.092409 19343 ts_tablet_manager.cc:1434] T c783b6e59edb46c4976d6b2117292201 P ecd798a306df4905858bf774b6cd98f3: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:28:22.093852 19343 tablet_bootstrap.cc:492] T 22e532f746f14300aac7e6240a0e18bd P ecd798a306df4905858bf774b6cd98f3: Bootstrap starting.
I20260709 12:28:22.094791 19342 ts_tablet_manager.cc:1434] T 584e9788383444ce82092f41f1749c44 P 595ece3316774e33930c4ef7923b8dc1: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 12:28:22.096438 19342 tablet_bootstrap.cc:492] T c783b6e59edb46c4976d6b2117292201 P 595ece3316774e33930c4ef7923b8dc1: Bootstrap starting.
I20260709 12:28:22.092880 19340 tablet_bootstrap.cc:654] T 22e532f746f14300aac7e6240a0e18bd P a5cd38daa04940ac97f9037e3241cdaf: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:22.102901 19343 tablet_bootstrap.cc:654] T 22e532f746f14300aac7e6240a0e18bd P ecd798a306df4905858bf774b6cd98f3: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:22.106117 19342 tablet_bootstrap.cc:654] T c783b6e59edb46c4976d6b2117292201 P 595ece3316774e33930c4ef7923b8dc1: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:22.106815 19227 raft_consensus.cc:3060] T 9150dab4dcbc4945994ab3f7090326b5 P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:22.113363 19340 tablet_bootstrap.cc:492] T 22e532f746f14300aac7e6240a0e18bd P a5cd38daa04940ac97f9037e3241cdaf: No bootstrap required, opened a new log
I20260709 12:28:22.114220 19340 ts_tablet_manager.cc:1403] T 22e532f746f14300aac7e6240a0e18bd P a5cd38daa04940ac97f9037e3241cdaf: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.008s
I20260709 12:28:22.151425 19340 raft_consensus.cc:359] T 22e532f746f14300aac7e6240a0e18bd P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:22.152634 19340 raft_consensus.cc:385] T 22e532f746f14300aac7e6240a0e18bd P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:22.153393 19340 raft_consensus.cc:740] T 22e532f746f14300aac7e6240a0e18bd P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5cd38daa04940ac97f9037e3241cdaf, State: Initialized, Role: FOLLOWER
I20260709 12:28:22.154706 19340 consensus_queue.cc:260] T 22e532f746f14300aac7e6240a0e18bd P a5cd38daa04940ac97f9037e3241cdaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:22.164984 19340 ts_tablet_manager.cc:1434] T 22e532f746f14300aac7e6240a0e18bd P a5cd38daa04940ac97f9037e3241cdaf: Time spent starting tablet: real 0.050s	user 0.013s	sys 0.000s
I20260709 12:28:22.166599 19342 tablet_bootstrap.cc:492] T c783b6e59edb46c4976d6b2117292201 P 595ece3316774e33930c4ef7923b8dc1: No bootstrap required, opened a new log
I20260709 12:28:22.167265 19342 ts_tablet_manager.cc:1403] T c783b6e59edb46c4976d6b2117292201 P 595ece3316774e33930c4ef7923b8dc1: Time spent bootstrapping tablet: real 0.071s	user 0.020s	sys 0.042s
I20260709 12:28:22.170498 19342 raft_consensus.cc:359] T c783b6e59edb46c4976d6b2117292201 P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:22.171253 19342 raft_consensus.cc:385] T c783b6e59edb46c4976d6b2117292201 P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:22.171242 19343 tablet_bootstrap.cc:492] T 22e532f746f14300aac7e6240a0e18bd P ecd798a306df4905858bf774b6cd98f3: No bootstrap required, opened a new log
I20260709 12:28:22.171767 19342 raft_consensus.cc:740] T c783b6e59edb46c4976d6b2117292201 P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 595ece3316774e33930c4ef7923b8dc1, State: Initialized, Role: FOLLOWER
I20260709 12:28:22.172250 19343 ts_tablet_manager.cc:1403] T 22e532f746f14300aac7e6240a0e18bd P ecd798a306df4905858bf774b6cd98f3: Time spent bootstrapping tablet: real 0.079s	user 0.032s	sys 0.044s
I20260709 12:28:22.172739 19342 consensus_queue.cc:260] T c783b6e59edb46c4976d6b2117292201 P 595ece3316774e33930c4ef7923b8dc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:22.175354 19342 ts_tablet_manager.cc:1434] T c783b6e59edb46c4976d6b2117292201 P 595ece3316774e33930c4ef7923b8dc1: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:28:22.175741 19343 raft_consensus.cc:359] T 22e532f746f14300aac7e6240a0e18bd P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:22.176375 19342 tablet_bootstrap.cc:492] T 489fca1a81224008bc8b8e01b86bab9a P 595ece3316774e33930c4ef7923b8dc1: Bootstrap starting.
I20260709 12:28:22.176553 19343 raft_consensus.cc:385] T 22e532f746f14300aac7e6240a0e18bd P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:22.176949 19343 raft_consensus.cc:740] T 22e532f746f14300aac7e6240a0e18bd P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd798a306df4905858bf774b6cd98f3, State: Initialized, Role: FOLLOWER
I20260709 12:28:22.177722 19343 consensus_queue.cc:260] T 22e532f746f14300aac7e6240a0e18bd P ecd798a306df4905858bf774b6cd98f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:22.179816 19343 ts_tablet_manager.cc:1434] T 22e532f746f14300aac7e6240a0e18bd P ecd798a306df4905858bf774b6cd98f3: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:28:22.180788 19343 tablet_bootstrap.cc:492] T c542a19e01724e1982bf9694078796f3 P ecd798a306df4905858bf774b6cd98f3: Bootstrap starting.
I20260709 12:28:22.183529 19342 tablet_bootstrap.cc:654] T 489fca1a81224008bc8b8e01b86bab9a P 595ece3316774e33930c4ef7923b8dc1: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:22.186422 19343 tablet_bootstrap.cc:654] T c542a19e01724e1982bf9694078796f3 P ecd798a306df4905858bf774b6cd98f3: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:22.194715 19342 tablet_bootstrap.cc:492] T 489fca1a81224008bc8b8e01b86bab9a P 595ece3316774e33930c4ef7923b8dc1: No bootstrap required, opened a new log
I20260709 12:28:22.195277 19342 ts_tablet_manager.cc:1403] T 489fca1a81224008bc8b8e01b86bab9a P 595ece3316774e33930c4ef7923b8dc1: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.003s
I20260709 12:28:22.198124 19342 raft_consensus.cc:359] T 489fca1a81224008bc8b8e01b86bab9a P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:22.198869 19342 raft_consensus.cc:385] T 489fca1a81224008bc8b8e01b86bab9a P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:22.199151 19342 raft_consensus.cc:740] T 489fca1a81224008bc8b8e01b86bab9a P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 595ece3316774e33930c4ef7923b8dc1, State: Initialized, Role: FOLLOWER
I20260709 12:28:22.199867 19342 consensus_queue.cc:260] T 489fca1a81224008bc8b8e01b86bab9a P 595ece3316774e33930c4ef7923b8dc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:22.203802 19344 consensus_queue.cc:1048] T 9150dab4dcbc4945994ab3f7090326b5 P a5cd38daa04940ac97f9037e3241cdaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:22.205821 19342 ts_tablet_manager.cc:1434] T 489fca1a81224008bc8b8e01b86bab9a P 595ece3316774e33930c4ef7923b8dc1: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 12:28:22.212512 19343 tablet_bootstrap.cc:492] T c542a19e01724e1982bf9694078796f3 P ecd798a306df4905858bf774b6cd98f3: No bootstrap required, opened a new log
I20260709 12:28:22.213155 19343 ts_tablet_manager.cc:1403] T c542a19e01724e1982bf9694078796f3 P ecd798a306df4905858bf774b6cd98f3: Time spent bootstrapping tablet: real 0.033s	user 0.008s	sys 0.019s
I20260709 12:28:22.216329 19343 raft_consensus.cc:359] T c542a19e01724e1982bf9694078796f3 P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:22.217048 19343 raft_consensus.cc:385] T c542a19e01724e1982bf9694078796f3 P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:22.217303 19343 raft_consensus.cc:740] T c542a19e01724e1982bf9694078796f3 P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd798a306df4905858bf774b6cd98f3, State: Initialized, Role: FOLLOWER
I20260709 12:28:22.218031 19343 consensus_queue.cc:260] T c542a19e01724e1982bf9694078796f3 P ecd798a306df4905858bf774b6cd98f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:22.220460 19343 ts_tablet_manager.cc:1434] T c542a19e01724e1982bf9694078796f3 P ecd798a306df4905858bf774b6cd98f3: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 12:28:22.227856 19359 raft_consensus.cc:493] T 584e9788383444ce82092f41f1749c44 P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:22.228674 19359 raft_consensus.cc:515] T 584e9788383444ce82092f41f1749c44 P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:22.234936 19344 consensus_queue.cc:1048] T 9150dab4dcbc4945994ab3f7090326b5 P a5cd38daa04940ac97f9037e3241cdaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:22.235651 19227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584e9788383444ce82092f41f1749c44" candidate_uuid: "a5cd38daa04940ac97f9037e3241cdaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "595ece3316774e33930c4ef7923b8dc1" is_pre_election: true
I20260709 12:28:22.236629 19227 raft_consensus.cc:2468] T 584e9788383444ce82092f41f1749c44 P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a5cd38daa04940ac97f9037e3241cdaf in term 0.
I20260709 12:28:22.241881 19359 leader_election.cc:290] T 584e9788383444ce82092f41f1749c44 P a5cd38daa04940ac97f9037e3241cdaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66:37433), ecd798a306df4905858bf774b6cd98f3 (127.9.116.67:37403)
I20260709 12:28:22.243285 19301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584e9788383444ce82092f41f1749c44" candidate_uuid: "a5cd38daa04940ac97f9037e3241cdaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd798a306df4905858bf774b6cd98f3" is_pre_election: true
I20260709 12:28:22.244240 19301 raft_consensus.cc:2468] T 584e9788383444ce82092f41f1749c44 P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a5cd38daa04940ac97f9037e3241cdaf in term 0.
I20260709 12:28:22.244108 19117 leader_election.cc:304] T 584e9788383444ce82092f41f1749c44 P a5cd38daa04940ac97f9037e3241cdaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 595ece3316774e33930c4ef7923b8dc1, a5cd38daa04940ac97f9037e3241cdaf; no voters: 
I20260709 12:28:22.246161 19359 raft_consensus.cc:2804] T 584e9788383444ce82092f41f1749c44 P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:22.246615 19359 raft_consensus.cc:493] T 584e9788383444ce82092f41f1749c44 P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:22.247166 19363 raft_consensus.cc:493] T f4a87e357d584a3b925af9c5d05e2ab6 P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:22.247318 19359 raft_consensus.cc:3060] T 584e9788383444ce82092f41f1749c44 P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:22.247846 19363 raft_consensus.cc:515] T f4a87e357d584a3b925af9c5d05e2ab6 P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:22.249030 19301 raft_consensus.cc:3060] T c511fe69a84144d2ad2e090cc6766ffc P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:22.250134 19363 leader_election.cc:290] T f4a87e357d584a3b925af9c5d05e2ab6 P ecd798a306df4905858bf774b6cd98f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65:42503), 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66:37433)
I20260709 12:28:22.251487 19350 raft_consensus.cc:493] T 489fca1a81224008bc8b8e01b86bab9a P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:22.252377 19350 raft_consensus.cc:515] T 489fca1a81224008bc8b8e01b86bab9a P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:22.254752 19151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a87e357d584a3b925af9c5d05e2ab6" candidate_uuid: "ecd798a306df4905858bf774b6cd98f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5cd38daa04940ac97f9037e3241cdaf" is_pre_election: true
I20260709 12:28:22.255668 19151 raft_consensus.cc:2468] T f4a87e357d584a3b925af9c5d05e2ab6 P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd798a306df4905858bf774b6cd98f3 in term 0.
I20260709 12:28:22.254987 19227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a87e357d584a3b925af9c5d05e2ab6" candidate_uuid: "ecd798a306df4905858bf774b6cd98f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "595ece3316774e33930c4ef7923b8dc1" is_pre_election: true
I20260709 12:28:22.256924 19227 raft_consensus.cc:2468] T f4a87e357d584a3b925af9c5d05e2ab6 P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd798a306df4905858bf774b6cd98f3 in term 0.
I20260709 12:28:22.258585 19266 leader_election.cc:304] T f4a87e357d584a3b925af9c5d05e2ab6 P ecd798a306df4905858bf774b6cd98f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 595ece3316774e33930c4ef7923b8dc1, ecd798a306df4905858bf774b6cd98f3; no voters: 
I20260709 12:28:22.259394 19363 raft_consensus.cc:2804] T f4a87e357d584a3b925af9c5d05e2ab6 P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:22.259886 19363 raft_consensus.cc:493] T f4a87e357d584a3b925af9c5d05e2ab6 P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:22.260305 19363 raft_consensus.cc:3060] T f4a87e357d584a3b925af9c5d05e2ab6 P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:22.260306 19362 consensus_queue.cc:1048] T c511fe69a84144d2ad2e090cc6766ffc P 595ece3316774e33930c4ef7923b8dc1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:22.262777 19344 raft_consensus.cc:493] T 22e532f746f14300aac7e6240a0e18bd P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:22.263337 19344 raft_consensus.cc:515] T 22e532f746f14300aac7e6240a0e18bd P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:22.266393 19344 leader_election.cc:290] T 22e532f746f14300aac7e6240a0e18bd P a5cd38daa04940ac97f9037e3241cdaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66:37433), ecd798a306df4905858bf774b6cd98f3 (127.9.116.67:37403)
I20260709 12:28:22.268748 19227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22e532f746f14300aac7e6240a0e18bd" candidate_uuid: "a5cd38daa04940ac97f9037e3241cdaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "595ece3316774e33930c4ef7923b8dc1" is_pre_election: true
I20260709 12:28:22.269822 19227 raft_consensus.cc:2468] T 22e532f746f14300aac7e6240a0e18bd P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a5cd38daa04940ac97f9037e3241cdaf in term 0.
I20260709 12:28:22.268746 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22e532f746f14300aac7e6240a0e18bd" candidate_uuid: "a5cd38daa04940ac97f9037e3241cdaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd798a306df4905858bf774b6cd98f3" is_pre_election: true
I20260709 12:28:22.271656 19299 raft_consensus.cc:2468] T 22e532f746f14300aac7e6240a0e18bd P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a5cd38daa04940ac97f9037e3241cdaf in term 0.
I20260709 12:28:22.273105 19117 leader_election.cc:304] T 22e532f746f14300aac7e6240a0e18bd P a5cd38daa04940ac97f9037e3241cdaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a5cd38daa04940ac97f9037e3241cdaf, ecd798a306df4905858bf774b6cd98f3; no voters: 
I20260709 12:28:22.274719 19350 leader_election.cc:290] T 489fca1a81224008bc8b8e01b86bab9a P 595ece3316774e33930c4ef7923b8dc1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65:42503), ecd798a306df4905858bf774b6cd98f3 (127.9.116.67:37403)
I20260709 12:28:22.275758 19151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489fca1a81224008bc8b8e01b86bab9a" candidate_uuid: "595ece3316774e33930c4ef7923b8dc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5cd38daa04940ac97f9037e3241cdaf" is_pre_election: true
I20260709 12:28:22.276171 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489fca1a81224008bc8b8e01b86bab9a" candidate_uuid: "595ece3316774e33930c4ef7923b8dc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd798a306df4905858bf774b6cd98f3" is_pre_election: true
I20260709 12:28:22.277508 19299 raft_consensus.cc:2393] T 489fca1a81224008bc8b8e01b86bab9a P ecd798a306df4905858bf774b6cd98f3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 595ece3316774e33930c4ef7923b8dc1 in current term 1: Already voted for candidate a5cd38daa04940ac97f9037e3241cdaf in this term.
I20260709 12:28:22.277421 19359 raft_consensus.cc:515] T 584e9788383444ce82092f41f1749c44 P a5cd38daa04940ac97f9037e3241cdaf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:22.278869 19192 leader_election.cc:304] T 489fca1a81224008bc8b8e01b86bab9a P 595ece3316774e33930c4ef7923b8dc1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 595ece3316774e33930c4ef7923b8dc1; no voters: a5cd38daa04940ac97f9037e3241cdaf, ecd798a306df4905858bf774b6cd98f3
I20260709 12:28:22.280120 19350 raft_consensus.cc:3060] T 489fca1a81224008bc8b8e01b86bab9a P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:22.279909 19363 raft_consensus.cc:515] T f4a87e357d584a3b925af9c5d05e2ab6 P ecd798a306df4905858bf774b6cd98f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:22.281242 19301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584e9788383444ce82092f41f1749c44" candidate_uuid: "a5cd38daa04940ac97f9037e3241cdaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd798a306df4905858bf774b6cd98f3"
I20260709 12:28:22.285431 19301 raft_consensus.cc:3060] T 584e9788383444ce82092f41f1749c44 P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:22.279918 19359 leader_election.cc:290] T 584e9788383444ce82092f41f1749c44 P a5cd38daa04940ac97f9037e3241cdaf [CANDIDATE]: Term 1 election: Requested vote from peers 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66:37433), ecd798a306df4905858bf774b6cd98f3 (127.9.116.67:37403)
I20260709 12:28:22.292009 19350 raft_consensus.cc:2749] T 489fca1a81224008bc8b8e01b86bab9a P 595ece3316774e33930c4ef7923b8dc1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:22.283178 19151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a87e357d584a3b925af9c5d05e2ab6" candidate_uuid: "ecd798a306df4905858bf774b6cd98f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5cd38daa04940ac97f9037e3241cdaf"
I20260709 12:28:22.293745 19151 raft_consensus.cc:3060] T f4a87e357d584a3b925af9c5d05e2ab6 P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:22.280284 19396 raft_consensus.cc:2804] T 22e532f746f14300aac7e6240a0e18bd P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:22.283941 19226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a87e357d584a3b925af9c5d05e2ab6" candidate_uuid: "ecd798a306df4905858bf774b6cd98f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "595ece3316774e33930c4ef7923b8dc1"
I20260709 12:28:22.284693 19227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584e9788383444ce82092f41f1749c44" candidate_uuid: "a5cd38daa04940ac97f9037e3241cdaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "595ece3316774e33930c4ef7923b8dc1"
I20260709 12:28:22.294622 19301 raft_consensus.cc:2468] T 584e9788383444ce82092f41f1749c44 P ecd798a306df4905858bf774b6cd98f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5cd38daa04940ac97f9037e3241cdaf in term 1.
I20260709 12:28:22.295648 19227 raft_consensus.cc:3060] T 584e9788383444ce82092f41f1749c44 P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:22.295754 19226 raft_consensus.cc:3060] T f4a87e357d584a3b925af9c5d05e2ab6 P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:22.297154 19117 leader_election.cc:304] T 584e9788383444ce82092f41f1749c44 P a5cd38daa04940ac97f9037e3241cdaf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a5cd38daa04940ac97f9037e3241cdaf, ecd798a306df4905858bf774b6cd98f3; no voters: 
I20260709 12:28:22.298530 19359 raft_consensus.cc:2804] T 584e9788383444ce82092f41f1749c44 P a5cd38daa04940ac97f9037e3241cdaf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:22.299173 19359 raft_consensus.cc:697] T 584e9788383444ce82092f41f1749c44 P a5cd38daa04940ac97f9037e3241cdaf [term 1 LEADER]: Becoming Leader. State: Replica: a5cd38daa04940ac97f9037e3241cdaf, State: Running, Role: LEADER
I20260709 12:28:22.300305 19359 consensus_queue.cc:237] T 584e9788383444ce82092f41f1749c44 P a5cd38daa04940ac97f9037e3241cdaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:22.304723 19151 raft_consensus.cc:2468] T f4a87e357d584a3b925af9c5d05e2ab6 P a5cd38daa04940ac97f9037e3241cdaf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd798a306df4905858bf774b6cd98f3 in term 1.
I20260709 12:28:22.306562 19265 leader_election.cc:304] T f4a87e357d584a3b925af9c5d05e2ab6 P ecd798a306df4905858bf774b6cd98f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a5cd38daa04940ac97f9037e3241cdaf, ecd798a306df4905858bf774b6cd98f3; no voters: 
I20260709 12:28:22.308696 19351 raft_consensus.cc:2804] T f4a87e357d584a3b925af9c5d05e2ab6 P ecd798a306df4905858bf774b6cd98f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:22.313453 19350 raft_consensus.cc:493] T c783b6e59edb46c4976d6b2117292201 P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:22.314152 19350 raft_consensus.cc:515] T c783b6e59edb46c4976d6b2117292201 P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:22.282353 19363 leader_election.cc:290] T f4a87e357d584a3b925af9c5d05e2ab6 P ecd798a306df4905858bf774b6cd98f3 [CANDIDATE]: Term 1 election: Requested vote from peers a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65:42503), 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66:37433)
I20260709 12:28:22.315770 19396 raft_consensus.cc:493] T 22e532f746f14300aac7e6240a0e18bd P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:22.325973 19396 raft_consensus.cc:3060] T 22e532f746f14300aac7e6240a0e18bd P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:22.328581 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783b6e59edb46c4976d6b2117292201" candidate_uuid: "595ece3316774e33930c4ef7923b8dc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd798a306df4905858bf774b6cd98f3" is_pre_election: true
I20260709 12:28:22.329609 19300 raft_consensus.cc:2468] T c783b6e59edb46c4976d6b2117292201 P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 595ece3316774e33930c4ef7923b8dc1 in term 0.
I20260709 12:28:22.330807 19192 leader_election.cc:304] T c783b6e59edb46c4976d6b2117292201 P 595ece3316774e33930c4ef7923b8dc1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 595ece3316774e33930c4ef7923b8dc1, ecd798a306df4905858bf774b6cd98f3; no voters: 
I20260709 12:28:22.331944 19350 leader_election.cc:290] T c783b6e59edb46c4976d6b2117292201 P 595ece3316774e33930c4ef7923b8dc1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65:42503), ecd798a306df4905858bf774b6cd98f3 (127.9.116.67:37403)
I20260709 12:28:22.332530 19350 raft_consensus.cc:2804] T c783b6e59edb46c4976d6b2117292201 P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:22.332902 19350 raft_consensus.cc:493] T c783b6e59edb46c4976d6b2117292201 P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:22.333324 19350 raft_consensus.cc:3060] T c783b6e59edb46c4976d6b2117292201 P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:22.342696 19227 raft_consensus.cc:2468] T 584e9788383444ce82092f41f1749c44 P 595ece3316774e33930c4ef7923b8dc1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5cd38daa04940ac97f9037e3241cdaf in term 1.
I20260709 12:28:22.348783 19350 raft_consensus.cc:515] T c783b6e59edb46c4976d6b2117292201 P 595ece3316774e33930c4ef7923b8dc1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:22.354265 19350 leader_election.cc:290] T c783b6e59edb46c4976d6b2117292201 P 595ece3316774e33930c4ef7923b8dc1 [CANDIDATE]: Term 1 election: Requested vote from peers a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65:42503), ecd798a306df4905858bf774b6cd98f3 (127.9.116.67:37403)
I20260709 12:28:22.356879 19351 raft_consensus.cc:697] T f4a87e357d584a3b925af9c5d05e2ab6 P ecd798a306df4905858bf774b6cd98f3 [term 1 LEADER]: Becoming Leader. State: Replica: ecd798a306df4905858bf774b6cd98f3, State: Running, Role: LEADER
I20260709 12:28:22.358630 19351 consensus_queue.cc:237] T f4a87e357d584a3b925af9c5d05e2ab6 P ecd798a306df4905858bf774b6cd98f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:22.417225 19048 catalog_manager.cc:5697] T 584e9788383444ce82092f41f1749c44 P a5cd38daa04940ac97f9037e3241cdaf reported cstate change: term changed from 0 to 1, leader changed from <none> to a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65). New cstate: current_term: 1 leader_uuid: "a5cd38daa04940ac97f9037e3241cdaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:22.424335 19151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783b6e59edb46c4976d6b2117292201" candidate_uuid: "595ece3316774e33930c4ef7923b8dc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5cd38daa04940ac97f9037e3241cdaf" is_pre_election: true
I20260709 12:28:22.425343 19152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783b6e59edb46c4976d6b2117292201" candidate_uuid: "595ece3316774e33930c4ef7923b8dc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5cd38daa04940ac97f9037e3241cdaf"
I20260709 12:28:22.426414 19151 raft_consensus.cc:2468] T c783b6e59edb46c4976d6b2117292201 P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 595ece3316774e33930c4ef7923b8dc1 in term 0.
I20260709 12:28:22.430958 19226 raft_consensus.cc:2468] T f4a87e357d584a3b925af9c5d05e2ab6 P 595ece3316774e33930c4ef7923b8dc1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd798a306df4905858bf774b6cd98f3 in term 1.
I20260709 12:28:22.437630 19301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783b6e59edb46c4976d6b2117292201" candidate_uuid: "595ece3316774e33930c4ef7923b8dc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd798a306df4905858bf774b6cd98f3"
I20260709 12:28:22.438755 19301 raft_consensus.cc:3060] T c783b6e59edb46c4976d6b2117292201 P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:22.448119 19362 consensus_queue.cc:1048] T c511fe69a84144d2ad2e090cc6766ffc P 595ece3316774e33930c4ef7923b8dc1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:22.453591 19363 consensus_queue.cc:1048] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P ecd798a306df4905858bf774b6cd98f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:22.466452 19351 consensus_queue.cc:1048] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P ecd798a306df4905858bf774b6cd98f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:22.468912 19301 raft_consensus.cc:2468] T c783b6e59edb46c4976d6b2117292201 P ecd798a306df4905858bf774b6cd98f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 595ece3316774e33930c4ef7923b8dc1 in term 1.
I20260709 12:28:22.475778 19192 leader_election.cc:304] T c783b6e59edb46c4976d6b2117292201 P 595ece3316774e33930c4ef7923b8dc1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 595ece3316774e33930c4ef7923b8dc1, ecd798a306df4905858bf774b6cd98f3; no voters: a5cd38daa04940ac97f9037e3241cdaf
I20260709 12:28:22.477541 19362 raft_consensus.cc:2804] T c783b6e59edb46c4976d6b2117292201 P 595ece3316774e33930c4ef7923b8dc1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:22.478719 19362 raft_consensus.cc:697] T c783b6e59edb46c4976d6b2117292201 P 595ece3316774e33930c4ef7923b8dc1 [term 1 LEADER]: Becoming Leader. State: Replica: 595ece3316774e33930c4ef7923b8dc1, State: Running, Role: LEADER
I20260709 12:28:22.480628 19344 consensus_queue.cc:1048] T c542a19e01724e1982bf9694078796f3 P a5cd38daa04940ac97f9037e3241cdaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:22.480702 19362 consensus_queue.cc:237] T c783b6e59edb46c4976d6b2117292201 P 595ece3316774e33930c4ef7923b8dc1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:22.482964 19344 consensus_queue.cc:1048] T 489fca1a81224008bc8b8e01b86bab9a P a5cd38daa04940ac97f9037e3241cdaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:28:22.497349 19396 raft_consensus.cc:515] T 22e532f746f14300aac7e6240a0e18bd P a5cd38daa04940ac97f9037e3241cdaf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:22.497750 19046 catalog_manager.cc:5697] T f4a87e357d584a3b925af9c5d05e2ab6 P ecd798a306df4905858bf774b6cd98f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to ecd798a306df4905858bf774b6cd98f3 (127.9.116.67). New cstate: current_term: 1 leader_uuid: "ecd798a306df4905858bf774b6cd98f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:22.505597 19301 raft_consensus.cc:3060] T c542a19e01724e1982bf9694078796f3 P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:22.517107 19396 leader_election.cc:290] T 22e532f746f14300aac7e6240a0e18bd P a5cd38daa04940ac97f9037e3241cdaf [CANDIDATE]: Term 1 election: Requested vote from peers 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66:37433), ecd798a306df4905858bf774b6cd98f3 (127.9.116.67:37403)
I20260709 12:28:22.520758 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22e532f746f14300aac7e6240a0e18bd" candidate_uuid: "a5cd38daa04940ac97f9037e3241cdaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd798a306df4905858bf774b6cd98f3"
I20260709 12:28:22.521997 19300 raft_consensus.cc:3060] T 22e532f746f14300aac7e6240a0e18bd P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:22.532789 19403 raft_consensus.cc:493] T c542a19e01724e1982bf9694078796f3 P ecd798a306df4905858bf774b6cd98f3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:22.534060 19403 raft_consensus.cc:515] T c542a19e01724e1982bf9694078796f3 P ecd798a306df4905858bf774b6cd98f3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:22.547147 19403 leader_election.cc:290] T c542a19e01724e1982bf9694078796f3 P ecd798a306df4905858bf774b6cd98f3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65:42503), 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66:37433)
I20260709 12:28:22.549463 19152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c542a19e01724e1982bf9694078796f3" candidate_uuid: "ecd798a306df4905858bf774b6cd98f3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5cd38daa04940ac97f9037e3241cdaf" is_pre_election: true
I20260709 12:28:22.549213 19396 consensus_queue.cc:1048] T c542a19e01724e1982bf9694078796f3 P a5cd38daa04940ac97f9037e3241cdaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:22.550680 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c542a19e01724e1982bf9694078796f3" candidate_uuid: "ecd798a306df4905858bf774b6cd98f3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "595ece3316774e33930c4ef7923b8dc1" is_pre_election: true
I20260709 12:28:22.552556 19266 leader_election.cc:304] T c542a19e01724e1982bf9694078796f3 P ecd798a306df4905858bf774b6cd98f3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd798a306df4905858bf774b6cd98f3; no voters: 595ece3316774e33930c4ef7923b8dc1, a5cd38daa04940ac97f9037e3241cdaf
I20260709 12:28:22.553071 19300 raft_consensus.cc:2468] T 22e532f746f14300aac7e6240a0e18bd P ecd798a306df4905858bf774b6cd98f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5cd38daa04940ac97f9037e3241cdaf in term 1.
I20260709 12:28:22.554028 19351 raft_consensus.cc:2749] T c542a19e01724e1982bf9694078796f3 P ecd798a306df4905858bf774b6cd98f3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:22.556210 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22e532f746f14300aac7e6240a0e18bd" candidate_uuid: "a5cd38daa04940ac97f9037e3241cdaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "595ece3316774e33930c4ef7923b8dc1"
I20260709 12:28:22.556962 19224 raft_consensus.cc:3060] T 22e532f746f14300aac7e6240a0e18bd P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:22.559533 19117 leader_election.cc:304] T 22e532f746f14300aac7e6240a0e18bd P a5cd38daa04940ac97f9037e3241cdaf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a5cd38daa04940ac97f9037e3241cdaf, ecd798a306df4905858bf774b6cd98f3; no voters: 
I20260709 12:28:22.568987 19050 catalog_manager.cc:5697] T c783b6e59edb46c4976d6b2117292201 P 595ece3316774e33930c4ef7923b8dc1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66). New cstate: current_term: 1 leader_uuid: "595ece3316774e33930c4ef7923b8dc1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:22.571631 19344 raft_consensus.cc:2804] T 22e532f746f14300aac7e6240a0e18bd P a5cd38daa04940ac97f9037e3241cdaf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:22.576438 19344 raft_consensus.cc:697] T 22e532f746f14300aac7e6240a0e18bd P a5cd38daa04940ac97f9037e3241cdaf [term 1 LEADER]: Becoming Leader. State: Replica: a5cd38daa04940ac97f9037e3241cdaf, State: Running, Role: LEADER
I20260709 12:28:22.583240 19344 consensus_queue.cc:237] T 22e532f746f14300aac7e6240a0e18bd P a5cd38daa04940ac97f9037e3241cdaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:22.610373 19396 consensus_queue.cc:1048] T 489fca1a81224008bc8b8e01b86bab9a P a5cd38daa04940ac97f9037e3241cdaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:22.619763 19224 raft_consensus.cc:2468] T 22e532f746f14300aac7e6240a0e18bd P 595ece3316774e33930c4ef7923b8dc1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5cd38daa04940ac97f9037e3241cdaf in term 1.
W20260709 12:28:22.650490 19098 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:28:22.650029 19047 catalog_manager.cc:5697] T 22e532f746f14300aac7e6240a0e18bd P a5cd38daa04940ac97f9037e3241cdaf reported cstate change: term changed from 0 to 1, leader changed from <none> to a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65). New cstate: current_term: 1 leader_uuid: "a5cd38daa04940ac97f9037e3241cdaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:22.701139 19344 consensus_queue.cc:1048] T 584e9788383444ce82092f41f1749c44 P a5cd38daa04940ac97f9037e3241cdaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:22.718336 19395 consensus_queue.cc:1048] T 584e9788383444ce82092f41f1749c44 P a5cd38daa04940ac97f9037e3241cdaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:22.746186 19301 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d9d28b53dbf34d0b94a1b47ab3ed7c3e"
dest_uuid: "ecd798a306df4905858bf774b6cd98f3"
mode: GRACEFUL
new_leader_uuid: "a5cd38daa04940ac97f9037e3241cdaf"
 from {username='slave'} at 127.0.0.1:49300
I20260709 12:28:22.746819 19301 raft_consensus.cc:606] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P ecd798a306df4905858bf774b6cd98f3 [term 1 LEADER]: Received request to transfer leadership to TS a5cd38daa04940ac97f9037e3241cdaf
I20260709 12:28:22.765108 19301 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f4a87e357d584a3b925af9c5d05e2ab6"
dest_uuid: "ecd798a306df4905858bf774b6cd98f3"
mode: GRACEFUL
new_leader_uuid: "595ece3316774e33930c4ef7923b8dc1"
 from {username='slave'} at 127.0.0.1:49300
I20260709 12:28:22.765667 19301 raft_consensus.cc:606] T f4a87e357d584a3b925af9c5d05e2ab6 P ecd798a306df4905858bf774b6cd98f3 [term 1 LEADER]: Received request to transfer leadership to TS 595ece3316774e33930c4ef7923b8dc1
I20260709 12:28:22.787300 19151 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c542a19e01724e1982bf9694078796f3"
dest_uuid: "a5cd38daa04940ac97f9037e3241cdaf"
mode: GRACEFUL
new_leader_uuid: "595ece3316774e33930c4ef7923b8dc1"
 from {username='slave'} at 127.0.0.1:34446
I20260709 12:28:22.787999 19151 raft_consensus.cc:606] T c542a19e01724e1982bf9694078796f3 P a5cd38daa04940ac97f9037e3241cdaf [term 1 LEADER]: Received request to transfer leadership to TS 595ece3316774e33930c4ef7923b8dc1
I20260709 12:28:22.795761 19151 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22e532f746f14300aac7e6240a0e18bd"
dest_uuid: "a5cd38daa04940ac97f9037e3241cdaf"
mode: GRACEFUL
new_leader_uuid: "595ece3316774e33930c4ef7923b8dc1"
 from {username='slave'} at 127.0.0.1:34446
I20260709 12:28:22.796401 19151 raft_consensus.cc:606] T 22e532f746f14300aac7e6240a0e18bd P a5cd38daa04940ac97f9037e3241cdaf [term 1 LEADER]: Received request to transfer leadership to TS 595ece3316774e33930c4ef7923b8dc1
I20260709 12:28:22.813339 19226 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c783b6e59edb46c4976d6b2117292201"
dest_uuid: "595ece3316774e33930c4ef7923b8dc1"
mode: GRACEFUL
new_leader_uuid: "ecd798a306df4905858bf774b6cd98f3"
 from {username='slave'} at 127.0.0.1:45280
I20260709 12:28:22.813987 19226 raft_consensus.cc:606] T c783b6e59edb46c4976d6b2117292201 P 595ece3316774e33930c4ef7923b8dc1 [term 1 LEADER]: Received request to transfer leadership to TS ecd798a306df4905858bf774b6cd98f3
I20260709 12:28:22.818598 19403 consensus_queue.cc:1048] T f4a87e357d584a3b925af9c5d05e2ab6 P ecd798a306df4905858bf774b6cd98f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:22.826061 19351 raft_consensus.cc:993] T f4a87e357d584a3b925af9c5d05e2ab6 P ecd798a306df4905858bf774b6cd98f3: : Instructing follower 595ece3316774e33930c4ef7923b8dc1 to start an election
I20260709 12:28:22.826606 19363 raft_consensus.cc:1081] T f4a87e357d584a3b925af9c5d05e2ab6 P ecd798a306df4905858bf774b6cd98f3 [term 1 LEADER]: Signalling peer 595ece3316774e33930c4ef7923b8dc1 to start an election
I20260709 12:28:22.829156 19224 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f4a87e357d584a3b925af9c5d05e2ab6"
dest_uuid: "595ece3316774e33930c4ef7923b8dc1"
 from {username='slave'} at 127.0.0.1:45272
I20260709 12:28:22.830229 19224 raft_consensus.cc:493] T f4a87e357d584a3b925af9c5d05e2ab6 P 595ece3316774e33930c4ef7923b8dc1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:22.830806 19224 raft_consensus.cc:3060] T f4a87e357d584a3b925af9c5d05e2ab6 P 595ece3316774e33930c4ef7923b8dc1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:22.835863 19351 consensus_queue.cc:1048] T f4a87e357d584a3b925af9c5d05e2ab6 P ecd798a306df4905858bf774b6cd98f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:22.841578 19224 raft_consensus.cc:515] T f4a87e357d584a3b925af9c5d05e2ab6 P 595ece3316774e33930c4ef7923b8dc1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:22.845935 19152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a87e357d584a3b925af9c5d05e2ab6" candidate_uuid: "595ece3316774e33930c4ef7923b8dc1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a5cd38daa04940ac97f9037e3241cdaf"
I20260709 12:28:22.846853 19152 raft_consensus.cc:3060] T f4a87e357d584a3b925af9c5d05e2ab6 P a5cd38daa04940ac97f9037e3241cdaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:22.847988 19224 leader_election.cc:290] T f4a87e357d584a3b925af9c5d05e2ab6 P 595ece3316774e33930c4ef7923b8dc1 [CANDIDATE]: Term 2 election: Requested vote from peers a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65:42503), ecd798a306df4905858bf774b6cd98f3 (127.9.116.67:37403)
I20260709 12:28:22.850337 19301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a87e357d584a3b925af9c5d05e2ab6" candidate_uuid: "595ece3316774e33930c4ef7923b8dc1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ecd798a306df4905858bf774b6cd98f3"
I20260709 12:28:22.851334 19301 raft_consensus.cc:3055] T f4a87e357d584a3b925af9c5d05e2ab6 P ecd798a306df4905858bf774b6cd98f3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:22.851754 19301 raft_consensus.cc:740] T f4a87e357d584a3b925af9c5d05e2ab6 P ecd798a306df4905858bf774b6cd98f3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ecd798a306df4905858bf774b6cd98f3, State: Running, Role: LEADER
I20260709 12:28:22.852896 19301 consensus_queue.cc:260] T f4a87e357d584a3b925af9c5d05e2ab6 P ecd798a306df4905858bf774b6cd98f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:22.854496 19301 raft_consensus.cc:3060] T f4a87e357d584a3b925af9c5d05e2ab6 P ecd798a306df4905858bf774b6cd98f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:22.858956 19152 raft_consensus.cc:2468] T f4a87e357d584a3b925af9c5d05e2ab6 P a5cd38daa04940ac97f9037e3241cdaf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 595ece3316774e33930c4ef7923b8dc1 in term 2.
I20260709 12:28:22.860880 19191 leader_election.cc:304] T f4a87e357d584a3b925af9c5d05e2ab6 P 595ece3316774e33930c4ef7923b8dc1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 595ece3316774e33930c4ef7923b8dc1, a5cd38daa04940ac97f9037e3241cdaf; no voters: 
I20260709 12:28:22.861881 19362 raft_consensus.cc:2804] T f4a87e357d584a3b925af9c5d05e2ab6 P 595ece3316774e33930c4ef7923b8dc1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:22.862425 19362 raft_consensus.cc:697] T f4a87e357d584a3b925af9c5d05e2ab6 P 595ece3316774e33930c4ef7923b8dc1 [term 2 LEADER]: Becoming Leader. State: Replica: 595ece3316774e33930c4ef7923b8dc1, State: Running, Role: LEADER
I20260709 12:28:22.863421 19362 consensus_queue.cc:237] T f4a87e357d584a3b925af9c5d05e2ab6 P 595ece3316774e33930c4ef7923b8dc1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:22.865954 19301 raft_consensus.cc:2468] T f4a87e357d584a3b925af9c5d05e2ab6 P ecd798a306df4905858bf774b6cd98f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 595ece3316774e33930c4ef7923b8dc1 in term 2.
I20260709 12:28:22.872241 19050 catalog_manager.cc:5697] T f4a87e357d584a3b925af9c5d05e2ab6 P 595ece3316774e33930c4ef7923b8dc1 reported cstate change: term changed from 1 to 2, leader changed from ecd798a306df4905858bf774b6cd98f3 (127.9.116.67) to 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66). New cstate: current_term: 2 leader_uuid: "595ece3316774e33930c4ef7923b8dc1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:22.886965 19152 raft_consensus.cc:3060] T c783b6e59edb46c4976d6b2117292201 P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:22.894270 19362 consensus_queue.cc:1048] T c783b6e59edb46c4976d6b2117292201 P 595ece3316774e33930c4ef7923b8dc1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:22.909644 19362 consensus_queue.cc:1048] T c783b6e59edb46c4976d6b2117292201 P 595ece3316774e33930c4ef7923b8dc1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:22.919486 19350 raft_consensus.cc:993] T c783b6e59edb46c4976d6b2117292201 P 595ece3316774e33930c4ef7923b8dc1: : Instructing follower ecd798a306df4905858bf774b6cd98f3 to start an election
I20260709 12:28:22.920146 19362 raft_consensus.cc:1081] T c783b6e59edb46c4976d6b2117292201 P 595ece3316774e33930c4ef7923b8dc1 [term 1 LEADER]: Signalling peer ecd798a306df4905858bf774b6cd98f3 to start an election
I20260709 12:28:22.921814 19299 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c783b6e59edb46c4976d6b2117292201"
dest_uuid: "ecd798a306df4905858bf774b6cd98f3"
 from {username='slave'} at 127.0.0.1:49288
I20260709 12:28:22.922379 19299 raft_consensus.cc:493] T c783b6e59edb46c4976d6b2117292201 P ecd798a306df4905858bf774b6cd98f3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:22.922783 19299 raft_consensus.cc:3060] T c783b6e59edb46c4976d6b2117292201 P ecd798a306df4905858bf774b6cd98f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:22.933075 19299 raft_consensus.cc:515] T c783b6e59edb46c4976d6b2117292201 P ecd798a306df4905858bf774b6cd98f3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:22.935361 19299 leader_election.cc:290] T c783b6e59edb46c4976d6b2117292201 P ecd798a306df4905858bf774b6cd98f3 [CANDIDATE]: Term 2 election: Requested vote from peers a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65:42503), 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66:37433)
I20260709 12:28:22.936548 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783b6e59edb46c4976d6b2117292201" candidate_uuid: "ecd798a306df4905858bf774b6cd98f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "595ece3316774e33930c4ef7923b8dc1"
I20260709 12:28:22.936447 19152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783b6e59edb46c4976d6b2117292201" candidate_uuid: "ecd798a306df4905858bf774b6cd98f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a5cd38daa04940ac97f9037e3241cdaf"
I20260709 12:28:22.937294 19224 raft_consensus.cc:3055] T c783b6e59edb46c4976d6b2117292201 P 595ece3316774e33930c4ef7923b8dc1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:22.937376 19152 raft_consensus.cc:3060] T c783b6e59edb46c4976d6b2117292201 P a5cd38daa04940ac97f9037e3241cdaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:22.937978 19224 raft_consensus.cc:740] T c783b6e59edb46c4976d6b2117292201 P 595ece3316774e33930c4ef7923b8dc1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 595ece3316774e33930c4ef7923b8dc1, State: Running, Role: LEADER
I20260709 12:28:22.938889 19224 consensus_queue.cc:260] T c783b6e59edb46c4976d6b2117292201 P 595ece3316774e33930c4ef7923b8dc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:22.940259 19224 raft_consensus.cc:3060] T c783b6e59edb46c4976d6b2117292201 P 595ece3316774e33930c4ef7923b8dc1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:22.948089 19152 raft_consensus.cc:2468] T c783b6e59edb46c4976d6b2117292201 P a5cd38daa04940ac97f9037e3241cdaf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd798a306df4905858bf774b6cd98f3 in term 2.
I20260709 12:28:22.949112 19224 raft_consensus.cc:2468] T c783b6e59edb46c4976d6b2117292201 P 595ece3316774e33930c4ef7923b8dc1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd798a306df4905858bf774b6cd98f3 in term 2.
I20260709 12:28:22.949657 19265 leader_election.cc:304] T c783b6e59edb46c4976d6b2117292201 P ecd798a306df4905858bf774b6cd98f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a5cd38daa04940ac97f9037e3241cdaf, ecd798a306df4905858bf774b6cd98f3; no voters: 
I20260709 12:28:22.950636 19351 raft_consensus.cc:2804] T c783b6e59edb46c4976d6b2117292201 P ecd798a306df4905858bf774b6cd98f3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:22.951093 19351 raft_consensus.cc:697] T c783b6e59edb46c4976d6b2117292201 P ecd798a306df4905858bf774b6cd98f3 [term 2 LEADER]: Becoming Leader. State: Replica: ecd798a306df4905858bf774b6cd98f3, State: Running, Role: LEADER
I20260709 12:28:22.952153 19351 consensus_queue.cc:237] T c783b6e59edb46c4976d6b2117292201 P ecd798a306df4905858bf774b6cd98f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:22.960160 19046 catalog_manager.cc:5697] T c783b6e59edb46c4976d6b2117292201 P ecd798a306df4905858bf774b6cd98f3 reported cstate change: term changed from 1 to 2, leader changed from 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66) to ecd798a306df4905858bf774b6cd98f3 (127.9.116.67). New cstate: current_term: 2 leader_uuid: "ecd798a306df4905858bf774b6cd98f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:23.023036 19359 consensus_queue.cc:1048] T 22e532f746f14300aac7e6240a0e18bd P a5cd38daa04940ac97f9037e3241cdaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:23.026554 19359 raft_consensus.cc:993] T c542a19e01724e1982bf9694078796f3 P a5cd38daa04940ac97f9037e3241cdaf: : Instructing follower 595ece3316774e33930c4ef7923b8dc1 to start an election
I20260709 12:28:23.027029 19395 raft_consensus.cc:1081] T c542a19e01724e1982bf9694078796f3 P a5cd38daa04940ac97f9037e3241cdaf [term 1 LEADER]: Signalling peer 595ece3316774e33930c4ef7923b8dc1 to start an election
I20260709 12:28:23.029101 19224 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c542a19e01724e1982bf9694078796f3"
dest_uuid: "595ece3316774e33930c4ef7923b8dc1"
 from {username='slave'} at 127.0.0.1:45262
I20260709 12:28:23.029776 19224 raft_consensus.cc:493] T c542a19e01724e1982bf9694078796f3 P 595ece3316774e33930c4ef7923b8dc1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:23.030467 19224 raft_consensus.cc:3060] T c542a19e01724e1982bf9694078796f3 P 595ece3316774e33930c4ef7923b8dc1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:23.039456 19224 raft_consensus.cc:515] T c542a19e01724e1982bf9694078796f3 P 595ece3316774e33930c4ef7923b8dc1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:23.040815 19359 consensus_queue.cc:1048] T 22e532f746f14300aac7e6240a0e18bd P a5cd38daa04940ac97f9037e3241cdaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:23.042634 19152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c542a19e01724e1982bf9694078796f3" candidate_uuid: "595ece3316774e33930c4ef7923b8dc1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a5cd38daa04940ac97f9037e3241cdaf"
I20260709 12:28:23.044205 19152 raft_consensus.cc:3055] T c542a19e01724e1982bf9694078796f3 P a5cd38daa04940ac97f9037e3241cdaf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:23.044586 19152 raft_consensus.cc:740] T c542a19e01724e1982bf9694078796f3 P a5cd38daa04940ac97f9037e3241cdaf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a5cd38daa04940ac97f9037e3241cdaf, State: Running, Role: LEADER
I20260709 12:28:23.043776 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c542a19e01724e1982bf9694078796f3" candidate_uuid: "595ece3316774e33930c4ef7923b8dc1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ecd798a306df4905858bf774b6cd98f3"
I20260709 12:28:23.045212 19299 raft_consensus.cc:3060] T c542a19e01724e1982bf9694078796f3 P ecd798a306df4905858bf774b6cd98f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:23.045822 19152 consensus_queue.cc:260] T c542a19e01724e1982bf9694078796f3 P a5cd38daa04940ac97f9037e3241cdaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:23.047149 19152 raft_consensus.cc:3060] T c542a19e01724e1982bf9694078796f3 P a5cd38daa04940ac97f9037e3241cdaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:23.043535 19224 leader_election.cc:290] T c542a19e01724e1982bf9694078796f3 P 595ece3316774e33930c4ef7923b8dc1 [CANDIDATE]: Term 2 election: Requested vote from peers a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65:42503), ecd798a306df4905858bf774b6cd98f3 (127.9.116.67:37403)
I20260709 12:28:23.055197 19299 raft_consensus.cc:2468] T c542a19e01724e1982bf9694078796f3 P ecd798a306df4905858bf774b6cd98f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 595ece3316774e33930c4ef7923b8dc1 in term 2.
I20260709 12:28:23.056800 19192 leader_election.cc:304] T c542a19e01724e1982bf9694078796f3 P 595ece3316774e33930c4ef7923b8dc1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 595ece3316774e33930c4ef7923b8dc1, ecd798a306df4905858bf774b6cd98f3; no voters: 
I20260709 12:28:23.057833 19401 raft_consensus.cc:2804] T c542a19e01724e1982bf9694078796f3 P 595ece3316774e33930c4ef7923b8dc1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:23.058346 19401 raft_consensus.cc:697] T c542a19e01724e1982bf9694078796f3 P 595ece3316774e33930c4ef7923b8dc1 [term 2 LEADER]: Becoming Leader. State: Replica: 595ece3316774e33930c4ef7923b8dc1, State: Running, Role: LEADER
I20260709 12:28:23.058789 19344 raft_consensus.cc:993] T 22e532f746f14300aac7e6240a0e18bd P a5cd38daa04940ac97f9037e3241cdaf: : Instructing follower 595ece3316774e33930c4ef7923b8dc1 to start an election
I20260709 12:28:23.059255 19401 consensus_queue.cc:237] T c542a19e01724e1982bf9694078796f3 P 595ece3316774e33930c4ef7923b8dc1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:23.059639 19344 raft_consensus.cc:1081] T 22e532f746f14300aac7e6240a0e18bd P a5cd38daa04940ac97f9037e3241cdaf [term 1 LEADER]: Signalling peer 595ece3316774e33930c4ef7923b8dc1 to start an election
I20260709 12:28:23.060380 19152 raft_consensus.cc:2468] T c542a19e01724e1982bf9694078796f3 P a5cd38daa04940ac97f9037e3241cdaf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 595ece3316774e33930c4ef7923b8dc1 in term 2.
I20260709 12:28:23.063179 19226 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "22e532f746f14300aac7e6240a0e18bd"
dest_uuid: "595ece3316774e33930c4ef7923b8dc1"
 from {username='slave'} at 127.0.0.1:45262
I20260709 12:28:23.064144 19226 raft_consensus.cc:493] T 22e532f746f14300aac7e6240a0e18bd P 595ece3316774e33930c4ef7923b8dc1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:23.064575 19226 raft_consensus.cc:3060] T 22e532f746f14300aac7e6240a0e18bd P 595ece3316774e33930c4ef7923b8dc1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:23.073753 19226 raft_consensus.cc:515] T 22e532f746f14300aac7e6240a0e18bd P 595ece3316774e33930c4ef7923b8dc1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:23.074103 19363 raft_consensus.cc:993] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P ecd798a306df4905858bf774b6cd98f3: : Instructing follower a5cd38daa04940ac97f9037e3241cdaf to start an election
I20260709 12:28:23.074942 19351 raft_consensus.cc:1081] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P ecd798a306df4905858bf774b6cd98f3 [term 1 LEADER]: Signalling peer a5cd38daa04940ac97f9037e3241cdaf to start an election
I20260709 12:28:23.076350 19226 leader_election.cc:290] T 22e532f746f14300aac7e6240a0e18bd P 595ece3316774e33930c4ef7923b8dc1 [CANDIDATE]: Term 2 election: Requested vote from peers a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65:42503), ecd798a306df4905858bf774b6cd98f3 (127.9.116.67:37403)
I20260709 12:28:23.077373 19151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22e532f746f14300aac7e6240a0e18bd" candidate_uuid: "595ece3316774e33930c4ef7923b8dc1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a5cd38daa04940ac97f9037e3241cdaf"
I20260709 12:28:23.077920 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22e532f746f14300aac7e6240a0e18bd" candidate_uuid: "595ece3316774e33930c4ef7923b8dc1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ecd798a306df4905858bf774b6cd98f3"
I20260709 12:28:23.078200 19151 raft_consensus.cc:3055] T 22e532f746f14300aac7e6240a0e18bd P a5cd38daa04940ac97f9037e3241cdaf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:23.078632 19151 raft_consensus.cc:740] T 22e532f746f14300aac7e6240a0e18bd P a5cd38daa04940ac97f9037e3241cdaf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a5cd38daa04940ac97f9037e3241cdaf, State: Running, Role: LEADER
I20260709 12:28:23.078665 19299 raft_consensus.cc:3060] T 22e532f746f14300aac7e6240a0e18bd P ecd798a306df4905858bf774b6cd98f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:23.079305 19152 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d9d28b53dbf34d0b94a1b47ab3ed7c3e"
dest_uuid: "a5cd38daa04940ac97f9037e3241cdaf"
 from {username='slave'} at 127.0.0.1:34440
I20260709 12:28:23.080010 19152 raft_consensus.cc:493] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P a5cd38daa04940ac97f9037e3241cdaf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:23.079923 19151 consensus_queue.cc:260] T 22e532f746f14300aac7e6240a0e18bd P a5cd38daa04940ac97f9037e3241cdaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:23.080509 19152 raft_consensus.cc:3060] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P a5cd38daa04940ac97f9037e3241cdaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:23.081238 19151 raft_consensus.cc:3060] T 22e532f746f14300aac7e6240a0e18bd P a5cd38daa04940ac97f9037e3241cdaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:23.082492 19050 catalog_manager.cc:5697] T c542a19e01724e1982bf9694078796f3 P 595ece3316774e33930c4ef7923b8dc1 reported cstate change: term changed from 1 to 2, leader changed from a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65) to 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66). New cstate: current_term: 2 leader_uuid: "595ece3316774e33930c4ef7923b8dc1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:23.089941 19152 raft_consensus.cc:515] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P a5cd38daa04940ac97f9037e3241cdaf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } }
I20260709 12:28:23.093703 19299 raft_consensus.cc:2468] T 22e532f746f14300aac7e6240a0e18bd P ecd798a306df4905858bf774b6cd98f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 595ece3316774e33930c4ef7923b8dc1 in term 2.
I20260709 12:28:23.094235 19152 leader_election.cc:290] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P a5cd38daa04940ac97f9037e3241cdaf [CANDIDATE]: Term 2 election: Requested vote from peers ecd798a306df4905858bf774b6cd98f3 (127.9.116.67:37403), 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66:37433)
I20260709 12:28:23.094108 19301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d28b53dbf34d0b94a1b47ab3ed7c3e" candidate_uuid: "a5cd38daa04940ac97f9037e3241cdaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ecd798a306df4905858bf774b6cd98f3"
I20260709 12:28:23.095070 19301 raft_consensus.cc:3055] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P ecd798a306df4905858bf774b6cd98f3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:23.095417 19301 raft_consensus.cc:740] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P ecd798a306df4905858bf774b6cd98f3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ecd798a306df4905858bf774b6cd98f3, State: Running, Role: LEADER
I20260709 12:28:23.095917 19192 leader_election.cc:304] T 22e532f746f14300aac7e6240a0e18bd P 595ece3316774e33930c4ef7923b8dc1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 595ece3316774e33930c4ef7923b8dc1, ecd798a306df4905858bf774b6cd98f3; no voters: 
I20260709 12:28:23.094108 19226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d28b53dbf34d0b94a1b47ab3ed7c3e" candidate_uuid: "a5cd38daa04940ac97f9037e3241cdaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "595ece3316774e33930c4ef7923b8dc1"
I20260709 12:28:23.096352 19301 consensus_queue.cc:260] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P ecd798a306df4905858bf774b6cd98f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } }
I20260709 12:28:23.097101 19401 raft_consensus.cc:2804] T 22e532f746f14300aac7e6240a0e18bd P 595ece3316774e33930c4ef7923b8dc1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:23.097281 19151 raft_consensus.cc:2468] T 22e532f746f14300aac7e6240a0e18bd P a5cd38daa04940ac97f9037e3241cdaf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 595ece3316774e33930c4ef7923b8dc1 in term 2.
I20260709 12:28:23.097113 19226 raft_consensus.cc:3060] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P 595ece3316774e33930c4ef7923b8dc1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:23.097708 19401 raft_consensus.cc:697] T 22e532f746f14300aac7e6240a0e18bd P 595ece3316774e33930c4ef7923b8dc1 [term 2 LEADER]: Becoming Leader. State: Replica: 595ece3316774e33930c4ef7923b8dc1, State: Running, Role: LEADER
I20260709 12:28:23.098835 19301 raft_consensus.cc:3060] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P ecd798a306df4905858bf774b6cd98f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:23.099023 19401 consensus_queue.cc:237] T 22e532f746f14300aac7e6240a0e18bd P 595ece3316774e33930c4ef7923b8dc1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:23.105531 19226 raft_consensus.cc:2468] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P 595ece3316774e33930c4ef7923b8dc1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5cd38daa04940ac97f9037e3241cdaf in term 2.
I20260709 12:28:23.106920 19117 leader_election.cc:304] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P a5cd38daa04940ac97f9037e3241cdaf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 595ece3316774e33930c4ef7923b8dc1, a5cd38daa04940ac97f9037e3241cdaf; no voters: 
I20260709 12:28:23.108220 19359 raft_consensus.cc:2804] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P a5cd38daa04940ac97f9037e3241cdaf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:23.108769 19359 raft_consensus.cc:697] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P a5cd38daa04940ac97f9037e3241cdaf [term 2 LEADER]: Becoming Leader. State: Replica: a5cd38daa04940ac97f9037e3241cdaf, State: Running, Role: LEADER
I20260709 12:28:23.108508 19050 catalog_manager.cc:5697] T 22e532f746f14300aac7e6240a0e18bd P 595ece3316774e33930c4ef7923b8dc1 reported cstate change: term changed from 1 to 2, leader changed from a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65) to 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66). New cstate: current_term: 2 leader_uuid: "595ece3316774e33930c4ef7923b8dc1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:23.109810 19359 consensus_queue.cc:237] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P a5cd38daa04940ac97f9037e3241cdaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } }
I20260709 12:28:23.111250 19301 raft_consensus.cc:2468] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P ecd798a306df4905858bf774b6cd98f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5cd38daa04940ac97f9037e3241cdaf in term 2.
I20260709 12:28:23.120707 19046 catalog_manager.cc:5697] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P a5cd38daa04940ac97f9037e3241cdaf reported cstate change: term changed from 1 to 2, leader changed from ecd798a306df4905858bf774b6cd98f3 (127.9.116.67) to a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65). New cstate: current_term: 2 leader_uuid: "a5cd38daa04940ac97f9037e3241cdaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:23.254585 19151 raft_consensus.cc:1275] T f4a87e357d584a3b925af9c5d05e2ab6 P a5cd38daa04940ac97f9037e3241cdaf [term 2 FOLLOWER]: Refusing update from remote peer 595ece3316774e33930c4ef7923b8dc1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:23.256052 19401 consensus_queue.cc:1048] T f4a87e357d584a3b925af9c5d05e2ab6 P 595ece3316774e33930c4ef7923b8dc1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:23.265739 19301 raft_consensus.cc:1275] T f4a87e357d584a3b925af9c5d05e2ab6 P ecd798a306df4905858bf774b6cd98f3 [term 2 FOLLOWER]: Refusing update from remote peer 595ece3316774e33930c4ef7923b8dc1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:23.267500 19350 consensus_queue.cc:1048] T f4a87e357d584a3b925af9c5d05e2ab6 P 595ece3316774e33930c4ef7923b8dc1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:23.334730 19224 raft_consensus.cc:1275] T c783b6e59edb46c4976d6b2117292201 P 595ece3316774e33930c4ef7923b8dc1 [term 2 FOLLOWER]: Refusing update from remote peer ecd798a306df4905858bf774b6cd98f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:23.336108 19351 consensus_queue.cc:1048] T c783b6e59edb46c4976d6b2117292201 P ecd798a306df4905858bf774b6cd98f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:23.354126 19151 raft_consensus.cc:1275] T c783b6e59edb46c4976d6b2117292201 P a5cd38daa04940ac97f9037e3241cdaf [term 2 FOLLOWER]: Refusing update from remote peer ecd798a306df4905858bf774b6cd98f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:23.356317 19363 consensus_queue.cc:1048] T c783b6e59edb46c4976d6b2117292201 P ecd798a306df4905858bf774b6cd98f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:23.520941 19151 raft_consensus.cc:1275] T c542a19e01724e1982bf9694078796f3 P a5cd38daa04940ac97f9037e3241cdaf [term 2 FOLLOWER]: Refusing update from remote peer 595ece3316774e33930c4ef7923b8dc1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:23.522946 19350 consensus_queue.cc:1048] T c542a19e01724e1982bf9694078796f3 P 595ece3316774e33930c4ef7923b8dc1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:23.533432 19301 raft_consensus.cc:1275] T c542a19e01724e1982bf9694078796f3 P ecd798a306df4905858bf774b6cd98f3 [term 2 FOLLOWER]: Refusing update from remote peer 595ece3316774e33930c4ef7923b8dc1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:23.535283 19401 consensus_queue.cc:1048] T c542a19e01724e1982bf9694078796f3 P 595ece3316774e33930c4ef7923b8dc1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:23.571650 19301 raft_consensus.cc:1275] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P ecd798a306df4905858bf774b6cd98f3 [term 2 FOLLOWER]: Refusing update from remote peer a5cd38daa04940ac97f9037e3241cdaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:23.573127 19396 consensus_queue.cc:1048] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P a5cd38daa04940ac97f9037e3241cdaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:23.583664 19224 raft_consensus.cc:1275] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P 595ece3316774e33930c4ef7923b8dc1 [term 2 FOLLOWER]: Refusing update from remote peer a5cd38daa04940ac97f9037e3241cdaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:23.586246 19344 consensus_queue.cc:1048] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P a5cd38daa04940ac97f9037e3241cdaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:23.635802 19301 raft_consensus.cc:1275] T 22e532f746f14300aac7e6240a0e18bd P ecd798a306df4905858bf774b6cd98f3 [term 2 FOLLOWER]: Refusing update from remote peer 595ece3316774e33930c4ef7923b8dc1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:23.637264 19350 consensus_queue.cc:1048] T 22e532f746f14300aac7e6240a0e18bd P 595ece3316774e33930c4ef7923b8dc1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:23.646343 19151 raft_consensus.cc:1275] T 22e532f746f14300aac7e6240a0e18bd P a5cd38daa04940ac97f9037e3241cdaf [term 2 FOLLOWER]: Refusing update from remote peer 595ece3316774e33930c4ef7923b8dc1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:23.647866 19350 consensus_queue.cc:1048] T 22e532f746f14300aac7e6240a0e18bd P 595ece3316774e33930c4ef7923b8dc1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:25.852662 19050 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37338:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:28:25.855187 19050 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:28:25.919661 19142 tablet_service.cc:1511] Processing CreateTablet for tablet e2cf09feaca24068a727752850983ac5 (DEFAULT_TABLE table=soft_deleted_table [id=43c808bf3d5c47a8b2657ddd54446cfd]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:28:25.920815 19215 tablet_service.cc:1511] Processing CreateTablet for tablet e2cf09feaca24068a727752850983ac5 (DEFAULT_TABLE table=soft_deleted_table [id=43c808bf3d5c47a8b2657ddd54446cfd]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:28:25.921717 19142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2cf09feaca24068a727752850983ac5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:25.922490 19285 tablet_service.cc:1511] Processing CreateTablet for tablet e2cf09feaca24068a727752850983ac5 (DEFAULT_TABLE table=soft_deleted_table [id=43c808bf3d5c47a8b2657ddd54446cfd]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:28:25.923022 19215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2cf09feaca24068a727752850983ac5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:25.924080 19285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2cf09feaca24068a727752850983ac5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:25.926011 19136 tablet_service.cc:1511] Processing CreateTablet for tablet 47b5cca5e909437c96a329dd6a87e474 (DEFAULT_TABLE table=soft_deleted_table [id=43c808bf3d5c47a8b2657ddd54446cfd]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:28:25.927619 19136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47b5cca5e909437c96a329dd6a87e474. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:25.928561 19209 tablet_service.cc:1511] Processing CreateTablet for tablet 47b5cca5e909437c96a329dd6a87e474 (DEFAULT_TABLE table=soft_deleted_table [id=43c808bf3d5c47a8b2657ddd54446cfd]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:28:25.930117 19209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47b5cca5e909437c96a329dd6a87e474. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:25.932272 19284 tablet_service.cc:1511] Processing CreateTablet for tablet 47b5cca5e909437c96a329dd6a87e474 (DEFAULT_TABLE table=soft_deleted_table [id=43c808bf3d5c47a8b2657ddd54446cfd]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:28:25.933991 19284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47b5cca5e909437c96a329dd6a87e474. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:25.958436 19139 tablet_service.cc:1511] Processing CreateTablet for tablet 88011d359ca74cf18e222bdaed1978a0 (DEFAULT_TABLE table=soft_deleted_table [id=43c808bf3d5c47a8b2657ddd54446cfd]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:28:25.960513 19139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88011d359ca74cf18e222bdaed1978a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:25.960135 19214 tablet_service.cc:1511] Processing CreateTablet for tablet 88011d359ca74cf18e222bdaed1978a0 (DEFAULT_TABLE table=soft_deleted_table [id=43c808bf3d5c47a8b2657ddd54446cfd]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:28:25.961798 19214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88011d359ca74cf18e222bdaed1978a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:25.966702 19140 tablet_service.cc:1511] Processing CreateTablet for tablet 8d1007a33823446895ad5e0307fa4fff (DEFAULT_TABLE table=soft_deleted_table [id=43c808bf3d5c47a8b2657ddd54446cfd]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:28:25.968487 19140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d1007a33823446895ad5e0307fa4fff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:25.968809 19210 tablet_service.cc:1511] Processing CreateTablet for tablet 8d1007a33823446895ad5e0307fa4fff (DEFAULT_TABLE table=soft_deleted_table [id=43c808bf3d5c47a8b2657ddd54446cfd]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:28:25.970434 19210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d1007a33823446895ad5e0307fa4fff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:25.966790 19283 tablet_service.cc:1511] Processing CreateTablet for tablet 88011d359ca74cf18e222bdaed1978a0 (DEFAULT_TABLE table=soft_deleted_table [id=43c808bf3d5c47a8b2657ddd54446cfd]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:28:25.972924 19443 tablet_bootstrap.cc:492] T 47b5cca5e909437c96a329dd6a87e474 P 595ece3316774e33930c4ef7923b8dc1: Bootstrap starting.
I20260709 12:28:25.973379 19283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88011d359ca74cf18e222bdaed1978a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:25.984097 19443 tablet_bootstrap.cc:654] T 47b5cca5e909437c96a329dd6a87e474 P 595ece3316774e33930c4ef7923b8dc1: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:25.989005 19290 tablet_service.cc:1511] Processing CreateTablet for tablet 8d1007a33823446895ad5e0307fa4fff (DEFAULT_TABLE table=soft_deleted_table [id=43c808bf3d5c47a8b2657ddd54446cfd]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:28:25.991407 19290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d1007a33823446895ad5e0307fa4fff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:25.991683 19444 tablet_bootstrap.cc:492] T e2cf09feaca24068a727752850983ac5 P a5cd38daa04940ac97f9037e3241cdaf: Bootstrap starting.
I20260709 12:28:25.996907 19443 tablet_bootstrap.cc:492] T 47b5cca5e909437c96a329dd6a87e474 P 595ece3316774e33930c4ef7923b8dc1: No bootstrap required, opened a new log
I20260709 12:28:25.997612 19443 ts_tablet_manager.cc:1403] T 47b5cca5e909437c96a329dd6a87e474 P 595ece3316774e33930c4ef7923b8dc1: Time spent bootstrapping tablet: real 0.025s	user 0.006s	sys 0.014s
I20260709 12:28:26.001289 19443 raft_consensus.cc:359] T 47b5cca5e909437c96a329dd6a87e474 P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.002086 19443 raft_consensus.cc:385] T 47b5cca5e909437c96a329dd6a87e474 P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:26.002408 19443 raft_consensus.cc:740] T 47b5cca5e909437c96a329dd6a87e474 P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 595ece3316774e33930c4ef7923b8dc1, State: Initialized, Role: FOLLOWER
I20260709 12:28:26.003374 19443 consensus_queue.cc:260] T 47b5cca5e909437c96a329dd6a87e474 P 595ece3316774e33930c4ef7923b8dc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.006279 19444 tablet_bootstrap.cc:654] T e2cf09feaca24068a727752850983ac5 P a5cd38daa04940ac97f9037e3241cdaf: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:26.012202 19443 ts_tablet_manager.cc:1434] T 47b5cca5e909437c96a329dd6a87e474 P 595ece3316774e33930c4ef7923b8dc1: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.001s
I20260709 12:28:26.013736 19443 tablet_bootstrap.cc:492] T e2cf09feaca24068a727752850983ac5 P 595ece3316774e33930c4ef7923b8dc1: Bootstrap starting.
I20260709 12:28:26.014219 19142 tablet_service.cc:1511] Processing CreateTablet for tablet 345ac35ca3d140d3ab3ba9fc108a930b (DEFAULT_TABLE table=soft_deleted_table [id=43c808bf3d5c47a8b2657ddd54446cfd]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:28:26.015684 19142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 345ac35ca3d140d3ab3ba9fc108a930b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:26.035224 19442 tablet_bootstrap.cc:492] T e2cf09feaca24068a727752850983ac5 P ecd798a306df4905858bf774b6cd98f3: Bootstrap starting.
I20260709 12:28:26.044718 19443 tablet_bootstrap.cc:654] T e2cf09feaca24068a727752850983ac5 P 595ece3316774e33930c4ef7923b8dc1: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:26.051206 19442 tablet_bootstrap.cc:654] T e2cf09feaca24068a727752850983ac5 P ecd798a306df4905858bf774b6cd98f3: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:26.053453 19287 tablet_service.cc:1511] Processing CreateTablet for tablet 345ac35ca3d140d3ab3ba9fc108a930b (DEFAULT_TABLE table=soft_deleted_table [id=43c808bf3d5c47a8b2657ddd54446cfd]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:28:26.055742 19287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 345ac35ca3d140d3ab3ba9fc108a930b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:26.060598 19215 tablet_service.cc:1511] Processing CreateTablet for tablet 1e372667da904e65aa5d7c5345b08fca (DEFAULT_TABLE table=soft_deleted_table [id=43c808bf3d5c47a8b2657ddd54446cfd]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:28:26.062198 19215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e372667da904e65aa5d7c5345b08fca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:26.062696 19285 tablet_service.cc:1511] Processing CreateTablet for tablet 1e372667da904e65aa5d7c5345b08fca (DEFAULT_TABLE table=soft_deleted_table [id=43c808bf3d5c47a8b2657ddd54446cfd]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:28:26.064265 19285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e372667da904e65aa5d7c5345b08fca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:26.062733 19214 tablet_service.cc:1511] Processing CreateTablet for tablet 345ac35ca3d140d3ab3ba9fc108a930b (DEFAULT_TABLE table=soft_deleted_table [id=43c808bf3d5c47a8b2657ddd54446cfd]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:28:26.069213 19214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 345ac35ca3d140d3ab3ba9fc108a930b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:26.073856 19136 tablet_service.cc:1511] Processing CreateTablet for tablet 1e372667da904e65aa5d7c5345b08fca (DEFAULT_TABLE table=soft_deleted_table [id=43c808bf3d5c47a8b2657ddd54446cfd]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:28:26.073927 19138 tablet_service.cc:1511] Processing CreateTablet for tablet 7c21e55b8c694512b0ed942898b2749d (DEFAULT_TABLE table=soft_deleted_table [id=43c808bf3d5c47a8b2657ddd54446cfd]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:28:26.075423 19136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e372667da904e65aa5d7c5345b08fca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:26.076396 19138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c21e55b8c694512b0ed942898b2749d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:26.077036 19209 tablet_service.cc:1511] Processing CreateTablet for tablet 7c21e55b8c694512b0ed942898b2749d (DEFAULT_TABLE table=soft_deleted_table [id=43c808bf3d5c47a8b2657ddd54446cfd]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:28:26.078455 19209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c21e55b8c694512b0ed942898b2749d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:26.079277 19284 tablet_service.cc:1511] Processing CreateTablet for tablet 7c21e55b8c694512b0ed942898b2749d (DEFAULT_TABLE table=soft_deleted_table [id=43c808bf3d5c47a8b2657ddd54446cfd]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:28:26.080928 19284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c21e55b8c694512b0ed942898b2749d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:26.091617 19444 tablet_bootstrap.cc:492] T e2cf09feaca24068a727752850983ac5 P a5cd38daa04940ac97f9037e3241cdaf: No bootstrap required, opened a new log
I20260709 12:28:26.097987 19444 ts_tablet_manager.cc:1403] T e2cf09feaca24068a727752850983ac5 P a5cd38daa04940ac97f9037e3241cdaf: Time spent bootstrapping tablet: real 0.101s	user 0.023s	sys 0.000s
I20260709 12:28:26.106585 19444 raft_consensus.cc:359] T e2cf09feaca24068a727752850983ac5 P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.107465 19444 raft_consensus.cc:385] T e2cf09feaca24068a727752850983ac5 P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:26.117415 19444 raft_consensus.cc:740] T e2cf09feaca24068a727752850983ac5 P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5cd38daa04940ac97f9037e3241cdaf, State: Initialized, Role: FOLLOWER
I20260709 12:28:26.120887 19142 tablet_service.cc:1511] Processing CreateTablet for tablet 84655933e2a8465d8aede7f18c893cad (DEFAULT_TABLE table=soft_deleted_table [id=43c808bf3d5c47a8b2657ddd54446cfd]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:28:26.122462 19444 consensus_queue.cc:260] T e2cf09feaca24068a727752850983ac5 P a5cd38daa04940ac97f9037e3241cdaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.125752 19444 ts_tablet_manager.cc:1434] T e2cf09feaca24068a727752850983ac5 P a5cd38daa04940ac97f9037e3241cdaf: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 12:28:26.125391 19290 tablet_service.cc:1511] Processing CreateTablet for tablet 84655933e2a8465d8aede7f18c893cad (DEFAULT_TABLE table=soft_deleted_table [id=43c808bf3d5c47a8b2657ddd54446cfd]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:28:26.126927 19444 tablet_bootstrap.cc:492] T 47b5cca5e909437c96a329dd6a87e474 P a5cd38daa04940ac97f9037e3241cdaf: Bootstrap starting.
I20260709 12:28:26.123416 19210 tablet_service.cc:1511] Processing CreateTablet for tablet 84655933e2a8465d8aede7f18c893cad (DEFAULT_TABLE table=soft_deleted_table [id=43c808bf3d5c47a8b2657ddd54446cfd]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:28:26.128430 19210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84655933e2a8465d8aede7f18c893cad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:26.129720 19443 tablet_bootstrap.cc:492] T e2cf09feaca24068a727752850983ac5 P 595ece3316774e33930c4ef7923b8dc1: No bootstrap required, opened a new log
I20260709 12:28:26.130389 19443 ts_tablet_manager.cc:1403] T e2cf09feaca24068a727752850983ac5 P 595ece3316774e33930c4ef7923b8dc1: Time spent bootstrapping tablet: real 0.117s	user 0.014s	sys 0.005s
I20260709 12:28:26.134861 19443 raft_consensus.cc:359] T e2cf09feaca24068a727752850983ac5 P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.139696 19443 raft_consensus.cc:385] T e2cf09feaca24068a727752850983ac5 P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:26.140208 19443 raft_consensus.cc:740] T e2cf09feaca24068a727752850983ac5 P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 595ece3316774e33930c4ef7923b8dc1, State: Initialized, Role: FOLLOWER
I20260709 12:28:26.123499 19142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84655933e2a8465d8aede7f18c893cad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:26.142212 19290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84655933e2a8465d8aede7f18c893cad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:26.141955 19443 consensus_queue.cc:260] T e2cf09feaca24068a727752850983ac5 P 595ece3316774e33930c4ef7923b8dc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.145222 19443 ts_tablet_manager.cc:1434] T e2cf09feaca24068a727752850983ac5 P 595ece3316774e33930c4ef7923b8dc1: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 12:28:26.146592 19443 tablet_bootstrap.cc:492] T 88011d359ca74cf18e222bdaed1978a0 P 595ece3316774e33930c4ef7923b8dc1: Bootstrap starting.
I20260709 12:28:26.155412 19213 tablet_service.cc:1511] Processing CreateTablet for tablet 0fd8240043ac467eb287176c4f2e97e7 (DEFAULT_TABLE table=soft_deleted_table [id=43c808bf3d5c47a8b2657ddd54446cfd]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:28:26.157289 19213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fd8240043ac467eb287176c4f2e97e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:26.171995 19140 tablet_service.cc:1511] Processing CreateTablet for tablet 0fd8240043ac467eb287176c4f2e97e7 (DEFAULT_TABLE table=soft_deleted_table [id=43c808bf3d5c47a8b2657ddd54446cfd]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:28:26.173448 19140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fd8240043ac467eb287176c4f2e97e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:26.163539 19442 tablet_bootstrap.cc:492] T e2cf09feaca24068a727752850983ac5 P ecd798a306df4905858bf774b6cd98f3: No bootstrap required, opened a new log
I20260709 12:28:26.177574 19442 ts_tablet_manager.cc:1403] T e2cf09feaca24068a727752850983ac5 P ecd798a306df4905858bf774b6cd98f3: Time spent bootstrapping tablet: real 0.143s	user 0.007s	sys 0.015s
I20260709 12:28:26.182508 19442 raft_consensus.cc:359] T e2cf09feaca24068a727752850983ac5 P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.187918 19442 raft_consensus.cc:385] T e2cf09feaca24068a727752850983ac5 P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:26.188796 19442 raft_consensus.cc:740] T e2cf09feaca24068a727752850983ac5 P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd798a306df4905858bf774b6cd98f3, State: Initialized, Role: FOLLOWER
I20260709 12:28:26.190089 19442 consensus_queue.cc:260] T e2cf09feaca24068a727752850983ac5 P ecd798a306df4905858bf774b6cd98f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.195830 19442 ts_tablet_manager.cc:1434] T e2cf09feaca24068a727752850983ac5 P ecd798a306df4905858bf774b6cd98f3: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.006s
I20260709 12:28:26.199679 19442 tablet_bootstrap.cc:492] T 47b5cca5e909437c96a329dd6a87e474 P ecd798a306df4905858bf774b6cd98f3: Bootstrap starting.
I20260709 12:28:26.202379 19283 tablet_service.cc:1511] Processing CreateTablet for tablet 0fd8240043ac467eb287176c4f2e97e7 (DEFAULT_TABLE table=soft_deleted_table [id=43c808bf3d5c47a8b2657ddd54446cfd]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:28:26.203958 19283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fd8240043ac467eb287176c4f2e97e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:26.205669 19444 tablet_bootstrap.cc:654] T 47b5cca5e909437c96a329dd6a87e474 P a5cd38daa04940ac97f9037e3241cdaf: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:26.210632 19443 tablet_bootstrap.cc:654] T 88011d359ca74cf18e222bdaed1978a0 P 595ece3316774e33930c4ef7923b8dc1: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:26.216908 19442 tablet_bootstrap.cc:654] T 47b5cca5e909437c96a329dd6a87e474 P ecd798a306df4905858bf774b6cd98f3: Neither blocks nor log segments found. Creating new log.
W20260709 12:28:26.231496 19192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:37403, user_credentials={real_user=slave}} blocked reactor thread for 62745.4us
I20260709 12:28:26.246348 19428 raft_consensus.cc:493] T 47b5cca5e909437c96a329dd6a87e474 P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:26.246873 19428 raft_consensus.cc:515] T 47b5cca5e909437c96a329dd6a87e474 P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.249258 19428 leader_election.cc:290] T 47b5cca5e909437c96a329dd6a87e474 P 595ece3316774e33930c4ef7923b8dc1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65:42503), ecd798a306df4905858bf774b6cd98f3 (127.9.116.67:37403)
W20260709 12:28:26.251401 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.65:42503, user_credentials={real_user=slave}} blocked reactor thread for 76031us
I20260709 12:28:26.253661 19152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b5cca5e909437c96a329dd6a87e474" candidate_uuid: "595ece3316774e33930c4ef7923b8dc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5cd38daa04940ac97f9037e3241cdaf" is_pre_election: true
W20260709 12:28:26.257432 19191 leader_election.cc:343] T 47b5cca5e909437c96a329dd6a87e474 P 595ece3316774e33930c4ef7923b8dc1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65:42503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:26.258904 19301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b5cca5e909437c96a329dd6a87e474" candidate_uuid: "595ece3316774e33930c4ef7923b8dc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd798a306df4905858bf774b6cd98f3" is_pre_election: true
W20260709 12:28:26.261415 19192 leader_election.cc:343] T 47b5cca5e909437c96a329dd6a87e474 P 595ece3316774e33930c4ef7923b8dc1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecd798a306df4905858bf774b6cd98f3 (127.9.116.67:37403): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:26.262085 19192 leader_election.cc:304] T 47b5cca5e909437c96a329dd6a87e474 P 595ece3316774e33930c4ef7923b8dc1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 595ece3316774e33930c4ef7923b8dc1; no voters: a5cd38daa04940ac97f9037e3241cdaf, ecd798a306df4905858bf774b6cd98f3
I20260709 12:28:26.263018 19428 raft_consensus.cc:2749] T 47b5cca5e909437c96a329dd6a87e474 P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:26.265621 19442 tablet_bootstrap.cc:492] T 47b5cca5e909437c96a329dd6a87e474 P ecd798a306df4905858bf774b6cd98f3: No bootstrap required, opened a new log
I20260709 12:28:26.266189 19442 ts_tablet_manager.cc:1403] T 47b5cca5e909437c96a329dd6a87e474 P ecd798a306df4905858bf774b6cd98f3: Time spent bootstrapping tablet: real 0.067s	user 0.020s	sys 0.009s
I20260709 12:28:26.271024 19444 tablet_bootstrap.cc:492] T 47b5cca5e909437c96a329dd6a87e474 P a5cd38daa04940ac97f9037e3241cdaf: No bootstrap required, opened a new log
I20260709 12:28:26.271306 19442 raft_consensus.cc:359] T 47b5cca5e909437c96a329dd6a87e474 P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.271819 19444 ts_tablet_manager.cc:1403] T 47b5cca5e909437c96a329dd6a87e474 P a5cd38daa04940ac97f9037e3241cdaf: Time spent bootstrapping tablet: real 0.145s	user 0.021s	sys 0.004s
I20260709 12:28:26.272114 19442 raft_consensus.cc:385] T 47b5cca5e909437c96a329dd6a87e474 P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:26.272473 19442 raft_consensus.cc:740] T 47b5cca5e909437c96a329dd6a87e474 P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd798a306df4905858bf774b6cd98f3, State: Initialized, Role: FOLLOWER
I20260709 12:28:26.273324 19442 consensus_queue.cc:260] T 47b5cca5e909437c96a329dd6a87e474 P ecd798a306df4905858bf774b6cd98f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.276708 19444 raft_consensus.cc:359] T 47b5cca5e909437c96a329dd6a87e474 P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.277918 19444 raft_consensus.cc:385] T 47b5cca5e909437c96a329dd6a87e474 P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:26.278414 19444 raft_consensus.cc:740] T 47b5cca5e909437c96a329dd6a87e474 P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5cd38daa04940ac97f9037e3241cdaf, State: Initialized, Role: FOLLOWER
I20260709 12:28:26.279390 19444 consensus_queue.cc:260] T 47b5cca5e909437c96a329dd6a87e474 P a5cd38daa04940ac97f9037e3241cdaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.282652 19442 ts_tablet_manager.cc:1434] T 47b5cca5e909437c96a329dd6a87e474 P ecd798a306df4905858bf774b6cd98f3: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 12:28:26.284127 19442 tablet_bootstrap.cc:492] T 8d1007a33823446895ad5e0307fa4fff P ecd798a306df4905858bf774b6cd98f3: Bootstrap starting.
I20260709 12:28:26.282656 19444 ts_tablet_manager.cc:1434] T 47b5cca5e909437c96a329dd6a87e474 P a5cd38daa04940ac97f9037e3241cdaf: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:28:26.287694 19444 tablet_bootstrap.cc:492] T 345ac35ca3d140d3ab3ba9fc108a930b P a5cd38daa04940ac97f9037e3241cdaf: Bootstrap starting.
I20260709 12:28:26.289564 19443 tablet_bootstrap.cc:492] T 88011d359ca74cf18e222bdaed1978a0 P 595ece3316774e33930c4ef7923b8dc1: No bootstrap required, opened a new log
I20260709 12:28:26.290124 19443 ts_tablet_manager.cc:1403] T 88011d359ca74cf18e222bdaed1978a0 P 595ece3316774e33930c4ef7923b8dc1: Time spent bootstrapping tablet: real 0.144s	user 0.007s	sys 0.021s
I20260709 12:28:26.291383 19442 tablet_bootstrap.cc:654] T 8d1007a33823446895ad5e0307fa4fff P ecd798a306df4905858bf774b6cd98f3: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:26.293465 19443 raft_consensus.cc:359] T 88011d359ca74cf18e222bdaed1978a0 P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.294309 19443 raft_consensus.cc:385] T 88011d359ca74cf18e222bdaed1978a0 P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:26.294625 19443 raft_consensus.cc:740] T 88011d359ca74cf18e222bdaed1978a0 P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 595ece3316774e33930c4ef7923b8dc1, State: Initialized, Role: FOLLOWER
I20260709 12:28:26.296103 19443 consensus_queue.cc:260] T 88011d359ca74cf18e222bdaed1978a0 P 595ece3316774e33930c4ef7923b8dc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.296649 19444 tablet_bootstrap.cc:654] T 345ac35ca3d140d3ab3ba9fc108a930b P a5cd38daa04940ac97f9037e3241cdaf: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:26.302455 19443 ts_tablet_manager.cc:1434] T 88011d359ca74cf18e222bdaed1978a0 P 595ece3316774e33930c4ef7923b8dc1: Time spent starting tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 12:28:26.304051 19443 tablet_bootstrap.cc:492] T 8d1007a33823446895ad5e0307fa4fff P 595ece3316774e33930c4ef7923b8dc1: Bootstrap starting.
I20260709 12:28:26.307785 19431 raft_consensus.cc:493] T 47b5cca5e909437c96a329dd6a87e474 P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:26.308475 19431 raft_consensus.cc:515] T 47b5cca5e909437c96a329dd6a87e474 P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.312191 19226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b5cca5e909437c96a329dd6a87e474" candidate_uuid: "ecd798a306df4905858bf774b6cd98f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "595ece3316774e33930c4ef7923b8dc1" is_pre_election: true
I20260709 12:28:26.312892 19226 raft_consensus.cc:2468] T 47b5cca5e909437c96a329dd6a87e474 P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd798a306df4905858bf774b6cd98f3 in term 0.
I20260709 12:28:26.316224 19266 leader_election.cc:304] T 47b5cca5e909437c96a329dd6a87e474 P ecd798a306df4905858bf774b6cd98f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 595ece3316774e33930c4ef7923b8dc1, ecd798a306df4905858bf774b6cd98f3; no voters: 
I20260709 12:28:26.317911 19431 leader_election.cc:290] T 47b5cca5e909437c96a329dd6a87e474 P ecd798a306df4905858bf774b6cd98f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65:42503), 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66:37433)
I20260709 12:28:26.321131 19431 raft_consensus.cc:2804] T 47b5cca5e909437c96a329dd6a87e474 P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:26.321554 19431 raft_consensus.cc:493] T 47b5cca5e909437c96a329dd6a87e474 P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:26.321899 19431 raft_consensus.cc:3060] T 47b5cca5e909437c96a329dd6a87e474 P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:26.326756 19152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b5cca5e909437c96a329dd6a87e474" candidate_uuid: "ecd798a306df4905858bf774b6cd98f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5cd38daa04940ac97f9037e3241cdaf" is_pre_election: true
I20260709 12:28:26.327860 19152 raft_consensus.cc:2468] T 47b5cca5e909437c96a329dd6a87e474 P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd798a306df4905858bf774b6cd98f3 in term 0.
I20260709 12:28:26.328476 19444 tablet_bootstrap.cc:492] T 345ac35ca3d140d3ab3ba9fc108a930b P a5cd38daa04940ac97f9037e3241cdaf: No bootstrap required, opened a new log
I20260709 12:28:26.329842 19444 ts_tablet_manager.cc:1403] T 345ac35ca3d140d3ab3ba9fc108a930b P a5cd38daa04940ac97f9037e3241cdaf: Time spent bootstrapping tablet: real 0.042s	user 0.026s	sys 0.008s
I20260709 12:28:26.332597 19450 raft_consensus.cc:493] T e2cf09feaca24068a727752850983ac5 P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:26.333288 19450 raft_consensus.cc:515] T e2cf09feaca24068a727752850983ac5 P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.335449 19444 raft_consensus.cc:359] T 345ac35ca3d140d3ab3ba9fc108a930b P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.336680 19444 raft_consensus.cc:385] T 345ac35ca3d140d3ab3ba9fc108a930b P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:26.337090 19444 raft_consensus.cc:740] T 345ac35ca3d140d3ab3ba9fc108a930b P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5cd38daa04940ac97f9037e3241cdaf, State: Initialized, Role: FOLLOWER
I20260709 12:28:26.337935 19152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2cf09feaca24068a727752850983ac5" candidate_uuid: "595ece3316774e33930c4ef7923b8dc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5cd38daa04940ac97f9037e3241cdaf" is_pre_election: true
I20260709 12:28:26.338209 19444 consensus_queue.cc:260] T 345ac35ca3d140d3ab3ba9fc108a930b P a5cd38daa04940ac97f9037e3241cdaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.342047 19444 ts_tablet_manager.cc:1434] T 345ac35ca3d140d3ab3ba9fc108a930b P a5cd38daa04940ac97f9037e3241cdaf: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 12:28:26.338687 19152 raft_consensus.cc:2468] T e2cf09feaca24068a727752850983ac5 P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 595ece3316774e33930c4ef7923b8dc1 in term 0.
I20260709 12:28:26.340001 19443 tablet_bootstrap.cc:654] T 8d1007a33823446895ad5e0307fa4fff P 595ece3316774e33930c4ef7923b8dc1: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:26.344432 19450 leader_election.cc:290] T e2cf09feaca24068a727752850983ac5 P 595ece3316774e33930c4ef7923b8dc1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65:42503), ecd798a306df4905858bf774b6cd98f3 (127.9.116.67:37403)
I20260709 12:28:26.345754 19191 leader_election.cc:304] T e2cf09feaca24068a727752850983ac5 P 595ece3316774e33930c4ef7923b8dc1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 595ece3316774e33930c4ef7923b8dc1, a5cd38daa04940ac97f9037e3241cdaf; no voters: 
I20260709 12:28:26.346153 19444 tablet_bootstrap.cc:492] T 88011d359ca74cf18e222bdaed1978a0 P a5cd38daa04940ac97f9037e3241cdaf: Bootstrap starting.
I20260709 12:28:26.348219 19450 raft_consensus.cc:2804] T e2cf09feaca24068a727752850983ac5 P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:26.348865 19450 raft_consensus.cc:493] T e2cf09feaca24068a727752850983ac5 P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:26.352968 19450 raft_consensus.cc:3060] T e2cf09feaca24068a727752850983ac5 P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:26.348219 19301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2cf09feaca24068a727752850983ac5" candidate_uuid: "595ece3316774e33930c4ef7923b8dc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd798a306df4905858bf774b6cd98f3" is_pre_election: true
I20260709 12:28:26.354537 19301 raft_consensus.cc:2468] T e2cf09feaca24068a727752850983ac5 P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 595ece3316774e33930c4ef7923b8dc1 in term 0.
I20260709 12:28:26.355103 19444 tablet_bootstrap.cc:654] T 88011d359ca74cf18e222bdaed1978a0 P a5cd38daa04940ac97f9037e3241cdaf: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:26.356433 19442 tablet_bootstrap.cc:492] T 8d1007a33823446895ad5e0307fa4fff P ecd798a306df4905858bf774b6cd98f3: No bootstrap required, opened a new log
I20260709 12:28:26.357118 19442 ts_tablet_manager.cc:1403] T 8d1007a33823446895ad5e0307fa4fff P ecd798a306df4905858bf774b6cd98f3: Time spent bootstrapping tablet: real 0.073s	user 0.013s	sys 0.043s
I20260709 12:28:26.361203 19442 raft_consensus.cc:359] T 8d1007a33823446895ad5e0307fa4fff P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.362247 19442 raft_consensus.cc:385] T 8d1007a33823446895ad5e0307fa4fff P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:26.362715 19442 raft_consensus.cc:740] T 8d1007a33823446895ad5e0307fa4fff P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd798a306df4905858bf774b6cd98f3, State: Initialized, Role: FOLLOWER
I20260709 12:28:26.363731 19431 raft_consensus.cc:515] T 47b5cca5e909437c96a329dd6a87e474 P ecd798a306df4905858bf774b6cd98f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.363961 19442 consensus_queue.cc:260] T 8d1007a33823446895ad5e0307fa4fff P ecd798a306df4905858bf774b6cd98f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.367638 19152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b5cca5e909437c96a329dd6a87e474" candidate_uuid: "ecd798a306df4905858bf774b6cd98f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5cd38daa04940ac97f9037e3241cdaf"
I20260709 12:28:26.368376 19152 raft_consensus.cc:3060] T 47b5cca5e909437c96a329dd6a87e474 P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:26.372821 19450 raft_consensus.cc:515] T e2cf09feaca24068a727752850983ac5 P 595ece3316774e33930c4ef7923b8dc1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.375419 19442 ts_tablet_manager.cc:1434] T 8d1007a33823446895ad5e0307fa4fff P ecd798a306df4905858bf774b6cd98f3: Time spent starting tablet: real 0.018s	user 0.016s	sys 0.001s
I20260709 12:28:26.378551 19442 tablet_bootstrap.cc:492] T 1e372667da904e65aa5d7c5345b08fca P ecd798a306df4905858bf774b6cd98f3: Bootstrap starting.
I20260709 12:28:26.380781 19450 leader_election.cc:290] T e2cf09feaca24068a727752850983ac5 P 595ece3316774e33930c4ef7923b8dc1 [CANDIDATE]: Term 1 election: Requested vote from peers a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65:42503), ecd798a306df4905858bf774b6cd98f3 (127.9.116.67:37403)
I20260709 12:28:26.380630 19151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2cf09feaca24068a727752850983ac5" candidate_uuid: "595ece3316774e33930c4ef7923b8dc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5cd38daa04940ac97f9037e3241cdaf"
I20260709 12:28:26.382076 19151 raft_consensus.cc:3060] T e2cf09feaca24068a727752850983ac5 P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:26.387262 19301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2cf09feaca24068a727752850983ac5" candidate_uuid: "595ece3316774e33930c4ef7923b8dc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd798a306df4905858bf774b6cd98f3"
I20260709 12:28:26.388057 19301 raft_consensus.cc:3060] T e2cf09feaca24068a727752850983ac5 P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:26.392650 19152 raft_consensus.cc:2468] T 47b5cca5e909437c96a329dd6a87e474 P a5cd38daa04940ac97f9037e3241cdaf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd798a306df4905858bf774b6cd98f3 in term 1.
I20260709 12:28:26.395817 19226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b5cca5e909437c96a329dd6a87e474" candidate_uuid: "ecd798a306df4905858bf774b6cd98f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "595ece3316774e33930c4ef7923b8dc1"
I20260709 12:28:26.396526 19226 raft_consensus.cc:3060] T 47b5cca5e909437c96a329dd6a87e474 P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:26.396363 19265 leader_election.cc:304] T 47b5cca5e909437c96a329dd6a87e474 P ecd798a306df4905858bf774b6cd98f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a5cd38daa04940ac97f9037e3241cdaf, ecd798a306df4905858bf774b6cd98f3; no voters: 
I20260709 12:28:26.399387 19456 raft_consensus.cc:2804] T 47b5cca5e909437c96a329dd6a87e474 P ecd798a306df4905858bf774b6cd98f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:26.400360 19456 raft_consensus.cc:697] T 47b5cca5e909437c96a329dd6a87e474 P ecd798a306df4905858bf774b6cd98f3 [term 1 LEADER]: Becoming Leader. State: Replica: ecd798a306df4905858bf774b6cd98f3, State: Running, Role: LEADER
I20260709 12:28:26.401356 19456 consensus_queue.cc:237] T 47b5cca5e909437c96a329dd6a87e474 P ecd798a306df4905858bf774b6cd98f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.403616 19151 raft_consensus.cc:2468] T e2cf09feaca24068a727752850983ac5 P a5cd38daa04940ac97f9037e3241cdaf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 595ece3316774e33930c4ef7923b8dc1 in term 1.
I20260709 12:28:26.407092 19226 raft_consensus.cc:2468] T 47b5cca5e909437c96a329dd6a87e474 P 595ece3316774e33930c4ef7923b8dc1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd798a306df4905858bf774b6cd98f3 in term 1.
I20260709 12:28:26.408164 19301 raft_consensus.cc:2468] T e2cf09feaca24068a727752850983ac5 P ecd798a306df4905858bf774b6cd98f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 595ece3316774e33930c4ef7923b8dc1 in term 1.
I20260709 12:28:26.408589 19191 leader_election.cc:304] T e2cf09feaca24068a727752850983ac5 P 595ece3316774e33930c4ef7923b8dc1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 595ece3316774e33930c4ef7923b8dc1, a5cd38daa04940ac97f9037e3241cdaf; no voters: 
I20260709 12:28:26.418043 19442 tablet_bootstrap.cc:654] T 1e372667da904e65aa5d7c5345b08fca P ecd798a306df4905858bf774b6cd98f3: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:26.420816 19428 raft_consensus.cc:2804] T e2cf09feaca24068a727752850983ac5 P 595ece3316774e33930c4ef7923b8dc1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:26.421471 19428 raft_consensus.cc:697] T e2cf09feaca24068a727752850983ac5 P 595ece3316774e33930c4ef7923b8dc1 [term 1 LEADER]: Becoming Leader. State: Replica: 595ece3316774e33930c4ef7923b8dc1, State: Running, Role: LEADER
I20260709 12:28:26.422405 19428 consensus_queue.cc:237] T e2cf09feaca24068a727752850983ac5 P 595ece3316774e33930c4ef7923b8dc1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.429435 19442 tablet_bootstrap.cc:492] T 1e372667da904e65aa5d7c5345b08fca P ecd798a306df4905858bf774b6cd98f3: No bootstrap required, opened a new log
I20260709 12:28:26.407358 19431 leader_election.cc:290] T 47b5cca5e909437c96a329dd6a87e474 P ecd798a306df4905858bf774b6cd98f3 [CANDIDATE]: Term 1 election: Requested vote from peers a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65:42503), 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66:37433)
I20260709 12:28:26.433130 19442 ts_tablet_manager.cc:1403] T 1e372667da904e65aa5d7c5345b08fca P ecd798a306df4905858bf774b6cd98f3: Time spent bootstrapping tablet: real 0.055s	user 0.024s	sys 0.003s
I20260709 12:28:26.437777 19443 tablet_bootstrap.cc:492] T 8d1007a33823446895ad5e0307fa4fff P 595ece3316774e33930c4ef7923b8dc1: No bootstrap required, opened a new log
I20260709 12:28:26.438691 19443 ts_tablet_manager.cc:1403] T 8d1007a33823446895ad5e0307fa4fff P 595ece3316774e33930c4ef7923b8dc1: Time spent bootstrapping tablet: real 0.135s	user 0.009s	sys 0.008s
I20260709 12:28:26.437992 19442 raft_consensus.cc:359] T 1e372667da904e65aa5d7c5345b08fca P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.447570 19442 raft_consensus.cc:385] T 1e372667da904e65aa5d7c5345b08fca P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:26.447997 19442 raft_consensus.cc:740] T 1e372667da904e65aa5d7c5345b08fca P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd798a306df4905858bf774b6cd98f3, State: Initialized, Role: FOLLOWER
I20260709 12:28:26.447700 19047 catalog_manager.cc:5697] T e2cf09feaca24068a727752850983ac5 P 595ece3316774e33930c4ef7923b8dc1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66). New cstate: current_term: 1 leader_uuid: "595ece3316774e33930c4ef7923b8dc1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:26.448832 19442 consensus_queue.cc:260] T 1e372667da904e65aa5d7c5345b08fca P ecd798a306df4905858bf774b6cd98f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.451314 19442 ts_tablet_manager.cc:1434] T 1e372667da904e65aa5d7c5345b08fca P ecd798a306df4905858bf774b6cd98f3: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 12:28:26.452445 19442 tablet_bootstrap.cc:492] T 345ac35ca3d140d3ab3ba9fc108a930b P ecd798a306df4905858bf774b6cd98f3: Bootstrap starting.
I20260709 12:28:26.453110 19050 catalog_manager.cc:5697] T 47b5cca5e909437c96a329dd6a87e474 P ecd798a306df4905858bf774b6cd98f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to ecd798a306df4905858bf774b6cd98f3 (127.9.116.67). New cstate: current_term: 1 leader_uuid: "ecd798a306df4905858bf774b6cd98f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:26.454800 19443 raft_consensus.cc:359] T 8d1007a33823446895ad5e0307fa4fff P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.456482 19443 raft_consensus.cc:385] T 8d1007a33823446895ad5e0307fa4fff P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:26.457315 19443 raft_consensus.cc:740] T 8d1007a33823446895ad5e0307fa4fff P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 595ece3316774e33930c4ef7923b8dc1, State: Initialized, Role: FOLLOWER
I20260709 12:28:26.457971 19444 tablet_bootstrap.cc:492] T 88011d359ca74cf18e222bdaed1978a0 P a5cd38daa04940ac97f9037e3241cdaf: No bootstrap required, opened a new log
I20260709 12:28:26.458602 19444 ts_tablet_manager.cc:1403] T 88011d359ca74cf18e222bdaed1978a0 P a5cd38daa04940ac97f9037e3241cdaf: Time spent bootstrapping tablet: real 0.115s	user 0.040s	sys 0.056s
I20260709 12:28:26.459025 19443 consensus_queue.cc:260] T 8d1007a33823446895ad5e0307fa4fff P 595ece3316774e33930c4ef7923b8dc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.459940 19442 tablet_bootstrap.cc:654] T 345ac35ca3d140d3ab3ba9fc108a930b P ecd798a306df4905858bf774b6cd98f3: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:26.462292 19443 ts_tablet_manager.cc:1434] T 8d1007a33823446895ad5e0307fa4fff P 595ece3316774e33930c4ef7923b8dc1: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.001s
I20260709 12:28:26.462189 19444 raft_consensus.cc:359] T 88011d359ca74cf18e222bdaed1978a0 P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.463459 19444 raft_consensus.cc:385] T 88011d359ca74cf18e222bdaed1978a0 P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:26.463935 19443 tablet_bootstrap.cc:492] T 0fd8240043ac467eb287176c4f2e97e7 P 595ece3316774e33930c4ef7923b8dc1: Bootstrap starting.
I20260709 12:28:26.463920 19444 raft_consensus.cc:740] T 88011d359ca74cf18e222bdaed1978a0 P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5cd38daa04940ac97f9037e3241cdaf, State: Initialized, Role: FOLLOWER
I20260709 12:28:26.466156 19444 consensus_queue.cc:260] T 88011d359ca74cf18e222bdaed1978a0 P a5cd38daa04940ac97f9037e3241cdaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.469759 19444 ts_tablet_manager.cc:1434] T 88011d359ca74cf18e222bdaed1978a0 P a5cd38daa04940ac97f9037e3241cdaf: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.004s
I20260709 12:28:26.471051 19444 tablet_bootstrap.cc:492] T 8d1007a33823446895ad5e0307fa4fff P a5cd38daa04940ac97f9037e3241cdaf: Bootstrap starting.
I20260709 12:28:26.479283 19444 tablet_bootstrap.cc:654] T 8d1007a33823446895ad5e0307fa4fff P a5cd38daa04940ac97f9037e3241cdaf: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:26.487538 19443 tablet_bootstrap.cc:654] T 0fd8240043ac467eb287176c4f2e97e7 P 595ece3316774e33930c4ef7923b8dc1: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:26.502077 19442 tablet_bootstrap.cc:492] T 345ac35ca3d140d3ab3ba9fc108a930b P ecd798a306df4905858bf774b6cd98f3: No bootstrap required, opened a new log
I20260709 12:28:26.502836 19442 ts_tablet_manager.cc:1403] T 345ac35ca3d140d3ab3ba9fc108a930b P ecd798a306df4905858bf774b6cd98f3: Time spent bootstrapping tablet: real 0.051s	user 0.029s	sys 0.015s
I20260709 12:28:26.504451 19444 tablet_bootstrap.cc:492] T 8d1007a33823446895ad5e0307fa4fff P a5cd38daa04940ac97f9037e3241cdaf: No bootstrap required, opened a new log
I20260709 12:28:26.505487 19444 ts_tablet_manager.cc:1403] T 8d1007a33823446895ad5e0307fa4fff P a5cd38daa04940ac97f9037e3241cdaf: Time spent bootstrapping tablet: real 0.035s	user 0.010s	sys 0.012s
I20260709 12:28:26.509727 19444 raft_consensus.cc:359] T 8d1007a33823446895ad5e0307fa4fff P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.510630 19444 raft_consensus.cc:385] T 8d1007a33823446895ad5e0307fa4fff P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:26.510972 19444 raft_consensus.cc:740] T 8d1007a33823446895ad5e0307fa4fff P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5cd38daa04940ac97f9037e3241cdaf, State: Initialized, Role: FOLLOWER
I20260709 12:28:26.511818 19444 consensus_queue.cc:260] T 8d1007a33823446895ad5e0307fa4fff P a5cd38daa04940ac97f9037e3241cdaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.514396 19444 ts_tablet_manager.cc:1434] T 8d1007a33823446895ad5e0307fa4fff P a5cd38daa04940ac97f9037e3241cdaf: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 12:28:26.515452 19444 tablet_bootstrap.cc:492] T 7c21e55b8c694512b0ed942898b2749d P a5cd38daa04940ac97f9037e3241cdaf: Bootstrap starting.
I20260709 12:28:26.517176 19443 tablet_bootstrap.cc:492] T 0fd8240043ac467eb287176c4f2e97e7 P 595ece3316774e33930c4ef7923b8dc1: No bootstrap required, opened a new log
I20260709 12:28:26.518077 19443 ts_tablet_manager.cc:1403] T 0fd8240043ac467eb287176c4f2e97e7 P 595ece3316774e33930c4ef7923b8dc1: Time spent bootstrapping tablet: real 0.055s	user 0.013s	sys 0.008s
I20260709 12:28:26.521971 19456 raft_consensus.cc:493] T 8d1007a33823446895ad5e0307fa4fff P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:26.523233 19444 tablet_bootstrap.cc:654] T 7c21e55b8c694512b0ed942898b2749d P a5cd38daa04940ac97f9037e3241cdaf: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:26.523013 19456 raft_consensus.cc:515] T 8d1007a33823446895ad5e0307fa4fff P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.528203 19151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1007a33823446895ad5e0307fa4fff" candidate_uuid: "ecd798a306df4905858bf774b6cd98f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5cd38daa04940ac97f9037e3241cdaf" is_pre_election: true
I20260709 12:28:26.528551 19226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1007a33823446895ad5e0307fa4fff" candidate_uuid: "ecd798a306df4905858bf774b6cd98f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "595ece3316774e33930c4ef7923b8dc1" is_pre_election: true
I20260709 12:28:26.529259 19151 raft_consensus.cc:2468] T 8d1007a33823446895ad5e0307fa4fff P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd798a306df4905858bf774b6cd98f3 in term 0.
I20260709 12:28:26.529573 19226 raft_consensus.cc:2468] T 8d1007a33823446895ad5e0307fa4fff P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd798a306df4905858bf774b6cd98f3 in term 0.
I20260709 12:28:26.531283 19266 leader_election.cc:304] T 8d1007a33823446895ad5e0307fa4fff P ecd798a306df4905858bf774b6cd98f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 595ece3316774e33930c4ef7923b8dc1, ecd798a306df4905858bf774b6cd98f3; no voters: 
I20260709 12:28:26.532476 19431 raft_consensus.cc:2804] T 8d1007a33823446895ad5e0307fa4fff P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:26.532771 19456 leader_election.cc:290] T 8d1007a33823446895ad5e0307fa4fff P ecd798a306df4905858bf774b6cd98f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65:42503), 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66:37433)
I20260709 12:28:26.532888 19431 raft_consensus.cc:493] T 8d1007a33823446895ad5e0307fa4fff P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:26.533368 19431 raft_consensus.cc:3060] T 8d1007a33823446895ad5e0307fa4fff P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:26.535295 19443 raft_consensus.cc:359] T 0fd8240043ac467eb287176c4f2e97e7 P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.536161 19443 raft_consensus.cc:385] T 0fd8240043ac467eb287176c4f2e97e7 P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:26.536476 19443 raft_consensus.cc:740] T 0fd8240043ac467eb287176c4f2e97e7 P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 595ece3316774e33930c4ef7923b8dc1, State: Initialized, Role: FOLLOWER
I20260709 12:28:26.537299 19443 consensus_queue.cc:260] T 0fd8240043ac467eb287176c4f2e97e7 P 595ece3316774e33930c4ef7923b8dc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.509330 19442 raft_consensus.cc:359] T 345ac35ca3d140d3ab3ba9fc108a930b P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.540009 19442 raft_consensus.cc:385] T 345ac35ca3d140d3ab3ba9fc108a930b P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:26.540479 19442 raft_consensus.cc:740] T 345ac35ca3d140d3ab3ba9fc108a930b P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd798a306df4905858bf774b6cd98f3, State: Initialized, Role: FOLLOWER
I20260709 12:28:26.541426 19442 consensus_queue.cc:260] T 345ac35ca3d140d3ab3ba9fc108a930b P ecd798a306df4905858bf774b6cd98f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.543295 19444 tablet_bootstrap.cc:492] T 7c21e55b8c694512b0ed942898b2749d P a5cd38daa04940ac97f9037e3241cdaf: No bootstrap required, opened a new log
I20260709 12:28:26.543969 19444 ts_tablet_manager.cc:1403] T 7c21e55b8c694512b0ed942898b2749d P a5cd38daa04940ac97f9037e3241cdaf: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.015s
I20260709 12:28:26.544590 19442 ts_tablet_manager.cc:1434] T 345ac35ca3d140d3ab3ba9fc108a930b P ecd798a306df4905858bf774b6cd98f3: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.004s
I20260709 12:28:26.545925 19442 tablet_bootstrap.cc:492] T 88011d359ca74cf18e222bdaed1978a0 P ecd798a306df4905858bf774b6cd98f3: Bootstrap starting.
I20260709 12:28:26.546779 19444 raft_consensus.cc:359] T 7c21e55b8c694512b0ed942898b2749d P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.547475 19444 raft_consensus.cc:385] T 7c21e55b8c694512b0ed942898b2749d P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:26.547077 19431 raft_consensus.cc:515] T 8d1007a33823446895ad5e0307fa4fff P ecd798a306df4905858bf774b6cd98f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.547849 19444 raft_consensus.cc:740] T 7c21e55b8c694512b0ed942898b2749d P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5cd38daa04940ac97f9037e3241cdaf, State: Initialized, Role: FOLLOWER
I20260709 12:28:26.548683 19444 consensus_queue.cc:260] T 7c21e55b8c694512b0ed942898b2749d P a5cd38daa04940ac97f9037e3241cdaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.551254 19444 ts_tablet_manager.cc:1434] T 7c21e55b8c694512b0ed942898b2749d P a5cd38daa04940ac97f9037e3241cdaf: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:28:26.551007 19151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1007a33823446895ad5e0307fa4fff" candidate_uuid: "ecd798a306df4905858bf774b6cd98f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5cd38daa04940ac97f9037e3241cdaf"
I20260709 12:28:26.551852 19151 raft_consensus.cc:3060] T 8d1007a33823446895ad5e0307fa4fff P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:26.552066 19443 ts_tablet_manager.cc:1434] T 0fd8240043ac467eb287176c4f2e97e7 P 595ece3316774e33930c4ef7923b8dc1: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 12:28:26.552508 19444 tablet_bootstrap.cc:492] T 84655933e2a8465d8aede7f18c893cad P a5cd38daa04940ac97f9037e3241cdaf: Bootstrap starting.
I20260709 12:28:26.553184 19443 tablet_bootstrap.cc:492] T 7c21e55b8c694512b0ed942898b2749d P 595ece3316774e33930c4ef7923b8dc1: Bootstrap starting.
I20260709 12:28:26.555342 19431 leader_election.cc:290] T 8d1007a33823446895ad5e0307fa4fff P ecd798a306df4905858bf774b6cd98f3 [CANDIDATE]: Term 1 election: Requested vote from peers a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65:42503), 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66:37433)
I20260709 12:28:26.556013 19226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1007a33823446895ad5e0307fa4fff" candidate_uuid: "ecd798a306df4905858bf774b6cd98f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "595ece3316774e33930c4ef7923b8dc1"
I20260709 12:28:26.557163 19226 raft_consensus.cc:3060] T 8d1007a33823446895ad5e0307fa4fff P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:26.562243 19444 tablet_bootstrap.cc:654] T 84655933e2a8465d8aede7f18c893cad P a5cd38daa04940ac97f9037e3241cdaf: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:26.564201 19151 raft_consensus.cc:2468] T 8d1007a33823446895ad5e0307fa4fff P a5cd38daa04940ac97f9037e3241cdaf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd798a306df4905858bf774b6cd98f3 in term 1.
I20260709 12:28:26.566079 19265 leader_election.cc:304] T 8d1007a33823446895ad5e0307fa4fff P ecd798a306df4905858bf774b6cd98f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a5cd38daa04940ac97f9037e3241cdaf, ecd798a306df4905858bf774b6cd98f3; no voters: 
I20260709 12:28:26.567252 19431 raft_consensus.cc:2804] T 8d1007a33823446895ad5e0307fa4fff P ecd798a306df4905858bf774b6cd98f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:26.567852 19431 raft_consensus.cc:697] T 8d1007a33823446895ad5e0307fa4fff P ecd798a306df4905858bf774b6cd98f3 [term 1 LEADER]: Becoming Leader. State: Replica: ecd798a306df4905858bf774b6cd98f3, State: Running, Role: LEADER
I20260709 12:28:26.568778 19459 raft_consensus.cc:493] T 345ac35ca3d140d3ab3ba9fc108a930b P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:26.568720 19431 consensus_queue.cc:237] T 8d1007a33823446895ad5e0307fa4fff P ecd798a306df4905858bf774b6cd98f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.569442 19459 raft_consensus.cc:515] T 345ac35ca3d140d3ab3ba9fc108a930b P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.571092 19226 raft_consensus.cc:2468] T 8d1007a33823446895ad5e0307fa4fff P 595ece3316774e33930c4ef7923b8dc1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd798a306df4905858bf774b6cd98f3 in term 1.
I20260709 12:28:26.572692 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "345ac35ca3d140d3ab3ba9fc108a930b" candidate_uuid: "ecd798a306df4905858bf774b6cd98f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "595ece3316774e33930c4ef7923b8dc1" is_pre_election: true
I20260709 12:28:26.571406 19459 leader_election.cc:290] T 345ac35ca3d140d3ab3ba9fc108a930b P ecd798a306df4905858bf774b6cd98f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65:42503), 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66:37433)
W20260709 12:28:26.580394 19266 leader_election.cc:343] T 345ac35ca3d140d3ab3ba9fc108a930b P ecd798a306df4905858bf774b6cd98f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66:37433): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:26.584528 19442 tablet_bootstrap.cc:654] T 88011d359ca74cf18e222bdaed1978a0 P ecd798a306df4905858bf774b6cd98f3: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:26.576288 19344 raft_consensus.cc:493] T 345ac35ca3d140d3ab3ba9fc108a930b P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:26.585559 19344 raft_consensus.cc:515] T 345ac35ca3d140d3ab3ba9fc108a930b P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.588255 19344 leader_election.cc:290] T 345ac35ca3d140d3ab3ba9fc108a930b P a5cd38daa04940ac97f9037e3241cdaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66:37433), ecd798a306df4905858bf774b6cd98f3 (127.9.116.67:37403)
I20260709 12:28:26.588295 19443 tablet_bootstrap.cc:654] T 7c21e55b8c694512b0ed942898b2749d P 595ece3316774e33930c4ef7923b8dc1: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:26.588492 19444 tablet_bootstrap.cc:492] T 84655933e2a8465d8aede7f18c893cad P a5cd38daa04940ac97f9037e3241cdaf: No bootstrap required, opened a new log
I20260709 12:28:26.589325 19444 ts_tablet_manager.cc:1403] T 84655933e2a8465d8aede7f18c893cad P a5cd38daa04940ac97f9037e3241cdaf: Time spent bootstrapping tablet: real 0.037s	user 0.016s	sys 0.008s
I20260709 12:28:26.590298 19226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "345ac35ca3d140d3ab3ba9fc108a930b" candidate_uuid: "a5cd38daa04940ac97f9037e3241cdaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "595ece3316774e33930c4ef7923b8dc1" is_pre_election: true
I20260709 12:28:26.591163 19301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "345ac35ca3d140d3ab3ba9fc108a930b" candidate_uuid: "a5cd38daa04940ac97f9037e3241cdaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd798a306df4905858bf774b6cd98f3" is_pre_election: true
I20260709 12:28:26.591884 19301 raft_consensus.cc:2468] T 345ac35ca3d140d3ab3ba9fc108a930b P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a5cd38daa04940ac97f9037e3241cdaf in term 0.
I20260709 12:28:26.592183 19442 tablet_bootstrap.cc:492] T 88011d359ca74cf18e222bdaed1978a0 P ecd798a306df4905858bf774b6cd98f3: No bootstrap required, opened a new log
I20260709 12:28:26.592936 19442 ts_tablet_manager.cc:1403] T 88011d359ca74cf18e222bdaed1978a0 P ecd798a306df4905858bf774b6cd98f3: Time spent bootstrapping tablet: real 0.047s	user 0.014s	sys 0.000s
W20260709 12:28:26.593449 19117 leader_election.cc:343] T 345ac35ca3d140d3ab3ba9fc108a930b P a5cd38daa04940ac97f9037e3241cdaf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66:37433): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:26.594208 19428 raft_consensus.cc:493] T 88011d359ca74cf18e222bdaed1978a0 P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:26.594743 19428 raft_consensus.cc:515] T 88011d359ca74cf18e222bdaed1978a0 P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.594230 19117 leader_election.cc:304] T 345ac35ca3d140d3ab3ba9fc108a930b P a5cd38daa04940ac97f9037e3241cdaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a5cd38daa04940ac97f9037e3241cdaf, ecd798a306df4905858bf774b6cd98f3; no voters: 595ece3316774e33930c4ef7923b8dc1
I20260709 12:28:26.597208 19428 leader_election.cc:290] T 88011d359ca74cf18e222bdaed1978a0 P 595ece3316774e33930c4ef7923b8dc1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65:42503), ecd798a306df4905858bf774b6cd98f3 (127.9.116.67:37403)
I20260709 12:28:26.593043 19444 raft_consensus.cc:359] T 84655933e2a8465d8aede7f18c893cad P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.598058 19444 raft_consensus.cc:385] T 84655933e2a8465d8aede7f18c893cad P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:26.598272 19152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88011d359ca74cf18e222bdaed1978a0" candidate_uuid: "595ece3316774e33930c4ef7923b8dc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5cd38daa04940ac97f9037e3241cdaf" is_pre_election: true
I20260709 12:28:26.598480 19444 raft_consensus.cc:740] T 84655933e2a8465d8aede7f18c893cad P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5cd38daa04940ac97f9037e3241cdaf, State: Initialized, Role: FOLLOWER
I20260709 12:28:26.598598 19442 raft_consensus.cc:359] T 88011d359ca74cf18e222bdaed1978a0 P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.599493 19444 consensus_queue.cc:260] T 84655933e2a8465d8aede7f18c893cad P a5cd38daa04940ac97f9037e3241cdaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.600087 19442 raft_consensus.cc:385] T 88011d359ca74cf18e222bdaed1978a0 P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:26.599015 19152 raft_consensus.cc:2468] T 88011d359ca74cf18e222bdaed1978a0 P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 595ece3316774e33930c4ef7923b8dc1 in term 0.
I20260709 12:28:26.600754 19442 raft_consensus.cc:740] T 88011d359ca74cf18e222bdaed1978a0 P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd798a306df4905858bf774b6cd98f3, State: Initialized, Role: FOLLOWER
I20260709 12:28:26.603165 19191 leader_election.cc:304] T 88011d359ca74cf18e222bdaed1978a0 P 595ece3316774e33930c4ef7923b8dc1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 595ece3316774e33930c4ef7923b8dc1, a5cd38daa04940ac97f9037e3241cdaf; no voters: 
I20260709 12:28:26.604593 19428 raft_consensus.cc:2804] T 88011d359ca74cf18e222bdaed1978a0 P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:26.605111 19428 raft_consensus.cc:493] T 88011d359ca74cf18e222bdaed1978a0 P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:26.605556 19428 raft_consensus.cc:3060] T 88011d359ca74cf18e222bdaed1978a0 P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:26.607995 19431 raft_consensus.cc:493] T 1e372667da904e65aa5d7c5345b08fca P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:26.608610 19431 raft_consensus.cc:515] T 1e372667da904e65aa5d7c5345b08fca P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.610299 19444 ts_tablet_manager.cc:1434] T 84655933e2a8465d8aede7f18c893cad P a5cd38daa04940ac97f9037e3241cdaf: Time spent starting tablet: real 0.021s	user 0.011s	sys 0.003s
I20260709 12:28:26.611002 19431 leader_election.cc:290] T 1e372667da904e65aa5d7c5345b08fca P ecd798a306df4905858bf774b6cd98f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65:42503), 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66:37433)
I20260709 12:28:26.611642 19444 tablet_bootstrap.cc:492] T 1e372667da904e65aa5d7c5345b08fca P a5cd38daa04940ac97f9037e3241cdaf: Bootstrap starting.
I20260709 12:28:26.602622 19442 consensus_queue.cc:260] T 88011d359ca74cf18e222bdaed1978a0 P ecd798a306df4905858bf774b6cd98f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.600661 19301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88011d359ca74cf18e222bdaed1978a0" candidate_uuid: "595ece3316774e33930c4ef7923b8dc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd798a306df4905858bf774b6cd98f3" is_pre_election: true
I20260709 12:28:26.613649 19301 raft_consensus.cc:2468] T 88011d359ca74cf18e222bdaed1978a0 P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 595ece3316774e33930c4ef7923b8dc1 in term 0.
I20260709 12:28:26.612834 19475 raft_consensus.cc:2804] T 345ac35ca3d140d3ab3ba9fc108a930b P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:26.614010 19226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e372667da904e65aa5d7c5345b08fca" candidate_uuid: "ecd798a306df4905858bf774b6cd98f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "595ece3316774e33930c4ef7923b8dc1" is_pre_election: true
I20260709 12:28:26.615835 19475 raft_consensus.cc:493] T 345ac35ca3d140d3ab3ba9fc108a930b P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:26.616343 19475 raft_consensus.cc:3060] T 345ac35ca3d140d3ab3ba9fc108a930b P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:28:26.617578 19266 leader_election.cc:343] T 1e372667da904e65aa5d7c5345b08fca P ecd798a306df4905858bf774b6cd98f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66:37433): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:26.618927 19442 ts_tablet_manager.cc:1434] T 88011d359ca74cf18e222bdaed1978a0 P ecd798a306df4905858bf774b6cd98f3: Time spent starting tablet: real 0.025s	user 0.014s	sys 0.000s
I20260709 12:28:26.621781 19442 tablet_bootstrap.cc:492] T 84655933e2a8465d8aede7f18c893cad P ecd798a306df4905858bf774b6cd98f3: Bootstrap starting.
I20260709 12:28:26.631035 19444 tablet_bootstrap.cc:654] T 1e372667da904e65aa5d7c5345b08fca P a5cd38daa04940ac97f9037e3241cdaf: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:26.636757 19475 raft_consensus.cc:515] T 345ac35ca3d140d3ab3ba9fc108a930b P a5cd38daa04940ac97f9037e3241cdaf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.639047 19442 tablet_bootstrap.cc:654] T 84655933e2a8465d8aede7f18c893cad P ecd798a306df4905858bf774b6cd98f3: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:26.623601 19152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e372667da904e65aa5d7c5345b08fca" candidate_uuid: "ecd798a306df4905858bf774b6cd98f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5cd38daa04940ac97f9037e3241cdaf" is_pre_election: true
W20260709 12:28:26.643970 19265 leader_election.cc:343] T 1e372667da904e65aa5d7c5345b08fca P ecd798a306df4905858bf774b6cd98f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65:42503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:26.644481 19265 leader_election.cc:304] T 1e372667da904e65aa5d7c5345b08fca P ecd798a306df4905858bf774b6cd98f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd798a306df4905858bf774b6cd98f3; no voters: 595ece3316774e33930c4ef7923b8dc1, a5cd38daa04940ac97f9037e3241cdaf
I20260709 12:28:26.644618 19475 leader_election.cc:290] T 345ac35ca3d140d3ab3ba9fc108a930b P a5cd38daa04940ac97f9037e3241cdaf [CANDIDATE]: Term 1 election: Requested vote from peers 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66:37433), ecd798a306df4905858bf774b6cd98f3 (127.9.116.67:37403)
I20260709 12:28:26.645895 19431 raft_consensus.cc:2749] T 1e372667da904e65aa5d7c5345b08fca P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:26.648506 19301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "345ac35ca3d140d3ab3ba9fc108a930b" candidate_uuid: "a5cd38daa04940ac97f9037e3241cdaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd798a306df4905858bf774b6cd98f3"
I20260709 12:28:26.648955 19226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "345ac35ca3d140d3ab3ba9fc108a930b" candidate_uuid: "a5cd38daa04940ac97f9037e3241cdaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "595ece3316774e33930c4ef7923b8dc1"
I20260709 12:28:26.649449 19301 raft_consensus.cc:3060] T 345ac35ca3d140d3ab3ba9fc108a930b P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:28:26.656121 19117 leader_election.cc:343] T 345ac35ca3d140d3ab3ba9fc108a930b P a5cd38daa04940ac97f9037e3241cdaf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66:37433): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:26.661631 19475 raft_consensus.cc:493] T 84655933e2a8465d8aede7f18c893cad P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:26.662006 19444 tablet_bootstrap.cc:492] T 1e372667da904e65aa5d7c5345b08fca P a5cd38daa04940ac97f9037e3241cdaf: No bootstrap required, opened a new log
I20260709 12:28:26.662669 19444 ts_tablet_manager.cc:1403] T 1e372667da904e65aa5d7c5345b08fca P a5cd38daa04940ac97f9037e3241cdaf: Time spent bootstrapping tablet: real 0.051s	user 0.013s	sys 0.000s
I20260709 12:28:26.662297 19475 raft_consensus.cc:515] T 84655933e2a8465d8aede7f18c893cad P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.664819 19475 leader_election.cc:290] T 84655933e2a8465d8aede7f18c893cad P a5cd38daa04940ac97f9037e3241cdaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66:37433), ecd798a306df4905858bf774b6cd98f3 (127.9.116.67:37403)
I20260709 12:28:26.669521 19226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84655933e2a8465d8aede7f18c893cad" candidate_uuid: "a5cd38daa04940ac97f9037e3241cdaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "595ece3316774e33930c4ef7923b8dc1" is_pre_election: true
I20260709 12:28:26.572386 19151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "345ac35ca3d140d3ab3ba9fc108a930b" candidate_uuid: "ecd798a306df4905858bf774b6cd98f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5cd38daa04940ac97f9037e3241cdaf" is_pre_election: true
W20260709 12:28:26.671298 19117 leader_election.cc:343] T 84655933e2a8465d8aede7f18c893cad P a5cd38daa04940ac97f9037e3241cdaf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66:37433): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:26.671787 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84655933e2a8465d8aede7f18c893cad" candidate_uuid: "a5cd38daa04940ac97f9037e3241cdaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd798a306df4905858bf774b6cd98f3" is_pre_election: true
I20260709 12:28:26.671321 19151 raft_consensus.cc:2393] T 345ac35ca3d140d3ab3ba9fc108a930b P a5cd38daa04940ac97f9037e3241cdaf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd798a306df4905858bf774b6cd98f3 in current term 1: Already voted for candidate a5cd38daa04940ac97f9037e3241cdaf in this term.
W20260709 12:28:26.675386 19117 leader_election.cc:343] T 84655933e2a8465d8aede7f18c893cad P a5cd38daa04940ac97f9037e3241cdaf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecd798a306df4905858bf774b6cd98f3 (127.9.116.67:37403): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:26.675853 19265 leader_election.cc:304] T 345ac35ca3d140d3ab3ba9fc108a930b P ecd798a306df4905858bf774b6cd98f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd798a306df4905858bf774b6cd98f3; no voters: 595ece3316774e33930c4ef7923b8dc1, a5cd38daa04940ac97f9037e3241cdaf
I20260709 12:28:26.676374 19117 leader_election.cc:304] T 84655933e2a8465d8aede7f18c893cad P a5cd38daa04940ac97f9037e3241cdaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a5cd38daa04940ac97f9037e3241cdaf; no voters: 595ece3316774e33930c4ef7923b8dc1, ecd798a306df4905858bf774b6cd98f3
I20260709 12:28:26.677266 19344 raft_consensus.cc:2749] T 84655933e2a8465d8aede7f18c893cad P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:26.666400 19444 raft_consensus.cc:359] T 1e372667da904e65aa5d7c5345b08fca P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.679266 19444 raft_consensus.cc:385] T 1e372667da904e65aa5d7c5345b08fca P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:26.679633 19444 raft_consensus.cc:740] T 1e372667da904e65aa5d7c5345b08fca P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5cd38daa04940ac97f9037e3241cdaf, State: Initialized, Role: FOLLOWER
I20260709 12:28:26.680382 19444 consensus_queue.cc:260] T 1e372667da904e65aa5d7c5345b08fca P a5cd38daa04940ac97f9037e3241cdaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.679351 19428 raft_consensus.cc:515] T 88011d359ca74cf18e222bdaed1978a0 P 595ece3316774e33930c4ef7923b8dc1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.683020 19444 ts_tablet_manager.cc:1434] T 1e372667da904e65aa5d7c5345b08fca P a5cd38daa04940ac97f9037e3241cdaf: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.003s
I20260709 12:28:26.685004 19301 raft_consensus.cc:2468] T 345ac35ca3d140d3ab3ba9fc108a930b P ecd798a306df4905858bf774b6cd98f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5cd38daa04940ac97f9037e3241cdaf in term 1.
I20260709 12:28:26.685869 19431 raft_consensus.cc:2749] T 345ac35ca3d140d3ab3ba9fc108a930b P ecd798a306df4905858bf774b6cd98f3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:26.686365 19117 leader_election.cc:304] T 345ac35ca3d140d3ab3ba9fc108a930b P a5cd38daa04940ac97f9037e3241cdaf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a5cd38daa04940ac97f9037e3241cdaf, ecd798a306df4905858bf774b6cd98f3; no voters: 595ece3316774e33930c4ef7923b8dc1
I20260709 12:28:26.687181 19444 tablet_bootstrap.cc:492] T 0fd8240043ac467eb287176c4f2e97e7 P a5cd38daa04940ac97f9037e3241cdaf: Bootstrap starting.
I20260709 12:28:26.687738 19344 raft_consensus.cc:2804] T 345ac35ca3d140d3ab3ba9fc108a930b P a5cd38daa04940ac97f9037e3241cdaf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:26.688627 19344 raft_consensus.cc:697] T 345ac35ca3d140d3ab3ba9fc108a930b P a5cd38daa04940ac97f9037e3241cdaf [term 1 LEADER]: Becoming Leader. State: Replica: a5cd38daa04940ac97f9037e3241cdaf, State: Running, Role: LEADER
I20260709 12:28:26.689443 19344 consensus_queue.cc:237] T 345ac35ca3d140d3ab3ba9fc108a930b P a5cd38daa04940ac97f9037e3241cdaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
W20260709 12:28:26.698791 19098 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:28:26.702898 19444 tablet_bootstrap.cc:654] T 0fd8240043ac467eb287176c4f2e97e7 P a5cd38daa04940ac97f9037e3241cdaf: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:26.705600 19301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88011d359ca74cf18e222bdaed1978a0" candidate_uuid: "595ece3316774e33930c4ef7923b8dc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd798a306df4905858bf774b6cd98f3"
I20260709 12:28:26.705646 19151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88011d359ca74cf18e222bdaed1978a0" candidate_uuid: "595ece3316774e33930c4ef7923b8dc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5cd38daa04940ac97f9037e3241cdaf"
I20260709 12:28:26.706254 19301 raft_consensus.cc:3060] T 88011d359ca74cf18e222bdaed1978a0 P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:26.706445 19151 raft_consensus.cc:3060] T 88011d359ca74cf18e222bdaed1978a0 P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:26.708501 19046 catalog_manager.cc:5697] T 8d1007a33823446895ad5e0307fa4fff P ecd798a306df4905858bf774b6cd98f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to ecd798a306df4905858bf774b6cd98f3 (127.9.116.67). New cstate: current_term: 1 leader_uuid: "ecd798a306df4905858bf774b6cd98f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:26.709259 19428 leader_election.cc:290] T 88011d359ca74cf18e222bdaed1978a0 P 595ece3316774e33930c4ef7923b8dc1 [CANDIDATE]: Term 1 election: Requested vote from peers a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65:42503), ecd798a306df4905858bf774b6cd98f3 (127.9.116.67:37403)
I20260709 12:28:26.711277 19442 tablet_bootstrap.cc:492] T 84655933e2a8465d8aede7f18c893cad P ecd798a306df4905858bf774b6cd98f3: No bootstrap required, opened a new log
I20260709 12:28:26.711611 19443 tablet_bootstrap.cc:492] T 7c21e55b8c694512b0ed942898b2749d P 595ece3316774e33930c4ef7923b8dc1: No bootstrap required, opened a new log
I20260709 12:28:26.712002 19442 ts_tablet_manager.cc:1403] T 84655933e2a8465d8aede7f18c893cad P ecd798a306df4905858bf774b6cd98f3: Time spent bootstrapping tablet: real 0.091s	user 0.022s	sys 0.036s
I20260709 12:28:26.712128 19443 ts_tablet_manager.cc:1403] T 7c21e55b8c694512b0ed942898b2749d P 595ece3316774e33930c4ef7923b8dc1: Time spent bootstrapping tablet: real 0.159s	user 0.035s	sys 0.047s
I20260709 12:28:26.714421 19301 raft_consensus.cc:2468] T 88011d359ca74cf18e222bdaed1978a0 P ecd798a306df4905858bf774b6cd98f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 595ece3316774e33930c4ef7923b8dc1 in term 1.
I20260709 12:28:26.715639 19192 leader_election.cc:304] T 88011d359ca74cf18e222bdaed1978a0 P 595ece3316774e33930c4ef7923b8dc1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 595ece3316774e33930c4ef7923b8dc1, ecd798a306df4905858bf774b6cd98f3; no voters: 
I20260709 12:28:26.715598 19442 raft_consensus.cc:359] T 84655933e2a8465d8aede7f18c893cad P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.717285 19428 raft_consensus.cc:2804] T 88011d359ca74cf18e222bdaed1978a0 P 595ece3316774e33930c4ef7923b8dc1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:26.717406 19442 raft_consensus.cc:385] T 84655933e2a8465d8aede7f18c893cad P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:26.717049 19443 raft_consensus.cc:359] T 7c21e55b8c694512b0ed942898b2749d P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.717935 19442 raft_consensus.cc:740] T 84655933e2a8465d8aede7f18c893cad P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd798a306df4905858bf774b6cd98f3, State: Initialized, Role: FOLLOWER
I20260709 12:28:26.718130 19428 raft_consensus.cc:697] T 88011d359ca74cf18e222bdaed1978a0 P 595ece3316774e33930c4ef7923b8dc1 [term 1 LEADER]: Becoming Leader. State: Replica: 595ece3316774e33930c4ef7923b8dc1, State: Running, Role: LEADER
I20260709 12:28:26.718940 19442 consensus_queue.cc:260] T 84655933e2a8465d8aede7f18c893cad P ecd798a306df4905858bf774b6cd98f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.719198 19428 consensus_queue.cc:237] T 88011d359ca74cf18e222bdaed1978a0 P 595ece3316774e33930c4ef7923b8dc1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.718127 19443 raft_consensus.cc:385] T 7c21e55b8c694512b0ed942898b2749d P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:26.720942 19443 raft_consensus.cc:740] T 7c21e55b8c694512b0ed942898b2749d P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 595ece3316774e33930c4ef7923b8dc1, State: Initialized, Role: FOLLOWER
I20260709 12:28:26.721772 19443 consensus_queue.cc:260] T 7c21e55b8c694512b0ed942898b2749d P 595ece3316774e33930c4ef7923b8dc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.722316 19442 ts_tablet_manager.cc:1434] T 84655933e2a8465d8aede7f18c893cad P ecd798a306df4905858bf774b6cd98f3: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:28:26.723465 19442 tablet_bootstrap.cc:492] T 0fd8240043ac467eb287176c4f2e97e7 P ecd798a306df4905858bf774b6cd98f3: Bootstrap starting.
I20260709 12:28:26.724428 19450 raft_consensus.cc:493] T 7c21e55b8c694512b0ed942898b2749d P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:26.724573 19443 ts_tablet_manager.cc:1434] T 7c21e55b8c694512b0ed942898b2749d P 595ece3316774e33930c4ef7923b8dc1: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 12:28:26.724967 19450 raft_consensus.cc:515] T 7c21e55b8c694512b0ed942898b2749d P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.725751 19443 tablet_bootstrap.cc:492] T 1e372667da904e65aa5d7c5345b08fca P 595ece3316774e33930c4ef7923b8dc1: Bootstrap starting.
I20260709 12:28:26.728309 19050 catalog_manager.cc:5697] T 345ac35ca3d140d3ab3ba9fc108a930b P a5cd38daa04940ac97f9037e3241cdaf reported cstate change: term changed from 0 to 1, leader changed from <none> to a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65). New cstate: current_term: 1 leader_uuid: "a5cd38daa04940ac97f9037e3241cdaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:26.729981 19152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c21e55b8c694512b0ed942898b2749d" candidate_uuid: "595ece3316774e33930c4ef7923b8dc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5cd38daa04940ac97f9037e3241cdaf" is_pre_election: true
I20260709 12:28:26.730741 19442 tablet_bootstrap.cc:654] T 0fd8240043ac467eb287176c4f2e97e7 P ecd798a306df4905858bf774b6cd98f3: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:26.730809 19152 raft_consensus.cc:2468] T 7c21e55b8c694512b0ed942898b2749d P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 595ece3316774e33930c4ef7923b8dc1 in term 0.
I20260709 12:28:26.732402 19444 tablet_bootstrap.cc:492] T 0fd8240043ac467eb287176c4f2e97e7 P a5cd38daa04940ac97f9037e3241cdaf: No bootstrap required, opened a new log
I20260709 12:28:26.732960 19444 ts_tablet_manager.cc:1403] T 0fd8240043ac467eb287176c4f2e97e7 P a5cd38daa04940ac97f9037e3241cdaf: Time spent bootstrapping tablet: real 0.046s	user 0.013s	sys 0.000s
I20260709 12:28:26.732800 19191 leader_election.cc:304] T 7c21e55b8c694512b0ed942898b2749d P 595ece3316774e33930c4ef7923b8dc1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 595ece3316774e33930c4ef7923b8dc1, a5cd38daa04940ac97f9037e3241cdaf; no voters: 
I20260709 12:28:26.734097 19449 raft_consensus.cc:2804] T 7c21e55b8c694512b0ed942898b2749d P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:26.734485 19449 raft_consensus.cc:493] T 7c21e55b8c694512b0ed942898b2749d P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:26.734823 19449 raft_consensus.cc:3060] T 7c21e55b8c694512b0ed942898b2749d P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:26.736948 19444 raft_consensus.cc:359] T 0fd8240043ac467eb287176c4f2e97e7 P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.738098 19444 raft_consensus.cc:385] T 0fd8240043ac467eb287176c4f2e97e7 P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:26.738456 19444 raft_consensus.cc:740] T 0fd8240043ac467eb287176c4f2e97e7 P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5cd38daa04940ac97f9037e3241cdaf, State: Initialized, Role: FOLLOWER
I20260709 12:28:26.739493 19444 consensus_queue.cc:260] T 0fd8240043ac467eb287176c4f2e97e7 P a5cd38daa04940ac97f9037e3241cdaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.742357 19444 ts_tablet_manager.cc:1434] T 0fd8240043ac467eb287176c4f2e97e7 P a5cd38daa04940ac97f9037e3241cdaf: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:28:26.744047 19344 raft_consensus.cc:493] T 0fd8240043ac467eb287176c4f2e97e7 P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:26.744613 19344 raft_consensus.cc:515] T 0fd8240043ac467eb287176c4f2e97e7 P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.748486 19443 tablet_bootstrap.cc:654] T 1e372667da904e65aa5d7c5345b08fca P 595ece3316774e33930c4ef7923b8dc1: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:26.747260 19344 leader_election.cc:290] T 0fd8240043ac467eb287176c4f2e97e7 P a5cd38daa04940ac97f9037e3241cdaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66:37433), ecd798a306df4905858bf774b6cd98f3 (127.9.116.67:37403)
I20260709 12:28:26.749349 19301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd8240043ac467eb287176c4f2e97e7" candidate_uuid: "a5cd38daa04940ac97f9037e3241cdaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd798a306df4905858bf774b6cd98f3" is_pre_election: true
I20260709 12:28:26.749807 19226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd8240043ac467eb287176c4f2e97e7" candidate_uuid: "a5cd38daa04940ac97f9037e3241cdaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "595ece3316774e33930c4ef7923b8dc1" is_pre_election: true
I20260709 12:28:26.750319 19450 leader_election.cc:290] T 7c21e55b8c694512b0ed942898b2749d P 595ece3316774e33930c4ef7923b8dc1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65:42503), ecd798a306df4905858bf774b6cd98f3 (127.9.116.67:37403)
I20260709 12:28:26.750483 19226 raft_consensus.cc:2468] T 0fd8240043ac467eb287176c4f2e97e7 P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a5cd38daa04940ac97f9037e3241cdaf in term 0.
W20260709 12:28:26.751175 19117 leader_election.cc:343] T 0fd8240043ac467eb287176c4f2e97e7 P a5cd38daa04940ac97f9037e3241cdaf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecd798a306df4905858bf774b6cd98f3 (127.9.116.67:37403): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:26.751833 19301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c21e55b8c694512b0ed942898b2749d" candidate_uuid: "595ece3316774e33930c4ef7923b8dc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd798a306df4905858bf774b6cd98f3" is_pre_election: true
I20260709 12:28:26.752574 19117 leader_election.cc:304] T 0fd8240043ac467eb287176c4f2e97e7 P a5cd38daa04940ac97f9037e3241cdaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 595ece3316774e33930c4ef7923b8dc1, a5cd38daa04940ac97f9037e3241cdaf; no voters: ecd798a306df4905858bf774b6cd98f3
W20260709 12:28:26.753506 19192 leader_election.cc:343] T 7c21e55b8c694512b0ed942898b2749d P 595ece3316774e33930c4ef7923b8dc1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecd798a306df4905858bf774b6cd98f3 (127.9.116.67:37403): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:26.754036 19344 raft_consensus.cc:2804] T 0fd8240043ac467eb287176c4f2e97e7 P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:26.754457 19344 raft_consensus.cc:493] T 0fd8240043ac467eb287176c4f2e97e7 P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:26.754848 19344 raft_consensus.cc:3060] T 0fd8240043ac467eb287176c4f2e97e7 P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:26.764828 19443 tablet_bootstrap.cc:492] T 1e372667da904e65aa5d7c5345b08fca P 595ece3316774e33930c4ef7923b8dc1: No bootstrap required, opened a new log
I20260709 12:28:26.765763 19443 ts_tablet_manager.cc:1403] T 1e372667da904e65aa5d7c5345b08fca P 595ece3316774e33930c4ef7923b8dc1: Time spent bootstrapping tablet: real 0.040s	user 0.009s	sys 0.013s
I20260709 12:28:26.771193 19443 raft_consensus.cc:359] T 1e372667da904e65aa5d7c5345b08fca P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.772375 19443 raft_consensus.cc:385] T 1e372667da904e65aa5d7c5345b08fca P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:26.772796 19443 raft_consensus.cc:740] T 1e372667da904e65aa5d7c5345b08fca P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 595ece3316774e33930c4ef7923b8dc1, State: Initialized, Role: FOLLOWER
I20260709 12:28:26.773869 19443 consensus_queue.cc:260] T 1e372667da904e65aa5d7c5345b08fca P 595ece3316774e33930c4ef7923b8dc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.778112 19443 ts_tablet_manager.cc:1434] T 1e372667da904e65aa5d7c5345b08fca P 595ece3316774e33930c4ef7923b8dc1: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 12:28:26.779810 19443 tablet_bootstrap.cc:492] T 345ac35ca3d140d3ab3ba9fc108a930b P 595ece3316774e33930c4ef7923b8dc1: Bootstrap starting.
I20260709 12:28:26.778327 19151 raft_consensus.cc:2468] T 88011d359ca74cf18e222bdaed1978a0 P a5cd38daa04940ac97f9037e3241cdaf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 595ece3316774e33930c4ef7923b8dc1 in term 1.
I20260709 12:28:26.765488 19449 raft_consensus.cc:515] T 7c21e55b8c694512b0ed942898b2749d P 595ece3316774e33930c4ef7923b8dc1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.787633 19449 leader_election.cc:290] T 7c21e55b8c694512b0ed942898b2749d P 595ece3316774e33930c4ef7923b8dc1 [CANDIDATE]: Term 1 election: Requested vote from peers a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65:42503), ecd798a306df4905858bf774b6cd98f3 (127.9.116.67:37403)
I20260709 12:28:26.789402 19301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c21e55b8c694512b0ed942898b2749d" candidate_uuid: "595ece3316774e33930c4ef7923b8dc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd798a306df4905858bf774b6cd98f3"
I20260709 12:28:26.790324 19344 raft_consensus.cc:515] T 0fd8240043ac467eb287176c4f2e97e7 P a5cd38daa04940ac97f9037e3241cdaf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
W20260709 12:28:26.791688 19192 leader_election.cc:343] T 7c21e55b8c694512b0ed942898b2749d P 595ece3316774e33930c4ef7923b8dc1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ecd798a306df4905858bf774b6cd98f3 (127.9.116.67:37403): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:26.793493 19344 leader_election.cc:290] T 0fd8240043ac467eb287176c4f2e97e7 P a5cd38daa04940ac97f9037e3241cdaf [CANDIDATE]: Term 1 election: Requested vote from peers 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66:37433), ecd798a306df4905858bf774b6cd98f3 (127.9.116.67:37403)
I20260709 12:28:26.792791 19151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c21e55b8c694512b0ed942898b2749d" candidate_uuid: "595ece3316774e33930c4ef7923b8dc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5cd38daa04940ac97f9037e3241cdaf"
I20260709 12:28:26.795048 19301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd8240043ac467eb287176c4f2e97e7" candidate_uuid: "a5cd38daa04940ac97f9037e3241cdaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd798a306df4905858bf774b6cd98f3"
I20260709 12:28:26.838591 19151 raft_consensus.cc:3060] T 7c21e55b8c694512b0ed942898b2749d P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:26.839264 19442 tablet_bootstrap.cc:492] T 0fd8240043ac467eb287176c4f2e97e7 P ecd798a306df4905858bf774b6cd98f3: No bootstrap required, opened a new log
I20260709 12:28:26.839360 19443 tablet_bootstrap.cc:654] T 345ac35ca3d140d3ab3ba9fc108a930b P 595ece3316774e33930c4ef7923b8dc1: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:26.840081 19442 ts_tablet_manager.cc:1403] T 0fd8240043ac467eb287176c4f2e97e7 P ecd798a306df4905858bf774b6cd98f3: Time spent bootstrapping tablet: real 0.117s	user 0.021s	sys 0.037s
I20260709 12:28:26.795533 19226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd8240043ac467eb287176c4f2e97e7" candidate_uuid: "a5cd38daa04940ac97f9037e3241cdaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "595ece3316774e33930c4ef7923b8dc1"
I20260709 12:28:26.843062 19226 raft_consensus.cc:3060] T 0fd8240043ac467eb287176c4f2e97e7 P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:26.843142 19442 raft_consensus.cc:359] T 0fd8240043ac467eb287176c4f2e97e7 P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.813133 19048 catalog_manager.cc:5697] T 88011d359ca74cf18e222bdaed1978a0 P 595ece3316774e33930c4ef7923b8dc1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66). New cstate: current_term: 1 leader_uuid: "595ece3316774e33930c4ef7923b8dc1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:26.844004 19442 raft_consensus.cc:385] T 0fd8240043ac467eb287176c4f2e97e7 P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:26.844357 19442 raft_consensus.cc:740] T 0fd8240043ac467eb287176c4f2e97e7 P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd798a306df4905858bf774b6cd98f3, State: Initialized, Role: FOLLOWER
I20260709 12:28:26.845095 19442 consensus_queue.cc:260] T 0fd8240043ac467eb287176c4f2e97e7 P ecd798a306df4905858bf774b6cd98f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
W20260709 12:28:26.847028 19117 leader_election.cc:343] T 0fd8240043ac467eb287176c4f2e97e7 P a5cd38daa04940ac97f9037e3241cdaf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ecd798a306df4905858bf774b6cd98f3 (127.9.116.67:37403): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:26.848023 19459 consensus_queue.cc:1048] T 47b5cca5e909437c96a329dd6a87e474 P ecd798a306df4905858bf774b6cd98f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:26.851856 19442 ts_tablet_manager.cc:1434] T 0fd8240043ac467eb287176c4f2e97e7 P ecd798a306df4905858bf774b6cd98f3: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:28:26.853257 19442 tablet_bootstrap.cc:492] T 7c21e55b8c694512b0ed942898b2749d P ecd798a306df4905858bf774b6cd98f3: Bootstrap starting.
I20260709 12:28:26.861881 19442 tablet_bootstrap.cc:654] T 7c21e55b8c694512b0ed942898b2749d P ecd798a306df4905858bf774b6cd98f3: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:26.863334 19443 tablet_bootstrap.cc:492] T 345ac35ca3d140d3ab3ba9fc108a930b P 595ece3316774e33930c4ef7923b8dc1: No bootstrap required, opened a new log
I20260709 12:28:26.864005 19443 ts_tablet_manager.cc:1403] T 345ac35ca3d140d3ab3ba9fc108a930b P 595ece3316774e33930c4ef7923b8dc1: Time spent bootstrapping tablet: real 0.085s	user 0.021s	sys 0.000s
I20260709 12:28:26.866847 19151 raft_consensus.cc:2468] T 7c21e55b8c694512b0ed942898b2749d P a5cd38daa04940ac97f9037e3241cdaf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 595ece3316774e33930c4ef7923b8dc1 in term 1.
I20260709 12:28:26.867934 19443 raft_consensus.cc:359] T 345ac35ca3d140d3ab3ba9fc108a930b P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.868702 19443 raft_consensus.cc:385] T 345ac35ca3d140d3ab3ba9fc108a930b P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:26.869015 19443 raft_consensus.cc:740] T 345ac35ca3d140d3ab3ba9fc108a930b P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 595ece3316774e33930c4ef7923b8dc1, State: Initialized, Role: FOLLOWER
I20260709 12:28:26.869742 19443 consensus_queue.cc:260] T 345ac35ca3d140d3ab3ba9fc108a930b P 595ece3316774e33930c4ef7923b8dc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.872139 19443 ts_tablet_manager.cc:1434] T 345ac35ca3d140d3ab3ba9fc108a930b P 595ece3316774e33930c4ef7923b8dc1: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:28:26.873076 19443 tablet_bootstrap.cc:492] T 84655933e2a8465d8aede7f18c893cad P 595ece3316774e33930c4ef7923b8dc1: Bootstrap starting.
I20260709 12:28:26.872871 19191 leader_election.cc:304] T 7c21e55b8c694512b0ed942898b2749d P 595ece3316774e33930c4ef7923b8dc1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 595ece3316774e33930c4ef7923b8dc1, a5cd38daa04940ac97f9037e3241cdaf; no voters: ecd798a306df4905858bf774b6cd98f3
I20260709 12:28:26.874215 19449 raft_consensus.cc:2804] T 7c21e55b8c694512b0ed942898b2749d P 595ece3316774e33930c4ef7923b8dc1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:26.874719 19449 raft_consensus.cc:697] T 7c21e55b8c694512b0ed942898b2749d P 595ece3316774e33930c4ef7923b8dc1 [term 1 LEADER]: Becoming Leader. State: Replica: 595ece3316774e33930c4ef7923b8dc1, State: Running, Role: LEADER
I20260709 12:28:26.875808 19449 consensus_queue.cc:237] T 7c21e55b8c694512b0ed942898b2749d P 595ece3316774e33930c4ef7923b8dc1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.881342 19443 tablet_bootstrap.cc:654] T 84655933e2a8465d8aede7f18c893cad P 595ece3316774e33930c4ef7923b8dc1: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:26.883545 19459 raft_consensus.cc:493] T 0fd8240043ac467eb287176c4f2e97e7 P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:26.884158 19459 raft_consensus.cc:515] T 0fd8240043ac467eb287176c4f2e97e7 P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.885298 19442 tablet_bootstrap.cc:492] T 7c21e55b8c694512b0ed942898b2749d P ecd798a306df4905858bf774b6cd98f3: No bootstrap required, opened a new log
I20260709 12:28:26.886358 19459 leader_election.cc:290] T 0fd8240043ac467eb287176c4f2e97e7 P ecd798a306df4905858bf774b6cd98f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65:42503), 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66:37433)
I20260709 12:28:26.888720 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd8240043ac467eb287176c4f2e97e7" candidate_uuid: "ecd798a306df4905858bf774b6cd98f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "595ece3316774e33930c4ef7923b8dc1" is_pre_election: true
I20260709 12:28:26.890542 19442 ts_tablet_manager.cc:1403] T 7c21e55b8c694512b0ed942898b2749d P ecd798a306df4905858bf774b6cd98f3: Time spent bootstrapping tablet: real 0.038s	user 0.014s	sys 0.004s
I20260709 12:28:26.891332 19428 consensus_queue.cc:1048] T e2cf09feaca24068a727752850983ac5 P 595ece3316774e33930c4ef7923b8dc1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:26.894912 19442 raft_consensus.cc:359] T 7c21e55b8c694512b0ed942898b2749d P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.896072 19442 raft_consensus.cc:385] T 7c21e55b8c694512b0ed942898b2749d P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:26.896423 19442 raft_consensus.cc:740] T 7c21e55b8c694512b0ed942898b2749d P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd798a306df4905858bf774b6cd98f3, State: Initialized, Role: FOLLOWER
I20260709 12:28:26.897267 19442 consensus_queue.cc:260] T 7c21e55b8c694512b0ed942898b2749d P ecd798a306df4905858bf774b6cd98f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.895001 19150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd8240043ac467eb287176c4f2e97e7" candidate_uuid: "ecd798a306df4905858bf774b6cd98f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5cd38daa04940ac97f9037e3241cdaf" is_pre_election: true
I20260709 12:28:26.899257 19150 raft_consensus.cc:2393] T 0fd8240043ac467eb287176c4f2e97e7 P a5cd38daa04940ac97f9037e3241cdaf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd798a306df4905858bf774b6cd98f3 in current term 1: Already voted for candidate a5cd38daa04940ac97f9037e3241cdaf in this term.
I20260709 12:28:26.900770 19442 ts_tablet_manager.cc:1434] T 7c21e55b8c694512b0ed942898b2749d P ecd798a306df4905858bf774b6cd98f3: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:28:26.901046 19265 leader_election.cc:304] T 0fd8240043ac467eb287176c4f2e97e7 P ecd798a306df4905858bf774b6cd98f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd798a306df4905858bf774b6cd98f3; no voters: 595ece3316774e33930c4ef7923b8dc1, a5cd38daa04940ac97f9037e3241cdaf
I20260709 12:28:26.902483 19459 raft_consensus.cc:3060] T 0fd8240043ac467eb287176c4f2e97e7 P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:26.904336 19443 tablet_bootstrap.cc:492] T 84655933e2a8465d8aede7f18c893cad P 595ece3316774e33930c4ef7923b8dc1: No bootstrap required, opened a new log
I20260709 12:28:26.904902 19443 ts_tablet_manager.cc:1403] T 84655933e2a8465d8aede7f18c893cad P 595ece3316774e33930c4ef7923b8dc1: Time spent bootstrapping tablet: real 0.032s	user 0.019s	sys 0.008s
I20260709 12:28:26.908087 19443 raft_consensus.cc:359] T 84655933e2a8465d8aede7f18c893cad P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.909189 19443 raft_consensus.cc:385] T 84655933e2a8465d8aede7f18c893cad P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:26.910601 19431 raft_consensus.cc:493] T 7c21e55b8c694512b0ed942898b2749d P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:26.911260 19431 raft_consensus.cc:515] T 7c21e55b8c694512b0ed942898b2749d P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.911981 19459 raft_consensus.cc:2749] T 0fd8240043ac467eb287176c4f2e97e7 P ecd798a306df4905858bf774b6cd98f3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:26.912684 19226 raft_consensus.cc:2468] T 0fd8240043ac467eb287176c4f2e97e7 P 595ece3316774e33930c4ef7923b8dc1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5cd38daa04940ac97f9037e3241cdaf in term 1.
I20260709 12:28:26.913693 19431 leader_election.cc:290] T 7c21e55b8c694512b0ed942898b2749d P ecd798a306df4905858bf774b6cd98f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65:42503), 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66:37433)
I20260709 12:28:26.914170 19117 leader_election.cc:304] T 0fd8240043ac467eb287176c4f2e97e7 P a5cd38daa04940ac97f9037e3241cdaf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 595ece3316774e33930c4ef7923b8dc1, a5cd38daa04940ac97f9037e3241cdaf; no voters: ecd798a306df4905858bf774b6cd98f3
I20260709 12:28:26.909868 19443 raft_consensus.cc:740] T 84655933e2a8465d8aede7f18c893cad P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 595ece3316774e33930c4ef7923b8dc1, State: Initialized, Role: FOLLOWER
I20260709 12:28:26.915827 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c21e55b8c694512b0ed942898b2749d" candidate_uuid: "ecd798a306df4905858bf774b6cd98f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "595ece3316774e33930c4ef7923b8dc1" is_pre_election: true
I20260709 12:28:26.915987 19476 raft_consensus.cc:2804] T 0fd8240043ac467eb287176c4f2e97e7 P a5cd38daa04940ac97f9037e3241cdaf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:26.916574 19443 consensus_queue.cc:260] T 84655933e2a8465d8aede7f18c893cad P 595ece3316774e33930c4ef7923b8dc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.917574 19476 raft_consensus.cc:697] T 0fd8240043ac467eb287176c4f2e97e7 P a5cd38daa04940ac97f9037e3241cdaf [term 1 LEADER]: Becoming Leader. State: Replica: a5cd38daa04940ac97f9037e3241cdaf, State: Running, Role: LEADER
I20260709 12:28:26.917428 19344 raft_consensus.cc:493] T 1e372667da904e65aa5d7c5345b08fca P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:26.918493 19344 raft_consensus.cc:515] T 1e372667da904e65aa5d7c5345b08fca P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.919072 19443 ts_tablet_manager.cc:1434] T 84655933e2a8465d8aede7f18c893cad P 595ece3316774e33930c4ef7923b8dc1: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:28:26.918602 19476 consensus_queue.cc:237] T 0fd8240043ac467eb287176c4f2e97e7 P a5cd38daa04940ac97f9037e3241cdaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.921017 19344 leader_election.cc:290] T 1e372667da904e65aa5d7c5345b08fca P a5cd38daa04940ac97f9037e3241cdaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66:37433), ecd798a306df4905858bf774b6cd98f3 (127.9.116.67:37403)
I20260709 12:28:26.922363 19301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e372667da904e65aa5d7c5345b08fca" candidate_uuid: "a5cd38daa04940ac97f9037e3241cdaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd798a306df4905858bf774b6cd98f3" is_pre_election: true
I20260709 12:28:26.923081 19301 raft_consensus.cc:2468] T 1e372667da904e65aa5d7c5345b08fca P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a5cd38daa04940ac97f9037e3241cdaf in term 0.
I20260709 12:28:26.923493 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e372667da904e65aa5d7c5345b08fca" candidate_uuid: "a5cd38daa04940ac97f9037e3241cdaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "595ece3316774e33930c4ef7923b8dc1" is_pre_election: true
I20260709 12:28:26.924309 19224 raft_consensus.cc:2468] T 1e372667da904e65aa5d7c5345b08fca P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a5cd38daa04940ac97f9037e3241cdaf in term 0.
I20260709 12:28:26.924687 19117 leader_election.cc:304] T 1e372667da904e65aa5d7c5345b08fca P a5cd38daa04940ac97f9037e3241cdaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a5cd38daa04940ac97f9037e3241cdaf, ecd798a306df4905858bf774b6cd98f3; no voters: 
I20260709 12:28:26.926568 19344 raft_consensus.cc:2804] T 1e372667da904e65aa5d7c5345b08fca P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:26.927701 19344 raft_consensus.cc:493] T 1e372667da904e65aa5d7c5345b08fca P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:26.928485 19344 raft_consensus.cc:3060] T 1e372667da904e65aa5d7c5345b08fca P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:26.934118 19151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c21e55b8c694512b0ed942898b2749d" candidate_uuid: "ecd798a306df4905858bf774b6cd98f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5cd38daa04940ac97f9037e3241cdaf" is_pre_election: true
I20260709 12:28:26.935376 19151 raft_consensus.cc:2393] T 7c21e55b8c694512b0ed942898b2749d P a5cd38daa04940ac97f9037e3241cdaf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecd798a306df4905858bf774b6cd98f3 in current term 1: Already voted for candidate 595ece3316774e33930c4ef7923b8dc1 in this term.
I20260709 12:28:26.936805 19265 leader_election.cc:304] T 7c21e55b8c694512b0ed942898b2749d P ecd798a306df4905858bf774b6cd98f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecd798a306df4905858bf774b6cd98f3; no voters: 595ece3316774e33930c4ef7923b8dc1, a5cd38daa04940ac97f9037e3241cdaf
I20260709 12:28:26.938129 19456 raft_consensus.cc:3060] T 7c21e55b8c694512b0ed942898b2749d P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:26.940683 19344 raft_consensus.cc:515] T 1e372667da904e65aa5d7c5345b08fca P a5cd38daa04940ac97f9037e3241cdaf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.942883 19344 leader_election.cc:290] T 1e372667da904e65aa5d7c5345b08fca P a5cd38daa04940ac97f9037e3241cdaf [CANDIDATE]: Term 1 election: Requested vote from peers 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66:37433), ecd798a306df4905858bf774b6cd98f3 (127.9.116.67:37403)
I20260709 12:28:26.944188 19226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e372667da904e65aa5d7c5345b08fca" candidate_uuid: "a5cd38daa04940ac97f9037e3241cdaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "595ece3316774e33930c4ef7923b8dc1"
I20260709 12:28:26.944396 19301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e372667da904e65aa5d7c5345b08fca" candidate_uuid: "a5cd38daa04940ac97f9037e3241cdaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd798a306df4905858bf774b6cd98f3"
I20260709 12:28:26.944983 19226 raft_consensus.cc:3060] T 1e372667da904e65aa5d7c5345b08fca P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:26.945045 19301 raft_consensus.cc:3060] T 1e372667da904e65aa5d7c5345b08fca P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:26.947618 19050 catalog_manager.cc:5697] T 0fd8240043ac467eb287176c4f2e97e7 P a5cd38daa04940ac97f9037e3241cdaf reported cstate change: term changed from 0 to 1, leader changed from <none> to a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65). New cstate: current_term: 1 leader_uuid: "a5cd38daa04940ac97f9037e3241cdaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:26.949698 19456 raft_consensus.cc:2749] T 7c21e55b8c694512b0ed942898b2749d P ecd798a306df4905858bf774b6cd98f3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:26.954114 19226 raft_consensus.cc:2468] T 1e372667da904e65aa5d7c5345b08fca P 595ece3316774e33930c4ef7923b8dc1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5cd38daa04940ac97f9037e3241cdaf in term 1.
I20260709 12:28:26.955013 19301 raft_consensus.cc:2468] T 1e372667da904e65aa5d7c5345b08fca P ecd798a306df4905858bf774b6cd98f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5cd38daa04940ac97f9037e3241cdaf in term 1.
I20260709 12:28:26.955834 19117 leader_election.cc:304] T 1e372667da904e65aa5d7c5345b08fca P a5cd38daa04940ac97f9037e3241cdaf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 595ece3316774e33930c4ef7923b8dc1, a5cd38daa04940ac97f9037e3241cdaf; no voters: 
I20260709 12:28:26.957715 19344 raft_consensus.cc:2804] T 1e372667da904e65aa5d7c5345b08fca P a5cd38daa04940ac97f9037e3241cdaf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:26.957754 19456 raft_consensus.cc:493] T 84655933e2a8465d8aede7f18c893cad P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:26.958850 19456 raft_consensus.cc:515] T 84655933e2a8465d8aede7f18c893cad P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.959851 19344 raft_consensus.cc:697] T 1e372667da904e65aa5d7c5345b08fca P a5cd38daa04940ac97f9037e3241cdaf [term 1 LEADER]: Becoming Leader. State: Replica: a5cd38daa04940ac97f9037e3241cdaf, State: Running, Role: LEADER
I20260709 12:28:26.960799 19344 consensus_queue.cc:237] T 1e372667da904e65aa5d7c5345b08fca P a5cd38daa04940ac97f9037e3241cdaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.961911 19459 consensus_queue.cc:1048] T 47b5cca5e909437c96a329dd6a87e474 P ecd798a306df4905858bf774b6cd98f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:26.963353 19456 leader_election.cc:290] T 84655933e2a8465d8aede7f18c893cad P ecd798a306df4905858bf774b6cd98f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65:42503), 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66:37433)
I20260709 12:28:26.967051 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84655933e2a8465d8aede7f18c893cad" candidate_uuid: "ecd798a306df4905858bf774b6cd98f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "595ece3316774e33930c4ef7923b8dc1" is_pre_election: true
I20260709 12:28:26.967967 19225 raft_consensus.cc:2468] T 84655933e2a8465d8aede7f18c893cad P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd798a306df4905858bf774b6cd98f3 in term 0.
I20260709 12:28:26.969340 19449 consensus_queue.cc:1048] T e2cf09feaca24068a727752850983ac5 P 595ece3316774e33930c4ef7923b8dc1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:26.969558 19266 leader_election.cc:304] T 84655933e2a8465d8aede7f18c893cad P ecd798a306df4905858bf774b6cd98f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 595ece3316774e33930c4ef7923b8dc1, ecd798a306df4905858bf774b6cd98f3; no voters: 
I20260709 12:28:26.972518 19459 raft_consensus.cc:2804] T 84655933e2a8465d8aede7f18c893cad P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:26.976507 19459 raft_consensus.cc:493] T 84655933e2a8465d8aede7f18c893cad P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:26.976945 19459 raft_consensus.cc:3060] T 84655933e2a8465d8aede7f18c893cad P ecd798a306df4905858bf774b6cd98f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:26.974695 19046 catalog_manager.cc:5697] T 7c21e55b8c694512b0ed942898b2749d P 595ece3316774e33930c4ef7923b8dc1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66). New cstate: current_term: 1 leader_uuid: "595ece3316774e33930c4ef7923b8dc1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:26.970301 19152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84655933e2a8465d8aede7f18c893cad" candidate_uuid: "ecd798a306df4905858bf774b6cd98f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5cd38daa04940ac97f9037e3241cdaf" is_pre_election: true
I20260709 12:28:26.980316 19152 raft_consensus.cc:2468] T 84655933e2a8465d8aede7f18c893cad P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd798a306df4905858bf774b6cd98f3 in term 0.
I20260709 12:28:26.985755 19459 raft_consensus.cc:515] T 84655933e2a8465d8aede7f18c893cad P ecd798a306df4905858bf774b6cd98f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:26.989212 19152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84655933e2a8465d8aede7f18c893cad" candidate_uuid: "ecd798a306df4905858bf774b6cd98f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5cd38daa04940ac97f9037e3241cdaf"
I20260709 12:28:26.989878 19152 raft_consensus.cc:3060] T 84655933e2a8465d8aede7f18c893cad P a5cd38daa04940ac97f9037e3241cdaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:27.000432 19456 consensus_queue.cc:1048] T 8d1007a33823446895ad5e0307fa4fff P ecd798a306df4905858bf774b6cd98f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:27.017884 19459 leader_election.cc:290] T 84655933e2a8465d8aede7f18c893cad P ecd798a306df4905858bf774b6cd98f3 [CANDIDATE]: Term 1 election: Requested vote from peers a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65:42503), 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66:37433)
I20260709 12:28:27.021267 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84655933e2a8465d8aede7f18c893cad" candidate_uuid: "ecd798a306df4905858bf774b6cd98f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "595ece3316774e33930c4ef7923b8dc1"
I20260709 12:28:27.022056 19225 raft_consensus.cc:3060] T 84655933e2a8465d8aede7f18c893cad P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:27.022306 19152 raft_consensus.cc:2468] T 84655933e2a8465d8aede7f18c893cad P a5cd38daa04940ac97f9037e3241cdaf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd798a306df4905858bf774b6cd98f3 in term 1.
I20260709 12:28:27.027479 19265 leader_election.cc:304] T 84655933e2a8465d8aede7f18c893cad P ecd798a306df4905858bf774b6cd98f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a5cd38daa04940ac97f9037e3241cdaf, ecd798a306df4905858bf774b6cd98f3; no voters: 
I20260709 12:28:27.031751 19494 raft_consensus.cc:2804] T 84655933e2a8465d8aede7f18c893cad P ecd798a306df4905858bf774b6cd98f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:27.032397 19494 raft_consensus.cc:697] T 84655933e2a8465d8aede7f18c893cad P ecd798a306df4905858bf774b6cd98f3 [term 1 LEADER]: Becoming Leader. State: Replica: ecd798a306df4905858bf774b6cd98f3, State: Running, Role: LEADER
I20260709 12:28:27.033608 19494 consensus_queue.cc:237] T 84655933e2a8465d8aede7f18c893cad P ecd798a306df4905858bf774b6cd98f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:27.039717 19459 consensus_queue.cc:1048] T 8d1007a33823446895ad5e0307fa4fff P ecd798a306df4905858bf774b6cd98f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:27.040762 19225 raft_consensus.cc:2468] T 84655933e2a8465d8aede7f18c893cad P 595ece3316774e33930c4ef7923b8dc1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd798a306df4905858bf774b6cd98f3 in term 1.
I20260709 12:28:27.040439 19047 catalog_manager.cc:5697] T 1e372667da904e65aa5d7c5345b08fca P a5cd38daa04940ac97f9037e3241cdaf reported cstate change: term changed from 0 to 1, leader changed from <none> to a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65). New cstate: current_term: 1 leader_uuid: "a5cd38daa04940ac97f9037e3241cdaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:27.061836 19050 catalog_manager.cc:5697] T 84655933e2a8465d8aede7f18c893cad P ecd798a306df4905858bf774b6cd98f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to ecd798a306df4905858bf774b6cd98f3 (127.9.116.67). New cstate: current_term: 1 leader_uuid: "ecd798a306df4905858bf774b6cd98f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:27.111476 19225 raft_consensus.cc:3060] T 345ac35ca3d140d3ab3ba9fc108a930b P 595ece3316774e33930c4ef7923b8dc1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:27.120239 19344 consensus_queue.cc:1048] T 345ac35ca3d140d3ab3ba9fc108a930b P a5cd38daa04940ac97f9037e3241cdaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:27.134868 19475 consensus_queue.cc:1048] T 345ac35ca3d140d3ab3ba9fc108a930b P a5cd38daa04940ac97f9037e3241cdaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:27.145973 19449 consensus_queue.cc:1048] T 88011d359ca74cf18e222bdaed1978a0 P 595ece3316774e33930c4ef7923b8dc1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:27.148895 19225 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e2cf09feaca24068a727752850983ac5"
dest_uuid: "595ece3316774e33930c4ef7923b8dc1"
mode: GRACEFUL
new_leader_uuid: "a5cd38daa04940ac97f9037e3241cdaf"
 from {username='slave'} at 127.0.0.1:45280
I20260709 12:28:27.149554 19225 raft_consensus.cc:606] T e2cf09feaca24068a727752850983ac5 P 595ece3316774e33930c4ef7923b8dc1 [term 1 LEADER]: Received request to transfer leadership to TS a5cd38daa04940ac97f9037e3241cdaf
I20260709 12:28:27.157729 19300 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "47b5cca5e909437c96a329dd6a87e474"
dest_uuid: "ecd798a306df4905858bf774b6cd98f3"
mode: GRACEFUL
new_leader_uuid: "a5cd38daa04940ac97f9037e3241cdaf"
 from {username='slave'} at 127.0.0.1:49300
I20260709 12:28:27.158383 19300 raft_consensus.cc:606] T 47b5cca5e909437c96a329dd6a87e474 P ecd798a306df4905858bf774b6cd98f3 [term 1 LEADER]: Received request to transfer leadership to TS a5cd38daa04940ac97f9037e3241cdaf
I20260709 12:28:27.159782 19450 consensus_queue.cc:1048] T 88011d359ca74cf18e222bdaed1978a0 P 595ece3316774e33930c4ef7923b8dc1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:27.166465 19225 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "88011d359ca74cf18e222bdaed1978a0"
dest_uuid: "595ece3316774e33930c4ef7923b8dc1"
mode: GRACEFUL
new_leader_uuid: "a5cd38daa04940ac97f9037e3241cdaf"
 from {username='slave'} at 127.0.0.1:45280
I20260709 12:28:27.167269 19225 raft_consensus.cc:606] T 88011d359ca74cf18e222bdaed1978a0 P 595ece3316774e33930c4ef7923b8dc1 [term 1 LEADER]: Received request to transfer leadership to TS a5cd38daa04940ac97f9037e3241cdaf
I20260709 12:28:27.177392 19300 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d1007a33823446895ad5e0307fa4fff"
dest_uuid: "ecd798a306df4905858bf774b6cd98f3"
mode: GRACEFUL
new_leader_uuid: "a5cd38daa04940ac97f9037e3241cdaf"
 from {username='slave'} at 127.0.0.1:49300
I20260709 12:28:27.177778 19449 raft_consensus.cc:993] T 88011d359ca74cf18e222bdaed1978a0 P 595ece3316774e33930c4ef7923b8dc1: : Instructing follower a5cd38daa04940ac97f9037e3241cdaf to start an election
I20260709 12:28:27.178326 19300 raft_consensus.cc:606] T 8d1007a33823446895ad5e0307fa4fff P ecd798a306df4905858bf774b6cd98f3 [term 1 LEADER]: Received request to transfer leadership to TS a5cd38daa04940ac97f9037e3241cdaf
I20260709 12:28:27.178471 19449 raft_consensus.cc:1081] T 88011d359ca74cf18e222bdaed1978a0 P 595ece3316774e33930c4ef7923b8dc1 [term 1 LEADER]: Signalling peer a5cd38daa04940ac97f9037e3241cdaf to start an election
I20260709 12:28:27.180622 19149 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "88011d359ca74cf18e222bdaed1978a0"
dest_uuid: "a5cd38daa04940ac97f9037e3241cdaf"
 from {username='slave'} at 127.0.0.1:34442
I20260709 12:28:27.181241 19149 raft_consensus.cc:493] T 88011d359ca74cf18e222bdaed1978a0 P a5cd38daa04940ac97f9037e3241cdaf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:27.181619 19149 raft_consensus.cc:3060] T 88011d359ca74cf18e222bdaed1978a0 P a5cd38daa04940ac97f9037e3241cdaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:27.185312 19152 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "345ac35ca3d140d3ab3ba9fc108a930b"
dest_uuid: "a5cd38daa04940ac97f9037e3241cdaf"
mode: GRACEFUL
new_leader_uuid: "595ece3316774e33930c4ef7923b8dc1"
 from {username='slave'} at 127.0.0.1:34446
I20260709 12:28:27.186364 19152 raft_consensus.cc:606] T 345ac35ca3d140d3ab3ba9fc108a930b P a5cd38daa04940ac97f9037e3241cdaf [term 1 LEADER]: Received request to transfer leadership to TS 595ece3316774e33930c4ef7923b8dc1
I20260709 12:28:27.190519 19149 raft_consensus.cc:515] T 88011d359ca74cf18e222bdaed1978a0 P a5cd38daa04940ac97f9037e3241cdaf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:27.192978 19149 leader_election.cc:290] T 88011d359ca74cf18e222bdaed1978a0 P a5cd38daa04940ac97f9037e3241cdaf [CANDIDATE]: Term 2 election: Requested vote from peers 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66:37433), ecd798a306df4905858bf774b6cd98f3 (127.9.116.67:37403)
I20260709 12:28:27.193706 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88011d359ca74cf18e222bdaed1978a0" candidate_uuid: "a5cd38daa04940ac97f9037e3241cdaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "595ece3316774e33930c4ef7923b8dc1"
I20260709 12:28:27.193974 19152 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e372667da904e65aa5d7c5345b08fca"
dest_uuid: "a5cd38daa04940ac97f9037e3241cdaf"
mode: GRACEFUL
new_leader_uuid: "595ece3316774e33930c4ef7923b8dc1"
 from {username='slave'} at 127.0.0.1:34446
I20260709 12:28:27.194438 19225 raft_consensus.cc:3055] T 88011d359ca74cf18e222bdaed1978a0 P 595ece3316774e33930c4ef7923b8dc1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:27.194124 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88011d359ca74cf18e222bdaed1978a0" candidate_uuid: "a5cd38daa04940ac97f9037e3241cdaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ecd798a306df4905858bf774b6cd98f3"
I20260709 12:28:27.194541 19152 raft_consensus.cc:606] T 1e372667da904e65aa5d7c5345b08fca P a5cd38daa04940ac97f9037e3241cdaf [term 1 LEADER]: Received request to transfer leadership to TS 595ece3316774e33930c4ef7923b8dc1
I20260709 12:28:27.194823 19225 raft_consensus.cc:740] T 88011d359ca74cf18e222bdaed1978a0 P 595ece3316774e33930c4ef7923b8dc1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 595ece3316774e33930c4ef7923b8dc1, State: Running, Role: LEADER
I20260709 12:28:27.195801 19225 consensus_queue.cc:260] T 88011d359ca74cf18e222bdaed1978a0 P 595ece3316774e33930c4ef7923b8dc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:27.196326 19300 raft_consensus.cc:3060] T 88011d359ca74cf18e222bdaed1978a0 P ecd798a306df4905858bf774b6cd98f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:27.197271 19225 raft_consensus.cc:3060] T 88011d359ca74cf18e222bdaed1978a0 P 595ece3316774e33930c4ef7923b8dc1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:27.205600 19300 raft_consensus.cc:2468] T 88011d359ca74cf18e222bdaed1978a0 P ecd798a306df4905858bf774b6cd98f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5cd38daa04940ac97f9037e3241cdaf in term 2.
I20260709 12:28:27.205837 19301 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "84655933e2a8465d8aede7f18c893cad"
dest_uuid: "ecd798a306df4905858bf774b6cd98f3"
mode: GRACEFUL
new_leader_uuid: "595ece3316774e33930c4ef7923b8dc1"
 from {username='slave'} at 127.0.0.1:49300
I20260709 12:28:27.206581 19301 raft_consensus.cc:606] T 84655933e2a8465d8aede7f18c893cad P ecd798a306df4905858bf774b6cd98f3 [term 1 LEADER]: Received request to transfer leadership to TS 595ece3316774e33930c4ef7923b8dc1
I20260709 12:28:27.207207 19117 leader_election.cc:304] T 88011d359ca74cf18e222bdaed1978a0 P a5cd38daa04940ac97f9037e3241cdaf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a5cd38daa04940ac97f9037e3241cdaf, ecd798a306df4905858bf774b6cd98f3; no voters: 
I20260709 12:28:27.207811 19225 raft_consensus.cc:2468] T 88011d359ca74cf18e222bdaed1978a0 P 595ece3316774e33930c4ef7923b8dc1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5cd38daa04940ac97f9037e3241cdaf in term 2.
I20260709 12:28:27.208881 19506 raft_consensus.cc:2804] T 88011d359ca74cf18e222bdaed1978a0 P a5cd38daa04940ac97f9037e3241cdaf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:27.209401 19506 raft_consensus.cc:697] T 88011d359ca74cf18e222bdaed1978a0 P a5cd38daa04940ac97f9037e3241cdaf [term 2 LEADER]: Becoming Leader. State: Replica: a5cd38daa04940ac97f9037e3241cdaf, State: Running, Role: LEADER
I20260709 12:28:27.210300 19506 consensus_queue.cc:237] T 88011d359ca74cf18e222bdaed1978a0 P a5cd38daa04940ac97f9037e3241cdaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:27.214159 19152 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0fd8240043ac467eb287176c4f2e97e7"
dest_uuid: "a5cd38daa04940ac97f9037e3241cdaf"
mode: GRACEFUL
new_leader_uuid: "ecd798a306df4905858bf774b6cd98f3"
 from {username='slave'} at 127.0.0.1:34446
I20260709 12:28:27.214851 19152 raft_consensus.cc:606] T 0fd8240043ac467eb287176c4f2e97e7 P a5cd38daa04940ac97f9037e3241cdaf [term 1 LEADER]: Received request to transfer leadership to TS ecd798a306df4905858bf774b6cd98f3
I20260709 12:28:27.219413 19048 catalog_manager.cc:5697] T 88011d359ca74cf18e222bdaed1978a0 P a5cd38daa04940ac97f9037e3241cdaf reported cstate change: term changed from 1 to 2, leader changed from 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66) to a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65). New cstate: current_term: 2 leader_uuid: "a5cd38daa04940ac97f9037e3241cdaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:27.325556 19449 consensus_queue.cc:1048] T 7c21e55b8c694512b0ed942898b2749d P 595ece3316774e33930c4ef7923b8dc1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:27.339075 19506 consensus_queue.cc:1048] T 0fd8240043ac467eb287176c4f2e97e7 P a5cd38daa04940ac97f9037e3241cdaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:27.341403 19428 consensus_queue.cc:1048] T 7c21e55b8c694512b0ed942898b2749d P 595ece3316774e33930c4ef7923b8dc1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:27.359278 19506 consensus_queue.cc:1048] T 0fd8240043ac467eb287176c4f2e97e7 P a5cd38daa04940ac97f9037e3241cdaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:27.370829 19344 raft_consensus.cc:993] T 0fd8240043ac467eb287176c4f2e97e7 P a5cd38daa04940ac97f9037e3241cdaf: : Instructing follower ecd798a306df4905858bf774b6cd98f3 to start an election
I20260709 12:28:27.371316 19344 raft_consensus.cc:1081] T 0fd8240043ac467eb287176c4f2e97e7 P a5cd38daa04940ac97f9037e3241cdaf [term 1 LEADER]: Signalling peer ecd798a306df4905858bf774b6cd98f3 to start an election
I20260709 12:28:27.373057 19301 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0fd8240043ac467eb287176c4f2e97e7"
dest_uuid: "ecd798a306df4905858bf774b6cd98f3"
 from {username='slave'} at 127.0.0.1:49280
I20260709 12:28:27.373651 19301 raft_consensus.cc:493] T 0fd8240043ac467eb287176c4f2e97e7 P ecd798a306df4905858bf774b6cd98f3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:27.374279 19301 raft_consensus.cc:3060] T 0fd8240043ac467eb287176c4f2e97e7 P ecd798a306df4905858bf774b6cd98f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:27.381076 19301 raft_consensus.cc:515] T 0fd8240043ac467eb287176c4f2e97e7 P ecd798a306df4905858bf774b6cd98f3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:27.383042 19301 leader_election.cc:290] T 0fd8240043ac467eb287176c4f2e97e7 P ecd798a306df4905858bf774b6cd98f3 [CANDIDATE]: Term 2 election: Requested vote from peers a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65:42503), 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66:37433)
I20260709 12:28:27.384097 19152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd8240043ac467eb287176c4f2e97e7" candidate_uuid: "ecd798a306df4905858bf774b6cd98f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a5cd38daa04940ac97f9037e3241cdaf"
I20260709 12:28:27.384382 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd8240043ac467eb287176c4f2e97e7" candidate_uuid: "ecd798a306df4905858bf774b6cd98f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "595ece3316774e33930c4ef7923b8dc1"
I20260709 12:28:27.385179 19224 raft_consensus.cc:3060] T 0fd8240043ac467eb287176c4f2e97e7 P 595ece3316774e33930c4ef7923b8dc1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:27.385121 19152 raft_consensus.cc:3055] T 0fd8240043ac467eb287176c4f2e97e7 P a5cd38daa04940ac97f9037e3241cdaf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:27.385924 19152 raft_consensus.cc:740] T 0fd8240043ac467eb287176c4f2e97e7 P a5cd38daa04940ac97f9037e3241cdaf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a5cd38daa04940ac97f9037e3241cdaf, State: Running, Role: LEADER
I20260709 12:28:27.386824 19152 consensus_queue.cc:260] T 0fd8240043ac467eb287176c4f2e97e7 P a5cd38daa04940ac97f9037e3241cdaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:27.388221 19152 raft_consensus.cc:3060] T 0fd8240043ac467eb287176c4f2e97e7 P a5cd38daa04940ac97f9037e3241cdaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:27.391939 19224 raft_consensus.cc:2468] T 0fd8240043ac467eb287176c4f2e97e7 P 595ece3316774e33930c4ef7923b8dc1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd798a306df4905858bf774b6cd98f3 in term 2.
I20260709 12:28:27.393193 19266 leader_election.cc:304] T 0fd8240043ac467eb287176c4f2e97e7 P ecd798a306df4905858bf774b6cd98f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 595ece3316774e33930c4ef7923b8dc1, ecd798a306df4905858bf774b6cd98f3; no voters: 
I20260709 12:28:27.393998 19456 raft_consensus.cc:2804] T 0fd8240043ac467eb287176c4f2e97e7 P ecd798a306df4905858bf774b6cd98f3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:27.394495 19456 raft_consensus.cc:697] T 0fd8240043ac467eb287176c4f2e97e7 P ecd798a306df4905858bf774b6cd98f3 [term 2 LEADER]: Becoming Leader. State: Replica: ecd798a306df4905858bf774b6cd98f3, State: Running, Role: LEADER
I20260709 12:28:27.395641 19152 raft_consensus.cc:2468] T 0fd8240043ac467eb287176c4f2e97e7 P a5cd38daa04940ac97f9037e3241cdaf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd798a306df4905858bf774b6cd98f3 in term 2.
I20260709 12:28:27.395354 19456 consensus_queue.cc:237] T 0fd8240043ac467eb287176c4f2e97e7 P ecd798a306df4905858bf774b6cd98f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:27.403285 19047 catalog_manager.cc:5697] T 0fd8240043ac467eb287176c4f2e97e7 P ecd798a306df4905858bf774b6cd98f3 reported cstate change: term changed from 1 to 2, leader changed from a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65) to ecd798a306df4905858bf774b6cd98f3 (127.9.116.67). New cstate: current_term: 2 leader_uuid: "ecd798a306df4905858bf774b6cd98f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:27.449937 19494 raft_consensus.cc:993] T 47b5cca5e909437c96a329dd6a87e474 P ecd798a306df4905858bf774b6cd98f3: : Instructing follower a5cd38daa04940ac97f9037e3241cdaf to start an election
I20260709 12:28:27.450538 19456 raft_consensus.cc:1081] T 47b5cca5e909437c96a329dd6a87e474 P ecd798a306df4905858bf774b6cd98f3 [term 1 LEADER]: Signalling peer a5cd38daa04940ac97f9037e3241cdaf to start an election
I20260709 12:28:27.452621 19149 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "47b5cca5e909437c96a329dd6a87e474"
dest_uuid: "a5cd38daa04940ac97f9037e3241cdaf"
 from {username='slave'} at 127.0.0.1:34440
I20260709 12:28:27.453164 19149 raft_consensus.cc:493] T 47b5cca5e909437c96a329dd6a87e474 P a5cd38daa04940ac97f9037e3241cdaf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:27.453481 19149 raft_consensus.cc:3060] T 47b5cca5e909437c96a329dd6a87e474 P a5cd38daa04940ac97f9037e3241cdaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:27.459044 19149 raft_consensus.cc:515] T 47b5cca5e909437c96a329dd6a87e474 P a5cd38daa04940ac97f9037e3241cdaf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:27.460958 19149 leader_election.cc:290] T 47b5cca5e909437c96a329dd6a87e474 P a5cd38daa04940ac97f9037e3241cdaf [CANDIDATE]: Term 2 election: Requested vote from peers 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66:37433), ecd798a306df4905858bf774b6cd98f3 (127.9.116.67:37403)
I20260709 12:28:27.462512 19301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b5cca5e909437c96a329dd6a87e474" candidate_uuid: "a5cd38daa04940ac97f9037e3241cdaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ecd798a306df4905858bf774b6cd98f3"
I20260709 12:28:27.462568 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b5cca5e909437c96a329dd6a87e474" candidate_uuid: "a5cd38daa04940ac97f9037e3241cdaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "595ece3316774e33930c4ef7923b8dc1"
I20260709 12:28:27.463794 19301 raft_consensus.cc:3055] T 47b5cca5e909437c96a329dd6a87e474 P ecd798a306df4905858bf774b6cd98f3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:27.463994 19225 raft_consensus.cc:3060] T 47b5cca5e909437c96a329dd6a87e474 P 595ece3316774e33930c4ef7923b8dc1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:27.464206 19301 raft_consensus.cc:740] T 47b5cca5e909437c96a329dd6a87e474 P ecd798a306df4905858bf774b6cd98f3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ecd798a306df4905858bf774b6cd98f3, State: Running, Role: LEADER
I20260709 12:28:27.465101 19301 consensus_queue.cc:260] T 47b5cca5e909437c96a329dd6a87e474 P ecd798a306df4905858bf774b6cd98f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:27.466435 19301 raft_consensus.cc:3060] T 47b5cca5e909437c96a329dd6a87e474 P ecd798a306df4905858bf774b6cd98f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:27.470052 19225 raft_consensus.cc:2468] T 47b5cca5e909437c96a329dd6a87e474 P 595ece3316774e33930c4ef7923b8dc1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5cd38daa04940ac97f9037e3241cdaf in term 2.
I20260709 12:28:27.471477 19117 leader_election.cc:304] T 47b5cca5e909437c96a329dd6a87e474 P a5cd38daa04940ac97f9037e3241cdaf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 595ece3316774e33930c4ef7923b8dc1, a5cd38daa04940ac97f9037e3241cdaf; no voters: 
I20260709 12:28:27.472289 19344 raft_consensus.cc:2804] T 47b5cca5e909437c96a329dd6a87e474 P a5cd38daa04940ac97f9037e3241cdaf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:27.472751 19344 raft_consensus.cc:697] T 47b5cca5e909437c96a329dd6a87e474 P a5cd38daa04940ac97f9037e3241cdaf [term 2 LEADER]: Becoming Leader. State: Replica: a5cd38daa04940ac97f9037e3241cdaf, State: Running, Role: LEADER
I20260709 12:28:27.472939 19301 raft_consensus.cc:2468] T 47b5cca5e909437c96a329dd6a87e474 P ecd798a306df4905858bf774b6cd98f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5cd38daa04940ac97f9037e3241cdaf in term 2.
I20260709 12:28:27.473708 19344 consensus_queue.cc:237] T 47b5cca5e909437c96a329dd6a87e474 P a5cd38daa04940ac97f9037e3241cdaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:27.481815 19047 catalog_manager.cc:5697] T 47b5cca5e909437c96a329dd6a87e474 P a5cd38daa04940ac97f9037e3241cdaf reported cstate change: term changed from 1 to 2, leader changed from ecd798a306df4905858bf774b6cd98f3 (127.9.116.67) to a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65). New cstate: current_term: 2 leader_uuid: "a5cd38daa04940ac97f9037e3241cdaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:27.486986 19511 raft_consensus.cc:993] T e2cf09feaca24068a727752850983ac5 P 595ece3316774e33930c4ef7923b8dc1: : Instructing follower a5cd38daa04940ac97f9037e3241cdaf to start an election
I20260709 12:28:27.487644 19511 raft_consensus.cc:1081] T e2cf09feaca24068a727752850983ac5 P 595ece3316774e33930c4ef7923b8dc1 [term 1 LEADER]: Signalling peer a5cd38daa04940ac97f9037e3241cdaf to start an election
I20260709 12:28:27.489404 19149 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e2cf09feaca24068a727752850983ac5"
dest_uuid: "a5cd38daa04940ac97f9037e3241cdaf"
 from {username='slave'} at 127.0.0.1:34442
I20260709 12:28:27.490010 19149 raft_consensus.cc:493] T e2cf09feaca24068a727752850983ac5 P a5cd38daa04940ac97f9037e3241cdaf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:27.490307 19149 raft_consensus.cc:3060] T e2cf09feaca24068a727752850983ac5 P a5cd38daa04940ac97f9037e3241cdaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:27.496296 19149 raft_consensus.cc:515] T e2cf09feaca24068a727752850983ac5 P a5cd38daa04940ac97f9037e3241cdaf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:27.497967 19149 leader_election.cc:290] T e2cf09feaca24068a727752850983ac5 P a5cd38daa04940ac97f9037e3241cdaf [CANDIDATE]: Term 2 election: Requested vote from peers 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66:37433), ecd798a306df4905858bf774b6cd98f3 (127.9.116.67:37403)
I20260709 12:28:27.499090 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2cf09feaca24068a727752850983ac5" candidate_uuid: "a5cd38daa04940ac97f9037e3241cdaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "595ece3316774e33930c4ef7923b8dc1"
I20260709 12:28:27.499517 19301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2cf09feaca24068a727752850983ac5" candidate_uuid: "a5cd38daa04940ac97f9037e3241cdaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ecd798a306df4905858bf774b6cd98f3"
I20260709 12:28:27.499734 19225 raft_consensus.cc:3055] T e2cf09feaca24068a727752850983ac5 P 595ece3316774e33930c4ef7923b8dc1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:27.500090 19301 raft_consensus.cc:3060] T e2cf09feaca24068a727752850983ac5 P ecd798a306df4905858bf774b6cd98f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:27.500118 19225 raft_consensus.cc:740] T e2cf09feaca24068a727752850983ac5 P 595ece3316774e33930c4ef7923b8dc1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 595ece3316774e33930c4ef7923b8dc1, State: Running, Role: LEADER
I20260709 12:28:27.501044 19225 consensus_queue.cc:260] T e2cf09feaca24068a727752850983ac5 P 595ece3316774e33930c4ef7923b8dc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:27.502017 19225 raft_consensus.cc:3060] T e2cf09feaca24068a727752850983ac5 P 595ece3316774e33930c4ef7923b8dc1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:27.505730 19301 raft_consensus.cc:2468] T e2cf09feaca24068a727752850983ac5 P ecd798a306df4905858bf774b6cd98f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5cd38daa04940ac97f9037e3241cdaf in term 2.
I20260709 12:28:27.507194 19225 raft_consensus.cc:2468] T e2cf09feaca24068a727752850983ac5 P 595ece3316774e33930c4ef7923b8dc1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5cd38daa04940ac97f9037e3241cdaf in term 2.
I20260709 12:28:27.507817 19117 leader_election.cc:304] T e2cf09feaca24068a727752850983ac5 P a5cd38daa04940ac97f9037e3241cdaf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a5cd38daa04940ac97f9037e3241cdaf, ecd798a306df4905858bf774b6cd98f3; no voters: 
I20260709 12:28:27.508724 19344 raft_consensus.cc:2804] T e2cf09feaca24068a727752850983ac5 P a5cd38daa04940ac97f9037e3241cdaf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:27.509177 19344 raft_consensus.cc:697] T e2cf09feaca24068a727752850983ac5 P a5cd38daa04940ac97f9037e3241cdaf [term 2 LEADER]: Becoming Leader. State: Replica: a5cd38daa04940ac97f9037e3241cdaf, State: Running, Role: LEADER
I20260709 12:28:27.509909 19344 consensus_queue.cc:237] T e2cf09feaca24068a727752850983ac5 P a5cd38daa04940ac97f9037e3241cdaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:27.516572 19047 catalog_manager.cc:5697] T e2cf09feaca24068a727752850983ac5 P a5cd38daa04940ac97f9037e3241cdaf reported cstate change: term changed from 1 to 2, leader changed from 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66) to a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65). New cstate: current_term: 2 leader_uuid: "a5cd38daa04940ac97f9037e3241cdaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:27.529881 19344 consensus_queue.cc:1048] T 1e372667da904e65aa5d7c5345b08fca P a5cd38daa04940ac97f9037e3241cdaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:27.541749 19506 consensus_queue.cc:1048] T 1e372667da904e65aa5d7c5345b08fca P a5cd38daa04940ac97f9037e3241cdaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:27.547863 19456 consensus_queue.cc:1048] T 84655933e2a8465d8aede7f18c893cad P ecd798a306df4905858bf774b6cd98f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:27.550043 19494 consensus_queue.cc:1048] T 84655933e2a8465d8aede7f18c893cad P ecd798a306df4905858bf774b6cd98f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:27.554643 19476 raft_consensus.cc:993] T 1e372667da904e65aa5d7c5345b08fca P a5cd38daa04940ac97f9037e3241cdaf: : Instructing follower 595ece3316774e33930c4ef7923b8dc1 to start an election
I20260709 12:28:27.555249 19476 raft_consensus.cc:1081] T 1e372667da904e65aa5d7c5345b08fca P a5cd38daa04940ac97f9037e3241cdaf [term 1 LEADER]: Signalling peer 595ece3316774e33930c4ef7923b8dc1 to start an election
I20260709 12:28:27.558431 19226 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1e372667da904e65aa5d7c5345b08fca"
dest_uuid: "595ece3316774e33930c4ef7923b8dc1"
 from {username='slave'} at 127.0.0.1:45262
I20260709 12:28:27.559243 19226 raft_consensus.cc:493] T 1e372667da904e65aa5d7c5345b08fca P 595ece3316774e33930c4ef7923b8dc1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:27.559764 19226 raft_consensus.cc:3060] T 1e372667da904e65aa5d7c5345b08fca P 595ece3316774e33930c4ef7923b8dc1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:27.562597 19506 raft_consensus.cc:993] T 345ac35ca3d140d3ab3ba9fc108a930b P a5cd38daa04940ac97f9037e3241cdaf: : Instructing follower 595ece3316774e33930c4ef7923b8dc1 to start an election
I20260709 12:28:27.563334 19475 raft_consensus.cc:1081] T 345ac35ca3d140d3ab3ba9fc108a930b P a5cd38daa04940ac97f9037e3241cdaf [term 1 LEADER]: Signalling peer 595ece3316774e33930c4ef7923b8dc1 to start an election
I20260709 12:28:27.566494 19224 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "345ac35ca3d140d3ab3ba9fc108a930b"
dest_uuid: "595ece3316774e33930c4ef7923b8dc1"
 from {username='slave'} at 127.0.0.1:45262
I20260709 12:28:27.567194 19224 raft_consensus.cc:493] T 345ac35ca3d140d3ab3ba9fc108a930b P 595ece3316774e33930c4ef7923b8dc1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:27.567724 19224 raft_consensus.cc:3060] T 345ac35ca3d140d3ab3ba9fc108a930b P 595ece3316774e33930c4ef7923b8dc1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:27.573668 19502 raft_consensus.cc:993] T 84655933e2a8465d8aede7f18c893cad P ecd798a306df4905858bf774b6cd98f3: : Instructing follower 595ece3316774e33930c4ef7923b8dc1 to start an election
I20260709 12:28:27.574903 19494 raft_consensus.cc:1081] T 84655933e2a8465d8aede7f18c893cad P ecd798a306df4905858bf774b6cd98f3 [term 1 LEADER]: Signalling peer 595ece3316774e33930c4ef7923b8dc1 to start an election
I20260709 12:28:27.577009 19225 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "84655933e2a8465d8aede7f18c893cad"
dest_uuid: "595ece3316774e33930c4ef7923b8dc1"
 from {username='slave'} at 127.0.0.1:45272
I20260709 12:28:27.577651 19225 raft_consensus.cc:493] T 84655933e2a8465d8aede7f18c893cad P 595ece3316774e33930c4ef7923b8dc1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:27.578089 19225 raft_consensus.cc:3060] T 84655933e2a8465d8aede7f18c893cad P 595ece3316774e33930c4ef7923b8dc1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:27.582103 19224 raft_consensus.cc:515] T 345ac35ca3d140d3ab3ba9fc108a930b P 595ece3316774e33930c4ef7923b8dc1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:27.585570 19149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "345ac35ca3d140d3ab3ba9fc108a930b" candidate_uuid: "595ece3316774e33930c4ef7923b8dc1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a5cd38daa04940ac97f9037e3241cdaf"
I20260709 12:28:27.585243 19226 raft_consensus.cc:515] T 1e372667da904e65aa5d7c5345b08fca P 595ece3316774e33930c4ef7923b8dc1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:27.586274 19149 raft_consensus.cc:3055] T 345ac35ca3d140d3ab3ba9fc108a930b P a5cd38daa04940ac97f9037e3241cdaf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:27.586647 19149 raft_consensus.cc:740] T 345ac35ca3d140d3ab3ba9fc108a930b P a5cd38daa04940ac97f9037e3241cdaf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a5cd38daa04940ac97f9037e3241cdaf, State: Running, Role: LEADER
I20260709 12:28:27.587826 19149 consensus_queue.cc:260] T 345ac35ca3d140d3ab3ba9fc108a930b P a5cd38daa04940ac97f9037e3241cdaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:27.589672 19149 raft_consensus.cc:3060] T 345ac35ca3d140d3ab3ba9fc108a930b P a5cd38daa04940ac97f9037e3241cdaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:27.591828 19226 leader_election.cc:290] T 1e372667da904e65aa5d7c5345b08fca P 595ece3316774e33930c4ef7923b8dc1 [CANDIDATE]: Term 2 election: Requested vote from peers a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65:42503), ecd798a306df4905858bf774b6cd98f3 (127.9.116.67:37403)
I20260709 12:28:27.592167 19152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e372667da904e65aa5d7c5345b08fca" candidate_uuid: "595ece3316774e33930c4ef7923b8dc1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a5cd38daa04940ac97f9037e3241cdaf"
I20260709 12:28:27.593108 19152 raft_consensus.cc:3055] T 1e372667da904e65aa5d7c5345b08fca P a5cd38daa04940ac97f9037e3241cdaf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:27.593540 19152 raft_consensus.cc:740] T 1e372667da904e65aa5d7c5345b08fca P a5cd38daa04940ac97f9037e3241cdaf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a5cd38daa04940ac97f9037e3241cdaf, State: Running, Role: LEADER
I20260709 12:28:27.594507 19301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e372667da904e65aa5d7c5345b08fca" candidate_uuid: "595ece3316774e33930c4ef7923b8dc1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ecd798a306df4905858bf774b6cd98f3"
I20260709 12:28:27.595328 19301 raft_consensus.cc:3060] T 1e372667da904e65aa5d7c5345b08fca P ecd798a306df4905858bf774b6cd98f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:27.595803 19224 leader_election.cc:290] T 345ac35ca3d140d3ab3ba9fc108a930b P 595ece3316774e33930c4ef7923b8dc1 [CANDIDATE]: Term 2 election: Requested vote from peers a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65:42503), ecd798a306df4905858bf774b6cd98f3 (127.9.116.67:37403)
I20260709 12:28:27.594588 19152 consensus_queue.cc:260] T 1e372667da904e65aa5d7c5345b08fca P a5cd38daa04940ac97f9037e3241cdaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:27.596691 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "345ac35ca3d140d3ab3ba9fc108a930b" candidate_uuid: "595ece3316774e33930c4ef7923b8dc1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ecd798a306df4905858bf774b6cd98f3"
I20260709 12:28:27.597311 19300 raft_consensus.cc:3060] T 345ac35ca3d140d3ab3ba9fc108a930b P ecd798a306df4905858bf774b6cd98f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:27.597468 19152 raft_consensus.cc:3060] T 1e372667da904e65aa5d7c5345b08fca P a5cd38daa04940ac97f9037e3241cdaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:27.603530 19301 raft_consensus.cc:2468] T 1e372667da904e65aa5d7c5345b08fca P ecd798a306df4905858bf774b6cd98f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 595ece3316774e33930c4ef7923b8dc1 in term 2.
I20260709 12:28:27.604979 19192 leader_election.cc:304] T 1e372667da904e65aa5d7c5345b08fca P 595ece3316774e33930c4ef7923b8dc1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 595ece3316774e33930c4ef7923b8dc1, ecd798a306df4905858bf774b6cd98f3; no voters: 
I20260709 12:28:27.606253 19511 raft_consensus.cc:2804] T 1e372667da904e65aa5d7c5345b08fca P 595ece3316774e33930c4ef7923b8dc1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:27.606827 19511 raft_consensus.cc:697] T 1e372667da904e65aa5d7c5345b08fca P 595ece3316774e33930c4ef7923b8dc1 [term 2 LEADER]: Becoming Leader. State: Replica: 595ece3316774e33930c4ef7923b8dc1, State: Running, Role: LEADER
I20260709 12:28:27.607795 19511 consensus_queue.cc:237] T 1e372667da904e65aa5d7c5345b08fca P 595ece3316774e33930c4ef7923b8dc1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:27.609624 19456 raft_consensus.cc:993] T 8d1007a33823446895ad5e0307fa4fff P ecd798a306df4905858bf774b6cd98f3: : Instructing follower a5cd38daa04940ac97f9037e3241cdaf to start an election
I20260709 12:28:27.610216 19456 raft_consensus.cc:1081] T 8d1007a33823446895ad5e0307fa4fff P ecd798a306df4905858bf774b6cd98f3 [term 1 LEADER]: Signalling peer a5cd38daa04940ac97f9037e3241cdaf to start an election
I20260709 12:28:27.612454 19151 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8d1007a33823446895ad5e0307fa4fff"
dest_uuid: "a5cd38daa04940ac97f9037e3241cdaf"
 from {username='slave'} at 127.0.0.1:34440
I20260709 12:28:27.613356 19151 raft_consensus.cc:493] T 8d1007a33823446895ad5e0307fa4fff P a5cd38daa04940ac97f9037e3241cdaf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:27.613781 19151 raft_consensus.cc:3060] T 8d1007a33823446895ad5e0307fa4fff P a5cd38daa04940ac97f9037e3241cdaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:27.614662 19225 raft_consensus.cc:515] T 84655933e2a8465d8aede7f18c893cad P 595ece3316774e33930c4ef7923b8dc1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:27.615932 19227 raft_consensus.cc:1240] T 84655933e2a8465d8aede7f18c893cad P 595ece3316774e33930c4ef7923b8dc1 [term 2 FOLLOWER]: Rejecting Update request from peer ecd798a306df4905858bf774b6cd98f3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:28:27.619470 19152 raft_consensus.cc:2468] T 1e372667da904e65aa5d7c5345b08fca P a5cd38daa04940ac97f9037e3241cdaf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 595ece3316774e33930c4ef7923b8dc1 in term 2.
I20260709 12:28:27.620463 19456 consensus_queue.cc:1059] T 84655933e2a8465d8aede7f18c893cad P ecd798a306df4905858bf774b6cd98f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:27.621076 19225 leader_election.cc:290] T 84655933e2a8465d8aede7f18c893cad P 595ece3316774e33930c4ef7923b8dc1 [CANDIDATE]: Term 2 election: Requested vote from peers a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65:42503), ecd798a306df4905858bf774b6cd98f3 (127.9.116.67:37403)
I20260709 12:28:27.621367 19456 raft_consensus.cc:3055] T 84655933e2a8465d8aede7f18c893cad P ecd798a306df4905858bf774b6cd98f3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:27.619520 19149 raft_consensus.cc:2468] T 345ac35ca3d140d3ab3ba9fc108a930b P a5cd38daa04940ac97f9037e3241cdaf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 595ece3316774e33930c4ef7923b8dc1 in term 2.
I20260709 12:28:27.621762 19456 raft_consensus.cc:740] T 84655933e2a8465d8aede7f18c893cad P ecd798a306df4905858bf774b6cd98f3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ecd798a306df4905858bf774b6cd98f3, State: Running, Role: LEADER
I20260709 12:28:27.623328 19456 consensus_queue.cc:260] T 84655933e2a8465d8aede7f18c893cad P ecd798a306df4905858bf774b6cd98f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:27.623561 19191 leader_election.cc:304] T 345ac35ca3d140d3ab3ba9fc108a930b P 595ece3316774e33930c4ef7923b8dc1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 595ece3316774e33930c4ef7923b8dc1, a5cd38daa04940ac97f9037e3241cdaf; no voters: 
I20260709 12:28:27.624748 19456 raft_consensus.cc:3060] T 84655933e2a8465d8aede7f18c893cad P ecd798a306df4905858bf774b6cd98f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:27.623596 19301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84655933e2a8465d8aede7f18c893cad" candidate_uuid: "595ece3316774e33930c4ef7923b8dc1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ecd798a306df4905858bf774b6cd98f3"
I20260709 12:28:27.624800 19511 raft_consensus.cc:2804] T 345ac35ca3d140d3ab3ba9fc108a930b P 595ece3316774e33930c4ef7923b8dc1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:27.626466 19511 raft_consensus.cc:697] T 345ac35ca3d140d3ab3ba9fc108a930b P 595ece3316774e33930c4ef7923b8dc1 [term 2 LEADER]: Becoming Leader. State: Replica: 595ece3316774e33930c4ef7923b8dc1, State: Running, Role: LEADER
I20260709 12:28:27.626520 19152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84655933e2a8465d8aede7f18c893cad" candidate_uuid: "595ece3316774e33930c4ef7923b8dc1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a5cd38daa04940ac97f9037e3241cdaf"
I20260709 12:28:27.627187 19152 raft_consensus.cc:3060] T 84655933e2a8465d8aede7f18c893cad P a5cd38daa04940ac97f9037e3241cdaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:27.609161 19300 raft_consensus.cc:2468] T 345ac35ca3d140d3ab3ba9fc108a930b P ecd798a306df4905858bf774b6cd98f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 595ece3316774e33930c4ef7923b8dc1 in term 2.
I20260709 12:28:27.627453 19511 consensus_queue.cc:237] T 345ac35ca3d140d3ab3ba9fc108a930b P 595ece3316774e33930c4ef7923b8dc1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:27.627422 19151 raft_consensus.cc:515] T 8d1007a33823446895ad5e0307fa4fff P a5cd38daa04940ac97f9037e3241cdaf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:27.632309 19048 catalog_manager.cc:5697] T 1e372667da904e65aa5d7c5345b08fca P 595ece3316774e33930c4ef7923b8dc1 reported cstate change: term changed from 1 to 2, leader changed from a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65) to 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66). New cstate: current_term: 2 leader_uuid: "595ece3316774e33930c4ef7923b8dc1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:27.635633 19152 raft_consensus.cc:2468] T 84655933e2a8465d8aede7f18c893cad P a5cd38daa04940ac97f9037e3241cdaf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 595ece3316774e33930c4ef7923b8dc1 in term 2.
I20260709 12:28:27.636158 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1007a33823446895ad5e0307fa4fff" candidate_uuid: "a5cd38daa04940ac97f9037e3241cdaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "595ece3316774e33930c4ef7923b8dc1"
I20260709 12:28:27.636795 19225 raft_consensus.cc:3060] T 8d1007a33823446895ad5e0307fa4fff P 595ece3316774e33930c4ef7923b8dc1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:27.637121 19151 leader_election.cc:290] T 8d1007a33823446895ad5e0307fa4fff P a5cd38daa04940ac97f9037e3241cdaf [CANDIDATE]: Term 2 election: Requested vote from peers 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66:37433), ecd798a306df4905858bf774b6cd98f3 (127.9.116.67:37403)
I20260709 12:28:27.639562 19301 raft_consensus.cc:2468] T 84655933e2a8465d8aede7f18c893cad P ecd798a306df4905858bf774b6cd98f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 595ece3316774e33930c4ef7923b8dc1 in term 2.
I20260709 12:28:27.644755 19191 leader_election.cc:304] T 84655933e2a8465d8aede7f18c893cad P 595ece3316774e33930c4ef7923b8dc1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 595ece3316774e33930c4ef7923b8dc1, a5cd38daa04940ac97f9037e3241cdaf; no voters: 
I20260709 12:28:27.646236 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d1007a33823446895ad5e0307fa4fff" candidate_uuid: "a5cd38daa04940ac97f9037e3241cdaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ecd798a306df4905858bf774b6cd98f3"
I20260709 12:28:27.646554 19428 raft_consensus.cc:2804] T 84655933e2a8465d8aede7f18c893cad P 595ece3316774e33930c4ef7923b8dc1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:27.647143 19300 raft_consensus.cc:3055] T 8d1007a33823446895ad5e0307fa4fff P ecd798a306df4905858bf774b6cd98f3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:27.647547 19300 raft_consensus.cc:740] T 8d1007a33823446895ad5e0307fa4fff P ecd798a306df4905858bf774b6cd98f3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ecd798a306df4905858bf774b6cd98f3, State: Running, Role: LEADER
I20260709 12:28:27.647341 19428 raft_consensus.cc:697] T 84655933e2a8465d8aede7f18c893cad P 595ece3316774e33930c4ef7923b8dc1 [term 2 LEADER]: Becoming Leader. State: Replica: 595ece3316774e33930c4ef7923b8dc1, State: Running, Role: LEADER
I20260709 12:28:27.648763 19428 consensus_queue.cc:237] T 84655933e2a8465d8aede7f18c893cad P 595ece3316774e33930c4ef7923b8dc1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:27.648685 19300 consensus_queue.cc:260] T 8d1007a33823446895ad5e0307fa4fff P ecd798a306df4905858bf774b6cd98f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:27.646540 19225 raft_consensus.cc:2468] T 8d1007a33823446895ad5e0307fa4fff P 595ece3316774e33930c4ef7923b8dc1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5cd38daa04940ac97f9037e3241cdaf in term 2.
I20260709 12:28:27.650380 19300 raft_consensus.cc:3060] T 8d1007a33823446895ad5e0307fa4fff P ecd798a306df4905858bf774b6cd98f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:27.651824 19117 leader_election.cc:304] T 8d1007a33823446895ad5e0307fa4fff P a5cd38daa04940ac97f9037e3241cdaf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 595ece3316774e33930c4ef7923b8dc1, a5cd38daa04940ac97f9037e3241cdaf; no voters: 
I20260709 12:28:27.652802 19475 raft_consensus.cc:2804] T 8d1007a33823446895ad5e0307fa4fff P a5cd38daa04940ac97f9037e3241cdaf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:27.653288 19475 raft_consensus.cc:697] T 8d1007a33823446895ad5e0307fa4fff P a5cd38daa04940ac97f9037e3241cdaf [term 2 LEADER]: Becoming Leader. State: Replica: a5cd38daa04940ac97f9037e3241cdaf, State: Running, Role: LEADER
I20260709 12:28:27.654125 19475 consensus_queue.cc:237] T 8d1007a33823446895ad5e0307fa4fff P a5cd38daa04940ac97f9037e3241cdaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:27.659209 19300 raft_consensus.cc:2468] T 8d1007a33823446895ad5e0307fa4fff P ecd798a306df4905858bf774b6cd98f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5cd38daa04940ac97f9037e3241cdaf in term 2.
I20260709 12:28:27.660504 19048 catalog_manager.cc:5697] T 345ac35ca3d140d3ab3ba9fc108a930b P 595ece3316774e33930c4ef7923b8dc1 reported cstate change: term changed from 1 to 2, leader changed from a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65) to 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66). New cstate: current_term: 2 leader_uuid: "595ece3316774e33930c4ef7923b8dc1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:27.662068 19048 catalog_manager.cc:5697] T 84655933e2a8465d8aede7f18c893cad P 595ece3316774e33930c4ef7923b8dc1 reported cstate change: term changed from 1 to 2, leader changed from ecd798a306df4905858bf774b6cd98f3 (127.9.116.67) to 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66). New cstate: current_term: 2 leader_uuid: "595ece3316774e33930c4ef7923b8dc1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:27.663733 19046 catalog_manager.cc:5697] T 8d1007a33823446895ad5e0307fa4fff P a5cd38daa04940ac97f9037e3241cdaf reported cstate change: term changed from 1 to 2, leader changed from ecd798a306df4905858bf774b6cd98f3 (127.9.116.67) to a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65). New cstate: current_term: 2 leader_uuid: "a5cd38daa04940ac97f9037e3241cdaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:27.671150 19300 raft_consensus.cc:1275] T 88011d359ca74cf18e222bdaed1978a0 P ecd798a306df4905858bf774b6cd98f3 [term 2 FOLLOWER]: Refusing update from remote peer a5cd38daa04940ac97f9037e3241cdaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:27.673414 19475 consensus_queue.cc:1048] T 88011d359ca74cf18e222bdaed1978a0 P a5cd38daa04940ac97f9037e3241cdaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:27.682703 19225 raft_consensus.cc:1275] T 88011d359ca74cf18e222bdaed1978a0 P 595ece3316774e33930c4ef7923b8dc1 [term 2 FOLLOWER]: Refusing update from remote peer a5cd38daa04940ac97f9037e3241cdaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:27.684731 19476 consensus_queue.cc:1048] T 88011d359ca74cf18e222bdaed1978a0 P a5cd38daa04940ac97f9037e3241cdaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:27.788834 19225 raft_consensus.cc:1275] T 0fd8240043ac467eb287176c4f2e97e7 P 595ece3316774e33930c4ef7923b8dc1 [term 2 FOLLOWER]: Refusing update from remote peer ecd798a306df4905858bf774b6cd98f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:27.790613 19456 consensus_queue.cc:1048] T 0fd8240043ac467eb287176c4f2e97e7 P ecd798a306df4905858bf774b6cd98f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:27.791769 19151 raft_consensus.cc:1275] T 0fd8240043ac467eb287176c4f2e97e7 P a5cd38daa04940ac97f9037e3241cdaf [term 2 FOLLOWER]: Refusing update from remote peer ecd798a306df4905858bf774b6cd98f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:27.793506 19456 consensus_queue.cc:1048] T 0fd8240043ac467eb287176c4f2e97e7 P ecd798a306df4905858bf774b6cd98f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:27.861809 19225 raft_consensus.cc:1275] T 47b5cca5e909437c96a329dd6a87e474 P 595ece3316774e33930c4ef7923b8dc1 [term 2 FOLLOWER]: Refusing update from remote peer a5cd38daa04940ac97f9037e3241cdaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:27.863534 19476 consensus_queue.cc:1048] T 47b5cca5e909437c96a329dd6a87e474 P a5cd38daa04940ac97f9037e3241cdaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:27.876580 19300 raft_consensus.cc:1275] T 47b5cca5e909437c96a329dd6a87e474 P ecd798a306df4905858bf774b6cd98f3 [term 2 FOLLOWER]: Refusing update from remote peer a5cd38daa04940ac97f9037e3241cdaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:27.878068 19475 consensus_queue.cc:1048] T 47b5cca5e909437c96a329dd6a87e474 P a5cd38daa04940ac97f9037e3241cdaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:27.909631 19300 raft_consensus.cc:1275] T e2cf09feaca24068a727752850983ac5 P ecd798a306df4905858bf774b6cd98f3 [term 2 FOLLOWER]: Refusing update from remote peer a5cd38daa04940ac97f9037e3241cdaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:27.911283 19475 consensus_queue.cc:1048] T e2cf09feaca24068a727752850983ac5 P a5cd38daa04940ac97f9037e3241cdaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:27.919945 19225 raft_consensus.cc:1275] T e2cf09feaca24068a727752850983ac5 P 595ece3316774e33930c4ef7923b8dc1 [term 2 FOLLOWER]: Refusing update from remote peer a5cd38daa04940ac97f9037e3241cdaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:27.921916 19475 consensus_queue.cc:1048] T e2cf09feaca24068a727752850983ac5 P a5cd38daa04940ac97f9037e3241cdaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:28.042574 19301 raft_consensus.cc:1275] T 345ac35ca3d140d3ab3ba9fc108a930b P ecd798a306df4905858bf774b6cd98f3 [term 2 FOLLOWER]: Refusing update from remote peer 595ece3316774e33930c4ef7923b8dc1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:28.044116 19520 consensus_queue.cc:1048] T 345ac35ca3d140d3ab3ba9fc108a930b P 595ece3316774e33930c4ef7923b8dc1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:28.050882 19151 raft_consensus.cc:1275] T 345ac35ca3d140d3ab3ba9fc108a930b P a5cd38daa04940ac97f9037e3241cdaf [term 2 FOLLOWER]: Refusing update from remote peer 595ece3316774e33930c4ef7923b8dc1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:28.052779 19511 consensus_queue.cc:1048] T 345ac35ca3d140d3ab3ba9fc108a930b P 595ece3316774e33930c4ef7923b8dc1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:28.105338 19151 raft_consensus.cc:1275] T 1e372667da904e65aa5d7c5345b08fca P a5cd38daa04940ac97f9037e3241cdaf [term 2 FOLLOWER]: Refusing update from remote peer 595ece3316774e33930c4ef7923b8dc1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:28.106964 19511 consensus_queue.cc:1048] T 1e372667da904e65aa5d7c5345b08fca P 595ece3316774e33930c4ef7923b8dc1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:28.117596 19301 raft_consensus.cc:1275] T 1e372667da904e65aa5d7c5345b08fca P ecd798a306df4905858bf774b6cd98f3 [term 2 FOLLOWER]: Refusing update from remote peer 595ece3316774e33930c4ef7923b8dc1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:28.119344 19511 consensus_queue.cc:1048] T 1e372667da904e65aa5d7c5345b08fca P 595ece3316774e33930c4ef7923b8dc1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:28.138878 19227 raft_consensus.cc:1275] T 8d1007a33823446895ad5e0307fa4fff P 595ece3316774e33930c4ef7923b8dc1 [term 2 FOLLOWER]: Refusing update from remote peer a5cd38daa04940ac97f9037e3241cdaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:28.140388 19476 consensus_queue.cc:1048] T 8d1007a33823446895ad5e0307fa4fff P a5cd38daa04940ac97f9037e3241cdaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:28.143095 19301 raft_consensus.cc:1275] T 8d1007a33823446895ad5e0307fa4fff P ecd798a306df4905858bf774b6cd98f3 [term 2 FOLLOWER]: Refusing update from remote peer a5cd38daa04940ac97f9037e3241cdaf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:28.144258 19476 consensus_queue.cc:1048] T 8d1007a33823446895ad5e0307fa4fff P a5cd38daa04940ac97f9037e3241cdaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:28.188772 19300 raft_consensus.cc:1275] T 84655933e2a8465d8aede7f18c893cad P ecd798a306df4905858bf774b6cd98f3 [term 2 FOLLOWER]: Refusing update from remote peer 595ece3316774e33930c4ef7923b8dc1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:28.190522 19511 consensus_queue.cc:1048] T 84655933e2a8465d8aede7f18c893cad P 595ece3316774e33930c4ef7923b8dc1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:28.200820 19151 raft_consensus.cc:1275] T 84655933e2a8465d8aede7f18c893cad P a5cd38daa04940ac97f9037e3241cdaf [term 2 FOLLOWER]: Refusing update from remote peer 595ece3316774e33930c4ef7923b8dc1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:28.203001 19428 consensus_queue.cc:1048] T 84655933e2a8465d8aede7f18c893cad P 595ece3316774e33930c4ef7923b8dc1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:30.219033 19050 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37338:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:28:30.241797 19050 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37338:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:28:30.306859  9681 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:28:30.515920 19564 tablet.cc:1724] T e2cf09feaca24068a727752850983ac5 P a5cd38daa04940ac97f9037e3241cdaf: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:30.531818 19571 tablet.cc:1724] T 47b5cca5e909437c96a329dd6a87e474 P 595ece3316774e33930c4ef7923b8dc1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:28:30.558120 19562 log.cc:927] Time spent T e2cf09feaca24068a727752850983ac5 P 595ece3316774e33930c4ef7923b8dc1: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:28:30.514792 19566 tablet.cc:1724] T 345ac35ca3d140d3ab3ba9fc108a930b P 595ece3316774e33930c4ef7923b8dc1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:30.588176 19574 tablet.cc:1724] T 1e372667da904e65aa5d7c5345b08fca P 595ece3316774e33930c4ef7923b8dc1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:30.588941 19569 tablet.cc:1724] T 345ac35ca3d140d3ab3ba9fc108a930b P a5cd38daa04940ac97f9037e3241cdaf: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:28:30.603725 19563 log.cc:927] Time spent T 1e372667da904e65aa5d7c5345b08fca P a5cd38daa04940ac97f9037e3241cdaf: Append to log took a long time: real 0.104s	user 0.004s	sys 0.002s
I20260709 12:28:30.605901 19570 tablet.cc:1724] T 47b5cca5e909437c96a329dd6a87e474 P a5cd38daa04940ac97f9037e3241cdaf: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:30.618974 19225 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c21e55b8c694512b0ed942898b2749d"
dest_uuid: "595ece3316774e33930c4ef7923b8dc1"
mode: GRACEFUL
new_leader_uuid: "ecd798a306df4905858bf774b6cd98f3"
 from {username='slave'} at 127.0.0.1:60132
W20260709 12:28:30.632609 19178 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:345ac35ca3d140d3ab3ba9fc108a930b)
I20260709 12:28:30.653903 19225 raft_consensus.cc:606] T 7c21e55b8c694512b0ed942898b2749d P 595ece3316774e33930c4ef7923b8dc1 [term 1 LEADER]: Received request to transfer leadership to TS ecd798a306df4905858bf774b6cd98f3
I20260709 12:28:30.623914 19578 tablet.cc:1724] T 1e372667da904e65aa5d7c5345b08fca P ecd798a306df4905858bf774b6cd98f3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:28:30.672755 19178 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:345ac35ca3d140d3ab3ba9fc108a930b)
W20260709 12:28:30.683212 19178 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:345ac35ca3d140d3ab3ba9fc108a930b)
W20260709 12:28:30.685590 19117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:37403, user_credentials={real_user=slave}} blocked reactor thread for 51451.2us
I20260709 12:28:30.622282 19575 tablet.cc:1724] T e2cf09feaca24068a727752850983ac5 P ecd798a306df4905858bf774b6cd98f3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:30.686115 19577 tablet.cc:1724] T 345ac35ca3d140d3ab3ba9fc108a930b P ecd798a306df4905858bf774b6cd98f3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:30.688688 19586 tablet.cc:1724] T 47b5cca5e909437c96a329dd6a87e474 P ecd798a306df4905858bf774b6cd98f3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:30.711773 19566 tablet.cc:1724] T e2cf09feaca24068a727752850983ac5 P 595ece3316774e33930c4ef7923b8dc1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:30.712610 19511 raft_consensus.cc:993] T 7c21e55b8c694512b0ed942898b2749d P 595ece3316774e33930c4ef7923b8dc1: : Instructing follower ecd798a306df4905858bf774b6cd98f3 to start an election
W20260709 12:28:30.865783 19117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:37403, user_credentials={real_user=slave}} blocked reactor thread for 100879us
I20260709 12:28:30.871513 19511 raft_consensus.cc:1081] T 7c21e55b8c694512b0ed942898b2749d P 595ece3316774e33930c4ef7923b8dc1 [term 1 LEADER]: Signalling peer ecd798a306df4905858bf774b6cd98f3 to start an election
I20260709 12:28:30.886049 19570 tablet.cc:1724] T 8d1007a33823446895ad5e0307fa4fff P a5cd38daa04940ac97f9037e3241cdaf: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:30.899082 19574 tablet.cc:1724] T 88011d359ca74cf18e222bdaed1978a0 P 595ece3316774e33930c4ef7923b8dc1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:30.900534 19589 tablet.cc:1724] T 1e372667da904e65aa5d7c5345b08fca P a5cd38daa04940ac97f9037e3241cdaf: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:30.907063 19588 tablet.cc:1724] T 8d1007a33823446895ad5e0307fa4fff P 595ece3316774e33930c4ef7923b8dc1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:30.922289 19298 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7c21e55b8c694512b0ed942898b2749d"
dest_uuid: "ecd798a306df4905858bf774b6cd98f3"
 from {username='slave'} at 127.0.0.1:49288
I20260709 12:28:30.923020 19298 raft_consensus.cc:493] T 7c21e55b8c694512b0ed942898b2749d P ecd798a306df4905858bf774b6cd98f3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:30.923408 19298 raft_consensus.cc:3060] T 7c21e55b8c694512b0ed942898b2749d P ecd798a306df4905858bf774b6cd98f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:30.926412 19589 tablet.cc:1724] T 88011d359ca74cf18e222bdaed1978a0 P a5cd38daa04940ac97f9037e3241cdaf: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:30.936159 19577 tablet.cc:1724] T 84655933e2a8465d8aede7f18c893cad P ecd798a306df4905858bf774b6cd98f3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:30.939406 19578 tablet.cc:1724] T 7c21e55b8c694512b0ed942898b2749d P ecd798a306df4905858bf774b6cd98f3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:30.957686 19566 tablet.cc:1724] T 84655933e2a8465d8aede7f18c893cad P 595ece3316774e33930c4ef7923b8dc1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:30.960232 19569 tablet.cc:1724] T 7c21e55b8c694512b0ed942898b2749d P a5cd38daa04940ac97f9037e3241cdaf: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:30.961628 19571 tablet.cc:1724] T 7c21e55b8c694512b0ed942898b2749d P 595ece3316774e33930c4ef7923b8dc1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:30.961756 19588 tablet.cc:1724] T 0fd8240043ac467eb287176c4f2e97e7 P 595ece3316774e33930c4ef7923b8dc1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:30.977202 19578 tablet.cc:1724] T 8d1007a33823446895ad5e0307fa4fff P ecd798a306df4905858bf774b6cd98f3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:30.979655 19577 tablet.cc:1724] T 88011d359ca74cf18e222bdaed1978a0 P ecd798a306df4905858bf774b6cd98f3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:30.987486 19564 tablet.cc:1724] T 0fd8240043ac467eb287176c4f2e97e7 P a5cd38daa04940ac97f9037e3241cdaf: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:30.995833 19149 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "88011d359ca74cf18e222bdaed1978a0"
dest_uuid: "a5cd38daa04940ac97f9037e3241cdaf"
mode: GRACEFUL
new_leader_uuid: "ecd798a306df4905858bf774b6cd98f3"
 from {username='slave'} at 127.0.0.1:32978
I20260709 12:28:30.996887 19149 raft_consensus.cc:606] T 88011d359ca74cf18e222bdaed1978a0 P a5cd38daa04940ac97f9037e3241cdaf [term 2 LEADER]: Received request to transfer leadership to TS ecd798a306df4905858bf774b6cd98f3
I20260709 12:28:30.999038  9681 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 12:28:30.999945  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:31.002543 19564 tablet.cc:1724] T 84655933e2a8465d8aede7f18c893cad P a5cd38daa04940ac97f9037e3241cdaf: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:31.006404 19575 tablet.cc:1724] T 0fd8240043ac467eb287176c4f2e97e7 P ecd798a306df4905858bf774b6cd98f3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:31.014339 19149 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9150dab4dcbc4945994ab3f7090326b5"
dest_uuid: "a5cd38daa04940ac97f9037e3241cdaf"
mode: GRACEFUL
new_leader_uuid: "ecd798a306df4905858bf774b6cd98f3"
 from {username='slave'} at 127.0.0.1:32978
I20260709 12:28:31.015245 19149 raft_consensus.cc:606] T 9150dab4dcbc4945994ab3f7090326b5 P a5cd38daa04940ac97f9037e3241cdaf [term 1 LEADER]: Received request to transfer leadership to TS ecd798a306df4905858bf774b6cd98f3
I20260709 12:28:31.019464 19223 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c542a19e01724e1982bf9694078796f3"
dest_uuid: "595ece3316774e33930c4ef7923b8dc1"
mode: GRACEFUL
new_leader_uuid: "ecd798a306df4905858bf774b6cd98f3"
 from {username='slave'} at 127.0.0.1:60132
I20260709 12:28:31.020274 19223 raft_consensus.cc:606] T c542a19e01724e1982bf9694078796f3 P 595ece3316774e33930c4ef7923b8dc1 [term 2 LEADER]: Received request to transfer leadership to TS ecd798a306df4905858bf774b6cd98f3
I20260709 12:28:31.022092  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:28:31.022874  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:31.046715 19298 raft_consensus.cc:515] T 7c21e55b8c694512b0ed942898b2749d P ecd798a306df4905858bf774b6cd98f3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:31.054359 19149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c21e55b8c694512b0ed942898b2749d" candidate_uuid: "ecd798a306df4905858bf774b6cd98f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "a5cd38daa04940ac97f9037e3241cdaf"
I20260709 12:28:31.055140 19149 raft_consensus.cc:3060] T 7c21e55b8c694512b0ed942898b2749d P a5cd38daa04940ac97f9037e3241cdaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:31.068327 19298 leader_election.cc:290] T 7c21e55b8c694512b0ed942898b2749d P ecd798a306df4905858bf774b6cd98f3 [CANDIDATE]: Term 2 election: Requested vote from peers a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65:42503), 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66:37433)
I20260709 12:28:31.069816 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c21e55b8c694512b0ed942898b2749d" candidate_uuid: "ecd798a306df4905858bf774b6cd98f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "595ece3316774e33930c4ef7923b8dc1"
I20260709 12:28:31.070528 19223 raft_consensus.cc:3055] T 7c21e55b8c694512b0ed942898b2749d P 595ece3316774e33930c4ef7923b8dc1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:31.070871 19223 raft_consensus.cc:740] T 7c21e55b8c694512b0ed942898b2749d P 595ece3316774e33930c4ef7923b8dc1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 595ece3316774e33930c4ef7923b8dc1, State: Running, Role: LEADER
I20260709 12:28:31.071750 19223 consensus_queue.cc:260] T 7c21e55b8c694512b0ed942898b2749d P 595ece3316774e33930c4ef7923b8dc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:31.072921 19223 raft_consensus.cc:3060] T 7c21e55b8c694512b0ed942898b2749d P 595ece3316774e33930c4ef7923b8dc1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:31.076311 19149 raft_consensus.cc:2468] T 7c21e55b8c694512b0ed942898b2749d P a5cd38daa04940ac97f9037e3241cdaf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd798a306df4905858bf774b6cd98f3 in term 2.
I20260709 12:28:31.078413 19265 leader_election.cc:304] T 7c21e55b8c694512b0ed942898b2749d P ecd798a306df4905858bf774b6cd98f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a5cd38daa04940ac97f9037e3241cdaf, ecd798a306df4905858bf774b6cd98f3; no voters: 
I20260709 12:28:31.079636 19546 raft_consensus.cc:2804] T 7c21e55b8c694512b0ed942898b2749d P ecd798a306df4905858bf774b6cd98f3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:31.080145 19223 raft_consensus.cc:2468] T 7c21e55b8c694512b0ed942898b2749d P 595ece3316774e33930c4ef7923b8dc1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd798a306df4905858bf774b6cd98f3 in term 2.
I20260709 12:28:31.080307 19546 raft_consensus.cc:697] T 7c21e55b8c694512b0ed942898b2749d P ecd798a306df4905858bf774b6cd98f3 [term 2 LEADER]: Becoming Leader. State: Replica: ecd798a306df4905858bf774b6cd98f3, State: Running, Role: LEADER
I20260709 12:28:31.081696 19546 consensus_queue.cc:237] T 7c21e55b8c694512b0ed942898b2749d P ecd798a306df4905858bf774b6cd98f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:31.091629 19050 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 9370f92c47a14d899d2bfc637e9440dc: soft_deleted_table [id=43c808bf3d5c47a8b2657ddd54446cfd] alter complete (version 1)
I20260709 12:28:31.103641 19047 catalog_manager.cc:5697] T 7c21e55b8c694512b0ed942898b2749d P ecd798a306df4905858bf774b6cd98f3 reported cstate change: term changed from 1 to 2, leader changed from 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66) to ecd798a306df4905858bf774b6cd98f3 (127.9.116.67). New cstate: current_term: 2 leader_uuid: "ecd798a306df4905858bf774b6cd98f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:31.387853 19561 raft_consensus.cc:993] T c542a19e01724e1982bf9694078796f3 P 595ece3316774e33930c4ef7923b8dc1: : Instructing follower ecd798a306df4905858bf774b6cd98f3 to start an election
I20260709 12:28:31.388445 19545 raft_consensus.cc:1081] T c542a19e01724e1982bf9694078796f3 P 595ece3316774e33930c4ef7923b8dc1 [term 2 LEADER]: Signalling peer ecd798a306df4905858bf774b6cd98f3 to start an election
I20260709 12:28:31.390440 19298 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c542a19e01724e1982bf9694078796f3"
dest_uuid: "ecd798a306df4905858bf774b6cd98f3"
 from {username='slave'} at 127.0.0.1:49288
I20260709 12:28:31.391083 19298 raft_consensus.cc:493] T c542a19e01724e1982bf9694078796f3 P ecd798a306df4905858bf774b6cd98f3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:31.391564 19298 raft_consensus.cc:3060] T c542a19e01724e1982bf9694078796f3 P ecd798a306df4905858bf774b6cd98f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:31.398404 19298 raft_consensus.cc:515] T c542a19e01724e1982bf9694078796f3 P ecd798a306df4905858bf774b6cd98f3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:31.400790 19298 leader_election.cc:290] T c542a19e01724e1982bf9694078796f3 P ecd798a306df4905858bf774b6cd98f3 [CANDIDATE]: Term 3 election: Requested vote from peers a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65:42503), 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66:37433)
I20260709 12:28:31.401531 19149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c542a19e01724e1982bf9694078796f3" candidate_uuid: "ecd798a306df4905858bf774b6cd98f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a5cd38daa04940ac97f9037e3241cdaf"
I20260709 12:28:31.401877 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c542a19e01724e1982bf9694078796f3" candidate_uuid: "ecd798a306df4905858bf774b6cd98f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "595ece3316774e33930c4ef7923b8dc1"
I20260709 12:28:31.402278 19149 raft_consensus.cc:3060] T c542a19e01724e1982bf9694078796f3 P a5cd38daa04940ac97f9037e3241cdaf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:31.402568 19223 raft_consensus.cc:3055] T c542a19e01724e1982bf9694078796f3 P 595ece3316774e33930c4ef7923b8dc1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:31.402985 19223 raft_consensus.cc:740] T c542a19e01724e1982bf9694078796f3 P 595ece3316774e33930c4ef7923b8dc1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 595ece3316774e33930c4ef7923b8dc1, State: Running, Role: LEADER
I20260709 12:28:31.403769 19223 consensus_queue.cc:260] T c542a19e01724e1982bf9694078796f3 P 595ece3316774e33930c4ef7923b8dc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:31.404837 19223 raft_consensus.cc:3060] T c542a19e01724e1982bf9694078796f3 P 595ece3316774e33930c4ef7923b8dc1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:31.409124 19149 raft_consensus.cc:2468] T c542a19e01724e1982bf9694078796f3 P a5cd38daa04940ac97f9037e3241cdaf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd798a306df4905858bf774b6cd98f3 in term 3.
I20260709 12:28:31.411013 19265 leader_election.cc:304] T c542a19e01724e1982bf9694078796f3 P ecd798a306df4905858bf774b6cd98f3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a5cd38daa04940ac97f9037e3241cdaf, ecd798a306df4905858bf774b6cd98f3; no voters: 
I20260709 12:28:31.412062 19546 raft_consensus.cc:2804] T c542a19e01724e1982bf9694078796f3 P ecd798a306df4905858bf774b6cd98f3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:31.412694 19546 raft_consensus.cc:697] T c542a19e01724e1982bf9694078796f3 P ecd798a306df4905858bf774b6cd98f3 [term 3 LEADER]: Becoming Leader. State: Replica: ecd798a306df4905858bf774b6cd98f3, State: Running, Role: LEADER
I20260709 12:28:31.413902 19223 raft_consensus.cc:2468] T c542a19e01724e1982bf9694078796f3 P 595ece3316774e33930c4ef7923b8dc1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd798a306df4905858bf774b6cd98f3 in term 3.
I20260709 12:28:31.413681 19546 consensus_queue.cc:237] T c542a19e01724e1982bf9694078796f3 P ecd798a306df4905858bf774b6cd98f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:31.416376 19523 raft_consensus.cc:993] T 88011d359ca74cf18e222bdaed1978a0 P a5cd38daa04940ac97f9037e3241cdaf: : Instructing follower ecd798a306df4905858bf774b6cd98f3 to start an election
I20260709 12:28:31.417061 19581 raft_consensus.cc:1081] T 88011d359ca74cf18e222bdaed1978a0 P a5cd38daa04940ac97f9037e3241cdaf [term 2 LEADER]: Signalling peer ecd798a306df4905858bf774b6cd98f3 to start an election
I20260709 12:28:31.419623 19296 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "88011d359ca74cf18e222bdaed1978a0"
dest_uuid: "ecd798a306df4905858bf774b6cd98f3"
 from {username='slave'} at 127.0.0.1:49280
I20260709 12:28:31.420353 19296 raft_consensus.cc:493] T 88011d359ca74cf18e222bdaed1978a0 P ecd798a306df4905858bf774b6cd98f3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:31.420775 19296 raft_consensus.cc:3060] T 88011d359ca74cf18e222bdaed1978a0 P ecd798a306df4905858bf774b6cd98f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:31.421577 19552 raft_consensus.cc:993] T 9150dab4dcbc4945994ab3f7090326b5 P a5cd38daa04940ac97f9037e3241cdaf: : Instructing follower ecd798a306df4905858bf774b6cd98f3 to start an election
I20260709 12:28:31.422168 19581 raft_consensus.cc:1081] T 9150dab4dcbc4945994ab3f7090326b5 P a5cd38daa04940ac97f9037e3241cdaf [term 1 LEADER]: Signalling peer ecd798a306df4905858bf774b6cd98f3 to start an election
I20260709 12:28:31.424697 19298 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9150dab4dcbc4945994ab3f7090326b5"
dest_uuid: "ecd798a306df4905858bf774b6cd98f3"
 from {username='slave'} at 127.0.0.1:49280
I20260709 12:28:31.425307 19298 raft_consensus.cc:493] T 9150dab4dcbc4945994ab3f7090326b5 P ecd798a306df4905858bf774b6cd98f3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:31.425714 19298 raft_consensus.cc:3060] T 9150dab4dcbc4945994ab3f7090326b5 P ecd798a306df4905858bf774b6cd98f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:31.428761 19050 catalog_manager.cc:5697] T c542a19e01724e1982bf9694078796f3 P ecd798a306df4905858bf774b6cd98f3 reported cstate change: term changed from 2 to 3, leader changed from 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66) to ecd798a306df4905858bf774b6cd98f3 (127.9.116.67). New cstate: current_term: 3 leader_uuid: "ecd798a306df4905858bf774b6cd98f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:31.429817 19296 raft_consensus.cc:515] T 88011d359ca74cf18e222bdaed1978a0 P ecd798a306df4905858bf774b6cd98f3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:31.432996 19149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88011d359ca74cf18e222bdaed1978a0" candidate_uuid: "ecd798a306df4905858bf774b6cd98f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "a5cd38daa04940ac97f9037e3241cdaf"
I20260709 12:28:31.433596 19149 raft_consensus.cc:3055] T 88011d359ca74cf18e222bdaed1978a0 P a5cd38daa04940ac97f9037e3241cdaf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:31.433964 19149 raft_consensus.cc:740] T 88011d359ca74cf18e222bdaed1978a0 P a5cd38daa04940ac97f9037e3241cdaf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a5cd38daa04940ac97f9037e3241cdaf, State: Running, Role: LEADER
I20260709 12:28:31.434753 19149 consensus_queue.cc:260] T 88011d359ca74cf18e222bdaed1978a0 P a5cd38daa04940ac97f9037e3241cdaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:31.436081 19149 raft_consensus.cc:3060] T 88011d359ca74cf18e222bdaed1978a0 P a5cd38daa04940ac97f9037e3241cdaf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:31.437043 19298 raft_consensus.cc:515] T 9150dab4dcbc4945994ab3f7090326b5 P ecd798a306df4905858bf774b6cd98f3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:31.440498 19298 leader_election.cc:290] T 9150dab4dcbc4945994ab3f7090326b5 P ecd798a306df4905858bf774b6cd98f3 [CANDIDATE]: Term 2 election: Requested vote from peers a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65:42503), 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66:37433)
I20260709 12:28:31.440524 19148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9150dab4dcbc4945994ab3f7090326b5" candidate_uuid: "ecd798a306df4905858bf774b6cd98f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a5cd38daa04940ac97f9037e3241cdaf"
I20260709 12:28:31.441352 19148 raft_consensus.cc:3055] T 9150dab4dcbc4945994ab3f7090326b5 P a5cd38daa04940ac97f9037e3241cdaf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:31.441680 19148 raft_consensus.cc:740] T 9150dab4dcbc4945994ab3f7090326b5 P a5cd38daa04940ac97f9037e3241cdaf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a5cd38daa04940ac97f9037e3241cdaf, State: Running, Role: LEADER
I20260709 12:28:31.441844 19296 leader_election.cc:290] T 88011d359ca74cf18e222bdaed1978a0 P ecd798a306df4905858bf774b6cd98f3 [CANDIDATE]: Term 3 election: Requested vote from peers a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65:42503), 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66:37433)
I20260709 12:28:31.442477 19148 consensus_queue.cc:260] T 9150dab4dcbc4945994ab3f7090326b5 P a5cd38daa04940ac97f9037e3241cdaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:31.442965 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9150dab4dcbc4945994ab3f7090326b5" candidate_uuid: "ecd798a306df4905858bf774b6cd98f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "595ece3316774e33930c4ef7923b8dc1"
I20260709 12:28:31.443608 19223 raft_consensus.cc:3060] T 9150dab4dcbc4945994ab3f7090326b5 P 595ece3316774e33930c4ef7923b8dc1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:31.443703 19148 raft_consensus.cc:3060] T 9150dab4dcbc4945994ab3f7090326b5 P a5cd38daa04940ac97f9037e3241cdaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:31.444868 19227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88011d359ca74cf18e222bdaed1978a0" candidate_uuid: "ecd798a306df4905858bf774b6cd98f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "595ece3316774e33930c4ef7923b8dc1"
I20260709 12:28:31.445473 19227 raft_consensus.cc:3060] T 88011d359ca74cf18e222bdaed1978a0 P 595ece3316774e33930c4ef7923b8dc1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:31.454553 19223 raft_consensus.cc:2468] T 9150dab4dcbc4945994ab3f7090326b5 P 595ece3316774e33930c4ef7923b8dc1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd798a306df4905858bf774b6cd98f3 in term 2.
I20260709 12:28:31.456143 19149 raft_consensus.cc:2468] T 88011d359ca74cf18e222bdaed1978a0 P a5cd38daa04940ac97f9037e3241cdaf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd798a306df4905858bf774b6cd98f3 in term 3.
I20260709 12:28:31.456792 19266 leader_election.cc:304] T 9150dab4dcbc4945994ab3f7090326b5 P ecd798a306df4905858bf774b6cd98f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 595ece3316774e33930c4ef7923b8dc1, ecd798a306df4905858bf774b6cd98f3; no voters: 
I20260709 12:28:31.457424 19265 leader_election.cc:304] T 88011d359ca74cf18e222bdaed1978a0 P ecd798a306df4905858bf774b6cd98f3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a5cd38daa04940ac97f9037e3241cdaf, ecd798a306df4905858bf774b6cd98f3; no voters: 
I20260709 12:28:31.457747 19546 raft_consensus.cc:2804] T 9150dab4dcbc4945994ab3f7090326b5 P ecd798a306df4905858bf774b6cd98f3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:31.458324 19546 raft_consensus.cc:697] T 9150dab4dcbc4945994ab3f7090326b5 P ecd798a306df4905858bf774b6cd98f3 [term 2 LEADER]: Becoming Leader. State: Replica: ecd798a306df4905858bf774b6cd98f3, State: Running, Role: LEADER
I20260709 12:28:31.458369 19502 raft_consensus.cc:2804] T 88011d359ca74cf18e222bdaed1978a0 P ecd798a306df4905858bf774b6cd98f3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:31.459028 19502 raft_consensus.cc:697] T 88011d359ca74cf18e222bdaed1978a0 P ecd798a306df4905858bf774b6cd98f3 [term 3 LEADER]: Becoming Leader. State: Replica: ecd798a306df4905858bf774b6cd98f3, State: Running, Role: LEADER
I20260709 12:28:31.459411 19546 consensus_queue.cc:237] T 9150dab4dcbc4945994ab3f7090326b5 P ecd798a306df4905858bf774b6cd98f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:31.459904 19148 raft_consensus.cc:2468] T 9150dab4dcbc4945994ab3f7090326b5 P a5cd38daa04940ac97f9037e3241cdaf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd798a306df4905858bf774b6cd98f3 in term 2.
I20260709 12:28:31.460054 19502 consensus_queue.cc:237] T 88011d359ca74cf18e222bdaed1978a0 P ecd798a306df4905858bf774b6cd98f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } }
I20260709 12:28:31.460016 19227 raft_consensus.cc:2468] T 88011d359ca74cf18e222bdaed1978a0 P 595ece3316774e33930c4ef7923b8dc1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd798a306df4905858bf774b6cd98f3 in term 3.
I20260709 12:28:31.469868 19050 catalog_manager.cc:5697] T 9150dab4dcbc4945994ab3f7090326b5 P ecd798a306df4905858bf774b6cd98f3 reported cstate change: term changed from 1 to 2, leader changed from a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65) to ecd798a306df4905858bf774b6cd98f3 (127.9.116.67). New cstate: current_term: 2 leader_uuid: "ecd798a306df4905858bf774b6cd98f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:31.482620 19050 catalog_manager.cc:5697] T 88011d359ca74cf18e222bdaed1978a0 P ecd798a306df4905858bf774b6cd98f3 reported cstate change: term changed from 2 to 3, leader changed from a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65) to ecd798a306df4905858bf774b6cd98f3 (127.9.116.67). New cstate: current_term: 3 leader_uuid: "ecd798a306df4905858bf774b6cd98f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd798a306df4905858bf774b6cd98f3" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 37403 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:31.544349 19149 raft_consensus.cc:1275] T 7c21e55b8c694512b0ed942898b2749d P a5cd38daa04940ac97f9037e3241cdaf [term 2 FOLLOWER]: Refusing update from remote peer ecd798a306df4905858bf774b6cd98f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:28:31.545679 19546 consensus_queue.cc:1048] T 7c21e55b8c694512b0ed942898b2749d P ecd798a306df4905858bf774b6cd98f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:31.555814 19227 raft_consensus.cc:1275] T 7c21e55b8c694512b0ed942898b2749d P 595ece3316774e33930c4ef7923b8dc1 [term 2 FOLLOWER]: Refusing update from remote peer ecd798a306df4905858bf774b6cd98f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:28:31.557384 19502 consensus_queue.cc:1048] T 7c21e55b8c694512b0ed942898b2749d P ecd798a306df4905858bf774b6cd98f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:28:31.871448 19149 raft_consensus.cc:1275] T 9150dab4dcbc4945994ab3f7090326b5 P a5cd38daa04940ac97f9037e3241cdaf [term 2 FOLLOWER]: Refusing update from remote peer ecd798a306df4905858bf774b6cd98f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:31.873149 19502 consensus_queue.cc:1048] T 9150dab4dcbc4945994ab3f7090326b5 P ecd798a306df4905858bf774b6cd98f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:31.887451 19227 raft_consensus.cc:1275] T 9150dab4dcbc4945994ab3f7090326b5 P 595ece3316774e33930c4ef7923b8dc1 [term 2 FOLLOWER]: Refusing update from remote peer ecd798a306df4905858bf774b6cd98f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:31.890390 19546 consensus_queue.cc:1048] T 9150dab4dcbc4945994ab3f7090326b5 P ecd798a306df4905858bf774b6cd98f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:31.938971 19227 raft_consensus.cc:1275] T c542a19e01724e1982bf9694078796f3 P 595ece3316774e33930c4ef7923b8dc1 [term 3 FOLLOWER]: Refusing update from remote peer ecd798a306df4905858bf774b6cd98f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:31.940514 19546 consensus_queue.cc:1048] T c542a19e01724e1982bf9694078796f3 P ecd798a306df4905858bf774b6cd98f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:31.950425 19149 raft_consensus.cc:1275] T c542a19e01724e1982bf9694078796f3 P a5cd38daa04940ac97f9037e3241cdaf [term 3 FOLLOWER]: Refusing update from remote peer ecd798a306df4905858bf774b6cd98f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:31.952360 19502 consensus_queue.cc:1048] T c542a19e01724e1982bf9694078796f3 P ecd798a306df4905858bf774b6cd98f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:31.970046 19227 raft_consensus.cc:1275] T 88011d359ca74cf18e222bdaed1978a0 P 595ece3316774e33930c4ef7923b8dc1 [term 3 FOLLOWER]: Refusing update from remote peer ecd798a306df4905858bf774b6cd98f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:28:31.971907 19502 consensus_queue.cc:1048] T 88011d359ca74cf18e222bdaed1978a0 P ecd798a306df4905858bf774b6cd98f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "595ece3316774e33930c4ef7923b8dc1" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 37433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:28:31.985937 19149 raft_consensus.cc:1275] T 88011d359ca74cf18e222bdaed1978a0 P a5cd38daa04940ac97f9037e3241cdaf [term 3 FOLLOWER]: Refusing update from remote peer ecd798a306df4905858bf774b6cd98f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:28:31.988606 19546 consensus_queue.cc:1048] T 88011d359ca74cf18e222bdaed1978a0 P ecd798a306df4905858bf774b6cd98f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5cd38daa04940ac97f9037e3241cdaf" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 42503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:28:32.024194  9681 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:28:32.030807  9681 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:28:32.031301  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:32.037726  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:28:32.038295  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:33.039985  9681 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:28:33.047837  9681 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:28:33.048506  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:33.053673  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:28:33.054075  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:34.055456  9681 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:28:34.062801  9681 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:28:34.063558  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:34.069701  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:28:34.070184  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:35.071166  9681 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:28:35.076303  9681 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:28:35.076807  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:35.083936  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:28:35.084740  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:36.086282  9681 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:28:36.093219  9681 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:28:36.093868  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:36.099298  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:28:36.099905  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:37.101155  9681 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:28:37.108542  9681 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:28:37.109196  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:37.114161  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:28:37.114764  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:38.116286  9681 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:28:38.122601  9681 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:28:38.123155  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:38.128970  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:28:38.129559  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:39.130786  9681 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:28:39.136868  9681 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:28:39.137362  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:39.143894  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:28:39.144306  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:40.145550  9681 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:28:40.151512  9681 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:28:40.152043  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:40.157855  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:28:40.158413  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:41.234028  9681 tablet_server.cc:179] TabletServer@127.9.116.65:0 shutting down...
W20260709 12:28:41.273313 19191 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 8 similar messages]
W20260709 12:28:41.280750 19191 consensus_peers.cc:597] T 345ac35ca3d140d3ab3ba9fc108a930b P 595ece3316774e33930c4ef7923b8dc1 -> Peer a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65:42503): Couldn't send request to peer a5cd38daa04940ac97f9037e3241cdaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:41.292883  9681 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:28:41.293906  9681 tablet_replica.cc:333] T 1e372667da904e65aa5d7c5345b08fca P a5cd38daa04940ac97f9037e3241cdaf: stopping tablet replica
I20260709 12:28:41.294975  9681 raft_consensus.cc:2243] T 1e372667da904e65aa5d7c5345b08fca P a5cd38daa04940ac97f9037e3241cdaf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.296084  9681 raft_consensus.cc:2272] T 1e372667da904e65aa5d7c5345b08fca P a5cd38daa04940ac97f9037e3241cdaf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.300951  9681 tablet_replica.cc:333] T 84655933e2a8465d8aede7f18c893cad P a5cd38daa04940ac97f9037e3241cdaf: stopping tablet replica
I20260709 12:28:41.301971  9681 raft_consensus.cc:2243] T 84655933e2a8465d8aede7f18c893cad P a5cd38daa04940ac97f9037e3241cdaf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.302968  9681 raft_consensus.cc:2272] T 84655933e2a8465d8aede7f18c893cad P a5cd38daa04940ac97f9037e3241cdaf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.306409  9681 tablet_replica.cc:333] T 8d1007a33823446895ad5e0307fa4fff P a5cd38daa04940ac97f9037e3241cdaf: stopping tablet replica
I20260709 12:28:41.307355  9681 raft_consensus.cc:2243] T 8d1007a33823446895ad5e0307fa4fff P a5cd38daa04940ac97f9037e3241cdaf [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:41.308629  9681 raft_consensus.cc:2272] T 8d1007a33823446895ad5e0307fa4fff P a5cd38daa04940ac97f9037e3241cdaf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.312896  9681 tablet_replica.cc:333] T 7c21e55b8c694512b0ed942898b2749d P a5cd38daa04940ac97f9037e3241cdaf: stopping tablet replica
I20260709 12:28:41.313860  9681 raft_consensus.cc:2243] T 7c21e55b8c694512b0ed942898b2749d P a5cd38daa04940ac97f9037e3241cdaf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.314630  9681 raft_consensus.cc:2272] T 7c21e55b8c694512b0ed942898b2749d P a5cd38daa04940ac97f9037e3241cdaf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.317683  9681 tablet_replica.cc:333] T 345ac35ca3d140d3ab3ba9fc108a930b P a5cd38daa04940ac97f9037e3241cdaf: stopping tablet replica
I20260709 12:28:41.318658  9681 raft_consensus.cc:2243] T 345ac35ca3d140d3ab3ba9fc108a930b P a5cd38daa04940ac97f9037e3241cdaf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.320032  9681 raft_consensus.cc:2272] T 345ac35ca3d140d3ab3ba9fc108a930b P a5cd38daa04940ac97f9037e3241cdaf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.324486  9681 tablet_replica.cc:333] T c783b6e59edb46c4976d6b2117292201 P a5cd38daa04940ac97f9037e3241cdaf: stopping tablet replica
I20260709 12:28:41.325381  9681 raft_consensus.cc:2243] T c783b6e59edb46c4976d6b2117292201 P a5cd38daa04940ac97f9037e3241cdaf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.326031  9681 raft_consensus.cc:2272] T c783b6e59edb46c4976d6b2117292201 P a5cd38daa04940ac97f9037e3241cdaf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.330200  9681 tablet_replica.cc:333] T 0fd8240043ac467eb287176c4f2e97e7 P a5cd38daa04940ac97f9037e3241cdaf: stopping tablet replica
I20260709 12:28:41.331243  9681 raft_consensus.cc:2243] T 0fd8240043ac467eb287176c4f2e97e7 P a5cd38daa04940ac97f9037e3241cdaf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.331990  9681 raft_consensus.cc:2272] T 0fd8240043ac467eb287176c4f2e97e7 P a5cd38daa04940ac97f9037e3241cdaf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.334926  9681 tablet_replica.cc:333] T e2cf09feaca24068a727752850983ac5 P a5cd38daa04940ac97f9037e3241cdaf: stopping tablet replica
I20260709 12:28:41.335809  9681 raft_consensus.cc:2243] T e2cf09feaca24068a727752850983ac5 P a5cd38daa04940ac97f9037e3241cdaf [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:41.336990  9681 raft_consensus.cc:2272] T e2cf09feaca24068a727752850983ac5 P a5cd38daa04940ac97f9037e3241cdaf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.339967  9681 tablet_replica.cc:333] T 489fca1a81224008bc8b8e01b86bab9a P a5cd38daa04940ac97f9037e3241cdaf: stopping tablet replica
I20260709 12:28:41.340801  9681 raft_consensus.cc:2243] T 489fca1a81224008bc8b8e01b86bab9a P a5cd38daa04940ac97f9037e3241cdaf [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:41.342154  9681 raft_consensus.cc:2272] T 489fca1a81224008bc8b8e01b86bab9a P a5cd38daa04940ac97f9037e3241cdaf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.346530  9681 tablet_replica.cc:333] T 584e9788383444ce82092f41f1749c44 P a5cd38daa04940ac97f9037e3241cdaf: stopping tablet replica
I20260709 12:28:41.347360  9681 raft_consensus.cc:2243] T 584e9788383444ce82092f41f1749c44 P a5cd38daa04940ac97f9037e3241cdaf [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:41.348438  9681 raft_consensus.cc:2272] T 584e9788383444ce82092f41f1749c44 P a5cd38daa04940ac97f9037e3241cdaf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.351315  9681 tablet_replica.cc:333] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P a5cd38daa04940ac97f9037e3241cdaf: stopping tablet replica
I20260709 12:28:41.351984  9681 raft_consensus.cc:2243] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P a5cd38daa04940ac97f9037e3241cdaf [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:41.352972  9681 raft_consensus.cc:2272] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P a5cd38daa04940ac97f9037e3241cdaf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.355369  9681 tablet_replica.cc:333] T f4a87e357d584a3b925af9c5d05e2ab6 P a5cd38daa04940ac97f9037e3241cdaf: stopping tablet replica
I20260709 12:28:41.355967  9681 raft_consensus.cc:2243] T f4a87e357d584a3b925af9c5d05e2ab6 P a5cd38daa04940ac97f9037e3241cdaf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.356504  9681 raft_consensus.cc:2272] T f4a87e357d584a3b925af9c5d05e2ab6 P a5cd38daa04940ac97f9037e3241cdaf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.359656  9681 tablet_replica.cc:333] T 22e532f746f14300aac7e6240a0e18bd P a5cd38daa04940ac97f9037e3241cdaf: stopping tablet replica
I20260709 12:28:41.360488  9681 raft_consensus.cc:2243] T 22e532f746f14300aac7e6240a0e18bd P a5cd38daa04940ac97f9037e3241cdaf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.361318  9681 raft_consensus.cc:2272] T 22e532f746f14300aac7e6240a0e18bd P a5cd38daa04940ac97f9037e3241cdaf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.364297  9681 tablet_replica.cc:333] T c542a19e01724e1982bf9694078796f3 P a5cd38daa04940ac97f9037e3241cdaf: stopping tablet replica
I20260709 12:28:41.365020  9681 raft_consensus.cc:2243] T c542a19e01724e1982bf9694078796f3 P a5cd38daa04940ac97f9037e3241cdaf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.365728  9681 raft_consensus.cc:2272] T c542a19e01724e1982bf9694078796f3 P a5cd38daa04940ac97f9037e3241cdaf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.368603  9681 tablet_replica.cc:333] T 88011d359ca74cf18e222bdaed1978a0 P a5cd38daa04940ac97f9037e3241cdaf: stopping tablet replica
I20260709 12:28:41.369302  9681 raft_consensus.cc:2243] T 88011d359ca74cf18e222bdaed1978a0 P a5cd38daa04940ac97f9037e3241cdaf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.369845  9681 raft_consensus.cc:2272] T 88011d359ca74cf18e222bdaed1978a0 P a5cd38daa04940ac97f9037e3241cdaf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.372323  9681 tablet_replica.cc:333] T c511fe69a84144d2ad2e090cc6766ffc P a5cd38daa04940ac97f9037e3241cdaf: stopping tablet replica
I20260709 12:28:41.372920  9681 raft_consensus.cc:2243] T c511fe69a84144d2ad2e090cc6766ffc P a5cd38daa04940ac97f9037e3241cdaf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.373422  9681 raft_consensus.cc:2272] T c511fe69a84144d2ad2e090cc6766ffc P a5cd38daa04940ac97f9037e3241cdaf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.376997  9681 tablet_replica.cc:333] T 47b5cca5e909437c96a329dd6a87e474 P a5cd38daa04940ac97f9037e3241cdaf: stopping tablet replica
I20260709 12:28:41.377761  9681 raft_consensus.cc:2243] T 47b5cca5e909437c96a329dd6a87e474 P a5cd38daa04940ac97f9037e3241cdaf [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:41.379148  9681 raft_consensus.cc:2272] T 47b5cca5e909437c96a329dd6a87e474 P a5cd38daa04940ac97f9037e3241cdaf [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:41.380441 19265 consensus_peers.cc:597] T 7c21e55b8c694512b0ed942898b2749d P ecd798a306df4905858bf774b6cd98f3 -> Peer a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65:42503): Couldn't send request to peer a5cd38daa04940ac97f9037e3241cdaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:41.383215  9681 tablet_replica.cc:333] T 9150dab4dcbc4945994ab3f7090326b5 P a5cd38daa04940ac97f9037e3241cdaf: stopping tablet replica
I20260709 12:28:41.384123  9681 raft_consensus.cc:2243] T 9150dab4dcbc4945994ab3f7090326b5 P a5cd38daa04940ac97f9037e3241cdaf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.384676  9681 raft_consensus.cc:2272] T 9150dab4dcbc4945994ab3f7090326b5 P a5cd38daa04940ac97f9037e3241cdaf [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:41.421666 19191 consensus_peers.cc:597] T 1e372667da904e65aa5d7c5345b08fca P 595ece3316774e33930c4ef7923b8dc1 -> Peer a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65:42503): Couldn't send request to peer a5cd38daa04940ac97f9037e3241cdaf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:41.438105  9681 tablet_server.cc:196] TabletServer@127.9.116.65:0 shutdown complete.
W20260709 12:28:41.448624 19191 consensus_peers.cc:597] T f4a87e357d584a3b925af9c5d05e2ab6 P 595ece3316774e33930c4ef7923b8dc1 -> Peer a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65:42503): Couldn't send request to peer a5cd38daa04940ac97f9037e3241cdaf. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:42503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:41.492890  9681 tablet_server.cc:179] TabletServer@127.9.116.66:0 shutting down...
W20260709 12:28:41.539687 19191 consensus_peers.cc:597] T 22e532f746f14300aac7e6240a0e18bd P 595ece3316774e33930c4ef7923b8dc1 -> Peer a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65:42503): Couldn't send request to peer a5cd38daa04940ac97f9037e3241cdaf. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:42503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:41.546593 19265 consensus_peers.cc:597] T 9150dab4dcbc4945994ab3f7090326b5 P ecd798a306df4905858bf774b6cd98f3 -> Peer a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65:42503): Couldn't send request to peer a5cd38daa04940ac97f9037e3241cdaf. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:42503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:41.547288 19265 consensus_peers.cc:597] T c783b6e59edb46c4976d6b2117292201 P ecd798a306df4905858bf774b6cd98f3 -> Peer a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65:42503): Couldn't send request to peer a5cd38daa04940ac97f9037e3241cdaf. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:42503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:41.548365  9681 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:28:41.549338  9681 tablet_replica.cc:333] T 84655933e2a8465d8aede7f18c893cad P 595ece3316774e33930c4ef7923b8dc1: stopping tablet replica
I20260709 12:28:41.550693  9681 raft_consensus.cc:2243] T 84655933e2a8465d8aede7f18c893cad P 595ece3316774e33930c4ef7923b8dc1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:41.552147  9681 raft_consensus.cc:2272] T 84655933e2a8465d8aede7f18c893cad P 595ece3316774e33930c4ef7923b8dc1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.554939  9681 tablet_replica.cc:333] T 1e372667da904e65aa5d7c5345b08fca P 595ece3316774e33930c4ef7923b8dc1: stopping tablet replica
I20260709 12:28:41.555745  9681 raft_consensus.cc:2243] T 1e372667da904e65aa5d7c5345b08fca P 595ece3316774e33930c4ef7923b8dc1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:41.556975  9681 raft_consensus.cc:2272] T 1e372667da904e65aa5d7c5345b08fca P 595ece3316774e33930c4ef7923b8dc1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.559480  9681 tablet_replica.cc:333] T 345ac35ca3d140d3ab3ba9fc108a930b P 595ece3316774e33930c4ef7923b8dc1: stopping tablet replica
I20260709 12:28:41.560216  9681 raft_consensus.cc:2243] T 345ac35ca3d140d3ab3ba9fc108a930b P 595ece3316774e33930c4ef7923b8dc1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:41.561148  9681 raft_consensus.cc:2272] T 345ac35ca3d140d3ab3ba9fc108a930b P 595ece3316774e33930c4ef7923b8dc1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.563395  9681 tablet_replica.cc:333] T 7c21e55b8c694512b0ed942898b2749d P 595ece3316774e33930c4ef7923b8dc1: stopping tablet replica
I20260709 12:28:41.564093  9681 raft_consensus.cc:2243] T 7c21e55b8c694512b0ed942898b2749d P 595ece3316774e33930c4ef7923b8dc1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.565054  9681 raft_consensus.cc:2272] T 7c21e55b8c694512b0ed942898b2749d P 595ece3316774e33930c4ef7923b8dc1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.567701  9681 tablet_replica.cc:333] T 8d1007a33823446895ad5e0307fa4fff P 595ece3316774e33930c4ef7923b8dc1: stopping tablet replica
I20260709 12:28:41.568320  9681 raft_consensus.cc:2243] T 8d1007a33823446895ad5e0307fa4fff P 595ece3316774e33930c4ef7923b8dc1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.568946  9681 raft_consensus.cc:2272] T 8d1007a33823446895ad5e0307fa4fff P 595ece3316774e33930c4ef7923b8dc1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.572183  9681 tablet_replica.cc:333] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P 595ece3316774e33930c4ef7923b8dc1: stopping tablet replica
I20260709 12:28:41.573026  9681 raft_consensus.cc:2243] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P 595ece3316774e33930c4ef7923b8dc1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.573760  9681 raft_consensus.cc:2272] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P 595ece3316774e33930c4ef7923b8dc1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.576884  9681 tablet_replica.cc:333] T 584e9788383444ce82092f41f1749c44 P 595ece3316774e33930c4ef7923b8dc1: stopping tablet replica
I20260709 12:28:41.577440  9681 raft_consensus.cc:2243] T 584e9788383444ce82092f41f1749c44 P 595ece3316774e33930c4ef7923b8dc1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.578091  9681 raft_consensus.cc:2272] T 584e9788383444ce82092f41f1749c44 P 595ece3316774e33930c4ef7923b8dc1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.581477  9681 tablet_replica.cc:333] T 489fca1a81224008bc8b8e01b86bab9a P 595ece3316774e33930c4ef7923b8dc1: stopping tablet replica
I20260709 12:28:41.582288  9681 raft_consensus.cc:2243] T 489fca1a81224008bc8b8e01b86bab9a P 595ece3316774e33930c4ef7923b8dc1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.582949  9681 raft_consensus.cc:2272] T 489fca1a81224008bc8b8e01b86bab9a P 595ece3316774e33930c4ef7923b8dc1 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:41.583675 19265 consensus_peers.cc:597] T 0fd8240043ac467eb287176c4f2e97e7 P ecd798a306df4905858bf774b6cd98f3 -> Peer a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65:42503): Couldn't send request to peer a5cd38daa04940ac97f9037e3241cdaf. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:42503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:41.585767  9681 tablet_replica.cc:333] T c783b6e59edb46c4976d6b2117292201 P 595ece3316774e33930c4ef7923b8dc1: stopping tablet replica
I20260709 12:28:41.586694  9681 raft_consensus.cc:2243] T c783b6e59edb46c4976d6b2117292201 P 595ece3316774e33930c4ef7923b8dc1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.587435  9681 raft_consensus.cc:2272] T c783b6e59edb46c4976d6b2117292201 P 595ece3316774e33930c4ef7923b8dc1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.589944  9681 tablet_replica.cc:333] T 0fd8240043ac467eb287176c4f2e97e7 P 595ece3316774e33930c4ef7923b8dc1: stopping tablet replica
I20260709 12:28:41.590669  9681 raft_consensus.cc:2243] T 0fd8240043ac467eb287176c4f2e97e7 P 595ece3316774e33930c4ef7923b8dc1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.591179  9681 raft_consensus.cc:2272] T 0fd8240043ac467eb287176c4f2e97e7 P 595ece3316774e33930c4ef7923b8dc1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.593521  9681 tablet_replica.cc:333] T e2cf09feaca24068a727752850983ac5 P 595ece3316774e33930c4ef7923b8dc1: stopping tablet replica
I20260709 12:28:41.594117  9681 raft_consensus.cc:2243] T e2cf09feaca24068a727752850983ac5 P 595ece3316774e33930c4ef7923b8dc1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.594686  9681 raft_consensus.cc:2272] T e2cf09feaca24068a727752850983ac5 P 595ece3316774e33930c4ef7923b8dc1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.597199  9681 tablet_replica.cc:333] T 22e532f746f14300aac7e6240a0e18bd P 595ece3316774e33930c4ef7923b8dc1: stopping tablet replica
I20260709 12:28:41.597776  9681 raft_consensus.cc:2243] T 22e532f746f14300aac7e6240a0e18bd P 595ece3316774e33930c4ef7923b8dc1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:41.598682  9681 raft_consensus.cc:2272] T 22e532f746f14300aac7e6240a0e18bd P 595ece3316774e33930c4ef7923b8dc1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.601181  9681 tablet_replica.cc:333] T f4a87e357d584a3b925af9c5d05e2ab6 P 595ece3316774e33930c4ef7923b8dc1: stopping tablet replica
I20260709 12:28:41.601752  9681 raft_consensus.cc:2243] T f4a87e357d584a3b925af9c5d05e2ab6 P 595ece3316774e33930c4ef7923b8dc1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:41.602632  9681 raft_consensus.cc:2272] T f4a87e357d584a3b925af9c5d05e2ab6 P 595ece3316774e33930c4ef7923b8dc1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.605252  9681 tablet_replica.cc:333] T 47b5cca5e909437c96a329dd6a87e474 P 595ece3316774e33930c4ef7923b8dc1: stopping tablet replica
I20260709 12:28:41.605863  9681 raft_consensus.cc:2243] T 47b5cca5e909437c96a329dd6a87e474 P 595ece3316774e33930c4ef7923b8dc1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.606446  9681 raft_consensus.cc:2272] T 47b5cca5e909437c96a329dd6a87e474 P 595ece3316774e33930c4ef7923b8dc1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.608894  9681 tablet_replica.cc:333] T 9150dab4dcbc4945994ab3f7090326b5 P 595ece3316774e33930c4ef7923b8dc1: stopping tablet replica
I20260709 12:28:41.609477  9681 raft_consensus.cc:2243] T 9150dab4dcbc4945994ab3f7090326b5 P 595ece3316774e33930c4ef7923b8dc1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.610000  9681 raft_consensus.cc:2272] T 9150dab4dcbc4945994ab3f7090326b5 P 595ece3316774e33930c4ef7923b8dc1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.612298  9681 tablet_replica.cc:333] T c542a19e01724e1982bf9694078796f3 P 595ece3316774e33930c4ef7923b8dc1: stopping tablet replica
I20260709 12:28:41.612905  9681 raft_consensus.cc:2243] T c542a19e01724e1982bf9694078796f3 P 595ece3316774e33930c4ef7923b8dc1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.613456  9681 raft_consensus.cc:2272] T c542a19e01724e1982bf9694078796f3 P 595ece3316774e33930c4ef7923b8dc1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.615967  9681 tablet_replica.cc:333] T 88011d359ca74cf18e222bdaed1978a0 P 595ece3316774e33930c4ef7923b8dc1: stopping tablet replica
I20260709 12:28:41.616547  9681 raft_consensus.cc:2243] T 88011d359ca74cf18e222bdaed1978a0 P 595ece3316774e33930c4ef7923b8dc1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.617189  9681 raft_consensus.cc:2272] T 88011d359ca74cf18e222bdaed1978a0 P 595ece3316774e33930c4ef7923b8dc1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.619735  9681 tablet_replica.cc:333] T c511fe69a84144d2ad2e090cc6766ffc P 595ece3316774e33930c4ef7923b8dc1: stopping tablet replica
I20260709 12:28:41.620431  9681 raft_consensus.cc:2243] T c511fe69a84144d2ad2e090cc6766ffc P 595ece3316774e33930c4ef7923b8dc1 [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:28:41.621346 19191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:41.621961  9681 raft_consensus.cc:2272] T c511fe69a84144d2ad2e090cc6766ffc P 595ece3316774e33930c4ef7923b8dc1 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:41.654335 19265 consensus_peers.cc:597] T 88011d359ca74cf18e222bdaed1978a0 P ecd798a306df4905858bf774b6cd98f3 -> Peer a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65:42503): Couldn't send request to peer a5cd38daa04940ac97f9037e3241cdaf. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:42503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:41.673607  9681 tablet_server.cc:196] TabletServer@127.9.116.66:0 shutdown complete.
W20260709 12:28:41.690816 19266 consensus_peers.cc:597] T 7c21e55b8c694512b0ed942898b2749d P ecd798a306df4905858bf774b6cd98f3 -> Peer 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66:37433): Couldn't send request to peer 595ece3316774e33930c4ef7923b8dc1. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.66:37433: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:41.696514 19265 consensus_peers.cc:597] T c542a19e01724e1982bf9694078796f3 P ecd798a306df4905858bf774b6cd98f3 -> Peer a5cd38daa04940ac97f9037e3241cdaf (127.9.116.65:42503): Couldn't send request to peer a5cd38daa04940ac97f9037e3241cdaf. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:42503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:41.708613 19266 consensus_peers.cc:597] T 88011d359ca74cf18e222bdaed1978a0 P ecd798a306df4905858bf774b6cd98f3 -> Peer 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66:37433): Couldn't send request to peer 595ece3316774e33930c4ef7923b8dc1. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.66:37433: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:41.709211 19266 consensus_peers.cc:597] T c542a19e01724e1982bf9694078796f3 P ecd798a306df4905858bf774b6cd98f3 -> Peer 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66:37433): Couldn't send request to peer 595ece3316774e33930c4ef7923b8dc1. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.66:37433: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:41.725761 19266 consensus_peers.cc:597] T c783b6e59edb46c4976d6b2117292201 P ecd798a306df4905858bf774b6cd98f3 -> Peer 595ece3316774e33930c4ef7923b8dc1 (127.9.116.66:37433): Couldn't send request to peer 595ece3316774e33930c4ef7923b8dc1. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.66:37433: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:41.729027  9681 tablet_server.cc:179] TabletServer@127.9.116.67:0 shutting down...
I20260709 12:28:41.772677  9681 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:28:41.773504  9681 tablet_replica.cc:333] T 84655933e2a8465d8aede7f18c893cad P ecd798a306df4905858bf774b6cd98f3: stopping tablet replica
I20260709 12:28:41.774281  9681 raft_consensus.cc:2243] T 84655933e2a8465d8aede7f18c893cad P ecd798a306df4905858bf774b6cd98f3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.774873  9681 raft_consensus.cc:2272] T 84655933e2a8465d8aede7f18c893cad P ecd798a306df4905858bf774b6cd98f3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.777288  9681 tablet_replica.cc:333] T 7c21e55b8c694512b0ed942898b2749d P ecd798a306df4905858bf774b6cd98f3: stopping tablet replica
I20260709 12:28:41.777899  9681 raft_consensus.cc:2243] T 7c21e55b8c694512b0ed942898b2749d P ecd798a306df4905858bf774b6cd98f3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:41.778805  9681 raft_consensus.cc:2272] T 7c21e55b8c694512b0ed942898b2749d P ecd798a306df4905858bf774b6cd98f3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.782138  9681 tablet_replica.cc:333] T 345ac35ca3d140d3ab3ba9fc108a930b P ecd798a306df4905858bf774b6cd98f3: stopping tablet replica
I20260709 12:28:41.783452  9681 raft_consensus.cc:2243] T 345ac35ca3d140d3ab3ba9fc108a930b P ecd798a306df4905858bf774b6cd98f3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.784467  9681 raft_consensus.cc:2272] T 345ac35ca3d140d3ab3ba9fc108a930b P ecd798a306df4905858bf774b6cd98f3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.787035  9681 tablet_replica.cc:333] T 1e372667da904e65aa5d7c5345b08fca P ecd798a306df4905858bf774b6cd98f3: stopping tablet replica
I20260709 12:28:41.787729  9681 raft_consensus.cc:2243] T 1e372667da904e65aa5d7c5345b08fca P ecd798a306df4905858bf774b6cd98f3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.788266  9681 raft_consensus.cc:2272] T 1e372667da904e65aa5d7c5345b08fca P ecd798a306df4905858bf774b6cd98f3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.790634  9681 tablet_replica.cc:333] T 8d1007a33823446895ad5e0307fa4fff P ecd798a306df4905858bf774b6cd98f3: stopping tablet replica
I20260709 12:28:41.791316  9681 raft_consensus.cc:2243] T 8d1007a33823446895ad5e0307fa4fff P ecd798a306df4905858bf774b6cd98f3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.791914  9681 raft_consensus.cc:2272] T 8d1007a33823446895ad5e0307fa4fff P ecd798a306df4905858bf774b6cd98f3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.794461  9681 tablet_replica.cc:333] T c542a19e01724e1982bf9694078796f3 P ecd798a306df4905858bf774b6cd98f3: stopping tablet replica
I20260709 12:28:41.795184  9681 raft_consensus.cc:2243] T c542a19e01724e1982bf9694078796f3 P ecd798a306df4905858bf774b6cd98f3 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:28:41.796393  9681 raft_consensus.cc:2272] T c542a19e01724e1982bf9694078796f3 P ecd798a306df4905858bf774b6cd98f3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.799084  9681 tablet_replica.cc:333] T f4a87e357d584a3b925af9c5d05e2ab6 P ecd798a306df4905858bf774b6cd98f3: stopping tablet replica
I20260709 12:28:41.799830  9681 raft_consensus.cc:2243] T f4a87e357d584a3b925af9c5d05e2ab6 P ecd798a306df4905858bf774b6cd98f3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.800384  9681 raft_consensus.cc:2272] T f4a87e357d584a3b925af9c5d05e2ab6 P ecd798a306df4905858bf774b6cd98f3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.802870  9681 tablet_replica.cc:333] T 22e532f746f14300aac7e6240a0e18bd P ecd798a306df4905858bf774b6cd98f3: stopping tablet replica
I20260709 12:28:41.803550  9681 raft_consensus.cc:2243] T 22e532f746f14300aac7e6240a0e18bd P ecd798a306df4905858bf774b6cd98f3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.804243  9681 raft_consensus.cc:2272] T 22e532f746f14300aac7e6240a0e18bd P ecd798a306df4905858bf774b6cd98f3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.806879  9681 tablet_replica.cc:333] T c783b6e59edb46c4976d6b2117292201 P ecd798a306df4905858bf774b6cd98f3: stopping tablet replica
I20260709 12:28:41.807546  9681 raft_consensus.cc:2243] T c783b6e59edb46c4976d6b2117292201 P ecd798a306df4905858bf774b6cd98f3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:41.808955  9681 raft_consensus.cc:2272] T c783b6e59edb46c4976d6b2117292201 P ecd798a306df4905858bf774b6cd98f3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.811400  9681 tablet_replica.cc:333] T 88011d359ca74cf18e222bdaed1978a0 P ecd798a306df4905858bf774b6cd98f3: stopping tablet replica
I20260709 12:28:41.812172  9681 raft_consensus.cc:2243] T 88011d359ca74cf18e222bdaed1978a0 P ecd798a306df4905858bf774b6cd98f3 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:28:41.813153  9681 raft_consensus.cc:2272] T 88011d359ca74cf18e222bdaed1978a0 P ecd798a306df4905858bf774b6cd98f3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.815310  9681 tablet_replica.cc:333] T c511fe69a84144d2ad2e090cc6766ffc P ecd798a306df4905858bf774b6cd98f3: stopping tablet replica
I20260709 12:28:41.815985  9681 raft_consensus.cc:2243] T c511fe69a84144d2ad2e090cc6766ffc P ecd798a306df4905858bf774b6cd98f3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.816483  9681 raft_consensus.cc:2272] T c511fe69a84144d2ad2e090cc6766ffc P ecd798a306df4905858bf774b6cd98f3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.819901  9681 tablet_replica.cc:333] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P ecd798a306df4905858bf774b6cd98f3: stopping tablet replica
I20260709 12:28:41.820691  9681 raft_consensus.cc:2243] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P ecd798a306df4905858bf774b6cd98f3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.821293  9681 raft_consensus.cc:2272] T d9d28b53dbf34d0b94a1b47ab3ed7c3e P ecd798a306df4905858bf774b6cd98f3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.824010  9681 tablet_replica.cc:333] T 584e9788383444ce82092f41f1749c44 P ecd798a306df4905858bf774b6cd98f3: stopping tablet replica
I20260709 12:28:41.824761  9681 raft_consensus.cc:2243] T 584e9788383444ce82092f41f1749c44 P ecd798a306df4905858bf774b6cd98f3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.825320  9681 raft_consensus.cc:2272] T 584e9788383444ce82092f41f1749c44 P ecd798a306df4905858bf774b6cd98f3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.828266  9681 tablet_replica.cc:333] T 489fca1a81224008bc8b8e01b86bab9a P ecd798a306df4905858bf774b6cd98f3: stopping tablet replica
I20260709 12:28:41.828939  9681 raft_consensus.cc:2243] T 489fca1a81224008bc8b8e01b86bab9a P ecd798a306df4905858bf774b6cd98f3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.829468  9681 raft_consensus.cc:2272] T 489fca1a81224008bc8b8e01b86bab9a P ecd798a306df4905858bf774b6cd98f3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.831910  9681 tablet_replica.cc:333] T 0fd8240043ac467eb287176c4f2e97e7 P ecd798a306df4905858bf774b6cd98f3: stopping tablet replica
I20260709 12:28:41.832412  9681 raft_consensus.cc:2243] T 0fd8240043ac467eb287176c4f2e97e7 P ecd798a306df4905858bf774b6cd98f3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:41.833576  9681 raft_consensus.cc:2272] T 0fd8240043ac467eb287176c4f2e97e7 P ecd798a306df4905858bf774b6cd98f3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.835968  9681 tablet_replica.cc:333] T e2cf09feaca24068a727752850983ac5 P ecd798a306df4905858bf774b6cd98f3: stopping tablet replica
I20260709 12:28:41.836480  9681 raft_consensus.cc:2243] T e2cf09feaca24068a727752850983ac5 P ecd798a306df4905858bf774b6cd98f3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.836985  9681 raft_consensus.cc:2272] T e2cf09feaca24068a727752850983ac5 P ecd798a306df4905858bf774b6cd98f3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.839138  9681 tablet_replica.cc:333] T 47b5cca5e909437c96a329dd6a87e474 P ecd798a306df4905858bf774b6cd98f3: stopping tablet replica
I20260709 12:28:41.839675  9681 raft_consensus.cc:2243] T 47b5cca5e909437c96a329dd6a87e474 P ecd798a306df4905858bf774b6cd98f3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:41.840133  9681 raft_consensus.cc:2272] T 47b5cca5e909437c96a329dd6a87e474 P ecd798a306df4905858bf774b6cd98f3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.843016  9681 tablet_replica.cc:333] T 9150dab4dcbc4945994ab3f7090326b5 P ecd798a306df4905858bf774b6cd98f3: stopping tablet replica
I20260709 12:28:41.843482  9681 raft_consensus.cc:2243] T 9150dab4dcbc4945994ab3f7090326b5 P ecd798a306df4905858bf774b6cd98f3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:41.844427  9681 raft_consensus.cc:2272] T 9150dab4dcbc4945994ab3f7090326b5 P ecd798a306df4905858bf774b6cd98f3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.896610  9681 tablet_server.cc:196] TabletServer@127.9.116.67:0 shutdown complete.
I20260709 12:28:41.944415  9681 master.cc:562] Master@127.9.116.126:42093 shutting down...
I20260709 12:28:41.978036  9681 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 9370f92c47a14d899d2bfc637e9440dc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:41.978719  9681 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 9370f92c47a14d899d2bfc637e9440dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.979077  9681 tablet_replica.cc:333] T 00000000000000000000000000000000 P 9370f92c47a14d899d2bfc637e9440dc: stopping tablet replica
I20260709 12:28:42.003382  9681 master.cc:584] Master@127.9.116.126:42093 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (21617 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 12:28:42.070454  9681 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.9.116.126:36317
I20260709 12:28:42.072405  9681 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:28:42.079375 19629 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:42.079375 19630 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:42.080674 19632 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:42.080914  9681 server_base.cc:1061] running on GCE node
I20260709 12:28:42.082219  9681 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:28:42.082475  9681 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:28:42.082592  9681 hybrid_clock.cc:648] HybridClock initialized: now 1783600122082580 us; error 0 us; skew 500 ppm
I20260709 12:28:42.083127  9681 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:28:42.086288  9681 webserver.cc:533] Webserver started at http://127.9.116.126:39977/ using document root <none> and password file <none>
I20260709 12:28:42.086822  9681 fs_manager.cc:362] Metadata directory not provided
I20260709 12:28:42.086999  9681 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:28:42.087301  9681 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:28:42.088738  9681 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599781984018-9681-0/minicluster-data/master-0-root/instance:
uuid: "2e4c90d2566f4ef1a0bc47afa0ffa47a"
format_stamp: "Formatted at 2026-07-09 12:28:42 on dist-test-slave-zk51"
I20260709 12:28:42.094246  9681 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.001s
I20260709 12:28:42.098369 19637 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:42.099326  9681 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:28:42.099660  9681 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599781984018-9681-0/minicluster-data/master-0-root
uuid: "2e4c90d2566f4ef1a0bc47afa0ffa47a"
format_stamp: "Formatted at 2026-07-09 12:28:42 on dist-test-slave-zk51"
I20260709 12:28:42.099946  9681 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599781984018-9681-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599781984018-9681-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599781984018-9681-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:28:42.138635  9681 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:28:42.140128  9681 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:28:42.189535  9681 rpc_server.cc:307] RPC server started. Bound to: 127.9.116.126:36317
I20260709 12:28:42.189656 19688 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.116.126:36317 every 8 connection(s)
I20260709 12:28:42.193956 19689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.206792 19689 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2e4c90d2566f4ef1a0bc47afa0ffa47a: Bootstrap starting.
I20260709 12:28:42.213371 19689 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2e4c90d2566f4ef1a0bc47afa0ffa47a: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:42.219141 19689 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2e4c90d2566f4ef1a0bc47afa0ffa47a: No bootstrap required, opened a new log
I20260709 12:28:42.222162 19689 raft_consensus.cc:359] T 00000000000000000000000000000000 P 2e4c90d2566f4ef1a0bc47afa0ffa47a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e4c90d2566f4ef1a0bc47afa0ffa47a" member_type: VOTER }
I20260709 12:28:42.222725 19689 raft_consensus.cc:385] T 00000000000000000000000000000000 P 2e4c90d2566f4ef1a0bc47afa0ffa47a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:42.223042 19689 raft_consensus.cc:740] T 00000000000000000000000000000000 P 2e4c90d2566f4ef1a0bc47afa0ffa47a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e4c90d2566f4ef1a0bc47afa0ffa47a, State: Initialized, Role: FOLLOWER
I20260709 12:28:42.223790 19689 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2e4c90d2566f4ef1a0bc47afa0ffa47a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e4c90d2566f4ef1a0bc47afa0ffa47a" member_type: VOTER }
I20260709 12:28:42.224481 19689 raft_consensus.cc:399] T 00000000000000000000000000000000 P 2e4c90d2566f4ef1a0bc47afa0ffa47a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:28:42.224781 19689 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2e4c90d2566f4ef1a0bc47afa0ffa47a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:28:42.225149 19689 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2e4c90d2566f4ef1a0bc47afa0ffa47a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:42.230804 19689 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2e4c90d2566f4ef1a0bc47afa0ffa47a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e4c90d2566f4ef1a0bc47afa0ffa47a" member_type: VOTER }
I20260709 12:28:42.231460 19689 leader_election.cc:304] T 00000000000000000000000000000000 P 2e4c90d2566f4ef1a0bc47afa0ffa47a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2e4c90d2566f4ef1a0bc47afa0ffa47a; no voters: 
I20260709 12:28:42.232717 19689 leader_election.cc:290] T 00000000000000000000000000000000 P 2e4c90d2566f4ef1a0bc47afa0ffa47a [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:28:42.233186 19692 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 2e4c90d2566f4ef1a0bc47afa0ffa47a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:42.234674 19692 raft_consensus.cc:697] T 00000000000000000000000000000000 P 2e4c90d2566f4ef1a0bc47afa0ffa47a [term 1 LEADER]: Becoming Leader. State: Replica: 2e4c90d2566f4ef1a0bc47afa0ffa47a, State: Running, Role: LEADER
I20260709 12:28:42.235625 19692 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2e4c90d2566f4ef1a0bc47afa0ffa47a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e4c90d2566f4ef1a0bc47afa0ffa47a" member_type: VOTER }
I20260709 12:28:42.235893 19689 sys_catalog.cc:565] T 00000000000000000000000000000000 P 2e4c90d2566f4ef1a0bc47afa0ffa47a [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:28:42.241246 19693 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e4c90d2566f4ef1a0bc47afa0ffa47a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2e4c90d2566f4ef1a0bc47afa0ffa47a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e4c90d2566f4ef1a0bc47afa0ffa47a" member_type: VOTER } }
I20260709 12:28:42.241197 19694 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e4c90d2566f4ef1a0bc47afa0ffa47a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2e4c90d2566f4ef1a0bc47afa0ffa47a. Latest consensus state: current_term: 1 leader_uuid: "2e4c90d2566f4ef1a0bc47afa0ffa47a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e4c90d2566f4ef1a0bc47afa0ffa47a" member_type: VOTER } }
I20260709 12:28:42.245676 19693 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e4c90d2566f4ef1a0bc47afa0ffa47a [sys.catalog]: This master's current role is: LEADER
I20260709 12:28:42.245755 19694 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e4c90d2566f4ef1a0bc47afa0ffa47a [sys.catalog]: This master's current role is: LEADER
I20260709 12:28:42.248512 19701 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:28:42.255234 19701 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:28:42.257284  9681 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:28:42.266534 19701 catalog_manager.cc:1383] Generated new cluster ID: 9c8d6911bca34a11be4637b4982e8829
I20260709 12:28:42.266888 19701 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:28:42.292097 19701 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:28:42.293588 19701 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:28:42.314550 19701 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 2e4c90d2566f4ef1a0bc47afa0ffa47a: Generated new TSK 0
I20260709 12:28:42.315328 19701 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:28:42.325075  9681 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:28:42.331732 19710 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:42.332759 19711 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:42.334668 19713 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:42.338183  9681 server_base.cc:1061] running on GCE node
I20260709 12:28:42.339372  9681 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:28:42.339679  9681 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:28:42.339838  9681 hybrid_clock.cc:648] HybridClock initialized: now 1783600122339825 us; error 0 us; skew 500 ppm
I20260709 12:28:42.340340  9681 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:28:42.342911  9681 webserver.cc:533] Webserver started at http://127.9.116.65:40179/ using document root <none> and password file <none>
I20260709 12:28:42.343390  9681 fs_manager.cc:362] Metadata directory not provided
I20260709 12:28:42.343551  9681 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:28:42.344012  9681 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:28:42.345719  9681 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599781984018-9681-0/minicluster-data/ts-0-root/instance:
uuid: "8dfbf314f9eb4599aa1f64e0098053f2"
format_stamp: "Formatted at 2026-07-09 12:28:42 on dist-test-slave-zk51"
I20260709 12:28:42.351353  9681 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.003s
I20260709 12:28:42.355118 19718 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:42.356244  9681 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:28:42.356633  9681 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599781984018-9681-0/minicluster-data/ts-0-root
uuid: "8dfbf314f9eb4599aa1f64e0098053f2"
format_stamp: "Formatted at 2026-07-09 12:28:42 on dist-test-slave-zk51"
I20260709 12:28:42.357081  9681 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599781984018-9681-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599781984018-9681-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599781984018-9681-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:28:42.395370  9681 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:28:42.396754  9681 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:28:42.398553  9681 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:28:42.401433  9681 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:28:42.401695  9681 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:42.401950  9681 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:28:42.402326  9681 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:42.452869  9681 rpc_server.cc:307] RPC server started. Bound to: 127.9.116.65:38251
I20260709 12:28:42.452997 19780 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.116.65:38251 every 8 connection(s)
I20260709 12:28:42.459123  9681 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:28:42.466979 19785 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:42.468657 19786 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:42.472821 19788 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:42.474121  9681 server_base.cc:1061] running on GCE node
I20260709 12:28:42.474367 19781 heartbeater.cc:344] Connected to a master server at 127.9.116.126:36317
I20260709 12:28:42.474838 19781 heartbeater.cc:461] Registering TS with master...
I20260709 12:28:42.475677  9681 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:28:42.476172  9681 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:28:42.476024 19781 heartbeater.cc:507] Master 127.9.116.126:36317 requested a full tablet report, sending...
I20260709 12:28:42.476552  9681 hybrid_clock.cc:648] HybridClock initialized: now 1783600122476528 us; error 0 us; skew 500 ppm
I20260709 12:28:42.477402  9681 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:28:42.479777 19654 ts_manager.cc:194] Registered new tserver with Master: 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65:38251)
I20260709 12:28:42.480974  9681 webserver.cc:533] Webserver started at http://127.9.116.66:36915/ using document root <none> and password file <none>
I20260709 12:28:42.481753  9681 fs_manager.cc:362] Metadata directory not provided
I20260709 12:28:42.482013  9681 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:28:42.482348  9681 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:28:42.482584 19654 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54064
I20260709 12:28:42.484280  9681 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599781984018-9681-0/minicluster-data/ts-1-root/instance:
uuid: "b2005221a1af4e559e0cb1cf28636c84"
format_stamp: "Formatted at 2026-07-09 12:28:42 on dist-test-slave-zk51"
I20260709 12:28:42.490321  9681 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:28:42.494338 19793 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:42.495393  9681 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.002s
I20260709 12:28:42.495949  9681 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599781984018-9681-0/minicluster-data/ts-1-root
uuid: "b2005221a1af4e559e0cb1cf28636c84"
format_stamp: "Formatted at 2026-07-09 12:28:42 on dist-test-slave-zk51"
I20260709 12:28:42.496381  9681 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599781984018-9681-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599781984018-9681-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599781984018-9681-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:28:42.510433  9681 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:28:42.511827  9681 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:28:42.513388  9681 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:28:42.515875  9681 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:28:42.516083  9681 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:42.516384  9681 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:28:42.516559  9681 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:42.571975  9681 rpc_server.cc:307] RPC server started. Bound to: 127.9.116.66:42783
I20260709 12:28:42.572103 19855 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.116.66:42783 every 8 connection(s)
I20260709 12:28:42.576967  9681 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:28:42.586476 19859 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:42.588538 19860 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:42.589668  9681 server_base.cc:1061] running on GCE node
W20260709 12:28:42.592479 19862 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:42.624445  9681 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:28:42.625496  9681 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:28:42.626935  9681 hybrid_clock.cc:648] HybridClock initialized: now 1783600122626907 us; error 0 us; skew 500 ppm
I20260709 12:28:42.627878 19856 heartbeater.cc:344] Connected to a master server at 127.9.116.126:36317
I20260709 12:28:42.627949  9681 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:28:42.628625 19856 heartbeater.cc:461] Registering TS with master...
I20260709 12:28:42.630172 19856 heartbeater.cc:507] Master 127.9.116.126:36317 requested a full tablet report, sending...
I20260709 12:28:42.632287  9681 webserver.cc:533] Webserver started at http://127.9.116.67:39589/ using document root <none> and password file <none>
I20260709 12:28:42.633249  9681 fs_manager.cc:362] Metadata directory not provided
I20260709 12:28:42.633558  9681 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:28:42.633925  9681 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:28:42.633886 19654 ts_manager.cc:194] Registered new tserver with Master: b2005221a1af4e559e0cb1cf28636c84 (127.9.116.66:42783)
I20260709 12:28:42.636168  9681 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599781984018-9681-0/minicluster-data/ts-2-root/instance:
uuid: "72b654ed19904db48b0a8e50fe4e12c7"
format_stamp: "Formatted at 2026-07-09 12:28:42 on dist-test-slave-zk51"
I20260709 12:28:42.636404 19654 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54070
I20260709 12:28:42.643016  9681 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:28:42.648388 19868 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:42.649312  9681 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:28:42.649837  9681 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599781984018-9681-0/minicluster-data/ts-2-root
uuid: "72b654ed19904db48b0a8e50fe4e12c7"
format_stamp: "Formatted at 2026-07-09 12:28:42 on dist-test-slave-zk51"
I20260709 12:28:42.650120  9681 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599781984018-9681-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599781984018-9681-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskbugafs/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599781984018-9681-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:28:42.680584  9681 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:28:42.682528  9681 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:28:42.684655  9681 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:28:42.688007  9681 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:28:42.688303  9681 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:42.688614  9681 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:28:42.688807  9681 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:42.747449  9681 rpc_server.cc:307] RPC server started. Bound to: 127.9.116.67:34699
I20260709 12:28:42.747994 19930 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.116.67:34699 every 8 connection(s)
I20260709 12:28:42.769914 19931 heartbeater.cc:344] Connected to a master server at 127.9.116.126:36317
I20260709 12:28:42.770426 19931 heartbeater.cc:461] Registering TS with master...
I20260709 12:28:42.771322 19931 heartbeater.cc:507] Master 127.9.116.126:36317 requested a full tablet report, sending...
I20260709 12:28:42.773561 19654 ts_manager.cc:194] Registered new tserver with Master: 72b654ed19904db48b0a8e50fe4e12c7 (127.9.116.67:34699)
I20260709 12:28:42.774222  9681 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.021351023s
I20260709 12:28:42.775368 19654 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54072
I20260709 12:28:42.811126 19654 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54076:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:28:42.814863 19654 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:28:42.910722 19746 tablet_service.cc:1511] Processing CreateTablet for tablet 22affa70596649658254e443bccdb7e2 (DEFAULT_TABLE table=test-workload [id=94a30292fee0455089e3cf30743a970b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:28:42.912971 19746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22affa70596649658254e443bccdb7e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.915249 19894 tablet_service.cc:1511] Processing CreateTablet for tablet 3545d7ed467b44c3b9be7f1c8d642c6c (DEFAULT_TABLE table=test-workload [id=94a30292fee0455089e3cf30743a970b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:28:42.917047 19894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3545d7ed467b44c3b9be7f1c8d642c6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.919842 19895 tablet_service.cc:1511] Processing CreateTablet for tablet 8d17b409914c4c139fb5a5e4fbcbd54a (DEFAULT_TABLE table=test-workload [id=94a30292fee0455089e3cf30743a970b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:28:42.921571 19895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d17b409914c4c139fb5a5e4fbcbd54a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.912454 19896 tablet_service.cc:1511] Processing CreateTablet for tablet 22affa70596649658254e443bccdb7e2 (DEFAULT_TABLE table=test-workload [id=94a30292fee0455089e3cf30743a970b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:28:42.924948 19896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22affa70596649658254e443bccdb7e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.926146 19893 tablet_service.cc:1511] Processing CreateTablet for tablet 7ae5eb89de7c49b5a4e4813747c2764a (DEFAULT_TABLE table=test-workload [id=94a30292fee0455089e3cf30743a970b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:28:42.929390 19892 tablet_service.cc:1511] Processing CreateTablet for tablet 0f3c299838c041199cb1ebb8978304f9 (DEFAULT_TABLE table=test-workload [id=94a30292fee0455089e3cf30743a970b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:28:42.930506 19821 tablet_service.cc:1511] Processing CreateTablet for tablet 22affa70596649658254e443bccdb7e2 (DEFAULT_TABLE table=test-workload [id=94a30292fee0455089e3cf30743a970b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:28:42.932597 19891 tablet_service.cc:1511] Processing CreateTablet for tablet ed4996cfc4a0429fae414b2c8e341c0d (DEFAULT_TABLE table=test-workload [id=94a30292fee0455089e3cf30743a970b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:28:42.932987 19820 tablet_service.cc:1511] Processing CreateTablet for tablet 8d17b409914c4c139fb5a5e4fbcbd54a (DEFAULT_TABLE table=test-workload [id=94a30292fee0455089e3cf30743a970b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:28:42.933045 19816 tablet_service.cc:1511] Processing CreateTablet for tablet ed4996cfc4a0429fae414b2c8e341c0d (DEFAULT_TABLE table=test-workload [id=94a30292fee0455089e3cf30743a970b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:28:42.934239 19893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ae5eb89de7c49b5a4e4813747c2764a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.934492 19820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d17b409914c4c139fb5a5e4fbcbd54a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.935871 19817 tablet_service.cc:1511] Processing CreateTablet for tablet 0f3c299838c041199cb1ebb8978304f9 (DEFAULT_TABLE table=test-workload [id=94a30292fee0455089e3cf30743a970b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:28:42.937410 19817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f3c299838c041199cb1ebb8978304f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.937775 19815 tablet_service.cc:1511] Processing CreateTablet for tablet 3aeae4fb47e646d09bdeb06f2d3ee837 (DEFAULT_TABLE table=test-workload [id=94a30292fee0455089e3cf30743a970b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:28:42.940897 19819 tablet_service.cc:1511] Processing CreateTablet for tablet 3545d7ed467b44c3b9be7f1c8d642c6c (DEFAULT_TABLE table=test-workload [id=94a30292fee0455089e3cf30743a970b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:28:42.941195 19890 tablet_service.cc:1511] Processing CreateTablet for tablet 3aeae4fb47e646d09bdeb06f2d3ee837 (DEFAULT_TABLE table=test-workload [id=94a30292fee0455089e3cf30743a970b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:28:42.942567 19819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3545d7ed467b44c3b9be7f1c8d642c6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.944470 19814 tablet_service.cc:1511] Processing CreateTablet for tablet 66f3ed0a695841ce959ef857c4741496 (DEFAULT_TABLE table=test-workload [id=94a30292fee0455089e3cf30743a970b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:28:42.945204 19821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22affa70596649658254e443bccdb7e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.946812 19889 tablet_service.cc:1511] Processing CreateTablet for tablet 66f3ed0a695841ce959ef857c4741496 (DEFAULT_TABLE table=test-workload [id=94a30292fee0455089e3cf30743a970b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:28:42.948143 19814 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66f3ed0a695841ce959ef857c4741496. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.949246 19815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3aeae4fb47e646d09bdeb06f2d3ee837. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.946883 19818 tablet_service.cc:1511] Processing CreateTablet for tablet 7ae5eb89de7c49b5a4e4813747c2764a (DEFAULT_TABLE table=test-workload [id=94a30292fee0455089e3cf30743a970b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:28:42.947093 19891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed4996cfc4a0429fae414b2c8e341c0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.951280 19813 tablet_service.cc:1511] Processing CreateTablet for tablet a47b4bf847674ea286f15a089566d812 (DEFAULT_TABLE table=test-workload [id=94a30292fee0455089e3cf30743a970b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:28:42.953325 19813 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a47b4bf847674ea286f15a089566d812. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.954133 19892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f3c299838c041199cb1ebb8978304f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.954033 19888 tablet_service.cc:1511] Processing CreateTablet for tablet a47b4bf847674ea286f15a089566d812 (DEFAULT_TABLE table=test-workload [id=94a30292fee0455089e3cf30743a970b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:28:42.954789 19816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed4996cfc4a0429fae414b2c8e341c0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.955724 19888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a47b4bf847674ea286f15a089566d812. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.959316 19890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3aeae4fb47e646d09bdeb06f2d3ee837. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.964039 19818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ae5eb89de7c49b5a4e4813747c2764a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.964039 19889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66f3ed0a695841ce959ef857c4741496. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.992390 19745 tablet_service.cc:1511] Processing CreateTablet for tablet 8d17b409914c4c139fb5a5e4fbcbd54a (DEFAULT_TABLE table=test-workload [id=94a30292fee0455089e3cf30743a970b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:28:42.995164 19745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d17b409914c4c139fb5a5e4fbcbd54a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.996073 19741 tablet_service.cc:1511] Processing CreateTablet for tablet ed4996cfc4a0429fae414b2c8e341c0d (DEFAULT_TABLE table=test-workload [id=94a30292fee0455089e3cf30743a970b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:28:42.996889 19742 tablet_service.cc:1511] Processing CreateTablet for tablet 0f3c299838c041199cb1ebb8978304f9 (DEFAULT_TABLE table=test-workload [id=94a30292fee0455089e3cf30743a970b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:28:42.997598 19741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed4996cfc4a0429fae414b2c8e341c0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.998330 19742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f3c299838c041199cb1ebb8978304f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.993213 19743 tablet_service.cc:1511] Processing CreateTablet for tablet 7ae5eb89de7c49b5a4e4813747c2764a (DEFAULT_TABLE table=test-workload [id=94a30292fee0455089e3cf30743a970b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:28:43.000339 19740 tablet_service.cc:1511] Processing CreateTablet for tablet 3aeae4fb47e646d09bdeb06f2d3ee837 (DEFAULT_TABLE table=test-workload [id=94a30292fee0455089e3cf30743a970b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:28:43.003218 19744 tablet_service.cc:1511] Processing CreateTablet for tablet 3545d7ed467b44c3b9be7f1c8d642c6c (DEFAULT_TABLE table=test-workload [id=94a30292fee0455089e3cf30743a970b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:28:43.007985 19743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ae5eb89de7c49b5a4e4813747c2764a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:43.011952 19744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3545d7ed467b44c3b9be7f1c8d642c6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:43.022322 19740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3aeae4fb47e646d09bdeb06f2d3ee837. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:43.057395 19739 tablet_service.cc:1511] Processing CreateTablet for tablet 66f3ed0a695841ce959ef857c4741496 (DEFAULT_TABLE table=test-workload [id=94a30292fee0455089e3cf30743a970b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:28:43.057901 19738 tablet_service.cc:1511] Processing CreateTablet for tablet a47b4bf847674ea286f15a089566d812 (DEFAULT_TABLE table=test-workload [id=94a30292fee0455089e3cf30743a970b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:28:43.059114 19739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66f3ed0a695841ce959ef857c4741496. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:43.060384 19738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a47b4bf847674ea286f15a089566d812. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:43.112775 19949 tablet_bootstrap.cc:492] T 7ae5eb89de7c49b5a4e4813747c2764a P 72b654ed19904db48b0a8e50fe4e12c7: Bootstrap starting.
I20260709 12:28:43.145864 19950 tablet_bootstrap.cc:492] T 8d17b409914c4c139fb5a5e4fbcbd54a P 8dfbf314f9eb4599aa1f64e0098053f2: Bootstrap starting.
I20260709 12:28:43.157927 19950 tablet_bootstrap.cc:654] T 8d17b409914c4c139fb5a5e4fbcbd54a P 8dfbf314f9eb4599aa1f64e0098053f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:43.172422 19949 tablet_bootstrap.cc:654] T 7ae5eb89de7c49b5a4e4813747c2764a P 72b654ed19904db48b0a8e50fe4e12c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:43.183420 19951 tablet_bootstrap.cc:492] T 3aeae4fb47e646d09bdeb06f2d3ee837 P b2005221a1af4e559e0cb1cf28636c84: Bootstrap starting.
I20260709 12:28:43.185421 19950 tablet_bootstrap.cc:492] T 8d17b409914c4c139fb5a5e4fbcbd54a P 8dfbf314f9eb4599aa1f64e0098053f2: No bootstrap required, opened a new log
I20260709 12:28:43.185987 19950 ts_tablet_manager.cc:1403] T 8d17b409914c4c139fb5a5e4fbcbd54a P 8dfbf314f9eb4599aa1f64e0098053f2: Time spent bootstrapping tablet: real 0.041s	user 0.017s	sys 0.005s
I20260709 12:28:43.191026 19950 raft_consensus.cc:359] T 8d17b409914c4c139fb5a5e4fbcbd54a P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:43.193009 19950 raft_consensus.cc:385] T 8d17b409914c4c139fb5a5e4fbcbd54a P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:43.193419 19950 raft_consensus.cc:740] T 8d17b409914c4c139fb5a5e4fbcbd54a P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dfbf314f9eb4599aa1f64e0098053f2, State: Initialized, Role: FOLLOWER
I20260709 12:28:43.193598 19951 tablet_bootstrap.cc:654] T 3aeae4fb47e646d09bdeb06f2d3ee837 P b2005221a1af4e559e0cb1cf28636c84: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:43.194890 19950 consensus_queue.cc:260] T 8d17b409914c4c139fb5a5e4fbcbd54a P 8dfbf314f9eb4599aa1f64e0098053f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:43.195998 19949 tablet_bootstrap.cc:492] T 7ae5eb89de7c49b5a4e4813747c2764a P 72b654ed19904db48b0a8e50fe4e12c7: No bootstrap required, opened a new log
I20260709 12:28:43.196645 19949 ts_tablet_manager.cc:1403] T 7ae5eb89de7c49b5a4e4813747c2764a P 72b654ed19904db48b0a8e50fe4e12c7: Time spent bootstrapping tablet: real 0.084s	user 0.011s	sys 0.008s
I20260709 12:28:43.199381 19781 heartbeater.cc:499] Master 127.9.116.126:36317 was elected leader, sending a full tablet report...
I20260709 12:28:43.200165 19949 raft_consensus.cc:359] T 7ae5eb89de7c49b5a4e4813747c2764a P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:43.200961 19949 raft_consensus.cc:385] T 7ae5eb89de7c49b5a4e4813747c2764a P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:43.201125 19950 ts_tablet_manager.cc:1434] T 8d17b409914c4c139fb5a5e4fbcbd54a P 8dfbf314f9eb4599aa1f64e0098053f2: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.009s
I20260709 12:28:43.201241 19949 raft_consensus.cc:740] T 7ae5eb89de7c49b5a4e4813747c2764a P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72b654ed19904db48b0a8e50fe4e12c7, State: Initialized, Role: FOLLOWER
I20260709 12:28:43.202495 19950 tablet_bootstrap.cc:492] T 3545d7ed467b44c3b9be7f1c8d642c6c P 8dfbf314f9eb4599aa1f64e0098053f2: Bootstrap starting.
I20260709 12:28:43.202342 19949 consensus_queue.cc:260] T 7ae5eb89de7c49b5a4e4813747c2764a P 72b654ed19904db48b0a8e50fe4e12c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
W20260709 12:28:43.208386 19782 tablet.cc:2406] T 8d17b409914c4c139fb5a5e4fbcbd54a P 8dfbf314f9eb4599aa1f64e0098053f2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:28:43.212634 19931 heartbeater.cc:499] Master 127.9.116.126:36317 was elected leader, sending a full tablet report...
I20260709 12:28:43.213559 19950 tablet_bootstrap.cc:654] T 3545d7ed467b44c3b9be7f1c8d642c6c P 8dfbf314f9eb4599aa1f64e0098053f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:43.213836 19949 ts_tablet_manager.cc:1434] T 7ae5eb89de7c49b5a4e4813747c2764a P 72b654ed19904db48b0a8e50fe4e12c7: Time spent starting tablet: real 0.017s	user 0.010s	sys 0.004s
I20260709 12:28:43.215346 19949 tablet_bootstrap.cc:492] T 0f3c299838c041199cb1ebb8978304f9 P 72b654ed19904db48b0a8e50fe4e12c7: Bootstrap starting.
I20260709 12:28:43.222684 19949 tablet_bootstrap.cc:654] T 0f3c299838c041199cb1ebb8978304f9 P 72b654ed19904db48b0a8e50fe4e12c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:43.229687 19950 tablet_bootstrap.cc:492] T 3545d7ed467b44c3b9be7f1c8d642c6c P 8dfbf314f9eb4599aa1f64e0098053f2: No bootstrap required, opened a new log
I20260709 12:28:43.230782 19950 ts_tablet_manager.cc:1403] T 3545d7ed467b44c3b9be7f1c8d642c6c P 8dfbf314f9eb4599aa1f64e0098053f2: Time spent bootstrapping tablet: real 0.029s	user 0.008s	sys 0.017s
I20260709 12:28:43.235515 19949 tablet_bootstrap.cc:492] T 0f3c299838c041199cb1ebb8978304f9 P 72b654ed19904db48b0a8e50fe4e12c7: No bootstrap required, opened a new log
I20260709 12:28:43.236222 19949 ts_tablet_manager.cc:1403] T 0f3c299838c041199cb1ebb8978304f9 P 72b654ed19904db48b0a8e50fe4e12c7: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.007s
I20260709 12:28:43.235965 19950 raft_consensus.cc:359] T 3545d7ed467b44c3b9be7f1c8d642c6c P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:43.237393 19950 raft_consensus.cc:385] T 3545d7ed467b44c3b9be7f1c8d642c6c P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:43.237838 19950 raft_consensus.cc:740] T 3545d7ed467b44c3b9be7f1c8d642c6c P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dfbf314f9eb4599aa1f64e0098053f2, State: Initialized, Role: FOLLOWER
I20260709 12:28:43.239475 19950 consensus_queue.cc:260] T 3545d7ed467b44c3b9be7f1c8d642c6c P 8dfbf314f9eb4599aa1f64e0098053f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:43.240091 19949 raft_consensus.cc:359] T 0f3c299838c041199cb1ebb8978304f9 P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:43.241441 19949 raft_consensus.cc:385] T 0f3c299838c041199cb1ebb8978304f9 P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:43.241817 19949 raft_consensus.cc:740] T 0f3c299838c041199cb1ebb8978304f9 P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72b654ed19904db48b0a8e50fe4e12c7, State: Initialized, Role: FOLLOWER
I20260709 12:28:43.243309 19950 ts_tablet_manager.cc:1434] T 3545d7ed467b44c3b9be7f1c8d642c6c P 8dfbf314f9eb4599aa1f64e0098053f2: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.006s
I20260709 12:28:43.243044 19949 consensus_queue.cc:260] T 0f3c299838c041199cb1ebb8978304f9 P 72b654ed19904db48b0a8e50fe4e12c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:43.245174 19950 tablet_bootstrap.cc:492] T a47b4bf847674ea286f15a089566d812 P 8dfbf314f9eb4599aa1f64e0098053f2: Bootstrap starting.
I20260709 12:28:43.246116 19949 ts_tablet_manager.cc:1434] T 0f3c299838c041199cb1ebb8978304f9 P 72b654ed19904db48b0a8e50fe4e12c7: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:28:43.247838 19949 tablet_bootstrap.cc:492] T 22affa70596649658254e443bccdb7e2 P 72b654ed19904db48b0a8e50fe4e12c7: Bootstrap starting.
W20260709 12:28:43.252681 19702 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:28:43.255728 19949 tablet_bootstrap.cc:654] T 22affa70596649658254e443bccdb7e2 P 72b654ed19904db48b0a8e50fe4e12c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:43.258947 19950 tablet_bootstrap.cc:654] T a47b4bf847674ea286f15a089566d812 P 8dfbf314f9eb4599aa1f64e0098053f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:43.269470 19949 tablet_bootstrap.cc:492] T 22affa70596649658254e443bccdb7e2 P 72b654ed19904db48b0a8e50fe4e12c7: No bootstrap required, opened a new log
I20260709 12:28:43.270088 19949 ts_tablet_manager.cc:1403] T 22affa70596649658254e443bccdb7e2 P 72b654ed19904db48b0a8e50fe4e12c7: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.007s
I20260709 12:28:43.273502 19951 tablet_bootstrap.cc:492] T 3aeae4fb47e646d09bdeb06f2d3ee837 P b2005221a1af4e559e0cb1cf28636c84: No bootstrap required, opened a new log
I20260709 12:28:43.273746 19950 tablet_bootstrap.cc:492] T a47b4bf847674ea286f15a089566d812 P 8dfbf314f9eb4599aa1f64e0098053f2: No bootstrap required, opened a new log
I20260709 12:28:43.274215 19951 ts_tablet_manager.cc:1403] T 3aeae4fb47e646d09bdeb06f2d3ee837 P b2005221a1af4e559e0cb1cf28636c84: Time spent bootstrapping tablet: real 0.091s	user 0.039s	sys 0.049s
I20260709 12:28:43.273825 19949 raft_consensus.cc:359] T 22affa70596649658254e443bccdb7e2 P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } } peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } }
I20260709 12:28:43.275007 19949 raft_consensus.cc:385] T 22affa70596649658254e443bccdb7e2 P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:43.274302 19950 ts_tablet_manager.cc:1403] T a47b4bf847674ea286f15a089566d812 P 8dfbf314f9eb4599aa1f64e0098053f2: Time spent bootstrapping tablet: real 0.030s	user 0.019s	sys 0.005s
I20260709 12:28:43.277275 19951 raft_consensus.cc:359] T 3aeae4fb47e646d09bdeb06f2d3ee837 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:43.277969 19951 raft_consensus.cc:385] T 3aeae4fb47e646d09bdeb06f2d3ee837 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:43.275417 19949 raft_consensus.cc:740] T 22affa70596649658254e443bccdb7e2 P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72b654ed19904db48b0a8e50fe4e12c7, State: Initialized, Role: FOLLOWER
I20260709 12:28:43.278486 19951 raft_consensus.cc:740] T 3aeae4fb47e646d09bdeb06f2d3ee837 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2005221a1af4e559e0cb1cf28636c84, State: Initialized, Role: FOLLOWER
I20260709 12:28:43.278724 19950 raft_consensus.cc:359] T a47b4bf847674ea286f15a089566d812 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:43.279686 19950 raft_consensus.cc:385] T a47b4bf847674ea286f15a089566d812 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:43.279166 19949 consensus_queue.cc:260] T 22affa70596649658254e443bccdb7e2 P 72b654ed19904db48b0a8e50fe4e12c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } } peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } }
I20260709 12:28:43.279480 19951 consensus_queue.cc:260] T 3aeae4fb47e646d09bdeb06f2d3ee837 P b2005221a1af4e559e0cb1cf28636c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:43.280025 19950 raft_consensus.cc:740] T a47b4bf847674ea286f15a089566d812 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dfbf314f9eb4599aa1f64e0098053f2, State: Initialized, Role: FOLLOWER
I20260709 12:28:43.280970 19950 consensus_queue.cc:260] T a47b4bf847674ea286f15a089566d812 P 8dfbf314f9eb4599aa1f64e0098053f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:43.282755 19949 ts_tablet_manager.cc:1434] T 22affa70596649658254e443bccdb7e2 P 72b654ed19904db48b0a8e50fe4e12c7: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.005s
I20260709 12:28:43.283254 19950 ts_tablet_manager.cc:1434] T a47b4bf847674ea286f15a089566d812 P 8dfbf314f9eb4599aa1f64e0098053f2: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 12:28:43.284427 19950 tablet_bootstrap.cc:492] T 22affa70596649658254e443bccdb7e2 P 8dfbf314f9eb4599aa1f64e0098053f2: Bootstrap starting.
I20260709 12:28:43.284499 19949 tablet_bootstrap.cc:492] T 66f3ed0a695841ce959ef857c4741496 P 72b654ed19904db48b0a8e50fe4e12c7: Bootstrap starting.
I20260709 12:28:43.292368 19950 tablet_bootstrap.cc:654] T 22affa70596649658254e443bccdb7e2 P 8dfbf314f9eb4599aa1f64e0098053f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:43.294476 19856 heartbeater.cc:499] Master 127.9.116.126:36317 was elected leader, sending a full tablet report...
I20260709 12:28:43.295204 19951 ts_tablet_manager.cc:1434] T 3aeae4fb47e646d09bdeb06f2d3ee837 P b2005221a1af4e559e0cb1cf28636c84: Time spent starting tablet: real 0.020s	user 0.015s	sys 0.003s
I20260709 12:28:43.296298 19951 tablet_bootstrap.cc:492] T ed4996cfc4a0429fae414b2c8e341c0d P b2005221a1af4e559e0cb1cf28636c84: Bootstrap starting.
I20260709 12:28:43.298444 19956 raft_consensus.cc:493] T 0f3c299838c041199cb1ebb8978304f9 P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:43.299230 19956 raft_consensus.cc:515] T 0f3c299838c041199cb1ebb8978304f9 P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:43.302376 19956 leader_election.cc:290] T 0f3c299838c041199cb1ebb8978304f9 P 72b654ed19904db48b0a8e50fe4e12c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65:38251), b2005221a1af4e559e0cb1cf28636c84 (127.9.116.66:42783)
I20260709 12:28:43.304104 19951 tablet_bootstrap.cc:654] T ed4996cfc4a0429fae414b2c8e341c0d P b2005221a1af4e559e0cb1cf28636c84: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:43.308917 19949 tablet_bootstrap.cc:654] T 66f3ed0a695841ce959ef857c4741496 P 72b654ed19904db48b0a8e50fe4e12c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:43.314651 19954 raft_consensus.cc:493] T a47b4bf847674ea286f15a089566d812 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:43.315615 19954 raft_consensus.cc:515] T a47b4bf847674ea286f15a089566d812 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:43.317085 19950 tablet_bootstrap.cc:492] T 22affa70596649658254e443bccdb7e2 P 8dfbf314f9eb4599aa1f64e0098053f2: No bootstrap required, opened a new log
I20260709 12:28:43.317754 19950 ts_tablet_manager.cc:1403] T 22affa70596649658254e443bccdb7e2 P 8dfbf314f9eb4599aa1f64e0098053f2: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.019s
I20260709 12:28:43.321311 19950 raft_consensus.cc:359] T 22affa70596649658254e443bccdb7e2 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } } peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } }
I20260709 12:28:43.322089 19950 raft_consensus.cc:385] T 22affa70596649658254e443bccdb7e2 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:43.322396 19950 raft_consensus.cc:740] T 22affa70596649658254e443bccdb7e2 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dfbf314f9eb4599aa1f64e0098053f2, State: Initialized, Role: FOLLOWER
I20260709 12:28:43.323244 19950 consensus_queue.cc:260] T 22affa70596649658254e443bccdb7e2 P 8dfbf314f9eb4599aa1f64e0098053f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } } peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } }
I20260709 12:28:43.328482 19954 leader_election.cc:290] T a47b4bf847674ea286f15a089566d812 P 8dfbf314f9eb4599aa1f64e0098053f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2005221a1af4e559e0cb1cf28636c84 (127.9.116.66:42783), 72b654ed19904db48b0a8e50fe4e12c7 (127.9.116.67:34699)
I20260709 12:28:43.367386 19756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3c299838c041199cb1ebb8978304f9" candidate_uuid: "72b654ed19904db48b0a8e50fe4e12c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" is_pre_election: true
W20260709 12:28:43.370049 19870 leader_election.cc:343] T 0f3c299838c041199cb1ebb8978304f9 P 72b654ed19904db48b0a8e50fe4e12c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65:38251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:43.377220 19951 tablet_bootstrap.cc:492] T ed4996cfc4a0429fae414b2c8e341c0d P b2005221a1af4e559e0cb1cf28636c84: No bootstrap required, opened a new log
I20260709 12:28:43.378080 19951 ts_tablet_manager.cc:1403] T ed4996cfc4a0429fae414b2c8e341c0d P b2005221a1af4e559e0cb1cf28636c84: Time spent bootstrapping tablet: real 0.082s	user 0.031s	sys 0.046s
I20260709 12:28:43.382580 19951 raft_consensus.cc:359] T ed4996cfc4a0429fae414b2c8e341c0d P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:43.383903 19951 raft_consensus.cc:385] T ed4996cfc4a0429fae414b2c8e341c0d P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:43.384335 19951 raft_consensus.cc:740] T ed4996cfc4a0429fae414b2c8e341c0d P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2005221a1af4e559e0cb1cf28636c84, State: Initialized, Role: FOLLOWER
I20260709 12:28:43.385710 19951 consensus_queue.cc:260] T ed4996cfc4a0429fae414b2c8e341c0d P b2005221a1af4e559e0cb1cf28636c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:43.389137 19951 ts_tablet_manager.cc:1434] T ed4996cfc4a0429fae414b2c8e341c0d P b2005221a1af4e559e0cb1cf28636c84: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.001s
I20260709 12:28:43.390276 19831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3c299838c041199cb1ebb8978304f9" candidate_uuid: "72b654ed19904db48b0a8e50fe4e12c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2005221a1af4e559e0cb1cf28636c84" is_pre_election: true
I20260709 12:28:43.391043 19951 tablet_bootstrap.cc:492] T 22affa70596649658254e443bccdb7e2 P b2005221a1af4e559e0cb1cf28636c84: Bootstrap starting.
W20260709 12:28:43.392755 19869 leader_election.cc:343] T 0f3c299838c041199cb1ebb8978304f9 P 72b654ed19904db48b0a8e50fe4e12c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2005221a1af4e559e0cb1cf28636c84 (127.9.116.66:42783): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:43.393481 19869 leader_election.cc:304] T 0f3c299838c041199cb1ebb8978304f9 P 72b654ed19904db48b0a8e50fe4e12c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72b654ed19904db48b0a8e50fe4e12c7; no voters: 8dfbf314f9eb4599aa1f64e0098053f2, b2005221a1af4e559e0cb1cf28636c84
I20260709 12:28:43.394975 19956 raft_consensus.cc:2749] T 0f3c299838c041199cb1ebb8978304f9 P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:43.398558 19949 tablet_bootstrap.cc:492] T 66f3ed0a695841ce959ef857c4741496 P 72b654ed19904db48b0a8e50fe4e12c7: No bootstrap required, opened a new log
I20260709 12:28:43.399326 19949 ts_tablet_manager.cc:1403] T 66f3ed0a695841ce959ef857c4741496 P 72b654ed19904db48b0a8e50fe4e12c7: Time spent bootstrapping tablet: real 0.115s	user 0.015s	sys 0.006s
I20260709 12:28:43.403015 19951 tablet_bootstrap.cc:654] T 22affa70596649658254e443bccdb7e2 P b2005221a1af4e559e0cb1cf28636c84: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:43.404969 19949 raft_consensus.cc:359] T 66f3ed0a695841ce959ef857c4741496 P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:43.408478 19949 raft_consensus.cc:385] T 66f3ed0a695841ce959ef857c4741496 P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:43.409019 19949 raft_consensus.cc:740] T 66f3ed0a695841ce959ef857c4741496 P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72b654ed19904db48b0a8e50fe4e12c7, State: Initialized, Role: FOLLOWER
I20260709 12:28:43.410328 19949 consensus_queue.cc:260] T 66f3ed0a695841ce959ef857c4741496 P 72b654ed19904db48b0a8e50fe4e12c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:43.419945 19949 ts_tablet_manager.cc:1434] T 66f3ed0a695841ce959ef857c4741496 P 72b654ed19904db48b0a8e50fe4e12c7: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.002s
I20260709 12:28:43.424454 19949 tablet_bootstrap.cc:492] T a47b4bf847674ea286f15a089566d812 P 72b654ed19904db48b0a8e50fe4e12c7: Bootstrap starting.
I20260709 12:28:43.434159 19950 ts_tablet_manager.cc:1434] T 22affa70596649658254e443bccdb7e2 P 8dfbf314f9eb4599aa1f64e0098053f2: Time spent starting tablet: real 0.116s	user 0.037s	sys 0.074s
I20260709 12:28:43.443517 19950 tablet_bootstrap.cc:492] T 0f3c299838c041199cb1ebb8978304f9 P 8dfbf314f9eb4599aa1f64e0098053f2: Bootstrap starting.
I20260709 12:28:43.448314 19906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47b4bf847674ea286f15a089566d812" candidate_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72b654ed19904db48b0a8e50fe4e12c7" is_pre_election: true
I20260709 12:28:43.440650 19951 tablet_bootstrap.cc:492] T 22affa70596649658254e443bccdb7e2 P b2005221a1af4e559e0cb1cf28636c84: No bootstrap required, opened a new log
I20260709 12:28:43.450261 19951 ts_tablet_manager.cc:1403] T 22affa70596649658254e443bccdb7e2 P b2005221a1af4e559e0cb1cf28636c84: Time spent bootstrapping tablet: real 0.060s	user 0.033s	sys 0.015s
I20260709 12:28:43.450899 19950 tablet_bootstrap.cc:654] T 0f3c299838c041199cb1ebb8978304f9 P 8dfbf314f9eb4599aa1f64e0098053f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:43.450990 19831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47b4bf847674ea286f15a089566d812" candidate_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2005221a1af4e559e0cb1cf28636c84" is_pre_election: true
W20260709 12:28:43.451025 19719 leader_election.cc:343] T a47b4bf847674ea286f15a089566d812 P 8dfbf314f9eb4599aa1f64e0098053f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72b654ed19904db48b0a8e50fe4e12c7 (127.9.116.67:34699): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:28:43.454007 19719 leader_election.cc:343] T a47b4bf847674ea286f15a089566d812 P 8dfbf314f9eb4599aa1f64e0098053f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2005221a1af4e559e0cb1cf28636c84 (127.9.116.66:42783): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:43.453904 19951 raft_consensus.cc:359] T 22affa70596649658254e443bccdb7e2 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } } peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } }
I20260709 12:28:43.454698 19719 leader_election.cc:304] T a47b4bf847674ea286f15a089566d812 P 8dfbf314f9eb4599aa1f64e0098053f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dfbf314f9eb4599aa1f64e0098053f2; no voters: 72b654ed19904db48b0a8e50fe4e12c7, b2005221a1af4e559e0cb1cf28636c84
I20260709 12:28:43.454986 19951 raft_consensus.cc:385] T 22affa70596649658254e443bccdb7e2 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:43.455415 19951 raft_consensus.cc:740] T 22affa70596649658254e443bccdb7e2 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2005221a1af4e559e0cb1cf28636c84, State: Initialized, Role: FOLLOWER
I20260709 12:28:43.455793 19968 raft_consensus.cc:2749] T a47b4bf847674ea286f15a089566d812 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:43.456466 19951 consensus_queue.cc:260] T 22affa70596649658254e443bccdb7e2 P b2005221a1af4e559e0cb1cf28636c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } } peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } }
I20260709 12:28:43.457515 19950 tablet_bootstrap.cc:492] T 0f3c299838c041199cb1ebb8978304f9 P 8dfbf314f9eb4599aa1f64e0098053f2: No bootstrap required, opened a new log
I20260709 12:28:43.458142 19950 ts_tablet_manager.cc:1403] T 0f3c299838c041199cb1ebb8978304f9 P 8dfbf314f9eb4599aa1f64e0098053f2: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.004s
I20260709 12:28:43.459300 19951 ts_tablet_manager.cc:1434] T 22affa70596649658254e443bccdb7e2 P b2005221a1af4e559e0cb1cf28636c84: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 12:28:43.460469 19951 tablet_bootstrap.cc:492] T 3545d7ed467b44c3b9be7f1c8d642c6c P b2005221a1af4e559e0cb1cf28636c84: Bootstrap starting.
I20260709 12:28:43.461400 19950 raft_consensus.cc:359] T 0f3c299838c041199cb1ebb8978304f9 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:43.462209 19950 raft_consensus.cc:385] T 0f3c299838c041199cb1ebb8978304f9 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:43.462518 19950 raft_consensus.cc:740] T 0f3c299838c041199cb1ebb8978304f9 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dfbf314f9eb4599aa1f64e0098053f2, State: Initialized, Role: FOLLOWER
I20260709 12:28:43.463459 19950 consensus_queue.cc:260] T 0f3c299838c041199cb1ebb8978304f9 P 8dfbf314f9eb4599aa1f64e0098053f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:43.466334 19950 ts_tablet_manager.cc:1434] T 0f3c299838c041199cb1ebb8978304f9 P 8dfbf314f9eb4599aa1f64e0098053f2: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:28:43.467031 19949 tablet_bootstrap.cc:654] T a47b4bf847674ea286f15a089566d812 P 72b654ed19904db48b0a8e50fe4e12c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:43.467881 19950 tablet_bootstrap.cc:492] T 66f3ed0a695841ce959ef857c4741496 P 8dfbf314f9eb4599aa1f64e0098053f2: Bootstrap starting.
I20260709 12:28:43.468143 19951 tablet_bootstrap.cc:654] T 3545d7ed467b44c3b9be7f1c8d642c6c P b2005221a1af4e559e0cb1cf28636c84: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:43.480068 19950 tablet_bootstrap.cc:654] T 66f3ed0a695841ce959ef857c4741496 P 8dfbf314f9eb4599aa1f64e0098053f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:43.488451 19951 tablet_bootstrap.cc:492] T 3545d7ed467b44c3b9be7f1c8d642c6c P b2005221a1af4e559e0cb1cf28636c84: No bootstrap required, opened a new log
I20260709 12:28:43.489071 19951 ts_tablet_manager.cc:1403] T 3545d7ed467b44c3b9be7f1c8d642c6c P b2005221a1af4e559e0cb1cf28636c84: Time spent bootstrapping tablet: real 0.029s	user 0.017s	sys 0.009s
I20260709 12:28:43.492825 19951 raft_consensus.cc:359] T 3545d7ed467b44c3b9be7f1c8d642c6c P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:43.493836 19951 raft_consensus.cc:385] T 3545d7ed467b44c3b9be7f1c8d642c6c P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:43.494184 19951 raft_consensus.cc:740] T 3545d7ed467b44c3b9be7f1c8d642c6c P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2005221a1af4e559e0cb1cf28636c84, State: Initialized, Role: FOLLOWER
I20260709 12:28:43.495450 19951 consensus_queue.cc:260] T 3545d7ed467b44c3b9be7f1c8d642c6c P b2005221a1af4e559e0cb1cf28636c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:43.497900 19949 tablet_bootstrap.cc:492] T a47b4bf847674ea286f15a089566d812 P 72b654ed19904db48b0a8e50fe4e12c7: No bootstrap required, opened a new log
I20260709 12:28:43.498718 19949 ts_tablet_manager.cc:1403] T a47b4bf847674ea286f15a089566d812 P 72b654ed19904db48b0a8e50fe4e12c7: Time spent bootstrapping tablet: real 0.075s	user 0.016s	sys 0.020s
I20260709 12:28:43.499029 19950 tablet_bootstrap.cc:492] T 66f3ed0a695841ce959ef857c4741496 P 8dfbf314f9eb4599aa1f64e0098053f2: No bootstrap required, opened a new log
I20260709 12:28:43.499164 19951 ts_tablet_manager.cc:1434] T 3545d7ed467b44c3b9be7f1c8d642c6c P b2005221a1af4e559e0cb1cf28636c84: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.004s
I20260709 12:28:43.500195 19950 ts_tablet_manager.cc:1403] T 66f3ed0a695841ce959ef857c4741496 P 8dfbf314f9eb4599aa1f64e0098053f2: Time spent bootstrapping tablet: real 0.033s	user 0.022s	sys 0.006s
I20260709 12:28:43.500864 19951 tablet_bootstrap.cc:492] T 8d17b409914c4c139fb5a5e4fbcbd54a P b2005221a1af4e559e0cb1cf28636c84: Bootstrap starting.
I20260709 12:28:43.502154 19949 raft_consensus.cc:359] T a47b4bf847674ea286f15a089566d812 P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:43.503050 19949 raft_consensus.cc:385] T a47b4bf847674ea286f15a089566d812 P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:43.503365 19949 raft_consensus.cc:740] T a47b4bf847674ea286f15a089566d812 P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72b654ed19904db48b0a8e50fe4e12c7, State: Initialized, Role: FOLLOWER
I20260709 12:28:43.504351 19949 consensus_queue.cc:260] T a47b4bf847674ea286f15a089566d812 P 72b654ed19904db48b0a8e50fe4e12c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:43.504225 19950 raft_consensus.cc:359] T 66f3ed0a695841ce959ef857c4741496 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:43.505719 19950 raft_consensus.cc:385] T 66f3ed0a695841ce959ef857c4741496 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:43.506196 19950 raft_consensus.cc:740] T 66f3ed0a695841ce959ef857c4741496 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dfbf314f9eb4599aa1f64e0098053f2, State: Initialized, Role: FOLLOWER
I20260709 12:28:43.507123 19950 consensus_queue.cc:260] T 66f3ed0a695841ce959ef857c4741496 P 8dfbf314f9eb4599aa1f64e0098053f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:43.506860 19949 ts_tablet_manager.cc:1434] T a47b4bf847674ea286f15a089566d812 P 72b654ed19904db48b0a8e50fe4e12c7: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 12:28:43.509419 19951 tablet_bootstrap.cc:654] T 8d17b409914c4c139fb5a5e4fbcbd54a P b2005221a1af4e559e0cb1cf28636c84: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:43.509969 19950 ts_tablet_manager.cc:1434] T 66f3ed0a695841ce959ef857c4741496 P 8dfbf314f9eb4599aa1f64e0098053f2: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:28:43.510557 19949 tablet_bootstrap.cc:492] T ed4996cfc4a0429fae414b2c8e341c0d P 72b654ed19904db48b0a8e50fe4e12c7: Bootstrap starting.
I20260709 12:28:43.511364 19950 tablet_bootstrap.cc:492] T 3aeae4fb47e646d09bdeb06f2d3ee837 P 8dfbf314f9eb4599aa1f64e0098053f2: Bootstrap starting.
I20260709 12:28:43.519554 19949 tablet_bootstrap.cc:654] T ed4996cfc4a0429fae414b2c8e341c0d P 72b654ed19904db48b0a8e50fe4e12c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:43.522138 19951 tablet_bootstrap.cc:492] T 8d17b409914c4c139fb5a5e4fbcbd54a P b2005221a1af4e559e0cb1cf28636c84: No bootstrap required, opened a new log
I20260709 12:28:43.522879 19951 ts_tablet_manager.cc:1403] T 8d17b409914c4c139fb5a5e4fbcbd54a P b2005221a1af4e559e0cb1cf28636c84: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.006s
I20260709 12:28:43.525537 19950 tablet_bootstrap.cc:654] T 3aeae4fb47e646d09bdeb06f2d3ee837 P 8dfbf314f9eb4599aa1f64e0098053f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:43.526791 19951 raft_consensus.cc:359] T 8d17b409914c4c139fb5a5e4fbcbd54a P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:43.527807 19951 raft_consensus.cc:385] T 8d17b409914c4c139fb5a5e4fbcbd54a P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:43.528299 19951 raft_consensus.cc:740] T 8d17b409914c4c139fb5a5e4fbcbd54a P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2005221a1af4e559e0cb1cf28636c84, State: Initialized, Role: FOLLOWER
I20260709 12:28:43.529418 19951 consensus_queue.cc:260] T 8d17b409914c4c139fb5a5e4fbcbd54a P b2005221a1af4e559e0cb1cf28636c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:43.532536 19951 ts_tablet_manager.cc:1434] T 8d17b409914c4c139fb5a5e4fbcbd54a P b2005221a1af4e559e0cb1cf28636c84: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.004s
I20260709 12:28:43.533624 19951 tablet_bootstrap.cc:492] T 66f3ed0a695841ce959ef857c4741496 P b2005221a1af4e559e0cb1cf28636c84: Bootstrap starting.
I20260709 12:28:43.539378 19968 raft_consensus.cc:493] T 3545d7ed467b44c3b9be7f1c8d642c6c P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:43.540251 19968 raft_consensus.cc:515] T 3545d7ed467b44c3b9be7f1c8d642c6c P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:43.543375 19951 tablet_bootstrap.cc:654] T 66f3ed0a695841ce959ef857c4741496 P b2005221a1af4e559e0cb1cf28636c84: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:43.545210 19831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3545d7ed467b44c3b9be7f1c8d642c6c" candidate_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2005221a1af4e559e0cb1cf28636c84" is_pre_election: true
I20260709 12:28:43.545977 19831 raft_consensus.cc:2468] T 3545d7ed467b44c3b9be7f1c8d642c6c P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dfbf314f9eb4599aa1f64e0098053f2 in term 0.
I20260709 12:28:43.548085 19906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3545d7ed467b44c3b9be7f1c8d642c6c" candidate_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72b654ed19904db48b0a8e50fe4e12c7" is_pre_election: true
I20260709 12:28:43.549091 19950 tablet_bootstrap.cc:492] T 3aeae4fb47e646d09bdeb06f2d3ee837 P 8dfbf314f9eb4599aa1f64e0098053f2: No bootstrap required, opened a new log
I20260709 12:28:43.551306 19950 ts_tablet_manager.cc:1403] T 3aeae4fb47e646d09bdeb06f2d3ee837 P 8dfbf314f9eb4599aa1f64e0098053f2: Time spent bootstrapping tablet: real 0.040s	user 0.011s	sys 0.015s
I20260709 12:28:43.552399 19956 raft_consensus.cc:493] T 66f3ed0a695841ce959ef857c4741496 P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:43.553548 19956 raft_consensus.cc:515] T 66f3ed0a695841ce959ef857c4741496 P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:43.556993 19950 raft_consensus.cc:359] T 3aeae4fb47e646d09bdeb06f2d3ee837 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:43.559224 19950 raft_consensus.cc:385] T 3aeae4fb47e646d09bdeb06f2d3ee837 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:43.559697 19950 raft_consensus.cc:740] T 3aeae4fb47e646d09bdeb06f2d3ee837 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dfbf314f9eb4599aa1f64e0098053f2, State: Initialized, Role: FOLLOWER
I20260709 12:28:43.560843 19951 tablet_bootstrap.cc:492] T 66f3ed0a695841ce959ef857c4741496 P b2005221a1af4e559e0cb1cf28636c84: No bootstrap required, opened a new log
I20260709 12:28:43.560737 19950 consensus_queue.cc:260] T 3aeae4fb47e646d09bdeb06f2d3ee837 P 8dfbf314f9eb4599aa1f64e0098053f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:43.561425 19951 ts_tablet_manager.cc:1403] T 66f3ed0a695841ce959ef857c4741496 P b2005221a1af4e559e0cb1cf28636c84: Time spent bootstrapping tablet: real 0.028s	user 0.016s	sys 0.006s
I20260709 12:28:43.563675 19950 ts_tablet_manager.cc:1434] T 3aeae4fb47e646d09bdeb06f2d3ee837 P 8dfbf314f9eb4599aa1f64e0098053f2: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 12:28:43.565052 19950 tablet_bootstrap.cc:492] T ed4996cfc4a0429fae414b2c8e341c0d P 8dfbf314f9eb4599aa1f64e0098053f2: Bootstrap starting.
I20260709 12:28:43.564898 19951 raft_consensus.cc:359] T 66f3ed0a695841ce959ef857c4741496 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:43.564910 19756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66f3ed0a695841ce959ef857c4741496" candidate_uuid: "72b654ed19904db48b0a8e50fe4e12c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" is_pre_election: true
I20260709 12:28:43.565958 19951 raft_consensus.cc:385] T 66f3ed0a695841ce959ef857c4741496 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:43.566372 19951 raft_consensus.cc:740] T 66f3ed0a695841ce959ef857c4741496 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2005221a1af4e559e0cb1cf28636c84, State: Initialized, Role: FOLLOWER
I20260709 12:28:43.566459 19756 raft_consensus.cc:2468] T 66f3ed0a695841ce959ef857c4741496 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72b654ed19904db48b0a8e50fe4e12c7 in term 0.
I20260709 12:28:43.567725 19956 leader_election.cc:290] T 66f3ed0a695841ce959ef857c4741496 P 72b654ed19904db48b0a8e50fe4e12c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65:38251), b2005221a1af4e559e0cb1cf28636c84 (127.9.116.66:42783)
I20260709 12:28:43.567770 19951 consensus_queue.cc:260] T 66f3ed0a695841ce959ef857c4741496 P b2005221a1af4e559e0cb1cf28636c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:43.570281 19831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66f3ed0a695841ce959ef857c4741496" candidate_uuid: "72b654ed19904db48b0a8e50fe4e12c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2005221a1af4e559e0cb1cf28636c84" is_pre_election: true
I20260709 12:28:43.571220 19951 ts_tablet_manager.cc:1434] T 66f3ed0a695841ce959ef857c4741496 P b2005221a1af4e559e0cb1cf28636c84: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 12:28:43.571444 19831 raft_consensus.cc:2468] T 66f3ed0a695841ce959ef857c4741496 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72b654ed19904db48b0a8e50fe4e12c7 in term 0.
I20260709 12:28:43.572718 19951 tablet_bootstrap.cc:492] T 0f3c299838c041199cb1ebb8978304f9 P b2005221a1af4e559e0cb1cf28636c84: Bootstrap starting.
W20260709 12:28:43.557917 19719 leader_election.cc:343] T 3545d7ed467b44c3b9be7f1c8d642c6c P 8dfbf314f9eb4599aa1f64e0098053f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72b654ed19904db48b0a8e50fe4e12c7 (127.9.116.67:34699): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:43.574003 19719 leader_election.cc:304] T 3545d7ed467b44c3b9be7f1c8d642c6c P 8dfbf314f9eb4599aa1f64e0098053f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dfbf314f9eb4599aa1f64e0098053f2, b2005221a1af4e559e0cb1cf28636c84; no voters: 72b654ed19904db48b0a8e50fe4e12c7
I20260709 12:28:43.575207 19950 tablet_bootstrap.cc:654] T ed4996cfc4a0429fae414b2c8e341c0d P 8dfbf314f9eb4599aa1f64e0098053f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:43.575373 19954 raft_consensus.cc:2804] T 3545d7ed467b44c3b9be7f1c8d642c6c P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:43.576321 19954 raft_consensus.cc:493] T 3545d7ed467b44c3b9be7f1c8d642c6c P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:43.576867 19954 raft_consensus.cc:3060] T 3545d7ed467b44c3b9be7f1c8d642c6c P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:43.581521 19951 tablet_bootstrap.cc:654] T 0f3c299838c041199cb1ebb8978304f9 P b2005221a1af4e559e0cb1cf28636c84: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:43.581202 19869 leader_election.cc:304] T 66f3ed0a695841ce959ef857c4741496 P 72b654ed19904db48b0a8e50fe4e12c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72b654ed19904db48b0a8e50fe4e12c7, b2005221a1af4e559e0cb1cf28636c84; no voters: 
I20260709 12:28:43.595860 19951 tablet_bootstrap.cc:492] T 0f3c299838c041199cb1ebb8978304f9 P b2005221a1af4e559e0cb1cf28636c84: No bootstrap required, opened a new log
I20260709 12:28:43.596617 19951 ts_tablet_manager.cc:1403] T 0f3c299838c041199cb1ebb8978304f9 P b2005221a1af4e559e0cb1cf28636c84: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.005s
I20260709 12:28:43.596797 19950 tablet_bootstrap.cc:492] T ed4996cfc4a0429fae414b2c8e341c0d P 8dfbf314f9eb4599aa1f64e0098053f2: No bootstrap required, opened a new log
I20260709 12:28:43.597838 19950 ts_tablet_manager.cc:1403] T ed4996cfc4a0429fae414b2c8e341c0d P 8dfbf314f9eb4599aa1f64e0098053f2: Time spent bootstrapping tablet: real 0.033s	user 0.015s	sys 0.007s
I20260709 12:28:43.600652 19951 raft_consensus.cc:359] T 0f3c299838c041199cb1ebb8978304f9 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:43.601614 19951 raft_consensus.cc:385] T 0f3c299838c041199cb1ebb8978304f9 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:43.602022 19951 raft_consensus.cc:740] T 0f3c299838c041199cb1ebb8978304f9 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2005221a1af4e559e0cb1cf28636c84, State: Initialized, Role: FOLLOWER
I20260709 12:28:43.603067 19951 consensus_queue.cc:260] T 0f3c299838c041199cb1ebb8978304f9 P b2005221a1af4e559e0cb1cf28636c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:43.603438 19950 raft_consensus.cc:359] T ed4996cfc4a0429fae414b2c8e341c0d P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:43.606042 19950 raft_consensus.cc:385] T ed4996cfc4a0429fae414b2c8e341c0d P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:43.606595 19951 ts_tablet_manager.cc:1434] T 0f3c299838c041199cb1ebb8978304f9 P b2005221a1af4e559e0cb1cf28636c84: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:28:43.607789 19950 raft_consensus.cc:740] T ed4996cfc4a0429fae414b2c8e341c0d P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dfbf314f9eb4599aa1f64e0098053f2, State: Initialized, Role: FOLLOWER
I20260709 12:28:43.608685 19951 tablet_bootstrap.cc:492] T a47b4bf847674ea286f15a089566d812 P b2005221a1af4e559e0cb1cf28636c84: Bootstrap starting.
I20260709 12:28:43.558723 19968 leader_election.cc:290] T 3545d7ed467b44c3b9be7f1c8d642c6c P 8dfbf314f9eb4599aa1f64e0098053f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2005221a1af4e559e0cb1cf28636c84 (127.9.116.66:42783), 72b654ed19904db48b0a8e50fe4e12c7 (127.9.116.67:34699)
I20260709 12:28:43.609609 19950 consensus_queue.cc:260] T ed4996cfc4a0429fae414b2c8e341c0d P 8dfbf314f9eb4599aa1f64e0098053f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:43.611878 19956 raft_consensus.cc:2804] T 66f3ed0a695841ce959ef857c4741496 P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:43.612936 19956 raft_consensus.cc:493] T 66f3ed0a695841ce959ef857c4741496 P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:43.613544 19956 raft_consensus.cc:3060] T 66f3ed0a695841ce959ef857c4741496 P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:43.614509 19950 ts_tablet_manager.cc:1434] T ed4996cfc4a0429fae414b2c8e341c0d P 8dfbf314f9eb4599aa1f64e0098053f2: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:28:43.610052 19968 raft_consensus.cc:493] T 0f3c299838c041199cb1ebb8978304f9 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:43.617326 19951 tablet_bootstrap.cc:654] T a47b4bf847674ea286f15a089566d812 P b2005221a1af4e559e0cb1cf28636c84: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:43.624143 19968 raft_consensus.cc:515] T 0f3c299838c041199cb1ebb8978304f9 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:43.626569 19968 leader_election.cc:290] T 0f3c299838c041199cb1ebb8978304f9 P 8dfbf314f9eb4599aa1f64e0098053f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2005221a1af4e559e0cb1cf28636c84 (127.9.116.66:42783), 72b654ed19904db48b0a8e50fe4e12c7 (127.9.116.67:34699)
I20260709 12:28:43.628451 19950 tablet_bootstrap.cc:492] T 7ae5eb89de7c49b5a4e4813747c2764a P 8dfbf314f9eb4599aa1f64e0098053f2: Bootstrap starting.
I20260709 12:28:43.629279 19982 raft_consensus.cc:493] T 22affa70596649658254e443bccdb7e2 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:43.629846 19982 raft_consensus.cc:515] T 22affa70596649658254e443bccdb7e2 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } } peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } }
I20260709 12:28:43.632546 19982 leader_election.cc:290] T 22affa70596649658254e443bccdb7e2 P 8dfbf314f9eb4599aa1f64e0098053f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72b654ed19904db48b0a8e50fe4e12c7 (127.9.116.67:34699), b2005221a1af4e559e0cb1cf28636c84 (127.9.116.66:42783)
I20260709 12:28:43.637739 19949 tablet_bootstrap.cc:492] T ed4996cfc4a0429fae414b2c8e341c0d P 72b654ed19904db48b0a8e50fe4e12c7: No bootstrap required, opened a new log
I20260709 12:28:43.638684 19949 ts_tablet_manager.cc:1403] T ed4996cfc4a0429fae414b2c8e341c0d P 72b654ed19904db48b0a8e50fe4e12c7: Time spent bootstrapping tablet: real 0.128s	user 0.046s	sys 0.073s
I20260709 12:28:43.639004 19950 tablet_bootstrap.cc:654] T 7ae5eb89de7c49b5a4e4813747c2764a P 8dfbf314f9eb4599aa1f64e0098053f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:43.640216 19831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3c299838c041199cb1ebb8978304f9" candidate_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2005221a1af4e559e0cb1cf28636c84" is_pre_election: true
I20260709 12:28:43.640973 19831 raft_consensus.cc:2468] T 0f3c299838c041199cb1ebb8978304f9 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dfbf314f9eb4599aa1f64e0098053f2 in term 0.
I20260709 12:28:43.641738 19905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22affa70596649658254e443bccdb7e2" candidate_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72b654ed19904db48b0a8e50fe4e12c7" is_pre_election: true
I20260709 12:28:43.642890 19830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22affa70596649658254e443bccdb7e2" candidate_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2005221a1af4e559e0cb1cf28636c84" is_pre_election: true
I20260709 12:28:43.642831 19949 raft_consensus.cc:359] T ed4996cfc4a0429fae414b2c8e341c0d P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:43.644340 19949 raft_consensus.cc:385] T ed4996cfc4a0429fae414b2c8e341c0d P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:43.644492 19719 leader_election.cc:304] T 0f3c299838c041199cb1ebb8978304f9 P 8dfbf314f9eb4599aa1f64e0098053f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dfbf314f9eb4599aa1f64e0098053f2, b2005221a1af4e559e0cb1cf28636c84; no voters: 
I20260709 12:28:43.644804 19949 raft_consensus.cc:740] T ed4996cfc4a0429fae414b2c8e341c0d P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72b654ed19904db48b0a8e50fe4e12c7, State: Initialized, Role: FOLLOWER
I20260709 12:28:43.645648 19984 raft_consensus.cc:2804] T 0f3c299838c041199cb1ebb8978304f9 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:43.646064 19984 raft_consensus.cc:493] T 0f3c299838c041199cb1ebb8978304f9 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:43.646709 19984 raft_consensus.cc:3060] T 0f3c299838c041199cb1ebb8978304f9 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:43.645964 19949 consensus_queue.cc:260] T ed4996cfc4a0429fae414b2c8e341c0d P 72b654ed19904db48b0a8e50fe4e12c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:43.639068 19906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3c299838c041199cb1ebb8978304f9" candidate_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72b654ed19904db48b0a8e50fe4e12c7" is_pre_election: true
I20260709 12:28:43.635076 19961 raft_consensus.cc:493] T 22affa70596649658254e443bccdb7e2 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:43.656023 19961 raft_consensus.cc:515] T 22affa70596649658254e443bccdb7e2 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } } peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } }
I20260709 12:28:43.658681 19984 raft_consensus.cc:515] T 0f3c299838c041199cb1ebb8978304f9 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:43.663919 19984 leader_election.cc:290] T 0f3c299838c041199cb1ebb8978304f9 P 8dfbf314f9eb4599aa1f64e0098053f2 [CANDIDATE]: Term 1 election: Requested vote from peers b2005221a1af4e559e0cb1cf28636c84 (127.9.116.66:42783), 72b654ed19904db48b0a8e50fe4e12c7 (127.9.116.67:34699)
I20260709 12:28:43.664088 19830 raft_consensus.cc:2468] T 22affa70596649658254e443bccdb7e2 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dfbf314f9eb4599aa1f64e0098053f2 in term 0.
I20260709 12:28:43.643187 19905 raft_consensus.cc:2468] T 22affa70596649658254e443bccdb7e2 P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dfbf314f9eb4599aa1f64e0098053f2 in term 0.
I20260709 12:28:43.660846 19961 leader_election.cc:290] T 22affa70596649658254e443bccdb7e2 P b2005221a1af4e559e0cb1cf28636c84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72b654ed19904db48b0a8e50fe4e12c7 (127.9.116.67:34699), 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65:38251)
I20260709 12:28:43.672515 19985 raft_consensus.cc:493] T 7ae5eb89de7c49b5a4e4813747c2764a P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:43.673106 19985 raft_consensus.cc:515] T 7ae5eb89de7c49b5a4e4813747c2764a P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:43.665117 19956 raft_consensus.cc:515] T 66f3ed0a695841ce959ef857c4741496 P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:43.674296 19954 raft_consensus.cc:515] T 3545d7ed467b44c3b9be7f1c8d642c6c P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:43.675886 19956 leader_election.cc:290] T 66f3ed0a695841ce959ef857c4741496 P 72b654ed19904db48b0a8e50fe4e12c7 [CANDIDATE]: Term 1 election: Requested vote from peers 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65:38251), b2005221a1af4e559e0cb1cf28636c84 (127.9.116.66:42783)
I20260709 12:28:43.677145 19756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae5eb89de7c49b5a4e4813747c2764a" candidate_uuid: "72b654ed19904db48b0a8e50fe4e12c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" is_pre_election: true
I20260709 12:28:43.677704 19829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66f3ed0a695841ce959ef857c4741496" candidate_uuid: "72b654ed19904db48b0a8e50fe4e12c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2005221a1af4e559e0cb1cf28636c84"
I20260709 12:28:43.678465 19829 raft_consensus.cc:3060] T 66f3ed0a695841ce959ef857c4741496 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:43.678905 19755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66f3ed0a695841ce959ef857c4741496" candidate_uuid: "72b654ed19904db48b0a8e50fe4e12c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dfbf314f9eb4599aa1f64e0098053f2"
I20260709 12:28:43.661562 19906 raft_consensus.cc:2468] T 0f3c299838c041199cb1ebb8978304f9 P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dfbf314f9eb4599aa1f64e0098053f2 in term 0.
I20260709 12:28:43.679718 19954 leader_election.cc:290] T 3545d7ed467b44c3b9be7f1c8d642c6c P 8dfbf314f9eb4599aa1f64e0098053f2 [CANDIDATE]: Term 1 election: Requested vote from peers b2005221a1af4e559e0cb1cf28636c84 (127.9.116.66:42783), 72b654ed19904db48b0a8e50fe4e12c7 (127.9.116.67:34699)
I20260709 12:28:43.684087 19831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae5eb89de7c49b5a4e4813747c2764a" candidate_uuid: "72b654ed19904db48b0a8e50fe4e12c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2005221a1af4e559e0cb1cf28636c84" is_pre_election: true
W20260709 12:28:43.685092 19870 leader_election.cc:343] T 7ae5eb89de7c49b5a4e4813747c2764a P 72b654ed19904db48b0a8e50fe4e12c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65:38251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:43.685868 19985 leader_election.cc:290] T 7ae5eb89de7c49b5a4e4813747c2764a P 72b654ed19904db48b0a8e50fe4e12c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65:38251), b2005221a1af4e559e0cb1cf28636c84 (127.9.116.66:42783)
W20260709 12:28:43.687938 19869 leader_election.cc:343] T 7ae5eb89de7c49b5a4e4813747c2764a P 72b654ed19904db48b0a8e50fe4e12c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2005221a1af4e559e0cb1cf28636c84 (127.9.116.66:42783): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:43.690536 19831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3c299838c041199cb1ebb8978304f9" candidate_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2005221a1af4e559e0cb1cf28636c84"
I20260709 12:28:43.690891 19830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3545d7ed467b44c3b9be7f1c8d642c6c" candidate_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2005221a1af4e559e0cb1cf28636c84"
I20260709 12:28:43.691309 19954 raft_consensus.cc:493] T 8d17b409914c4c139fb5a5e4fbcbd54a P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:43.679606 19755 raft_consensus.cc:3060] T 66f3ed0a695841ce959ef857c4741496 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:43.690629 19869 leader_election.cc:304] T 7ae5eb89de7c49b5a4e4813747c2764a P 72b654ed19904db48b0a8e50fe4e12c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72b654ed19904db48b0a8e50fe4e12c7; no voters: 8dfbf314f9eb4599aa1f64e0098053f2, b2005221a1af4e559e0cb1cf28636c84
I20260709 12:28:43.691999 19830 raft_consensus.cc:3060] T 3545d7ed467b44c3b9be7f1c8d642c6c P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:43.692483 19906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3545d7ed467b44c3b9be7f1c8d642c6c" candidate_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72b654ed19904db48b0a8e50fe4e12c7"
I20260709 12:28:43.693428 19985 raft_consensus.cc:2749] T 7ae5eb89de7c49b5a4e4813747c2764a P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:43.693938 19719 leader_election.cc:304] T 22affa70596649658254e443bccdb7e2 P 8dfbf314f9eb4599aa1f64e0098053f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dfbf314f9eb4599aa1f64e0098053f2, b2005221a1af4e559e0cb1cf28636c84; no voters: 
I20260709 12:28:43.695004 19984 raft_consensus.cc:2804] T 22affa70596649658254e443bccdb7e2 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:43.692004 19954 raft_consensus.cc:515] T 8d17b409914c4c139fb5a5e4fbcbd54a P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:43.695448 19984 raft_consensus.cc:493] T 22affa70596649658254e443bccdb7e2 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:43.695885 19984 raft_consensus.cc:3060] T 22affa70596649658254e443bccdb7e2 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:43.692123 19905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3c299838c041199cb1ebb8978304f9" candidate_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72b654ed19904db48b0a8e50fe4e12c7"
I20260709 12:28:43.698215 19905 raft_consensus.cc:3060] T 0f3c299838c041199cb1ebb8978304f9 P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:43.697520 19954 leader_election.cc:290] T 8d17b409914c4c139fb5a5e4fbcbd54a P 8dfbf314f9eb4599aa1f64e0098053f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2005221a1af4e559e0cb1cf28636c84 (127.9.116.66:42783), 72b654ed19904db48b0a8e50fe4e12c7 (127.9.116.67:34699)
I20260709 12:28:43.691291 19831 raft_consensus.cc:3060] T 0f3c299838c041199cb1ebb8978304f9 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:28:43.703536 19719 leader_election.cc:343] T 3545d7ed467b44c3b9be7f1c8d642c6c P 8dfbf314f9eb4599aa1f64e0098053f2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 72b654ed19904db48b0a8e50fe4e12c7 (127.9.116.67:34699): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:43.706812 19906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d17b409914c4c139fb5a5e4fbcbd54a" candidate_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72b654ed19904db48b0a8e50fe4e12c7" is_pre_election: true
I20260709 12:28:43.706926 19828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d17b409914c4c139fb5a5e4fbcbd54a" candidate_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2005221a1af4e559e0cb1cf28636c84" is_pre_election: true
I20260709 12:28:43.707803 19828 raft_consensus.cc:2468] T 8d17b409914c4c139fb5a5e4fbcbd54a P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dfbf314f9eb4599aa1f64e0098053f2 in term 0.
I20260709 12:28:43.707796 19961 raft_consensus.cc:493] T 3aeae4fb47e646d09bdeb06f2d3ee837 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:43.711812 19961 raft_consensus.cc:515] T 3aeae4fb47e646d09bdeb06f2d3ee837 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:43.712452 19755 raft_consensus.cc:2468] T 66f3ed0a695841ce959ef857c4741496 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72b654ed19904db48b0a8e50fe4e12c7 in term 1.
I20260709 12:28:43.714239 19870 leader_election.cc:304] T 66f3ed0a695841ce959ef857c4741496 P 72b654ed19904db48b0a8e50fe4e12c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72b654ed19904db48b0a8e50fe4e12c7, 8dfbf314f9eb4599aa1f64e0098053f2; no voters: 
I20260709 12:28:43.716033 19719 leader_election.cc:304] T 8d17b409914c4c139fb5a5e4fbcbd54a P 8dfbf314f9eb4599aa1f64e0098053f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dfbf314f9eb4599aa1f64e0098053f2, b2005221a1af4e559e0cb1cf28636c84; no voters: 
I20260709 12:28:43.717063 19954 raft_consensus.cc:2804] T 8d17b409914c4c139fb5a5e4fbcbd54a P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:43.717474 19954 raft_consensus.cc:493] T 8d17b409914c4c139fb5a5e4fbcbd54a P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:43.717991 19954 raft_consensus.cc:3060] T 8d17b409914c4c139fb5a5e4fbcbd54a P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:43.719202 19990 raft_consensus.cc:2804] T 66f3ed0a695841ce959ef857c4741496 P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:43.720041 19990 raft_consensus.cc:697] T 66f3ed0a695841ce959ef857c4741496 P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 LEADER]: Becoming Leader. State: Replica: 72b654ed19904db48b0a8e50fe4e12c7, State: Running, Role: LEADER
I20260709 12:28:43.721151 19990 consensus_queue.cc:237] T 66f3ed0a695841ce959ef857c4741496 P 72b654ed19904db48b0a8e50fe4e12c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:43.722019 19961 leader_election.cc:290] T 3aeae4fb47e646d09bdeb06f2d3ee837 P b2005221a1af4e559e0cb1cf28636c84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65:38251), 72b654ed19904db48b0a8e50fe4e12c7 (127.9.116.67:34699)
I20260709 12:28:43.724045 19830 raft_consensus.cc:2468] T 3545d7ed467b44c3b9be7f1c8d642c6c P b2005221a1af4e559e0cb1cf28636c84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dfbf314f9eb4599aa1f64e0098053f2 in term 1.
I20260709 12:28:43.725414 19949 ts_tablet_manager.cc:1434] T ed4996cfc4a0429fae414b2c8e341c0d P 72b654ed19904db48b0a8e50fe4e12c7: Time spent starting tablet: real 0.086s	user 0.016s	sys 0.000s
I20260709 12:28:43.728955 19949 tablet_bootstrap.cc:492] T 3545d7ed467b44c3b9be7f1c8d642c6c P 72b654ed19904db48b0a8e50fe4e12c7: Bootstrap starting.
I20260709 12:28:43.729645 19756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aeae4fb47e646d09bdeb06f2d3ee837" candidate_uuid: "b2005221a1af4e559e0cb1cf28636c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" is_pre_election: true
I20260709 12:28:43.730322 19904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aeae4fb47e646d09bdeb06f2d3ee837" candidate_uuid: "b2005221a1af4e559e0cb1cf28636c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72b654ed19904db48b0a8e50fe4e12c7" is_pre_election: true
I20260709 12:28:43.730561 19756 raft_consensus.cc:2468] T 3aeae4fb47e646d09bdeb06f2d3ee837 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2005221a1af4e559e0cb1cf28636c84 in term 0.
I20260709 12:28:43.732899 19795 leader_election.cc:304] T 3aeae4fb47e646d09bdeb06f2d3ee837 P b2005221a1af4e559e0cb1cf28636c84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dfbf314f9eb4599aa1f64e0098053f2, b2005221a1af4e559e0cb1cf28636c84; no voters: 
W20260709 12:28:43.733711 19794 leader_election.cc:343] T 3aeae4fb47e646d09bdeb06f2d3ee837 P b2005221a1af4e559e0cb1cf28636c84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72b654ed19904db48b0a8e50fe4e12c7 (127.9.116.67:34699): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:43.734048 19961 raft_consensus.cc:2804] T 3aeae4fb47e646d09bdeb06f2d3ee837 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:43.734637 19961 raft_consensus.cc:493] T 3aeae4fb47e646d09bdeb06f2d3ee837 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:43.735106 19961 raft_consensus.cc:3060] T 3aeae4fb47e646d09bdeb06f2d3ee837 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:43.736158 19755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22affa70596649658254e443bccdb7e2" candidate_uuid: "b2005221a1af4e559e0cb1cf28636c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" is_pre_election: true
I20260709 12:28:43.734900 19906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22affa70596649658254e443bccdb7e2" candidate_uuid: "b2005221a1af4e559e0cb1cf28636c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72b654ed19904db48b0a8e50fe4e12c7" is_pre_election: true
I20260709 12:28:43.737093 19906 raft_consensus.cc:2468] T 22affa70596649658254e443bccdb7e2 P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2005221a1af4e559e0cb1cf28636c84 in term 0.
W20260709 12:28:43.737587 19719 leader_election.cc:343] T 8d17b409914c4c139fb5a5e4fbcbd54a P 8dfbf314f9eb4599aa1f64e0098053f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72b654ed19904db48b0a8e50fe4e12c7 (127.9.116.67:34699): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:43.738652 19794 leader_election.cc:304] T 22affa70596649658254e443bccdb7e2 P b2005221a1af4e559e0cb1cf28636c84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72b654ed19904db48b0a8e50fe4e12c7, b2005221a1af4e559e0cb1cf28636c84; no voters: 
I20260709 12:28:43.741750 19829 raft_consensus.cc:2468] T 66f3ed0a695841ce959ef857c4741496 P b2005221a1af4e559e0cb1cf28636c84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72b654ed19904db48b0a8e50fe4e12c7 in term 1.
I20260709 12:28:43.743623 19950 tablet_bootstrap.cc:492] T 7ae5eb89de7c49b5a4e4813747c2764a P 8dfbf314f9eb4599aa1f64e0098053f2: No bootstrap required, opened a new log
I20260709 12:28:43.744464 19950 ts_tablet_manager.cc:1403] T 7ae5eb89de7c49b5a4e4813747c2764a P 8dfbf314f9eb4599aa1f64e0098053f2: Time spent bootstrapping tablet: real 0.123s	user 0.023s	sys 0.003s
I20260709 12:28:43.751878 19949 tablet_bootstrap.cc:654] T 3545d7ed467b44c3b9be7f1c8d642c6c P 72b654ed19904db48b0a8e50fe4e12c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:43.754175 19954 raft_consensus.cc:515] T 8d17b409914c4c139fb5a5e4fbcbd54a P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:43.757704 19831 raft_consensus.cc:2468] T 0f3c299838c041199cb1ebb8978304f9 P b2005221a1af4e559e0cb1cf28636c84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dfbf314f9eb4599aa1f64e0098053f2 in term 1.
I20260709 12:28:43.738689 19719 leader_election.cc:304] T 3545d7ed467b44c3b9be7f1c8d642c6c P 8dfbf314f9eb4599aa1f64e0098053f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dfbf314f9eb4599aa1f64e0098053f2, b2005221a1af4e559e0cb1cf28636c84; no voters: 72b654ed19904db48b0a8e50fe4e12c7
I20260709 12:28:43.763924 19968 raft_consensus.cc:2804] T 3545d7ed467b44c3b9be7f1c8d642c6c P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:43.764497 19968 raft_consensus.cc:697] T 3545d7ed467b44c3b9be7f1c8d642c6c P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 LEADER]: Becoming Leader. State: Replica: 8dfbf314f9eb4599aa1f64e0098053f2, State: Running, Role: LEADER
I20260709 12:28:43.765422 19968 consensus_queue.cc:237] T 3545d7ed467b44c3b9be7f1c8d642c6c P 8dfbf314f9eb4599aa1f64e0098053f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:43.773612 19905 raft_consensus.cc:2468] T 0f3c299838c041199cb1ebb8978304f9 P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dfbf314f9eb4599aa1f64e0098053f2 in term 1.
I20260709 12:28:43.740404 19984 raft_consensus.cc:515] T 22affa70596649658254e443bccdb7e2 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } } peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } }
I20260709 12:28:43.776859 19755 raft_consensus.cc:2393] T 22affa70596649658254e443bccdb7e2 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2005221a1af4e559e0cb1cf28636c84 in current term 1: Already voted for candidate 8dfbf314f9eb4599aa1f64e0098053f2 in this term.
I20260709 12:28:43.780928 19984 leader_election.cc:290] T 22affa70596649658254e443bccdb7e2 P 8dfbf314f9eb4599aa1f64e0098053f2 [CANDIDATE]: Term 1 election: Requested vote from peers 72b654ed19904db48b0a8e50fe4e12c7 (127.9.116.67:34699), b2005221a1af4e559e0cb1cf28636c84 (127.9.116.66:42783)
I20260709 12:28:43.783546 19906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22affa70596649658254e443bccdb7e2" candidate_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72b654ed19904db48b0a8e50fe4e12c7"
I20260709 12:28:43.783959 19719 leader_election.cc:304] T 0f3c299838c041199cb1ebb8978304f9 P 8dfbf314f9eb4599aa1f64e0098053f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72b654ed19904db48b0a8e50fe4e12c7, 8dfbf314f9eb4599aa1f64e0098053f2; no voters: 
I20260709 12:28:43.784662 19906 raft_consensus.cc:3060] T 22affa70596649658254e443bccdb7e2 P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:43.789832 19954 leader_election.cc:290] T 8d17b409914c4c139fb5a5e4fbcbd54a P 8dfbf314f9eb4599aa1f64e0098053f2 [CANDIDATE]: Term 1 election: Requested vote from peers b2005221a1af4e559e0cb1cf28636c84 (127.9.116.66:42783), 72b654ed19904db48b0a8e50fe4e12c7 (127.9.116.67:34699)
I20260709 12:28:43.787644 19984 raft_consensus.cc:2804] T 0f3c299838c041199cb1ebb8978304f9 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:28:43.800786 19794 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.116.67:34699, user_credentials={real_user=slave}} blocked reactor thread for 62218.9us
I20260709 12:28:43.806913 19905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d17b409914c4c139fb5a5e4fbcbd54a" candidate_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72b654ed19904db48b0a8e50fe4e12c7"
I20260709 12:28:43.803242 19654 catalog_manager.cc:5697] T 66f3ed0a695841ce959ef857c4741496 P 72b654ed19904db48b0a8e50fe4e12c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72b654ed19904db48b0a8e50fe4e12c7 (127.9.116.67). New cstate: current_term: 1 leader_uuid: "72b654ed19904db48b0a8e50fe4e12c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } health_report { overall_health: HEALTHY } } }
W20260709 12:28:43.809271 19719 leader_election.cc:343] T 8d17b409914c4c139fb5a5e4fbcbd54a P 8dfbf314f9eb4599aa1f64e0098053f2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 72b654ed19904db48b0a8e50fe4e12c7 (127.9.116.67:34699): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:43.809748 19951 tablet_bootstrap.cc:492] T a47b4bf847674ea286f15a089566d812 P b2005221a1af4e559e0cb1cf28636c84: No bootstrap required, opened a new log
I20260709 12:28:43.810293 19951 ts_tablet_manager.cc:1403] T a47b4bf847674ea286f15a089566d812 P b2005221a1af4e559e0cb1cf28636c84: Time spent bootstrapping tablet: real 0.202s	user 0.027s	sys 0.024s
I20260709 12:28:43.812075 19950 raft_consensus.cc:359] T 7ae5eb89de7c49b5a4e4813747c2764a P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:43.813004 19950 raft_consensus.cc:385] T 7ae5eb89de7c49b5a4e4813747c2764a P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:43.813133 19906 raft_consensus.cc:2468] T 22affa70596649658254e443bccdb7e2 P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dfbf314f9eb4599aa1f64e0098053f2 in term 1.
I20260709 12:28:43.814169 19991 raft_consensus.cc:2804] T 22affa70596649658254e443bccdb7e2 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:43.814729 19991 raft_consensus.cc:493] T 22affa70596649658254e443bccdb7e2 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:43.815127 19991 raft_consensus.cc:3060] T 22affa70596649658254e443bccdb7e2 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:43.813295 19950 raft_consensus.cc:740] T 7ae5eb89de7c49b5a4e4813747c2764a P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dfbf314f9eb4599aa1f64e0098053f2, State: Initialized, Role: FOLLOWER
I20260709 12:28:43.805593 19984 raft_consensus.cc:697] T 0f3c299838c041199cb1ebb8978304f9 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 LEADER]: Becoming Leader. State: Replica: 8dfbf314f9eb4599aa1f64e0098053f2, State: Running, Role: LEADER
I20260709 12:28:43.804617 19961 raft_consensus.cc:515] T 3aeae4fb47e646d09bdeb06f2d3ee837 P b2005221a1af4e559e0cb1cf28636c84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:43.814977 19652 catalog_manager.cc:5697] T 3545d7ed467b44c3b9be7f1c8d642c6c P 8dfbf314f9eb4599aa1f64e0098053f2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65). New cstate: current_term: 1 leader_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:43.819110 19950 consensus_queue.cc:260] T 7ae5eb89de7c49b5a4e4813747c2764a P 8dfbf314f9eb4599aa1f64e0098053f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:43.821666 19755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aeae4fb47e646d09bdeb06f2d3ee837" candidate_uuid: "b2005221a1af4e559e0cb1cf28636c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dfbf314f9eb4599aa1f64e0098053f2"
I20260709 12:28:43.822234 19950 ts_tablet_manager.cc:1434] T 7ae5eb89de7c49b5a4e4813747c2764a P 8dfbf314f9eb4599aa1f64e0098053f2: Time spent starting tablet: real 0.077s	user 0.009s	sys 0.000s
I20260709 12:28:43.822412 19755 raft_consensus.cc:3060] T 3aeae4fb47e646d09bdeb06f2d3ee837 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:43.828334 19984 consensus_queue.cc:237] T 0f3c299838c041199cb1ebb8978304f9 P 8dfbf314f9eb4599aa1f64e0098053f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:43.822463 19719 leader_election.cc:304] T 22affa70596649658254e443bccdb7e2 P 8dfbf314f9eb4599aa1f64e0098053f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72b654ed19904db48b0a8e50fe4e12c7, 8dfbf314f9eb4599aa1f64e0098053f2; no voters: 
I20260709 12:28:43.832223 19968 raft_consensus.cc:2804] T 22affa70596649658254e443bccdb7e2 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:43.832837 19968 raft_consensus.cc:697] T 22affa70596649658254e443bccdb7e2 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 LEADER]: Becoming Leader. State: Replica: 8dfbf314f9eb4599aa1f64e0098053f2, State: Running, Role: LEADER
I20260709 12:28:43.833591 19991 raft_consensus.cc:515] T 22affa70596649658254e443bccdb7e2 P b2005221a1af4e559e0cb1cf28636c84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } } peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } }
I20260709 12:28:43.833828 19968 consensus_queue.cc:237] T 22affa70596649658254e443bccdb7e2 P 8dfbf314f9eb4599aa1f64e0098053f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } } peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } }
I20260709 12:28:43.838419 19991 leader_election.cc:290] T 22affa70596649658254e443bccdb7e2 P b2005221a1af4e559e0cb1cf28636c84 [CANDIDATE]: Term 1 election: Requested vote from peers 72b654ed19904db48b0a8e50fe4e12c7 (127.9.116.67:34699), 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65:38251)
I20260709 12:28:43.838786 19756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22affa70596649658254e443bccdb7e2" candidate_uuid: "b2005221a1af4e559e0cb1cf28636c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dfbf314f9eb4599aa1f64e0098053f2"
I20260709 12:28:43.839279 19991 raft_consensus.cc:493] T ed4996cfc4a0429fae414b2c8e341c0d P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:43.840004 19991 raft_consensus.cc:515] T ed4996cfc4a0429fae414b2c8e341c0d P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:43.826797 19951 raft_consensus.cc:359] T a47b4bf847674ea286f15a089566d812 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:43.841482 19951 raft_consensus.cc:385] T a47b4bf847674ea286f15a089566d812 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:43.841827 19961 leader_election.cc:290] T 3aeae4fb47e646d09bdeb06f2d3ee837 P b2005221a1af4e559e0cb1cf28636c84 [CANDIDATE]: Term 1 election: Requested vote from peers 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65:38251), 72b654ed19904db48b0a8e50fe4e12c7 (127.9.116.67:34699)
I20260709 12:28:43.841840 19951 raft_consensus.cc:740] T a47b4bf847674ea286f15a089566d812 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2005221a1af4e559e0cb1cf28636c84, State: Initialized, Role: FOLLOWER
I20260709 12:28:43.844506 19756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4996cfc4a0429fae414b2c8e341c0d" candidate_uuid: "b2005221a1af4e559e0cb1cf28636c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" is_pre_election: true
I20260709 12:28:43.845295 19756 raft_consensus.cc:2468] T ed4996cfc4a0429fae414b2c8e341c0d P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2005221a1af4e559e0cb1cf28636c84 in term 0.
I20260709 12:28:43.845744 19755 raft_consensus.cc:2468] T 3aeae4fb47e646d09bdeb06f2d3ee837 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2005221a1af4e559e0cb1cf28636c84 in term 1.
I20260709 12:28:43.845629 19949 tablet_bootstrap.cc:492] T 3545d7ed467b44c3b9be7f1c8d642c6c P 72b654ed19904db48b0a8e50fe4e12c7: No bootstrap required, opened a new log
I20260709 12:28:43.847149 19949 ts_tablet_manager.cc:1403] T 3545d7ed467b44c3b9be7f1c8d642c6c P 72b654ed19904db48b0a8e50fe4e12c7: Time spent bootstrapping tablet: real 0.118s	user 0.015s	sys 0.012s
I20260709 12:28:43.846967 19795 leader_election.cc:304] T ed4996cfc4a0429fae414b2c8e341c0d P b2005221a1af4e559e0cb1cf28636c84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dfbf314f9eb4599aa1f64e0098053f2, b2005221a1af4e559e0cb1cf28636c84; no voters: 
I20260709 12:28:43.848690 19961 raft_consensus.cc:2804] T ed4996cfc4a0429fae414b2c8e341c0d P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:43.849273 19961 raft_consensus.cc:493] T ed4996cfc4a0429fae414b2c8e341c0d P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:43.849844 19961 raft_consensus.cc:3060] T ed4996cfc4a0429fae414b2c8e341c0d P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:43.847441 19991 leader_election.cc:290] T ed4996cfc4a0429fae414b2c8e341c0d P b2005221a1af4e559e0cb1cf28636c84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65:38251), 72b654ed19904db48b0a8e50fe4e12c7 (127.9.116.67:34699)
I20260709 12:28:43.853312 19795 leader_election.cc:304] T 3aeae4fb47e646d09bdeb06f2d3ee837 P b2005221a1af4e559e0cb1cf28636c84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dfbf314f9eb4599aa1f64e0098053f2, b2005221a1af4e559e0cb1cf28636c84; no voters: 
I20260709 12:28:43.855333 19951 consensus_queue.cc:260] T a47b4bf847674ea286f15a089566d812 P b2005221a1af4e559e0cb1cf28636c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:43.856856 19831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22affa70596649658254e443bccdb7e2" candidate_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2005221a1af4e559e0cb1cf28636c84"
I20260709 12:28:43.858328 19951 ts_tablet_manager.cc:1434] T a47b4bf847674ea286f15a089566d812 P b2005221a1af4e559e0cb1cf28636c84: Time spent starting tablet: real 0.048s	user 0.011s	sys 0.000s
I20260709 12:28:43.860050 19951 tablet_bootstrap.cc:492] T 7ae5eb89de7c49b5a4e4813747c2764a P b2005221a1af4e559e0cb1cf28636c84: Bootstrap starting.
I20260709 12:28:43.857064 19829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d17b409914c4c139fb5a5e4fbcbd54a" candidate_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2005221a1af4e559e0cb1cf28636c84"
I20260709 12:28:43.854609 19991 raft_consensus.cc:2804] T 3aeae4fb47e646d09bdeb06f2d3ee837 P b2005221a1af4e559e0cb1cf28636c84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:43.869531 19831 raft_consensus.cc:2393] T 22affa70596649658254e443bccdb7e2 P b2005221a1af4e559e0cb1cf28636c84 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dfbf314f9eb4599aa1f64e0098053f2 in current term 1: Already voted for candidate b2005221a1af4e559e0cb1cf28636c84 in this term.
I20260709 12:28:43.869812 19906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22affa70596649658254e443bccdb7e2" candidate_uuid: "b2005221a1af4e559e0cb1cf28636c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72b654ed19904db48b0a8e50fe4e12c7"
I20260709 12:28:43.870616 19906 raft_consensus.cc:2393] T 22affa70596649658254e443bccdb7e2 P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b2005221a1af4e559e0cb1cf28636c84 in current term 1: Already voted for candidate 8dfbf314f9eb4599aa1f64e0098053f2 in this term.
I20260709 12:28:43.870803 19990 raft_consensus.cc:493] T a47b4bf847674ea286f15a089566d812 P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:43.871238 19990 raft_consensus.cc:515] T a47b4bf847674ea286f15a089566d812 P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:43.872356 19949 raft_consensus.cc:359] T 3545d7ed467b44c3b9be7f1c8d642c6c P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:43.873147 19949 raft_consensus.cc:385] T 3545d7ed467b44c3b9be7f1c8d642c6c P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:43.873368 19990 leader_election.cc:290] T a47b4bf847674ea286f15a089566d812 P 72b654ed19904db48b0a8e50fe4e12c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65:38251), b2005221a1af4e559e0cb1cf28636c84 (127.9.116.66:42783)
I20260709 12:28:43.873476 19949 raft_consensus.cc:740] T 3545d7ed467b44c3b9be7f1c8d642c6c P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72b654ed19904db48b0a8e50fe4e12c7, State: Initialized, Role: FOLLOWER
I20260709 12:28:43.864953 19829 raft_consensus.cc:3060] T 8d17b409914c4c139fb5a5e4fbcbd54a P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:43.874364 19949 consensus_queue.cc:260] T 3545d7ed467b44c3b9be7f1c8d642c6c P 72b654ed19904db48b0a8e50fe4e12c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:43.876799 19831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47b4bf847674ea286f15a089566d812" candidate_uuid: "72b654ed19904db48b0a8e50fe4e12c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2005221a1af4e559e0cb1cf28636c84" is_pre_election: true
I20260709 12:28:43.877506 19831 raft_consensus.cc:2468] T a47b4bf847674ea286f15a089566d812 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72b654ed19904db48b0a8e50fe4e12c7 in term 0.
I20260709 12:28:43.879307 19869 leader_election.cc:304] T a47b4bf847674ea286f15a089566d812 P 72b654ed19904db48b0a8e50fe4e12c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72b654ed19904db48b0a8e50fe4e12c7, b2005221a1af4e559e0cb1cf28636c84; no voters: 
I20260709 12:28:43.880434 19990 raft_consensus.cc:2804] T a47b4bf847674ea286f15a089566d812 P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:43.880801 19990 raft_consensus.cc:493] T a47b4bf847674ea286f15a089566d812 P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:43.881130 19990 raft_consensus.cc:3060] T a47b4bf847674ea286f15a089566d812 P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:43.881958 19905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4996cfc4a0429fae414b2c8e341c0d" candidate_uuid: "b2005221a1af4e559e0cb1cf28636c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72b654ed19904db48b0a8e50fe4e12c7" is_pre_election: true
I20260709 12:28:43.882709 19905 raft_consensus.cc:2468] T ed4996cfc4a0429fae414b2c8e341c0d P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2005221a1af4e559e0cb1cf28636c84 in term 0.
I20260709 12:28:43.884086 19755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47b4bf847674ea286f15a089566d812" candidate_uuid: "72b654ed19904db48b0a8e50fe4e12c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" is_pre_election: true
I20260709 12:28:43.884826 19755 raft_consensus.cc:2468] T a47b4bf847674ea286f15a089566d812 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72b654ed19904db48b0a8e50fe4e12c7 in term 0.
I20260709 12:28:43.885241 19951 tablet_bootstrap.cc:654] T 7ae5eb89de7c49b5a4e4813747c2764a P b2005221a1af4e559e0cb1cf28636c84: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:43.886294 19906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aeae4fb47e646d09bdeb06f2d3ee837" candidate_uuid: "b2005221a1af4e559e0cb1cf28636c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72b654ed19904db48b0a8e50fe4e12c7"
I20260709 12:28:43.887926 19949 ts_tablet_manager.cc:1434] T 3545d7ed467b44c3b9be7f1c8d642c6c P 72b654ed19904db48b0a8e50fe4e12c7: Time spent starting tablet: real 0.040s	user 0.009s	sys 0.000s
I20260709 12:28:43.889528 19949 tablet_bootstrap.cc:492] T 8d17b409914c4c139fb5a5e4fbcbd54a P 72b654ed19904db48b0a8e50fe4e12c7: Bootstrap starting.
I20260709 12:28:43.875936 19991 raft_consensus.cc:697] T 3aeae4fb47e646d09bdeb06f2d3ee837 P b2005221a1af4e559e0cb1cf28636c84 [term 1 LEADER]: Becoming Leader. State: Replica: b2005221a1af4e559e0cb1cf28636c84, State: Running, Role: LEADER
I20260709 12:28:43.891939 19990 raft_consensus.cc:515] T a47b4bf847674ea286f15a089566d812 P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:43.892879 19991 consensus_queue.cc:237] T 3aeae4fb47e646d09bdeb06f2d3ee837 P b2005221a1af4e559e0cb1cf28636c84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:43.891417 19829 raft_consensus.cc:2468] T 8d17b409914c4c139fb5a5e4fbcbd54a P b2005221a1af4e559e0cb1cf28636c84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dfbf314f9eb4599aa1f64e0098053f2 in term 1.
I20260709 12:28:43.877909 19794 leader_election.cc:304] T 22affa70596649658254e443bccdb7e2 P b2005221a1af4e559e0cb1cf28636c84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2005221a1af4e559e0cb1cf28636c84; no voters: 72b654ed19904db48b0a8e50fe4e12c7, 8dfbf314f9eb4599aa1f64e0098053f2
I20260709 12:28:43.895251 19961 raft_consensus.cc:515] T ed4996cfc4a0429fae414b2c8e341c0d P b2005221a1af4e559e0cb1cf28636c84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:43.896082 19755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47b4bf847674ea286f15a089566d812" candidate_uuid: "72b654ed19904db48b0a8e50fe4e12c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dfbf314f9eb4599aa1f64e0098053f2"
I20260709 12:28:43.896756 19755 raft_consensus.cc:3060] T a47b4bf847674ea286f15a089566d812 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:43.896663 19996 raft_consensus.cc:2749] T 22affa70596649658254e443bccdb7e2 P b2005221a1af4e559e0cb1cf28636c84 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:28:43.900882 19719 leader_election.cc:304] T 8d17b409914c4c139fb5a5e4fbcbd54a P 8dfbf314f9eb4599aa1f64e0098053f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dfbf314f9eb4599aa1f64e0098053f2, b2005221a1af4e559e0cb1cf28636c84; no voters: 72b654ed19904db48b0a8e50fe4e12c7
I20260709 12:28:43.902180 19968 raft_consensus.cc:2804] T 8d17b409914c4c139fb5a5e4fbcbd54a P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:43.902235 19961 leader_election.cc:290] T ed4996cfc4a0429fae414b2c8e341c0d P b2005221a1af4e559e0cb1cf28636c84 [CANDIDATE]: Term 1 election: Requested vote from peers 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65:38251), 72b654ed19904db48b0a8e50fe4e12c7 (127.9.116.67:34699)
I20260709 12:28:43.902740 19968 raft_consensus.cc:697] T 8d17b409914c4c139fb5a5e4fbcbd54a P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 LEADER]: Becoming Leader. State: Replica: 8dfbf314f9eb4599aa1f64e0098053f2, State: Running, Role: LEADER
I20260709 12:28:43.903810 19968 consensus_queue.cc:237] T 8d17b409914c4c139fb5a5e4fbcbd54a P 8dfbf314f9eb4599aa1f64e0098053f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:43.904426 19829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47b4bf847674ea286f15a089566d812" candidate_uuid: "72b654ed19904db48b0a8e50fe4e12c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2005221a1af4e559e0cb1cf28636c84"
I20260709 12:28:43.905078 19829 raft_consensus.cc:3060] T a47b4bf847674ea286f15a089566d812 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:43.907127 19949 tablet_bootstrap.cc:654] T 8d17b409914c4c139fb5a5e4fbcbd54a P 72b654ed19904db48b0a8e50fe4e12c7: Neither blocks nor log segments found. Creating new log.
W20260709 12:28:43.902762 19794 leader_election.cc:343] T 3aeae4fb47e646d09bdeb06f2d3ee837 P b2005221a1af4e559e0cb1cf28636c84 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 72b654ed19904db48b0a8e50fe4e12c7 (127.9.116.67:34699): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:43.908295 19756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4996cfc4a0429fae414b2c8e341c0d" candidate_uuid: "b2005221a1af4e559e0cb1cf28636c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dfbf314f9eb4599aa1f64e0098053f2"
I20260709 12:28:43.908965 19756 raft_consensus.cc:3060] T ed4996cfc4a0429fae414b2c8e341c0d P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:43.910337 19906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed4996cfc4a0429fae414b2c8e341c0d" candidate_uuid: "b2005221a1af4e559e0cb1cf28636c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72b654ed19904db48b0a8e50fe4e12c7"
I20260709 12:28:43.911005 19906 raft_consensus.cc:3060] T ed4996cfc4a0429fae414b2c8e341c0d P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:43.921301 19951 tablet_bootstrap.cc:492] T 7ae5eb89de7c49b5a4e4813747c2764a P b2005221a1af4e559e0cb1cf28636c84: No bootstrap required, opened a new log
I20260709 12:28:43.922125 19951 ts_tablet_manager.cc:1403] T 7ae5eb89de7c49b5a4e4813747c2764a P b2005221a1af4e559e0cb1cf28636c84: Time spent bootstrapping tablet: real 0.062s	user 0.026s	sys 0.000s
I20260709 12:28:43.907469 19990 leader_election.cc:290] T a47b4bf847674ea286f15a089566d812 P 72b654ed19904db48b0a8e50fe4e12c7 [CANDIDATE]: Term 1 election: Requested vote from peers 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65:38251), b2005221a1af4e559e0cb1cf28636c84 (127.9.116.66:42783)
I20260709 12:28:43.929422 19906 raft_consensus.cc:2468] T ed4996cfc4a0429fae414b2c8e341c0d P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2005221a1af4e559e0cb1cf28636c84 in term 1.
I20260709 12:28:43.931195 19794 leader_election.cc:304] T ed4996cfc4a0429fae414b2c8e341c0d P b2005221a1af4e559e0cb1cf28636c84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72b654ed19904db48b0a8e50fe4e12c7, b2005221a1af4e559e0cb1cf28636c84; no voters: 
I20260709 12:28:43.932303 19961 raft_consensus.cc:2804] T ed4996cfc4a0429fae414b2c8e341c0d P b2005221a1af4e559e0cb1cf28636c84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:43.932902 19961 raft_consensus.cc:697] T ed4996cfc4a0429fae414b2c8e341c0d P b2005221a1af4e559e0cb1cf28636c84 [term 1 LEADER]: Becoming Leader. State: Replica: b2005221a1af4e559e0cb1cf28636c84, State: Running, Role: LEADER
I20260709 12:28:43.934013 19961 consensus_queue.cc:237] T ed4996cfc4a0429fae414b2c8e341c0d P b2005221a1af4e559e0cb1cf28636c84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:43.937414 19951 raft_consensus.cc:359] T 7ae5eb89de7c49b5a4e4813747c2764a P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:43.938490 19951 raft_consensus.cc:385] T 7ae5eb89de7c49b5a4e4813747c2764a P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:43.945940 19755 raft_consensus.cc:2468] T a47b4bf847674ea286f15a089566d812 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72b654ed19904db48b0a8e50fe4e12c7 in term 1.
I20260709 12:28:43.947845 19870 leader_election.cc:304] T a47b4bf847674ea286f15a089566d812 P 72b654ed19904db48b0a8e50fe4e12c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72b654ed19904db48b0a8e50fe4e12c7, 8dfbf314f9eb4599aa1f64e0098053f2; no voters: 
I20260709 12:28:43.948753 19990 raft_consensus.cc:2804] T a47b4bf847674ea286f15a089566d812 P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:43.949491 19990 raft_consensus.cc:697] T a47b4bf847674ea286f15a089566d812 P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 LEADER]: Becoming Leader. State: Replica: 72b654ed19904db48b0a8e50fe4e12c7, State: Running, Role: LEADER
I20260709 12:28:43.950700 19990 consensus_queue.cc:237] T a47b4bf847674ea286f15a089566d812 P 72b654ed19904db48b0a8e50fe4e12c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:43.956255 19756 raft_consensus.cc:2468] T ed4996cfc4a0429fae414b2c8e341c0d P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2005221a1af4e559e0cb1cf28636c84 in term 1.
I20260709 12:28:43.933073 19829 raft_consensus.cc:2468] T a47b4bf847674ea286f15a089566d812 P b2005221a1af4e559e0cb1cf28636c84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72b654ed19904db48b0a8e50fe4e12c7 in term 1.
I20260709 12:28:43.938844 19951 raft_consensus.cc:740] T 7ae5eb89de7c49b5a4e4813747c2764a P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2005221a1af4e559e0cb1cf28636c84, State: Initialized, Role: FOLLOWER
I20260709 12:28:43.960312 19951 consensus_queue.cc:260] T 7ae5eb89de7c49b5a4e4813747c2764a P b2005221a1af4e559e0cb1cf28636c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:43.962545 19951 ts_tablet_manager.cc:1434] T 7ae5eb89de7c49b5a4e4813747c2764a P b2005221a1af4e559e0cb1cf28636c84: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.000s
I20260709 12:28:43.965817 19651 catalog_manager.cc:5697] T 3aeae4fb47e646d09bdeb06f2d3ee837 P b2005221a1af4e559e0cb1cf28636c84 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2005221a1af4e559e0cb1cf28636c84 (127.9.116.66). New cstate: current_term: 1 leader_uuid: "b2005221a1af4e559e0cb1cf28636c84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:43.966116 19949 tablet_bootstrap.cc:492] T 8d17b409914c4c139fb5a5e4fbcbd54a P 72b654ed19904db48b0a8e50fe4e12c7: No bootstrap required, opened a new log
I20260709 12:28:43.971025 19949 ts_tablet_manager.cc:1403] T 8d17b409914c4c139fb5a5e4fbcbd54a P 72b654ed19904db48b0a8e50fe4e12c7: Time spent bootstrapping tablet: real 0.082s	user 0.031s	sys 0.013s
I20260709 12:28:43.973546 19652 catalog_manager.cc:5697] T a47b4bf847674ea286f15a089566d812 P 72b654ed19904db48b0a8e50fe4e12c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72b654ed19904db48b0a8e50fe4e12c7 (127.9.116.67). New cstate: current_term: 1 leader_uuid: "72b654ed19904db48b0a8e50fe4e12c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:43.977316 19949 raft_consensus.cc:359] T 8d17b409914c4c139fb5a5e4fbcbd54a P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:43.978147 19949 raft_consensus.cc:385] T 8d17b409914c4c139fb5a5e4fbcbd54a P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:43.978434 19949 raft_consensus.cc:740] T 8d17b409914c4c139fb5a5e4fbcbd54a P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72b654ed19904db48b0a8e50fe4e12c7, State: Initialized, Role: FOLLOWER
I20260709 12:28:43.979242 19949 consensus_queue.cc:260] T 8d17b409914c4c139fb5a5e4fbcbd54a P 72b654ed19904db48b0a8e50fe4e12c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:43.981746 19949 ts_tablet_manager.cc:1434] T 8d17b409914c4c139fb5a5e4fbcbd54a P 72b654ed19904db48b0a8e50fe4e12c7: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:28:43.982965 19949 tablet_bootstrap.cc:492] T 3aeae4fb47e646d09bdeb06f2d3ee837 P 72b654ed19904db48b0a8e50fe4e12c7: Bootstrap starting.
I20260709 12:28:43.989910 19949 tablet_bootstrap.cc:654] T 3aeae4fb47e646d09bdeb06f2d3ee837 P 72b654ed19904db48b0a8e50fe4e12c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:43.989007 19654 catalog_manager.cc:5697] T 0f3c299838c041199cb1ebb8978304f9 P 8dfbf314f9eb4599aa1f64e0098053f2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65). New cstate: current_term: 1 leader_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:43.992274 19654 catalog_manager.cc:5697] T 22affa70596649658254e443bccdb7e2 P 8dfbf314f9eb4599aa1f64e0098053f2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65). New cstate: current_term: 1 leader_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:43.994638 19654 catalog_manager.cc:5697] T 8d17b409914c4c139fb5a5e4fbcbd54a P 8dfbf314f9eb4599aa1f64e0098053f2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65). New cstate: current_term: 1 leader_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:43.995523 19949 tablet_bootstrap.cc:492] T 3aeae4fb47e646d09bdeb06f2d3ee837 P 72b654ed19904db48b0a8e50fe4e12c7: No bootstrap required, opened a new log
I20260709 12:28:43.996129 19949 ts_tablet_manager.cc:1403] T 3aeae4fb47e646d09bdeb06f2d3ee837 P 72b654ed19904db48b0a8e50fe4e12c7: Time spent bootstrapping tablet: real 0.013s	user 0.012s	sys 0.000s
I20260709 12:28:43.998971 19949 raft_consensus.cc:359] T 3aeae4fb47e646d09bdeb06f2d3ee837 P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:43.999469 19949 raft_consensus.cc:385] T 3aeae4fb47e646d09bdeb06f2d3ee837 P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:43.999764 19949 raft_consensus.cc:740] T 3aeae4fb47e646d09bdeb06f2d3ee837 P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72b654ed19904db48b0a8e50fe4e12c7, State: Initialized, Role: FOLLOWER
I20260709 12:28:44.000356 19949 consensus_queue.cc:260] T 3aeae4fb47e646d09bdeb06f2d3ee837 P 72b654ed19904db48b0a8e50fe4e12c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:44.002036 19949 ts_tablet_manager.cc:1434] T 3aeae4fb47e646d09bdeb06f2d3ee837 P 72b654ed19904db48b0a8e50fe4e12c7: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:28:44.008183 19651 catalog_manager.cc:5697] T ed4996cfc4a0429fae414b2c8e341c0d P b2005221a1af4e559e0cb1cf28636c84 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2005221a1af4e559e0cb1cf28636c84 (127.9.116.66). New cstate: current_term: 1 leader_uuid: "b2005221a1af4e559e0cb1cf28636c84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:44.011772 19990 raft_consensus.cc:493] T 3aeae4fb47e646d09bdeb06f2d3ee837 P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:44.012316 19990 raft_consensus.cc:515] T 3aeae4fb47e646d09bdeb06f2d3ee837 P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:44.014480 19990 leader_election.cc:290] T 3aeae4fb47e646d09bdeb06f2d3ee837 P 72b654ed19904db48b0a8e50fe4e12c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65:38251), b2005221a1af4e559e0cb1cf28636c84 (127.9.116.66:42783)
I20260709 12:28:44.015522 19756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aeae4fb47e646d09bdeb06f2d3ee837" candidate_uuid: "72b654ed19904db48b0a8e50fe4e12c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" is_pre_election: true
I20260709 12:28:44.016511 19756 raft_consensus.cc:2393] T 3aeae4fb47e646d09bdeb06f2d3ee837 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72b654ed19904db48b0a8e50fe4e12c7 in current term 1: Already voted for candidate b2005221a1af4e559e0cb1cf28636c84 in this term.
I20260709 12:28:44.017611 19829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aeae4fb47e646d09bdeb06f2d3ee837" candidate_uuid: "72b654ed19904db48b0a8e50fe4e12c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2005221a1af4e559e0cb1cf28636c84" is_pre_election: true
I20260709 12:28:44.019510 19869 leader_election.cc:304] T 3aeae4fb47e646d09bdeb06f2d3ee837 P 72b654ed19904db48b0a8e50fe4e12c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72b654ed19904db48b0a8e50fe4e12c7; no voters: 8dfbf314f9eb4599aa1f64e0098053f2, b2005221a1af4e559e0cb1cf28636c84
I20260709 12:28:44.020610 19990 raft_consensus.cc:3060] T 3aeae4fb47e646d09bdeb06f2d3ee837 P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:44.023094 19985 raft_consensus.cc:493] T 3545d7ed467b44c3b9be7f1c8d642c6c P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:44.023710 19985 raft_consensus.cc:515] T 3545d7ed467b44c3b9be7f1c8d642c6c P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:44.025565 19985 leader_election.cc:290] T 3545d7ed467b44c3b9be7f1c8d642c6c P 72b654ed19904db48b0a8e50fe4e12c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65:38251), b2005221a1af4e559e0cb1cf28636c84 (127.9.116.66:42783)
I20260709 12:28:44.027060 19756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3545d7ed467b44c3b9be7f1c8d642c6c" candidate_uuid: "72b654ed19904db48b0a8e50fe4e12c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" is_pre_election: true
I20260709 12:28:44.027014 19829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3545d7ed467b44c3b9be7f1c8d642c6c" candidate_uuid: "72b654ed19904db48b0a8e50fe4e12c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2005221a1af4e559e0cb1cf28636c84" is_pre_election: true
I20260709 12:28:44.028658 19829 raft_consensus.cc:2393] T 3545d7ed467b44c3b9be7f1c8d642c6c P b2005221a1af4e559e0cb1cf28636c84 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72b654ed19904db48b0a8e50fe4e12c7 in current term 1: Already voted for candidate 8dfbf314f9eb4599aa1f64e0098053f2 in this term.
I20260709 12:28:44.029333 19990 raft_consensus.cc:2749] T 3aeae4fb47e646d09bdeb06f2d3ee837 P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:44.030186 19869 leader_election.cc:304] T 3545d7ed467b44c3b9be7f1c8d642c6c P 72b654ed19904db48b0a8e50fe4e12c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72b654ed19904db48b0a8e50fe4e12c7; no voters: 8dfbf314f9eb4599aa1f64e0098053f2, b2005221a1af4e559e0cb1cf28636c84
I20260709 12:28:44.031211 19990 raft_consensus.cc:3060] T 3545d7ed467b44c3b9be7f1c8d642c6c P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:44.038270 19990 raft_consensus.cc:2749] T 3545d7ed467b44c3b9be7f1c8d642c6c P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:44.074606 19990 raft_consensus.cc:493] T 8d17b409914c4c139fb5a5e4fbcbd54a P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:44.075109 19990 raft_consensus.cc:515] T 8d17b409914c4c139fb5a5e4fbcbd54a P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:44.078013 19990 leader_election.cc:290] T 8d17b409914c4c139fb5a5e4fbcbd54a P 72b654ed19904db48b0a8e50fe4e12c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65:38251), b2005221a1af4e559e0cb1cf28636c84 (127.9.116.66:42783)
I20260709 12:28:44.078405 19756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d17b409914c4c139fb5a5e4fbcbd54a" candidate_uuid: "72b654ed19904db48b0a8e50fe4e12c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" is_pre_election: true
I20260709 12:28:44.078691 19829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d17b409914c4c139fb5a5e4fbcbd54a" candidate_uuid: "72b654ed19904db48b0a8e50fe4e12c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2005221a1af4e559e0cb1cf28636c84" is_pre_election: true
I20260709 12:28:44.079680 19829 raft_consensus.cc:2393] T 8d17b409914c4c139fb5a5e4fbcbd54a P b2005221a1af4e559e0cb1cf28636c84 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72b654ed19904db48b0a8e50fe4e12c7 in current term 1: Already voted for candidate 8dfbf314f9eb4599aa1f64e0098053f2 in this term.
I20260709 12:28:44.081106 19869 leader_election.cc:304] T 8d17b409914c4c139fb5a5e4fbcbd54a P 72b654ed19904db48b0a8e50fe4e12c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72b654ed19904db48b0a8e50fe4e12c7; no voters: 8dfbf314f9eb4599aa1f64e0098053f2, b2005221a1af4e559e0cb1cf28636c84
I20260709 12:28:44.082028 19990 raft_consensus.cc:3060] T 8d17b409914c4c139fb5a5e4fbcbd54a P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:44.088969 19990 raft_consensus.cc:2749] T 8d17b409914c4c139fb5a5e4fbcbd54a P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:44.184691 19961 raft_consensus.cc:493] T 7ae5eb89de7c49b5a4e4813747c2764a P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:44.185369 19961 raft_consensus.cc:515] T 7ae5eb89de7c49b5a4e4813747c2764a P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:44.187177 19961 leader_election.cc:290] T 7ae5eb89de7c49b5a4e4813747c2764a P b2005221a1af4e559e0cb1cf28636c84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65:38251), 72b654ed19904db48b0a8e50fe4e12c7 (127.9.116.67:34699)
I20260709 12:28:44.187309 19968 raft_consensus.cc:493] T 7ae5eb89de7c49b5a4e4813747c2764a P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:44.188197 19756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae5eb89de7c49b5a4e4813747c2764a" candidate_uuid: "b2005221a1af4e559e0cb1cf28636c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" is_pre_election: true
I20260709 12:28:44.187966 19968 raft_consensus.cc:515] T 7ae5eb89de7c49b5a4e4813747c2764a P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:44.188426 19906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae5eb89de7c49b5a4e4813747c2764a" candidate_uuid: "b2005221a1af4e559e0cb1cf28636c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72b654ed19904db48b0a8e50fe4e12c7" is_pre_election: true
I20260709 12:28:44.189023 19756 raft_consensus.cc:2468] T 7ae5eb89de7c49b5a4e4813747c2764a P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2005221a1af4e559e0cb1cf28636c84 in term 0.
I20260709 12:28:44.189196 19906 raft_consensus.cc:2468] T 7ae5eb89de7c49b5a4e4813747c2764a P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2005221a1af4e559e0cb1cf28636c84 in term 0.
I20260709 12:28:44.190371 19968 leader_election.cc:290] T 7ae5eb89de7c49b5a4e4813747c2764a P 8dfbf314f9eb4599aa1f64e0098053f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2005221a1af4e559e0cb1cf28636c84 (127.9.116.66:42783), 72b654ed19904db48b0a8e50fe4e12c7 (127.9.116.67:34699)
I20260709 12:28:44.190490 19794 leader_election.cc:304] T 7ae5eb89de7c49b5a4e4813747c2764a P b2005221a1af4e559e0cb1cf28636c84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72b654ed19904db48b0a8e50fe4e12c7, b2005221a1af4e559e0cb1cf28636c84; no voters: 
I20260709 12:28:44.191560 19961 raft_consensus.cc:2804] T 7ae5eb89de7c49b5a4e4813747c2764a P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:44.191694 19906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae5eb89de7c49b5a4e4813747c2764a" candidate_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72b654ed19904db48b0a8e50fe4e12c7" is_pre_election: true
I20260709 12:28:44.192247 19961 raft_consensus.cc:493] T 7ae5eb89de7c49b5a4e4813747c2764a P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:44.192387 19829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae5eb89de7c49b5a4e4813747c2764a" candidate_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2005221a1af4e559e0cb1cf28636c84" is_pre_election: true
I20260709 12:28:44.192847 19961 raft_consensus.cc:3060] T 7ae5eb89de7c49b5a4e4813747c2764a P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:44.192646 19906 raft_consensus.cc:2468] T 7ae5eb89de7c49b5a4e4813747c2764a P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dfbf314f9eb4599aa1f64e0098053f2 in term 0.
I20260709 12:28:44.194083 19719 leader_election.cc:304] T 7ae5eb89de7c49b5a4e4813747c2764a P 8dfbf314f9eb4599aa1f64e0098053f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72b654ed19904db48b0a8e50fe4e12c7, 8dfbf314f9eb4599aa1f64e0098053f2; no voters: 
I20260709 12:28:44.194895 19968 raft_consensus.cc:2804] T 7ae5eb89de7c49b5a4e4813747c2764a P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:44.195240 19968 raft_consensus.cc:493] T 7ae5eb89de7c49b5a4e4813747c2764a P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:44.195523 19968 raft_consensus.cc:3060] T 7ae5eb89de7c49b5a4e4813747c2764a P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:44.200620 19961 raft_consensus.cc:515] T 7ae5eb89de7c49b5a4e4813747c2764a P b2005221a1af4e559e0cb1cf28636c84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:44.202154 19829 raft_consensus.cc:2393] T 7ae5eb89de7c49b5a4e4813747c2764a P b2005221a1af4e559e0cb1cf28636c84 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dfbf314f9eb4599aa1f64e0098053f2 in current term 1: Already voted for candidate b2005221a1af4e559e0cb1cf28636c84 in this term.
I20260709 12:28:44.203212 19961 leader_election.cc:290] T 7ae5eb89de7c49b5a4e4813747c2764a P b2005221a1af4e559e0cb1cf28636c84 [CANDIDATE]: Term 1 election: Requested vote from peers 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65:38251), 72b654ed19904db48b0a8e50fe4e12c7 (127.9.116.67:34699)
I20260709 12:28:44.203739 19990 consensus_queue.cc:1048] T 66f3ed0a695841ce959ef857c4741496 P 72b654ed19904db48b0a8e50fe4e12c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:44.205493 19906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae5eb89de7c49b5a4e4813747c2764a" candidate_uuid: "b2005221a1af4e559e0cb1cf28636c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72b654ed19904db48b0a8e50fe4e12c7"
I20260709 12:28:44.205281 19968 raft_consensus.cc:515] T 7ae5eb89de7c49b5a4e4813747c2764a P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:44.206274 19906 raft_consensus.cc:3060] T 7ae5eb89de7c49b5a4e4813747c2764a P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:44.207006 19756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae5eb89de7c49b5a4e4813747c2764a" candidate_uuid: "b2005221a1af4e559e0cb1cf28636c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dfbf314f9eb4599aa1f64e0098053f2"
I20260709 12:28:44.207862 19756 raft_consensus.cc:2393] T 7ae5eb89de7c49b5a4e4813747c2764a P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b2005221a1af4e559e0cb1cf28636c84 in current term 1: Already voted for candidate 8dfbf314f9eb4599aa1f64e0098053f2 in this term.
I20260709 12:28:44.209334 19968 leader_election.cc:290] T 7ae5eb89de7c49b5a4e4813747c2764a P 8dfbf314f9eb4599aa1f64e0098053f2 [CANDIDATE]: Term 1 election: Requested vote from peers b2005221a1af4e559e0cb1cf28636c84 (127.9.116.66:42783), 72b654ed19904db48b0a8e50fe4e12c7 (127.9.116.67:34699)
I20260709 12:28:44.210455 19905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae5eb89de7c49b5a4e4813747c2764a" candidate_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72b654ed19904db48b0a8e50fe4e12c7"
I20260709 12:28:44.208832 19829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae5eb89de7c49b5a4e4813747c2764a" candidate_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2005221a1af4e559e0cb1cf28636c84"
I20260709 12:28:44.212194 19829 raft_consensus.cc:2393] T 7ae5eb89de7c49b5a4e4813747c2764a P b2005221a1af4e559e0cb1cf28636c84 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dfbf314f9eb4599aa1f64e0098053f2 in current term 1: Already voted for candidate b2005221a1af4e559e0cb1cf28636c84 in this term.
I20260709 12:28:44.213406 19719 leader_election.cc:304] T 7ae5eb89de7c49b5a4e4813747c2764a P 8dfbf314f9eb4599aa1f64e0098053f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dfbf314f9eb4599aa1f64e0098053f2; no voters: 72b654ed19904db48b0a8e50fe4e12c7, b2005221a1af4e559e0cb1cf28636c84
I20260709 12:28:44.214227 19968 raft_consensus.cc:2749] T 7ae5eb89de7c49b5a4e4813747c2764a P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:28:44.218328 19906 raft_consensus.cc:2468] T 7ae5eb89de7c49b5a4e4813747c2764a P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2005221a1af4e559e0cb1cf28636c84 in term 1.
I20260709 12:28:44.220150 19794 leader_election.cc:304] T 7ae5eb89de7c49b5a4e4813747c2764a P b2005221a1af4e559e0cb1cf28636c84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72b654ed19904db48b0a8e50fe4e12c7, b2005221a1af4e559e0cb1cf28636c84; no voters: 8dfbf314f9eb4599aa1f64e0098053f2
I20260709 12:28:44.226428 19968 consensus_queue.cc:1048] T 3545d7ed467b44c3b9be7f1c8d642c6c P 8dfbf314f9eb4599aa1f64e0098053f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:44.226985 19961 raft_consensus.cc:2804] T 7ae5eb89de7c49b5a4e4813747c2764a P b2005221a1af4e559e0cb1cf28636c84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:44.230890 20011 consensus_queue.cc:1048] T 66f3ed0a695841ce959ef857c4741496 P 72b654ed19904db48b0a8e50fe4e12c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:44.231184 19961 raft_consensus.cc:697] T 7ae5eb89de7c49b5a4e4813747c2764a P b2005221a1af4e559e0cb1cf28636c84 [term 1 LEADER]: Becoming Leader. State: Replica: b2005221a1af4e559e0cb1cf28636c84, State: Running, Role: LEADER
I20260709 12:28:44.232411 19961 consensus_queue.cc:237] T 7ae5eb89de7c49b5a4e4813747c2764a P b2005221a1af4e559e0cb1cf28636c84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:44.247138 19968 consensus_queue.cc:1048] T 3545d7ed467b44c3b9be7f1c8d642c6c P 8dfbf314f9eb4599aa1f64e0098053f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:44.269380 19984 consensus_queue.cc:1048] T 22affa70596649658254e443bccdb7e2 P 8dfbf314f9eb4599aa1f64e0098053f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:28:44.277323 19702 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:28:44.276583 19651 catalog_manager.cc:5697] T 7ae5eb89de7c49b5a4e4813747c2764a P b2005221a1af4e559e0cb1cf28636c84 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2005221a1af4e559e0cb1cf28636c84 (127.9.116.66). New cstate: current_term: 1 leader_uuid: "b2005221a1af4e559e0cb1cf28636c84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:44.305488 19984 consensus_queue.cc:1048] T 22affa70596649658254e443bccdb7e2 P 8dfbf314f9eb4599aa1f64e0098053f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:44.307811 19954 consensus_queue.cc:1048] T 0f3c299838c041199cb1ebb8978304f9 P 8dfbf314f9eb4599aa1f64e0098053f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:44.310431 19961 consensus_queue.cc:1048] T 3aeae4fb47e646d09bdeb06f2d3ee837 P b2005221a1af4e559e0cb1cf28636c84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:44.324908 20017 consensus_queue.cc:1048] T 0f3c299838c041199cb1ebb8978304f9 P 8dfbf314f9eb4599aa1f64e0098053f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:44.341197 19996 consensus_queue.cc:1048] T 3aeae4fb47e646d09bdeb06f2d3ee837 P b2005221a1af4e559e0cb1cf28636c84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:44.393453 20017 consensus_queue.cc:1048] T 8d17b409914c4c139fb5a5e4fbcbd54a P 8dfbf314f9eb4599aa1f64e0098053f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:44.403609 19996 consensus_queue.cc:1048] T ed4996cfc4a0429fae414b2c8e341c0d P b2005221a1af4e559e0cb1cf28636c84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:44.409684 19968 consensus_queue.cc:1048] T 8d17b409914c4c139fb5a5e4fbcbd54a P 8dfbf314f9eb4599aa1f64e0098053f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:44.426563 19961 consensus_queue.cc:1048] T ed4996cfc4a0429fae414b2c8e341c0d P b2005221a1af4e559e0cb1cf28636c84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:44.428639 20011 consensus_queue.cc:1048] T a47b4bf847674ea286f15a089566d812 P 72b654ed19904db48b0a8e50fe4e12c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:44.450170 19990 consensus_queue.cc:1048] T a47b4bf847674ea286f15a089566d812 P 72b654ed19904db48b0a8e50fe4e12c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:44.634637 19991 consensus_queue.cc:1048] T 7ae5eb89de7c49b5a4e4813747c2764a P b2005221a1af4e559e0cb1cf28636c84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:44.651294 19991 consensus_queue.cc:1048] T 7ae5eb89de7c49b5a4e4813747c2764a P b2005221a1af4e559e0cb1cf28636c84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:44.665808 19831 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7ae5eb89de7c49b5a4e4813747c2764a"
dest_uuid: "b2005221a1af4e559e0cb1cf28636c84"
mode: GRACEFUL
new_leader_uuid: "8dfbf314f9eb4599aa1f64e0098053f2"
 from {username='slave'} at 127.0.0.1:60180
I20260709 12:28:44.666563 19831 raft_consensus.cc:606] T 7ae5eb89de7c49b5a4e4813747c2764a P b2005221a1af4e559e0cb1cf28636c84 [term 1 LEADER]: Received request to transfer leadership to TS 8dfbf314f9eb4599aa1f64e0098053f2
I20260709 12:28:44.668763 19961 raft_consensus.cc:993] T 7ae5eb89de7c49b5a4e4813747c2764a P b2005221a1af4e559e0cb1cf28636c84: : Instructing follower 8dfbf314f9eb4599aa1f64e0098053f2 to start an election
I20260709 12:28:44.669250 19991 raft_consensus.cc:1081] T 7ae5eb89de7c49b5a4e4813747c2764a P b2005221a1af4e559e0cb1cf28636c84 [term 1 LEADER]: Signalling peer 8dfbf314f9eb4599aa1f64e0098053f2 to start an election
I20260709 12:28:44.671144 19756 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7ae5eb89de7c49b5a4e4813747c2764a"
dest_uuid: "8dfbf314f9eb4599aa1f64e0098053f2"
 from {username='slave'} at 127.0.0.1:50324
I20260709 12:28:44.671782 19756 raft_consensus.cc:493] T 7ae5eb89de7c49b5a4e4813747c2764a P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:44.672161 19756 raft_consensus.cc:3060] T 7ae5eb89de7c49b5a4e4813747c2764a P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:44.681064 19756 raft_consensus.cc:515] T 7ae5eb89de7c49b5a4e4813747c2764a P 8dfbf314f9eb4599aa1f64e0098053f2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:44.685627 19905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae5eb89de7c49b5a4e4813747c2764a" candidate_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "72b654ed19904db48b0a8e50fe4e12c7"
I20260709 12:28:44.686308 19905 raft_consensus.cc:3060] T 7ae5eb89de7c49b5a4e4813747c2764a P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:44.687505 19755 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f3c299838c041199cb1ebb8978304f9"
dest_uuid: "8dfbf314f9eb4599aa1f64e0098053f2"
mode: GRACEFUL
new_leader_uuid: "b2005221a1af4e559e0cb1cf28636c84"
 from {username='slave'} at 127.0.0.1:50336
I20260709 12:28:44.688230 19755 raft_consensus.cc:606] T 0f3c299838c041199cb1ebb8978304f9 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 LEADER]: Received request to transfer leadership to TS b2005221a1af4e559e0cb1cf28636c84
I20260709 12:28:44.689284 19831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae5eb89de7c49b5a4e4813747c2764a" candidate_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b2005221a1af4e559e0cb1cf28636c84"
I20260709 12:28:44.689931 19831 raft_consensus.cc:3055] T 7ae5eb89de7c49b5a4e4813747c2764a P b2005221a1af4e559e0cb1cf28636c84 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:44.690248 19831 raft_consensus.cc:740] T 7ae5eb89de7c49b5a4e4813747c2764a P b2005221a1af4e559e0cb1cf28636c84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b2005221a1af4e559e0cb1cf28636c84, State: Running, Role: LEADER
I20260709 12:28:44.691073 19831 consensus_queue.cc:260] T 7ae5eb89de7c49b5a4e4813747c2764a P b2005221a1af4e559e0cb1cf28636c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:44.692377 19831 raft_consensus.cc:3060] T 7ae5eb89de7c49b5a4e4813747c2764a P b2005221a1af4e559e0cb1cf28636c84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:44.694559 19905 raft_consensus.cc:2468] T 7ae5eb89de7c49b5a4e4813747c2764a P 72b654ed19904db48b0a8e50fe4e12c7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dfbf314f9eb4599aa1f64e0098053f2 in term 2.
I20260709 12:28:44.696041 19719 leader_election.cc:304] T 7ae5eb89de7c49b5a4e4813747c2764a P 8dfbf314f9eb4599aa1f64e0098053f2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72b654ed19904db48b0a8e50fe4e12c7, 8dfbf314f9eb4599aa1f64e0098053f2; no voters: 
I20260709 12:28:44.696887 19756 leader_election.cc:290] T 7ae5eb89de7c49b5a4e4813747c2764a P 8dfbf314f9eb4599aa1f64e0098053f2 [CANDIDATE]: Term 2 election: Requested vote from peers b2005221a1af4e559e0cb1cf28636c84 (127.9.116.66:42783), 72b654ed19904db48b0a8e50fe4e12c7 (127.9.116.67:34699)
I20260709 12:28:44.697006 19984 raft_consensus.cc:2804] T 7ae5eb89de7c49b5a4e4813747c2764a P 8dfbf314f9eb4599aa1f64e0098053f2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:44.698953 19984 raft_consensus.cc:697] T 7ae5eb89de7c49b5a4e4813747c2764a P 8dfbf314f9eb4599aa1f64e0098053f2 [term 2 LEADER]: Becoming Leader. State: Replica: 8dfbf314f9eb4599aa1f64e0098053f2, State: Running, Role: LEADER
I20260709 12:28:44.700095 19984 consensus_queue.cc:237] T 7ae5eb89de7c49b5a4e4813747c2764a P 8dfbf314f9eb4599aa1f64e0098053f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:44.702169 19831 raft_consensus.cc:2468] T 7ae5eb89de7c49b5a4e4813747c2764a P b2005221a1af4e559e0cb1cf28636c84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dfbf314f9eb4599aa1f64e0098053f2 in term 2.
I20260709 12:28:44.708573 19652 catalog_manager.cc:5697] T 7ae5eb89de7c49b5a4e4813747c2764a P 8dfbf314f9eb4599aa1f64e0098053f2 reported cstate change: term changed from 1 to 2, leader changed from b2005221a1af4e559e0cb1cf28636c84 (127.9.116.66) to 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65). New cstate: current_term: 2 leader_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:44.715431 19905 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66f3ed0a695841ce959ef857c4741496"
dest_uuid: "72b654ed19904db48b0a8e50fe4e12c7"
mode: GRACEFUL
new_leader_uuid: "b2005221a1af4e559e0cb1cf28636c84"
 from {username='slave'} at 127.0.0.1:52736
I20260709 12:28:44.716185 19905 raft_consensus.cc:606] T 66f3ed0a695841ce959ef857c4741496 P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 LEADER]: Received request to transfer leadership to TS b2005221a1af4e559e0cb1cf28636c84
I20260709 12:28:44.940879 19954 raft_consensus.cc:993] T 0f3c299838c041199cb1ebb8978304f9 P 8dfbf314f9eb4599aa1f64e0098053f2: : Instructing follower b2005221a1af4e559e0cb1cf28636c84 to start an election
I20260709 12:28:44.941515 19954 raft_consensus.cc:1081] T 0f3c299838c041199cb1ebb8978304f9 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 LEADER]: Signalling peer b2005221a1af4e559e0cb1cf28636c84 to start an election
I20260709 12:28:44.943908 19831 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0f3c299838c041199cb1ebb8978304f9"
dest_uuid: "b2005221a1af4e559e0cb1cf28636c84"
 from {username='slave'} at 127.0.0.1:60164
I20260709 12:28:44.944593 19831 raft_consensus.cc:493] T 0f3c299838c041199cb1ebb8978304f9 P b2005221a1af4e559e0cb1cf28636c84 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:44.945014 19831 raft_consensus.cc:3060] T 0f3c299838c041199cb1ebb8978304f9 P b2005221a1af4e559e0cb1cf28636c84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:44.951766 19831 raft_consensus.cc:515] T 0f3c299838c041199cb1ebb8978304f9 P b2005221a1af4e559e0cb1cf28636c84 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:44.954005 19831 leader_election.cc:290] T 0f3c299838c041199cb1ebb8978304f9 P b2005221a1af4e559e0cb1cf28636c84 [CANDIDATE]: Term 2 election: Requested vote from peers 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65:38251), 72b654ed19904db48b0a8e50fe4e12c7 (127.9.116.67:34699)
I20260709 12:28:44.955062 19756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3c299838c041199cb1ebb8978304f9" candidate_uuid: "b2005221a1af4e559e0cb1cf28636c84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8dfbf314f9eb4599aa1f64e0098053f2"
I20260709 12:28:44.955303 19905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3c299838c041199cb1ebb8978304f9" candidate_uuid: "b2005221a1af4e559e0cb1cf28636c84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "72b654ed19904db48b0a8e50fe4e12c7"
I20260709 12:28:44.955860 19905 raft_consensus.cc:3060] T 0f3c299838c041199cb1ebb8978304f9 P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:44.955861 19756 raft_consensus.cc:3055] T 0f3c299838c041199cb1ebb8978304f9 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:44.956540 19756 raft_consensus.cc:740] T 0f3c299838c041199cb1ebb8978304f9 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8dfbf314f9eb4599aa1f64e0098053f2, State: Running, Role: LEADER
I20260709 12:28:44.957415 19756 consensus_queue.cc:260] T 0f3c299838c041199cb1ebb8978304f9 P 8dfbf314f9eb4599aa1f64e0098053f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:44.958463 19756 raft_consensus.cc:3060] T 0f3c299838c041199cb1ebb8978304f9 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:44.963338 19905 raft_consensus.cc:2468] T 0f3c299838c041199cb1ebb8978304f9 P 72b654ed19904db48b0a8e50fe4e12c7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2005221a1af4e559e0cb1cf28636c84 in term 2.
I20260709 12:28:44.964970 19794 leader_election.cc:304] T 0f3c299838c041199cb1ebb8978304f9 P b2005221a1af4e559e0cb1cf28636c84 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72b654ed19904db48b0a8e50fe4e12c7, b2005221a1af4e559e0cb1cf28636c84; no voters: 
I20260709 12:28:44.965999 19991 raft_consensus.cc:2804] T 0f3c299838c041199cb1ebb8978304f9 P b2005221a1af4e559e0cb1cf28636c84 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:44.966491 19756 raft_consensus.cc:2468] T 0f3c299838c041199cb1ebb8978304f9 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2005221a1af4e559e0cb1cf28636c84 in term 2.
I20260709 12:28:44.966629 19991 raft_consensus.cc:697] T 0f3c299838c041199cb1ebb8978304f9 P b2005221a1af4e559e0cb1cf28636c84 [term 2 LEADER]: Becoming Leader. State: Replica: b2005221a1af4e559e0cb1cf28636c84, State: Running, Role: LEADER
I20260709 12:28:44.967712 19991 consensus_queue.cc:237] T 0f3c299838c041199cb1ebb8978304f9 P b2005221a1af4e559e0cb1cf28636c84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:44.975019 19652 catalog_manager.cc:5697] T 0f3c299838c041199cb1ebb8978304f9 P b2005221a1af4e559e0cb1cf28636c84 reported cstate change: term changed from 1 to 2, leader changed from 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65) to b2005221a1af4e559e0cb1cf28636c84 (127.9.116.66). New cstate: current_term: 2 leader_uuid: "b2005221a1af4e559e0cb1cf28636c84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:45.127362 19831 raft_consensus.cc:1275] T 7ae5eb89de7c49b5a4e4813747c2764a P b2005221a1af4e559e0cb1cf28636c84 [term 2 FOLLOWER]: Refusing update from remote peer 8dfbf314f9eb4599aa1f64e0098053f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:45.128934 19954 consensus_queue.cc:1048] T 7ae5eb89de7c49b5a4e4813747c2764a P 8dfbf314f9eb4599aa1f64e0098053f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:45.138023 19905 raft_consensus.cc:1275] T 7ae5eb89de7c49b5a4e4813747c2764a P 72b654ed19904db48b0a8e50fe4e12c7 [term 2 FOLLOWER]: Refusing update from remote peer 8dfbf314f9eb4599aa1f64e0098053f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:45.141001 19984 consensus_queue.cc:1048] T 7ae5eb89de7c49b5a4e4813747c2764a P 8dfbf314f9eb4599aa1f64e0098053f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:45.250716 20011 raft_consensus.cc:993] T 66f3ed0a695841ce959ef857c4741496 P 72b654ed19904db48b0a8e50fe4e12c7: : Instructing follower b2005221a1af4e559e0cb1cf28636c84 to start an election
I20260709 12:28:45.251199 20011 raft_consensus.cc:1081] T 66f3ed0a695841ce959ef857c4741496 P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 LEADER]: Signalling peer b2005221a1af4e559e0cb1cf28636c84 to start an election
I20260709 12:28:45.253278 19831 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "66f3ed0a695841ce959ef857c4741496"
dest_uuid: "b2005221a1af4e559e0cb1cf28636c84"
 from {username='slave'} at 127.0.0.1:60162
I20260709 12:28:45.254065 19831 raft_consensus.cc:493] T 66f3ed0a695841ce959ef857c4741496 P b2005221a1af4e559e0cb1cf28636c84 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:45.254515 19831 raft_consensus.cc:3060] T 66f3ed0a695841ce959ef857c4741496 P b2005221a1af4e559e0cb1cf28636c84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:45.261194 19831 raft_consensus.cc:515] T 66f3ed0a695841ce959ef857c4741496 P b2005221a1af4e559e0cb1cf28636c84 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:45.263940 19831 leader_election.cc:290] T 66f3ed0a695841ce959ef857c4741496 P b2005221a1af4e559e0cb1cf28636c84 [CANDIDATE]: Term 2 election: Requested vote from peers 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65:38251), 72b654ed19904db48b0a8e50fe4e12c7 (127.9.116.67:34699)
I20260709 12:28:45.264863 19756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66f3ed0a695841ce959ef857c4741496" candidate_uuid: "b2005221a1af4e559e0cb1cf28636c84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8dfbf314f9eb4599aa1f64e0098053f2"
I20260709 12:28:45.265236 19905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66f3ed0a695841ce959ef857c4741496" candidate_uuid: "b2005221a1af4e559e0cb1cf28636c84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "72b654ed19904db48b0a8e50fe4e12c7"
I20260709 12:28:45.265601 19756 raft_consensus.cc:3060] T 66f3ed0a695841ce959ef857c4741496 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:45.265899 19905 raft_consensus.cc:3055] T 66f3ed0a695841ce959ef857c4741496 P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:45.266271 19905 raft_consensus.cc:740] T 66f3ed0a695841ce959ef857c4741496 P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 72b654ed19904db48b0a8e50fe4e12c7, State: Running, Role: LEADER
I20260709 12:28:45.267081 19905 consensus_queue.cc:260] T 66f3ed0a695841ce959ef857c4741496 P 72b654ed19904db48b0a8e50fe4e12c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:45.268162 19905 raft_consensus.cc:3060] T 66f3ed0a695841ce959ef857c4741496 P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:45.271920 19756 raft_consensus.cc:2468] T 66f3ed0a695841ce959ef857c4741496 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2005221a1af4e559e0cb1cf28636c84 in term 2.
I20260709 12:28:45.273226 19795 leader_election.cc:304] T 66f3ed0a695841ce959ef857c4741496 P b2005221a1af4e559e0cb1cf28636c84 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dfbf314f9eb4599aa1f64e0098053f2, b2005221a1af4e559e0cb1cf28636c84; no voters: 
I20260709 12:28:45.274255 19991 raft_consensus.cc:2804] T 66f3ed0a695841ce959ef857c4741496 P b2005221a1af4e559e0cb1cf28636c84 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:45.274300 19905 raft_consensus.cc:2468] T 66f3ed0a695841ce959ef857c4741496 P 72b654ed19904db48b0a8e50fe4e12c7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2005221a1af4e559e0cb1cf28636c84 in term 2.
I20260709 12:28:45.274858 19991 raft_consensus.cc:697] T 66f3ed0a695841ce959ef857c4741496 P b2005221a1af4e559e0cb1cf28636c84 [term 2 LEADER]: Becoming Leader. State: Replica: b2005221a1af4e559e0cb1cf28636c84, State: Running, Role: LEADER
I20260709 12:28:45.275918 19991 consensus_queue.cc:237] T 66f3ed0a695841ce959ef857c4741496 P b2005221a1af4e559e0cb1cf28636c84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:45.286391 19651 catalog_manager.cc:5697] T 66f3ed0a695841ce959ef857c4741496 P b2005221a1af4e559e0cb1cf28636c84 reported cstate change: term changed from 1 to 2, leader changed from 72b654ed19904db48b0a8e50fe4e12c7 (127.9.116.67) to b2005221a1af4e559e0cb1cf28636c84 (127.9.116.66). New cstate: current_term: 2 leader_uuid: "b2005221a1af4e559e0cb1cf28636c84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:45.462689 19905 raft_consensus.cc:1275] T 0f3c299838c041199cb1ebb8978304f9 P 72b654ed19904db48b0a8e50fe4e12c7 [term 2 FOLLOWER]: Refusing update from remote peer b2005221a1af4e559e0cb1cf28636c84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:45.464376 19961 consensus_queue.cc:1048] T 0f3c299838c041199cb1ebb8978304f9 P b2005221a1af4e559e0cb1cf28636c84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:45.469652 19756 raft_consensus.cc:1275] T 0f3c299838c041199cb1ebb8978304f9 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 2 FOLLOWER]: Refusing update from remote peer b2005221a1af4e559e0cb1cf28636c84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:45.471884 19991 consensus_queue.cc:1048] T 0f3c299838c041199cb1ebb8978304f9 P b2005221a1af4e559e0cb1cf28636c84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:45.667874 19756 raft_consensus.cc:1275] T 66f3ed0a695841ce959ef857c4741496 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 2 FOLLOWER]: Refusing update from remote peer b2005221a1af4e559e0cb1cf28636c84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:45.669756 19991 consensus_queue.cc:1048] T 66f3ed0a695841ce959ef857c4741496 P b2005221a1af4e559e0cb1cf28636c84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:45.679646 19905 raft_consensus.cc:1275] T 66f3ed0a695841ce959ef857c4741496 P 72b654ed19904db48b0a8e50fe4e12c7 [term 2 FOLLOWER]: Refusing update from remote peer b2005221a1af4e559e0cb1cf28636c84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:45.681282 20040 consensus_queue.cc:1048] T 66f3ed0a695841ce959ef857c4741496 P b2005221a1af4e559e0cb1cf28636c84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:28:47.357486 19927 debug-util.cc:398] Leaking SignalData structure 0x7b080013c500 after lost signal to thread 9684
W20260709 12:28:47.358538 19927 debug-util.cc:398] Leaking SignalData structure 0x7b08000be5e0 after lost signal to thread 19688
W20260709 12:28:47.359743 19927 debug-util.cc:398] Leaking SignalData structure 0x7b080013a420 after lost signal to thread 19780
W20260709 12:28:47.360754 19927 debug-util.cc:398] Leaking SignalData structure 0x7b0800194760 after lost signal to thread 19855
W20260709 12:28:47.361722 19927 debug-util.cc:398] Leaking SignalData structure 0x7b08002de520 after lost signal to thread 19930
I20260709 12:28:47.948185 19651 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35492:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:28:47.951327 19651 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:28:48.013929 19743 tablet_service.cc:1511] Processing CreateTablet for tablet f6e468eccc244819925f994f88ded6c3 (DEFAULT_TABLE table=soft_deleted_table [id=088957e25c584b7298fd95d3a8b034f4]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:28:48.014628 19818 tablet_service.cc:1511] Processing CreateTablet for tablet f6e468eccc244819925f994f88ded6c3 (DEFAULT_TABLE table=soft_deleted_table [id=088957e25c584b7298fd95d3a8b034f4]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:28:48.015431 19743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6e468eccc244819925f994f88ded6c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:48.016017 19818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6e468eccc244819925f994f88ded6c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:48.022747 19741 tablet_service.cc:1511] Processing CreateTablet for tablet eecd23b305744bcabbef1e2e5cd206ce (DEFAULT_TABLE table=soft_deleted_table [id=088957e25c584b7298fd95d3a8b034f4]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:28:48.024829 19741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eecd23b305744bcabbef1e2e5cd206ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:48.026455 19890 tablet_service.cc:1511] Processing CreateTablet for tablet f6e468eccc244819925f994f88ded6c3 (DEFAULT_TABLE table=soft_deleted_table [id=088957e25c584b7298fd95d3a8b034f4]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:28:48.028273 19890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6e468eccc244819925f994f88ded6c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:48.028012 19813 tablet_service.cc:1511] Processing CreateTablet for tablet eecd23b305744bcabbef1e2e5cd206ce (DEFAULT_TABLE table=soft_deleted_table [id=088957e25c584b7298fd95d3a8b034f4]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:28:48.028879 19740 tablet_service.cc:1511] Processing CreateTablet for tablet 5425b69fce0a4b0ab03c4f1849b882e1 (DEFAULT_TABLE table=soft_deleted_table [id=088957e25c584b7298fd95d3a8b034f4]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:28:48.029565 19813 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eecd23b305744bcabbef1e2e5cd206ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:48.030259 19740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5425b69fce0a4b0ab03c4f1849b882e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:48.033674 19895 tablet_service.cc:1511] Processing CreateTablet for tablet eecd23b305744bcabbef1e2e5cd206ce (DEFAULT_TABLE table=soft_deleted_table [id=088957e25c584b7298fd95d3a8b034f4]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:28:48.034351 19742 tablet_service.cc:1511] Processing CreateTablet for tablet f8c6d1c957af4a36b0793ce6bcd840fb (DEFAULT_TABLE table=soft_deleted_table [id=088957e25c584b7298fd95d3a8b034f4]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:28:48.035169 19895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eecd23b305744bcabbef1e2e5cd206ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:48.034243 19817 tablet_service.cc:1511] Processing CreateTablet for tablet 5425b69fce0a4b0ab03c4f1849b882e1 (DEFAULT_TABLE table=soft_deleted_table [id=088957e25c584b7298fd95d3a8b034f4]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:28:48.041056 19739 tablet_service.cc:1511] Processing CreateTablet for tablet 2af1d81129aa40cfb84440644ae99bc5 (DEFAULT_TABLE table=soft_deleted_table [id=088957e25c584b7298fd95d3a8b034f4]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:28:48.041177 19742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8c6d1c957af4a36b0793ce6bcd840fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:48.047345 19745 tablet_service.cc:1511] Processing CreateTablet for tablet 65b2b8f9a0944d1a94ae5e90b9656f7c (DEFAULT_TABLE table=soft_deleted_table [id=088957e25c584b7298fd95d3a8b034f4]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:28:48.048122 19817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5425b69fce0a4b0ab03c4f1849b882e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:48.048822 19745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65b2b8f9a0944d1a94ae5e90b9656f7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:48.054044 19746 tablet_service.cc:1511] Processing CreateTablet for tablet d9f35e5399fd49539418b54e24f94016 (DEFAULT_TABLE table=soft_deleted_table [id=088957e25c584b7298fd95d3a8b034f4]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:28:48.055711 19746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9f35e5399fd49539418b54e24f94016. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:48.056725 19739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2af1d81129aa40cfb84440644ae99bc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:48.062968 19894 tablet_service.cc:1511] Processing CreateTablet for tablet 5425b69fce0a4b0ab03c4f1849b882e1 (DEFAULT_TABLE table=soft_deleted_table [id=088957e25c584b7298fd95d3a8b034f4]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:28:48.065117 19894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5425b69fce0a4b0ab03c4f1849b882e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:48.065999 19738 tablet_service.cc:1511] Processing CreateTablet for tablet 787520b5a0c64085a72e995881511ca5 (DEFAULT_TABLE table=soft_deleted_table [id=088957e25c584b7298fd95d3a8b034f4]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:28:48.068171 19738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 787520b5a0c64085a72e995881511ca5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:48.076332 19744 tablet_service.cc:1511] Processing CreateTablet for tablet 331c202d5bec4f76a11791c0f101dfd5 (DEFAULT_TABLE table=soft_deleted_table [id=088957e25c584b7298fd95d3a8b034f4]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:28:48.078341 19744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 331c202d5bec4f76a11791c0f101dfd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:48.087460 19820 tablet_service.cc:1511] Processing CreateTablet for tablet f8c6d1c957af4a36b0793ce6bcd840fb (DEFAULT_TABLE table=soft_deleted_table [id=088957e25c584b7298fd95d3a8b034f4]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:28:48.089624 19820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8c6d1c957af4a36b0793ce6bcd840fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:48.096302 20062 tablet_bootstrap.cc:492] T f6e468eccc244819925f994f88ded6c3 P 72b654ed19904db48b0a8e50fe4e12c7: Bootstrap starting.
I20260709 12:28:48.109249 19890 tablet_service.cc:1511] Processing CreateTablet for tablet f8c6d1c957af4a36b0793ce6bcd840fb (DEFAULT_TABLE table=soft_deleted_table [id=088957e25c584b7298fd95d3a8b034f4]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:28:48.112463 20062 tablet_bootstrap.cc:654] T f6e468eccc244819925f994f88ded6c3 P 72b654ed19904db48b0a8e50fe4e12c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:48.130741 19895 tablet_service.cc:1511] Processing CreateTablet for tablet 2af1d81129aa40cfb84440644ae99bc5 (DEFAULT_TABLE table=soft_deleted_table [id=088957e25c584b7298fd95d3a8b034f4]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:28:48.136482 19888 tablet_service.cc:1511] Processing CreateTablet for tablet 65b2b8f9a0944d1a94ae5e90b9656f7c (DEFAULT_TABLE table=soft_deleted_table [id=088957e25c584b7298fd95d3a8b034f4]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:28:48.143172 19890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8c6d1c957af4a36b0793ce6bcd840fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:48.146853 19891 tablet_service.cc:1511] Processing CreateTablet for tablet d9f35e5399fd49539418b54e24f94016 (DEFAULT_TABLE table=soft_deleted_table [id=088957e25c584b7298fd95d3a8b034f4]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:28:48.149039 19814 tablet_service.cc:1511] Processing CreateTablet for tablet 2af1d81129aa40cfb84440644ae99bc5 (DEFAULT_TABLE table=soft_deleted_table [id=088957e25c584b7298fd95d3a8b034f4]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:28:48.157492 19814 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2af1d81129aa40cfb84440644ae99bc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:48.150854 19821 tablet_service.cc:1511] Processing CreateTablet for tablet d9f35e5399fd49539418b54e24f94016 (DEFAULT_TABLE table=soft_deleted_table [id=088957e25c584b7298fd95d3a8b034f4]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:28:48.161288 19821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9f35e5399fd49539418b54e24f94016. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:48.151434 19819 tablet_service.cc:1511] Processing CreateTablet for tablet 65b2b8f9a0944d1a94ae5e90b9656f7c (DEFAULT_TABLE table=soft_deleted_table [id=088957e25c584b7298fd95d3a8b034f4]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:28:48.165158 19819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65b2b8f9a0944d1a94ae5e90b9656f7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:48.176276 19816 tablet_service.cc:1511] Processing CreateTablet for tablet 787520b5a0c64085a72e995881511ca5 (DEFAULT_TABLE table=soft_deleted_table [id=088957e25c584b7298fd95d3a8b034f4]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:28:48.178179 19895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2af1d81129aa40cfb84440644ae99bc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:48.178977 19816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 787520b5a0c64085a72e995881511ca5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:28:48.124541 19794 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:34699, user_credentials={real_user=slave}} blocked reactor thread for 51424.1us
I20260709 12:28:48.179039 19891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9f35e5399fd49539418b54e24f94016. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:48.200235 19888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65b2b8f9a0944d1a94ae5e90b9656f7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:48.204784 19889 tablet_service.cc:1511] Processing CreateTablet for tablet 787520b5a0c64085a72e995881511ca5 (DEFAULT_TABLE table=soft_deleted_table [id=088957e25c584b7298fd95d3a8b034f4]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:28:48.215962 19889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 787520b5a0c64085a72e995881511ca5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:48.219950 20062 tablet_bootstrap.cc:492] T f6e468eccc244819925f994f88ded6c3 P 72b654ed19904db48b0a8e50fe4e12c7: No bootstrap required, opened a new log
I20260709 12:28:48.220590 20062 ts_tablet_manager.cc:1403] T f6e468eccc244819925f994f88ded6c3 P 72b654ed19904db48b0a8e50fe4e12c7: Time spent bootstrapping tablet: real 0.125s	user 0.023s	sys 0.041s
I20260709 12:28:48.226004 19815 tablet_service.cc:1511] Processing CreateTablet for tablet 331c202d5bec4f76a11791c0f101dfd5 (DEFAULT_TABLE table=soft_deleted_table [id=088957e25c584b7298fd95d3a8b034f4]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:28:48.227905 19815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 331c202d5bec4f76a11791c0f101dfd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:48.228003 20062 raft_consensus.cc:359] T f6e468eccc244819925f994f88ded6c3 P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:48.228858 20062 raft_consensus.cc:385] T f6e468eccc244819925f994f88ded6c3 P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:48.229161 20062 raft_consensus.cc:740] T f6e468eccc244819925f994f88ded6c3 P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72b654ed19904db48b0a8e50fe4e12c7, State: Initialized, Role: FOLLOWER
I20260709 12:28:48.230067 20062 consensus_queue.cc:260] T f6e468eccc244819925f994f88ded6c3 P 72b654ed19904db48b0a8e50fe4e12c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:48.232188 19896 tablet_service.cc:1511] Processing CreateTablet for tablet 331c202d5bec4f76a11791c0f101dfd5 (DEFAULT_TABLE table=soft_deleted_table [id=088957e25c584b7298fd95d3a8b034f4]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:28:48.233572 19896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 331c202d5bec4f76a11791c0f101dfd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:48.292272 20062 ts_tablet_manager.cc:1434] T f6e468eccc244819925f994f88ded6c3 P 72b654ed19904db48b0a8e50fe4e12c7: Time spent starting tablet: real 0.071s	user 0.009s	sys 0.000s
I20260709 12:28:48.301960 20062 tablet_bootstrap.cc:492] T eecd23b305744bcabbef1e2e5cd206ce P 72b654ed19904db48b0a8e50fe4e12c7: Bootstrap starting.
I20260709 12:28:48.340960 20065 tablet_bootstrap.cc:492] T 65b2b8f9a0944d1a94ae5e90b9656f7c P 8dfbf314f9eb4599aa1f64e0098053f2: Bootstrap starting.
I20260709 12:28:48.344521 20066 tablet_bootstrap.cc:492] T 65b2b8f9a0944d1a94ae5e90b9656f7c P b2005221a1af4e559e0cb1cf28636c84: Bootstrap starting.
I20260709 12:28:48.353454 20062 tablet_bootstrap.cc:654] T eecd23b305744bcabbef1e2e5cd206ce P 72b654ed19904db48b0a8e50fe4e12c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:48.355151 20066 tablet_bootstrap.cc:654] T 65b2b8f9a0944d1a94ae5e90b9656f7c P b2005221a1af4e559e0cb1cf28636c84: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:48.355929 20065 tablet_bootstrap.cc:654] T 65b2b8f9a0944d1a94ae5e90b9656f7c P 8dfbf314f9eb4599aa1f64e0098053f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:48.366214 20062 tablet_bootstrap.cc:492] T eecd23b305744bcabbef1e2e5cd206ce P 72b654ed19904db48b0a8e50fe4e12c7: No bootstrap required, opened a new log
I20260709 12:28:48.366823 20062 ts_tablet_manager.cc:1403] T eecd23b305744bcabbef1e2e5cd206ce P 72b654ed19904db48b0a8e50fe4e12c7: Time spent bootstrapping tablet: real 0.065s	user 0.014s	sys 0.002s
I20260709 12:28:48.367151 20066 tablet_bootstrap.cc:492] T 65b2b8f9a0944d1a94ae5e90b9656f7c P b2005221a1af4e559e0cb1cf28636c84: No bootstrap required, opened a new log
I20260709 12:28:48.368009 20066 ts_tablet_manager.cc:1403] T 65b2b8f9a0944d1a94ae5e90b9656f7c P b2005221a1af4e559e0cb1cf28636c84: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.009s
I20260709 12:28:48.370503 20062 raft_consensus.cc:359] T eecd23b305744bcabbef1e2e5cd206ce P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:48.372407 20066 raft_consensus.cc:359] T 65b2b8f9a0944d1a94ae5e90b9656f7c P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:48.373319 20066 raft_consensus.cc:385] T 65b2b8f9a0944d1a94ae5e90b9656f7c P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:48.373636 20066 raft_consensus.cc:740] T 65b2b8f9a0944d1a94ae5e90b9656f7c P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2005221a1af4e559e0cb1cf28636c84, State: Initialized, Role: FOLLOWER
I20260709 12:28:48.373905 20062 raft_consensus.cc:385] T eecd23b305744bcabbef1e2e5cd206ce P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:48.374374 20062 raft_consensus.cc:740] T eecd23b305744bcabbef1e2e5cd206ce P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72b654ed19904db48b0a8e50fe4e12c7, State: Initialized, Role: FOLLOWER
I20260709 12:28:48.374786 20066 consensus_queue.cc:260] T 65b2b8f9a0944d1a94ae5e90b9656f7c P b2005221a1af4e559e0cb1cf28636c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:48.377532 20066 ts_tablet_manager.cc:1434] T 65b2b8f9a0944d1a94ae5e90b9656f7c P b2005221a1af4e559e0cb1cf28636c84: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 12:28:48.373740 20065 tablet_bootstrap.cc:492] T 65b2b8f9a0944d1a94ae5e90b9656f7c P 8dfbf314f9eb4599aa1f64e0098053f2: No bootstrap required, opened a new log
I20260709 12:28:48.379702 20065 ts_tablet_manager.cc:1403] T 65b2b8f9a0944d1a94ae5e90b9656f7c P 8dfbf314f9eb4599aa1f64e0098053f2: Time spent bootstrapping tablet: real 0.039s	user 0.013s	sys 0.007s
I20260709 12:28:48.375257 20062 consensus_queue.cc:260] T eecd23b305744bcabbef1e2e5cd206ce P 72b654ed19904db48b0a8e50fe4e12c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:48.384622 20066 tablet_bootstrap.cc:492] T eecd23b305744bcabbef1e2e5cd206ce P b2005221a1af4e559e0cb1cf28636c84: Bootstrap starting.
I20260709 12:28:48.395666 20066 tablet_bootstrap.cc:654] T eecd23b305744bcabbef1e2e5cd206ce P b2005221a1af4e559e0cb1cf28636c84: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:48.406463 20062 ts_tablet_manager.cc:1434] T eecd23b305744bcabbef1e2e5cd206ce P 72b654ed19904db48b0a8e50fe4e12c7: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.003s
I20260709 12:28:48.413375 20062 tablet_bootstrap.cc:492] T d9f35e5399fd49539418b54e24f94016 P 72b654ed19904db48b0a8e50fe4e12c7: Bootstrap starting.
I20260709 12:28:48.416464 20065 raft_consensus.cc:359] T 65b2b8f9a0944d1a94ae5e90b9656f7c P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:48.417395 20065 raft_consensus.cc:385] T 65b2b8f9a0944d1a94ae5e90b9656f7c P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:48.417701 20065 raft_consensus.cc:740] T 65b2b8f9a0944d1a94ae5e90b9656f7c P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dfbf314f9eb4599aa1f64e0098053f2, State: Initialized, Role: FOLLOWER
I20260709 12:28:48.418556 20065 consensus_queue.cc:260] T 65b2b8f9a0944d1a94ae5e90b9656f7c P 8dfbf314f9eb4599aa1f64e0098053f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:48.422910 20066 tablet_bootstrap.cc:492] T eecd23b305744bcabbef1e2e5cd206ce P b2005221a1af4e559e0cb1cf28636c84: No bootstrap required, opened a new log
I20260709 12:28:48.423619 20066 ts_tablet_manager.cc:1403] T eecd23b305744bcabbef1e2e5cd206ce P b2005221a1af4e559e0cb1cf28636c84: Time spent bootstrapping tablet: real 0.045s	user 0.009s	sys 0.008s
I20260709 12:28:48.423674 20065 ts_tablet_manager.cc:1434] T 65b2b8f9a0944d1a94ae5e90b9656f7c P 8dfbf314f9eb4599aa1f64e0098053f2: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.002s
I20260709 12:28:48.424953 20065 tablet_bootstrap.cc:492] T 5425b69fce0a4b0ab03c4f1849b882e1 P 8dfbf314f9eb4599aa1f64e0098053f2: Bootstrap starting.
I20260709 12:28:48.432085 20065 tablet_bootstrap.cc:654] T 5425b69fce0a4b0ab03c4f1849b882e1 P 8dfbf314f9eb4599aa1f64e0098053f2: Neither blocks nor log segments found. Creating new log.
W20260709 12:28:48.433408 19702 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:28:48.437319 20066 raft_consensus.cc:359] T eecd23b305744bcabbef1e2e5cd206ce P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:48.440586 20066 raft_consensus.cc:385] T eecd23b305744bcabbef1e2e5cd206ce P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:48.440949 20066 raft_consensus.cc:740] T eecd23b305744bcabbef1e2e5cd206ce P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2005221a1af4e559e0cb1cf28636c84, State: Initialized, Role: FOLLOWER
I20260709 12:28:48.441821 20066 consensus_queue.cc:260] T eecd23b305744bcabbef1e2e5cd206ce P b2005221a1af4e559e0cb1cf28636c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:48.442780 20062 tablet_bootstrap.cc:654] T d9f35e5399fd49539418b54e24f94016 P 72b654ed19904db48b0a8e50fe4e12c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:48.451046 20065 tablet_bootstrap.cc:492] T 5425b69fce0a4b0ab03c4f1849b882e1 P 8dfbf314f9eb4599aa1f64e0098053f2: No bootstrap required, opened a new log
I20260709 12:28:48.451177 20066 ts_tablet_manager.cc:1434] T eecd23b305744bcabbef1e2e5cd206ce P b2005221a1af4e559e0cb1cf28636c84: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 12:28:48.451884 20065 ts_tablet_manager.cc:1403] T 5425b69fce0a4b0ab03c4f1849b882e1 P 8dfbf314f9eb4599aa1f64e0098053f2: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.009s
I20260709 12:28:48.452952 20066 tablet_bootstrap.cc:492] T 2af1d81129aa40cfb84440644ae99bc5 P b2005221a1af4e559e0cb1cf28636c84: Bootstrap starting.
I20260709 12:28:48.455884 20063 raft_consensus.cc:493] T eecd23b305744bcabbef1e2e5cd206ce P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:48.455885 20065 raft_consensus.cc:359] T 5425b69fce0a4b0ab03c4f1849b882e1 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:48.456496 20063 raft_consensus.cc:515] T eecd23b305744bcabbef1e2e5cd206ce P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:48.457111 20065 raft_consensus.cc:385] T 5425b69fce0a4b0ab03c4f1849b882e1 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:48.457461 20065 raft_consensus.cc:740] T 5425b69fce0a4b0ab03c4f1849b882e1 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dfbf314f9eb4599aa1f64e0098053f2, State: Initialized, Role: FOLLOWER
I20260709 12:28:48.458231 20065 consensus_queue.cc:260] T 5425b69fce0a4b0ab03c4f1849b882e1 P 8dfbf314f9eb4599aa1f64e0098053f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:48.460786 19831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eecd23b305744bcabbef1e2e5cd206ce" candidate_uuid: "72b654ed19904db48b0a8e50fe4e12c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2005221a1af4e559e0cb1cf28636c84" is_pre_election: true
I20260709 12:28:48.461182 20066 tablet_bootstrap.cc:654] T 2af1d81129aa40cfb84440644ae99bc5 P b2005221a1af4e559e0cb1cf28636c84: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:48.461582 19831 raft_consensus.cc:2468] T eecd23b305744bcabbef1e2e5cd206ce P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72b654ed19904db48b0a8e50fe4e12c7 in term 0.
I20260709 12:28:48.463541 19755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eecd23b305744bcabbef1e2e5cd206ce" candidate_uuid: "72b654ed19904db48b0a8e50fe4e12c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" is_pre_election: true
W20260709 12:28:48.465986 19870 leader_election.cc:343] T eecd23b305744bcabbef1e2e5cd206ce P 72b654ed19904db48b0a8e50fe4e12c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65:38251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:48.466715 20063 leader_election.cc:290] T eecd23b305744bcabbef1e2e5cd206ce P 72b654ed19904db48b0a8e50fe4e12c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65:38251), b2005221a1af4e559e0cb1cf28636c84 (127.9.116.66:42783)
I20260709 12:28:48.467252 19869 leader_election.cc:304] T eecd23b305744bcabbef1e2e5cd206ce P 72b654ed19904db48b0a8e50fe4e12c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72b654ed19904db48b0a8e50fe4e12c7, b2005221a1af4e559e0cb1cf28636c84; no voters: 8dfbf314f9eb4599aa1f64e0098053f2
I20260709 12:28:48.461220 20065 ts_tablet_manager.cc:1434] T 5425b69fce0a4b0ab03c4f1849b882e1 P 8dfbf314f9eb4599aa1f64e0098053f2: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.005s
I20260709 12:28:48.473462 20063 raft_consensus.cc:2804] T eecd23b305744bcabbef1e2e5cd206ce P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:48.476502 20063 raft_consensus.cc:493] T eecd23b305744bcabbef1e2e5cd206ce P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:48.477027 20063 raft_consensus.cc:3060] T eecd23b305744bcabbef1e2e5cd206ce P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:48.477510 20065 tablet_bootstrap.cc:492] T d9f35e5399fd49539418b54e24f94016 P 8dfbf314f9eb4599aa1f64e0098053f2: Bootstrap starting.
I20260709 12:28:48.489250 20062 tablet_bootstrap.cc:492] T d9f35e5399fd49539418b54e24f94016 P 72b654ed19904db48b0a8e50fe4e12c7: No bootstrap required, opened a new log
I20260709 12:28:48.490206 20062 ts_tablet_manager.cc:1403] T d9f35e5399fd49539418b54e24f94016 P 72b654ed19904db48b0a8e50fe4e12c7: Time spent bootstrapping tablet: real 0.077s	user 0.019s	sys 0.019s
I20260709 12:28:48.494127 20062 raft_consensus.cc:359] T d9f35e5399fd49539418b54e24f94016 P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:48.494580 20063 raft_consensus.cc:515] T eecd23b305744bcabbef1e2e5cd206ce P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:48.495388 20062 raft_consensus.cc:385] T d9f35e5399fd49539418b54e24f94016 P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:48.495841 20062 raft_consensus.cc:740] T d9f35e5399fd49539418b54e24f94016 P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72b654ed19904db48b0a8e50fe4e12c7, State: Initialized, Role: FOLLOWER
I20260709 12:28:48.496837 20062 consensus_queue.cc:260] T d9f35e5399fd49539418b54e24f94016 P 72b654ed19904db48b0a8e50fe4e12c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:48.497418 20066 tablet_bootstrap.cc:492] T 2af1d81129aa40cfb84440644ae99bc5 P b2005221a1af4e559e0cb1cf28636c84: No bootstrap required, opened a new log
I20260709 12:28:48.498175 20066 ts_tablet_manager.cc:1403] T 2af1d81129aa40cfb84440644ae99bc5 P b2005221a1af4e559e0cb1cf28636c84: Time spent bootstrapping tablet: real 0.046s	user 0.016s	sys 0.020s
I20260709 12:28:48.497989 19755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eecd23b305744bcabbef1e2e5cd206ce" candidate_uuid: "72b654ed19904db48b0a8e50fe4e12c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dfbf314f9eb4599aa1f64e0098053f2"
I20260709 12:28:48.498962 20065 tablet_bootstrap.cc:654] T d9f35e5399fd49539418b54e24f94016 P 8dfbf314f9eb4599aa1f64e0098053f2: Neither blocks nor log segments found. Creating new log.
W20260709 12:28:48.503299 19870 leader_election.cc:343] T eecd23b305744bcabbef1e2e5cd206ce P 72b654ed19904db48b0a8e50fe4e12c7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65:38251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:48.502539 20066 raft_consensus.cc:359] T 2af1d81129aa40cfb84440644ae99bc5 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:48.506120 20066 raft_consensus.cc:385] T 2af1d81129aa40cfb84440644ae99bc5 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:48.508762 20063 leader_election.cc:290] T eecd23b305744bcabbef1e2e5cd206ce P 72b654ed19904db48b0a8e50fe4e12c7 [CANDIDATE]: Term 1 election: Requested vote from peers 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65:38251), b2005221a1af4e559e0cb1cf28636c84 (127.9.116.66:42783)
I20260709 12:28:48.509809 20066 raft_consensus.cc:740] T 2af1d81129aa40cfb84440644ae99bc5 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2005221a1af4e559e0cb1cf28636c84, State: Initialized, Role: FOLLOWER
I20260709 12:28:48.511647 19831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eecd23b305744bcabbef1e2e5cd206ce" candidate_uuid: "72b654ed19904db48b0a8e50fe4e12c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2005221a1af4e559e0cb1cf28636c84"
I20260709 12:28:48.513193 19831 raft_consensus.cc:3060] T eecd23b305744bcabbef1e2e5cd206ce P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:48.512992 20066 consensus_queue.cc:260] T 2af1d81129aa40cfb84440644ae99bc5 P b2005221a1af4e559e0cb1cf28636c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:48.515309 20066 ts_tablet_manager.cc:1434] T 2af1d81129aa40cfb84440644ae99bc5 P b2005221a1af4e559e0cb1cf28636c84: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.001s
I20260709 12:28:48.517470 20066 tablet_bootstrap.cc:492] T f6e468eccc244819925f994f88ded6c3 P b2005221a1af4e559e0cb1cf28636c84: Bootstrap starting.
I20260709 12:28:48.522336 19831 raft_consensus.cc:2468] T eecd23b305744bcabbef1e2e5cd206ce P b2005221a1af4e559e0cb1cf28636c84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72b654ed19904db48b0a8e50fe4e12c7 in term 1.
I20260709 12:28:48.524494 20066 tablet_bootstrap.cc:654] T f6e468eccc244819925f994f88ded6c3 P b2005221a1af4e559e0cb1cf28636c84: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:48.530337 20065 tablet_bootstrap.cc:492] T d9f35e5399fd49539418b54e24f94016 P 8dfbf314f9eb4599aa1f64e0098053f2: No bootstrap required, opened a new log
I20260709 12:28:48.530205 19869 leader_election.cc:304] T eecd23b305744bcabbef1e2e5cd206ce P 72b654ed19904db48b0a8e50fe4e12c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72b654ed19904db48b0a8e50fe4e12c7, b2005221a1af4e559e0cb1cf28636c84; no voters: 8dfbf314f9eb4599aa1f64e0098053f2
I20260709 12:28:48.531054 20065 ts_tablet_manager.cc:1403] T d9f35e5399fd49539418b54e24f94016 P 8dfbf314f9eb4599aa1f64e0098053f2: Time spent bootstrapping tablet: real 0.054s	user 0.001s	sys 0.024s
I20260709 12:28:48.528539 20062 ts_tablet_manager.cc:1434] T d9f35e5399fd49539418b54e24f94016 P 72b654ed19904db48b0a8e50fe4e12c7: Time spent starting tablet: real 0.038s	user 0.011s	sys 0.009s
I20260709 12:28:48.531932 20063 raft_consensus.cc:2804] T eecd23b305744bcabbef1e2e5cd206ce P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:48.532480 20063 raft_consensus.cc:697] T eecd23b305744bcabbef1e2e5cd206ce P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 LEADER]: Becoming Leader. State: Replica: 72b654ed19904db48b0a8e50fe4e12c7, State: Running, Role: LEADER
I20260709 12:28:48.532913 20062 tablet_bootstrap.cc:492] T f8c6d1c957af4a36b0793ce6bcd840fb P 72b654ed19904db48b0a8e50fe4e12c7: Bootstrap starting.
I20260709 12:28:48.533354 20063 consensus_queue.cc:237] T eecd23b305744bcabbef1e2e5cd206ce P 72b654ed19904db48b0a8e50fe4e12c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:48.534777 20065 raft_consensus.cc:359] T d9f35e5399fd49539418b54e24f94016 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:48.535624 20065 raft_consensus.cc:385] T d9f35e5399fd49539418b54e24f94016 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:48.536000 20065 raft_consensus.cc:740] T d9f35e5399fd49539418b54e24f94016 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dfbf314f9eb4599aa1f64e0098053f2, State: Initialized, Role: FOLLOWER
I20260709 12:28:48.536981 20065 consensus_queue.cc:260] T d9f35e5399fd49539418b54e24f94016 P 8dfbf314f9eb4599aa1f64e0098053f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:48.542253 20062 tablet_bootstrap.cc:654] T f8c6d1c957af4a36b0793ce6bcd840fb P 72b654ed19904db48b0a8e50fe4e12c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:48.546968 20066 tablet_bootstrap.cc:492] T f6e468eccc244819925f994f88ded6c3 P b2005221a1af4e559e0cb1cf28636c84: No bootstrap required, opened a new log
I20260709 12:28:48.547597 20066 ts_tablet_manager.cc:1403] T f6e468eccc244819925f994f88ded6c3 P b2005221a1af4e559e0cb1cf28636c84: Time spent bootstrapping tablet: real 0.030s	user 0.008s	sys 0.003s
I20260709 12:28:48.550786 20071 raft_consensus.cc:493] T 5425b69fce0a4b0ab03c4f1849b882e1 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:48.551424 20071 raft_consensus.cc:515] T 5425b69fce0a4b0ab03c4f1849b882e1 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:48.551447 20066 raft_consensus.cc:359] T f6e468eccc244819925f994f88ded6c3 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:48.556788 20066 raft_consensus.cc:385] T f6e468eccc244819925f994f88ded6c3 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:48.557217 20066 raft_consensus.cc:740] T f6e468eccc244819925f994f88ded6c3 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2005221a1af4e559e0cb1cf28636c84, State: Initialized, Role: FOLLOWER
I20260709 12:28:48.556187 20071 leader_election.cc:290] T 5425b69fce0a4b0ab03c4f1849b882e1 P 8dfbf314f9eb4599aa1f64e0098053f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2005221a1af4e559e0cb1cf28636c84 (127.9.116.66:42783), 72b654ed19904db48b0a8e50fe4e12c7 (127.9.116.67:34699)
I20260709 12:28:48.557572 19904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5425b69fce0a4b0ab03c4f1849b882e1" candidate_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72b654ed19904db48b0a8e50fe4e12c7" is_pre_election: true
I20260709 12:28:48.558642 20066 consensus_queue.cc:260] T f6e468eccc244819925f994f88ded6c3 P b2005221a1af4e559e0cb1cf28636c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
W20260709 12:28:48.559366 19719 leader_election.cc:343] T 5425b69fce0a4b0ab03c4f1849b882e1 P 8dfbf314f9eb4599aa1f64e0098053f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72b654ed19904db48b0a8e50fe4e12c7 (127.9.116.67:34699): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:48.550343 20065 ts_tablet_manager.cc:1434] T d9f35e5399fd49539418b54e24f94016 P 8dfbf314f9eb4599aa1f64e0098053f2: Time spent starting tablet: real 0.019s	user 0.003s	sys 0.003s
I20260709 12:28:48.561522 19653 catalog_manager.cc:5697] T eecd23b305744bcabbef1e2e5cd206ce P 72b654ed19904db48b0a8e50fe4e12c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72b654ed19904db48b0a8e50fe4e12c7 (127.9.116.67). New cstate: current_term: 1 leader_uuid: "72b654ed19904db48b0a8e50fe4e12c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:48.563997 19831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5425b69fce0a4b0ab03c4f1849b882e1" candidate_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2005221a1af4e559e0cb1cf28636c84" is_pre_election: true
I20260709 12:28:48.565901 20065 tablet_bootstrap.cc:492] T f6e468eccc244819925f994f88ded6c3 P 8dfbf314f9eb4599aa1f64e0098053f2: Bootstrap starting.
W20260709 12:28:48.566963 19719 leader_election.cc:343] T 5425b69fce0a4b0ab03c4f1849b882e1 P 8dfbf314f9eb4599aa1f64e0098053f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2005221a1af4e559e0cb1cf28636c84 (127.9.116.66:42783): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:48.568152 19719 leader_election.cc:304] T 5425b69fce0a4b0ab03c4f1849b882e1 P 8dfbf314f9eb4599aa1f64e0098053f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dfbf314f9eb4599aa1f64e0098053f2; no voters: 72b654ed19904db48b0a8e50fe4e12c7, b2005221a1af4e559e0cb1cf28636c84
I20260709 12:28:48.569389 20071 raft_consensus.cc:2749] T 5425b69fce0a4b0ab03c4f1849b882e1 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:48.567219 20066 ts_tablet_manager.cc:1434] T f6e468eccc244819925f994f88ded6c3 P b2005221a1af4e559e0cb1cf28636c84: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.001s
I20260709 12:28:48.573705 20066 tablet_bootstrap.cc:492] T 787520b5a0c64085a72e995881511ca5 P b2005221a1af4e559e0cb1cf28636c84: Bootstrap starting.
I20260709 12:28:48.577219 20065 tablet_bootstrap.cc:654] T f6e468eccc244819925f994f88ded6c3 P 8dfbf314f9eb4599aa1f64e0098053f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:48.582141 20066 tablet_bootstrap.cc:654] T 787520b5a0c64085a72e995881511ca5 P b2005221a1af4e559e0cb1cf28636c84: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:48.585636 20062 tablet_bootstrap.cc:492] T f8c6d1c957af4a36b0793ce6bcd840fb P 72b654ed19904db48b0a8e50fe4e12c7: No bootstrap required, opened a new log
I20260709 12:28:48.586596 20062 ts_tablet_manager.cc:1403] T f8c6d1c957af4a36b0793ce6bcd840fb P 72b654ed19904db48b0a8e50fe4e12c7: Time spent bootstrapping tablet: real 0.054s	user 0.009s	sys 0.023s
I20260709 12:28:48.591768 20062 raft_consensus.cc:359] T f8c6d1c957af4a36b0793ce6bcd840fb P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:48.592984 20062 raft_consensus.cc:385] T f8c6d1c957af4a36b0793ce6bcd840fb P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:48.593528 20062 raft_consensus.cc:740] T f8c6d1c957af4a36b0793ce6bcd840fb P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72b654ed19904db48b0a8e50fe4e12c7, State: Initialized, Role: FOLLOWER
I20260709 12:28:48.595477 20062 consensus_queue.cc:260] T f8c6d1c957af4a36b0793ce6bcd840fb P 72b654ed19904db48b0a8e50fe4e12c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:48.596938 20063 raft_consensus.cc:493] T f8c6d1c957af4a36b0793ce6bcd840fb P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:48.597623 20063 raft_consensus.cc:515] T f8c6d1c957af4a36b0793ce6bcd840fb P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:48.601203 20065 tablet_bootstrap.cc:492] T f6e468eccc244819925f994f88ded6c3 P 8dfbf314f9eb4599aa1f64e0098053f2: No bootstrap required, opened a new log
I20260709 12:28:48.601995 20065 ts_tablet_manager.cc:1403] T f6e468eccc244819925f994f88ded6c3 P 8dfbf314f9eb4599aa1f64e0098053f2: Time spent bootstrapping tablet: real 0.038s	user 0.019s	sys 0.003s
I20260709 12:28:48.604122 19755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c6d1c957af4a36b0793ce6bcd840fb" candidate_uuid: "72b654ed19904db48b0a8e50fe4e12c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" is_pre_election: true
W20260709 12:28:48.606916 19870 leader_election.cc:343] T f8c6d1c957af4a36b0793ce6bcd840fb P 72b654ed19904db48b0a8e50fe4e12c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65:38251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:48.609907 20063 leader_election.cc:290] T f8c6d1c957af4a36b0793ce6bcd840fb P 72b654ed19904db48b0a8e50fe4e12c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65:38251), b2005221a1af4e559e0cb1cf28636c84 (127.9.116.66:42783)
I20260709 12:28:48.611346 19831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c6d1c957af4a36b0793ce6bcd840fb" candidate_uuid: "72b654ed19904db48b0a8e50fe4e12c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2005221a1af4e559e0cb1cf28636c84" is_pre_election: true
I20260709 12:28:48.612568 20066 tablet_bootstrap.cc:492] T 787520b5a0c64085a72e995881511ca5 P b2005221a1af4e559e0cb1cf28636c84: No bootstrap required, opened a new log
I20260709 12:28:48.613158 20066 ts_tablet_manager.cc:1403] T 787520b5a0c64085a72e995881511ca5 P b2005221a1af4e559e0cb1cf28636c84: Time spent bootstrapping tablet: real 0.040s	user 0.012s	sys 0.020s
W20260709 12:28:48.613137 19869 leader_election.cc:343] T f8c6d1c957af4a36b0793ce6bcd840fb P 72b654ed19904db48b0a8e50fe4e12c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2005221a1af4e559e0cb1cf28636c84 (127.9.116.66:42783): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:48.613817 19869 leader_election.cc:304] T f8c6d1c957af4a36b0793ce6bcd840fb P 72b654ed19904db48b0a8e50fe4e12c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72b654ed19904db48b0a8e50fe4e12c7; no voters: 8dfbf314f9eb4599aa1f64e0098053f2, b2005221a1af4e559e0cb1cf28636c84
I20260709 12:28:48.614785 20063 raft_consensus.cc:2749] T f8c6d1c957af4a36b0793ce6bcd840fb P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:48.615984 20062 ts_tablet_manager.cc:1434] T f8c6d1c957af4a36b0793ce6bcd840fb P 72b654ed19904db48b0a8e50fe4e12c7: Time spent starting tablet: real 0.029s	user 0.010s	sys 0.004s
I20260709 12:28:48.617141 20062 tablet_bootstrap.cc:492] T 5425b69fce0a4b0ab03c4f1849b882e1 P 72b654ed19904db48b0a8e50fe4e12c7: Bootstrap starting.
I20260709 12:28:48.618090 20066 raft_consensus.cc:359] T 787520b5a0c64085a72e995881511ca5 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:48.618924 20066 raft_consensus.cc:385] T 787520b5a0c64085a72e995881511ca5 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:48.619242 20066 raft_consensus.cc:740] T 787520b5a0c64085a72e995881511ca5 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2005221a1af4e559e0cb1cf28636c84, State: Initialized, Role: FOLLOWER
I20260709 12:28:48.616052 20065 raft_consensus.cc:359] T f6e468eccc244819925f994f88ded6c3 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:48.620151 20066 consensus_queue.cc:260] T 787520b5a0c64085a72e995881511ca5 P b2005221a1af4e559e0cb1cf28636c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:48.622699 20066 ts_tablet_manager.cc:1434] T 787520b5a0c64085a72e995881511ca5 P b2005221a1af4e559e0cb1cf28636c84: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:28:48.623999 20066 tablet_bootstrap.cc:492] T 5425b69fce0a4b0ab03c4f1849b882e1 P b2005221a1af4e559e0cb1cf28636c84: Bootstrap starting.
I20260709 12:28:48.633487 20065 raft_consensus.cc:385] T f6e468eccc244819925f994f88ded6c3 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:48.633980 20065 raft_consensus.cc:740] T f6e468eccc244819925f994f88ded6c3 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dfbf314f9eb4599aa1f64e0098053f2, State: Initialized, Role: FOLLOWER
I20260709 12:28:48.634992 20065 consensus_queue.cc:260] T f6e468eccc244819925f994f88ded6c3 P 8dfbf314f9eb4599aa1f64e0098053f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:48.639441 20066 tablet_bootstrap.cc:654] T 5425b69fce0a4b0ab03c4f1849b882e1 P b2005221a1af4e559e0cb1cf28636c84: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:48.654791 20066 tablet_bootstrap.cc:492] T 5425b69fce0a4b0ab03c4f1849b882e1 P b2005221a1af4e559e0cb1cf28636c84: No bootstrap required, opened a new log
I20260709 12:28:48.655565 20066 ts_tablet_manager.cc:1403] T 5425b69fce0a4b0ab03c4f1849b882e1 P b2005221a1af4e559e0cb1cf28636c84: Time spent bootstrapping tablet: real 0.032s	user 0.014s	sys 0.007s
I20260709 12:28:48.656466 20065 ts_tablet_manager.cc:1434] T f6e468eccc244819925f994f88ded6c3 P 8dfbf314f9eb4599aa1f64e0098053f2: Time spent starting tablet: real 0.054s	user 0.003s	sys 0.006s
I20260709 12:28:48.657912 20065 tablet_bootstrap.cc:492] T f8c6d1c957af4a36b0793ce6bcd840fb P 8dfbf314f9eb4599aa1f64e0098053f2: Bootstrap starting.
I20260709 12:28:48.659993 20066 raft_consensus.cc:359] T 5425b69fce0a4b0ab03c4f1849b882e1 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:48.661183 20066 raft_consensus.cc:385] T 5425b69fce0a4b0ab03c4f1849b882e1 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:48.661582 20066 raft_consensus.cc:740] T 5425b69fce0a4b0ab03c4f1849b882e1 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2005221a1af4e559e0cb1cf28636c84, State: Initialized, Role: FOLLOWER
I20260709 12:28:48.664929 20062 tablet_bootstrap.cc:654] T 5425b69fce0a4b0ab03c4f1849b882e1 P 72b654ed19904db48b0a8e50fe4e12c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:48.662683 20066 consensus_queue.cc:260] T 5425b69fce0a4b0ab03c4f1849b882e1 P b2005221a1af4e559e0cb1cf28636c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:48.678934 20063 raft_consensus.cc:493] T f6e468eccc244819925f994f88ded6c3 P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:48.679541 20063 raft_consensus.cc:515] T f6e468eccc244819925f994f88ded6c3 P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:48.680284 20065 tablet_bootstrap.cc:654] T f8c6d1c957af4a36b0793ce6bcd840fb P 8dfbf314f9eb4599aa1f64e0098053f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:48.682376 20066 ts_tablet_manager.cc:1434] T 5425b69fce0a4b0ab03c4f1849b882e1 P b2005221a1af4e559e0cb1cf28636c84: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.003s
I20260709 12:28:48.683156 19831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e468eccc244819925f994f88ded6c3" candidate_uuid: "72b654ed19904db48b0a8e50fe4e12c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2005221a1af4e559e0cb1cf28636c84" is_pre_election: true
I20260709 12:28:48.683495 20066 tablet_bootstrap.cc:492] T f8c6d1c957af4a36b0793ce6bcd840fb P b2005221a1af4e559e0cb1cf28636c84: Bootstrap starting.
I20260709 12:28:48.683897 19831 raft_consensus.cc:2468] T f6e468eccc244819925f994f88ded6c3 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72b654ed19904db48b0a8e50fe4e12c7 in term 0.
I20260709 12:28:48.685871 19755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e468eccc244819925f994f88ded6c3" candidate_uuid: "72b654ed19904db48b0a8e50fe4e12c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" is_pre_election: true
I20260709 12:28:48.686581 19755 raft_consensus.cc:2468] T f6e468eccc244819925f994f88ded6c3 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72b654ed19904db48b0a8e50fe4e12c7 in term 0.
I20260709 12:28:48.689669 20063 leader_election.cc:290] T f6e468eccc244819925f994f88ded6c3 P 72b654ed19904db48b0a8e50fe4e12c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65:38251), b2005221a1af4e559e0cb1cf28636c84 (127.9.116.66:42783)
I20260709 12:28:48.688369 19869 leader_election.cc:304] T f6e468eccc244819925f994f88ded6c3 P 72b654ed19904db48b0a8e50fe4e12c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72b654ed19904db48b0a8e50fe4e12c7, b2005221a1af4e559e0cb1cf28636c84; no voters: 
I20260709 12:28:48.692111 20066 tablet_bootstrap.cc:654] T f8c6d1c957af4a36b0793ce6bcd840fb P b2005221a1af4e559e0cb1cf28636c84: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:48.692178 20063 raft_consensus.cc:2804] T f6e468eccc244819925f994f88ded6c3 P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:48.692734 20063 raft_consensus.cc:493] T f6e468eccc244819925f994f88ded6c3 P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:48.693425 20063 raft_consensus.cc:3060] T f6e468eccc244819925f994f88ded6c3 P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:48.706624 20062 tablet_bootstrap.cc:492] T 5425b69fce0a4b0ab03c4f1849b882e1 P 72b654ed19904db48b0a8e50fe4e12c7: No bootstrap required, opened a new log
I20260709 12:28:48.707620 20062 ts_tablet_manager.cc:1403] T 5425b69fce0a4b0ab03c4f1849b882e1 P 72b654ed19904db48b0a8e50fe4e12c7: Time spent bootstrapping tablet: real 0.091s	user 0.018s	sys 0.009s
I20260709 12:28:48.712260 20062 raft_consensus.cc:359] T 5425b69fce0a4b0ab03c4f1849b882e1 P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:48.713470 20062 raft_consensus.cc:385] T 5425b69fce0a4b0ab03c4f1849b882e1 P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:48.713883 20062 raft_consensus.cc:740] T 5425b69fce0a4b0ab03c4f1849b882e1 P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72b654ed19904db48b0a8e50fe4e12c7, State: Initialized, Role: FOLLOWER
I20260709 12:28:48.716642 20063 raft_consensus.cc:515] T f6e468eccc244819925f994f88ded6c3 P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:48.718741 20060 raft_consensus.cc:493] T 787520b5a0c64085a72e995881511ca5 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:48.719472 20060 raft_consensus.cc:515] T 787520b5a0c64085a72e995881511ca5 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:48.721048 19755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e468eccc244819925f994f88ded6c3" candidate_uuid: "72b654ed19904db48b0a8e50fe4e12c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dfbf314f9eb4599aa1f64e0098053f2"
I20260709 12:28:48.721956 19755 raft_consensus.cc:3060] T f6e468eccc244819925f994f88ded6c3 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:48.723768 19756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787520b5a0c64085a72e995881511ca5" candidate_uuid: "b2005221a1af4e559e0cb1cf28636c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" is_pre_election: true
I20260709 12:28:48.725354 20071 raft_consensus.cc:493] T d9f35e5399fd49539418b54e24f94016 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:48.726095 20071 raft_consensus.cc:515] T d9f35e5399fd49539418b54e24f94016 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:48.731176 19831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9f35e5399fd49539418b54e24f94016" candidate_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2005221a1af4e559e0cb1cf28636c84" is_pre_election: true
I20260709 12:28:48.733404 20063 leader_election.cc:290] T f6e468eccc244819925f994f88ded6c3 P 72b654ed19904db48b0a8e50fe4e12c7 [CANDIDATE]: Term 1 election: Requested vote from peers 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65:38251), b2005221a1af4e559e0cb1cf28636c84 (127.9.116.66:42783)
W20260709 12:28:48.733971 19719 leader_election.cc:343] T d9f35e5399fd49539418b54e24f94016 P 8dfbf314f9eb4599aa1f64e0098053f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2005221a1af4e559e0cb1cf28636c84 (127.9.116.66:42783): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:48.734349 20062 consensus_queue.cc:260] T 5425b69fce0a4b0ab03c4f1849b882e1 P 72b654ed19904db48b0a8e50fe4e12c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
W20260709 12:28:48.735517 19795 leader_election.cc:343] T 787520b5a0c64085a72e995881511ca5 P b2005221a1af4e559e0cb1cf28636c84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65:38251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:48.736586 20066 tablet_bootstrap.cc:492] T f8c6d1c957af4a36b0793ce6bcd840fb P b2005221a1af4e559e0cb1cf28636c84: No bootstrap required, opened a new log
I20260709 12:28:48.737241 20066 ts_tablet_manager.cc:1403] T f8c6d1c957af4a36b0793ce6bcd840fb P b2005221a1af4e559e0cb1cf28636c84: Time spent bootstrapping tablet: real 0.054s	user 0.034s	sys 0.016s
I20260709 12:28:48.738283 20060 leader_election.cc:290] T 787520b5a0c64085a72e995881511ca5 P b2005221a1af4e559e0cb1cf28636c84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65:38251), 72b654ed19904db48b0a8e50fe4e12c7 (127.9.116.67:34699)
I20260709 12:28:48.739667 19755 raft_consensus.cc:2468] T f6e468eccc244819925f994f88ded6c3 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72b654ed19904db48b0a8e50fe4e12c7 in term 1.
I20260709 12:28:48.737016 19831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e468eccc244819925f994f88ded6c3" candidate_uuid: "72b654ed19904db48b0a8e50fe4e12c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2005221a1af4e559e0cb1cf28636c84"
I20260709 12:28:48.740373 19831 raft_consensus.cc:3060] T f6e468eccc244819925f994f88ded6c3 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:48.740464 19904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787520b5a0c64085a72e995881511ca5" candidate_uuid: "b2005221a1af4e559e0cb1cf28636c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72b654ed19904db48b0a8e50fe4e12c7" is_pre_election: true
I20260709 12:28:48.737273 20062 ts_tablet_manager.cc:1434] T 5425b69fce0a4b0ab03c4f1849b882e1 P 72b654ed19904db48b0a8e50fe4e12c7: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 12:28:48.741050 19870 leader_election.cc:304] T f6e468eccc244819925f994f88ded6c3 P 72b654ed19904db48b0a8e50fe4e12c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72b654ed19904db48b0a8e50fe4e12c7, 8dfbf314f9eb4599aa1f64e0098053f2; no voters: 
I20260709 12:28:48.742069 20062 tablet_bootstrap.cc:492] T 65b2b8f9a0944d1a94ae5e90b9656f7c P 72b654ed19904db48b0a8e50fe4e12c7: Bootstrap starting.
W20260709 12:28:48.742349 19794 leader_election.cc:343] T 787520b5a0c64085a72e995881511ca5 P b2005221a1af4e559e0cb1cf28636c84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72b654ed19904db48b0a8e50fe4e12c7 (127.9.116.67:34699): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:48.742808 19794 leader_election.cc:304] T 787520b5a0c64085a72e995881511ca5 P b2005221a1af4e559e0cb1cf28636c84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2005221a1af4e559e0cb1cf28636c84; no voters: 72b654ed19904db48b0a8e50fe4e12c7, 8dfbf314f9eb4599aa1f64e0098053f2
I20260709 12:28:48.744335 20066 raft_consensus.cc:359] T f8c6d1c957af4a36b0793ce6bcd840fb P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:48.744946 20071 leader_election.cc:290] T d9f35e5399fd49539418b54e24f94016 P 8dfbf314f9eb4599aa1f64e0098053f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2005221a1af4e559e0cb1cf28636c84 (127.9.116.66:42783), 72b654ed19904db48b0a8e50fe4e12c7 (127.9.116.67:34699)
I20260709 12:28:48.745129 20066 raft_consensus.cc:385] T f8c6d1c957af4a36b0793ce6bcd840fb P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:48.745529 20063 raft_consensus.cc:2804] T f6e468eccc244819925f994f88ded6c3 P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:48.747956 20060 raft_consensus.cc:2749] T 787520b5a0c64085a72e995881511ca5 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:48.754082 20062 tablet_bootstrap.cc:654] T 65b2b8f9a0944d1a94ae5e90b9656f7c P 72b654ed19904db48b0a8e50fe4e12c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:48.745913 20066 raft_consensus.cc:740] T f8c6d1c957af4a36b0793ce6bcd840fb P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2005221a1af4e559e0cb1cf28636c84, State: Initialized, Role: FOLLOWER
I20260709 12:28:48.748023 20063 raft_consensus.cc:697] T f6e468eccc244819925f994f88ded6c3 P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 LEADER]: Becoming Leader. State: Replica: 72b654ed19904db48b0a8e50fe4e12c7, State: Running, Role: LEADER
I20260709 12:28:48.755414 20063 consensus_queue.cc:237] T f6e468eccc244819925f994f88ded6c3 P 72b654ed19904db48b0a8e50fe4e12c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:48.757541 20060 raft_consensus.cc:493] T 65b2b8f9a0944d1a94ae5e90b9656f7c P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:48.758106 20060 raft_consensus.cc:515] T 65b2b8f9a0944d1a94ae5e90b9656f7c P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:48.758344 19831 raft_consensus.cc:2468] T f6e468eccc244819925f994f88ded6c3 P b2005221a1af4e559e0cb1cf28636c84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72b654ed19904db48b0a8e50fe4e12c7 in term 1.
I20260709 12:28:48.749769 19904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9f35e5399fd49539418b54e24f94016" candidate_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72b654ed19904db48b0a8e50fe4e12c7" is_pre_election: true
I20260709 12:28:48.759126 20065 tablet_bootstrap.cc:492] T f8c6d1c957af4a36b0793ce6bcd840fb P 8dfbf314f9eb4599aa1f64e0098053f2: No bootstrap required, opened a new log
I20260709 12:28:48.759451 19904 raft_consensus.cc:2468] T d9f35e5399fd49539418b54e24f94016 P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dfbf314f9eb4599aa1f64e0098053f2 in term 0.
I20260709 12:28:48.760157 20065 ts_tablet_manager.cc:1403] T f8c6d1c957af4a36b0793ce6bcd840fb P 8dfbf314f9eb4599aa1f64e0098053f2: Time spent bootstrapping tablet: real 0.102s	user 0.026s	sys 0.029s
I20260709 12:28:48.760703 20060 leader_election.cc:290] T 65b2b8f9a0944d1a94ae5e90b9656f7c P b2005221a1af4e559e0cb1cf28636c84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65:38251), 72b654ed19904db48b0a8e50fe4e12c7 (127.9.116.67:34699)
I20260709 12:28:48.756608 20066 consensus_queue.cc:260] T f8c6d1c957af4a36b0793ce6bcd840fb P b2005221a1af4e559e0cb1cf28636c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:48.761554 19719 leader_election.cc:304] T d9f35e5399fd49539418b54e24f94016 P 8dfbf314f9eb4599aa1f64e0098053f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72b654ed19904db48b0a8e50fe4e12c7, 8dfbf314f9eb4599aa1f64e0098053f2; no voters: b2005221a1af4e559e0cb1cf28636c84
I20260709 12:28:48.761898 19904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65b2b8f9a0944d1a94ae5e90b9656f7c" candidate_uuid: "b2005221a1af4e559e0cb1cf28636c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72b654ed19904db48b0a8e50fe4e12c7" is_pre_election: true
I20260709 12:28:48.762899 20071 raft_consensus.cc:2804] T d9f35e5399fd49539418b54e24f94016 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:48.763291 20071 raft_consensus.cc:493] T d9f35e5399fd49539418b54e24f94016 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:28:48.763499 19794 leader_election.cc:343] T 65b2b8f9a0944d1a94ae5e90b9656f7c P b2005221a1af4e559e0cb1cf28636c84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72b654ed19904db48b0a8e50fe4e12c7 (127.9.116.67:34699): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:48.761504 19755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65b2b8f9a0944d1a94ae5e90b9656f7c" candidate_uuid: "b2005221a1af4e559e0cb1cf28636c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" is_pre_election: true
I20260709 12:28:48.764233 20071 raft_consensus.cc:3060] T d9f35e5399fd49539418b54e24f94016 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:48.764637 19755 raft_consensus.cc:2468] T 65b2b8f9a0944d1a94ae5e90b9656f7c P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2005221a1af4e559e0cb1cf28636c84 in term 0.
I20260709 12:28:48.766942 20065 raft_consensus.cc:359] T f8c6d1c957af4a36b0793ce6bcd840fb P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:48.768821 19795 leader_election.cc:304] T 65b2b8f9a0944d1a94ae5e90b9656f7c P b2005221a1af4e559e0cb1cf28636c84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dfbf314f9eb4599aa1f64e0098053f2, b2005221a1af4e559e0cb1cf28636c84; no voters: 72b654ed19904db48b0a8e50fe4e12c7
I20260709 12:28:48.779357 20060 raft_consensus.cc:2804] T 65b2b8f9a0944d1a94ae5e90b9656f7c P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:48.779834 20065 raft_consensus.cc:385] T f8c6d1c957af4a36b0793ce6bcd840fb P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:48.782415 20065 raft_consensus.cc:740] T f8c6d1c957af4a36b0793ce6bcd840fb P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dfbf314f9eb4599aa1f64e0098053f2, State: Initialized, Role: FOLLOWER
I20260709 12:28:48.783361 20065 consensus_queue.cc:260] T f8c6d1c957af4a36b0793ce6bcd840fb P 8dfbf314f9eb4599aa1f64e0098053f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:48.786046 20065 ts_tablet_manager.cc:1434] T f8c6d1c957af4a36b0793ce6bcd840fb P 8dfbf314f9eb4599aa1f64e0098053f2: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 12:28:48.779963 20060 raft_consensus.cc:493] T 65b2b8f9a0944d1a94ae5e90b9656f7c P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:48.786541 20060 raft_consensus.cc:3060] T 65b2b8f9a0944d1a94ae5e90b9656f7c P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:48.776520 20071 raft_consensus.cc:515] T d9f35e5399fd49539418b54e24f94016 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:48.797884 20065 tablet_bootstrap.cc:492] T eecd23b305744bcabbef1e2e5cd206ce P 8dfbf314f9eb4599aa1f64e0098053f2: Bootstrap starting.
I20260709 12:28:48.795063 20060 raft_consensus.cc:515] T 65b2b8f9a0944d1a94ae5e90b9656f7c P b2005221a1af4e559e0cb1cf28636c84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:48.802516 19904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9f35e5399fd49539418b54e24f94016" candidate_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72b654ed19904db48b0a8e50fe4e12c7"
I20260709 12:28:48.803285 19904 raft_consensus.cc:3060] T d9f35e5399fd49539418b54e24f94016 P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:48.798846 20071 leader_election.cc:290] T d9f35e5399fd49539418b54e24f94016 P 8dfbf314f9eb4599aa1f64e0098053f2 [CANDIDATE]: Term 1 election: Requested vote from peers b2005221a1af4e559e0cb1cf28636c84 (127.9.116.66:42783), 72b654ed19904db48b0a8e50fe4e12c7 (127.9.116.67:34699)
I20260709 12:28:48.804009 19830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9f35e5399fd49539418b54e24f94016" candidate_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2005221a1af4e559e0cb1cf28636c84"
I20260709 12:28:48.805873 19905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65b2b8f9a0944d1a94ae5e90b9656f7c" candidate_uuid: "b2005221a1af4e559e0cb1cf28636c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72b654ed19904db48b0a8e50fe4e12c7"
I20260709 12:28:48.795680 19652 catalog_manager.cc:5697] T f6e468eccc244819925f994f88ded6c3 P 72b654ed19904db48b0a8e50fe4e12c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72b654ed19904db48b0a8e50fe4e12c7 (127.9.116.67). New cstate: current_term: 1 leader_uuid: "72b654ed19904db48b0a8e50fe4e12c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:48.804845 19755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65b2b8f9a0944d1a94ae5e90b9656f7c" candidate_uuid: "b2005221a1af4e559e0cb1cf28636c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dfbf314f9eb4599aa1f64e0098053f2"
I20260709 12:28:48.812059 19755 raft_consensus.cc:3060] T 65b2b8f9a0944d1a94ae5e90b9656f7c P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:48.812316 20065 tablet_bootstrap.cc:654] T eecd23b305744bcabbef1e2e5cd206ce P 8dfbf314f9eb4599aa1f64e0098053f2: Neither blocks nor log segments found. Creating new log.
W20260709 12:28:48.816316 19794 leader_election.cc:343] T 65b2b8f9a0944d1a94ae5e90b9656f7c P b2005221a1af4e559e0cb1cf28636c84 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 72b654ed19904db48b0a8e50fe4e12c7 (127.9.116.67:34699): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:48.804608 20060 leader_election.cc:290] T 65b2b8f9a0944d1a94ae5e90b9656f7c P b2005221a1af4e559e0cb1cf28636c84 [CANDIDATE]: Term 1 election: Requested vote from peers 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65:38251), 72b654ed19904db48b0a8e50fe4e12c7 (127.9.116.67:34699)
I20260709 12:28:48.817329 20062 tablet_bootstrap.cc:492] T 65b2b8f9a0944d1a94ae5e90b9656f7c P 72b654ed19904db48b0a8e50fe4e12c7: No bootstrap required, opened a new log
W20260709 12:28:48.817656 19719 leader_election.cc:343] T d9f35e5399fd49539418b54e24f94016 P 8dfbf314f9eb4599aa1f64e0098053f2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2005221a1af4e559e0cb1cf28636c84 (127.9.116.66:42783): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:48.817881 20062 ts_tablet_manager.cc:1403] T 65b2b8f9a0944d1a94ae5e90b9656f7c P 72b654ed19904db48b0a8e50fe4e12c7: Time spent bootstrapping tablet: real 0.076s	user 0.024s	sys 0.012s
I20260709 12:28:48.763391 20066 ts_tablet_manager.cc:1434] T f8c6d1c957af4a36b0793ce6bcd840fb P b2005221a1af4e559e0cb1cf28636c84: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.001s
I20260709 12:28:48.821125 20062 raft_consensus.cc:359] T 65b2b8f9a0944d1a94ae5e90b9656f7c P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:48.822024 20062 raft_consensus.cc:385] T 65b2b8f9a0944d1a94ae5e90b9656f7c P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:48.822335 20062 raft_consensus.cc:740] T 65b2b8f9a0944d1a94ae5e90b9656f7c P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72b654ed19904db48b0a8e50fe4e12c7, State: Initialized, Role: FOLLOWER
I20260709 12:28:48.823170 20062 consensus_queue.cc:260] T 65b2b8f9a0944d1a94ae5e90b9656f7c P 72b654ed19904db48b0a8e50fe4e12c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:48.825752 20062 ts_tablet_manager.cc:1434] T 65b2b8f9a0944d1a94ae5e90b9656f7c P 72b654ed19904db48b0a8e50fe4e12c7: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:28:48.822335 20066 tablet_bootstrap.cc:492] T d9f35e5399fd49539418b54e24f94016 P b2005221a1af4e559e0cb1cf28636c84: Bootstrap starting.
I20260709 12:28:48.826848 20062 tablet_bootstrap.cc:492] T 331c202d5bec4f76a11791c0f101dfd5 P 72b654ed19904db48b0a8e50fe4e12c7: Bootstrap starting.
I20260709 12:28:48.827536 19755 raft_consensus.cc:2468] T 65b2b8f9a0944d1a94ae5e90b9656f7c P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2005221a1af4e559e0cb1cf28636c84 in term 1.
I20260709 12:28:48.831691 19795 leader_election.cc:304] T 65b2b8f9a0944d1a94ae5e90b9656f7c P b2005221a1af4e559e0cb1cf28636c84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dfbf314f9eb4599aa1f64e0098053f2, b2005221a1af4e559e0cb1cf28636c84; no voters: 72b654ed19904db48b0a8e50fe4e12c7
I20260709 12:28:48.833156 20060 raft_consensus.cc:2804] T 65b2b8f9a0944d1a94ae5e90b9656f7c P b2005221a1af4e559e0cb1cf28636c84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:48.830053 19904 raft_consensus.cc:2468] T d9f35e5399fd49539418b54e24f94016 P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dfbf314f9eb4599aa1f64e0098053f2 in term 1.
I20260709 12:28:48.840780 19719 leader_election.cc:304] T d9f35e5399fd49539418b54e24f94016 P 8dfbf314f9eb4599aa1f64e0098053f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72b654ed19904db48b0a8e50fe4e12c7, 8dfbf314f9eb4599aa1f64e0098053f2; no voters: b2005221a1af4e559e0cb1cf28636c84
I20260709 12:28:48.842236 20071 raft_consensus.cc:2804] T d9f35e5399fd49539418b54e24f94016 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:48.843151 20071 raft_consensus.cc:697] T d9f35e5399fd49539418b54e24f94016 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 LEADER]: Becoming Leader. State: Replica: 8dfbf314f9eb4599aa1f64e0098053f2, State: Running, Role: LEADER
I20260709 12:28:48.842882 20066 tablet_bootstrap.cc:654] T d9f35e5399fd49539418b54e24f94016 P b2005221a1af4e559e0cb1cf28636c84: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:48.844417 20071 consensus_queue.cc:237] T d9f35e5399fd49539418b54e24f94016 P 8dfbf314f9eb4599aa1f64e0098053f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:48.846474 20062 tablet_bootstrap.cc:654] T 331c202d5bec4f76a11791c0f101dfd5 P 72b654ed19904db48b0a8e50fe4e12c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:48.851714 20060 raft_consensus.cc:697] T 65b2b8f9a0944d1a94ae5e90b9656f7c P b2005221a1af4e559e0cb1cf28636c84 [term 1 LEADER]: Becoming Leader. State: Replica: b2005221a1af4e559e0cb1cf28636c84, State: Running, Role: LEADER
I20260709 12:28:48.853063 20060 consensus_queue.cc:237] T 65b2b8f9a0944d1a94ae5e90b9656f7c P b2005221a1af4e559e0cb1cf28636c84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:48.861661 20065 tablet_bootstrap.cc:492] T eecd23b305744bcabbef1e2e5cd206ce P 8dfbf314f9eb4599aa1f64e0098053f2: No bootstrap required, opened a new log
I20260709 12:28:48.862311 20065 ts_tablet_manager.cc:1403] T eecd23b305744bcabbef1e2e5cd206ce P 8dfbf314f9eb4599aa1f64e0098053f2: Time spent bootstrapping tablet: real 0.065s	user 0.021s	sys 0.010s
I20260709 12:28:48.862699 20066 tablet_bootstrap.cc:492] T d9f35e5399fd49539418b54e24f94016 P b2005221a1af4e559e0cb1cf28636c84: No bootstrap required, opened a new log
I20260709 12:28:48.863262 20066 ts_tablet_manager.cc:1403] T d9f35e5399fd49539418b54e24f94016 P b2005221a1af4e559e0cb1cf28636c84: Time spent bootstrapping tablet: real 0.041s	user 0.011s	sys 0.013s
I20260709 12:28:48.865752 20065 raft_consensus.cc:359] T eecd23b305744bcabbef1e2e5cd206ce P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:48.866670 20065 raft_consensus.cc:385] T eecd23b305744bcabbef1e2e5cd206ce P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:48.866155 19652 catalog_manager.cc:5697] T d9f35e5399fd49539418b54e24f94016 P 8dfbf314f9eb4599aa1f64e0098053f2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65). New cstate: current_term: 1 leader_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:48.867017 20065 raft_consensus.cc:740] T eecd23b305744bcabbef1e2e5cd206ce P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dfbf314f9eb4599aa1f64e0098053f2, State: Initialized, Role: FOLLOWER
I20260709 12:28:48.867966 20093 raft_consensus.cc:493] T 5425b69fce0a4b0ab03c4f1849b882e1 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:48.868404 20062 tablet_bootstrap.cc:492] T 331c202d5bec4f76a11791c0f101dfd5 P 72b654ed19904db48b0a8e50fe4e12c7: No bootstrap required, opened a new log
I20260709 12:28:48.868908 20093 raft_consensus.cc:515] T 5425b69fce0a4b0ab03c4f1849b882e1 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:48.869168 20062 ts_tablet_manager.cc:1403] T 331c202d5bec4f76a11791c0f101dfd5 P 72b654ed19904db48b0a8e50fe4e12c7: Time spent bootstrapping tablet: real 0.043s	user 0.014s	sys 0.004s
I20260709 12:28:48.866679 20066 raft_consensus.cc:359] T d9f35e5399fd49539418b54e24f94016 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:48.872403 20066 raft_consensus.cc:385] T d9f35e5399fd49539418b54e24f94016 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:48.873095 20066 raft_consensus.cc:740] T d9f35e5399fd49539418b54e24f94016 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2005221a1af4e559e0cb1cf28636c84, State: Initialized, Role: FOLLOWER
I20260709 12:28:48.868342 20065 consensus_queue.cc:260] T eecd23b305744bcabbef1e2e5cd206ce P 8dfbf314f9eb4599aa1f64e0098053f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:48.874047 20066 consensus_queue.cc:260] T d9f35e5399fd49539418b54e24f94016 P b2005221a1af4e559e0cb1cf28636c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:48.876678 20066 ts_tablet_manager.cc:1434] T d9f35e5399fd49539418b54e24f94016 P b2005221a1af4e559e0cb1cf28636c84: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:28:48.876899 20065 ts_tablet_manager.cc:1434] T eecd23b305744bcabbef1e2e5cd206ce P 8dfbf314f9eb4599aa1f64e0098053f2: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:28:48.875981 20062 raft_consensus.cc:359] T 331c202d5bec4f76a11791c0f101dfd5 P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:48.878100 20066 tablet_bootstrap.cc:492] T 331c202d5bec4f76a11791c0f101dfd5 P b2005221a1af4e559e0cb1cf28636c84: Bootstrap starting.
I20260709 12:28:48.878427 20062 raft_consensus.cc:385] T 331c202d5bec4f76a11791c0f101dfd5 P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:48.878831 20062 raft_consensus.cc:740] T 331c202d5bec4f76a11791c0f101dfd5 P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72b654ed19904db48b0a8e50fe4e12c7, State: Initialized, Role: FOLLOWER
I20260709 12:28:48.879719 20062 consensus_queue.cc:260] T 331c202d5bec4f76a11791c0f101dfd5 P 72b654ed19904db48b0a8e50fe4e12c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:48.880288 19755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5425b69fce0a4b0ab03c4f1849b882e1" candidate_uuid: "b2005221a1af4e559e0cb1cf28636c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" is_pre_election: true
I20260709 12:28:48.881058 19755 raft_consensus.cc:2468] T 5425b69fce0a4b0ab03c4f1849b882e1 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2005221a1af4e559e0cb1cf28636c84 in term 0.
I20260709 12:28:48.882783 20062 ts_tablet_manager.cc:1434] T 331c202d5bec4f76a11791c0f101dfd5 P 72b654ed19904db48b0a8e50fe4e12c7: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:28:48.878131 20065 tablet_bootstrap.cc:492] T 2af1d81129aa40cfb84440644ae99bc5 P 8dfbf314f9eb4599aa1f64e0098053f2: Bootstrap starting.
I20260709 12:28:48.884464 19795 leader_election.cc:304] T 5425b69fce0a4b0ab03c4f1849b882e1 P b2005221a1af4e559e0cb1cf28636c84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dfbf314f9eb4599aa1f64e0098053f2, b2005221a1af4e559e0cb1cf28636c84; no voters: 
I20260709 12:28:48.885311 20066 tablet_bootstrap.cc:654] T 331c202d5bec4f76a11791c0f101dfd5 P b2005221a1af4e559e0cb1cf28636c84: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:48.885479 20060 raft_consensus.cc:2804] T 5425b69fce0a4b0ab03c4f1849b882e1 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:48.886015 20060 raft_consensus.cc:493] T 5425b69fce0a4b0ab03c4f1849b882e1 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:48.882856 19651 catalog_manager.cc:5697] T 65b2b8f9a0944d1a94ae5e90b9656f7c P b2005221a1af4e559e0cb1cf28636c84 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2005221a1af4e559e0cb1cf28636c84 (127.9.116.66). New cstate: current_term: 1 leader_uuid: "b2005221a1af4e559e0cb1cf28636c84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:48.886464 20060 raft_consensus.cc:3060] T 5425b69fce0a4b0ab03c4f1849b882e1 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:48.884465 20062 tablet_bootstrap.cc:492] T 787520b5a0c64085a72e995881511ca5 P 72b654ed19904db48b0a8e50fe4e12c7: Bootstrap starting.
I20260709 12:28:48.904235 20093 leader_election.cc:290] T 5425b69fce0a4b0ab03c4f1849b882e1 P b2005221a1af4e559e0cb1cf28636c84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65:38251), 72b654ed19904db48b0a8e50fe4e12c7 (127.9.116.67:34699)
I20260709 12:28:48.906198 20060 raft_consensus.cc:515] T 5425b69fce0a4b0ab03c4f1849b882e1 P b2005221a1af4e559e0cb1cf28636c84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:48.920235 20062 tablet_bootstrap.cc:654] T 787520b5a0c64085a72e995881511ca5 P 72b654ed19904db48b0a8e50fe4e12c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:48.922485 20065 tablet_bootstrap.cc:654] T 2af1d81129aa40cfb84440644ae99bc5 P 8dfbf314f9eb4599aa1f64e0098053f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:48.928267 19755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5425b69fce0a4b0ab03c4f1849b882e1" candidate_uuid: "b2005221a1af4e559e0cb1cf28636c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dfbf314f9eb4599aa1f64e0098053f2"
I20260709 12:28:48.929018 19755 raft_consensus.cc:3060] T 5425b69fce0a4b0ab03c4f1849b882e1 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:48.929534 19904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5425b69fce0a4b0ab03c4f1849b882e1" candidate_uuid: "b2005221a1af4e559e0cb1cf28636c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72b654ed19904db48b0a8e50fe4e12c7" is_pre_election: true
I20260709 12:28:48.930473 19904 raft_consensus.cc:2468] T 5425b69fce0a4b0ab03c4f1849b882e1 P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2005221a1af4e559e0cb1cf28636c84 in term 0.
I20260709 12:28:48.937294 20066 tablet_bootstrap.cc:492] T 331c202d5bec4f76a11791c0f101dfd5 P b2005221a1af4e559e0cb1cf28636c84: No bootstrap required, opened a new log
I20260709 12:28:48.937889 20066 ts_tablet_manager.cc:1403] T 331c202d5bec4f76a11791c0f101dfd5 P b2005221a1af4e559e0cb1cf28636c84: Time spent bootstrapping tablet: real 0.060s	user 0.023s	sys 0.023s
I20260709 12:28:48.940871 20066 raft_consensus.cc:359] T 331c202d5bec4f76a11791c0f101dfd5 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:48.941567 20066 raft_consensus.cc:385] T 331c202d5bec4f76a11791c0f101dfd5 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:48.941840 20066 raft_consensus.cc:740] T 331c202d5bec4f76a11791c0f101dfd5 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2005221a1af4e559e0cb1cf28636c84, State: Initialized, Role: FOLLOWER
I20260709 12:28:48.942687 20066 consensus_queue.cc:260] T 331c202d5bec4f76a11791c0f101dfd5 P b2005221a1af4e559e0cb1cf28636c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:48.947751 20066 ts_tablet_manager.cc:1434] T 331c202d5bec4f76a11791c0f101dfd5 P b2005221a1af4e559e0cb1cf28636c84: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 12:28:48.951107 20060 leader_election.cc:290] T 5425b69fce0a4b0ab03c4f1849b882e1 P b2005221a1af4e559e0cb1cf28636c84 [CANDIDATE]: Term 1 election: Requested vote from peers 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65:38251), 72b654ed19904db48b0a8e50fe4e12c7 (127.9.116.67:34699)
I20260709 12:28:48.953382 19904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5425b69fce0a4b0ab03c4f1849b882e1" candidate_uuid: "b2005221a1af4e559e0cb1cf28636c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72b654ed19904db48b0a8e50fe4e12c7"
I20260709 12:28:48.954358 19755 raft_consensus.cc:2468] T 5425b69fce0a4b0ab03c4f1849b882e1 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2005221a1af4e559e0cb1cf28636c84 in term 1.
I20260709 12:28:48.954687 19904 raft_consensus.cc:3060] T 5425b69fce0a4b0ab03c4f1849b882e1 P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:48.956338 19795 leader_election.cc:304] T 5425b69fce0a4b0ab03c4f1849b882e1 P b2005221a1af4e559e0cb1cf28636c84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dfbf314f9eb4599aa1f64e0098053f2, b2005221a1af4e559e0cb1cf28636c84; no voters: 
I20260709 12:28:48.957484 20098 raft_consensus.cc:2804] T 5425b69fce0a4b0ab03c4f1849b882e1 P b2005221a1af4e559e0cb1cf28636c84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:48.958060 20098 raft_consensus.cc:697] T 5425b69fce0a4b0ab03c4f1849b882e1 P b2005221a1af4e559e0cb1cf28636c84 [term 1 LEADER]: Becoming Leader. State: Replica: b2005221a1af4e559e0cb1cf28636c84, State: Running, Role: LEADER
I20260709 12:28:48.959230 20098 consensus_queue.cc:237] T 5425b69fce0a4b0ab03c4f1849b882e1 P b2005221a1af4e559e0cb1cf28636c84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:48.960881 20065 tablet_bootstrap.cc:492] T 2af1d81129aa40cfb84440644ae99bc5 P 8dfbf314f9eb4599aa1f64e0098053f2: No bootstrap required, opened a new log
I20260709 12:28:48.961678 20065 ts_tablet_manager.cc:1403] T 2af1d81129aa40cfb84440644ae99bc5 P 8dfbf314f9eb4599aa1f64e0098053f2: Time spent bootstrapping tablet: real 0.084s	user 0.024s	sys 0.003s
I20260709 12:28:48.966264 20065 raft_consensus.cc:359] T 2af1d81129aa40cfb84440644ae99bc5 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:48.967145 20065 raft_consensus.cc:385] T 2af1d81129aa40cfb84440644ae99bc5 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:48.967612 20065 raft_consensus.cc:740] T 2af1d81129aa40cfb84440644ae99bc5 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dfbf314f9eb4599aa1f64e0098053f2, State: Initialized, Role: FOLLOWER
I20260709 12:28:48.969235 20065 consensus_queue.cc:260] T 2af1d81129aa40cfb84440644ae99bc5 P 8dfbf314f9eb4599aa1f64e0098053f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:48.971068 19904 raft_consensus.cc:2468] T 5425b69fce0a4b0ab03c4f1849b882e1 P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2005221a1af4e559e0cb1cf28636c84 in term 1.
I20260709 12:28:48.973029 20098 raft_consensus.cc:493] T 2af1d81129aa40cfb84440644ae99bc5 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:48.975499 20098 raft_consensus.cc:515] T 2af1d81129aa40cfb84440644ae99bc5 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:48.973579 20062 tablet_bootstrap.cc:492] T 787520b5a0c64085a72e995881511ca5 P 72b654ed19904db48b0a8e50fe4e12c7: No bootstrap required, opened a new log
I20260709 12:28:48.977002 20062 ts_tablet_manager.cc:1403] T 787520b5a0c64085a72e995881511ca5 P 72b654ed19904db48b0a8e50fe4e12c7: Time spent bootstrapping tablet: real 0.093s	user 0.020s	sys 0.008s
I20260709 12:28:48.978509 20098 leader_election.cc:290] T 2af1d81129aa40cfb84440644ae99bc5 P b2005221a1af4e559e0cb1cf28636c84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65:38251), 72b654ed19904db48b0a8e50fe4e12c7 (127.9.116.67:34699)
I20260709 12:28:48.981240 20062 raft_consensus.cc:359] T 787520b5a0c64085a72e995881511ca5 P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:48.981648 19904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af1d81129aa40cfb84440644ae99bc5" candidate_uuid: "b2005221a1af4e559e0cb1cf28636c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72b654ed19904db48b0a8e50fe4e12c7" is_pre_election: true
I20260709 12:28:48.982019 20062 raft_consensus.cc:385] T 787520b5a0c64085a72e995881511ca5 P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:48.982008 19755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af1d81129aa40cfb84440644ae99bc5" candidate_uuid: "b2005221a1af4e559e0cb1cf28636c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" is_pre_election: true
I20260709 12:28:48.982594 20062 raft_consensus.cc:740] T 787520b5a0c64085a72e995881511ca5 P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72b654ed19904db48b0a8e50fe4e12c7, State: Initialized, Role: FOLLOWER
I20260709 12:28:48.982935 19755 raft_consensus.cc:2468] T 2af1d81129aa40cfb84440644ae99bc5 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2005221a1af4e559e0cb1cf28636c84 in term 0.
I20260709 12:28:48.979502 19651 catalog_manager.cc:5697] T 5425b69fce0a4b0ab03c4f1849b882e1 P b2005221a1af4e559e0cb1cf28636c84 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2005221a1af4e559e0cb1cf28636c84 (127.9.116.66). New cstate: current_term: 1 leader_uuid: "b2005221a1af4e559e0cb1cf28636c84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } health_report { overall_health: UNKNOWN } } }
W20260709 12:28:48.983242 19794 leader_election.cc:343] T 2af1d81129aa40cfb84440644ae99bc5 P b2005221a1af4e559e0cb1cf28636c84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72b654ed19904db48b0a8e50fe4e12c7 (127.9.116.67:34699): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:48.984318 19795 leader_election.cc:304] T 2af1d81129aa40cfb84440644ae99bc5 P b2005221a1af4e559e0cb1cf28636c84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dfbf314f9eb4599aa1f64e0098053f2, b2005221a1af4e559e0cb1cf28636c84; no voters: 72b654ed19904db48b0a8e50fe4e12c7
I20260709 12:28:48.984484 20062 consensus_queue.cc:260] T 787520b5a0c64085a72e995881511ca5 P 72b654ed19904db48b0a8e50fe4e12c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:48.980471 20065 ts_tablet_manager.cc:1434] T 2af1d81129aa40cfb84440644ae99bc5 P 8dfbf314f9eb4599aa1f64e0098053f2: Time spent starting tablet: real 0.018s	user 0.011s	sys 0.000s
I20260709 12:28:48.987095 20065 tablet_bootstrap.cc:492] T 787520b5a0c64085a72e995881511ca5 P 8dfbf314f9eb4599aa1f64e0098053f2: Bootstrap starting.
I20260709 12:28:48.979544 20060 raft_consensus.cc:493] T d9f35e5399fd49539418b54e24f94016 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:48.987702 20062 ts_tablet_manager.cc:1434] T 787520b5a0c64085a72e995881511ca5 P 72b654ed19904db48b0a8e50fe4e12c7: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 12:28:48.987962 20060 raft_consensus.cc:515] T d9f35e5399fd49539418b54e24f94016 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:48.989494 20062 tablet_bootstrap.cc:492] T 2af1d81129aa40cfb84440644ae99bc5 P 72b654ed19904db48b0a8e50fe4e12c7: Bootstrap starting.
I20260709 12:28:48.990651 20060 leader_election.cc:290] T d9f35e5399fd49539418b54e24f94016 P b2005221a1af4e559e0cb1cf28636c84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65:38251), 72b654ed19904db48b0a8e50fe4e12c7 (127.9.116.67:34699)
I20260709 12:28:48.991269 20060 raft_consensus.cc:2804] T 2af1d81129aa40cfb84440644ae99bc5 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:48.991648 20060 raft_consensus.cc:493] T 2af1d81129aa40cfb84440644ae99bc5 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:48.992002 20060 raft_consensus.cc:3060] T 2af1d81129aa40cfb84440644ae99bc5 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:48.992769 19756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9f35e5399fd49539418b54e24f94016" candidate_uuid: "b2005221a1af4e559e0cb1cf28636c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" is_pre_election: true
I20260709 12:28:48.992126 19904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9f35e5399fd49539418b54e24f94016" candidate_uuid: "b2005221a1af4e559e0cb1cf28636c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72b654ed19904db48b0a8e50fe4e12c7" is_pre_election: true
I20260709 12:28:48.994092 19904 raft_consensus.cc:2393] T d9f35e5399fd49539418b54e24f94016 P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2005221a1af4e559e0cb1cf28636c84 in current term 1: Already voted for candidate 8dfbf314f9eb4599aa1f64e0098053f2 in this term.
I20260709 12:28:49.000881 19795 leader_election.cc:304] T d9f35e5399fd49539418b54e24f94016 P b2005221a1af4e559e0cb1cf28636c84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2005221a1af4e559e0cb1cf28636c84; no voters: 72b654ed19904db48b0a8e50fe4e12c7, 8dfbf314f9eb4599aa1f64e0098053f2
I20260709 12:28:49.002154 20093 raft_consensus.cc:3060] T d9f35e5399fd49539418b54e24f94016 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:49.004312 20062 tablet_bootstrap.cc:654] T 2af1d81129aa40cfb84440644ae99bc5 P 72b654ed19904db48b0a8e50fe4e12c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:49.006286 20065 tablet_bootstrap.cc:654] T 787520b5a0c64085a72e995881511ca5 P 8dfbf314f9eb4599aa1f64e0098053f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:49.006834 19756 raft_consensus.cc:3060] T eecd23b305744bcabbef1e2e5cd206ce P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:49.012863 20060 raft_consensus.cc:515] T 2af1d81129aa40cfb84440644ae99bc5 P b2005221a1af4e559e0cb1cf28636c84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:49.016088 20060 leader_election.cc:290] T 2af1d81129aa40cfb84440644ae99bc5 P b2005221a1af4e559e0cb1cf28636c84 [CANDIDATE]: Term 1 election: Requested vote from peers 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65:38251), 72b654ed19904db48b0a8e50fe4e12c7 (127.9.116.67:34699)
I20260709 12:28:49.018296 19904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af1d81129aa40cfb84440644ae99bc5" candidate_uuid: "b2005221a1af4e559e0cb1cf28636c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72b654ed19904db48b0a8e50fe4e12c7"
I20260709 12:28:49.018947 19754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af1d81129aa40cfb84440644ae99bc5" candidate_uuid: "b2005221a1af4e559e0cb1cf28636c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dfbf314f9eb4599aa1f64e0098053f2"
I20260709 12:28:49.021077 19754 raft_consensus.cc:3060] T 2af1d81129aa40cfb84440644ae99bc5 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:28:49.022117 19794 leader_election.cc:343] T 2af1d81129aa40cfb84440644ae99bc5 P b2005221a1af4e559e0cb1cf28636c84 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 72b654ed19904db48b0a8e50fe4e12c7 (127.9.116.67:34699): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:49.034240 20093 raft_consensus.cc:2749] T d9f35e5399fd49539418b54e24f94016 P b2005221a1af4e559e0cb1cf28636c84 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:49.047698 20063 consensus_queue.cc:1048] T eecd23b305744bcabbef1e2e5cd206ce P 72b654ed19904db48b0a8e50fe4e12c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:49.056881 19754 raft_consensus.cc:2468] T 2af1d81129aa40cfb84440644ae99bc5 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2005221a1af4e559e0cb1cf28636c84 in term 1.
I20260709 12:28:49.058547 19795 leader_election.cc:304] T 2af1d81129aa40cfb84440644ae99bc5 P b2005221a1af4e559e0cb1cf28636c84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dfbf314f9eb4599aa1f64e0098053f2, b2005221a1af4e559e0cb1cf28636c84; no voters: 72b654ed19904db48b0a8e50fe4e12c7
I20260709 12:28:49.060444 20098 raft_consensus.cc:2804] T 2af1d81129aa40cfb84440644ae99bc5 P b2005221a1af4e559e0cb1cf28636c84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:49.061131 20098 raft_consensus.cc:697] T 2af1d81129aa40cfb84440644ae99bc5 P b2005221a1af4e559e0cb1cf28636c84 [term 1 LEADER]: Becoming Leader. State: Replica: b2005221a1af4e559e0cb1cf28636c84, State: Running, Role: LEADER
I20260709 12:28:49.062215 20098 consensus_queue.cc:237] T 2af1d81129aa40cfb84440644ae99bc5 P b2005221a1af4e559e0cb1cf28636c84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:49.100900 20062 tablet_bootstrap.cc:492] T 2af1d81129aa40cfb84440644ae99bc5 P 72b654ed19904db48b0a8e50fe4e12c7: No bootstrap required, opened a new log
I20260709 12:28:49.104727 20063 consensus_queue.cc:1048] T eecd23b305744bcabbef1e2e5cd206ce P 72b654ed19904db48b0a8e50fe4e12c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:49.116458 20062 ts_tablet_manager.cc:1403] T 2af1d81129aa40cfb84440644ae99bc5 P 72b654ed19904db48b0a8e50fe4e12c7: Time spent bootstrapping tablet: real 0.127s	user 0.044s	sys 0.049s
I20260709 12:28:49.117529 20063 raft_consensus.cc:493] T 787520b5a0c64085a72e995881511ca5 P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:49.118595 20063 raft_consensus.cc:515] T 787520b5a0c64085a72e995881511ca5 P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:49.119114 19651 catalog_manager.cc:5697] T 2af1d81129aa40cfb84440644ae99bc5 P b2005221a1af4e559e0cb1cf28636c84 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2005221a1af4e559e0cb1cf28636c84 (127.9.116.66). New cstate: current_term: 1 leader_uuid: "b2005221a1af4e559e0cb1cf28636c84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:49.121562 19756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787520b5a0c64085a72e995881511ca5" candidate_uuid: "72b654ed19904db48b0a8e50fe4e12c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" is_pre_election: true
I20260709 12:28:49.124300 20065 tablet_bootstrap.cc:492] T 787520b5a0c64085a72e995881511ca5 P 8dfbf314f9eb4599aa1f64e0098053f2: No bootstrap required, opened a new log
I20260709 12:28:49.124661 20070 raft_consensus.cc:493] T f8c6d1c957af4a36b0793ce6bcd840fb P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:49.124886 20065 ts_tablet_manager.cc:1403] T 787520b5a0c64085a72e995881511ca5 P 8dfbf314f9eb4599aa1f64e0098053f2: Time spent bootstrapping tablet: real 0.138s	user 0.033s	sys 0.041s
I20260709 12:28:49.125160 20070 raft_consensus.cc:515] T f8c6d1c957af4a36b0793ce6bcd840fb P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:49.127899 20065 raft_consensus.cc:359] T 787520b5a0c64085a72e995881511ca5 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:49.128670 20065 raft_consensus.cc:385] T 787520b5a0c64085a72e995881511ca5 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:49.128952 20065 raft_consensus.cc:740] T 787520b5a0c64085a72e995881511ca5 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dfbf314f9eb4599aa1f64e0098053f2, State: Initialized, Role: FOLLOWER
W20260709 12:28:49.129421 19870 leader_election.cc:343] T 787520b5a0c64085a72e995881511ca5 P 72b654ed19904db48b0a8e50fe4e12c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65:38251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:49.127471 20070 leader_election.cc:290] T f8c6d1c957af4a36b0793ce6bcd840fb P 8dfbf314f9eb4599aa1f64e0098053f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2005221a1af4e559e0cb1cf28636c84 (127.9.116.66:42783), 72b654ed19904db48b0a8e50fe4e12c7 (127.9.116.67:34699)
I20260709 12:28:49.131251 20098 raft_consensus.cc:493] T 331c202d5bec4f76a11791c0f101dfd5 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:49.130810 20065 consensus_queue.cc:260] T 787520b5a0c64085a72e995881511ca5 P 8dfbf314f9eb4599aa1f64e0098053f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:49.131800 20098 raft_consensus.cc:515] T 331c202d5bec4f76a11791c0f101dfd5 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:49.132961 19830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787520b5a0c64085a72e995881511ca5" candidate_uuid: "72b654ed19904db48b0a8e50fe4e12c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2005221a1af4e559e0cb1cf28636c84" is_pre_election: true
I20260709 12:28:49.133394 20065 ts_tablet_manager.cc:1434] T 787520b5a0c64085a72e995881511ca5 P 8dfbf314f9eb4599aa1f64e0098053f2: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:28:49.133682 19830 raft_consensus.cc:2468] T 787520b5a0c64085a72e995881511ca5 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72b654ed19904db48b0a8e50fe4e12c7 in term 0.
I20260709 12:28:49.134593 19829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c6d1c957af4a36b0793ce6bcd840fb" candidate_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2005221a1af4e559e0cb1cf28636c84" is_pre_election: true
I20260709 12:28:49.134859 20065 tablet_bootstrap.cc:492] T 331c202d5bec4f76a11791c0f101dfd5 P 8dfbf314f9eb4599aa1f64e0098053f2: Bootstrap starting.
I20260709 12:28:49.135340 19829 raft_consensus.cc:2468] T f8c6d1c957af4a36b0793ce6bcd840fb P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dfbf314f9eb4599aa1f64e0098053f2 in term 0.
I20260709 12:28:49.137032 19719 leader_election.cc:304] T f8c6d1c957af4a36b0793ce6bcd840fb P 8dfbf314f9eb4599aa1f64e0098053f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dfbf314f9eb4599aa1f64e0098053f2, b2005221a1af4e559e0cb1cf28636c84; no voters: 
I20260709 12:28:49.137346 19869 leader_election.cc:304] T 787520b5a0c64085a72e995881511ca5 P 72b654ed19904db48b0a8e50fe4e12c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72b654ed19904db48b0a8e50fe4e12c7, b2005221a1af4e559e0cb1cf28636c84; no voters: 8dfbf314f9eb4599aa1f64e0098053f2
I20260709 12:28:49.138334 20071 raft_consensus.cc:2804] T f8c6d1c957af4a36b0793ce6bcd840fb P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:49.138820 20071 raft_consensus.cc:493] T f8c6d1c957af4a36b0793ce6bcd840fb P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:49.139194 20071 raft_consensus.cc:3060] T f8c6d1c957af4a36b0793ce6bcd840fb P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:49.139411 19756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "331c202d5bec4f76a11791c0f101dfd5" candidate_uuid: "b2005221a1af4e559e0cb1cf28636c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" is_pre_election: true
I20260709 12:28:49.130841 19904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c6d1c957af4a36b0793ce6bcd840fb" candidate_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72b654ed19904db48b0a8e50fe4e12c7" is_pre_election: true
I20260709 12:28:49.139808 20076 raft_consensus.cc:2804] T 787520b5a0c64085a72e995881511ca5 P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:49.140548 20076 raft_consensus.cc:493] T 787520b5a0c64085a72e995881511ca5 P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:49.141050 20076 raft_consensus.cc:3060] T 787520b5a0c64085a72e995881511ca5 P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:49.140693 19904 raft_consensus.cc:2468] T f8c6d1c957af4a36b0793ce6bcd840fb P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dfbf314f9eb4599aa1f64e0098053f2 in term 0.
I20260709 12:28:49.142161 19906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "331c202d5bec4f76a11791c0f101dfd5" candidate_uuid: "b2005221a1af4e559e0cb1cf28636c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72b654ed19904db48b0a8e50fe4e12c7" is_pre_election: true
I20260709 12:28:49.145011 19906 raft_consensus.cc:2468] T 331c202d5bec4f76a11791c0f101dfd5 P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2005221a1af4e559e0cb1cf28636c84 in term 0.
I20260709 12:28:49.145751 20063 leader_election.cc:290] T 787520b5a0c64085a72e995881511ca5 P 72b654ed19904db48b0a8e50fe4e12c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65:38251), b2005221a1af4e559e0cb1cf28636c84 (127.9.116.66:42783)
W20260709 12:28:49.149870 19795 leader_election.cc:343] T 331c202d5bec4f76a11791c0f101dfd5 P b2005221a1af4e559e0cb1cf28636c84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65:38251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:49.157351 20071 raft_consensus.cc:515] T f8c6d1c957af4a36b0793ce6bcd840fb P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:49.158427 20062 raft_consensus.cc:359] T 2af1d81129aa40cfb84440644ae99bc5 P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:49.159261 20062 raft_consensus.cc:385] T 2af1d81129aa40cfb84440644ae99bc5 P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:49.159611 20062 raft_consensus.cc:740] T 2af1d81129aa40cfb84440644ae99bc5 P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72b654ed19904db48b0a8e50fe4e12c7, State: Initialized, Role: FOLLOWER
I20260709 12:28:49.160684 19831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c6d1c957af4a36b0793ce6bcd840fb" candidate_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2005221a1af4e559e0cb1cf28636c84"
I20260709 12:28:49.160559 20062 consensus_queue.cc:260] T 2af1d81129aa40cfb84440644ae99bc5 P 72b654ed19904db48b0a8e50fe4e12c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:49.161432 19831 raft_consensus.cc:3060] T f8c6d1c957af4a36b0793ce6bcd840fb P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:49.163689 20062 ts_tablet_manager.cc:1434] T 2af1d81129aa40cfb84440644ae99bc5 P 72b654ed19904db48b0a8e50fe4e12c7: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:28:49.166186 20063 raft_consensus.cc:493] T 65b2b8f9a0944d1a94ae5e90b9656f7c P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:49.166855 20063 raft_consensus.cc:515] T 65b2b8f9a0944d1a94ae5e90b9656f7c P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:49.134050 20098 leader_election.cc:290] T 331c202d5bec4f76a11791c0f101dfd5 P b2005221a1af4e559e0cb1cf28636c84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65:38251), 72b654ed19904db48b0a8e50fe4e12c7 (127.9.116.67:34699)
I20260709 12:28:49.175623 20076 raft_consensus.cc:515] T 787520b5a0c64085a72e995881511ca5 P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:49.176446 19829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65b2b8f9a0944d1a94ae5e90b9656f7c" candidate_uuid: "72b654ed19904db48b0a8e50fe4e12c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2005221a1af4e559e0cb1cf28636c84" is_pre_election: true
I20260709 12:28:49.177802 19794 leader_election.cc:304] T 331c202d5bec4f76a11791c0f101dfd5 P b2005221a1af4e559e0cb1cf28636c84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72b654ed19904db48b0a8e50fe4e12c7, b2005221a1af4e559e0cb1cf28636c84; no voters: 8dfbf314f9eb4599aa1f64e0098053f2
I20260709 12:28:49.178270 20076 leader_election.cc:290] T 787520b5a0c64085a72e995881511ca5 P 72b654ed19904db48b0a8e50fe4e12c7 [CANDIDATE]: Term 1 election: Requested vote from peers 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65:38251), b2005221a1af4e559e0cb1cf28636c84 (127.9.116.66:42783)
I20260709 12:28:49.179838 20098 raft_consensus.cc:2804] T 331c202d5bec4f76a11791c0f101dfd5 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:49.180326 20098 raft_consensus.cc:493] T 331c202d5bec4f76a11791c0f101dfd5 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:49.180876 20098 raft_consensus.cc:3060] T 331c202d5bec4f76a11791c0f101dfd5 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:49.185982 19831 raft_consensus.cc:2468] T f8c6d1c957af4a36b0793ce6bcd840fb P b2005221a1af4e559e0cb1cf28636c84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dfbf314f9eb4599aa1f64e0098053f2 in term 1.
I20260709 12:28:49.187418 19719 leader_election.cc:304] T f8c6d1c957af4a36b0793ce6bcd840fb P 8dfbf314f9eb4599aa1f64e0098053f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dfbf314f9eb4599aa1f64e0098053f2, b2005221a1af4e559e0cb1cf28636c84; no voters: 
I20260709 12:28:49.188374 20070 raft_consensus.cc:2804] T f8c6d1c957af4a36b0793ce6bcd840fb P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:49.188684 19829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787520b5a0c64085a72e995881511ca5" candidate_uuid: "72b654ed19904db48b0a8e50fe4e12c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2005221a1af4e559e0cb1cf28636c84"
I20260709 12:28:49.189476 19829 raft_consensus.cc:3060] T 787520b5a0c64085a72e995881511ca5 P b2005221a1af4e559e0cb1cf28636c84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:49.190995 20063 leader_election.cc:290] T 65b2b8f9a0944d1a94ae5e90b9656f7c P 72b654ed19904db48b0a8e50fe4e12c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65:38251), b2005221a1af4e559e0cb1cf28636c84 (127.9.116.66:42783)
I20260709 12:28:49.206235 20071 leader_election.cc:290] T f8c6d1c957af4a36b0793ce6bcd840fb P 8dfbf314f9eb4599aa1f64e0098053f2 [CANDIDATE]: Term 1 election: Requested vote from peers b2005221a1af4e559e0cb1cf28636c84 (127.9.116.66:42783), 72b654ed19904db48b0a8e50fe4e12c7 (127.9.116.67:34699)
I20260709 12:28:49.206151 20063 consensus_queue.cc:1048] T f6e468eccc244819925f994f88ded6c3 P 72b654ed19904db48b0a8e50fe4e12c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:49.207041 20071 raft_consensus.cc:493] T 787520b5a0c64085a72e995881511ca5 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:49.189296 19756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65b2b8f9a0944d1a94ae5e90b9656f7c" candidate_uuid: "72b654ed19904db48b0a8e50fe4e12c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" is_pre_election: true
I20260709 12:28:49.207520 20071 raft_consensus.cc:515] T 787520b5a0c64085a72e995881511ca5 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:49.208560 19756 raft_consensus.cc:2393] T 65b2b8f9a0944d1a94ae5e90b9656f7c P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72b654ed19904db48b0a8e50fe4e12c7 in current term 1: Already voted for candidate b2005221a1af4e559e0cb1cf28636c84 in this term.
I20260709 12:28:49.210539 19828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787520b5a0c64085a72e995881511ca5" candidate_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2005221a1af4e559e0cb1cf28636c84" is_pre_election: true
I20260709 12:28:49.213515 20065 tablet_bootstrap.cc:654] T 331c202d5bec4f76a11791c0f101dfd5 P 8dfbf314f9eb4599aa1f64e0098053f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:49.219061 19906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c6d1c957af4a36b0793ce6bcd840fb" candidate_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72b654ed19904db48b0a8e50fe4e12c7"
I20260709 12:28:49.219973 19906 raft_consensus.cc:3060] T f8c6d1c957af4a36b0793ce6bcd840fb P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:49.219830 20070 raft_consensus.cc:697] T f8c6d1c957af4a36b0793ce6bcd840fb P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 LEADER]: Becoming Leader. State: Replica: 8dfbf314f9eb4599aa1f64e0098053f2, State: Running, Role: LEADER
I20260709 12:28:49.221274 20070 consensus_queue.cc:237] T f8c6d1c957af4a36b0793ce6bcd840fb P 8dfbf314f9eb4599aa1f64e0098053f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:49.226375 20071 leader_election.cc:290] T 787520b5a0c64085a72e995881511ca5 P 8dfbf314f9eb4599aa1f64e0098053f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2005221a1af4e559e0cb1cf28636c84 (127.9.116.66:42783), 72b654ed19904db48b0a8e50fe4e12c7 (127.9.116.67:34699)
I20260709 12:28:49.228958 19904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787520b5a0c64085a72e995881511ca5" candidate_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72b654ed19904db48b0a8e50fe4e12c7" is_pre_election: true
I20260709 12:28:49.230185 19904 raft_consensus.cc:2393] T 787520b5a0c64085a72e995881511ca5 P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dfbf314f9eb4599aa1f64e0098053f2 in current term 1: Already voted for candidate 72b654ed19904db48b0a8e50fe4e12c7 in this term.
I20260709 12:28:49.231603 19719 leader_election.cc:304] T 787520b5a0c64085a72e995881511ca5 P 8dfbf314f9eb4599aa1f64e0098053f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dfbf314f9eb4599aa1f64e0098053f2; no voters: 72b654ed19904db48b0a8e50fe4e12c7, b2005221a1af4e559e0cb1cf28636c84
I20260709 12:28:49.233413 19829 raft_consensus.cc:2468] T 787520b5a0c64085a72e995881511ca5 P b2005221a1af4e559e0cb1cf28636c84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72b654ed19904db48b0a8e50fe4e12c7 in term 1.
I20260709 12:28:49.234298 20071 raft_consensus.cc:3060] T 787520b5a0c64085a72e995881511ca5 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:49.235400 19869 leader_election.cc:304] T 787520b5a0c64085a72e995881511ca5 P 72b654ed19904db48b0a8e50fe4e12c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72b654ed19904db48b0a8e50fe4e12c7, b2005221a1af4e559e0cb1cf28636c84; no voters: 
I20260709 12:28:49.235893 19904 raft_consensus.cc:3060] T 65b2b8f9a0944d1a94ae5e90b9656f7c P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:49.236480 20076 raft_consensus.cc:2804] T 787520b5a0c64085a72e995881511ca5 P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:49.237012 20076 raft_consensus.cc:697] T 787520b5a0c64085a72e995881511ca5 P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 LEADER]: Becoming Leader. State: Replica: 72b654ed19904db48b0a8e50fe4e12c7, State: Running, Role: LEADER
I20260709 12:28:49.237920 20076 consensus_queue.cc:237] T 787520b5a0c64085a72e995881511ca5 P 72b654ed19904db48b0a8e50fe4e12c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:49.243772 19906 raft_consensus.cc:2468] T f8c6d1c957af4a36b0793ce6bcd840fb P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dfbf314f9eb4599aa1f64e0098053f2 in term 1.
I20260709 12:28:49.248286 19756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787520b5a0c64085a72e995881511ca5" candidate_uuid: "72b654ed19904db48b0a8e50fe4e12c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dfbf314f9eb4599aa1f64e0098053f2"
I20260709 12:28:49.253700 19870 leader_election.cc:304] T 65b2b8f9a0944d1a94ae5e90b9656f7c P 72b654ed19904db48b0a8e50fe4e12c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72b654ed19904db48b0a8e50fe4e12c7; no voters: 8dfbf314f9eb4599aa1f64e0098053f2, b2005221a1af4e559e0cb1cf28636c84
I20260709 12:28:49.258157 20065 tablet_bootstrap.cc:492] T 331c202d5bec4f76a11791c0f101dfd5 P 8dfbf314f9eb4599aa1f64e0098053f2: No bootstrap required, opened a new log
I20260709 12:28:49.258926 20065 ts_tablet_manager.cc:1403] T 331c202d5bec4f76a11791c0f101dfd5 P 8dfbf314f9eb4599aa1f64e0098053f2: Time spent bootstrapping tablet: real 0.124s	user 0.011s	sys 0.007s
I20260709 12:28:49.259850 20098 raft_consensus.cc:515] T 331c202d5bec4f76a11791c0f101dfd5 P b2005221a1af4e559e0cb1cf28636c84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:49.260556 20076 raft_consensus.cc:2749] T 65b2b8f9a0944d1a94ae5e90b9656f7c P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:49.263474 19754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "331c202d5bec4f76a11791c0f101dfd5" candidate_uuid: "b2005221a1af4e559e0cb1cf28636c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dfbf314f9eb4599aa1f64e0098053f2"
I20260709 12:28:49.264329 19653 catalog_manager.cc:5697] T 787520b5a0c64085a72e995881511ca5 P 72b654ed19904db48b0a8e50fe4e12c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72b654ed19904db48b0a8e50fe4e12c7 (127.9.116.67). New cstate: current_term: 1 leader_uuid: "72b654ed19904db48b0a8e50fe4e12c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } health_report { overall_health: HEALTHY } } }
W20260709 12:28:49.265347 19795 leader_election.cc:343] T 331c202d5bec4f76a11791c0f101dfd5 P b2005221a1af4e559e0cb1cf28636c84 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65:38251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:49.266016 20065 raft_consensus.cc:359] T 331c202d5bec4f76a11791c0f101dfd5 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:49.267349 20098 leader_election.cc:290] T 331c202d5bec4f76a11791c0f101dfd5 P b2005221a1af4e559e0cb1cf28636c84 [CANDIDATE]: Term 1 election: Requested vote from peers 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65:38251), 72b654ed19904db48b0a8e50fe4e12c7 (127.9.116.67:34699)
I20260709 12:28:49.267942 20065 raft_consensus.cc:385] T 331c202d5bec4f76a11791c0f101dfd5 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:49.268461 19651 catalog_manager.cc:5697] T f8c6d1c957af4a36b0793ce6bcd840fb P 8dfbf314f9eb4599aa1f64e0098053f2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65). New cstate: current_term: 1 leader_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:49.268312 20065 raft_consensus.cc:740] T 331c202d5bec4f76a11791c0f101dfd5 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dfbf314f9eb4599aa1f64e0098053f2, State: Initialized, Role: FOLLOWER
I20260709 12:28:49.267269 20071 raft_consensus.cc:2749] T 787520b5a0c64085a72e995881511ca5 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:49.273219 20098 consensus_queue.cc:1048] T 65b2b8f9a0944d1a94ae5e90b9656f7c P b2005221a1af4e559e0cb1cf28636c84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:49.279073 19904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "331c202d5bec4f76a11791c0f101dfd5" candidate_uuid: "b2005221a1af4e559e0cb1cf28636c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72b654ed19904db48b0a8e50fe4e12c7"
I20260709 12:28:49.280239 19904 raft_consensus.cc:3060] T 331c202d5bec4f76a11791c0f101dfd5 P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:49.280870 19756 raft_consensus.cc:2468] T 787520b5a0c64085a72e995881511ca5 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72b654ed19904db48b0a8e50fe4e12c7 in term 1.
I20260709 12:28:49.282295 20065 consensus_queue.cc:260] T 331c202d5bec4f76a11791c0f101dfd5 P 8dfbf314f9eb4599aa1f64e0098053f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:49.290380 20063 consensus_queue.cc:1048] T f6e468eccc244819925f994f88ded6c3 P 72b654ed19904db48b0a8e50fe4e12c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:28:49.297813 20098 consensus_queue.cc:1048] T 65b2b8f9a0944d1a94ae5e90b9656f7c P b2005221a1af4e559e0cb1cf28636c84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:28:49.289566 19904 raft_consensus.cc:2468] T 331c202d5bec4f76a11791c0f101dfd5 P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2005221a1af4e559e0cb1cf28636c84 in term 1.
I20260709 12:28:49.297967 20065 ts_tablet_manager.cc:1434] T 331c202d5bec4f76a11791c0f101dfd5 P 8dfbf314f9eb4599aa1f64e0098053f2: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.001s
I20260709 12:28:49.310334 19794 leader_election.cc:304] T 331c202d5bec4f76a11791c0f101dfd5 P b2005221a1af4e559e0cb1cf28636c84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72b654ed19904db48b0a8e50fe4e12c7, b2005221a1af4e559e0cb1cf28636c84; no voters: 8dfbf314f9eb4599aa1f64e0098053f2
I20260709 12:28:49.312875 20093 raft_consensus.cc:2804] T 331c202d5bec4f76a11791c0f101dfd5 P b2005221a1af4e559e0cb1cf28636c84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:49.313544 20093 raft_consensus.cc:697] T 331c202d5bec4f76a11791c0f101dfd5 P b2005221a1af4e559e0cb1cf28636c84 [term 1 LEADER]: Becoming Leader. State: Replica: b2005221a1af4e559e0cb1cf28636c84, State: Running, Role: LEADER
I20260709 12:28:49.314692 20093 consensus_queue.cc:237] T 331c202d5bec4f76a11791c0f101dfd5 P b2005221a1af4e559e0cb1cf28636c84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:49.343628 20063 raft_consensus.cc:493] T 2af1d81129aa40cfb84440644ae99bc5 P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:49.344216 20063 raft_consensus.cc:515] T 2af1d81129aa40cfb84440644ae99bc5 P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:49.346550 19651 catalog_manager.cc:5697] T 331c202d5bec4f76a11791c0f101dfd5 P b2005221a1af4e559e0cb1cf28636c84 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2005221a1af4e559e0cb1cf28636c84 (127.9.116.66). New cstate: current_term: 1 leader_uuid: "b2005221a1af4e559e0cb1cf28636c84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:49.348806 19830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af1d81129aa40cfb84440644ae99bc5" candidate_uuid: "72b654ed19904db48b0a8e50fe4e12c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2005221a1af4e559e0cb1cf28636c84" is_pre_election: true
I20260709 12:28:49.351413 20063 leader_election.cc:290] T 2af1d81129aa40cfb84440644ae99bc5 P 72b654ed19904db48b0a8e50fe4e12c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65:38251), b2005221a1af4e559e0cb1cf28636c84 (127.9.116.66:42783)
I20260709 12:28:49.354456 19756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af1d81129aa40cfb84440644ae99bc5" candidate_uuid: "72b654ed19904db48b0a8e50fe4e12c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" is_pre_election: true
I20260709 12:28:49.355430 19756 raft_consensus.cc:2393] T 2af1d81129aa40cfb84440644ae99bc5 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72b654ed19904db48b0a8e50fe4e12c7 in current term 1: Already voted for candidate b2005221a1af4e559e0cb1cf28636c84 in this term.
I20260709 12:28:49.358446 19870 leader_election.cc:304] T 2af1d81129aa40cfb84440644ae99bc5 P 72b654ed19904db48b0a8e50fe4e12c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72b654ed19904db48b0a8e50fe4e12c7; no voters: 8dfbf314f9eb4599aa1f64e0098053f2, b2005221a1af4e559e0cb1cf28636c84
I20260709 12:28:49.360268 20071 consensus_queue.cc:1048] T d9f35e5399fd49539418b54e24f94016 P 8dfbf314f9eb4599aa1f64e0098053f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:49.360827 20063 raft_consensus.cc:3060] T 2af1d81129aa40cfb84440644ae99bc5 P 72b654ed19904db48b0a8e50fe4e12c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:49.369958 20093 consensus_queue.cc:1048] T 5425b69fce0a4b0ab03c4f1849b882e1 P b2005221a1af4e559e0cb1cf28636c84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:49.379316 20063 raft_consensus.cc:2749] T 2af1d81129aa40cfb84440644ae99bc5 P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:49.406816 20071 raft_consensus.cc:493] T 331c202d5bec4f76a11791c0f101dfd5 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:49.407490 20071 raft_consensus.cc:515] T 331c202d5bec4f76a11791c0f101dfd5 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:49.410115 20071 leader_election.cc:290] T 331c202d5bec4f76a11791c0f101dfd5 P 8dfbf314f9eb4599aa1f64e0098053f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2005221a1af4e559e0cb1cf28636c84 (127.9.116.66:42783), 72b654ed19904db48b0a8e50fe4e12c7 (127.9.116.67:34699)
I20260709 12:28:49.413537 19830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "331c202d5bec4f76a11791c0f101dfd5" candidate_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2005221a1af4e559e0cb1cf28636c84" is_pre_election: true
I20260709 12:28:49.414700 20060 consensus_queue.cc:1048] T 5425b69fce0a4b0ab03c4f1849b882e1 P b2005221a1af4e559e0cb1cf28636c84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:49.416402 19906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "331c202d5bec4f76a11791c0f101dfd5" candidate_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72b654ed19904db48b0a8e50fe4e12c7" is_pre_election: true
I20260709 12:28:49.417328 19906 raft_consensus.cc:2393] T 331c202d5bec4f76a11791c0f101dfd5 P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dfbf314f9eb4599aa1f64e0098053f2 in current term 1: Already voted for candidate b2005221a1af4e559e0cb1cf28636c84 in this term.
I20260709 12:28:49.421386 19719 leader_election.cc:304] T 331c202d5bec4f76a11791c0f101dfd5 P 8dfbf314f9eb4599aa1f64e0098053f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dfbf314f9eb4599aa1f64e0098053f2; no voters: 72b654ed19904db48b0a8e50fe4e12c7, b2005221a1af4e559e0cb1cf28636c84
I20260709 12:28:49.423094 20071 raft_consensus.cc:3060] T 331c202d5bec4f76a11791c0f101dfd5 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:49.431665 20071 raft_consensus.cc:2749] T 331c202d5bec4f76a11791c0f101dfd5 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:49.435784 20071 consensus_queue.cc:1048] T d9f35e5399fd49539418b54e24f94016 P 8dfbf314f9eb4599aa1f64e0098053f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:49.454648 20060 consensus_queue.cc:1048] T 2af1d81129aa40cfb84440644ae99bc5 P b2005221a1af4e559e0cb1cf28636c84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:49.477823 20093 consensus_queue.cc:1048] T 2af1d81129aa40cfb84440644ae99bc5 P b2005221a1af4e559e0cb1cf28636c84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:49.499724 19904 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f6e468eccc244819925f994f88ded6c3"
dest_uuid: "72b654ed19904db48b0a8e50fe4e12c7"
mode: GRACEFUL
new_leader_uuid: "8dfbf314f9eb4599aa1f64e0098053f2"
 from {username='slave'} at 127.0.0.1:52736
I20260709 12:28:49.500603 19904 raft_consensus.cc:606] T f6e468eccc244819925f994f88ded6c3 P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 LEADER]: Received request to transfer leadership to TS 8dfbf314f9eb4599aa1f64e0098053f2
I20260709 12:28:49.508319 19905 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eecd23b305744bcabbef1e2e5cd206ce"
dest_uuid: "72b654ed19904db48b0a8e50fe4e12c7"
mode: GRACEFUL
new_leader_uuid: "8dfbf314f9eb4599aa1f64e0098053f2"
 from {username='slave'} at 127.0.0.1:52736
I20260709 12:28:49.509189 19905 raft_consensus.cc:606] T eecd23b305744bcabbef1e2e5cd206ce P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 LEADER]: Received request to transfer leadership to TS 8dfbf314f9eb4599aa1f64e0098053f2
I20260709 12:28:49.516023 19830 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5425b69fce0a4b0ab03c4f1849b882e1"
dest_uuid: "b2005221a1af4e559e0cb1cf28636c84"
mode: GRACEFUL
new_leader_uuid: "8dfbf314f9eb4599aa1f64e0098053f2"
 from {username='slave'} at 127.0.0.1:60180
I20260709 12:28:49.516575 19830 raft_consensus.cc:606] T 5425b69fce0a4b0ab03c4f1849b882e1 P b2005221a1af4e559e0cb1cf28636c84 [term 1 LEADER]: Received request to transfer leadership to TS 8dfbf314f9eb4599aa1f64e0098053f2
I20260709 12:28:49.535094 19756 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d9f35e5399fd49539418b54e24f94016"
dest_uuid: "8dfbf314f9eb4599aa1f64e0098053f2"
mode: GRACEFUL
new_leader_uuid: "b2005221a1af4e559e0cb1cf28636c84"
 from {username='slave'} at 127.0.0.1:50336
I20260709 12:28:49.535733 19756 raft_consensus.cc:606] T d9f35e5399fd49539418b54e24f94016 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 LEADER]: Received request to transfer leadership to TS b2005221a1af4e559e0cb1cf28636c84
I20260709 12:28:49.542574 19905 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "787520b5a0c64085a72e995881511ca5"
dest_uuid: "72b654ed19904db48b0a8e50fe4e12c7"
mode: GRACEFUL
new_leader_uuid: "b2005221a1af4e559e0cb1cf28636c84"
 from {username='slave'} at 127.0.0.1:52736
I20260709 12:28:49.543251 19905 raft_consensus.cc:606] T 787520b5a0c64085a72e995881511ca5 P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 LEADER]: Received request to transfer leadership to TS b2005221a1af4e559e0cb1cf28636c84
I20260709 12:28:49.551069 19830 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "331c202d5bec4f76a11791c0f101dfd5"
dest_uuid: "b2005221a1af4e559e0cb1cf28636c84"
mode: GRACEFUL
new_leader_uuid: "72b654ed19904db48b0a8e50fe4e12c7"
 from {username='slave'} at 127.0.0.1:60180
I20260709 12:28:49.551714 19830 raft_consensus.cc:606] T 331c202d5bec4f76a11791c0f101dfd5 P b2005221a1af4e559e0cb1cf28636c84 [term 1 LEADER]: Received request to transfer leadership to TS 72b654ed19904db48b0a8e50fe4e12c7
I20260709 12:28:49.651487 20071 consensus_queue.cc:1048] T f8c6d1c957af4a36b0793ce6bcd840fb P 8dfbf314f9eb4599aa1f64e0098053f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:49.666040 20112 consensus_queue.cc:1048] T f8c6d1c957af4a36b0793ce6bcd840fb P 8dfbf314f9eb4599aa1f64e0098053f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:49.701233 20076 raft_consensus.cc:993] T eecd23b305744bcabbef1e2e5cd206ce P 72b654ed19904db48b0a8e50fe4e12c7: : Instructing follower 8dfbf314f9eb4599aa1f64e0098053f2 to start an election
I20260709 12:28:49.702316 20118 raft_consensus.cc:1081] T eecd23b305744bcabbef1e2e5cd206ce P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 LEADER]: Signalling peer 8dfbf314f9eb4599aa1f64e0098053f2 to start an election
I20260709 12:28:49.703318 20118 consensus_queue.cc:1048] T 787520b5a0c64085a72e995881511ca5 P 72b654ed19904db48b0a8e50fe4e12c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:49.704314 19756 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eecd23b305744bcabbef1e2e5cd206ce"
dest_uuid: "8dfbf314f9eb4599aa1f64e0098053f2"
 from {username='slave'} at 127.0.0.1:50310
I20260709 12:28:49.704999 19756 raft_consensus.cc:493] T eecd23b305744bcabbef1e2e5cd206ce P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:49.705488 19756 raft_consensus.cc:3060] T eecd23b305744bcabbef1e2e5cd206ce P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:49.720857 19756 raft_consensus.cc:515] T eecd23b305744bcabbef1e2e5cd206ce P 8dfbf314f9eb4599aa1f64e0098053f2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:49.724020 19829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eecd23b305744bcabbef1e2e5cd206ce" candidate_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b2005221a1af4e559e0cb1cf28636c84"
I20260709 12:28:49.724674 19829 raft_consensus.cc:3060] T eecd23b305744bcabbef1e2e5cd206ce P b2005221a1af4e559e0cb1cf28636c84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:49.737509 20063 raft_consensus.cc:993] T f6e468eccc244819925f994f88ded6c3 P 72b654ed19904db48b0a8e50fe4e12c7: : Instructing follower 8dfbf314f9eb4599aa1f64e0098053f2 to start an election
I20260709 12:28:49.738137 20063 raft_consensus.cc:1081] T f6e468eccc244819925f994f88ded6c3 P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 LEADER]: Signalling peer 8dfbf314f9eb4599aa1f64e0098053f2 to start an election
I20260709 12:28:49.738885 20118 consensus_queue.cc:1048] T 787520b5a0c64085a72e995881511ca5 P 72b654ed19904db48b0a8e50fe4e12c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:49.747759 19755 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f6e468eccc244819925f994f88ded6c3"
dest_uuid: "8dfbf314f9eb4599aa1f64e0098053f2"
 from {username='slave'} at 127.0.0.1:50310
I20260709 12:28:49.748486 19755 raft_consensus.cc:493] T f6e468eccc244819925f994f88ded6c3 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:49.749251 19755 raft_consensus.cc:3060] T f6e468eccc244819925f994f88ded6c3 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:49.755818 19829 raft_consensus.cc:2468] T eecd23b305744bcabbef1e2e5cd206ce P b2005221a1af4e559e0cb1cf28636c84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dfbf314f9eb4599aa1f64e0098053f2 in term 2.
I20260709 12:28:49.759321 19719 leader_election.cc:304] T eecd23b305744bcabbef1e2e5cd206ce P 8dfbf314f9eb4599aa1f64e0098053f2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dfbf314f9eb4599aa1f64e0098053f2, b2005221a1af4e559e0cb1cf28636c84; no voters: 
I20260709 12:28:49.760447 20071 raft_consensus.cc:2804] T eecd23b305744bcabbef1e2e5cd206ce P 8dfbf314f9eb4599aa1f64e0098053f2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:49.762506 19756 leader_election.cc:290] T eecd23b305744bcabbef1e2e5cd206ce P 8dfbf314f9eb4599aa1f64e0098053f2 [CANDIDATE]: Term 2 election: Requested vote from peers b2005221a1af4e559e0cb1cf28636c84 (127.9.116.66:42783), 72b654ed19904db48b0a8e50fe4e12c7 (127.9.116.67:34699)
I20260709 12:28:49.763693 20071 raft_consensus.cc:697] T eecd23b305744bcabbef1e2e5cd206ce P 8dfbf314f9eb4599aa1f64e0098053f2 [term 2 LEADER]: Becoming Leader. State: Replica: 8dfbf314f9eb4599aa1f64e0098053f2, State: Running, Role: LEADER
I20260709 12:28:49.765765 20071 consensus_queue.cc:237] T eecd23b305744bcabbef1e2e5cd206ce P 8dfbf314f9eb4599aa1f64e0098053f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:49.768160 19904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eecd23b305744bcabbef1e2e5cd206ce" candidate_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "72b654ed19904db48b0a8e50fe4e12c7"
I20260709 12:28:49.768927 19904 raft_consensus.cc:3055] T eecd23b305744bcabbef1e2e5cd206ce P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:49.769294 19904 raft_consensus.cc:740] T eecd23b305744bcabbef1e2e5cd206ce P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 72b654ed19904db48b0a8e50fe4e12c7, State: Running, Role: LEADER
I20260709 12:28:49.770331 19904 consensus_queue.cc:260] T eecd23b305744bcabbef1e2e5cd206ce P 72b654ed19904db48b0a8e50fe4e12c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:49.772418 19755 raft_consensus.cc:515] T f6e468eccc244819925f994f88ded6c3 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:49.772434 19904 raft_consensus.cc:3060] T eecd23b305744bcabbef1e2e5cd206ce P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:49.777825 19755 leader_election.cc:290] T f6e468eccc244819925f994f88ded6c3 P 8dfbf314f9eb4599aa1f64e0098053f2 [CANDIDATE]: Term 2 election: Requested vote from peers b2005221a1af4e559e0cb1cf28636c84 (127.9.116.66:42783), 72b654ed19904db48b0a8e50fe4e12c7 (127.9.116.67:34699)
I20260709 12:28:49.779645 19830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e468eccc244819925f994f88ded6c3" candidate_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b2005221a1af4e559e0cb1cf28636c84"
I20260709 12:28:49.779927 19905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e468eccc244819925f994f88ded6c3" candidate_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "72b654ed19904db48b0a8e50fe4e12c7"
I20260709 12:28:49.780465 19830 raft_consensus.cc:3060] T f6e468eccc244819925f994f88ded6c3 P b2005221a1af4e559e0cb1cf28636c84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:49.780731 20118 raft_consensus.cc:993] T 787520b5a0c64085a72e995881511ca5 P 72b654ed19904db48b0a8e50fe4e12c7: : Instructing follower b2005221a1af4e559e0cb1cf28636c84 to start an election
I20260709 12:28:49.781387 20118 raft_consensus.cc:1081] T 787520b5a0c64085a72e995881511ca5 P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 LEADER]: Signalling peer b2005221a1af4e559e0cb1cf28636c84 to start an election
I20260709 12:28:49.780655 19905 raft_consensus.cc:3055] T f6e468eccc244819925f994f88ded6c3 P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:49.783401 19905 raft_consensus.cc:740] T f6e468eccc244819925f994f88ded6c3 P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 72b654ed19904db48b0a8e50fe4e12c7, State: Running, Role: LEADER
I20260709 12:28:49.784456 19905 consensus_queue.cc:260] T f6e468eccc244819925f994f88ded6c3 P 72b654ed19904db48b0a8e50fe4e12c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:49.785771 19905 raft_consensus.cc:3060] T f6e468eccc244819925f994f88ded6c3 P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:49.790941 19830 raft_consensus.cc:2468] T f6e468eccc244819925f994f88ded6c3 P b2005221a1af4e559e0cb1cf28636c84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dfbf314f9eb4599aa1f64e0098053f2 in term 2.
I20260709 12:28:49.791741 19904 raft_consensus.cc:2468] T eecd23b305744bcabbef1e2e5cd206ce P 72b654ed19904db48b0a8e50fe4e12c7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dfbf314f9eb4599aa1f64e0098053f2 in term 2.
I20260709 12:28:49.792574 19719 leader_election.cc:304] T f6e468eccc244819925f994f88ded6c3 P 8dfbf314f9eb4599aa1f64e0098053f2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dfbf314f9eb4599aa1f64e0098053f2, b2005221a1af4e559e0cb1cf28636c84; no voters: 
I20260709 12:28:49.793325 19831 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "787520b5a0c64085a72e995881511ca5"
dest_uuid: "b2005221a1af4e559e0cb1cf28636c84"
 from {username='slave'} at 127.0.0.1:60162
I20260709 12:28:49.794013 19831 raft_consensus.cc:493] T 787520b5a0c64085a72e995881511ca5 P b2005221a1af4e559e0cb1cf28636c84 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:49.794461 19831 raft_consensus.cc:3060] T 787520b5a0c64085a72e995881511ca5 P b2005221a1af4e559e0cb1cf28636c84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:49.794543 20071 raft_consensus.cc:2804] T f6e468eccc244819925f994f88ded6c3 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:49.795405 20071 raft_consensus.cc:697] T f6e468eccc244819925f994f88ded6c3 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 2 LEADER]: Becoming Leader. State: Replica: 8dfbf314f9eb4599aa1f64e0098053f2, State: Running, Role: LEADER
I20260709 12:28:49.796383 20071 consensus_queue.cc:237] T f6e468eccc244819925f994f88ded6c3 P 8dfbf314f9eb4599aa1f64e0098053f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:49.798856 20093 consensus_queue.cc:1048] T 331c202d5bec4f76a11791c0f101dfd5 P b2005221a1af4e559e0cb1cf28636c84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:49.793715 19651 catalog_manager.cc:5697] T eecd23b305744bcabbef1e2e5cd206ce P 8dfbf314f9eb4599aa1f64e0098053f2 reported cstate change: term changed from 1 to 2, leader changed from 72b654ed19904db48b0a8e50fe4e12c7 (127.9.116.67) to 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65). New cstate: current_term: 2 leader_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:49.802790 19831 raft_consensus.cc:515] T 787520b5a0c64085a72e995881511ca5 P b2005221a1af4e559e0cb1cf28636c84 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:49.807473 19904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787520b5a0c64085a72e995881511ca5" candidate_uuid: "b2005221a1af4e559e0cb1cf28636c84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "72b654ed19904db48b0a8e50fe4e12c7"
I20260709 12:28:49.808413 19904 raft_consensus.cc:3055] T 787520b5a0c64085a72e995881511ca5 P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:49.808776 19904 raft_consensus.cc:740] T 787520b5a0c64085a72e995881511ca5 P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 72b654ed19904db48b0a8e50fe4e12c7, State: Running, Role: LEADER
I20260709 12:28:49.809623 19904 consensus_queue.cc:260] T 787520b5a0c64085a72e995881511ca5 P 72b654ed19904db48b0a8e50fe4e12c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:49.810765 19904 raft_consensus.cc:3060] T 787520b5a0c64085a72e995881511ca5 P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:49.810761 19905 raft_consensus.cc:2468] T f6e468eccc244819925f994f88ded6c3 P 72b654ed19904db48b0a8e50fe4e12c7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dfbf314f9eb4599aa1f64e0098053f2 in term 2.
I20260709 12:28:49.814762 19755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787520b5a0c64085a72e995881511ca5" candidate_uuid: "b2005221a1af4e559e0cb1cf28636c84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8dfbf314f9eb4599aa1f64e0098053f2"
I20260709 12:28:49.815855 19755 raft_consensus.cc:3060] T 787520b5a0c64085a72e995881511ca5 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:49.821868 19904 raft_consensus.cc:2468] T 787520b5a0c64085a72e995881511ca5 P 72b654ed19904db48b0a8e50fe4e12c7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2005221a1af4e559e0cb1cf28636c84 in term 2.
I20260709 12:28:49.822897 19831 leader_election.cc:290] T 787520b5a0c64085a72e995881511ca5 P b2005221a1af4e559e0cb1cf28636c84 [CANDIDATE]: Term 2 election: Requested vote from peers 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65:38251), 72b654ed19904db48b0a8e50fe4e12c7 (127.9.116.67:34699)
I20260709 12:28:49.824487 19794 leader_election.cc:304] T 787520b5a0c64085a72e995881511ca5 P b2005221a1af4e559e0cb1cf28636c84 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72b654ed19904db48b0a8e50fe4e12c7, b2005221a1af4e559e0cb1cf28636c84; no voters: 
I20260709 12:28:49.826248 20060 raft_consensus.cc:2804] T 787520b5a0c64085a72e995881511ca5 P b2005221a1af4e559e0cb1cf28636c84 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:49.826776 20060 raft_consensus.cc:697] T 787520b5a0c64085a72e995881511ca5 P b2005221a1af4e559e0cb1cf28636c84 [term 2 LEADER]: Becoming Leader. State: Replica: b2005221a1af4e559e0cb1cf28636c84, State: Running, Role: LEADER
I20260709 12:28:49.827761 20060 consensus_queue.cc:237] T 787520b5a0c64085a72e995881511ca5 P b2005221a1af4e559e0cb1cf28636c84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:49.839283 20060 consensus_queue.cc:1048] T 331c202d5bec4f76a11791c0f101dfd5 P b2005221a1af4e559e0cb1cf28636c84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:49.840227 19652 catalog_manager.cc:5697] T f6e468eccc244819925f994f88ded6c3 P 8dfbf314f9eb4599aa1f64e0098053f2 reported cstate change: term changed from 1 to 2, leader changed from 72b654ed19904db48b0a8e50fe4e12c7 (127.9.116.67) to 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65). New cstate: current_term: 2 leader_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:49.842376 19651 catalog_manager.cc:5697] T 787520b5a0c64085a72e995881511ca5 P b2005221a1af4e559e0cb1cf28636c84 reported cstate change: term changed from 1 to 2, leader changed from 72b654ed19904db48b0a8e50fe4e12c7 (127.9.116.67) to b2005221a1af4e559e0cb1cf28636c84 (127.9.116.66). New cstate: current_term: 2 leader_uuid: "b2005221a1af4e559e0cb1cf28636c84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:49.838037 19755 raft_consensus.cc:2468] T 787520b5a0c64085a72e995881511ca5 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2005221a1af4e559e0cb1cf28636c84 in term 2.
I20260709 12:28:49.856009 20098 raft_consensus.cc:993] T 331c202d5bec4f76a11791c0f101dfd5 P b2005221a1af4e559e0cb1cf28636c84: : Instructing follower 72b654ed19904db48b0a8e50fe4e12c7 to start an election
I20260709 12:28:49.856528 20098 raft_consensus.cc:1081] T 331c202d5bec4f76a11791c0f101dfd5 P b2005221a1af4e559e0cb1cf28636c84 [term 1 LEADER]: Signalling peer 72b654ed19904db48b0a8e50fe4e12c7 to start an election
I20260709 12:28:49.858444 19905 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "331c202d5bec4f76a11791c0f101dfd5"
dest_uuid: "72b654ed19904db48b0a8e50fe4e12c7"
 from {username='slave'} at 127.0.0.1:52726
I20260709 12:28:49.859140 19905 raft_consensus.cc:493] T 331c202d5bec4f76a11791c0f101dfd5 P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:49.859692 19905 raft_consensus.cc:3060] T 331c202d5bec4f76a11791c0f101dfd5 P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:49.868783 19905 raft_consensus.cc:515] T 331c202d5bec4f76a11791c0f101dfd5 P 72b654ed19904db48b0a8e50fe4e12c7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:49.870800 19905 leader_election.cc:290] T 331c202d5bec4f76a11791c0f101dfd5 P 72b654ed19904db48b0a8e50fe4e12c7 [CANDIDATE]: Term 2 election: Requested vote from peers 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65:38251), b2005221a1af4e559e0cb1cf28636c84 (127.9.116.66:42783)
I20260709 12:28:49.871925 19755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "331c202d5bec4f76a11791c0f101dfd5" candidate_uuid: "72b654ed19904db48b0a8e50fe4e12c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8dfbf314f9eb4599aa1f64e0098053f2"
I20260709 12:28:49.872576 19755 raft_consensus.cc:3060] T 331c202d5bec4f76a11791c0f101dfd5 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:49.872779 19831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "331c202d5bec4f76a11791c0f101dfd5" candidate_uuid: "72b654ed19904db48b0a8e50fe4e12c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b2005221a1af4e559e0cb1cf28636c84"
I20260709 12:28:49.873432 19831 raft_consensus.cc:3055] T 331c202d5bec4f76a11791c0f101dfd5 P b2005221a1af4e559e0cb1cf28636c84 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:49.873764 19831 raft_consensus.cc:740] T 331c202d5bec4f76a11791c0f101dfd5 P b2005221a1af4e559e0cb1cf28636c84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b2005221a1af4e559e0cb1cf28636c84, State: Running, Role: LEADER
I20260709 12:28:49.874545 19831 consensus_queue.cc:260] T 331c202d5bec4f76a11791c0f101dfd5 P b2005221a1af4e559e0cb1cf28636c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:49.875876 19831 raft_consensus.cc:3060] T 331c202d5bec4f76a11791c0f101dfd5 P b2005221a1af4e559e0cb1cf28636c84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:49.881220 19755 raft_consensus.cc:2468] T 331c202d5bec4f76a11791c0f101dfd5 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72b654ed19904db48b0a8e50fe4e12c7 in term 2.
I20260709 12:28:49.882393 19870 leader_election.cc:304] T 331c202d5bec4f76a11791c0f101dfd5 P 72b654ed19904db48b0a8e50fe4e12c7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72b654ed19904db48b0a8e50fe4e12c7, 8dfbf314f9eb4599aa1f64e0098053f2; no voters: 
I20260709 12:28:49.883205 20076 raft_consensus.cc:2804] T 331c202d5bec4f76a11791c0f101dfd5 P 72b654ed19904db48b0a8e50fe4e12c7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:49.883730 20076 raft_consensus.cc:697] T 331c202d5bec4f76a11791c0f101dfd5 P 72b654ed19904db48b0a8e50fe4e12c7 [term 2 LEADER]: Becoming Leader. State: Replica: 72b654ed19904db48b0a8e50fe4e12c7, State: Running, Role: LEADER
I20260709 12:28:49.883778 19831 raft_consensus.cc:2468] T 331c202d5bec4f76a11791c0f101dfd5 P b2005221a1af4e559e0cb1cf28636c84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72b654ed19904db48b0a8e50fe4e12c7 in term 2.
I20260709 12:28:49.884709 20076 consensus_queue.cc:237] T 331c202d5bec4f76a11791c0f101dfd5 P 72b654ed19904db48b0a8e50fe4e12c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:49.894908 19651 catalog_manager.cc:5697] T 331c202d5bec4f76a11791c0f101dfd5 P 72b654ed19904db48b0a8e50fe4e12c7 reported cstate change: term changed from 1 to 2, leader changed from b2005221a1af4e559e0cb1cf28636c84 (127.9.116.66) to 72b654ed19904db48b0a8e50fe4e12c7 (127.9.116.67). New cstate: current_term: 2 leader_uuid: "72b654ed19904db48b0a8e50fe4e12c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:49.908806 20111 raft_consensus.cc:993] T d9f35e5399fd49539418b54e24f94016 P 8dfbf314f9eb4599aa1f64e0098053f2: : Instructing follower b2005221a1af4e559e0cb1cf28636c84 to start an election
I20260709 12:28:49.909593 20111 raft_consensus.cc:1081] T d9f35e5399fd49539418b54e24f94016 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 LEADER]: Signalling peer b2005221a1af4e559e0cb1cf28636c84 to start an election
I20260709 12:28:49.911670 19831 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d9f35e5399fd49539418b54e24f94016"
dest_uuid: "b2005221a1af4e559e0cb1cf28636c84"
 from {username='slave'} at 127.0.0.1:60164
I20260709 12:28:49.912554 19831 raft_consensus.cc:493] T d9f35e5399fd49539418b54e24f94016 P b2005221a1af4e559e0cb1cf28636c84 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:49.913524 19831 raft_consensus.cc:3060] T d9f35e5399fd49539418b54e24f94016 P b2005221a1af4e559e0cb1cf28636c84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:49.923801 19831 raft_consensus.cc:515] T d9f35e5399fd49539418b54e24f94016 P b2005221a1af4e559e0cb1cf28636c84 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:49.926952 19831 leader_election.cc:290] T d9f35e5399fd49539418b54e24f94016 P b2005221a1af4e559e0cb1cf28636c84 [CANDIDATE]: Term 2 election: Requested vote from peers 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65:38251), 72b654ed19904db48b0a8e50fe4e12c7 (127.9.116.67:34699)
I20260709 12:28:49.928071 19905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9f35e5399fd49539418b54e24f94016" candidate_uuid: "b2005221a1af4e559e0cb1cf28636c84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "72b654ed19904db48b0a8e50fe4e12c7"
I20260709 12:28:49.928138 19755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9f35e5399fd49539418b54e24f94016" candidate_uuid: "b2005221a1af4e559e0cb1cf28636c84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8dfbf314f9eb4599aa1f64e0098053f2"
I20260709 12:28:49.929211 19905 raft_consensus.cc:3060] T d9f35e5399fd49539418b54e24f94016 P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:49.929349 19755 raft_consensus.cc:3055] T d9f35e5399fd49539418b54e24f94016 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:49.929997 19755 raft_consensus.cc:740] T d9f35e5399fd49539418b54e24f94016 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8dfbf314f9eb4599aa1f64e0098053f2, State: Running, Role: LEADER
I20260709 12:28:49.931671 19755 consensus_queue.cc:260] T d9f35e5399fd49539418b54e24f94016 P 8dfbf314f9eb4599aa1f64e0098053f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:49.933888 19755 raft_consensus.cc:3060] T d9f35e5399fd49539418b54e24f94016 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:49.939177 19905 raft_consensus.cc:2468] T d9f35e5399fd49539418b54e24f94016 P 72b654ed19904db48b0a8e50fe4e12c7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2005221a1af4e559e0cb1cf28636c84 in term 2.
I20260709 12:28:49.940770 19794 leader_election.cc:304] T d9f35e5399fd49539418b54e24f94016 P b2005221a1af4e559e0cb1cf28636c84 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72b654ed19904db48b0a8e50fe4e12c7, b2005221a1af4e559e0cb1cf28636c84; no voters: 
I20260709 12:28:49.941591 19755 raft_consensus.cc:2468] T d9f35e5399fd49539418b54e24f94016 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2005221a1af4e559e0cb1cf28636c84 in term 2.
I20260709 12:28:49.941681 20060 raft_consensus.cc:2804] T d9f35e5399fd49539418b54e24f94016 P b2005221a1af4e559e0cb1cf28636c84 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:49.942485 20060 raft_consensus.cc:697] T d9f35e5399fd49539418b54e24f94016 P b2005221a1af4e559e0cb1cf28636c84 [term 2 LEADER]: Becoming Leader. State: Replica: b2005221a1af4e559e0cb1cf28636c84, State: Running, Role: LEADER
I20260709 12:28:49.943413 20060 consensus_queue.cc:237] T d9f35e5399fd49539418b54e24f94016 P b2005221a1af4e559e0cb1cf28636c84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:49.954385 19652 catalog_manager.cc:5697] T d9f35e5399fd49539418b54e24f94016 P b2005221a1af4e559e0cb1cf28636c84 reported cstate change: term changed from 1 to 2, leader changed from 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65) to b2005221a1af4e559e0cb1cf28636c84 (127.9.116.66). New cstate: current_term: 2 leader_uuid: "b2005221a1af4e559e0cb1cf28636c84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:50.018507 20093 raft_consensus.cc:993] T 5425b69fce0a4b0ab03c4f1849b882e1 P b2005221a1af4e559e0cb1cf28636c84: : Instructing follower 8dfbf314f9eb4599aa1f64e0098053f2 to start an election
I20260709 12:28:50.019083 20060 raft_consensus.cc:1081] T 5425b69fce0a4b0ab03c4f1849b882e1 P b2005221a1af4e559e0cb1cf28636c84 [term 1 LEADER]: Signalling peer 8dfbf314f9eb4599aa1f64e0098053f2 to start an election
I20260709 12:28:50.020938 19755 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5425b69fce0a4b0ab03c4f1849b882e1"
dest_uuid: "8dfbf314f9eb4599aa1f64e0098053f2"
 from {username='slave'} at 127.0.0.1:50324
I20260709 12:28:50.021658 19755 raft_consensus.cc:493] T 5425b69fce0a4b0ab03c4f1849b882e1 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:50.022006 19755 raft_consensus.cc:3060] T 5425b69fce0a4b0ab03c4f1849b882e1 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:50.030288 19755 raft_consensus.cc:515] T 5425b69fce0a4b0ab03c4f1849b882e1 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:50.032260 19755 leader_election.cc:290] T 5425b69fce0a4b0ab03c4f1849b882e1 P 8dfbf314f9eb4599aa1f64e0098053f2 [CANDIDATE]: Term 2 election: Requested vote from peers b2005221a1af4e559e0cb1cf28636c84 (127.9.116.66:42783), 72b654ed19904db48b0a8e50fe4e12c7 (127.9.116.67:34699)
I20260709 12:28:50.033900 19905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5425b69fce0a4b0ab03c4f1849b882e1" candidate_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "72b654ed19904db48b0a8e50fe4e12c7"
I20260709 12:28:50.034430 19905 raft_consensus.cc:3060] T 5425b69fce0a4b0ab03c4f1849b882e1 P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:50.034020 19831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5425b69fce0a4b0ab03c4f1849b882e1" candidate_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b2005221a1af4e559e0cb1cf28636c84"
I20260709 12:28:50.035285 19831 raft_consensus.cc:3055] T 5425b69fce0a4b0ab03c4f1849b882e1 P b2005221a1af4e559e0cb1cf28636c84 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:50.035905 19831 raft_consensus.cc:740] T 5425b69fce0a4b0ab03c4f1849b882e1 P b2005221a1af4e559e0cb1cf28636c84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b2005221a1af4e559e0cb1cf28636c84, State: Running, Role: LEADER
I20260709 12:28:50.036775 19831 consensus_queue.cc:260] T 5425b69fce0a4b0ab03c4f1849b882e1 P b2005221a1af4e559e0cb1cf28636c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:50.038126 19831 raft_consensus.cc:3060] T 5425b69fce0a4b0ab03c4f1849b882e1 P b2005221a1af4e559e0cb1cf28636c84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:50.040628 19905 raft_consensus.cc:2468] T 5425b69fce0a4b0ab03c4f1849b882e1 P 72b654ed19904db48b0a8e50fe4e12c7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dfbf314f9eb4599aa1f64e0098053f2 in term 2.
I20260709 12:28:50.042311 19719 leader_election.cc:304] T 5425b69fce0a4b0ab03c4f1849b882e1 P 8dfbf314f9eb4599aa1f64e0098053f2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72b654ed19904db48b0a8e50fe4e12c7, 8dfbf314f9eb4599aa1f64e0098053f2; no voters: 
I20260709 12:28:50.043097 20071 raft_consensus.cc:2804] T 5425b69fce0a4b0ab03c4f1849b882e1 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:50.043560 20071 raft_consensus.cc:697] T 5425b69fce0a4b0ab03c4f1849b882e1 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 2 LEADER]: Becoming Leader. State: Replica: 8dfbf314f9eb4599aa1f64e0098053f2, State: Running, Role: LEADER
I20260709 12:28:50.044374 20071 consensus_queue.cc:237] T 5425b69fce0a4b0ab03c4f1849b882e1 P 8dfbf314f9eb4599aa1f64e0098053f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:50.047760 19831 raft_consensus.cc:2468] T 5425b69fce0a4b0ab03c4f1849b882e1 P b2005221a1af4e559e0cb1cf28636c84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dfbf314f9eb4599aa1f64e0098053f2 in term 2.
I20260709 12:28:50.052548 19652 catalog_manager.cc:5697] T 5425b69fce0a4b0ab03c4f1849b882e1 P 8dfbf314f9eb4599aa1f64e0098053f2 reported cstate change: term changed from 1 to 2, leader changed from b2005221a1af4e559e0cb1cf28636c84 (127.9.116.66) to 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65). New cstate: current_term: 2 leader_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:50.170576 19905 raft_consensus.cc:1275] T eecd23b305744bcabbef1e2e5cd206ce P 72b654ed19904db48b0a8e50fe4e12c7 [term 2 FOLLOWER]: Refusing update from remote peer 8dfbf314f9eb4599aa1f64e0098053f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:50.172538 20071 consensus_queue.cc:1048] T eecd23b305744bcabbef1e2e5cd206ce P 8dfbf314f9eb4599aa1f64e0098053f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:50.186299 19831 raft_consensus.cc:1275] T eecd23b305744bcabbef1e2e5cd206ce P b2005221a1af4e559e0cb1cf28636c84 [term 2 FOLLOWER]: Refusing update from remote peer 8dfbf314f9eb4599aa1f64e0098053f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:50.188469 20111 consensus_queue.cc:1048] T eecd23b305744bcabbef1e2e5cd206ce P 8dfbf314f9eb4599aa1f64e0098053f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:50.343277 19904 raft_consensus.cc:1275] T f6e468eccc244819925f994f88ded6c3 P 72b654ed19904db48b0a8e50fe4e12c7 [term 2 FOLLOWER]: Refusing update from remote peer 8dfbf314f9eb4599aa1f64e0098053f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:50.345022 20111 consensus_queue.cc:1048] T f6e468eccc244819925f994f88ded6c3 P 8dfbf314f9eb4599aa1f64e0098053f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:50.355186 19831 raft_consensus.cc:1275] T f6e468eccc244819925f994f88ded6c3 P b2005221a1af4e559e0cb1cf28636c84 [term 2 FOLLOWER]: Refusing update from remote peer 8dfbf314f9eb4599aa1f64e0098053f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:50.357044 20071 consensus_queue.cc:1048] T f6e468eccc244819925f994f88ded6c3 P 8dfbf314f9eb4599aa1f64e0098053f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:50.391291 19831 raft_consensus.cc:1275] T 331c202d5bec4f76a11791c0f101dfd5 P b2005221a1af4e559e0cb1cf28636c84 [term 2 FOLLOWER]: Refusing update from remote peer 72b654ed19904db48b0a8e50fe4e12c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:50.393499 20076 consensus_queue.cc:1048] T 331c202d5bec4f76a11791c0f101dfd5 P 72b654ed19904db48b0a8e50fe4e12c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:50.398146 19904 raft_consensus.cc:1275] T 787520b5a0c64085a72e995881511ca5 P 72b654ed19904db48b0a8e50fe4e12c7 [term 2 FOLLOWER]: Refusing update from remote peer b2005221a1af4e559e0cb1cf28636c84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:50.400102 20093 consensus_queue.cc:1048] T 787520b5a0c64085a72e995881511ca5 P b2005221a1af4e559e0cb1cf28636c84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:50.413456 19755 raft_consensus.cc:1275] T 331c202d5bec4f76a11791c0f101dfd5 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 2 FOLLOWER]: Refusing update from remote peer 72b654ed19904db48b0a8e50fe4e12c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:50.416492 20076 consensus_queue.cc:1048] T 331c202d5bec4f76a11791c0f101dfd5 P 72b654ed19904db48b0a8e50fe4e12c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:50.428145 19756 raft_consensus.cc:1275] T 787520b5a0c64085a72e995881511ca5 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 2 FOLLOWER]: Refusing update from remote peer b2005221a1af4e559e0cb1cf28636c84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:50.430621 20098 consensus_queue.cc:1048] T 787520b5a0c64085a72e995881511ca5 P b2005221a1af4e559e0cb1cf28636c84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:50.431362 19831 raft_consensus.cc:1275] T 5425b69fce0a4b0ab03c4f1849b882e1 P b2005221a1af4e559e0cb1cf28636c84 [term 2 FOLLOWER]: Refusing update from remote peer 8dfbf314f9eb4599aa1f64e0098053f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:50.438431 20071 consensus_queue.cc:1048] T 5425b69fce0a4b0ab03c4f1849b882e1 P 8dfbf314f9eb4599aa1f64e0098053f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:28:50.449679 19905 raft_consensus.cc:1275] T 5425b69fce0a4b0ab03c4f1849b882e1 P 72b654ed19904db48b0a8e50fe4e12c7 [term 2 FOLLOWER]: Refusing update from remote peer 8dfbf314f9eb4599aa1f64e0098053f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:50.451464 20112 consensus_queue.cc:1048] T 5425b69fce0a4b0ab03c4f1849b882e1 P 8dfbf314f9eb4599aa1f64e0098053f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:50.522341 19904 raft_consensus.cc:1275] T d9f35e5399fd49539418b54e24f94016 P 72b654ed19904db48b0a8e50fe4e12c7 [term 2 FOLLOWER]: Refusing update from remote peer b2005221a1af4e559e0cb1cf28636c84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:50.524801 20093 consensus_queue.cc:1048] T d9f35e5399fd49539418b54e24f94016 P b2005221a1af4e559e0cb1cf28636c84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:50.542052 19756 raft_consensus.cc:1275] T d9f35e5399fd49539418b54e24f94016 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 2 FOLLOWER]: Refusing update from remote peer b2005221a1af4e559e0cb1cf28636c84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:50.543712 20093 consensus_queue.cc:1048] T d9f35e5399fd49539418b54e24f94016 P b2005221a1af4e559e0cb1cf28636c84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:52.555696 19654 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35492:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:28:52.583097 19654 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:35492:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
W20260709 12:28:52.752188 20175 log.cc:927] Time spent T 65b2b8f9a0944d1a94ae5e90b9656f7c P 8dfbf314f9eb4599aa1f64e0098053f2: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:28:52.759708 20181 tablet.cc:1724] T eecd23b305744bcabbef1e2e5cd206ce P 8dfbf314f9eb4599aa1f64e0098053f2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:52.760427 20185 tablet.cc:1724] T f6e468eccc244819925f994f88ded6c3 P 8dfbf314f9eb4599aa1f64e0098053f2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:28:52.802141 19719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:34699, user_credentials={real_user=slave}} blocked reactor thread for 122932us
I20260709 12:28:52.920933  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:28:52.940698 20165 log.cc:927] Time spent T 5425b69fce0a4b0ab03c4f1849b882e1 P 8dfbf314f9eb4599aa1f64e0098053f2: Append to log took a long time: real 0.127s	user 0.007s	sys 0.006s
I20260709 12:28:52.994658 20195 tablet.cc:1724] T 65b2b8f9a0944d1a94ae5e90b9656f7c P 72b654ed19904db48b0a8e50fe4e12c7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:52.997452 20199 tablet.cc:1724] T d9f35e5399fd49539418b54e24f94016 P 72b654ed19904db48b0a8e50fe4e12c7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:53.018536 20203 tablet.cc:1724] T f8c6d1c957af4a36b0793ce6bcd840fb P 8dfbf314f9eb4599aa1f64e0098053f2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:53.048072 20196 tablet.cc:1724] T 65b2b8f9a0944d1a94ae5e90b9656f7c P b2005221a1af4e559e0cb1cf28636c84: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:53.057376 20200 tablet.cc:1724] T d9f35e5399fd49539418b54e24f94016 P b2005221a1af4e559e0cb1cf28636c84: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:53.119781 19654 catalog_manager.cc:5789] TS 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65:38251) does not have the latest schema for tablet f8c6d1c957af4a36b0793ce6bcd840fb (table soft_deleted_table [id=088957e25c584b7298fd95d3a8b034f4]). Expected version 1 got 0
I20260709 12:28:53.151427 20205 tablet.cc:1724] T eecd23b305744bcabbef1e2e5cd206ce P 72b654ed19904db48b0a8e50fe4e12c7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:53.153661 20207 tablet.cc:1724] T f6e468eccc244819925f994f88ded6c3 P 72b654ed19904db48b0a8e50fe4e12c7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:53.162703 19654 catalog_manager.cc:5789] TS 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65:38251) does not have the latest schema for tablet 5425b69fce0a4b0ab03c4f1849b882e1 (table soft_deleted_table [id=088957e25c584b7298fd95d3a8b034f4]). Expected version 1 got 0
I20260709 12:28:53.168160 20203 tablet.cc:1724] T 5425b69fce0a4b0ab03c4f1849b882e1 P 8dfbf314f9eb4599aa1f64e0098053f2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:28:53.189966 19719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.116.67:34699, user_credentials={real_user=slave}} blocked reactor thread for 45602.7us
I20260709 12:28:53.192554 20185 tablet.cc:1724] T 331c202d5bec4f76a11791c0f101dfd5 P 8dfbf314f9eb4599aa1f64e0098053f2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:53.194260 20211 tablet.cc:1724] T 2af1d81129aa40cfb84440644ae99bc5 P b2005221a1af4e559e0cb1cf28636c84: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:53.180225 20196 tablet.cc:1724] T 787520b5a0c64085a72e995881511ca5 P b2005221a1af4e559e0cb1cf28636c84: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:53.178915 20199 tablet.cc:1724] T f8c6d1c957af4a36b0793ce6bcd840fb P 72b654ed19904db48b0a8e50fe4e12c7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:53.240315 20181 tablet.cc:1724] T 787520b5a0c64085a72e995881511ca5 P 8dfbf314f9eb4599aa1f64e0098053f2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:53.267458 20195 tablet.cc:1724] T 331c202d5bec4f76a11791c0f101dfd5 P 72b654ed19904db48b0a8e50fe4e12c7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:53.282475 20207 tablet.cc:1724] T 2af1d81129aa40cfb84440644ae99bc5 P 72b654ed19904db48b0a8e50fe4e12c7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:53.283948 20216 tablet.cc:1724] T 331c202d5bec4f76a11791c0f101dfd5 P b2005221a1af4e559e0cb1cf28636c84: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:53.286098 20185 tablet.cc:1724] T 65b2b8f9a0944d1a94ae5e90b9656f7c P 8dfbf314f9eb4599aa1f64e0098053f2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:53.286573 20211 tablet.cc:1724] T f8c6d1c957af4a36b0793ce6bcd840fb P b2005221a1af4e559e0cb1cf28636c84: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:53.298570 20200 tablet.cc:1724] T f6e468eccc244819925f994f88ded6c3 P b2005221a1af4e559e0cb1cf28636c84: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:53.316692 20196 tablet.cc:1724] T eecd23b305744bcabbef1e2e5cd206ce P b2005221a1af4e559e0cb1cf28636c84: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:53.317836 20181 tablet.cc:1724] T 2af1d81129aa40cfb84440644ae99bc5 P 8dfbf314f9eb4599aa1f64e0098053f2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:53.318545 19831 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f3c299838c041199cb1ebb8978304f9"
dest_uuid: "b2005221a1af4e559e0cb1cf28636c84"
mode: GRACEFUL
new_leader_uuid: "72b654ed19904db48b0a8e50fe4e12c7"
 from {username='slave'} at 127.0.0.1:48316
I20260709 12:28:53.326570 19831 raft_consensus.cc:606] T 0f3c299838c041199cb1ebb8978304f9 P b2005221a1af4e559e0cb1cf28636c84 [term 2 LEADER]: Received request to transfer leadership to TS 72b654ed19904db48b0a8e50fe4e12c7
I20260709 12:28:53.333910 20195 tablet.cc:1724] T 787520b5a0c64085a72e995881511ca5 P 72b654ed19904db48b0a8e50fe4e12c7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:53.335795 20203 tablet.cc:1724] T d9f35e5399fd49539418b54e24f94016 P 8dfbf314f9eb4599aa1f64e0098053f2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:53.345490 20216 tablet.cc:1724] T 5425b69fce0a4b0ab03c4f1849b882e1 P b2005221a1af4e559e0cb1cf28636c84: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:53.347229 20207 tablet.cc:1724] T 5425b69fce0a4b0ab03c4f1849b882e1 P 72b654ed19904db48b0a8e50fe4e12c7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:53.388677 19753 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d17b409914c4c139fb5a5e4fbcbd54a"
dest_uuid: "8dfbf314f9eb4599aa1f64e0098053f2"
mode: GRACEFUL
new_leader_uuid: "72b654ed19904db48b0a8e50fe4e12c7"
 from {username='slave'} at 127.0.0.1:58290
I20260709 12:28:53.389715 19753 raft_consensus.cc:606] T 8d17b409914c4c139fb5a5e4fbcbd54a P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 LEADER]: Received request to transfer leadership to TS 72b654ed19904db48b0a8e50fe4e12c7
I20260709 12:28:53.391722  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:28:53.392581  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:53.398778 19652 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 2e4c90d2566f4ef1a0bc47afa0ffa47a: soft_deleted_table [id=088957e25c584b7298fd95d3a8b034f4] alter complete (version 1)
I20260709 12:28:53.490978 20209 raft_consensus.cc:993] T 0f3c299838c041199cb1ebb8978304f9 P b2005221a1af4e559e0cb1cf28636c84: : Instructing follower 72b654ed19904db48b0a8e50fe4e12c7 to start an election
I20260709 12:28:53.491645 20209 raft_consensus.cc:1081] T 0f3c299838c041199cb1ebb8978304f9 P b2005221a1af4e559e0cb1cf28636c84 [term 2 LEADER]: Signalling peer 72b654ed19904db48b0a8e50fe4e12c7 to start an election
I20260709 12:28:53.493848 19902 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0f3c299838c041199cb1ebb8978304f9"
dest_uuid: "72b654ed19904db48b0a8e50fe4e12c7"
 from {username='slave'} at 127.0.0.1:52726
I20260709 12:28:53.494381 19902 raft_consensus.cc:493] T 0f3c299838c041199cb1ebb8978304f9 P 72b654ed19904db48b0a8e50fe4e12c7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:53.494743 19902 raft_consensus.cc:3060] T 0f3c299838c041199cb1ebb8978304f9 P 72b654ed19904db48b0a8e50fe4e12c7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:53.500982 19902 raft_consensus.cc:515] T 0f3c299838c041199cb1ebb8978304f9 P 72b654ed19904db48b0a8e50fe4e12c7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:53.502825 19902 leader_election.cc:290] T 0f3c299838c041199cb1ebb8978304f9 P 72b654ed19904db48b0a8e50fe4e12c7 [CANDIDATE]: Term 3 election: Requested vote from peers 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65:38251), b2005221a1af4e559e0cb1cf28636c84 (127.9.116.66:42783)
I20260709 12:28:53.504299 19753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3c299838c041199cb1ebb8978304f9" candidate_uuid: "72b654ed19904db48b0a8e50fe4e12c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8dfbf314f9eb4599aa1f64e0098053f2"
I20260709 12:28:53.504649 19831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3c299838c041199cb1ebb8978304f9" candidate_uuid: "72b654ed19904db48b0a8e50fe4e12c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b2005221a1af4e559e0cb1cf28636c84"
I20260709 12:28:53.505427 19753 raft_consensus.cc:3060] T 0f3c299838c041199cb1ebb8978304f9 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:53.505667 19831 raft_consensus.cc:3055] T 0f3c299838c041199cb1ebb8978304f9 P b2005221a1af4e559e0cb1cf28636c84 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:53.506080 19831 raft_consensus.cc:740] T 0f3c299838c041199cb1ebb8978304f9 P b2005221a1af4e559e0cb1cf28636c84 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b2005221a1af4e559e0cb1cf28636c84, State: Running, Role: LEADER
I20260709 12:28:53.506875 19831 consensus_queue.cc:260] T 0f3c299838c041199cb1ebb8978304f9 P b2005221a1af4e559e0cb1cf28636c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:53.508351 19831 raft_consensus.cc:3060] T 0f3c299838c041199cb1ebb8978304f9 P b2005221a1af4e559e0cb1cf28636c84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:53.512742 19753 raft_consensus.cc:2468] T 0f3c299838c041199cb1ebb8978304f9 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72b654ed19904db48b0a8e50fe4e12c7 in term 3.
I20260709 12:28:53.514438 19870 leader_election.cc:304] T 0f3c299838c041199cb1ebb8978304f9 P 72b654ed19904db48b0a8e50fe4e12c7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72b654ed19904db48b0a8e50fe4e12c7, 8dfbf314f9eb4599aa1f64e0098053f2; no voters: 
I20260709 12:28:53.514473 19831 raft_consensus.cc:2468] T 0f3c299838c041199cb1ebb8978304f9 P b2005221a1af4e559e0cb1cf28636c84 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72b654ed19904db48b0a8e50fe4e12c7 in term 3.
I20260709 12:28:53.515588 20140 raft_consensus.cc:2804] T 0f3c299838c041199cb1ebb8978304f9 P 72b654ed19904db48b0a8e50fe4e12c7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:53.516129 20140 raft_consensus.cc:697] T 0f3c299838c041199cb1ebb8978304f9 P 72b654ed19904db48b0a8e50fe4e12c7 [term 3 LEADER]: Becoming Leader. State: Replica: 72b654ed19904db48b0a8e50fe4e12c7, State: Running, Role: LEADER
I20260709 12:28:53.517392 20140 consensus_queue.cc:237] T 0f3c299838c041199cb1ebb8978304f9 P 72b654ed19904db48b0a8e50fe4e12c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:53.525808 19653 catalog_manager.cc:5697] T 0f3c299838c041199cb1ebb8978304f9 P 72b654ed19904db48b0a8e50fe4e12c7 reported cstate change: term changed from 2 to 3, leader changed from b2005221a1af4e559e0cb1cf28636c84 (127.9.116.66) to 72b654ed19904db48b0a8e50fe4e12c7 (127.9.116.67). New cstate: current_term: 3 leader_uuid: "72b654ed19904db48b0a8e50fe4e12c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:53.800345 20145 raft_consensus.cc:993] T 8d17b409914c4c139fb5a5e4fbcbd54a P 8dfbf314f9eb4599aa1f64e0098053f2: : Instructing follower 72b654ed19904db48b0a8e50fe4e12c7 to start an election
I20260709 12:28:53.800922 20145 raft_consensus.cc:1081] T 8d17b409914c4c139fb5a5e4fbcbd54a P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 LEADER]: Signalling peer 72b654ed19904db48b0a8e50fe4e12c7 to start an election
I20260709 12:28:53.802835 19902 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8d17b409914c4c139fb5a5e4fbcbd54a"
dest_uuid: "72b654ed19904db48b0a8e50fe4e12c7"
 from {username='slave'} at 127.0.0.1:52714
I20260709 12:28:53.803370 19902 raft_consensus.cc:493] T 8d17b409914c4c139fb5a5e4fbcbd54a P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:53.803711 19902 raft_consensus.cc:3060] T 8d17b409914c4c139fb5a5e4fbcbd54a P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:53.810863 19902 raft_consensus.cc:515] T 8d17b409914c4c139fb5a5e4fbcbd54a P 72b654ed19904db48b0a8e50fe4e12c7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:53.812932 19902 leader_election.cc:290] T 8d17b409914c4c139fb5a5e4fbcbd54a P 72b654ed19904db48b0a8e50fe4e12c7 [CANDIDATE]: Term 2 election: Requested vote from peers 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65:38251), b2005221a1af4e559e0cb1cf28636c84 (127.9.116.66:42783)
I20260709 12:28:53.813736 19753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d17b409914c4c139fb5a5e4fbcbd54a" candidate_uuid: "72b654ed19904db48b0a8e50fe4e12c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8dfbf314f9eb4599aa1f64e0098053f2"
I20260709 12:28:53.814257 19831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d17b409914c4c139fb5a5e4fbcbd54a" candidate_uuid: "72b654ed19904db48b0a8e50fe4e12c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b2005221a1af4e559e0cb1cf28636c84"
I20260709 12:28:53.814529 19753 raft_consensus.cc:3055] T 8d17b409914c4c139fb5a5e4fbcbd54a P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:53.814911 19831 raft_consensus.cc:3060] T 8d17b409914c4c139fb5a5e4fbcbd54a P b2005221a1af4e559e0cb1cf28636c84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:53.815022 19753 raft_consensus.cc:740] T 8d17b409914c4c139fb5a5e4fbcbd54a P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8dfbf314f9eb4599aa1f64e0098053f2, State: Running, Role: LEADER
I20260709 12:28:53.816041 19753 consensus_queue.cc:260] T 8d17b409914c4c139fb5a5e4fbcbd54a P 8dfbf314f9eb4599aa1f64e0098053f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:53.817569 19753 raft_consensus.cc:3060] T 8d17b409914c4c139fb5a5e4fbcbd54a P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:53.822656 19831 raft_consensus.cc:2468] T 8d17b409914c4c139fb5a5e4fbcbd54a P b2005221a1af4e559e0cb1cf28636c84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72b654ed19904db48b0a8e50fe4e12c7 in term 2.
I20260709 12:28:53.824504 19869 leader_election.cc:304] T 8d17b409914c4c139fb5a5e4fbcbd54a P 72b654ed19904db48b0a8e50fe4e12c7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72b654ed19904db48b0a8e50fe4e12c7, b2005221a1af4e559e0cb1cf28636c84; no voters: 
I20260709 12:28:53.824803 19753 raft_consensus.cc:2468] T 8d17b409914c4c139fb5a5e4fbcbd54a P 8dfbf314f9eb4599aa1f64e0098053f2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72b654ed19904db48b0a8e50fe4e12c7 in term 2.
I20260709 12:28:53.825482 20140 raft_consensus.cc:2804] T 8d17b409914c4c139fb5a5e4fbcbd54a P 72b654ed19904db48b0a8e50fe4e12c7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:53.825991 20140 raft_consensus.cc:697] T 8d17b409914c4c139fb5a5e4fbcbd54a P 72b654ed19904db48b0a8e50fe4e12c7 [term 2 LEADER]: Becoming Leader. State: Replica: 72b654ed19904db48b0a8e50fe4e12c7, State: Running, Role: LEADER
I20260709 12:28:53.826993 20140 consensus_queue.cc:237] T 8d17b409914c4c139fb5a5e4fbcbd54a P 72b654ed19904db48b0a8e50fe4e12c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } }
I20260709 12:28:53.836558 19653 catalog_manager.cc:5697] T 8d17b409914c4c139fb5a5e4fbcbd54a P 72b654ed19904db48b0a8e50fe4e12c7 reported cstate change: term changed from 1 to 2, leader changed from 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65) to 72b654ed19904db48b0a8e50fe4e12c7 (127.9.116.67). New cstate: current_term: 2 leader_uuid: "72b654ed19904db48b0a8e50fe4e12c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72b654ed19904db48b0a8e50fe4e12c7" member_type: VOTER last_known_addr { host: "127.9.116.67" port: 34699 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:54.011440 19831 raft_consensus.cc:1275] T 0f3c299838c041199cb1ebb8978304f9 P b2005221a1af4e559e0cb1cf28636c84 [term 3 FOLLOWER]: Refusing update from remote peer 72b654ed19904db48b0a8e50fe4e12c7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:54.013270 20140 consensus_queue.cc:1048] T 0f3c299838c041199cb1ebb8978304f9 P 72b654ed19904db48b0a8e50fe4e12c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:54.024371 19753 raft_consensus.cc:1275] T 0f3c299838c041199cb1ebb8978304f9 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 3 FOLLOWER]: Refusing update from remote peer 72b654ed19904db48b0a8e50fe4e12c7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:54.026897 20228 consensus_queue.cc:1048] T 0f3c299838c041199cb1ebb8978304f9 P 72b654ed19904db48b0a8e50fe4e12c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:28:54.214396 19753 raft_consensus.cc:1275] T 8d17b409914c4c139fb5a5e4fbcbd54a P 8dfbf314f9eb4599aa1f64e0098053f2 [term 2 FOLLOWER]: Refusing update from remote peer 72b654ed19904db48b0a8e50fe4e12c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:54.216022 20228 consensus_queue.cc:1048] T 8d17b409914c4c139fb5a5e4fbcbd54a P 72b654ed19904db48b0a8e50fe4e12c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dfbf314f9eb4599aa1f64e0098053f2" member_type: VOTER last_known_addr { host: "127.9.116.65" port: 38251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:54.226409 19831 raft_consensus.cc:1275] T 8d17b409914c4c139fb5a5e4fbcbd54a P b2005221a1af4e559e0cb1cf28636c84 [term 2 FOLLOWER]: Refusing update from remote peer 72b654ed19904db48b0a8e50fe4e12c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:54.228173 20140 consensus_queue.cc:1048] T 8d17b409914c4c139fb5a5e4fbcbd54a P 72b654ed19904db48b0a8e50fe4e12c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2005221a1af4e559e0cb1cf28636c84" member_type: VOTER last_known_addr { host: "127.9.116.66" port: 42783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:54.394207  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:54.401770  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:28:54.402333  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:55.403563  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:55.410706  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:28:55.411171  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:56.412204  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:56.418165  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:28:56.418654  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:57.420051  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:57.426357  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:28:57.426913  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:58.428011  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:58.432936  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:28:58.433427  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:59.434682  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:59.440441  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:28:59.440865  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:00.442261  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:00.448262  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:29:00.449190  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:01.450301  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:01.455524  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:29:01.456161  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:02.457499  9681 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:02.463708  9681 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:29:02.464294  9681 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:03.551959  9681 tablet_server.cc:179] TabletServer@127.9.116.65:0 shutting down...
I20260709 12:29:03.615468  9681 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:29:03.616698  9681 tablet_replica.cc:333] T f8c6d1c957af4a36b0793ce6bcd840fb P 8dfbf314f9eb4599aa1f64e0098053f2: stopping tablet replica
I20260709 12:29:03.617763  9681 raft_consensus.cc:2243] T f8c6d1c957af4a36b0793ce6bcd840fb P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:03.618985  9681 raft_consensus.cc:2272] T f8c6d1c957af4a36b0793ce6bcd840fb P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:03.622044  9681 tablet_replica.cc:333] T 331c202d5bec4f76a11791c0f101dfd5 P 8dfbf314f9eb4599aa1f64e0098053f2: stopping tablet replica
I20260709 12:29:03.622884  9681 raft_consensus.cc:2243] T 331c202d5bec4f76a11791c0f101dfd5 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:03.623627  9681 raft_consensus.cc:2272] T 331c202d5bec4f76a11791c0f101dfd5 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:03.627373  9681 tablet_replica.cc:333] T f6e468eccc244819925f994f88ded6c3 P 8dfbf314f9eb4599aa1f64e0098053f2: stopping tablet replica
I20260709 12:29:03.628235  9681 raft_consensus.cc:2243] T f6e468eccc244819925f994f88ded6c3 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 2 LEADER]: Raft consensus shutting down.
W20260709 12:29:03.629186 19795 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 13 similar messages]
I20260709 12:29:03.629485  9681 raft_consensus.cc:2272] T f6e468eccc244819925f994f88ded6c3 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:03.633230 19795 consensus_peers.cc:597] T 3aeae4fb47e646d09bdeb06f2d3ee837 P b2005221a1af4e559e0cb1cf28636c84 -> Peer 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65:38251): Couldn't send request to peer 8dfbf314f9eb4599aa1f64e0098053f2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:03.633832  9681 tablet_replica.cc:333] T 2af1d81129aa40cfb84440644ae99bc5 P 8dfbf314f9eb4599aa1f64e0098053f2: stopping tablet replica
I20260709 12:29:03.634829  9681 raft_consensus.cc:2243] T 2af1d81129aa40cfb84440644ae99bc5 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:03.635950  9681 raft_consensus.cc:2272] T 2af1d81129aa40cfb84440644ae99bc5 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:03.640461  9681 tablet_replica.cc:333] T d9f35e5399fd49539418b54e24f94016 P 8dfbf314f9eb4599aa1f64e0098053f2: stopping tablet replica
I20260709 12:29:03.641685  9681 raft_consensus.cc:2243] T d9f35e5399fd49539418b54e24f94016 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:03.642400  9681 raft_consensus.cc:2272] T d9f35e5399fd49539418b54e24f94016 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:03.646448  9681 tablet_replica.cc:333] T 0f3c299838c041199cb1ebb8978304f9 P 8dfbf314f9eb4599aa1f64e0098053f2: stopping tablet replica
I20260709 12:29:03.647917  9681 raft_consensus.cc:2243] T 0f3c299838c041199cb1ebb8978304f9 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:03.649108  9681 raft_consensus.cc:2272] T 0f3c299838c041199cb1ebb8978304f9 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:03.653036  9681 tablet_replica.cc:333] T 5425b69fce0a4b0ab03c4f1849b882e1 P 8dfbf314f9eb4599aa1f64e0098053f2: stopping tablet replica
I20260709 12:29:03.653687  9681 raft_consensus.cc:2243] T 5425b69fce0a4b0ab03c4f1849b882e1 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:03.654695  9681 raft_consensus.cc:2272] T 5425b69fce0a4b0ab03c4f1849b882e1 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:03.657552  9681 tablet_replica.cc:333] T 65b2b8f9a0944d1a94ae5e90b9656f7c P 8dfbf314f9eb4599aa1f64e0098053f2: stopping tablet replica
I20260709 12:29:03.658171  9681 raft_consensus.cc:2243] T 65b2b8f9a0944d1a94ae5e90b9656f7c P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:03.658766  9681 raft_consensus.cc:2272] T 65b2b8f9a0944d1a94ae5e90b9656f7c P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:03.661494  9681 tablet_replica.cc:333] T 3aeae4fb47e646d09bdeb06f2d3ee837 P 8dfbf314f9eb4599aa1f64e0098053f2: stopping tablet replica
I20260709 12:29:03.662088  9681 raft_consensus.cc:2243] T 3aeae4fb47e646d09bdeb06f2d3ee837 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:03.662547  9681 raft_consensus.cc:2272] T 3aeae4fb47e646d09bdeb06f2d3ee837 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:03.665069  9681 tablet_replica.cc:333] T 3545d7ed467b44c3b9be7f1c8d642c6c P 8dfbf314f9eb4599aa1f64e0098053f2: stopping tablet replica
I20260709 12:29:03.665782  9681 raft_consensus.cc:2243] T 3545d7ed467b44c3b9be7f1c8d642c6c P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:03.666791  9681 raft_consensus.cc:2272] T 3545d7ed467b44c3b9be7f1c8d642c6c P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:03.669495  9681 tablet_replica.cc:333] T eecd23b305744bcabbef1e2e5cd206ce P 8dfbf314f9eb4599aa1f64e0098053f2: stopping tablet replica
I20260709 12:29:03.670133  9681 raft_consensus.cc:2243] T eecd23b305744bcabbef1e2e5cd206ce P 8dfbf314f9eb4599aa1f64e0098053f2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:03.671093  9681 raft_consensus.cc:2272] T eecd23b305744bcabbef1e2e5cd206ce P 8dfbf314f9eb4599aa1f64e0098053f2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:03.673751  9681 tablet_replica.cc:333] T 7ae5eb89de7c49b5a4e4813747c2764a P 8dfbf314f9eb4599aa1f64e0098053f2: stopping tablet replica
I20260709 12:29:03.674499  9681 raft_consensus.cc:2243] T 7ae5eb89de7c49b5a4e4813747c2764a P 8dfbf314f9eb4599aa1f64e0098053f2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:03.675506  9681 raft_consensus.cc:2272] T 7ae5eb89de7c49b5a4e4813747c2764a P 8dfbf314f9eb4599aa1f64e0098053f2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:03.678253  9681 tablet_replica.cc:333] T 22affa70596649658254e443bccdb7e2 P 8dfbf314f9eb4599aa1f64e0098053f2: stopping tablet replica
I20260709 12:29:03.678856  9681 raft_consensus.cc:2243] T 22affa70596649658254e443bccdb7e2 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:03.680076  9681 raft_consensus.cc:2272] T 22affa70596649658254e443bccdb7e2 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:03.684544  9681 tablet_replica.cc:333] T a47b4bf847674ea286f15a089566d812 P 8dfbf314f9eb4599aa1f64e0098053f2: stopping tablet replica
I20260709 12:29:03.685626  9681 raft_consensus.cc:2243] T a47b4bf847674ea286f15a089566d812 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:03.686399  9681 raft_consensus.cc:2272] T a47b4bf847674ea286f15a089566d812 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:03.687878 19795 consensus_peers.cc:597] T 787520b5a0c64085a72e995881511ca5 P b2005221a1af4e559e0cb1cf28636c84 -> Peer 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65:38251): Couldn't send request to peer 8dfbf314f9eb4599aa1f64e0098053f2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:03.689922  9681 tablet_replica.cc:333] T ed4996cfc4a0429fae414b2c8e341c0d P 8dfbf314f9eb4599aa1f64e0098053f2: stopping tablet replica
I20260709 12:29:03.690579  9681 raft_consensus.cc:2243] T ed4996cfc4a0429fae414b2c8e341c0d P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:03.691166  9681 raft_consensus.cc:2272] T ed4996cfc4a0429fae414b2c8e341c0d P 8dfbf314f9eb4599aa1f64e0098053f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:03.693893  9681 tablet_replica.cc:333] T 66f3ed0a695841ce959ef857c4741496 P 8dfbf314f9eb4599aa1f64e0098053f2: stopping tablet replica
I20260709 12:29:03.694420  9681 raft_consensus.cc:2243] T 66f3ed0a695841ce959ef857c4741496 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:03.695068  9681 raft_consensus.cc:2272] T 66f3ed0a695841ce959ef857c4741496 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:03.698653  9681 tablet_replica.cc:333] T 787520b5a0c64085a72e995881511ca5 P 8dfbf314f9eb4599aa1f64e0098053f2: stopping tablet replica
I20260709 12:29:03.699512  9681 raft_consensus.cc:2243] T 787520b5a0c64085a72e995881511ca5 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:03.700353  9681 raft_consensus.cc:2272] T 787520b5a0c64085a72e995881511ca5 P 8dfbf314f9eb4599aa1f64e0098053f2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:03.704488  9681 tablet_replica.cc:333] T 8d17b409914c4c139fb5a5e4fbcbd54a P 8dfbf314f9eb4599aa1f64e0098053f2: stopping tablet replica
I20260709 12:29:03.705566  9681 raft_consensus.cc:2243] T 8d17b409914c4c139fb5a5e4fbcbd54a P 8dfbf314f9eb4599aa1f64e0098053f2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:03.706404  9681 raft_consensus.cc:2272] T 8d17b409914c4c139fb5a5e4fbcbd54a P 8dfbf314f9eb4599aa1f64e0098053f2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:03.756829  9681 tablet_server.cc:196] TabletServer@127.9.116.65:0 shutdown complete.
W20260709 12:29:03.772217 19795 consensus_peers.cc:597] T 2af1d81129aa40cfb84440644ae99bc5 P b2005221a1af4e559e0cb1cf28636c84 -> Peer 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65:38251): Couldn't send request to peer 8dfbf314f9eb4599aa1f64e0098053f2. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:38251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:03.809688 19795 consensus_peers.cc:597] T 65b2b8f9a0944d1a94ae5e90b9656f7c P b2005221a1af4e559e0cb1cf28636c84 -> Peer 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65:38251): Couldn't send request to peer 8dfbf314f9eb4599aa1f64e0098053f2. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:38251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:03.827946  9681 tablet_server.cc:179] TabletServer@127.9.116.66:0 shutting down...
W20260709 12:29:03.854033 19869 consensus_peers.cc:597] T a47b4bf847674ea286f15a089566d812 P 72b654ed19904db48b0a8e50fe4e12c7 -> Peer b2005221a1af4e559e0cb1cf28636c84 (127.9.116.66:42783): Couldn't send request to peer b2005221a1af4e559e0cb1cf28636c84. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:03.855085 19869 consensus_peers.cc:597] T 331c202d5bec4f76a11791c0f101dfd5 P 72b654ed19904db48b0a8e50fe4e12c7 -> Peer b2005221a1af4e559e0cb1cf28636c84 (127.9.116.66:42783): Couldn't send request to peer b2005221a1af4e559e0cb1cf28636c84. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:03.863705 19870 consensus_peers.cc:597] T 331c202d5bec4f76a11791c0f101dfd5 P 72b654ed19904db48b0a8e50fe4e12c7 -> Peer 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65:38251): Couldn't send request to peer 8dfbf314f9eb4599aa1f64e0098053f2. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:38251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:03.876233  9681 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:29:03.877220  9681 tablet_replica.cc:333] T f8c6d1c957af4a36b0793ce6bcd840fb P b2005221a1af4e559e0cb1cf28636c84: stopping tablet replica
I20260709 12:29:03.878382  9681 raft_consensus.cc:2243] T f8c6d1c957af4a36b0793ce6bcd840fb P b2005221a1af4e559e0cb1cf28636c84 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:03.879209  9681 raft_consensus.cc:2272] T f8c6d1c957af4a36b0793ce6bcd840fb P b2005221a1af4e559e0cb1cf28636c84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:03.882913  9681 tablet_replica.cc:333] T 331c202d5bec4f76a11791c0f101dfd5 P b2005221a1af4e559e0cb1cf28636c84: stopping tablet replica
I20260709 12:29:03.883651  9681 raft_consensus.cc:2243] T 331c202d5bec4f76a11791c0f101dfd5 P b2005221a1af4e559e0cb1cf28636c84 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:03.884279  9681 raft_consensus.cc:2272] T 331c202d5bec4f76a11791c0f101dfd5 P b2005221a1af4e559e0cb1cf28636c84 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:03.887042  9681 tablet_replica.cc:333] T f6e468eccc244819925f994f88ded6c3 P b2005221a1af4e559e0cb1cf28636c84: stopping tablet replica
I20260709 12:29:03.887791  9681 raft_consensus.cc:2243] T f6e468eccc244819925f994f88ded6c3 P b2005221a1af4e559e0cb1cf28636c84 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:03.888356  9681 raft_consensus.cc:2272] T f6e468eccc244819925f994f88ded6c3 P b2005221a1af4e559e0cb1cf28636c84 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:03.891563  9681 tablet_replica.cc:333] T d9f35e5399fd49539418b54e24f94016 P b2005221a1af4e559e0cb1cf28636c84: stopping tablet replica
I20260709 12:29:03.892488  9681 raft_consensus.cc:2243] T d9f35e5399fd49539418b54e24f94016 P b2005221a1af4e559e0cb1cf28636c84 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:03.893625  9681 raft_consensus.cc:2272] T d9f35e5399fd49539418b54e24f94016 P b2005221a1af4e559e0cb1cf28636c84 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:03.897238  9681 tablet_replica.cc:333] T 2af1d81129aa40cfb84440644ae99bc5 P b2005221a1af4e559e0cb1cf28636c84: stopping tablet replica
I20260709 12:29:03.897953  9681 raft_consensus.cc:2243] T 2af1d81129aa40cfb84440644ae99bc5 P b2005221a1af4e559e0cb1cf28636c84 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:03.898916  9681 raft_consensus.cc:2272] T 2af1d81129aa40cfb84440644ae99bc5 P b2005221a1af4e559e0cb1cf28636c84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:03.901484  9681 tablet_replica.cc:333] T 7ae5eb89de7c49b5a4e4813747c2764a P b2005221a1af4e559e0cb1cf28636c84: stopping tablet replica
I20260709 12:29:03.902405  9681 raft_consensus.cc:2243] T 7ae5eb89de7c49b5a4e4813747c2764a P b2005221a1af4e559e0cb1cf28636c84 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:03.903164  9681 raft_consensus.cc:2272] T 7ae5eb89de7c49b5a4e4813747c2764a P b2005221a1af4e559e0cb1cf28636c84 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:03.908032  9681 tablet_replica.cc:333] T eecd23b305744bcabbef1e2e5cd206ce P b2005221a1af4e559e0cb1cf28636c84: stopping tablet replica
W20260709 12:29:03.908946 19795 consensus_peers.cc:597] T ed4996cfc4a0429fae414b2c8e341c0d P b2005221a1af4e559e0cb1cf28636c84 -> Peer 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65:38251): Couldn't send request to peer 8dfbf314f9eb4599aa1f64e0098053f2. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:38251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:03.909037  9681 raft_consensus.cc:2243] T eecd23b305744bcabbef1e2e5cd206ce P b2005221a1af4e559e0cb1cf28636c84 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:03.909936  9681 raft_consensus.cc:2272] T eecd23b305744bcabbef1e2e5cd206ce P b2005221a1af4e559e0cb1cf28636c84 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:03.912667  9681 tablet_replica.cc:333] T 65b2b8f9a0944d1a94ae5e90b9656f7c P b2005221a1af4e559e0cb1cf28636c84: stopping tablet replica
I20260709 12:29:03.913300  9681 raft_consensus.cc:2243] T 65b2b8f9a0944d1a94ae5e90b9656f7c P b2005221a1af4e559e0cb1cf28636c84 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:03.914214  9681 raft_consensus.cc:2272] T 65b2b8f9a0944d1a94ae5e90b9656f7c P b2005221a1af4e559e0cb1cf28636c84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:03.916666  9681 tablet_replica.cc:333] T a47b4bf847674ea286f15a089566d812 P b2005221a1af4e559e0cb1cf28636c84: stopping tablet replica
I20260709 12:29:03.917951  9681 raft_consensus.cc:2243] T a47b4bf847674ea286f15a089566d812 P b2005221a1af4e559e0cb1cf28636c84 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:03.918606  9681 raft_consensus.cc:2272] T a47b4bf847674ea286f15a089566d812 P b2005221a1af4e559e0cb1cf28636c84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:03.922019  9681 tablet_replica.cc:333] T 66f3ed0a695841ce959ef857c4741496 P b2005221a1af4e559e0cb1cf28636c84: stopping tablet replica
I20260709 12:29:03.923044  9681 raft_consensus.cc:2243] T 66f3ed0a695841ce959ef857c4741496 P b2005221a1af4e559e0cb1cf28636c84 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:03.924677  9681 raft_consensus.cc:2272] T 66f3ed0a695841ce959ef857c4741496 P b2005221a1af4e559e0cb1cf28636c84 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:03.928314  9681 tablet_replica.cc:333] T ed4996cfc4a0429fae414b2c8e341c0d P b2005221a1af4e559e0cb1cf28636c84: stopping tablet replica
I20260709 12:29:03.928941  9681 raft_consensus.cc:2243] T ed4996cfc4a0429fae414b2c8e341c0d P b2005221a1af4e559e0cb1cf28636c84 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:03.930097  9681 raft_consensus.cc:2272] T ed4996cfc4a0429fae414b2c8e341c0d P b2005221a1af4e559e0cb1cf28636c84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:03.932797  9681 tablet_replica.cc:333] T 787520b5a0c64085a72e995881511ca5 P b2005221a1af4e559e0cb1cf28636c84: stopping tablet replica
I20260709 12:29:03.933359  9681 raft_consensus.cc:2243] T 787520b5a0c64085a72e995881511ca5 P b2005221a1af4e559e0cb1cf28636c84 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:03.934446  9681 raft_consensus.cc:2272] T 787520b5a0c64085a72e995881511ca5 P b2005221a1af4e559e0cb1cf28636c84 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:03.938220  9681 tablet_replica.cc:333] T 8d17b409914c4c139fb5a5e4fbcbd54a P b2005221a1af4e559e0cb1cf28636c84: stopping tablet replica
W20260709 12:29:03.939538 19870 consensus_peers.cc:597] T a47b4bf847674ea286f15a089566d812 P 72b654ed19904db48b0a8e50fe4e12c7 -> Peer 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65:38251): Couldn't send request to peer 8dfbf314f9eb4599aa1f64e0098053f2. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:38251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:03.939462  9681 raft_consensus.cc:2243] T 8d17b409914c4c139fb5a5e4fbcbd54a P b2005221a1af4e559e0cb1cf28636c84 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:03.941156  9681 raft_consensus.cc:2272] T 8d17b409914c4c139fb5a5e4fbcbd54a P b2005221a1af4e559e0cb1cf28636c84 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:03.944183  9681 tablet_replica.cc:333] T 5425b69fce0a4b0ab03c4f1849b882e1 P b2005221a1af4e559e0cb1cf28636c84: stopping tablet replica
I20260709 12:29:03.944861  9681 raft_consensus.cc:2243] T 5425b69fce0a4b0ab03c4f1849b882e1 P b2005221a1af4e559e0cb1cf28636c84 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:03.945477  9681 raft_consensus.cc:2272] T 5425b69fce0a4b0ab03c4f1849b882e1 P b2005221a1af4e559e0cb1cf28636c84 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:03.948550  9681 tablet_replica.cc:333] T 0f3c299838c041199cb1ebb8978304f9 P b2005221a1af4e559e0cb1cf28636c84: stopping tablet replica
I20260709 12:29:03.949158  9681 raft_consensus.cc:2243] T 0f3c299838c041199cb1ebb8978304f9 P b2005221a1af4e559e0cb1cf28636c84 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:03.949743  9681 raft_consensus.cc:2272] T 0f3c299838c041199cb1ebb8978304f9 P b2005221a1af4e559e0cb1cf28636c84 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:03.952256  9681 tablet_replica.cc:333] T 3545d7ed467b44c3b9be7f1c8d642c6c P b2005221a1af4e559e0cb1cf28636c84: stopping tablet replica
I20260709 12:29:03.952805  9681 raft_consensus.cc:2243] T 3545d7ed467b44c3b9be7f1c8d642c6c P b2005221a1af4e559e0cb1cf28636c84 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:03.953312  9681 raft_consensus.cc:2272] T 3545d7ed467b44c3b9be7f1c8d642c6c P b2005221a1af4e559e0cb1cf28636c84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:03.955814  9681 tablet_replica.cc:333] T 22affa70596649658254e443bccdb7e2 P b2005221a1af4e559e0cb1cf28636c84: stopping tablet replica
I20260709 12:29:03.956420  9681 raft_consensus.cc:2243] T 22affa70596649658254e443bccdb7e2 P b2005221a1af4e559e0cb1cf28636c84 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:03.957137  9681 raft_consensus.cc:2272] T 22affa70596649658254e443bccdb7e2 P b2005221a1af4e559e0cb1cf28636c84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:03.960186  9681 tablet_replica.cc:333] T 3aeae4fb47e646d09bdeb06f2d3ee837 P b2005221a1af4e559e0cb1cf28636c84: stopping tablet replica
I20260709 12:29:03.960832  9681 raft_consensus.cc:2243] T 3aeae4fb47e646d09bdeb06f2d3ee837 P b2005221a1af4e559e0cb1cf28636c84 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:03.962018  9681 raft_consensus.cc:2272] T 3aeae4fb47e646d09bdeb06f2d3ee837 P b2005221a1af4e559e0cb1cf28636c84 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:03.979548 19870 consensus_peers.cc:597] T 8d17b409914c4c139fb5a5e4fbcbd54a P 72b654ed19904db48b0a8e50fe4e12c7 -> Peer 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65:38251): Couldn't send request to peer 8dfbf314f9eb4599aa1f64e0098053f2. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:38251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:04.012313  9681 tablet_server.cc:196] TabletServer@127.9.116.66:0 shutdown complete.
I20260709 12:29:04.060256  9681 tablet_server.cc:179] TabletServer@127.9.116.67:0 shutting down...
W20260709 12:29:04.098897 19870 consensus_peers.cc:597] T 0f3c299838c041199cb1ebb8978304f9 P 72b654ed19904db48b0a8e50fe4e12c7 -> Peer 8dfbf314f9eb4599aa1f64e0098053f2 (127.9.116.65:38251): Couldn't send request to peer 8dfbf314f9eb4599aa1f64e0098053f2. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.65:38251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:04.107120  9681 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:29:04.108194  9681 tablet_replica.cc:333] T 65b2b8f9a0944d1a94ae5e90b9656f7c P 72b654ed19904db48b0a8e50fe4e12c7: stopping tablet replica
I20260709 12:29:04.108979  9681 raft_consensus.cc:2243] T 65b2b8f9a0944d1a94ae5e90b9656f7c P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:04.109722  9681 raft_consensus.cc:2272] T 65b2b8f9a0944d1a94ae5e90b9656f7c P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:04.112733  9681 tablet_replica.cc:333] T f8c6d1c957af4a36b0793ce6bcd840fb P 72b654ed19904db48b0a8e50fe4e12c7: stopping tablet replica
I20260709 12:29:04.113513  9681 raft_consensus.cc:2243] T f8c6d1c957af4a36b0793ce6bcd840fb P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:04.114082  9681 raft_consensus.cc:2272] T f8c6d1c957af4a36b0793ce6bcd840fb P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:04.116385  9681 tablet_replica.cc:333] T 2af1d81129aa40cfb84440644ae99bc5 P 72b654ed19904db48b0a8e50fe4e12c7: stopping tablet replica
I20260709 12:29:04.117004  9681 raft_consensus.cc:2243] T 2af1d81129aa40cfb84440644ae99bc5 P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:04.117561  9681 raft_consensus.cc:2272] T 2af1d81129aa40cfb84440644ae99bc5 P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:04.120133  9681 tablet_replica.cc:333] T d9f35e5399fd49539418b54e24f94016 P 72b654ed19904db48b0a8e50fe4e12c7: stopping tablet replica
I20260709 12:29:04.120757  9681 raft_consensus.cc:2243] T d9f35e5399fd49539418b54e24f94016 P 72b654ed19904db48b0a8e50fe4e12c7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:04.121282  9681 raft_consensus.cc:2272] T d9f35e5399fd49539418b54e24f94016 P 72b654ed19904db48b0a8e50fe4e12c7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:04.123682  9681 tablet_replica.cc:333] T 7ae5eb89de7c49b5a4e4813747c2764a P 72b654ed19904db48b0a8e50fe4e12c7: stopping tablet replica
I20260709 12:29:04.124467  9681 raft_consensus.cc:2243] T 7ae5eb89de7c49b5a4e4813747c2764a P 72b654ed19904db48b0a8e50fe4e12c7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:04.125072  9681 raft_consensus.cc:2272] T 7ae5eb89de7c49b5a4e4813747c2764a P 72b654ed19904db48b0a8e50fe4e12c7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:04.127429  9681 tablet_replica.cc:333] T eecd23b305744bcabbef1e2e5cd206ce P 72b654ed19904db48b0a8e50fe4e12c7: stopping tablet replica
I20260709 12:29:04.128122  9681 raft_consensus.cc:2243] T eecd23b305744bcabbef1e2e5cd206ce P 72b654ed19904db48b0a8e50fe4e12c7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:04.128697  9681 raft_consensus.cc:2272] T eecd23b305744bcabbef1e2e5cd206ce P 72b654ed19904db48b0a8e50fe4e12c7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:04.130861  9681 tablet_replica.cc:333] T 331c202d5bec4f76a11791c0f101dfd5 P 72b654ed19904db48b0a8e50fe4e12c7: stopping tablet replica
I20260709 12:29:04.131418  9681 raft_consensus.cc:2243] T 331c202d5bec4f76a11791c0f101dfd5 P 72b654ed19904db48b0a8e50fe4e12c7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:04.132396  9681 raft_consensus.cc:2272] T 331c202d5bec4f76a11791c0f101dfd5 P 72b654ed19904db48b0a8e50fe4e12c7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:04.135177  9681 tablet_replica.cc:333] T f6e468eccc244819925f994f88ded6c3 P 72b654ed19904db48b0a8e50fe4e12c7: stopping tablet replica
I20260709 12:29:04.136209  9681 raft_consensus.cc:2243] T f6e468eccc244819925f994f88ded6c3 P 72b654ed19904db48b0a8e50fe4e12c7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:04.137116  9681 raft_consensus.cc:2272] T f6e468eccc244819925f994f88ded6c3 P 72b654ed19904db48b0a8e50fe4e12c7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:04.140909  9681 tablet_replica.cc:333] T 3aeae4fb47e646d09bdeb06f2d3ee837 P 72b654ed19904db48b0a8e50fe4e12c7: stopping tablet replica
W20260709 12:29:04.141536 19869 consensus_peers.cc:597] T 8d17b409914c4c139fb5a5e4fbcbd54a P 72b654ed19904db48b0a8e50fe4e12c7 -> Peer b2005221a1af4e559e0cb1cf28636c84 (127.9.116.66:42783): Couldn't send request to peer b2005221a1af4e559e0cb1cf28636c84. Status: Network error: Client connection negotiation failed: client connection to 127.9.116.66:42783: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:04.141788  9681 raft_consensus.cc:2243] T 3aeae4fb47e646d09bdeb06f2d3ee837 P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:04.142477  9681 raft_consensus.cc:2272] T 3aeae4fb47e646d09bdeb06f2d3ee837 P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:04.145175  9681 tablet_replica.cc:333] T 787520b5a0c64085a72e995881511ca5 P 72b654ed19904db48b0a8e50fe4e12c7: stopping tablet replica
I20260709 12:29:04.145772  9681 raft_consensus.cc:2243] T 787520b5a0c64085a72e995881511ca5 P 72b654ed19904db48b0a8e50fe4e12c7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:04.146311  9681 raft_consensus.cc:2272] T 787520b5a0c64085a72e995881511ca5 P 72b654ed19904db48b0a8e50fe4e12c7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:04.148784  9681 tablet_replica.cc:333] T 8d17b409914c4c139fb5a5e4fbcbd54a P 72b654ed19904db48b0a8e50fe4e12c7: stopping tablet replica
I20260709 12:29:04.149348  9681 raft_consensus.cc:2243] T 8d17b409914c4c139fb5a5e4fbcbd54a P 72b654ed19904db48b0a8e50fe4e12c7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:04.150422  9681 raft_consensus.cc:2272] T 8d17b409914c4c139fb5a5e4fbcbd54a P 72b654ed19904db48b0a8e50fe4e12c7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:04.152908  9681 tablet_replica.cc:333] T ed4996cfc4a0429fae414b2c8e341c0d P 72b654ed19904db48b0a8e50fe4e12c7: stopping tablet replica
I20260709 12:29:04.153462  9681 raft_consensus.cc:2243] T ed4996cfc4a0429fae414b2c8e341c0d P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:04.153888  9681 raft_consensus.cc:2272] T ed4996cfc4a0429fae414b2c8e341c0d P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:04.156217  9681 tablet_replica.cc:333] T 66f3ed0a695841ce959ef857c4741496 P 72b654ed19904db48b0a8e50fe4e12c7: stopping tablet replica
I20260709 12:29:04.156759  9681 raft_consensus.cc:2243] T 66f3ed0a695841ce959ef857c4741496 P 72b654ed19904db48b0a8e50fe4e12c7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:04.157192  9681 raft_consensus.cc:2272] T 66f3ed0a695841ce959ef857c4741496 P 72b654ed19904db48b0a8e50fe4e12c7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:04.159405  9681 tablet_replica.cc:333] T 22affa70596649658254e443bccdb7e2 P 72b654ed19904db48b0a8e50fe4e12c7: stopping tablet replica
I20260709 12:29:04.160027  9681 raft_consensus.cc:2243] T 22affa70596649658254e443bccdb7e2 P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:04.160495  9681 raft_consensus.cc:2272] T 22affa70596649658254e443bccdb7e2 P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:04.162739  9681 tablet_replica.cc:333] T 3545d7ed467b44c3b9be7f1c8d642c6c P 72b654ed19904db48b0a8e50fe4e12c7: stopping tablet replica
I20260709 12:29:04.163427  9681 raft_consensus.cc:2243] T 3545d7ed467b44c3b9be7f1c8d642c6c P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:04.164438  9681 raft_consensus.cc:2272] T 3545d7ed467b44c3b9be7f1c8d642c6c P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:04.167642  9681 tablet_replica.cc:333] T 5425b69fce0a4b0ab03c4f1849b882e1 P 72b654ed19904db48b0a8e50fe4e12c7: stopping tablet replica
I20260709 12:29:04.168466  9681 raft_consensus.cc:2243] T 5425b69fce0a4b0ab03c4f1849b882e1 P 72b654ed19904db48b0a8e50fe4e12c7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:04.169222  9681 raft_consensus.cc:2272] T 5425b69fce0a4b0ab03c4f1849b882e1 P 72b654ed19904db48b0a8e50fe4e12c7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:04.172164  9681 tablet_replica.cc:333] T 0f3c299838c041199cb1ebb8978304f9 P 72b654ed19904db48b0a8e50fe4e12c7: stopping tablet replica
I20260709 12:29:04.172859  9681 raft_consensus.cc:2243] T 0f3c299838c041199cb1ebb8978304f9 P 72b654ed19904db48b0a8e50fe4e12c7 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:29:04.173836  9681 raft_consensus.cc:2272] T 0f3c299838c041199cb1ebb8978304f9 P 72b654ed19904db48b0a8e50fe4e12c7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:04.177095  9681 tablet_replica.cc:333] T a47b4bf847674ea286f15a089566d812 P 72b654ed19904db48b0a8e50fe4e12c7: stopping tablet replica
I20260709 12:29:04.178380  9681 raft_consensus.cc:2243] T a47b4bf847674ea286f15a089566d812 P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:04.179548  9681 raft_consensus.cc:2272] T a47b4bf847674ea286f15a089566d812 P 72b654ed19904db48b0a8e50fe4e12c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:04.245739  9681 tablet_server.cc:196] TabletServer@127.9.116.67:0 shutdown complete.
I20260709 12:29:04.292366  9681 master.cc:562] Master@127.9.116.126:36317 shutting down...
I20260709 12:29:04.324182  9681 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 2e4c90d2566f4ef1a0bc47afa0ffa47a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:04.324949  9681 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 2e4c90d2566f4ef1a0bc47afa0ffa47a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:04.325313  9681 tablet_replica.cc:333] T 00000000000000000000000000000000 P 2e4c90d2566f4ef1a0bc47afa0ffa47a: stopping tablet replica
I20260709 12:29:04.351353  9681 master.cc:584] Master@127.9.116.126:36317 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (22349 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (43967 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (362243 ms total)
[  PASSED  ] 7 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] LeaderRebalancerTest.AddTserver

 1 FAILED TEST
I20260709 12:29:04.424154  9681 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 2251 messages since previous log ~33 seconds ago
I20260709 12:29:04.424580  9681 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 2251 messages since previous log ~33 seconds ago
I20260709 12:29:04.424873  9681 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 2247 messages since previous log ~33 seconds ago
I20260709 12:29:04.425220  9681 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~53 seconds ago
I20260709 12:29:04.425762  9681 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~53 seconds ago
I20260709 12:29:04.426137  9681 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 11 messages since previous log ~0 seconds ago
I20260709 12:29:04.426427  9681 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 53 messages since previous log ~21 seconds ago
